‘Cyberpunk 2077’ Used AI For A Dead Voice Actor’s Performance, With Permission

stopthatgirl7@kbin.social to Technology@lemmy.world – 328 points –
‘Cyberpunk 2077’ Used AI For A Dead Voice Actor’s Performance, With Permission
forbes.com

There are uses of AI that are proving to be more than black and white. While voice actors, have protested their performances being fed into AI against their will, we are now seeing an example of this being done, with permission, in a very unique case.

78

You are viewing a single comment

I was just thinking earlier today, games could probably use AI to seamlessly work the player's name into dialog. They would still hire voice actors, but insert whatever name the player chooses into the lines where it is mentioned. I feel like this isn't too far away.

World of Warcraft would benefit from this. Local processing power is quite up to the task these days, and it’s jarring to see your name on the screen but the audio says “champion” or something similar.

Maybe in 11.0…

Star field does this and it caught me complete off guard became I had used my real name.

Fallout 4 did as well, but it worked with a list of names that Codsworth could say. I'm assuming Starfield does something similar? Or is it a ton of NPCs that use the name?

Idk I didn't pick a name, I just entered my name for my character. Then I was playing and Vasco just said my name. I literally stopped in my tracks and was like "what did you just say?"

To be fair, Vasco is a robot with a robotic / computer generated sounding voice. It's still cool, but it wouldn't take modern AI / neural network based processing to do that, any old text to speech engine could reproduce Vasco's voice.

I thought they actually just recorded a ton of names for Fallout 4? I seem to recall hearing that they did something like 900+ different name recordings.

They did the same thing. Probably using the same list with additions. Both games have a robot be the only character who says your name. I suppose that makes it less unbelievable if you notice the splices where they add your name to an otherwise unaltered line.

That's what I meant :) I just assumed they did the same thing for Starfield

I like the idea a lot. I can think of two problems that need to be solved for this:

  1. How do you pronounce the player’s name correctly?
  2. How do you prohibit abuse?
  1. Have them type it a second time phonetically, and let them test it
  2. If single-player? Don't. If multiplayer? Yeah... that'd be a nightmare lmao

Multiplayer doesn't make a difference, at least not noticeably, as all those shenanigans can already be done by text. You'll get reported and named "player345133" whether you misspell e.g. a forbidden slur or use a misspelling to get the slur's pronunciation.

But it's harder to detect spoken slang when people make it talk in mixed accents and more, you would have to run a talk to text engine too many different times with different filters and parameters against many different languages' lists of slang words with multiple recognizable pronunciations.

And then somebody names themselves ChatGPT and the French will laugh because that sounds like "cat farted" in their language

I recently had this in a game. Just couldn't say which one sadly.. I was really suprised it said my (character's) name. Damn...which game was it?

Starfield does this to some degree: https://www.rockpapershotgun.com/starfield-names-list

It does it if you have an anglo-sounding name, which is the problem with brute forcing this.

Generative AI would be a fun solution, but it currently seems like it'd trigger a lot of controversy, sadly.

I use a piece of software called crew chief for sim racing, and it has what seems like infinite names for all different languages and regions.

I don't use that, but from what I see it seems to have a drop-down for name selection, just like any other instance of this. Certainly not "infinite names". A quick Google even shows a forum thread in their official forums to request specific names to be added.

So good for them on crowdsourcing the name list, I suppose, but for games that have a set release instead of being an ongoing, live database service the lists tend to be very limited and more often than not anglocentric. Even in sports games like NBA or FIFA where they just let you pick any existing name in the commentary database.

I look forward to the expansion from this, even. Real dialogue between the players and the game. Writers and designers set parameters for each character, backstory, motives, personality, current goals, etc. And then instead of a simple 4-5 choices of pre-canned dialog, with pre-canned responses, the player can type (or even say) whatever they want, and the game can return a customized response appropriate for the character.