Stellaris gets a DLC about AI that features AI-created voices, director insists it's 'ethical' and 'we're pretty good at exploring dystopian sci-fi and don't want to end up there ourselves'

simple@lemm.ee to Games@lemmy.world – 199 points –
Stellaris gets a DLC about AI that features AI-created voices, director insists it's 'ethical' and 'we're pretty good at exploring dystopian sci-fi and don't want to end up there ourselves'
pcgamer.com
86

While everyone here is screeching about jerbs, I would like to point out that using AI voices to voice an AI is an artistic genius in itself.

Yeah it's real luddite hours here

"How will voicebot 2.0 pay for his child's oil now?"

Are you an idiot?

People are worried about the actual voice actors who voice act the characters.

Do you think GLaDOS was voiced by a potato battery?

The Luddites ruled actually:

The Luddites were members of a 19th-century movement of English textile workers who opposed the use of certain types of cost-saving machinery, and often destroyed the machines in clandestine raids. They protested against manufacturers who used machines in "a fraudulent and deceitful manner" to replace the skilled labour of workers and drive down wages by producing inferior goods.

https://en.m.wikipedia.org/wiki/Luddite

It's very similar to protesting the use of AI to make an obviously inferior product, but apparently you think it's an insult.

I’m sick of the Luddite slander. They were completely right and people need to know

They were idiots trying to maintain a poverty based system simply because they weren't on the very lowest rung. They were also proven very wrong, demand for textiles increased dramatically as prices fell and areas where there had been nothing but privation flourished into affluent communities with longer lifespans, better wages and improved living conditions for everyone even the lowest classes - this resulted in improvements literacy amoung the poor and resulted in the erosion of the class system as the early industrial era matured.

If the luddities had won we'd all be far worse off now.

You are conflating technology and its benefits with the owning class's misuse of that technology. Capitalist apologists love to do this because otherwise the crimes of capitalism would have to stand on their own and there would be no defending them.

It's exactly this conflation that lets people claim that the luddites were entirely anti-technology, but they weren't. Again this is a lie that has been spread by capitalists to defend their own image.

The luddites were killed and suppressed by the military and the government made industrial sabotage a capital offense, and then slandered them. Maybe if they'd won we'd live in a world where reporters weren't murdered over the Panama papers for instance.

So your argument is that their stated aims were a lie and speeches claimed to be from notable figures in the movement were fabricated after the fact? Further that their violent actions should have been overlooked and if they had been there would be no corruption in the world today?

Surely you can see how that argument is about as credible as flat earth?

I don't understand why people think they can just rewrite history to suit their needs.

What speeches? What stated aims? You need to make claims if you want me to address them.

You want me to give you a history lesson? Funny that when you wanted people to believe an inversion of the history everyone knows you didn't see any need for sources but now you expect me to meticulously demonstrate every word? and yes we all know it'll never be enough...

It doesn't matter though because you're not serious about what you're saying and literally no one would belive your nonsense.

E: You can scroll down to the dividing line if you want to read the history and not my condescending screed about your ignorance. I suspect you won't read much of this so I'm putting this note here at the top to let you know that if you don't read the whole comment then you'll probably sound like a fool in your reply. I mean that's already true but like... even moreso. If you don't like the way I'm talking to you, you can refer yourself to the way you just talked to me.

Okay, so I think you've fucked up here. I think that because you seem to think I'm asking you for a demonstration, ie, for sources. But if you actually read my comment carefully you would know that I asked you for a claim. This was me politely asking you to simply say what you mean instead of hiding behind insinuations and vague hand-waving.

And the reason this is a fuck-up is because anyone who actually knew how to understand and source literature on a topic like this would have immediately known the distinction between making a claim, and demonstrating a claim. I have made quite clear claims but not yet demonstrated them. You have not made a single claim that could even be demonstrated, you have just assumed that everybody already agrees with your version to the point that it does not even need to be stated.

I also know it's a fuck-up because I have heard this fact as a rebuttal of a common misconception several times from a number of trustworthy sources, and before I repeated it I quickly checked to make sure I had it right, and it does appear to be the consensus of historians; I found no evidence of a credible debate on this; nobody is replying to some other side on this; it is uncontroversial.

I said the same thing four different ways there because you do seem to have some trouble following what is being said.

I am now going to go beyond what I originally asked you for and give you some real information, and then after that, if you still feel like it would be a good idea, you can reply. I suspect you won't want to though, because if you had the information to hand you wouldn't have protested so hard against me asking for even the most basic stating of your position. You also might have read something and learned that you were wrong, but let's not expect the moon. I suspect you went so hard because you realised you had nothing and you hoped I would be cowed by your obvious confidence, but I wasn't. I was in fact somewhat invigorated by it.


If you had looked up just the first source in the wikipedia article that I linked you, titled "What the Luddites Really Fought Against" and published in the history section of the Smithsonian Magazine, you'd have found these quotes:

The label now has many meanings, but when the group protested 200 years ago, technology wasn’t really the enemy

The word “Luddite,” handed down from a British industrial protest that began 200 years ago this month, turns up in our daily language in ways that suggest we’re confused not just about technology, but also about who the original Luddites were and what being a modern one actually means.

Despite their modern reputation, the original Luddites were neither opposed to technology nor inept at using it. Many were highly skilled machine operators in the textile industry. Nor was the technology they attacked particularly new. Moreover, the idea of smashing machines as a form of industrial protest did not begin or end with them. In truth, the secret of their enduring reputation depends less on what they did than on the name under which they did it. You could say they were good at branding.

As the Industrial Revolution began, workers naturally worried about being displaced by increasingly efficient machines. But the Luddites themselves “were totally fine with machines,” says Kevin Binfield, editor of the 2004 collection Writings of the Luddites. They confined their attacks to manufacturers who used machines in what they called “a fraudulent and deceitful manner” to get around standard labor practices. “They just wanted machines that made high-quality goods,” says Binfield, “and they wanted these machines to be run by workers who had gone through an apprenticeship and got paid decent wages. Those were their only concerns.”

Also because I can see your fingers racing to the keyboard about this: the first article on wikipedia is not the only thing I have read on this, I am simply using it because it is a good overview and starting point, and because it clearly shows just how easy it would have been for you to learn literally a single thing about this topic, but you chose virulent ignorance instead. I have in fact gone beyond wikipedia by giving you an actual source, and you aren't even there yet. By failing to even state your position, you have refused to enter the arena of discussing facts.

Now, I did mention the Panama papers, and that was a nod to the way that the rich employ violence against their detractors, and perhaps that was a stretch, but I could make the argument to someone interested. I doubt you are.

The problems the Luddites were protesting are more closely related to the modern problem of Fast Fashion, in which vast quantities of extremely poor quality transient clothing is produced and destroyed every single year. It is an economic, ecological and social disaster that ironically employs many many people in the most brutal shop conditions. The "cheap" clothing you championed as the cause of the "flourishing" is exactly the problem that the Luddites feared, and it has not been good for the planet or for people. The horrendous work conditions of the industrial revolution also led to clothing factories where children were employed to crawl under operating machines and were frequently minced by them. This is the kind of barbaric treatment of human beings that the Luddites were against and that the ruling class had them killed to maintain. This sort of thing still happens today, but in far away countries with poor populations that you don't see. Capitalism hasn't resulted in plenty, it has resulted in abject poverty for the vast majority of the world's population so that a small minority can live in luxurious comfort. I assume you don't think that's real capitalism or something, but you'd be wrong about that too.

The term Luddite did not come to have its modern meaning until the 1950's, at which point anyone who had ever known a Luddite was long dead and they were not able to protest the slander, but popular perception is often given by the ruling class, so we get people like you who apparently go off the vibes of the word you're familiar with and confuse that for actual knowledge.

The technology was created to replace voice actors. That's the actual purpose. Its very existence hurts their profession and benefits studios. You can not be a studio, use this technology, and claim to care about ethics, anymore than Amazon can claim to care about the workers as it invests in the machines to replace them.

No one is holding a gun to their head forcing them to us AI. They made a choice. There is no "ethical" way to cripple the livelihood of working class people for the benefit of your business. Just stop using the word.

It doesn't matter if you compensate or get their approval, because the fact is the existence of the technology in the industry effectively compels all voice actors to agree to let it use their voice, or they can't get work. It becomes a false choice.

If there was no financial benefit, if it truly made no difference in how much a studio pays in labor or the amount the artists make, there would be no reason for studios to want to use it.

Do you have any source for those claims? There are plenty of better reasons to develop voice synthesis than replacing voice actors.

Voiced characters that use generative AI in real time instead of prerecorded lines and a dialogue tree come to mind as an obvious use. How cool would that be, to be playing an RPG and ask any character any question you want and get an actual verbal answer? No way you can do that with voice actors.

Ever seen the game Vaudeville? It's a fairly basic detective game but all the characters have their own LLM and AI voices. I bought it for the reason you described. I just had to see the technology in action and I can definitely see a future with generative text/voices in games.

It's not perfect by any means but I think it's a very cool approach to a detective game. There have been updates to it since I played that address most of the problems I had with it like characters forgetting past conversations and giving conflicting info.

I had spitballed an idea similar to this a few months back. Build the characters, world, and situations, and give the AI that information. Pick a few specific pieces of info the AI would have to tell you at specific times, basically to act as guide rails. Then, let the AI and the player just... Interact.

That's pretty much Vaudeville. The only things you can do is click on locations and talk to people, each of whom has some bit of information you need to figure out.

It's basically an experiment to see what works and what doesn't with the idea. I appreciate that they kept the scope small (no quests, no WASD movement) and have been implementing changes as they discover the shortfalls (like the ones I've mentioned). If it ever does get released as a finished game, it'll be more like a proof of concept for other games to build off of.

I find it to be very off putting that Baldur’s Gate 3 doesn’t have voice actors for the main character.

There are so many different races that would have different voices and different accents that it wouldn’t be financially viable to do that with voice actors either.

They originally did for the beta (for origin characters at least) but the players didn't really like it so the feature was removed

The only real ethical concern is around the training data. If all voices are compensated / actively consent to be used in an AI program, then this is just a tool. People losing jobs doesn't really matter to an individual company. Industries change and technology advances.

So the real problem is they are using these types of tools, built of the skill of other voice actors, without properly compensating them or getting their consent.

What's the point of bringing up "ethics?" The job only existed in the first place because of technology, and now people want to argue that there is a right or wrong aspect to it?

How about the poor candle makers or buggy whip manufacturers? Should we keep downgrading society just to keep a few "artists" happy?

The term Luddite comes to mind.

Luddites were not anti-technology. They saw the progress of technology IN a primitive capitalist system and understood that technology would never benefit them, and always be used to subjugate them more.

If technology only benefits 0.1% of the world, and leads to the world dying, does it benefit humanity at all?

The concern is that the training and potentially production voices are not properly compensated or consenting

It's not so much that a new tool is used, it's that it exists due to the artistic product of people who aren't profiting from the novel use

A job coming or going isn't the true issue

Downgrading because we want people to stay employed?

Then let's go back to ploughing our fields by hand, surely that will create many new employment opportunities!

More importantly, the system we all accept (willingly or not) requires that people be employed to survive.

It's not a matter of wanting to be employed, as needing to be employed.

I have an idea for the practice that could help us better explore practical uses. Basically, a company may train an AI off an actor’s voice, but that actor retains full non-transferable ownership/control of any voices generated from that AI.

So, if a game is premiering a new game mode that needs 15 new lines from a character, but their actor is busy drinking Captain Morgan in their pool, the company can generate those 15 lines from AI, but MUST have a communication with the actor where they approve the lines, and agree on a price for them.

It would allow for dynamic voice moments in a small capacity, and keep actors in business. It would still need some degree of regulation to ensure no one pushes gross incentives.

Congratulations you essentially described what Stellaris devs did.

claim to care about the workers as it invests in the machines to replace them.

A company that invests in UBI could make that claim!

Obviously Amazon doesn't do that now. But I could see it happening when people stop being able to buy their junk

Good to see you have formed a strong opinion without having all of the information.

22 more...

I get that record sessions are a huge hassle and simply paying VAs per AI-generated voice line is easier for everyone, but it somehow makes Paradox look a little careless to me.

Stories like these also set a precident. This is what voice 'acting' will be like for a moment before it becomes effectively eliminated because voice libraries will become diverse enough quickly and there will be no need for a single more voice actor to be included. It seems like VAs are basically forced to sell their voice to AI companies quickly to at least make a quick buck before they never get a job again.

There's probably no stopping it, but that made this read all the more frustrating to me.

This is what (modern) voice acting has always been.

Actually read a few interviews with professional VAs or watch their streams if they do that. Two VAs actually interacting with each other and reacting is almost unheard of outside of very specific productions (and mostly are done as a stunt for some BTS footage). They read a dozen different takes of every line and go through like five different scripts worth of dialogue. And then they do "efforts" that are just general grunts and emoting that are used for the moment to moment gameplay and to pad out a scene that had heavy rewrites. It is why so many professional VAs can stream "their" games... because they genuinely have no idea what is going to happen.

Paying to train a limited use model off of a specific VA (or even a group of VAs) is the "logical" extension of that. And, arguably, it is a "good" one (with some MASSIVE caveats). Everyone lost their god damned mind over that FPS that came out last year where the announcer was (allegedly?) a model trained off of a VA. But it also meant that you could have stuff you would never have had otherwise. Nolan North isn't going to get a paycheck to sit in a booth all day commenting on random matches. But a model that can read out a team's name and string together different reactions? That is actually really cool and WAY better than the traditional sports game approach of "The Champion! just went through... A Table!"*

Like almost everything AI? The key is to focus on creators' rights and control what can and can't be used as training data. Because the genie is out of the bottle and ain't going back in. But if we can protect the rights of what goes into training data? Then people are still paid for their effort/creation.

Do I think this was done "ethically"? I don't know. But with everything Paradox has done in the past few years? I assume "not in the slightest". But the concept is sound and one that we need to standardize sooner than later.

Of course, we also need UBI so that people's lives aren't tied to their jobs but that is a bigger mess.

*: Also, if you don't think those aren't already stitched and blended together with most of the same tech then I have a bridge to sell you


I'll also add on that there are very good reasons to pay for models based on VAs. Brendan Fraser infamously permanently-ish hurt his vocal cords because of the performance that were expected of him in his prime. Same with a lot of VAs (I think David Hayter is one?) who basically need to smoke a pack a day when they are "in character" to get the right gravely voice. And while Stephanie Beatriz played it smart and made sure her "Rosa" voice was something she could maintain, a lot of actors and actresses basically can't be the character they are famous for because it is killing them.


And pulling a solution out of my ass that is surely missing important aspects of the industry?

if I just want Nolan North or Felicia Day to voice a character then I buy the use of their model from their agency and am charged based on how much dialogue they have in a given game. If I want to use them as a character going forward (so what ANet tried with Felicia before they realized she was too expensive and decided to give Zojja permanent brain damage so she wouldn't ever have dialogue again)? I can pay by line at a much cheaper rate.

But if I want Nolan North to do a voice that isn't just Drake? Then I am paying him to train a new model and it gets a lot more expensive. And I can pay more to "own" that training data with the same caveats regarding future use. The main idea being that I want to make sure my Nolan North performance doesn't end up in a competitor's game next week.

I love how upset people get about things like this

Your coffee is made by enslaved children and people shrug

Your clothes were made in a sweatshop and people shrug

Your music is owned by corporate monsters who impose absurd copyright to steal culture from those that live in it and people shrug

A theoretical voice actor misses out on a small role and you go wild calling for boycotts and making unhinged tweets at the company?

Very weird priorities.

Almost like it's totally unserious and nothing but self Important performative nonsense.

I feel like "The world sucks" is a poor argument for making it worse.

Almost like it's totally unserious and nothing but self Important performative nonsense.

This should be the new tagline for social media

It was crazy how swiftly media moved to present tons of reasons to hate AI.

It really made me realize how the people with this strongest opinions have been given those opinions by media that they don't even realize is a form of media.

we're pretty good at exploring dystopian sci-fi and don't want to end up there ourselves

I always think its the other way around. Some author writes a scary possibility about some topic that scared them but they don't know a lot about. So like a book about a massive bedron impactor creates mini black holes that eats everything it touches. Book becomes popular and in ten years the LHC has some breakthrough but the zeitgeist was already established and people find all the reasons the cool ass tech is really going to be he worst thing ever.

I'm not really up-to-date on voice synthesis. Have we reached the point where we can get enough training data from just a handful of voice actors to train a model of this quality?

Or is this a case of them using those voice actors for fine-tuning a pretrained model and just being quiet about that?

Yeah, if Mozilla's goal is 1200 clips/day and 2400 validations/day then I have a strong suspicion that Stellaris uses a pretrained model and there are no royalties for the people whose voices were used for the pretraining. Not that it would be feasible to spread royalties among that many people in the first place.

What could point against that suspicion though is that Stellaris doesn't need a "perfect" model so maybe they can get away with much, much less. After all the whole gimmick is that it is in-universe AI. A (near-)flawless model would be (near-)indistinguishable from a regular voice actor. Then there would've been no need to hire a bunch of voice actors to train an AI in the first place.

Assuming that it is pretrained -> finetued though, the only hope is that those initial files were donated willingly and not scraped somewhere. Otherwise their "ethical" argument goes out the window.

They claimed they specifically used an ethical model with a license where they pay the person whos voice was trained on.

Still waiting for them to fix their game and not produce even more DLCs

what is broken in stellaris

From my experience, nothing. I’m not sure what the guy is complaining about.

  • They changed the keybindings without giving you the ability to edit keybindings yourself
  • The performance is bad
  • The game speed is linked to framerate and the longer your run is, the slower your game runs
  • The former point results in players in multiplayer getting kicked because of synchronization issues
  • Many minor bugs such as science ships getting trapped at one planet because they cant ever finish surveying them
  • DLCs being absolutely overpriced sometimes
  • Mechanics being absolutely unbalanced

I bought the game on release and played the game for over 700 hours since and I had to witness many patches that introduced so many bugs

Not saying you’re wrong but it’s funny that you’re disparaging a game that you’ve played for 700 hours.

I love the game and at times I couldn't stop playing. The more it got patched the more issues I had with it and I haven't played in a while. Still waiting for Falling Frontier to be released :)

that's the type of player you want an analysis from, right?

I've played 1,300 hours of Destiny 2. I basically wrote my graduate thesis on how it uses psychological tactics to exploit its playerbase and how contemporary business models in gaming are harmful to consumers. Anyways, I gotta grind out my red borders before TFS drops.

1 more...
1 more...
1 more...

Have any of the involved voice actors confirmed the claims made in the article? I've seen multiple articles on this game, and the only quotes are from the game's director.

So far I've only seen one side claim this is ethical. That's not enough.