Spotify is going to clone podcasters’ voices — and translate them to other languages

stopthatgirl7@kbin.social to Technology@lemmy.world – 485 points –
Spotify is going to clone podcasters’ voices — and translate them to other languages
theverge.com

A partnership with OpenAI will let podcasters replicate their voices to automatically create foreign-language versions of their shows.

116

You are viewing a single comment

The problem with this is the same problem news websites has when they started switching out their foreign language writers with AI.

Just because you can translate what is literally being said word by word, doesn't mean you're translating the intent of what was being said.

Idioms, phrases, jokes, pleasantries, etc. won't translate into foreign languages no matter how well you can translate the literal words being said.

If you want good quality translation, you should get someone who knows the language and the culture to do it, as they can translate what's between the lines.

Shows with the budget/intent to create good quality translations will have them reviewed/refined by humans before they put it back in the voice of the host, I don't see why they couldn't do that.

Shows without the budget or that just don't care will use full-auto and I'm sure it will indeed suck.

I honestly think this a non-issue with the new llms coming out. Gpt 4 definitely understands idioms.

Hardest part with be getting the tone down and adding proper emotion to it.

Honestly, I agree. Machine translation isn't by necessity limited to "literal" translations anymore.

There's probably a strong English bias to that currently, but other languages will come with time

I'm with the person in this thread that pointed out that, with this, instead of translators handling an impossible amount of work, now they can edit the output to match correctly and get more done.

Fighting the tech will fail, as history has shown. Integrating it in a healthy, useful way is what is needed.

1 more...