No one’s ready for this: Our basic assumptions about photos capturing reality are about to go up in smoke.

jeffw@lemmy.world to Technology@lemmy.world – 415 points –
No one’s ready for this
theverge.com
156

You are viewing a single comment

While this is good thing, not being able to tell what is real and what is not would be disaster. What if every comment here but you were generated by some really advanced ai? What they can do now will be laughable compared to what they can do many years from now. And at that point it will be too late to demand anything to be done about it.

Ai generated content should have somekind of tag or mark that is inherently tied to it that can be used to identify it as ai generated, even if only part is used. No idea how that would work though if its even possible.

You already can't. You can't close Pandora's box.

Adding labels just creates a false sense of security.

it wouldnt be label, that wouldnt do anything since it could just be erased. It should be something like invisible set of pixels on pictures or some inaudible soundpattern on sounds that can be detected in some way.

But it's irrelevant. You can watermark all you want in the algorithms you control, but it doesn't change the underlying fact that pictures have been capable of lying for years.

People just recognizing that a picture is not evidence of anything is better.

Yes, but reason why people dont already consider pictures irrelevant is that it takes time and effort to manipulate a picture. With ai not only is it fast it can be automated. Of course you shouldnt accept something so unreliable as legal evidence but this will spill over to everything else too

It doesn't matter. Any time there are any stakes at all (and plenty of times there aren't), there's someone who will do the work.

It doesnt matter if you cant trust anything you see? What if you couldn't be sure if you weren't talking to bot right now?

Photos/video from unknown sources have already been completely worthless as evidence for a solid decade. If you used a random picture online to prove a point 5 years ago, you were wrong. This does not change that reality in any way.

The only thing changing is your awareness that they're not credible.

What about reliable sources becoming less reliable? Knowing something is not credible doesn't help if i can't know what is credible

They are not reliable sources. You cannot become less reliable than "not at all", and that has been the state of pictures and videos for many years already. There is absolutely no change to the evidentiary value of pictures/video.

Making the information more readily available does not change the reality that pictures aren't evidence.

I'm not talking about evidence, i'm talking about fundamendal being able to trust anything digital at all in any context. What if you couldnt be sure if phonecall from your friend was actually from your friend or if you cant be sure about any picture shown to you if its actually about some real thing.

Things you need to be able to trust in daily life dont have to be court-level evidence. That is what abuse of ai will take from us.

It's the exact same thing. You're drawing a distinction between two identical things.

Pictures have not been credible for a long time. You shouldn't have "trusted" a picture for anything 5 years ago.

The only thing that's in any way different is that now you know you can't trust it.

1 more...
1 more...
1 more...
1 more...
1 more...
1 more...
1 more...
1 more...
1 more...
1 more...
1 more...
1 more...