Facial recognition technology jailed a man for days. His lawsuit joins others from Black plaintiffs

JustAManOnAToilet@lemmy.world to News@lemmy.world – 269 points –
Facial recognition technology jailed a man for days. His lawsuit joins others from Black plaintiffs
apnews.com
17

I don't understand why an AI match can't at least be vetted by an actual person more or less on the spot!

Like

Hey AI matched you as this criminal individual, are you this person

gives ID

Oh you're not that person, sorry our bad.

It's still not great but much better than this.

Have you seen cops? They'll use any excuse to lock someone up, they're not going to 'take the risk of letting a suspect go'.

Yeah I am assuming a world where cops don't arrest black people because they feel like it lol

I don't think you understand how it works. So the process is simple. a crime happens. the cops are called, they collect whatever surveillance video they can get, or maybe it was a cell phone camera, or something. they load it up to the AI software, which then runs it against government databases (probably driver's license photos) and maybe images on social media.

it was the initial identification that was off- and should have been entirely avoidable here: the guy lived in Georgia, and the warrant issued in Louisiana. or, you know. Three states away. It disproportionately impacts black people because the training data used was mostly with white people.

checking to see that they match the provided identification doesn't work because they never had a reliable ID to begin with. Chances are, any video of photos uploaded to get an id is going to be dogshit. Security camera DVR's usually prioritize holding for about 30 days, which either requires a shit load of storage or a whole lot of compression. And this assumes the cameras are even capable of 4k. or 1080p or 720p. and then you got problems like dust and dirt (especially if it's outside,) obscuring the camera, or bad lighting, or whatever it is happening too far away.

most times, you're really only going to be able to get a general description off security cameras "White male with brown hair and scruffy beard and about five-six". and that's on a good system. shitty systems set up in the 80's? that's going to be more like... "it was a person."

Facial recognition and AI are great tools to assist law enforcement.
Relying on them as sole sources of information is just stupid.

Facial recognition and AI are way to easy to abuse. It significantly out ways the benefits. This technology should be totally banned.

Especially AI. It will allow unprecedented and appalling levels of inequality. Like walled ghettos. Government AI scares the hell out of me

The only way they will assist law enforcement in practice is giving the police and excuse to detain the wrong people.

They should only be used if they are open source, and viewable by the public to be checked for biases and bugs. Unfortunately, they are mostly black box technology made by companies.

And being able to hide the usage by saying “a reliable informant …” should be criminal

If only there were people who could have warned us. Oh wait.

Everyone was warning us this was going on in China.

Funny how nobody holds the US government to the same standard as China's. Probably because there's a trade war going on and these fools don't realize how much propaganda they've sucked up to support it.

Please link to the Chinese media reporting on it like this is then?

This is literally holding the US to the same standards? Or do you think the article is praising the tech?

Just gotta start wearing masks in public.

Wait, everyone was telling me this only happened in China.

Huh. You mean it's okay for America to spy on its citizens but not the Chinese? I guess I am a stupid tool who doesn't realize there's a trade war going on and both nations pull the exact same shit with their populace as the other.