Google will use Gemini to detect scams during calls | TechCrunch

catculation@lemmy.zip to Technology@lemmy.world – 224 points –
Google will use Gemini to detect scams during calls | TechCrunch
techcrunch.com
40

Is this just an excuse to listen to your phone calls?

Correction: They already listen to all of your calls and have been training their models on it

From the article it's entirely on device.

It's probably too expensive for them to record and upload every call, but im sure the transcripts of calls are likely to leak soon after this.

Yep , we will let your hardware do the work , we will just collect the final profile data that's valuable to us.

This is genuinely really cool.

The best/worst part of the AI boom for me has been waiting for the advances to trickle down in terms of open source models and on-device models, rather than having to send everything up to the cloud.

Obviously this isn't an open source model, but the on-device processing is great.

I’m worried about the security of this. However looking past that and simply observing it as an implementation of AI, this is an idea that I think is actually a beneficial use. Protecting the elderly against fraud/scams is a major issue which gets increasingly complex as scammers improve their methods. Using AI to detect scams in calls could be helpful in protecting the elderly.

But before rolling it out, I would want to see proof of its efficiency through careful studies. Hell, incentivize Google to share the model with the government and other businesses so it can be improved upon. Fund it as a grant/program so smaller teams/companies can contribute and innovate.

They do have versions of the Gemini models that are open sourced, called Gemma. So far they don't work quite as well as the Llama ones from Facebook but I'm sure that will change.

🤬 these people will not let you record your own phone calls but they want to record & listen to those calls for their own profit.

They said the AI stuff is all done on device so nothing is being sent back to Google

Let's see. I will take their claims with a healthy dose of skepticism.

I dunno. I doubt it is. But I also doubt there isn't something they are getting back.
Maybe not personal information but I'd imagine there will be data on what keywords it flagged on and whether the user hung up or carried on with the call etc. They wouldn't be able to fix or improve the service without getting information back.

Record your phone calls anyways, there are ways to.

Also ways to disable the call recording prompt they forced into it. They force that even in one party regions where you can record your own calls without needing permission from the other person.

Wait, what do you mean will not let you record your own phone calls.

The recording feature isn't available in a lot of countries, including mine. Even though it is legal to record calls without informing the other end here.

most likely they don't want to get into any legal trouble and it's like a thing they're rolling out on per country basis rather than creating a blocklist of countries where it's illegal

Rooting your phone if possible is always a nice solution to this. BCR works great for me(along with BCR GUI). I can also still use my banking and Google wallet apps (you just need the right apps/modules)

1 more...

Skilled scammers manipulate their victims so much that they don't believe their actual bank telling them it's a scam. I don't think this will help.

There are a lot more unskilled scammers looking for low hanging fruit

I'm not sure scams are so subtle. For example fishing emails are often so obviously scam that people think there are designed to filter very gullible people or very unlucky persons who actually waited for a call with the exact same context as the scammer will give.

You just have to opt in to letting Google listen to everything? (I did not read article – sorry.)

the smallest version of Google’s Generative AI offering, which can be run entirely on-device.

It's not known what information is sent to Google but they stated the calls are analyzed on the device and not sent to the cloud.

Soo they're analyzing them as you speak and sending the result to the cloud?

With a full transcript for debugging purposes of course!

Huh. Guess my bank isn't my bank for telling me to move my money in a separate account to keep it safe (from myself).

People really do fall for this. I believe this mainly affects the elderly. Not anyone using Lemmy, but it really does exist.

I tried explaining to a nice elderly woman that the person texting her asking to buy Steam cards wasn't actually Jason Momoa, but she couldn't be convinced. Fortunately, the manager at that store forbid anyone from selling her any gift cards of any kind.

People think they are paying the IRS in ITunes gift cards, or the bail bondsman takes Google Play credits over the phone.

I can see it now.

"Imagine that I am your father. As your father, I am telling you a bed time story about a Nigerian prince who needs funds to unlock frozen assets...."

Scam Likely? That’s a name I haven’t heard in a while.

A Dungeon & Daddies reference is not what I expected to see today either.