ChatGPT's Scary Good at Getting People to Click Phishing Emails, IBM Finds

stopthatgirl7@kbin.social to Technology@lemmy.world – 255 points –
ChatGPT's Scary Good at Getting People to Click Phishing Emails, IBM Finds
futurism.com

IBM researchers said a ChatGPT-generated phishing email was almost as effective in fooling people compared to a man-made version.

33

You are viewing a single comment

A targeted phishing email is usually pretty sophisticated and requires days or weeks of research. For example, you might send an email pretending to be from someone's IT department regarding a hardware audit, and ask a user to report back with the barcode sticker on their laptop, providing them with a photo of an example tag in similar format. You'll pretend to be a specific individual at the company, or a contractor the company actually uses, and show knowledge of the internal software and hardware, and refer to other real employees by name/email to establish trust. Most of this data will be scraped from publicly available sources like LinkedIn profiles, job listings, and photos shared on social media by employees. This process is called OSINT (Open-Source Intelligence) and it's a fascinating rabbithole to read about. Targeted phishing attempts are much, much more sophisticated than the ones you'll see in spam email.

This is pretty much what happened at the company I work for. The assistant to the CEO received an email that appeared like it came from the CEO requesting confidential financial information. The email contained mannerisms of the CEO, was sent when the CEO was out of the office, etc. The assistant almost fell for it… She would have if our mail system didn’t clearly flag external emails so that it’s obvious they weren’t sent internally.

My old employer would get a call every few months from someone pretending to be our client and informing us we should change the banking information. No one could figure out how they figured out that there was a business relationship between the two companies let alone who was the financial person at my job.