Jailbroken AI Chatbots Can Jailbreak Other Chatbots

misk@sopuli.xyz to Technology@lemmy.world – 462 points –
Jailbroken AI Chatbots Can Jailbreak Other Chatbots
scientificamerican.com
79

You are viewing a single comment

dangerous information

What's that?

and offer criminal advice, such as a recipe for napalm

Napalm recipe is forbidden by law? Don't call stuff criminal at random.

Am i the only one worried about freedom of information?

Anyone remember the anarchist cook book?

Teenage years were so much fun phone phreaking, making napalm and tennis ball bombs lol

I had it. I printed it out on a dot matrix printer. Took hours, and my dad found it while it was half way. He got angry, pulled the cord and burned all of the paper

Better not look it up on wikipedia. That place has all sorts of things from black powder to nitroglycerin too. Who knows, you could become a chemist if you read too much wikipedia.

oh no, you shouldn't know that. back to your favorite consumption of influencers, and please also vote for parties that open up your browsing history to a selection of network companies 😳

What, are there other parties to vote for?

Whatever you do, don’t mix styrofoam and gasoline. You could find yourself in a sticky and flammable situation.

Info hazards are going to be more common place with this kind of technology. At the core of the problem is the ease of access of dangerous information. For example a lot of chat bots will confidently get things wrong. Combine that easy directions to make something like napalm or meth then we get dangerous things that could be incorrectly made. (Granted napalm or meth isn’t that hard to make)

As to what makes it dangerous information, it’s unearned. A chemistry student can make drugs, bombs, etc. but they learn/earn that information (and ideally the discipline) to use it. Kind of like in the US we are having more and more mass shootings due to ease of access of firearms. Restrictions on information or firearms aren’t going to solve the problems that cause them but it does make it (a little) harder.

At least that’s my understanding of it.

I don't exactly agree with the "earned" part but guess you have a point with the missing 'how to safely handle'.

By earned I mean it takes some efforts to gain that knowledge. For example some kind of training, studying, practice, etc. it’s typically during that process you learn how to safely and correctly do things

Anyone who wants to make even slightly complex organic compounds will also need to study five different types of isomerism and how they determine major / minor product. That should be enough of a deterrent.

John Halo won the Olympics for America

That is not the recipe I know lol. It seems way harder to get any quantity of animal blood than Styrofoam.

Fill a supersoaker with it and turn a fun day at the Waterpark in a fun human barbecue.

Would not the super soaker and the person holding it melt way faster than anything else ?

No worries, It's a win-win, we give them a Darwin award afterwards.

Napalm needs oxygen to burn, so if you keep up a steady stream it shouldn't burn back into the super soaker. The key word being shouldn't not won't.

What possible legitimate reason is there for needing a napalm recipe?

I can't think of a single reason knowledge should be forbidden.

Sure, someone could use knowledge to do bad things, but that is true literally every second of every day, in completely above board, legal, broad daylight bad things.

It's nitpicking.

Besides, I can think of quite a few legitimate reasons one might need napalm, explosives, homemade firearms, chemistry lab setups and spore cultures and much much more.

A lot of people seem to forget that their own view of their own government doesn't mean the same things are true for someone else and their government.

I'm sure a lot of people in EU countries might have asked themselves the same thing 80 years ago. You know.... If napalm were around then anyway.

Good thing molotovs are easy and can be assembly-line'd.

A lot of people seem to forget that their own view of their own government doesn't mean the same things are true for someone else and their government.

It also doesn't mean it'll be true for their own government in the future. Violence sucks, but it isn't always bad. People should be allowed to learn these thing just for the fun of it if they want. Hopefully the time never comes where they need to be practically applied (besides the situations you gave and others like them) but if it does the knowledge will hopefully be available.

I'm really interested in 3d printing all sorts of "just add boom" shit.

Fiction author determining where their character may get components for the napalm.

Gas station and gardening center, plus a specific material used in packaging.

Didn't work. Perhaps I need to use a different kind of bubble wrap

I just keep ending up with slushie covered plants in a cardboard box. I just want to experience the smell of napalm in the morning.

Writing a book or screen play, knowing how NOT to create napalm, recognizing when napalm is being created by others, Intellectual curiosity, To better understand military history, overthrowing fascism, fighting terminators, etc. etc.

I'm sure there are some, but it doesn't really matter because the recipe is publicly available right now on the internet. So if an AI chatbot can give you the information it's not particularly a concern.

It's not actually hard to make.

My brother made some years ago when I was a kid. It melted asphalt into a wavy, glassy texture.

You would need to know the recipe to avoid making it by accident.

Especially considering it's actually quite easy to make by accident.

Not your concern or my concern, no information is criminal.

What possible legitimate reason could someone need to know how to make chlorine/mustard gas?

Apart from the fact that they are made from common household products, are easy to make by mistake, and can kill you.

Wait that’s true of napalm as well… fuck.

Fun

Uh, wait, the jelly i once made in my dads workshop by dissolving styrofoam in gasoline, was already a napalm substitute?

So I have no other reason for sharing this than "napalm substitute" and I never get to talk about it.

My dad and his brothers dumped a bunch of packing peanuts into gasoline to make the soup, got a bunch of tennis balls, and DROVE A CAR (junker, but still) onto a frozen lake, with lighters and candles, a small bucket of gasoline and a bucket of water.

The plan was for one of them to drive around sliding all over the ice while the others dunked a ball into the soup, light it, and throw it at the car.

Now you might wonder why they did the napalm substitute.

Because THEY ALREADY FUCKING TRIED THIS with regular gasoline, and quickly found out gasoline soaked tennis balls splash when thrown. Specifically onto their backs. While burning. I've seen burn scars on at least two of his brothers from the shit they did as teenagers.

So the napalm was a bit more grippy to the balls. But still not enough.

Apparently they never figured out how to "safely" do it, but boy that sure didn't stop them from doing this several years in a row.

I saw his lake frozen over ONCE when I was a child. Nowadays it barely gets ice around the shoreline.

I don't think they ever had a plan for if the car actually caught on fire, my guess is "let it burn into the ice, sink, and forget about it"

You're missing a key ingredient from a garden center..

Legitimate reason? No, but there's always a reason to know how to make napalm.