Google's AI-powered search summaries use 10x more energy than a standard Google search | The Hidden Environmental Impact of AI

ForgottenFlux@lemmy.world to Technology@lemmy.world – 1016 points –
The Hidden Environmental Impact of AI
jacobin.com
144

Don't worry folks, if we all stop using plastic straws and take 30 second showers, we'll be able to offset 5% of the carbon emissions this AI has!

Google ghg emissions in 2023 are 14.3 million metric tons. Which are a ridiculous percentage of global emissions.

Commercial aviation emissions are 935.000 million metric tons by year.

So IDK about plastic straws or google. But really if people stopped flying around so much that would actually make a dent on global emissions.

Don't get me wrong, google is a piece of shit. But they are not the ones causing climate change, neither is AI technology. Planes, cars, meat industry, offshore production... Those are some of the truly big culprits.

But they are not the ones causing climate change

The owners of google are capitalists. They are as responsible for climate change as any other capitalist.

Capitalists serve customers and do not operate in a vacuum. This finger pointing does nothing productive.

Capitalists have captured regulation and to a large extent democracy in the US. So finger pointing towards them is entirely useful. Especially given they spend good money to point the finger at us.

Capitalists serve customers hoard wealth through reckless profiteering irregardless of the costs to the rest of human society and do not operate in a vacuum.

FTFY. I do agree with your last part, though. The political racketeer establishments that enable them and the fascist security institutions that protect them are equally as culpable as they are.

Somebody is hitting a homerun!

Chad

i cant afford to ride airplanes. you are welcome.

This person has no personality!

He needs to travel!

well pay me for the tickets and i will gladly do more international flights everywhere.

I'd rather we give up AI than give up meat or flying. I am not taking a ship half way across the world.

You do you. But other people may have other priorities.

Anyway, how many times have an user to use an AI to even come close to a single commercial plate through the Atlantic? It may be a freaking lot.

You giving away AI, or even forcing all humandkind to do so, might as well do nothing as far as climate change is concerned.

I still believe there are other priorities over one trip every couple of years. Flight is one of the greatest achievements of humanity and I firmly believe it is important to visit other cultures.

I'm not sure about that. I live in a country that is suffering a lot because of tourism. And I'm not very fond of it.

Sometimes I prefer that people would just read our Wikipedia page instead of coming here.

I gather from your comments that you live in Spain, right? You guys suffer from all the 20€ flights going there from other European countries. At those prices you'll mostly encounter human trash (I know this because I'm from Germany and the the majority of Germans visiting Spain are morons), so I feel with you. These cheap flights need to stop. I'd like to see the kerosene taxed fully for European flights. Have the prices be something to think about.

It's great if you can afford it. If you can afford to fly even a couple times a year you're pretty privileged. I can't, and I'm still privileged.

I can't either. My wife is a teacher and we have a child. We can't vacation in the off-seasons. We both have great jobs. So if we get to fly, it's something special. And I don't want that taken away to be honest. Using airplanes like taxis however (e.g. Ryan Air)? That's just not a good thing to do to the environment.

Bro... Most peoples "personalities" revolves around "travel"

Telling them to stop brain dead tourism will not accept! Fuck your climate

Sounds like not using Google search would be a way more effective way of reducing CO2

5 more...

The annoying part is how many mainstream tech companies have ham-fisted AI into every crevice of every product. It isn't necessary and I'm not convinced it results in a "better search result" for 90% of the crap people throw into Google. Basic indexed searches are fine for most use cases.

As a buzzword or whatever this is leagues worse than "agile", which I already loathed the overuse/integration of.

Before AI it was IoT. Nobody asked for an Internet connected toaster or fridge...

I always felt like I was alone in this thinking. I think anyone with a bit of a security mindset don’t want everything connected, besides it makes them more expensive and easier to break. It’s certainly very convenient for programmed obsolescence.

It definitely has to walk in the desert for a while. I know multiple people who like it for some stuff. Like cameras and managing air conditioning.

If only Google had a working search engine before AI

Yes, but now we can get much worse results and three pages of ads for ten times the energy cost. Capitalism at its finest.

And yet it's still garbage....like their search

With adblock enabled I feel like their results are often better than for example Duckduckgo. I recently switched to using DDG as my standard search engine but I regularly find myself using Google instead to get the results I'm looking for.

Interesting, I'm actually the exact opposite. I always start with Google, because it's usually good enough, but whenever it takes 2-3 tries to get something relevant, I switch to ddg and get it first try.

My issue is mostly with image search results. DDG's images tend to be less relevant than Google's. DDG also lacks "smart" results (idk the official term).

For example when you search "rng 25" on Google, it will immediately present you with a random number between 1 and 25. On DDG you have to click on one of the search results and then use some website to generate the number.

Or when searching for the results of a soccer game, Google will immediately present all the stats to you, while on DDG you will only find some articles about it.

Of course it really depends on the kind of search and I'm sure DDG will regularly have better results than Google too.

One example I had with DDG image search was transparent electronics, I couldnt find a way to get electronics with a transparent case, DDG would only give me generic electronics images that had transparency. Google got it though

Those kinds of things are what people often take issue with Google about. Well, the second one anyway. The first is arguably not a search and is instead a calculation, but I admit that’s a little semantical.

The first however, is Google taking information provided by third parties, and presenting it to the user. It prevents traffic from flowing through to the original site, and is something actively complained about.

And I should care about that because? Google is sparing me from visiting a website that will harass me to accept cookies, complain about my adblocker, probably request to send notifications, etc.

The same reason we don’t let companies sell photocopies of books? This isn’t a take on piracy, to be clear. This is a take on one company stealing content from another, and serving it up as if it were their own. And when Google has a monopoly on search, that fucks over everyone but Google, including you.

Extracting information from the internet that is freely available isn't exactly stealing content. Haven't you ever copied something from Wikipedia? Why would Wikipedia even exist if people can't use and share its content?

You really don’t see a difference between a single user citing wiki, vs a billion dollar company going to great lengths to squeeze every cent they can out of everyone involved when looking up information?

AI is just what crypto bros moved onto after people realized that was a scam. It's immature technology that uses absurd amounts of energy for a solution in search of a problem, being pushed as the future, all for the prospect of making more money. Except this time it's being backed by major corporations because it means fewer employees they have to pay.

There are legitimate uses of AI in certain fields like medical research and 3D reconstruction that aren't just a scam. However, most of these are not consumer facing and the average person won't really hear about them.

It's unfortunate that what you said is very true on the consumer side of things...

I would love to see an AI make an ANSYS model that isn’t shit. They might be able to make cute pictures, but when it comes to making models for CFD or FEA, AI is a complete waste of time.

energy for a solution in search of a problem,

Except this time it’s being backed by major corporations because it means fewer employees they have to pay.

Ah yes the classic it is useless and here is a use for it logic.

I take it you haven't had to go through an AI chat bot for support before huh

I have and don't see the relevance. The argument is that it is useless and then mentions a use case. If you want to say it's crap I won't argue the point but you can't say X and ~X.

Crypto has been hitting all time highs this year; there's just more bros than before.

Crypto has been hitting all time highs this year; there’s just more bros than before.

There's a sucker born every minute

I skimmed the article, but it seems to be assuming that Google's LLM is using the same architecture as everyone else. I'm pretty sure Google uses their TPU chips instead of a regular GPU like everyone else. Those are generally pretty energy efficient.

That and they don't seem to be considering how much data is just being cached for questions that are the same. And a lot of Google searches are going to be identical just because of the search suggestions funneling people into the same form of a question.

Exactly. The difference between a cached response and a live one even for non-AI queries is an OOM difference.

At this point, a lot of people just care about the 'feel' of anti-AI articles even if the substance is BS though.

And then people just feed whatever gets clicks and shares.

Googles tpu can't handle llm's lol. What do you mean "exactly"?

In fact, Gemini was trained on, and is served, using TPUs.

Google said its TPUs allow Gemini to run “significantly faster” than earlier, less-capable models.

Did you think Google's only TPUs are the ones in the Pixel phones, and didn't know that they have server TPUs?

I hadn't really heard of the TPU chips until a couple weeks ago when my boss told me about how he uses USB versions for at-home ML processing of his closed network camera feeds. At first I thought he was using NVIDIA GPUs in some sort of desktop unit and just burning energy...but I looked the USB things up and they're wildly efficient and he says they work just fine for his applications. I was impressed.

The Coral is fantastic for use cases that don't need large models. Object recognition for security cameras (using Blue Iris or Frigate) is a common use case, but you can also do things like object tracking (track where individual objects move in a video), pose estimation, keyphrase detection, sound classification, and more.

It runs Tensorflow Lite, so you can also build your own models.

Pretty good for a $25 device!

Yeah they're pretty impressive for some at home stuff and they're not even that costly.

I'm pretty sure Google uses their TPU chips

The Coral ones? They don't have nearly enough RAM to handle LLMs - they only have 8MB RAM and only support small Tensorflow Lite models.

Google might have some custom-made non-public chips though - a lot of the big tech companies are working on that.

instead of a regular GPU

I wouldn't call them regular GPUs... AI use cases often use products like the Nvidia H100, which are specifically designed for AI. They don't have any video output ports.

The confounding part is that when I do get offered an "AI result", it's basically identical to the excerpt in the top "traditional search" result. It wasted a fair amount more time and energy to repeat what the top of the search said anyway. I've never seen the AI overview ever be more useful than the top snippet.

Its not even hidden, people just give zero fucks about how their magical rectangle works and get mad if you try to tell them.

The results used to be better too. AI just produces junk faster.

I don’t know if lemmians (lemmings?) live in the same world I live in; I find AI a HUGE productivity boost, in search, writing, generation, research.

Of course one has to check results carefully, it won’t remove the need for quality checks and doing stuff yourself. But as a sparring partner, an idea creator and an assistant, I am convinced people who make use of Claude/GPT etc will outperform people who don’t by a wide margin.

Ai devinetively has its use cases and boosts productivity if used right. The stuff google did is just the most bullshit ever seen. Its an example of useless Ai because of the "need" to use Ai.

Ok that we agree entirely. Google is worried that their investors will worry because their investors are too dumb to understand that LLMs and Search are two separate things and one isn’t necessarily better because it uses the other.

I find LLM’s to be entirely worthless in any kind of engineering analysis or scientific reference. It has done nothing but hinder the design process and we have moved entirely away from it as it’s a complete joke.

We will enter another AI winter soon enough.

How can you trust whatever you search for after the glue on pizza thing?

You’re confusing what I said as being solely about search.

No, I'm just addressing the search part. How can you trust it?

I’m not saying I can. I don’t use Google, haven’t for years, so can’t make statements about the quality of its search. Intuitively search isn’t benefitting from the use of AI.

You wrote:

I find AI a HUGE productivity boost, in search

Then when pushed, you walk it back:

search isn’t benefitting from the use of AI

Why make your initial comment of support if you just walk back on it? Got some money riding on it or something?

that's gonna be mighty useful when we've destroyed the planet. Also, you are not working with AI. You are working with a LLM.

Against bunker oil shipping, coal power plants, diesel cars, cement, our consumate appetite for plastic, gas and oil based heating, air travel, cooling buildings to 19 C when the outside is 38 C, ammonia based fertiliser, fast fashion, maintaining perfect green lawns in desert environments, driving monster trucks with one passengers on 18-lane highways, dismantling public transport, building glass skyscrapers with no external shade, buying new TVs every second year etc etc I think AI’s reputation as a carbon emitter, especially considering most of Azure, CG and AWS runs on renewables, is overblown and used as a battering ram in a larger battle that comes from very real concerns about how AI is changing our society.

most of Azure, CG and AWS runs on renewables

Yeah definitely believing that

  1. if each of those contributors to wrecking our planet points to the other causes as a justification to not limit their own damage, we're fucked
  2. it's not AI. It's large language models. Glorified statistical text prediction without any originality. It just appears to some naive humans as original because it regurgitates ideas to them that other people have had but they just hadn't heard before
  3. despite the misnaming, I agree that there's a real concern that it makes the majority of users even more stupid than mankind on average already is :/

It’s more that there is a vocal minority against it. I’d guess most of us are mostly neutral about it, we see the problems and the benefits but don’t see the need to comment everywhere about our feelings towards it.

If only they did what DuckDuckGo did and made it so it only popped up in very specific circumstances, primarily only drawing from current summarized information from Wikipedia in addition to its existing context, and allowed the user to turn it off completely in one click of a setting toggle.

I find it useful in DuckDuckGo because it's out of the way, unobtrusive, and only pops up when necessary. I've tried using Google with its search AI enabled, and it was the most unusable search engine I've used in years.

DDG has also gotten much worse since the introduction of AI features.

I haven't had any problems myself.

In fact, I regularly use their anonymized LLM Chat tab to help out with restructuring data, summarizing some more complex topics, or finding some info that doesn't readily appear near the top of search. It's made my search experience (again, specifically in my circumstance) much better than before.

whats up with these shit ass titles? It's not even REMOTELY hidden, it takes two fucking seconds of googling to figure this shit out.

The entire AI industry was dependent on GPU hardware manufacturers, and nvidia is STILL back ordered (to my knowledge)

This is like saying that crypto has a hidden energy cost.

It's hidden in the sense that the normal user does not see the true cost on their energy bill. You perform a search and get the result in milliseconds. That makes it easy to get the false impression that it's just a minor operation. It's not like driving a car and watching the the fuel gauge and see the consumption.

Of course one can research how much energy Google consumes and find out the background – IF you're interested. But most people just use tech and do not question or even understand.

For you it might be clear. For the overwhelming majority of people, this is news. People don't know shit about tech. Most would assume the AI thingy does its thing on the local computer.

Most would assume the AI thingy does its thing on the local computer.

good thing nvidia having a massive market cap isn't a big news item, it's worth noting that nobody is talking about all the hardware that microsoft and google are building, surely nobody will talk about the fact that nvidia is backordered for years on hardware.

It's even better that modern consumer grade CPUs aren't marketing for the NPU bits they have.

Or there are bigger fish to fry like coal power plants and wasted idle etc. shit Google's AI search results are wasteful in some cases but I've found it to actually improve my experience but I use a mix of search engines. You can always use one without AI or turn it off. It's being pushed into almost every search though which I really don't think is useful, and it would be best if they cached the answers instead of regeneration on command. They may cache some though.

As long as we are talking about crypto, and I know this is shocking, turns out some people are using it for unsavory acts. It is okay if you want to sit down.

There's cocaine on literally every US Dollar and that currency is backed by oil, relatively speaking crypto is cleaner

I am against the drug war and I think the cocaine thing was an urban legend. Also the US dollar is not backed up by oil.

The US Dollar is not only backed by oil, but also American banking imperialism.

Im against the war on drugs too. But speaking of drugs, weed is schedule 1, where Xanax is schedule 4 (low risk of abuse). It's completely upside down and not accurate. That said, the harmfulness of the substance and being for or against the war on drugs is completely separate from the fact that there's cocaine on literally every single dollar bill. Money is the dirtiest thing in general, and by those metrics, the US Dollar is dirtier

The US Dollar is not only backed by oil, but also American banking imperialism.

Keep your story straight next time.

from the fact that there’s cocaine on literally every single dollar bill.

Prove it.

92%, I may have used the word literally figuratively, but so does every other American

https://en.wikipedia.org/wiki/Contaminated_currency#%3A%7E%3Atext%3DResults_demonstrated_that_%2292%25_of%2C0.01-922.72_%CE%BCg_per_bill.?wprov=sfla1

That's the proof man, it's literally on the bills. We can literally see it

Also, what do you mean keep my story straight next time? It's not controversial at all that the US gets involved in military conflicts for oil or financial control (neorealism, neoliberalism). Oil is just one of the many incentives which makes the USD arguably dirty

92% == 100%

surely this man could not possibly be presented an image of a zombie that he WOULDN'T be afraid of, could he?

Are you really going to be that pedantic? to ignore my point that a lot of drug use is committed by the us Dollar by that 8%? You are a child

Damn crypto is so freaken awful. Not a single legit use for it that real money can't do better. No surprise that the people who defend it have to lie about facts and use name calling instead of arguments.

Oh did I mention 92% =/= 100%? I don't think I did.

Some people? The vast majority of the crypto eco system is grifters and get-rich-quick rubes.

my brother in christ people are making child pornography using generative AI. Everything sucks and is awful.

I don't know what you want from me. I think it was pretty clear I was talking about crypto and badmouthing it. I won't touch the child pornography generative AI issue with a ten foot pole and Covid mask.

To be fair, it was never "hidden" since all the top 5 decided that GPU was the way to go with this monetization.

Guess who is waiting on the other side of this idiocy with a solution? AMD with cheap FPGA that will do all this work at 10x the speed and similar energy reduction. At a massive fraction of the cost and hassle for cloud providers.

I'm genuinely curious where their penny picking went? All of tech companies shove ads into our throats and steal our privacy justifying that by saying they operate at loss and need to increase income. But suddenly they can afford spending huge amounts on some shit that won't give them any more income. How do they justify it then?

It's another untapped market they can monopolize. (Or just run at a loss because investors are happy with another imaginary pot of gold at the end of another rainbow.)

Perception. If a company isn't on the leading edge we don't consider them the best.

Regardless if you use them or not, if Google didn't touch AI but Edge did you would believe edge is more advanced.

It doesn't even need to appeal to you the user, but given the AI Gold Rush, they would have very unhappy investors if they did not.

Because data is king and sessions are going to be worth a lot more than searches. Go through the following

  1. Talk to a LLM about what product to buy

  2. Search online for a product to buy

Which one gives out more information about yourself?

This is terrible. Why don't we build nuclear power plants, rollout a carbon tax, and put incentives for companies to make their own energy via renewables?

You know the shit that we should have been doing before I was born.

I'm surprised it's only 10x. Running a prompt though a llm takes quite a bit of energy, so I guess even the regular searches take more energy than I thought.

Same. I think I've read that a single GPT-4 instance runs on a 128 GPU cluster, and ChatGPT can still take something like 30s to finish a long response. A H100 GPU has a TDP of 700w. Hard to believe that uses only 10x more energy than a search that takes milliseconds.

If these guys gave a shit they'd focus on light based chips, which are in very early stages, but will save a lot of power.

you mean the IBM light chips and bus ?

I was talking about the photonic chips from Eindhoven University of Technology in the Netherlands, but looking into it the last update on that was four years ago.

I know they were entangling photons, so there's probably lots of research and parts to work on, but still, maybe it's just not moving forwards.

I'm not that familiar with the technology, but the benefits seem worthy of more news than they get.

What are IBM's efforts like?

I wonder what the power consumption of getting to the information in the summary is as a whole when using a regular search, clicking on multiple links, finding the right information and extracting the relevant parts. Including the expenditures of energy by the human performing the task and everything that surrounds the activity.

There are real concerns surrounding AI, I wonder if this is truly one of them or if it’s just poorly researched ragebait.

I switched to Kagi like 6 months ago and I still love it. Almost never have to go back to google except for maps.

I would point out that Google has been "carbon neutral" with it's data centers for quite some time, unlike others who still rape the environment ahem AWS.

Carbon offsets? Yes indeed. The easiest, most useless way to reach carbon neutral.

carbon neutral is when you don't emit it in the first place, not by paying someone else to promise to make up for it later.

Wait till they learn about the environmental impacts of the oil industry, or the plastic industry.

Where are all the people that were so damn pissed with Bitcoins power consumption now?

Or was it never about the power consumption in the first place and now that little Timmy has an Ai buddy the waste of electricity is fine. SMH

It’s far more important that every country fixes how it legally generates power that isn’t green. Make burning coal illegal already.

You're literally responding to an article criticising the power consumption of ai. What do you mean where are the people? They're right here.

The one article that’s popped up in months of nothing. There was a larger response from people when it was something they saw as worthless using large quantities of power compared to the “helpful ai” that’s consuming the power now.

Shows that it never was about the environment in the first place. Hypocrites.

Criticisms of Bitcoin didn't really become popular until years after its introduction. Give it time.

So-called "AI" is worthless too so they'll get their turn.

I'd think there's some serious god damn overlap between the groups that are pissed about these things.

Or was it never about the power consumption in the first place and now that little Timmy has an Ai buddy the waste of electricity is fine. SMH

I don't think I want to waste my energy on hating these hypocrite Timmies since I haven't yet encountered a single one of them.

It's a different debate because bitcoiners lose literally nothing to green power laws and banning coal. AI users would see a reduction in output quality/speed.

Crypto bros would definitely not be happy, because it would make mining less profitable

Proof of work mining difficulty already auto adjusts to minimize profits. Taxes go up, difficulty goes down.

1 more...