Smart TVs take snapshots of what you watch multiple times per second

melroy@kbin.melroy.org to Technology@lemmy.world – 1469 points –

By Jeremy Hsu on September 24, 2024

Popular smart TV models made by Samsung and LG can take multiple snapshots of what you are watching every second – even when they are being used as external displays for your laptop or video game console.

Smart TV manufacturers use these frequent screenshots, as well as audio recordings, in their automatic content recognition systems, which track viewing habits in order to target people with specific advertising. But researchers showed this tracking by some of the world’s most popular smart TV brands – Samsung TVs can take screenshots every 500 milliseconds and LG TVs every 10 milliseconds – can occur when people least expect it.

“When a user connects their laptop via HDMI just to browse stuff on their laptop on a bigger screen by using the TV as a ‘dumb’ display, they are unsuspecting of their activity being screenshotted,” says Yash Vekaria at the University of California, Davis. Samsung and LG did not respond to a request for comment.

Vekaria and his colleagues connected smart TVs from Samsung and LG to their own computer server. Their server, which was equipped with software for analysing network traffic, acted as a middleman to see what visual snapshots or audio data the TVs were uploading.

They found the smart TVs did not appear to upload any screenshots or audio data when streaming from Netflix or other third-party apps, mirroring YouTube content streamed on a separate phone or laptop or when sitting idle. But the smart TVs did upload snapshots when showing broadcasts from the TV antenna or content from an HDMI-connected device.

The researchers also discovered country-specific differences when users streamed the free ad-supported TV channel provided by Samsung or LG platforms. Such user activities were uploaded when the TV was operating in the US but not in the UK.

By recording user activity even when it’s coming from connected laptops, smart TVs might capture sensitive data, says Vekaria. For example, it might record if people are browsing for baby products or other personal items.

Customers can opt out of such tracking for Samsung and LG TVs. But the process requires customers to either enable or disable between six and 11 different options in the TV settings.

“This is the sort of privacy-intrusive technology that should require people to opt into sharing their data with clear language explaining exactly what they’re agreeing to, not baked into initial setup agreements that people tend to speed through,” says Thorin Klosowski at the Electronic Frontier Foundation, a digital privacy non-profit based in California.

https://www.newscientist.com/article/2449198-smart-tvs-take-snapshots-of-what-you-watch-multiple-times-per-second/ (paywall!!)

440

You are viewing a single comment
View all comments

“When a user connects their laptop via HDMI just to browse stuff on their laptop on a bigger screen by using the TV as a ‘dumb’ display, they are unsuspecting of their activity being screenshotted,”

But if you never connected the TV to the internet, it's not able to upload anything right?

Correct

Thing is, it's getting pretty cheap to build radios into devices, and companies are doing that and bridging them to whatever Internet connectivity they can reach, not just your own. You don't necessarily have to personally plug something into an Ethernet socket to make a device Internet-connected.

From back when Amazon Sidewalk was rolling out:

https://www.statuscake.com/blog/what-is-amazon-mesh/

This time, however, the big news is Amazon mesh, a network to connect users and their devices. The tech giants have called this project Amazon Sidewalk+ with the idea first being made public back in 2019 where they announced they wanted to extend and expand the connectivity of their customers.

Why did Amazon do this?

According to Amazon, the main reason was to provide a better service for their customers whilst using their devices. Although there has been some backlash by those in the safety and security space, the idea seems to be very safe and simple. 

How will Amazon mesh work?

The Sidewalk project will create a network mesh between all the connected devices so it can increase the connection field around the devices. It will be able to do this by using Low-energy Bluetooth and 900MHz radio signals to pass data with the connected compatible devices. By doing this, the network can extend the reach of the signal and thus it will be able to cover a larger area to allow devices to connect. 

Here is an example of how this will work: imagine if you have a compatible device at the end of your garden such as a light which you normally can’t control with your phone. With the extended network, that light could connect to a neighbour’s device and by doing this it will be connected to the network, and you will have the ability to then use your phone to control the light.

There has been some concern regarding how much data the network will use for those who agree to be part of it and Amazon have estimated that the data usage could be around 400-500mbps a month. For most people, this is such a small amount that it won’t even be noticeable.

How can the mesh network be used?

Another use for this mesh is for users around the network to connect and possibly use the mesh to perform other tasks such as a Ring doorbell (Amazon-owned) to be installed in the part of the house where the usual Wi-Fi signal doesn’t reach. This provides customers with a great alternative to the far more expensive Wi-Fi extender mesh products on the market.

As is normal in situations like this, many users are concerned about the security of this project. According to what Amazon has released regarding how it will work so far, there will not be any security concerns as the connections will not identify which device was connected meaning that if your Ring doorbell extends the network to a nearby device, the system will not mention that this device was connected to that particular Ring doorbell. However, people need to be aware that Amazon itself can collect this data and the way the users interact with the network.

https://www.theguardian.com/technology/2021/jun/01/amazon-us-customers-given-one-week-to-opt-out-of-mass-wireless-sharing

The feature works by creating a low-bandwidth network using smart home devices such as Amazon Echoes and Ring security cameras. At its simplest, it means that a new Echo can set itself up using a neighbour’s wifi, or a security camera can continue to send motion alerts even if its connection to the internet is disrupted, by piggybacking on the connection of another camera across the street.

But the company’s plans have caused alarm among observers. Ashkan Soltani, a former chief technology officer of the US Federal Trade Commission, told the tech site Ars Technica: “In addition to capturing everyone’s shopping habits (from amazon.com) and their internet activity (as AWS is one of the most dominant web hosting services) … now they are also effectively becoming a global ISP with a flick of a switch, all without even having to lay a single foot of fiber”. The feature may also break the terms and conditions of users’ internet connections, which do not allow such resharing, warned Lydia Leong, an analyst at Gartner.

Users can disable Sidewalk in the settings section of the Alexa or Ring apps, but have until 8 June to do so. After that, if they have taken no action, the network will be turned on and their devices will become “Sidewalk Bridges”.

Amazon is not the first company to look to create such a network. Apple has taken a similar approach with the company’s range of AirTag item trackers, which can connect to the internet through any compatible iPhone they come into contact with, not simply their owner’s. And BT, through a long-term partnership with Fon, ran a service from 2007 until 2020 that allowed broadband customers to share spare bandwidth in a public wifi network.

When you have companies creating their own radio networks, they can use someone else's Internet connection to move data.

For expensive devices, like cars, it also makes economic sense to have a dedicated cell modem and service phoning data home. But it's not the only route.

Point is, you don't have a monopoly over granting your devices Internet access any more.

Well. That’s it. Get the flamethrowers. Time to burn down the Amazon.

No. Not the one that’s already burning. The other one.

Yeah I remember when they rolled that out… it does not give me hope for the future of privacy.

Canada needs to really ramp up our privacy laws, I’m not crazy about GDPR specifically, but there needs to be something more substantial here.

I'm not really gung-ho about mandatory approaches either, like with licensing, but for an optional approach:

  • I have to be able to assess a device and its drawbacks with a reasonable amount of knowledge and time spent researching it.

  • There has to be at least one option on the market that does what I want.

For cars, at least, we're really getting to the point where it's not practical to get a new car without a cell data link that phones home.

And trying to stay atop of the privacy issues for all classes of device out there can't be a full-time job, or it's not reasonable to expect people to make informed purchasing decisions. Like, I should just be able to say that I don't want a device that broadcasts any persistent unique IDs in plaintext over a radio, not have to research whether the current crop of smart automobile tire pressure valves has a protocol that exposes that information or not..

I'd like to avoid Europe's prescription-heavy regulatory route, but the way things are now in the US isn't my ideal either.

My hot air station has a reeeealllly long cable.

So long. It's the best. Unlike my..