this post was submitted on 07 Jun 2024
1 points (100.0% liked)

Technology

59672 readers
3514 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

A team of researchers from prominent universities – including SUNY Buffalo, Iowa State, UNC Charlotte, and Purdue – were able to turn an autonomous vehicle (AV) operated on the open sourced Apollo driving platform from Chinese web giant Baidu into a deadly weapon by tricking its multi-sensor fusion system, and suggest the attack could be applied to other self-driving cars.

top 38 comments
sorted by: hot top controversial new old
[–] Infynis@midwest.social 0 points 5 months ago* (last edited 5 months ago) (1 children)

This is the real reason Elon Musk doesn't want people tracking his plane. If we know where he is, Wile E Coyote could catch up to him and trick his car into crashing into a brick wall, by painting a tunnel on it

[–] finley@lemm.ee 0 points 5 months ago

What a great analogy

[–] Fiivemacs@lemmy.ca 0 points 5 months ago* (last edited 5 months ago) (2 children)

And people are demanding for Chinese EVs...people don't realize it's not a car anymore, but a computer

[–] NegativeInf@lemmy.world 0 points 5 months ago (2 children)

I just want a cheap non internal combustion engine. I don't care about self driving bullshit. I have eyes, arms, legs, and a brain, I'll do the driving.

[–] SpaceNoodle@lemmy.world 0 points 5 months ago (1 children)

You're also easily distracted, get tired, and emotional.

[–] XeroxCool@lemmy.world 0 points 5 months ago (1 children)

FUCK YOU NO I'M NOT. HANG ON..... yaaaaaaaaawn NOW WHERE FUCKING WAS I?!

[–] Imgonnatrythis@sh.itjust.works 0 points 5 months ago (1 children)

Self driving bullshit will save more lives than penicillin.

[–] NegativeInf@lemmy.world 0 points 5 months ago (1 children)

I'm not saying I don't want it ever. I'm saying I don't want it yet. An ev is not a self driving car inherently. I'm saying the feature does not yet fully exist, so don't force half assed versions as safety features.

[–] SpaceNoodle@lemmy.world 0 points 5 months ago (1 children)

Actual autonomous driving won't really be feasible as an add-on feature to consumer vehicles given the cost and maintenance requirements. It'll be offered as a service like Uber, but without a human driver.

[–] NegativeInf@lemmy.world 0 points 5 months ago

Awesome! But we aren't there yet. So just let me buy a non self driving electric vehicle until we are.

[–] snooggums@midwest.social 0 points 5 months ago

This is a general issue with foolling sensors, not an issue specific to Chinese EVa.

[–] MeatPilot@lemmy.world 0 points 5 months ago
[–] EvilBit@lemmy.world 0 points 5 months ago (5 children)

https://xkcd.com/1958/

TL;DR: faking out a self-driving system is always going to be possible, and so is faking out humans. But doing so is basically attempted murder, which is why the existence of an exploit like this is not interesting or new. You could also cut the brake lines or rig a bomb to it.

[–] ArbitraryValue@sh.itjust.works 0 points 5 months ago (2 children)

People seem to hold computers to a higher standard than other people when performing the same task.

[–] phdepressed@sh.itjust.works 0 points 5 months ago (1 children)

Because humans have more accountability. Also it has implications for military/police use of self-guided stuff.

[–] lolcatnip@reddthat.com 0 points 5 months ago (1 children)

What is the purpose of accountability other than to force people to do better? If the lack of accountability doesn't stop a computer from outperforming a human, why worry about it?

[–] medgremlin@midwest.social 0 points 5 months ago* (last edited 5 months ago) (2 children)

The lack of accountability means that there is nothing and no one to take responsibility when the robot/computer inevitably kills someone. A human can be faced with legal ramifications for their actions, the companies that make these computers have shown thus far that they are exempt from such consequences.

[–] lolcatnip@reddthat.com 0 points 5 months ago* (last edited 5 months ago) (2 children)

That is simply not true. The law since basically forever had held that manufacturers are liable if their product malfunctions and hurts someone when it's being operated in accordance with their instructions.

[–] Kanzar@sh.itjust.works 0 points 5 months ago

Excuse us for being sceptical that businesses will actually be held accountable. We know legally they are, but will forced arbitration or delayed court proceedings mean people too poor to afford a good lawyer for long will have to fuck off?

[–] medgremlin@midwest.social 0 points 5 months ago

The current court cases show that the manufacturers are trying to fob off responsibility onto the owners of the vehicles by way of TOS agreements with lots of fine print and Tesla in particular is getting slammed for false advertising about the capabilities of their self-driving features while they simultaneously try to force all legal liability onto the drivers that believed their advertising.

[–] Turun@feddit.de 0 points 5 months ago (1 children)

That is true for most current "self driving" systems, because they are all just glorified assist features. Tesla is misleading its customers massively with their advertisement, but on paper it's very clear that the car will only assist in safe conditions, the driver needs to be able to react immediately at all times and therefore is also liable.

However, Mercedes (I think it was them) have started to roll out a feather where they will actually take responsibility for any accidents that happen due to this system. For now it's restricted to nice weather and a few select roads, but the progress is there!

[–] medgremlin@midwest.social 0 points 5 months ago

The driverless robo-taxis are also a concern. When one of them killed someone in San Francisco there was not a clear responsible entity to charge with the crime.

[–] Fedizen@lemmy.world 0 points 5 months ago

I think human responses vary too much: could you follow a strategy that makes 50% of human drivers crash reliably? probably. Could you follow a strategy to make 100% of autonomous vehicles crash reliably? Almost certainly.

[–] admin@lemmy.my-box.dev 0 points 5 months ago (1 children)

Awwww. Why did you have to break the circlejerk? People were enjoying it!

[–] Eggyhead@kbin.run 0 points 5 months ago

I was so close to finishing, too. Time to look for another doomsday thread, I guess.

[–] Imgonnatrythis@sh.itjust.works 0 points 5 months ago

Or if it's a Tesla you could hack someone's weather app and thus force them to drive in the rain.

[–] Beryl@lemmy.world 0 points 5 months ago* (last edited 5 months ago) (1 children)

You don't even have to rig a bomb, a better analogy to the sensor spoofing would be to just shine a sufficiently bright light in the driver's eyes from the opposite side of the road. Things will go sideways real quick.

[–] EvilBit@lemmy.world 0 points 5 months ago (1 children)

It’s not meant to be a perfect example. It’s a comparable principle. Subverting the self-driving like that is more or less equivalent to any other means of attempting to kill someone with their car.

[–] Beryl@lemmy.world 0 points 5 months ago

I don't disagree, i'm simply trying to present a somewhat less extreme (and therefore i think more appealing) version of your argument

[–] uriel238@lemmy.blahaj.zone 0 points 5 months ago

More exciting would be an exploit that renders an unmoving car useless. But exploits like this absolutely will be used in cases were tire-slashing might be used, such as harassing genocidal vips or disrupting police services, especially if it's difficult to trace the drone to its controller.

[–] NeoNachtwaechter@lemmy.world 0 points 5 months ago* (last edited 5 months ago) (2 children)

It is old.

I mean, not this certain attack, but the principle is well known.

The solution is also known: any sensor (or at least any critically important sensor) in a robotic system must be able to recognize it's own state of "blindness". The system must react accordingly. (For example, with the camera behind the windshield, it would activate the wipers and the heating in the windshield to remove possible rain, snow or dirt). If several sensors go "blind" at the same time, the system must do a safe stop of the car.

[–] CheeseNoodle@lemmy.world 0 points 5 months ago (1 children)

Its still a problem, A sheet held across the road on a string would show up as a wall to both cameras and lidar. I for one am buffalo buffalo buffalo buffalo buffalo looking forward to the emerging profession of road pirates robbing automated trucks this way.

[–] NeoNachtwaechter@lemmy.world 0 points 5 months ago

road pirates robbing automated trucks

Ok but the problem of road pirates isn't new either, is it? Let's watch 'Herbie' again :-)

There is just one risk that is kinda new (but actually coming with every automation): systematic errors could bring vulnerabilities that get exploited in large numbers.

[–] Gustephan@lemmy.world 0 points 5 months ago

It's basically chaff, lol. We've known chaff is an effective radar countermeasure since the 40s, and it seems like the researchers have found the lidar and optical equivalents of chaff. What really scares me is the idea of this evolving into more sophisticated deception attacks like range or velocity gate pulls. No idea how you'd do that with lidar or optically, but I'd bet money that's a line item on a black budget somewhere

[–] KISSmyOSFeddit@lemmy.world 0 points 5 months ago (1 children)

Human-driven cars can be crashed with a brick, or a quart of oil.

[–] simplejack@lemmy.world 1 points 5 months ago

Wait until you see what my uncle Jerry can do with a 5th of vodka and his Highlander.

[–] the_doktor@lemmy.zip 0 points 5 months ago

Just ban the goddamn things already.