sumodm

FYI: Gukesh is 18 yrs old and the youngest World Champion. He is also the 18th champion, in its 138 years history.

Something along this lines is the real danger. People will understand common failure modes and assume they have understood its behavior for most scenarios. Unlike common deterministic and even some probabilistic systems, where behavior boundaries are well behaved, there could be discontinuities in 'rarer' seen parts of the boundary. And these 'rarer' parts need not be obvious to us humans, since few pixel changes might cause wrinkles.

*vocabulary use is for a broad stroke explanation.

sumodm

2 年前議論

Cruise isn't at fault for the collision with pedestrian, since it was a second order impact. The primary cause being Nissan Sentra and pedestrian. But could cruise avoided the impact and is this how humans react when we drive? Here is the timeline from the report.

  - AV starts moving at -9.2s, after light changes
  - Prediction output shows pedestrian path crossing AV travel lane: -7.7s
  - Pedestrian leaves AV's travel lane: -5.3s
  - Pedestrian pauses at crosswalk : -4.7s
  - Contact b/w Nissan and Pedestrian; -2.7s

sumodm

2 年前議論

> When the light turned green, the Nissan Sentra and the AV entered the intersection. Against a red light, a pedestrian entered the crosswalk on the opposite side of Market Street across from the vehicles, passed completely through the AV’s lane of travel, then stopped mid-crosswalk in front of the Nissan Sentra.

I wonder whether this flagged alarms in Cruise's systems when the pedestrian crossed in a potentially dangerous situation. These kind of 2nd and 3rd order conditions seems particularly hard to train for.

投稿

Tell HN: Masked email address on Gmail leading phishing attacks

コメント