Read on Twitter
How Does a Self-Driving Car Work? 
https://abs.twimg.com/emoji/v2/... draggable="false" alt="🔧" title="Schraubenschlüssel" aria-label="Emoji: Schraubenschlüssel"> https://abs.twimg.com/emoji/v2/... draggable="false" alt="🧠" title="Gehirn" aria-label="Emoji: Gehirn"> https://abs.twimg.com/emoji/v2/... draggable="false" alt="🚙" title="Wohnmobil" aria-label="Emoji: Wohnmobil">
This is classical self-driving car software stack. Nowadays, all steps in the pipeline are dominated by machine learning.
Read below for details on each stephttps://abs.twimg.com/emoji/v2/... draggable="false" alt="👇" title="Rückhand Zeigefinger nach unten" aria-label="Emoji: Rückhand Zeigefinger nach unten">
This is classical self-driving car software stack. Nowadays, all steps in the pipeline are dominated by machine learning.
Read below for details on each step
https://abs.twimg.com/emoji/v2/... draggable="false" alt="🧠" title="Gehirn" aria-label="Emoji: Gehirn"> https://abs.twimg.com/emoji/v2/... draggable="false" alt="🚙" title="Wohnmobil" aria-label="Emoji: Wohnmobil"> This is classical self-driving car software stack. Nowadays, all steps in the pipeline are dominated by machine learning.Read below for details on each step https://abs.twimg.com/emoji/v2/... draggable="false" alt="👇" title="Rückhand Zeigefinger nach unten" aria-label="Emoji: Rückhand Zeigefinger nach unten">" title="How Does a Self-Driving Car Work? https://abs.twimg.com/emoji/v2/... draggable="false" alt="🔧" title="Schraubenschlüssel" aria-label="Emoji: Schraubenschlüssel"> https://abs.twimg.com/emoji/v2/... draggable="false" alt="🧠" title="Gehirn" aria-label="Emoji: Gehirn"> https://abs.twimg.com/emoji/v2/... draggable="false" alt="🚙" title="Wohnmobil" aria-label="Emoji: Wohnmobil"> This is classical self-driving car software stack. Nowadays, all steps in the pipeline are dominated by machine learning.Read below for details on each step https://abs.twimg.com/emoji/v2/... draggable="false" alt="👇" title="Rückhand Zeigefinger nach unten" aria-label="Emoji: Rückhand Zeigefinger nach unten">" class="img-responsive" style="max-width:100%;"/>
Sensors https://abs.twimg.com/emoji/v2/... draggable="false" alt="🎥" title="Filmkamera" aria-label="Emoji: Filmkamera">
There are 3 main sensors for environment perception 360° around the car:
https://abs.twimg.com/emoji/v2/... draggable="false" alt="▪️" title="Schwarzes kleines Quadrat" aria-label="Emoji: Schwarzes kleines Quadrat"> Cameras
https://abs.twimg.com/emoji/v2/... draggable="false" alt="▪️" title="Schwarzes kleines Quadrat" aria-label="Emoji: Schwarzes kleines Quadrat"> Lidars
https://abs.twimg.com/emoji/v2/... draggable="false" alt="▪️" title="Schwarzes kleines Quadrat" aria-label="Emoji: Schwarzes kleines Quadrat"> Radars
Each sensor has different advantages and disadvantages, so combining all 3 is the best strategy to achieve maximum robustness.
There are 3 main sensors for environment perception 360° around the car:
Each sensor has different advantages and disadvantages, so combining all 3 is the best strategy to achieve maximum robustness.
There are 3 main sensors for environment perception 360° around the car:https://abs.twimg.com/emoji/v2/... draggable="false" alt="▪️" title="Schwarzes kleines Quadrat" aria-label="Emoji: Schwarzes kleines Quadrat"> Camerashttps://abs.twimg.com/emoji/v2/... draggable="false" alt="▪️" title="Schwarzes kleines Quadrat" aria-label="Emoji: Schwarzes kleines Quadrat"> Lidarshttps://abs.twimg.com/emoji/v2/... draggable="false" alt="▪️" title="Schwarzes kleines Quadrat" aria-label="Emoji: Schwarzes kleines Quadrat"> RadarsEach sensor has different advantages and disadvantages, so combining all 3 is the best strategy to achieve maximum robustness." title="Sensors https://abs.twimg.com/emoji/v2/... draggable="false" alt="🎥" title="Filmkamera" aria-label="Emoji: Filmkamera"> There are 3 main sensors for environment perception 360° around the car:https://abs.twimg.com/emoji/v2/... draggable="false" alt="▪️" title="Schwarzes kleines Quadrat" aria-label="Emoji: Schwarzes kleines Quadrat"> Camerashttps://abs.twimg.com/emoji/v2/... draggable="false" alt="▪️" title="Schwarzes kleines Quadrat" aria-label="Emoji: Schwarzes kleines Quadrat"> Lidarshttps://abs.twimg.com/emoji/v2/... draggable="false" alt="▪️" title="Schwarzes kleines Quadrat" aria-label="Emoji: Schwarzes kleines Quadrat"> RadarsEach sensor has different advantages and disadvantages, so combining all 3 is the best strategy to achieve maximum robustness." class="img-responsive" style="max-width:100%;"/>
Perception https://abs.twimg.com/emoji/v2/... draggable="false" alt="🖼️" title="Bilderrahmen mit Bild" aria-label="Emoji: Bilderrahmen mit Bild">
The perception module processes all the sensor raw data to detect different objects, drivable space, lane boundaries, measure distance etc.
Fusing the information from different sensors usually increases the quality of the data significantly.
The perception module processes all the sensor raw data to detect different objects, drivable space, lane boundaries, measure distance etc.
Fusing the information from different sensors usually increases the quality of the data significantly.
The perception module processes all the sensor raw data to detect different objects, drivable space, lane boundaries, measure distance etc.Fusing the information from different sensors usually increases the quality of the data significantly." title="Perception https://abs.twimg.com/emoji/v2/... draggable="false" alt="🖼️" title="Bilderrahmen mit Bild" aria-label="Emoji: Bilderrahmen mit Bild"> The perception module processes all the sensor raw data to detect different objects, drivable space, lane boundaries, measure distance etc.Fusing the information from different sensors usually increases the quality of the data significantly." class="img-responsive" style="max-width:100%;"/>
Localization https://abs.twimg.com/emoji/v2/... draggable="false" alt="🗺️" title="Weltkarte" aria-label="Emoji: Weltkarte">
Most self-driving cars use a HD map. The map provides information about the geometry of the road, traffic rules and position of interesting objects (e.g. traffic lights).
Localization in the map is done using GPS and landmarks detected by the sensors.
Most self-driving cars use a HD map. The map provides information about the geometry of the road, traffic rules and position of interesting objects (e.g. traffic lights).
Localization in the map is done using GPS and landmarks detected by the sensors.
Most self-driving cars use a HD map. The map provides information about the geometry of the road, traffic rules and position of interesting objects (e.g. traffic lights).Localization in the map is done using GPS and landmarks detected by the sensors." title="Localization https://abs.twimg.com/emoji/v2/... draggable="false" alt="🗺️" title="Weltkarte" aria-label="Emoji: Weltkarte"> Most self-driving cars use a HD map. The map provides information about the geometry of the road, traffic rules and position of interesting objects (e.g. traffic lights).Localization in the map is done using GPS and landmarks detected by the sensors." class="img-responsive" style="max-width:100%;"/>
Prediction https://abs.twimg.com/emoji/v2/... draggable="false" alt="🔮" title="Kristallkugel" aria-label="Emoji: Kristallkugel">
The goal of this module is to predict the actions and trajectories of other traffic participants.
Will the car in front break?
Will the car cut in front of me?
Will the pedestrian cross the street?
This is crucial for the car to plan its own trajectory!
The goal of this module is to predict the actions and trajectories of other traffic participants.
Will the car in front break?
Will the car cut in front of me?
Will the pedestrian cross the street?
This is crucial for the car to plan its own trajectory!
The goal of this module is to predict the actions and trajectories of other traffic participants.Will the car in front break?Will the car cut in front of me?Will the pedestrian cross the street? This is crucial for the car to plan its own trajectory!" title="Prediction https://abs.twimg.com/emoji/v2/... draggable="false" alt="🔮" title="Kristallkugel" aria-label="Emoji: Kristallkugel"> The goal of this module is to predict the actions and trajectories of other traffic participants.Will the car in front break?Will the car cut in front of me?Will the pedestrian cross the street? This is crucial for the car to plan its own trajectory!" class="img-responsive" style="max-width:100%;"/>
Planning https://abs.twimg.com/emoji/v2/... draggable="false" alt="🔀" title="Verbogene nach rechts zeigende Pfeile" aria-label="Emoji: Verbogene nach rechts zeigende Pfeile">
In this step the car plans its own trajectory and actions. It needs to consider all other traffic participants, their intentions and the surrounding infrastructure.
One of the main objectives when planning is to maximize safety, but also to drive naturally.
In this step the car plans its own trajectory and actions. It needs to consider all other traffic participants, their intentions and the surrounding infrastructure.
One of the main objectives when planning is to maximize safety, but also to drive naturally.
In this step the car plans its own trajectory and actions. It needs to consider all other traffic participants, their intentions and the surrounding infrastructure.One of the main objectives when planning is to maximize safety, but also to drive naturally." title="Planning https://abs.twimg.com/emoji/v2/... draggable="false" alt="🔀" title="Verbogene nach rechts zeigende Pfeile" aria-label="Emoji: Verbogene nach rechts zeigende Pfeile"> In this step the car plans its own trajectory and actions. It needs to consider all other traffic participants, their intentions and the surrounding infrastructure.One of the main objectives when planning is to maximize safety, but also to drive naturally." class="img-responsive" style="max-width:100%;"/>
Control https://abs.twimg.com/emoji/v2/... draggable="false" alt="🚙" title="Wohnmobil" aria-label="Emoji: Wohnmobil">
The final step is controlling the throttle, breaks and steering so that the car actually drives the planned trajectory.
Here, it is important to have a smooth and natural control and not a steering wheel that twitches all the time.
The final step is controlling the throttle, breaks and steering so that the car actually drives the planned trajectory.
Here, it is important to have a smooth and natural control and not a steering wheel that twitches all the time.
The final step is controlling the throttle, breaks and steering so that the car actually drives the planned trajectory.Here, it is important to have a smooth and natural control and not a steering wheel that twitches all the time." title="Control https://abs.twimg.com/emoji/v2/... draggable="false" alt="🚙" title="Wohnmobil" aria-label="Emoji: Wohnmobil"> The final step is controlling the throttle, breaks and steering so that the car actually drives the planned trajectory.Here, it is important to have a smooth and natural control and not a steering wheel that twitches all the time." class="img-responsive" style="max-width:100%;"/>
If you liked this thread and want to read more about self-driving cars and machine learning give me a follow! https://abs.twimg.com/emoji/v2/... draggable="false" alt="👍" title="Daumen hoch" aria-label="Emoji: Daumen hoch">
I have many more threads like this plannedhttps://abs.twimg.com/emoji/v2/... draggable="false" alt="😃" title="Lächelndes Gesicht mit geöffnetem Mund" aria-label="Emoji: Lächelndes Gesicht mit geöffnetem Mund">
I have many more threads like this planned
