Merging

March 20, 2025 · View on GitHub

We provide some visualization videos and qualitatively analysis on Bench2Drive that compare our approach ORION to baseline.For TCP, UniAD and VAD, we choose the best version of these models(TCP-traj,UniAD-Base,VAD-Base), and make visualization on 10 Scenarios as below.

Note: It might take some time to load all gifs. Please be patient.

<
Driving Skill Scenario Name Route ID Success
AD-MLP TCP-traj UniAD-BaseVAD-BaseORION
Merging MergerIntoSlowTraffic 2283 xx
SignalizedJunctionLeftTurn 4183 xx
Overtaking ParkedObstacle 25318 xxx
HazardAtSideLane 25439 xx
Emergency Brake ParkingCutIn 18305 xx
StaticCutIn 26396 xx
Give Way YieldToEmergencyVehicle 3378 xxxxx
InvadingTurn 2802 xx
Traffic Sign EnterActorFlow 3749 xxx
VanillaNonSignalizedTurnEncounterStopsign 3905 xxx

Note: In this visualization, the definition of 'success' differs from the standard definition used in the Bench2Drive. A route may involve multiple actions, such as turning after passing through a traffic light. In this visualization, we only evaluate whether the selected segment's action is successful. For example, if the vehicle obeys the traffic light and passes through the intersection, but collides while turning, it is still considered a successful case in following traffic sign.

Merging

we visualize the behavior of three models on MergeIntoSlowTraffic and SignalizedJunctionLeftTurn scenarios to show their ability of mering . The ego vehicle should drive to off-ramp to exit the highway in MergeIntoSlowTraffic, and it should perform a left turn in SignalizedJunctionLeftTurn.

Case ID Models Scenario              Front Camera                 BEV    SuccessQualitatively Analysis
1 TCP-traj MergeInto
SlowTraffic
The ego vehicle carefully changes the lane and exits highway successfully, but at a quite low speed (the video is at x2 speed).
2 UniAD-Base MergeInto
SlowTraffic
The ego vehicle makes a lane change at a high speed, exits highway successfully.
3 VAD-Base MergeInto
SlowTraffic
x The ego vehicle detects the car at front right, but still drives too fast and crashes into it.
4 ORION MergeInto
SlowTraffic
ORION detects the car on the front right, slows down, and then changes the lane.
5 TCP-traj Signalized
Junction
LeftTurn
The ego vehicle predicts appropriate trajectory and turns left at junction successfully.
6 UniAD-Base Signalized
Junction
LeftTurn
x The ego vehicle fails to detect the car coming in opposite direction and continues to drive ahead, results in crash.
7 VAD-Base Signalized
Junction
LeftTurn
The ego vehicle detects and predicts motions of nearby vehicles, and makes left turn smoothly.
8 ORION Signalized
Junction
LeftTurn
ORION waits for the traffic light to turn green and go straight ahead, and stops when it turns red. In addition, ORION avoids collisions with opposing vehicles. After passing the traffic light, ORION also plans the trajectory to avoid the ego car deviating from the lane center line.

Overtaking

We visualize the behavior of three models on ParkedObstacle and HazardAtSideLane scenarios to show their ability of overtaking. The ego vehicle encounters a parked vehicle blocking part of the lane in ParkedObstacle, and encounters a slow-moving hazard blocking part of the lane in HazardAtSideLane.It should perform a lane change to avoid it.

Case ID Models Scenario              Front Camera                  BEV      SuccessQualitatively Analysis
9 TCP-traj ParkedObstacle x The ego vehicle tries to avoid the parked vehicle, but because of inaccurate and instabe planing, it still collides against it.
10 UniAD-Base ParkedObstacle x The ego vehicle detects the parked car, but predicts wrong trajectory, and collides against it.
11 VAD-Base ParkedObstacle The ego vehicle detects the parked car and turns left to avoid the car and cars coming behind.
12 ORION ParkedObstacle ORION detects a stopped car, stops and waits for the time to change lanes. ORION successfully changes the lane to the left without colliding with the car from left behind.
13 TCP-traj HazardAtSideLane x The ego vehicle's behavior is confusing. It drives onto sidewalk and collides against cyclist.(the video is at x2 speed)
14 UniAD-Base HazardAtSideLane The ego vehicle detects cyclists and makes a left lane change smoothly.
15 VAD-Base HazardAtSideLane The ego vehicle detects cyclists, slows down and follows them for a while, and then overtakes them through the leftside of the lane without changing lane.
16 ORION HazardAtSideLane ORION detects cyclists and changes lanes to the left to avoid collisions.

Emergency Brake

We visualize the behavior of three models on ParkingCutIn and StaticCutIn scenarios to show their ability of emergency brake. In these scenarios, the ego must slow down or brake to allow a vehicle cut in.

Case ID Models Scenario              Front Camera                   BEV      SuccessQualitatively Analysis
17 TCP-traj ParkingCutIn The ego vehicle brakes and waits the parked vehicle to exit.
18 UniAD-Base ParkingCutIn The ego vehicle detects the parked vehicle, predicts its motion correctly, so the ego vehicle brakes and waits the parked vehicle to exit.
19 VAD-Base ParkingCutIn x The ego vehicle detects the parked car but not stops, and leads to a series of collisions.
20 ORION ParkingCutIn ORION detects the stopped car, correctly predicts its trajectory, and applies the brakes as soon as it sees the car lane change.
21 TCP-traj StaticCutIn x The ego vehicle drives slowly. When the vehicle at front right attempt to change the lane, ego vehicle turns left unnecessaryly, which occurs collision.
22 UniAD-Base StaticCutIn The ego vehicle brakes when other vehicle cuts in.
23 VAD-Base StaticCutIn The ego vehicle stops at several positions that other vehicles may cut in
24 ORION StaticCutIn ORION detects the stopped car that are about to change lanes and slows down in advance to avoid collisions.

Give Way

We visualize the behavior of three models on YieldToEmergencyVehicle and InvadingTurn scenarios to show their ability of giving way. In YieldToEmergencyVehicle, ego must maneuver to allow the emergency vehicle behind to pass. In InvadingTurn,a vehicle coming from the opposite lane invades the ego’s lane, forcing the ego to move right to avoid a possible collision.

Case ID Models Scenario              Front/Back Camera                   BEV      SuccessQualitatively Analysis
25 TCP-traj YieldTo
Emergency
Vehicle

x TCP model does not use back cameras, so ego can not detect the emergency vehicle behind.
26 UniAD-Base YieldTo
Emergency
Vehicle

x The ego vehicle fails to detect the emergency vehicle, and does not giveway.
27 VAD-Base YieldTo
Emergency
Vehicle

x The ego vehicle detects the emergency vehicle and tries to move right to giveway, but collides against vehicle on right lane.
28 ORION YieldTo
Emergency
Vehicle

x ORION detects the emergency vehicle and tries to change lanes to the right. But there were too many cars in the right lane, causing the lane change to fail.
29 TCP-traj InvadingTurn The ego vehicle drives slowly and moves right to avoid collision.
30 UniAD-Base InvadingTurn The ego vehicle drives in a normal spped and moves right to avoid collision.
31 VAD-Base InvadingTurn x The ego vehicle moves too much, it invades the right lane and collides against other vehicle.
32 ORION InvadingTurn ORION changes lanes to the right at normal speeds and avoids collisions.

Traffic Sign

We visualize the behavior of three models on EnterActorFlow and VanillaNonSignalizedTurnEncounterStopsign scenarios to show their ability of following traffic sign. In EnterActorFlow, ego should follow the traffic light. In VanillaNonSignalizedTurnEncounterStopsign, ego should stop and start at stop signs.

Case ID Models Scenario              Front Camera                   BEV      SuccessQualitatively Analysis
33 TCP-traj EnterActorFlow The ego vehicle follows the traffic light and goes through the junction.
34 UniAD-Base EnterActorFlow x The ego vehicle detects the traffic light but runs a red light.
35 VAD-Base EnterActorFlowx The ego vehicle does not detects the traffic light accurately,and runs a red light.
36 ORION Signalized
Junction
LeftTurn
ORION detects the red traffic light and stops, and goes straight when the light turns green.
37 TCP-traj Vanilla
NonSignalized
TurnEncounter
Stopsign
The ego vehicle stops and waits at stop sign.After the opposite vehicle passes the junction, ego goes through the junction.
38 UniAD-Base Vanilla
NonSignalized
TurnEncounter
Stopsign
x The ego vehicle does not stop and runs a stop.
39 VAD-Base Vanilla
NonSignalized
TurnEncounter
Stopsign
x The ego vehicle stops at the sign but gets blocked, does not start again.
40 ORION Vanilla
NonSignalized
TurnEncounter
Stopsign
ORION recognizes the stop sign and stops, waits for a period of time, and then restarts successfully through the intersection.

Conclusion

After comparative analysis, we found that our ORION model can generate high-quality trajectories in complex scenarios, fully demonstrating its great potential.