Merging
March 20, 2025 · View on GitHub
We provide some visualization videos and qualitatively analysis on Bench2Drive that compare our approach ORION to baseline.For TCP, UniAD and VAD, we choose the best version of these models(TCP-traj,UniAD-Base,VAD-Base), and make visualization on 10 Scenarios as below.
Note: It might take some time to load all gifs. Please be patient.
<| Driving Skill | Scenario Name | Route ID | Success | ||||
|---|---|---|---|---|---|---|---|
| AD-MLP | TCP-traj | UniAD-Base | VAD-Base | ORION | |||
| Merging | MergerIntoSlowTraffic | 2283 | x | √ | √ | x | √ |
| SignalizedJunctionLeftTurn | 4183 | x | √ | x | √ | √ | |
| Overtaking | ParkedObstacle | 25318 | x | x | x | √ | √ |
| HazardAtSideLane | 25439 | x | x | √ | √ | √ | |
| Emergency Brake | ParkingCutIn | 18305 | x | √ | √ | x | √ |
| StaticCutIn | 26396 | x | x | √ | √ | √ | |
| Give Way | YieldToEmergencyVehicle | 3378 | x | x | x | x | x |
| InvadingTurn | 2802 | x | √ | √ | x | √ | |
| Traffic Sign | EnterActorFlow | 3749 | x | √ | x | x | √ |
| VanillaNonSignalizedTurnEncounterStopsign | 3905 | x | √ | x | x | √ | |
Note: In this visualization, the definition of 'success' differs from the standard definition used in the Bench2Drive. A route may involve multiple actions, such as turning after passing through a traffic light. In this visualization, we only evaluate whether the selected segment's action is successful. For example, if the vehicle obeys the traffic light and passes through the intersection, but collides while turning, it is still considered a successful case in following traffic sign.
Merging
we visualize the behavior of three models on MergeIntoSlowTraffic and SignalizedJunctionLeftTurn scenarios to show their ability of mering . The ego vehicle should drive to off-ramp to exit the highway in MergeIntoSlowTraffic, and it should perform a left turn in SignalizedJunctionLeftTurn.
| Case ID | Models | Scenario | Front Camera | BEV | Success | Qualitatively Analysis |
|---|---|---|---|---|---|---|
| 1 | TCP-traj | MergeInto SlowTraffic | ![]() | ![]() | √ | The ego vehicle carefully changes the lane and exits highway successfully, but at a quite low speed (the video is at x2 speed). |
| 2 | UniAD-Base | MergeInto SlowTraffic | ![]() | ![]() | √ | The ego vehicle makes a lane change at a high speed, exits highway successfully. |
| 3 | VAD-Base | MergeInto SlowTraffic | ![]() | ![]() | x | The ego vehicle detects the car at front right, but still drives too fast and crashes into it. |
| 4 | ORION | MergeInto SlowTraffic | ![]() | ![]() | √ | ORION detects the car on the front right, slows down, and then changes the lane. |
| 5 | TCP-traj | Signalized Junction LeftTurn | ![]() | ![]() | √ | The ego vehicle predicts appropriate trajectory and turns left at junction successfully. |
| 6 | UniAD-Base | Signalized Junction LeftTurn | ![]() | ![]() | x | The ego vehicle fails to detect the car coming in opposite direction and continues to drive ahead, results in crash. |
| 7 | VAD-Base | Signalized Junction LeftTurn | ![]() | ![]() | √ | The ego vehicle detects and predicts motions of nearby vehicles, and makes left turn smoothly. |
| 8 | ORION | Signalized Junction LeftTurn | ![]() | ![]() | √ | ORION waits for the traffic light to turn green and go straight ahead, and stops when it turns red. In addition, ORION avoids collisions with opposing vehicles. After passing the traffic light, ORION also plans the trajectory to avoid the ego car deviating from the lane center line. |
Overtaking
We visualize the behavior of three models on ParkedObstacle and HazardAtSideLane scenarios to show their ability of overtaking. The ego vehicle encounters a parked vehicle blocking part of the lane in ParkedObstacle, and encounters a slow-moving hazard blocking part of the lane in HazardAtSideLane.It should perform a lane change to avoid it.
| Case ID | Models | Scenario | Front Camera | BEV | Success | Qualitatively Analysis |
|---|---|---|---|---|---|---|
| 9 | TCP-traj | ParkedObstacle | ![]() | ![]() | x | The ego vehicle tries to avoid the parked vehicle, but because of inaccurate and instabe planing, it still collides against it. |
| 10 | UniAD-Base | ParkedObstacle | ![]() | ![]() | x | The ego vehicle detects the parked car, but predicts wrong trajectory, and collides against it. |
| 11 | VAD-Base | ParkedObstacle | ![]() | ![]() | √ | The ego vehicle detects the parked car and turns left to avoid the car and cars coming behind. |
| 12 | ORION | ParkedObstacle | ![]() | ![]() | √ | ORION detects a stopped car, stops and waits for the time to change lanes. ORION successfully changes the lane to the left without colliding with the car from left behind. |
| 13 | TCP-traj | HazardAtSideLane | ![]() | ![]() | x | The ego vehicle's behavior is confusing. It drives onto sidewalk and collides against cyclist.(the video is at x2 speed) |
| 14 | UniAD-Base | HazardAtSideLane | ![]() | ![]() | √ | The ego vehicle detects cyclists and makes a left lane change smoothly. |
| 15 | VAD-Base | HazardAtSideLane | ![]() | ![]() | √ | The ego vehicle detects cyclists, slows down and follows them for a while, and then overtakes them through the leftside of the lane without changing lane. |
| 16 | ORION | HazardAtSideLane | ![]() | ![]() | √ | ORION detects cyclists and changes lanes to the left to avoid collisions. |
Emergency Brake
We visualize the behavior of three models on ParkingCutIn and StaticCutIn scenarios to show their ability of emergency brake. In these scenarios, the ego must slow down or brake to allow a vehicle cut in.
| Case ID | Models | Scenario | Front Camera | BEV | Success | Qualitatively Analysis |
|---|---|---|---|---|---|---|
| 17 | TCP-traj | ParkingCutIn | ![]() | ![]() | √ | The ego vehicle brakes and waits the parked vehicle to exit. |
| 18 | UniAD-Base | ParkingCutIn | ![]() | ![]() | √ | The ego vehicle detects the parked vehicle, predicts its motion correctly, so the ego vehicle brakes and waits the parked vehicle to exit. |
| 19 | VAD-Base | ParkingCutIn | ![]() | ![]() | x | The ego vehicle detects the parked car but not stops, and leads to a series of collisions. |
| 20 | ORION | ParkingCutIn | ![]() | ![]() | √ | ORION detects the stopped car, correctly predicts its trajectory, and applies the brakes as soon as it sees the car lane change. |
| 21 | TCP-traj | StaticCutIn | ![]() | ![]() | x | The ego vehicle drives slowly. When the vehicle at front right attempt to change the lane, ego vehicle turns left unnecessaryly, which occurs collision. |
| 22 | UniAD-Base | StaticCutIn | ![]() | ![]() | √ | The ego vehicle brakes when other vehicle cuts in. |
| 23 | VAD-Base | StaticCutIn | ![]() | ![]() | √ | The ego vehicle stops at several positions that other vehicles may cut in |
| 24 | ORION | StaticCutIn | ![]() | ![]() | √ | ORION detects the stopped car that are about to change lanes and slows down in advance to avoid collisions. |
Give Way
We visualize the behavior of three models on YieldToEmergencyVehicle and InvadingTurn scenarios to show their ability of giving way. In YieldToEmergencyVehicle, ego must maneuver to allow the emergency vehicle behind to pass. In InvadingTurn,a vehicle coming from the opposite lane invades the ego’s lane, forcing the ego to move right to avoid a possible collision.
| Case ID | Models | Scenario | Front/Back Camera | BEV | Success | Qualitatively Analysis |
|---|---|---|---|---|---|---|
| 25 | TCP-traj | YieldTo Emergency Vehicle | ![]() ![]() | ![]() | x | TCP model does not use back cameras, so ego can not detect the emergency vehicle behind. |
| 26 | UniAD-Base | YieldTo Emergency Vehicle | ![]() ![]() | ![]() | x | The ego vehicle fails to detect the emergency vehicle, and does not giveway. |
| 27 | VAD-Base | YieldTo Emergency Vehicle | ![]() ![]() | ![]() | x | The ego vehicle detects the emergency vehicle and tries to move right to giveway, but collides against vehicle on right lane. |
| 28 | ORION | YieldTo Emergency Vehicle | ![]() ![]() | ![]() | x | ORION detects the emergency vehicle and tries to change lanes to the right. But there were too many cars in the right lane, causing the lane change to fail. |
| 29 | TCP-traj | InvadingTurn | ![]() | ![]() | √ | The ego vehicle drives slowly and moves right to avoid collision. |
| 30 | UniAD-Base | InvadingTurn | ![]() | ![]() | √ | The ego vehicle drives in a normal spped and moves right to avoid collision. |
| 31 | VAD-Base | InvadingTurn | ![]() | ![]() | x | The ego vehicle moves too much, it invades the right lane and collides against other vehicle. |
| 32 | ORION | InvadingTurn | ![]() | ![]() | √ | ORION changes lanes to the right at normal speeds and avoids collisions. |
Traffic Sign
We visualize the behavior of three models on EnterActorFlow and VanillaNonSignalizedTurnEncounterStopsign scenarios to show their ability of following traffic sign. In EnterActorFlow, ego should follow the traffic light. In VanillaNonSignalizedTurnEncounterStopsign, ego should stop and start at stop signs.
| Case ID | Models | Scenario | Front Camera | BEV | Success | Qualitatively Analysis |
|---|---|---|---|---|---|---|
| 33 | TCP-traj | EnterActorFlow | ![]() | ![]() | √ | The ego vehicle follows the traffic light and goes through the junction. |
| 34 | UniAD-Base | EnterActorFlow | ![]() | ![]() | x | The ego vehicle detects the traffic light but runs a red light. |
| 35 | VAD-Base | EnterActorFlow | ![]() | ![]() | x | The ego vehicle does not detects the traffic light accurately,and runs a red light. |
| 36 | ORION | Signalized Junction LeftTurn | ![]() | ![]() | √ | ORION detects the red traffic light and stops, and goes straight when the light turns green. |
| 37 | TCP-traj | Vanilla NonSignalized TurnEncounter Stopsign | ![]() | ![]() | √ | The ego vehicle stops and waits at stop sign.After the opposite vehicle passes the junction, ego goes through the junction. |
| 38 | UniAD-Base | Vanilla NonSignalized TurnEncounter Stopsign | ![]() | ![]() | x | The ego vehicle does not stop and runs a stop. |
| 39 | VAD-Base | Vanilla NonSignalized TurnEncounter Stopsign | ![]() | ![]() | x | The ego vehicle stops at the sign but gets blocked, does not start again. |
| 40 | ORION | Vanilla NonSignalized TurnEncounter Stopsign | ![]() | ![]() | √ | ORION recognizes the stop sign and stops, waits for a period of time, and then restarts successfully through the intersection. |
Conclusion
After comparative analysis, we found that our ORION model can generate high-quality trajectories in complex scenarios, fully demonstrating its great potential.



















































































