2025-09-22 ODD working group weekly meeting (258) #6473
diegoyabuki
started this conversation in
Working group meetings
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Attendees
Agenda/Minutes
Weekly Simulation Results
August 24, 2025
Urban-Dense catalog on branch "scenario-dev": 68/81 scenarios passed.
public road bus catalog on branch "main": 279/332 scenarios passed.
August 31, 2025
Urban-Dense catalog on branch "scenario-dev": 67/81 scenarios passed.
public road bus catalog on branch "main": 181/332 scenarios passed.
September 07, 2025
Urban-Dense catalog on branch "scenario-dev": 69/81 scenarios passed.
public road bus catalog on branch "main": 280/332 scenarios passed.
September 14, 2025
Urban-Dense catalog on branch "scenario-dev": 67/81 scenarios passed.
public road bus catalog on branch "main": 283/332 scenarios passed.
September 21, 2025
Urban-Dense catalog on branch "scenario-dev": 68/81 scenarios passed.
public road bus catalog on branch "main": 289/332 scenarios passed.
Updated Summary of Failures
Fixed/Solved/Explained failures
Expected failures
Ongoing failures
Could not expand drivable area: Ego cannot expand drivable area to the opposite traffic lane when avoiding NPC/Pedestrians (LHT/RHT dependency).
Excess deceleration: Failed with excess deceleration (Non-deterministic case).
Insufficient avoidance margin: Ego got too close to NPC/Pedestrian laterally.
Bicycle collides with ego: Bicycle NPC collides with ego.
Cannot perform avoidance: Ego could not avoid a stationary NPC.
Missing ROS topics: Missing topics "metrics_modified_goal_{longitudinal | lateral | yaw}_deviation_mean" (label mismatch).
Collision during avoidance: Ego collides with static obstacle during avoidance (insufficient lateral clearance).
Ego stuck outside drivable area: Drivable area looks appropriately enhanced, but EGO stops for "Outside (of) Drivable Area".
Collision in left turn: Collision with oncoming traffic on left turn (RHT).
Ego did not back up: Ego did not back up as intended.
Incorrect simulation condition: Ego did not reach target speed.
Vehicle collision: Ego collided with a vehicle NPC.
Could not initialize localization: Requested the service "/api/localization/initialize" 30 times, but was not successful.
Could not engage: The simulator attempted to request Autoware to engage, but was aborted because Autoware's current state is INITIALIZING | WAITING_FOR_ROUTE | PLANNING.
Ego collides with vehicle moving on target lane after right turn: Ego collides with vehicle running on lane after right turn.
SIGSEGV in freespace planner: Freespace planner error after avoidance completion.
Simulation timed out: "map" passed to lookupTransform argument target_frame does not exist.
SIGABRT in start planner: Error in start planner (could be similar to SIGSEGV in freespace planner.
Ego does not start driving: Error during execution -- Invalid Trajectory published.
Simulator health check failed: Test execution succeeds, but the simulator health check fails.
Ego cannot find path to depart from parking lot: Ego gets stuck in the parking lot.
New failures
Obstacle cruise virtual wall temporarily shifted back: The virtual wall shifted back, causing ego to slow down.
MPT failure: Bad alloc in Model Predictive Trajectory stack.
MRM virtual wall: MRM comfortable stop wall keeps appearing during driving.
Traffic light topic with multiple types: Topic '/perception/traffic_light_recognition/(ex|in)ternal/traffic_signals' has more than one type associated.
Ego does not complete initialization: Ego gets stuck in the parking lot.
Autoware does not reach state WAITING_FOR_ENGAGE: Simulator waited for the Autoware state to transition to WAITING_FOR_ENGAGE, but time is up. The current Autoware state is PLANNING.
Could not call clear_route API: Requested the service "/api/routing/clear_route" 30 times, but was not successful.
Scenario Results Since Last TSC
- 2x Insufficient avoidance margin
- 4x Bicycle collides with ego
- 3x Excess deceleration
- 1x Cannot perform avoidance
- Ego stops twice in right turn (intersection + obstacle stop)
- 17x Ego stuck outside drivable area
- 4x Ego does not start driving
- 1x Simulator health check failed
- 1x Could not initialize localization
- 2x Autoware does not reach state WAITING_FOR_ENGAGE
- 9x Incorrect simulation condition
- 1x Missing ROS topics
- 1x SIGABRT in start planner
- 2x Ego cannot find path to depart from parking lot
- 1x Could not call clear_route API
This Week's Discussions
Recap of Discussions Until Last Week
Action Item
Documents
Tools
[Autoware Evaluator (CI/CD pipeline)]
[Scenario Simulator V2 (Scenario testing framework)]
The GUI Scenario editor
[TIER IV account]
Administrative
Please check the ODD WG wiki page.
This and other AWF periodic meetings can be checked on the Autoware Foundation events calendar. You can also add your contact to the ODD WG meeting invitation group to receive invitations for future meetings.
ODD WG meetings are held weekly in the following single time slot.
Beta Was this translation helpful? Give feedback.
All reactions