Skip to content

Relation solver places robot#880

Closed
qianl-nv wants to merge 9 commits into
mainfrom
qianl/dev/robot_placement
Closed

Relation solver places robot#880
qianl-nv wants to merge 9 commits into
mainfrom
qianl/dev/robot_placement

Conversation

@qianl-nv

@qianl-nv qianl-nv commented Jul 9, 2026

Copy link
Copy Markdown
Collaborator

Summary

Let the relation solver place robot embodiments

Detailed description

  • Introduce a shared PlacementEntity protocol so the relation solver, object
    placer, and overlap checks operate on both scene objects and embodiments;
    EmbodimentBase and Object now implement it.
  • Add USD-derived embodiment placement footprints (embodiment_placement.py)
    and wire Droid so its pose can be solved from spatial relations (e.g. on
    floor, next_to counter) instead of a hardcoded initial pose.
  • Expand the relation solver / object placer to write solved poses back to the
    correct Isaac Lab scene entity (robot for embodiments), and expand graph
    conversion to attach embodiment relations.
  • Defer the pxr-importing usd_prim_tree import in the pass-2 resolver so
    importing the generation agent no longer pulls in pxr before SimulationApp.
  • Add DummyEmbodiment/DummyObject test doubles plus tests for embodiment
    bbox, graph conversion, and solver placement; add example graph YAMLs
    (kitchen_droid_placement_only, kitchen_embodiment_placement,
    kitchen_pick_and_place).

@qianl-nv
qianl-nv force-pushed the qianl/dev/object_reference_v4 branch from 7e62316 to 1494c10 Compare July 10, 2026 09:35
Base automatically changed from qianl/dev/object_reference_v4 to main July 13, 2026 15:29
@qianl-nv
qianl-nv force-pushed the qianl/dev/robot_placement branch 2 times, most recently from 731d2ab to 91dc6e1 Compare July 15, 2026 03:21
qianl-nv added 5 commits July 20, 2026 22:54
Use placement_pool.objects for anchor and rotation lookup so layout keys match the pool instances that configclass duplicates in EventTermCfg params.

Signed-off-by: Qian Lin <qianl@nvidia.com>
@qianl-nv
qianl-nv force-pushed the qianl/dev/robot_placement branch from 91dc6e1 to 6dbb35a Compare July 21, 2026 06:59
qianl-nv added 4 commits July 21, 2026 17:21
Normalize PosePerEnv and init_state fallbacks in get_viewer_cfg_look_at_object so pick-and-place envs build without AttributeError.

Signed-off-by: Qian Lin <qianl@nvidia.com>
Discover Replicator/seed_* USDA floorplans and register them as
replicator_kitchen_<seed> background assets with a framing viewer cfg.

Signed-off-by: Qian Lin <qianl@nvidia.com>
@qianl-nv

Copy link
Copy Markdown
Collaborator Author

Split into #915 and #937

@qianl-nv qianl-nv closed this Jul 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant