[codex] Add Go2 visual event notifier demo#2286
Draft
Gshfrez wants to merge 2 commits into
Draft
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
BrowserNotificationSkill, a reusable DimOS skill that serves an HTTPS phone/browser alert page and exposesnotify_user(...)over MCP.Why
This demonstrates a reusable DimOS application pattern:
The recorded demo can use a traffic-light-style companion scenario, but the contribution generalizes to facility status lights, package alerts, warning signs, delivery events, and patrol notifications. The demo does not require an LLM API key, robot speech, navigation, or watch SDK integration.
Demo Path
https://<laptop-ip>:8450/notifyon the Samsung phone and tap Enable alerts.examples/go2_visual_event_notifier/demo_signals.htmland show green/yellow/red to the Go2 camera.Changes
TrafficLightColorDetectorclassifies RGB/BGR frames with HSV color masks and optional normalized ROI cropping.StableStateDebounceremits events only after repeated stable frames and cooldown.go2_traffic_light_companion.pysupports--source go2throughUnitreeWebRTCConnectionand--source webcamfor rehearsal.demo_signals.htmlprovides manual and auto-cycling red/yellow/green signals for recording.docs/examples/go2_visual_event_notifier.mddocuments setup, fallbacks, and the 90-second demo script.Validation
uv run python -m py_compile dimos/perception/visual_events/traffic_light.py examples/go2_visual_event_notifier/go2_traffic_light_companion.pyuv run pytest dimos/agents/skills/test_browser_notification_skill.py dimos/perception/visual_events/test_traffic_light_color_detector.pyuv run ruff check dimos/agents/skills/browser_notification_skill.py dimos/perception/visual_events examples/go2_visual_event_notifier/go2_traffic_light_companion.pyuv run python examples/go2_visual_event_notifier/go2_traffic_light_companion.py --helphttps://127.0.0.1:8450/notifyreturned200 text/html, and queued a high-priority alert.Safety Note
This is a prototype visual-event trigger and not a production traffic-safety system. The robot remains stationary; the demo only uses camera frames.