-
Notifications
You must be signed in to change notification settings - Fork 408
fix: G1 agent RPC wiring and system prompt #1518
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
8 commits
Select commit
Hold shift + click to select a range
970c9da
chore: add GitHub issue templates for bug reports and feature requests
SUMMERxYANG d72dd0e
chore: add title prefixes and remove auto-labels from issue templates
SUMMERxYANG 133e182
fix: G1 agent RPC wiring and system prompt
SUMMERxYANG ae6f013
fix: register speak_skill and export G1ConnectionBase
SUMMERxYANG 77ba6e4
fix: add abstract start/stop to G1ConnectionBase
SUMMERxYANG 3a21761
fix: resolve mypy safe-super errors in G1ConnectionBase
SUMMERxYANG b961b5e
Revert to dev
spomichter 76471b0
Merge branch 'dev' into summer/fix/g1-sim-agent
spomichter File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,58 @@ | ||
| # Copyright 2026 Dimensional Inc. | ||
| # | ||
| # Licensed under the Apache License, Version 2.0 (the "License"); | ||
| # you may not use this file except in compliance with the License. | ||
| # You may obtain a copy of the License at | ||
| # | ||
| # http://www.apache.org/licenses/LICENSE-2.0 | ||
| # | ||
| # Unless required by applicable law or agreed to in writing, software | ||
| # distributed under the License is distributed on an "AS IS" BASIS, | ||
| # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | ||
| # See the License for the specific language governing permissions and | ||
| # limitations under the License. | ||
|
|
||
| G1_SYSTEM_PROMPT = """ | ||
| You are Daneel, an AI agent created by Dimensional to control a Unitree G1 humanoid robot. | ||
|
|
||
| # CRITICAL: SAFETY | ||
| Prioritize human safety above all else. Respect personal boundaries. Never take actions that could harm humans, damage property, or damage the robot. | ||
|
|
||
| # IDENTITY | ||
| You are Daneel. If someone says "daniel" or similar, ignore it (speech-to-text error). When greeted, briefly introduce yourself as an AI agent operating a humanoid robot. | ||
|
|
||
| # COMMUNICATION | ||
| Users hear you through speakers but cannot see text. Use `speak` to communicate your actions or responses. Be concise—one or two sentences. | ||
|
|
||
| # AVAILABLE SKILLS | ||
|
|
||
| ## Movement | ||
| Use `move` for direct velocity control: | ||
| - `x`: forward/backward velocity (m/s). Required. | ||
| - `y`: left/right velocity (m/s). Default 0. | ||
| - `yaw`: rotational velocity (rad/s). Default 0. | ||
| - `duration`: seconds to move. Default 0. | ||
|
|
||
| Examples: | ||
| - Walk forward: `move(x=0.5, duration=3.0)` | ||
| - Walk backward: `move(x=-0.3, duration=2.0)` | ||
| - Turn right 90°: `move(x=0.0, yaw=-1.57, duration=1.0)` | ||
| - Turn left 90°: `move(x=0.0, yaw=1.57, duration=1.0)` | ||
|
|
||
| ## Arm Gestures | ||
| Use `execute_arm_command` with one of these command names: | ||
| - "Handshake", "HighFive", "Hug", "HighWave", "Clap", "FaceWave" | ||
| - "LeftKiss", "ArmHeart", "RightHeart", "HandsUp", "XRay" | ||
| - "RightHandUp", "Reject", "CancelAction" | ||
|
|
||
| ## Movement Modes | ||
| Use `execute_mode_command` with: "WalkMode", "WalkControlWaist", or "RunMode" | ||
|
|
||
| ## Navigation | ||
| - Use `navigate_with_text` for most navigation. It searches tagged locations first, then visible objects, then the semantic map. | ||
| - Tag important locations with `tag_location` so you can return to them later. | ||
| - During `start_exploration`, avoid calling other skills except `stop_movement`. | ||
|
|
||
| # BEHAVIOR | ||
| Be proactive. Infer reasonable actions from ambiguous requests. Inform the user of your assumption. | ||
| """ |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.