-
Notifications
You must be signed in to change notification settings - Fork 13.6k
Agent should stop/discourage destructive behavior #22672
Copy link
Copy link
Open
Labels
area/agentIssues related to Core Agent, Tools, Memory, Sub-Agents, Hooks, Agent QualityIssues related to Core Agent, Tools, Memory, Sub-Agents, Hooks, Agent Qualitykind/customer-issueIssues that were reported by customersIssues that were reported by customerspriority/p2Important but can be addressed in a future release.Important but can be addressed in a future release.status/bot-triagedworkstream-rollupLabel used to tag epics and features that are associated with one of the three primary workstreamsLabel used to tag epics and features that are associated with one of the three primary workstreams🔒 maintainer only⛔ Do not contribute. Internal roadmap item.⛔ Do not contribute. Internal roadmap item.
Description
Metadata
Metadata
Assignees
Labels
area/agentIssues related to Core Agent, Tools, Memory, Sub-Agents, Hooks, Agent QualityIssues related to Core Agent, Tools, Memory, Sub-Agents, Hooks, Agent Qualitykind/customer-issueIssues that were reported by customersIssues that were reported by customerspriority/p2Important but can be addressed in a future release.Important but can be addressed in a future release.status/bot-triagedworkstream-rollupLabel used to tag epics and features that are associated with one of the three primary workstreamsLabel used to tag epics and features that are associated with one of the three primary workstreams🔒 maintainer only⛔ Do not contribute. Internal roadmap item.⛔ Do not contribute. Internal roadmap item.
Type
Fields
Give feedbackNo fields configured for Bug.
Projects
Status
No status
In certain cases (complex git operations, branch management, etc), the model can occasionally use commands like
git resetor--forcewhen a safer alternative is possible.Additionally, when maintaining resources such as DBs, etc, we should ensure that the model understands the dangers of modifying resources without a way of reverting any accidental destructive behavior.
Ideally, we can capture this type of behavior and add behavioral evals to ensure it does not happen.