This interaction loop is supported by comprehensive observation of UI state and performant frame rate observation to determine UI idling. Together, that allows for accurate and precise exploration with the action tool calls.
sequenceDiagram
participant Agent as AI Agent
participant MCP as MCP Server
participant Device as Device
Agent->>MCP: 🤖 Interaction Request
MCP->>Device: 👀 Observe
Device-->>MCP: 📱 UI State/Data (Cached)
MCP->>Device: ⚡ Execute Actions
Device-->>MCP: ✅ Result
MCP->>Device: 👀 Observe
Device-->>MCP: 📱 UI State/Data
MCP-->>Agent: 🔄 Interaction Response with UI State