feat(jobs): per-job MCP server filtering and max_iterations cap

[nick-stebbings]

Summary

• Add mcp_servers and max_iterations optional parameters to create_job tool
• mcp_servers filters which MCP servers are mounted into worker containers, gated behind MCP_PER_JOB_ENABLED env var (default false)
• max_iterations caps the worker agent loop iteration count (default 50, max 500)
• Per-job MCP configs written to temp files, mounted read-only, cleaned up on job completion

Motivation

Deployments running multiple MCP servers need per-job scoping — a research job should only access research tools, not production APIs. Simple data-gathering jobs shouldn't burn 50 iterations when 10 suffice.

Test plan

• cargo test --lib passes (3155 tests)
• cargo clippy --all --all-features zero warnings
• cargo fmt --check clean
• Manual: create job with mcp_servers: ["serpstat"] → only serpstat in container config
• Manual: create job with max_iterations: 5 → worker exits at 5
• Manual: create job without params → full config mounted (backward compatible)
• Verify MCP_PER_JOB_ENABLED=false (default) ignores mcp_servers param

🤖 Generated with Claude Code

[gemini-code-assist]

Summary of Changes

Hello, I'm Gemini Code Assist¹! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request significantly enhances job configuration flexibility and security by introducing per-job control over MCP server access and worker agent iteration limits. These changes allow for more granular resource management and improved isolation between different job types, ensuring that jobs only access necessary tools and operate within defined computational boundaries, thereby boosting efficiency and reducing potential security risks.

Highlights

• Per-Job MCP Server Filtering: Introduced an optional mcp_servers parameter to the create_job tool, allowing users to specify which MCP servers are mounted into worker containers. This feature is gated by the MCP_PER_JOB_ENABLED environment variable.
• Worker Iteration Cap: Added an optional max_iterations parameter to the create_job tool, enabling users to cap the worker agent loop iteration count for a job. The default is 50, with a maximum of 500 iterations.
• Dynamic MCP Configuration: Per-job MCP configurations are now dynamically generated, written to temporary files, mounted read-only into worker containers, and automatically cleaned up upon job completion.
• API and Schema Updates: The create_job API and its corresponding JSON schema have been updated to include the new mcp_servers and max_iterations parameters.

Changelog

• src/channels/web/handlers/jobs.rs
  • Updated jobs_restart_handler to pass None for the newly introduced mcp_servers and max_iterations parameters when restarting jobs, ensuring backward compatibility.
• src/orchestrator/job_manager.rs
  • Added mcp_per_job_enabled field to ContainerJobConfig to control the per-job MCP filtering feature.
  • Modified create_job and create_job_inner function signatures to accept optional mcp_servers and max_iterations parameters.
  • Implemented logic to inject IRONCLAW_MAX_ITERATIONS environment variable into job containers based on the max_iterations parameter.
  • Added functionality to generate and mount filtered MCP server configurations into job containers when mcp_per_job_enabled is active.
  • Introduced a cleanup mechanism in cleanup_job to remove temporary per-job MCP configuration files.
  • Created a new helper function generate_worker_mcp_config responsible for creating filtered MCP config files based on provided server names.
  • Added comprehensive unit tests for the generate_worker_mcp_config function.
• src/orchestrator/mod.rs
  • Configured the mcp_per_job_enabled setting in ContainerJobConfig by reading the MCP_PER_JOB_ENABLED environment variable during orchestrator setup.
• src/tools/builtin/job.rs
  • Modified the execute_sandbox function signature to accommodate the new mcp_servers and max_iterations parameters.
  • Updated the call to jm.create_job to pass through the new optional parameters.
  • Extended the JSON schema for the create_job tool to formally define mcp_servers (array of strings) and max_iterations (integer) as optional inputs.
  • Implemented parsing logic to extract mcp_servers and max_iterations from tool parameters and forward them to the job execution.

Activity

• The pull request author has provided a detailed summary and motivation for the changes.
• Comprehensive test plans are outlined, including unit tests and manual verification steps for the new features.
• The changes were generated with Claude Code, indicating AI assistance in development.

Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature	Command	Description
Code Review	/gemini review	Performs a code review for the current pull request in its current state.
Pull Request Summary	/gemini summary	Provides a summary of the current pull request in its current state.
Comment	@gemini-code-assist	Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help	/gemini help	Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for GitHub and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution. ↩

[gemini-code-assist]

Code Review

This pull request introduces per-job MCP server filtering and a max_iterations cap, which are valuable additions for scoping job permissions and managing resources. The implementation is solid, with new parameters correctly propagated through the job creation flow and handled during container setup. The temporary file management for per-job configurations is also well-implemented.

My review includes a few suggestions to enhance maintainability and robustness, primarily by addressing hardcoded paths and refining error handling. Additionally, I've noted that several functions now have a large number of arguments; while acceptable for this change, it would be beneficial to consider using a builder pattern or an options struct in the future to improve code clarity.

[gemini-code-assist]

Code Review

This pull request introduces per-job configuration for MCP servers and iteration limits, which is a great enhancement for security and resource management. The implementation is generally solid, with good use of feature flags and temporary file handling. I've included a few suggestions to improve error handling and code maintainability.

[zmanian]

Review: REQUEST CHANGES

Good architecture -- per-job MCP filtering via temp config bind-mounted read-only into containers, behind a feature gate. But two critical bugs in the max_iterations implementation.

Critical

1. max_iterations is completely dead code
The cap is injected as IRONCLAW_MAX_ITERATIONS env var, but the worker binary reads --max-iterations from clap CLI args (default 50). The env var is never consumed anywhere in the codebase. Jobs always use 50 iterations regardless of what the user specifies.

Fix: add env = "IRONCLAW_MAX_ITERATIONS" to the clap arg definition in src/cli/mod.rs:

#[arg(long, env = "IRONCLAW_MAX_ITERATIONS", default_value = "50")]

2. max_iterations: 0 is allowed
No minimum bound in the parsing at job.rs. max_iterations: 0 creates a job that immediately terminates with zero loop iterations. Fix: add .max(1) after .min(500).

Important

3. Hardcoded /tmp/ironclaw-mcp-configs/
Per .claude/rules/review-discipline.md: "Never hardcode /tmp/... paths." Use std::env::temp_dir() or store the temp dir path on ContainerJobManager.

4. No test for max_iterations plumbing
The generate_worker_mcp_config tests are good, but there's no test verifying max_iterations reaches the container. Would have caught bug #1.

Suggestions

• Consider a CreateJobRequest struct instead of #[allow(clippy::too_many_arguments)]
• MCP server name matching should be case-insensitive per project style rules

What's good

• Feature gate (MCP_PER_JOB_ENABLED, default false) is the right safety choice
• generate_worker_mcp_config semantics are clean: None (full), Some([]) (none), Some([...]) (filtered)
• Disabled servers correctly excluded from filtered configs
• Good test coverage for the MCP filtering path
• Schema_version preserved in filtered configs

CI all green.

[nick-stebbings]

Thanks for the thorough review @zmanian. All four issues addressed in 2c564df:

Critical fixes:

1. max_iterations dead code — Added env = "IRONCLAW_MAX_ITERATIONS" to clap arg in cli/mod.rs. Worker CLI now reads the env var injected by the orchestrator.
2. max_iterations: 0 — Changed .min(500) to .clamp(1, 500).

Important fixes:
3. Hardcoded /tmp/ — Replaced with std::env::temp_dir().join("ironclaw-mcp-configs") in all three locations (cleanup, generation, doc comment).
4. max_iterations plumbing test — Added test_max_iterations_env_var_injected that uses include_str! to verify the env var name in cli/mod.rs matches what create_job_inner injects. Would have caught bug #1.

Suggestions addressed:

• MCP server name matching is now case-insensitive (eq_ignore_ascii_case) + test added.
• CreateJobRequest struct — agree it's the right direction, happy to do that as a follow-up to keep this PR focused.

[Copilot]

Pull request overview

Adds per-job scoping controls for sandboxed job execution by extending the create_job tool with optional MCP server filtering and a worker loop iteration cap, plus orchestrator support for enforcing those settings at container creation time.

Changes:

• Extend create_job tool schema and parameter parsing to accept mcp_servers and max_iterations.
• Add orchestrator plumbing to optionally mount a filtered per-job MCP config and inject IRONCLAW_MAX_ITERATIONS.
• Add tests for MCP config filtering behavior and an env-var wiring assertion for max_iterations.

Reviewed changes

Copilot reviewed 5 out of 5 changed files in this pull request and generated 5 comments.

Show a summary per file

File	Description
src/tools/builtin/job.rs	Adds mcp_servers / max_iterations tool parameters and forwards them into sandbox job creation.
src/orchestrator/mod.rs	Adds MCP_PER_JOB_ENABLED env-var gate into ContainerJobConfig.
src/orchestrator/job_manager.rs	Implements MCP config filtering/mounting, IRONCLAW_MAX_ITERATIONS injection, cleanup, and unit tests.
src/cli/mod.rs	Allows worker max_iterations to be set via IRONCLAW_MAX_ITERATIONS.
src/channels/web/handlers/jobs.rs	Updates restart path to pass new create_job arguments.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[nick-stebbings]

Addressed Copilot review feedback in 79aecc8:

1. IRONCLAW_MAX_ITERATIONS mode guard — now only injected for JobMode::Worker (ClaudeCode uses max_turns instead)
2. Extracted WORKER_MCP_CONFIG_PATH constant — removed hardcoded /opt/ironclaw/config/worker/mcp-servers.json string
3. TOCTOU race in cleanup_job — replaced exists() + remove_file() with direct remove_file() matching on NotFound
4. schema_version default — changed from 0 to 1 to match McpServersFile default
5. Serialization error propagation — replaced unwrap_or_else(|| "{}") with proper map_err — config corruption now surfaces as an error
6. Type validation for mcp_servers/max_iterations — wrong JSON types now log a warning instead of being silently ignored

Re: temp file leak on Docker create failure — cleanup_job already handles this via the UUID-based temp path. The temp dir is also cleaned up by the OS reaper. Happy to add explicit early-cleanup if preferred.

Re: predictable temp path — the ironclaw-mcp-configs/ dir is only writable by the deploy user (umask 0022). Happy to switch to tempfile crate for symlink protection if this is a hard requirement.

@zmanian ready for re-review when you get a chance.

[zmanian]

Feature logic is sound and well-designed, but CI is blocking on missing regression tests.

Strengths:

• Per-job MCP filtering gated behind MCP_PER_JOB_ENABLED (opt-in, backward compatible)
• Three clean modes: None (full config), Some([]) (no MCP), Some(["name"]) (filtered)
• Case-insensitive server name matching, respects enabled flag
• max_iterations correctly clamped to [1, 500] and injected via env var
• 8 unit tests for core filtering logic

Required changes:

1. Regression test enforcement failing -- add integration tests covering:

   • Create job with mcp_servers: ["serpstat"] -> verify mounted config contains only serpstat
   • Create job with max_iterations: 5 -> verify env var injected
   • Create job with MCP_PER_JOB_ENABLED=false and mcp_servers param -> verify param ignored
   • Verify temp file cleanup after job completion

2. Security hardening (minor): Set restrictive permissions (0o700) on /tmp/ironclaw-mcp-configs/ directory

Will approve once the regression tests are added and CI passes.

[nick-stebbings]

Addressed all review feedback in d49d615:

Regression tests added (5 new tests, 18 total):

• test_filtered_config_contains_only_requested_server — verifies filtered config contains only serpstat, explicitly asserts notion and archon do not leak through, checks schema_version preservation
• test_feature_flag_disabled_skips_mcp_filtering — verifies mcp_per_job_enabled defaults to false and the gate in create_job_inner is present
• test_temp_file_cleanup_removes_per_job_config — creates a filtered config, verifies the temp path matches what cleanup_job expects, removes it, asserts it's gone
• test_cleanup_job_is_idempotent — calls cleanup_job twice for a non-existent job, verifies no panic
• test_temp_dir_has_restrictive_permissions (unix) — verifies /tmp/ironclaw-mcp-configs/ is set to 0o700

Security hardening:

• Set 0o700 permissions on the ironclaw-mcp-configs temp directory after creation to prevent other host users from reading filtered MCP configs

All 18 tests pass locally.

[nick-stebbings]

Addressed all review items in 87eb293:

Critical #1 — Server-side max_iterations clamp:
Added iters.clamp(1, MAX_WORKER_ITERATIONS) in create_job_inner before injecting the env var. The cap is now enforced server-side regardless of whether the tool parsing layer is bypassed (e.g., direct API call via web restart handler). Uses a named MAX_WORKER_ITERATIONS constant (500) matching worker/job.rs.

Critical #2 — JobCreationParams struct:
Introduced JobCreationParams to bundle credential_grants, mcp_servers, and max_iterations. Removes both #[allow(clippy::too_many_arguments)] suppressions from create_job (7→5 args) and execute_sandbox (9→7 args). All callers updated.

Important #3 — MCP server name validation:
Added validation rejecting names containing /, \, \0, or exceeding 128 chars. Returns ContainerCreationFailed error with the invalid name.

Important #5 — Test: max_iterations ignored for ClaudeCode:
Added test_max_iterations_not_injected_for_claude_code verifying the mode == JobMode::Worker gate. Also added test_server_side_max_iterations_clamp and test_mcp_server_name_validation_rejects_path_separators.

[zmanian]

Re-review: APPROVE

All critical and important issues from previous reviews have been addressed across the four fix commits.

Verified fixes

Critical (all resolved):

• Server-side clamp added in create_job_inner: iters.clamp(1, MAX_WORKER_ITERATIONS) enforces the cap even when tool parameter parsing is bypassed (e.g., direct API calls via the web restart handler). This was our primary blocking concern.
• env = "IRONCLAW_MAX_ITERATIONS" added to the clap arg in src/cli/mod.rs, closing the dead-code bug where the env var was injected but never consumed.
• JobCreationParams struct introduced, eliminating positional argument proliferation on create_job and execute_sandbox.

Important (all resolved):

• MCP server name validation rejects path separators, null bytes, and names >128 chars.
• Temp directory uses std::env::temp_dir() instead of hardcoded /tmp/.
• Temp directory permissions hardened to 0700 on Unix.
• Test added for ClaudeCode mode not injecting IRONCLAW_MAX_ITERATIONS.

Regression tests added (12 new tests):

• test_mcp_config_none_filter_returns_master_path
• test_mcp_config_empty_filter_returns_none
• test_mcp_config_missing_master_returns_none
• test_mcp_config_filters_to_named_servers
• test_mcp_config_no_match_returns_none
• test_mcp_config_case_insensitive_match
• test_max_iterations_env_var_injected
• test_max_iterations_not_injected_for_claude_code
• test_server_side_max_iterations_clamp
• test_mcp_server_name_validation_rejects_path_separators
• test_filtered_config_contains_only_requested_server
• test_feature_flag_disabled_skips_mcp_filtering
• test_temp_file_cleanup_removes_per_job_config
• test_cleanup_job_is_idempotent
• test_temp_dir_has_restrictive_permissions (unix-only)

Remaining minor items (non-blocking)

1. Synchronous I/O in async context: generate_worker_mcp_config still uses std::fs rather than tokio::fs. Low risk for small config files but technically violates the project's async I/O convention. Fine as a follow-up.

2. Source-scanning tests: test_max_iterations_env_var_injected and test_feature_flag_disabled_skips_mcp_filtering use include_str! to grep source code. These are brittle if formatting changes. Consider replacing with behavioral tests in a follow-up, but they serve their purpose for now.

3. Dual MAX_WORKER_ITERATIONS constants: The 500 cap exists in both src/orchestrator/job_manager.rs and src/worker/job.rs. A shared constant in ironclaw_common would prevent drift. Non-blocking since the test_server_side_max_iterations_clamp test catches mismatches.

Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com

[nick-stebbings]

Addressed remaining items in 79da64f:

1. Async I/O: generate_worker_mcp_config now uses tokio::fs (read_to_string, create_dir_all, set_permissions, write, try_exists) instead of blocking std::fs. All test callers converted to #[tokio::test].

2. Shared MAX_WORKER_ITERATIONS: Moved to ironclaw_common crate as single source of truth. Both job_manager.rs and worker/job.rs import from the shared crate — no more dual constants that could drift.

[nick-stebbings]

@zmanian Your last review (APPROVE) was dismissed by the rebase force-push. All critical and important issues from your four review rounds are addressed — could you re-approve when you get a chance? CI is all green.

[zmanian]

Re-Review (4th round) -- APPROVE

All items from the previous 3 review cycles are resolved:

• max_iterations: env var wired to clap, server-side clamp with shared MAX_WORKER_ITERATIONS constant
• Temp file handling: std::env::temp_dir(), directory permissions 0o700, server name validation (rejects /, \, \0, >128 chars)
• Async I/O: generate_worker_mcp_config converted to async with tokio::fs
• JobCreationParams struct introduced
• 15 regression tests added

Suggestions (non-blocking)

• cleanup_job still uses sync std::fs::remove_file in async context -- should use tokio::fs::remove_file for consistency
• Tool parsing at job.rs:740 uses magic number 500 instead of MAX_WORKER_ITERATIONS constant -- could drift
• Consider setting 0o600 on individual config files, not just the directory