Skip to content

test(core): improve testing for API request/response parsing#21227

Merged
sehoon38 merged 3 commits intomainfrom
sehoon/integration_test
Mar 5, 2026
Merged

test(core): improve testing for API request/response parsing#21227
sehoon38 merged 3 commits intomainfrom
sehoon/integration_test

Conversation

@sehoon38
Copy link
Contributor

@sehoon38 sehoon38 commented Mar 5, 2026

Summary

This PR improves the integration testing for API request and response parsing, specifically addressing resilience against metadata-only or malformed chunks in streaming responses.

Details

  • Component-Level Parsing Tests: Added tests to packages/core/src/code_assist/server.test.ts to verify the SSE parser handles malformed JSON correctly (logging InvalidChunkEvent instead of crashing) and yields metadata-only chunks (e.g., chunks containing usageMetadata or consumedCredits but no candidates).
  • System-Wide E2E Resilience: Created a new integration test integration-tests/api-resilience.test.ts along with its response mock integration-tests/api-resilience.responses. This test verifies that the full application stack remains stable when receiving logically incomplete streaming chunks.

Related Issues

Fixes #20190

How to Validate

  1. Run component-level tests:

    npm test -w @google/gemini-cli-core -- src/code_assist/server.test.ts

    Expect all 32 tests to pass, including the new robustness test cases.

  2. Run E2E integration test:

    npm run test:integration:sandbox:none -- integration-tests/api-resilience.test.ts

    Expect the test to pass, confirming the CLI doesn't crash on metadata-only chunks.

Pre-Merge Checklist

  • Updated relevant documentation and README (if needed)
  • Added/updated tests (if needed)
  • Noted breaking changes (if any)
  • Validated on required platforms/methods:
    • MacOS
      • npm run

@sehoon38 sehoon38 requested a review from a team as a code owner March 5, 2026 06:20
@gemini-cli
Copy link
Contributor

gemini-cli bot commented Mar 5, 2026

Hi @sehoon38, thank you so much for your contribution to Gemini CLI! We really appreciate the time and effort you've put into this.

We're making some updates to our contribution process to improve how we track and review changes. Please take a moment to review our recent discussion post: Improving Our Contribution Process & Introducing New Guidelines.

Key Update: Starting January 26, 2026, the Gemini CLI project will require all pull requests to be associated with an existing issue. Any pull requests not linked to an issue by that date will be automatically closed.

Thank you for your understanding and for being a part of our community!

@gemini-code-assist
Copy link
Contributor

Summary of Changes

Hello, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request enhances the robustness of API request and response parsing, particularly for streaming responses. It introduces new tests at both the component and system levels to ensure the application gracefully handles malformed JSON and metadata-only chunks within API streams, preventing crashes and maintaining stability.

Highlights

  • Component-Level Parsing Tests: Added tests to packages/core/src/code_assist/server.test.ts to verify the SSE parser handles malformed JSON correctly (logging InvalidChunkEvent instead of crashing) and yields metadata-only chunks (e.g., chunks containing usageMetadata or consumedCredits but no candidates).
  • System-Wide E2E Resilience: Created a new integration test integration-tests/api-resilience.test.ts along with its response mock integration-tests/api-resilience.responses. This test verifies that the full application stack remains stable when receiving logically incomplete streaming chunks.
Changelog
  • integration-tests/api-resilience.responses
    • Added a mock streaming API response for testing resilience.
  • integration-tests/api-resilience.test.ts
    • Introduced a new E2E test to validate API streaming resilience.
  • packages/core/src/code_assist/server.test.ts
    • Added a test for handling malformed JSON in streaming responses.
    • Included a test for resilience to metadata-only chunks in generateContentStream.
Activity
  • No human activity has occurred on this pull request yet.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request enhances the integration tests for API response parsing by adding resilience checks for malformed and metadata-only chunks in streaming responses. The new tests in server.test.ts and the new E2E test in api-resilience.test.ts are well-structured and effectively cover the intended scenarios. I have one suggestion to improve the compatibility of the new E2E test with a wider range of Node.js versions, which aligns with our guideline to use node: prefixes for built-in modules.

@github-actions
Copy link

github-actions bot commented Mar 5, 2026

Size Change: -2 B (0%)

Total Size: 26 MB

ℹ️ View Unchanged
Filename Size Change
./bundle/gemini.js 25.5 MB -2 B (0%)
./bundle/node_modules/@google/gemini-cli-devtools/dist/client/main.js 221 kB 0 B
./bundle/node_modules/@google/gemini-cli-devtools/dist/src/_client-assets.js 227 kB 0 B
./bundle/node_modules/@google/gemini-cli-devtools/dist/src/index.js 11.5 kB 0 B
./bundle/node_modules/@google/gemini-cli-devtools/dist/src/types.js 132 B 0 B
./bundle/sandbox-macos-permissive-open.sb 890 B 0 B
./bundle/sandbox-macos-permissive-proxied.sb 1.31 kB 0 B
./bundle/sandbox-macos-restrictive-open.sb 3.36 kB 0 B
./bundle/sandbox-macos-restrictive-proxied.sb 3.56 kB 0 B
./bundle/sandbox-macos-strict-open.sb 4.82 kB 0 B
./bundle/sandbox-macos-strict-proxied.sb 5.02 kB 0 B

compressed-size-action

Added component-level and E2E integration tests to verify resilience
against malformed JSON and metadata-only chunks in API response streams.

Linked to #20190
@sehoon38 sehoon38 force-pushed the sehoon/integration_test branch from 257fbc4 to fa1cf13 Compare March 5, 2026 06:29
@gemini-cli gemini-cli bot added the 🔒 maintainer only ⛔ Do not contribute. Internal roadmap item. label Mar 5, 2026
@sehoon38 sehoon38 enabled auto-merge March 5, 2026 14:10
@sehoon38 sehoon38 changed the title test(core): improve integration testing for API request/response parsing test(core): improve testing for API request/response parsing Mar 5, 2026
Copy link
Contributor

@yunaseoul yunaseoul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@sehoon38 sehoon38 added this pull request to the merge queue Mar 5, 2026
Merged via the queue into main with commit 1aa4a32 Mar 5, 2026
29 checks passed
@sehoon38 sehoon38 deleted the sehoon/integration_test branch March 5, 2026 21:13
struckoff pushed a commit to struckoff/gemini-cli that referenced this pull request Mar 6, 2026
kunal-10-cloud pushed a commit to kunal-10-cloud/gemini-cli that referenced this pull request Mar 12, 2026
liamhelmer pushed a commit to badal-io/gemini-cli that referenced this pull request Mar 12, 2026
yashodipmore pushed a commit to yashodipmore/geemi-cli that referenced this pull request Mar 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

🔒 maintainer only ⛔ Do not contribute. Internal roadmap item.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Improve integration testing for API request/response parsing

2 participants