Skip to content

Isolate malformed LLM batch responses#265

Open
koriyoshi2041 wants to merge 1 commit into
NVIDIA:mainfrom
koriyoshi2041:fix-malformed-llm-response
Open

Isolate malformed LLM batch responses#265
koriyoshi2041 wants to merge 1 commit into
NVIDIA:mainfrom
koriyoshi2041:fix-malformed-llm-response

Conversation

@koriyoshi2041

Copy link
Copy Markdown
Contributor

Summary

  • skip only the malformed LLM batch when structured response parsing fails
  • keep configuration errors such as missing API keys propagating
  • add sync run_batches regression coverage for a stray-text structured response

Fixes #250.

Verification

  • uv run pytest tests/nodes/test_llm_analyzer_base.py -k "RunBatches or failed_batch or value_error"
  • uv run pytest tests/nodes/test_llm_analyzer_base.py
  • git diff --check upstream/main...HEAD
  • uv run ruff check src/ tests/
  • uv run ruff format --check src/ tests/

Note: make lint and make format fail in this shell because the Makefile calls bare ruff, but the equivalent uv run ruff ... commands above pass.

Signed-off-by: kigland <shuaizhicheng336@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Single malformed LLM response aborts the entire scan (uncaught pydantic ValidationError) — triggered consistently by the default nv_build model

1 participant