chore: upgrade @anthropic-ai/sdk to 0.104.1 and @anthropic-ai/vertex-sdk to 0.17.1 by p12tic · Pull Request #600 · Zoo-Code-Org/Zoo-Code

p12tic · 2026-06-13T10:57:21Z

Related GitHub Issue

Closes: #438

Description

Upgrades Anthropic AI SDK to newer version.

Test Procedure

Check if Anthropic provider still runs fine.

Pre-Submission Checklist

Issue Linked: This PR is linked to an approved GitHub Issue (see "Related GitHub Issue" above).
Scope: My changes are focused on the linked issue (one major feature/fix per PR).
Self-Review: I have performed a thorough self-review of my code.
Testing: New and/or updated tests have been added to cover my changes (if applicable).
Documentation Impact: I have considered if my changes require documentation updates (see "Documentation Updates" section below).
Contribution Guidelines: I have read and agree to the Contributor Guidelines.

Screenshots / Videos

N/A.

Documentation Updates

Not needed.

Additional Notes

None.

Get in Touch

Mention at github.

Summary by CodeRabbit

Bug Fixes
- Improved image handling across AI provider integrations to correctly process different image source types
- Enhanced robustness when processing unsupported message content formats with better fallback handling
- Updated dependencies to latest Anthropic SDK versions
New Features
- Extended markdown export support for additional message content block types

…sdk to 0.17.1

coderabbitai · 2026-06-13T10:57:29Z

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: 6cb9213e-b32c-442a-8b2e-fe822709bd47

📥 Commits

Reviewing files that changed from the base of the PR and between 6bcd398 and dec03d6.

⛔ Files ignored due to path filters (1)

pnpm-lock.yaml is excluded by !**/pnpm-lock.yaml

📒 Files selected for processing (11)

src/api/providers/native-ollama.ts
src/api/providers/openai-codex.ts
src/api/providers/openai-native.ts
src/api/transform/mistral-format.ts
src/api/transform/openai-format.ts
src/api/transform/r1-format.ts
src/api/transform/responses-api-input.ts
src/api/transform/vscode-lm-format.ts
src/api/transform/zai-format.ts
src/integrations/misc/export-markdown.ts
src/package.json

📝 Walkthrough

Walkthrough

This PR adds defensive type checking for image source handling across message format transformers and API providers, ensuring only base64-sourced images are converted to data URLs; simultaneously extends markdown export to recognize new content block types (tool-reference, document, search-result) and updates Anthropic SDK dependencies.

Changes

Image Source Type Safety

Layer / File(s)	Summary
OpenAI format transformer image and tool-result safety `src/api/transform/openai-format.ts`	Tool-result content mapping now explicitly handles `text` parts and returns empty string for non-image/non-text types. Non-tool message parts convert images to data URLs only when `source.type === "base64"`, otherwise emit `[Image]` placeholder; text parts pass through as-is.
Format transformers image source validation `src/api/transform/mistral-format.ts`, `src/api/transform/r1-format.ts`, `src/api/transform/responses-api-input.ts`, `src/api/transform/vscode-lm-format.ts`, `src/api/transform/zai-format.ts`	Mistral, R1, Responses API, VS Code LM, and ZAI transformers each guard base64 data URL construction with `part.source.type === "base64"` checks. Non-base64 images are skipped or replaced with placeholders; VS Code LM conditionally updates placeholder text based on source type.
Provider image and text content type safety `src/api/providers/native-ollama.ts`, `src/api/providers/openai-codex.ts`, `src/api/providers/openai-native.ts`	Native Ollama adds explicit `part.type === "text"` check in tool-result mapping; OpenAI Codex and OpenAI Native guard image block conversion with `source.type === "base64"` checks, preventing unconditional data URL construction from non-base64 sources.

Extended Content Block Type Support

Layer / File(s)	Summary
Markdown export content block type expansion `src/integrations/misc/export-markdown.ts`	ExtendedContentBlock type union adds `ToolReferenceBlockParam` alongside existing Anthropic and custom block types. formatContentBlockToMarkdown gains switch cases for `document`, `search_result`, and `tool_reference`, each returning a fixed placeholder label.

Anthropic SDK Version Update

Layer / File(s)	Summary
Anthropic SDK dependency versions `src/package.json`	`@anthropic-ai/sdk` and `@anthropic-ai/vertex-sdk` version ranges bumped from ^0.37.0 and ^0.7.0 to ^0.104.1 and ^0.17.1, respectively.

🎯 2 (Simple) | ⏱️ ~12 minutes

🐰 Base64 checks bloom like clover,
No more forcing non-base64 over,
Image sources now play it safe,
With placeholders keeping proper pace,
The SDK leaps, content blocks embrace! 🌱

🚥 Pre-merge checks | ✅ 2 | ❌ 3

❌ Failed checks (3 warnings)

Check name	Status	Explanation	Resolution
Linked Issues check	⚠️ Warning	Issue `#438` reports HTTP proxy being ignored in Anthropic provider; the code changes only address SDK version compatibility and image/content-type handling, not proxy functionality.	The PR does not address the core issue (`#438`): HTTP proxy support for the Anthropic provider. Verify whether the SDK upgrade itself fixes proxy handling, or implement explicit proxy configuration changes.
Out of Scope Changes check	⚠️ Warning	The PR includes changes beyond dependency upgrades: image source-type validation in multiple format transformers and export-markdown.ts content block expansion, which are beyond a simple SDK version bump.	Either justify why these format/transformation changes are necessary for the SDK upgrade, or move them to a separate PR to maintain clear scope separation from the dependency upgrade.
Docstring Coverage	⚠️ Warning	Docstring coverage is 33.33% which is insufficient. The required threshold is 80.00%.	Write docstrings for the functions missing them to satisfy the coverage threshold.

✅ Passed checks (2 passed)

Check name	Status	Explanation
Title check	✅ Passed	The PR title accurately describes the main change: upgrading Anthropic SDK packages to specific versions as confirmed by the package.json changes.
Description check	✅ Passed	The PR description provides the required sections (issue link, description, test procedure, checklist) and follows the template structure, though testing details are minimal.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing Touches

🧪 Generate unit tests (beta)

Create PR with unit tests

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

codecov · 2026-06-13T11:07:31Z

Codecov Report

❌ Patch coverage is 42.16867% with 48 lines in your changes missing coverage. Please review.

Files with missing lines	Patch %	Lines
src/api/transform/vscode-lm-format.ts	25.00%	15 Missing ⚠️
src/api/transform/openai-format.ts	57.14%	6 Missing ⚠️
src/api/transform/zai-format.ts	0.00%	6 Missing ⚠️
src/integrations/misc/export-markdown.ts	0.00%	6 Missing ⚠️
src/api/providers/native-ollama.ts	0.00%	4 Missing ⚠️
src/api/providers/openai-codex.ts	0.00%	4 Missing ⚠️
src/api/providers/openai-native.ts	0.00%	4 Missing ⚠️
src/api/transform/mistral-format.ts	75.00%	3 Missing ⚠️

📢 Thoughts on this report? Let us know!

edelauna

Thank you for taking on this dependency bump. Had a couple comments regarding image handling.

edelauna · 2026-06-25T11:57:16Z

@@ -361,7 +361,10 @@ export function convertToOpenAiMessages(
 										toolResultImages.push(part)


Should this push be guarded with if (part.source.type === "base64")? A URL-sourced image would get pushed here and emit "(see following user message for image)", but the follow-up flush block at line 385 is commented out — so the image silently disappears while the placeholder still goes to the model.

edelauna · 2026-06-25T11:57:16Z

+									if (part.type === "text") {
+										return part.text
+									}
+									return ""


In SDK 0.104.1, ToolResultBlockParam.content is Array<TextBlockParam | ImageBlockParam | SearchResultBlockParam | DocumentBlockParam | ToolReferenceBlockParam>. Could a SearchResultBlockParam or DocumentBlockParam inside a tool result end up here and get silently dropped as ""?

edelauna · 2026-06-25T11:57:17Z

+											image_url: { url: `data:${part.source.media_type};base64,${part.source.data}` },
+										}
 									}
+									return { type: "text", text: "[Image]" }


OpenAI chat completions supports URL images natively via { type: "image_url", image_url: { url: "https://..." } }. ai-sdk.ts already handles this case at line 63 as a reference. Worth forwarding URL sources here instead of falling back to [Image]?

edelauna · 2026-06-25T11:57:17Z

+										},
+									}
 								}
+								return { type: "text", text: "[Image]" }


Mistral also supports URL images natively (imageUrl: { url: "https://..." }). Could forward source.type === "url" here instead of substituting [Image], similar to openai-format.ts.

edelauna · 2026-06-25T11:57:17Z

 										if (part.type === "image") {
+											if (part.source.type === "base64") {
+												return new vscode.LanguageModelTextPart(
+													`[Image (${part.source?.type || "Unknown source-type"}): ${part.source?.media_type || "unknown media-type"} not supported by VSCode LM API]`,


Inside if (part.source.type === "base64"), part.source?.type is always "base64" — the optional chain and || "Unknown source-type" fallback are dead. Could simplify to [Image (base64): ${part.source.media_type} not supported by VSCode LM API].

chore: upgrade @anthropic-ai/sdk to 0.104.1 and @anthropic-ai/vertex-…

dec03d6

…sdk to 0.17.1

p12tic marked this pull request as ready for review June 13, 2026 11:36

p12tic requested review from JamesRobert20, edelauna, hannesrudolph, navedmerchant and taltas as code owners June 13, 2026 11:36

p12tic mentioned this pull request Jun 13, 2026

fix: pass proxy httpAgent to Anthropic SDK (node-fetch based) #441

Closed

6 tasks

edelauna requested changes Jun 25, 2026

View reviewed changes

github-actions Bot added the awaiting-author PR is waiting for the author to address requested changes label Jun 25, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

chore: upgrade @anthropic-ai/sdk to 0.104.1 and @anthropic-ai/vertex-sdk to 0.17.1#600

chore: upgrade @anthropic-ai/sdk to 0.104.1 and @anthropic-ai/vertex-sdk to 0.17.1#600
p12tic wants to merge 1 commit into
Zoo-Code-Org:mainfrom
p12tic:anthropic-sdk-upgrade

p12tic commented Jun 13, 2026 •

edited by coderabbitai Bot

Loading

Uh oh!

coderabbitai Bot commented Jun 13, 2026 •

edited

Loading

Walkthrough

Changes

❌ Failed checks (3 warnings)

Uh oh!

codecov Bot commented Jun 13, 2026

Uh oh!

edelauna left a comment

Uh oh!

edelauna Jun 25, 2026

Uh oh!

edelauna Jun 25, 2026

Uh oh!

edelauna Jun 25, 2026

Uh oh!

edelauna Jun 25, 2026

Uh oh!

edelauna Jun 25, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

		@@ -361,7 +361,10 @@ export function convertToOpenAiMessages(
		toolResultImages.push(part)

Uh oh!

Conversation

p12tic commented Jun 13, 2026 • edited by coderabbitai Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Related GitHub Issue

Description

Test Procedure

Pre-Submission Checklist

Screenshots / Videos

Documentation Updates

Additional Notes

Get in Touch

Summary by CodeRabbit

Uh oh!

coderabbitai Bot commented Jun 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Walkthrough

Changes

❌ Failed checks (3 warnings)

Uh oh!

codecov Bot commented Jun 13, 2026

Codecov Report

Uh oh!

edelauna left a comment

Choose a reason for hiding this comment

Uh oh!

edelauna Jun 25, 2026

Choose a reason for hiding this comment

Uh oh!

edelauna Jun 25, 2026

Choose a reason for hiding this comment

Uh oh!

edelauna Jun 25, 2026

Choose a reason for hiding this comment

Uh oh!

edelauna Jun 25, 2026

Choose a reason for hiding this comment

Uh oh!

edelauna Jun 25, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

p12tic commented Jun 13, 2026 •

edited by coderabbitai Bot

Loading

coderabbitai Bot commented Jun 13, 2026 •

edited

Loading