10K+ req/s batch API client for LLM endpoints — Rust, async, load-balanced
-
Updated
Feb 21, 2026 - Rust
#
batch-api
Here are 24 public repositories matching this topic...
💰 Optimize your Claude API usage to save 50-90% on costs with batching techniques and efficient request management.
python api awesome mcp openai batch-api ai-agents claude cost-saving streamlit llm anthropic ai-gateway api-optimization mcp-server claude-code mcp-gateway claude-skills
-
Updated
Jun 16, 2026 - Python
🚀 Free Anime Quiz REST API — auto-generated trivia, image, quote & batch quizzes with rate limiting, caching & retry logic. Deploy on Vercel in 1 click!
nodejs javascript api open-source express anime rest-api trivia manga developer-tools batch-api quiz-game free-api anime-api quiz-api quote-quiz anime-trivia vercel character-quiz anime-quiz
-
Updated
May 8, 2026 - JavaScript
Send non-urgent work to the Anthropic Batch API at 50% cost — directly from Claude Code
python cli batch-api cost-optimization anthropic llm-tools claude-opus anthropic-api claude-code claude-skill
-
Updated
Jun 11, 2026 - Shell
🚀 Comprehensive Claude API cost optimization toolkit - reduce costs by 50-95%
-
Updated
Mar 15, 2026 - JavaScript
🌏 EN ↔ 中文 i18n diff + Claude translate + HITL apply. Batch API path @ 50% off. MIT.
i18n python translation localization english chinese batch-api claude mcp-server solo-founder oss-tools
-
Updated
Jun 8, 2026 - Python
A Web and API Development Platform build over Symfony
platform php symfony rest-api api-server rbac oauth2-server multi-tenancy batch-api tus-protocol extract-transform-load klipper e-rbac advanced-query-builder
-
Updated
Nov 28, 2024 - PHP
DCL-392: Developing Enterprise Applications on Java EE 8
-
Updated
Nov 21, 2023 - Java
Carbon-aware MCP scheduler for agentic AI workflows. Defer "do it later" tasks to the cleanest electricity-grid hour inside a deadline — 40–70 % lower CO2, 50 % cheaper via Batch APIs. Apache-2.0.
python open-source typescript sustainability ai mcp scheduler scheduling openai batch-api agents green-software llm carbon-aware anthropic llm-tools grid-resilience agentic-ai model-context-protocol claude-code
-
Updated
Jun 16, 2026 - TypeScript
VMware BatchBox is an unofficial API for Draga OS Ultimate X and Draga OS X.
-
Updated
Feb 21, 2021 - Batchfile
Local web UI for OpenAI Sora 2 / Sora 2 Pro video generation with Batch API and automatic MP4 downloads.
-
Updated
May 23, 2026 - JavaScript
Analyse any codebase with Claude — at scale, at 50% cost. Tree-sitter parsing, Anthropic Batch API, 8 languages, 7 output formats.
-
Updated
Mar 27, 2026 - Rust
LangGraph pipeline that finds YouTube creators, scores them with Claude, and sends personalized outreach emails. Fully configurable via YAML.
python youtube-api influencer-marketing batch-api claude email-automation llm anthropic langgraph outreach-automation
-
Updated
May 25, 2026 - Python
Drop-in replacement for the Anthropic and OpenAI batch APIs — self-hosted, running against local Ollama or LM Studio. Point your existing SDK code at this server instead of the real APIs. No API keys, no cloud costs, no rate limits.
-
Updated
May 26, 2026 - PHP
Local mock server for testing LLM retries, fallbacks, and provider failure handling without spending tokens.
python testing mock-server openai developer-tools batch-api api-testing resilience chaos-engineering fastapi llm openai-compatible
-
Updated
Apr 17, 2026 - Python
Improve this page
Add a description, image, and links to the batch-api topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the batch-api topic, visit your repo's landing page and select "manage topics."