v1.3.0-main.3

What's Changed

Fixes

• fix(openai): Improve reasoning parameter handling by @vprashrex in #1001
• Assessment: Anthropic Batch fix by @vprashrex in #989
• docs(credentials): Add Anthropic provider support by @vprashrex in #998
• Bump tornado from 6.5.5 to 6.5.7 in /backend by @dependabot[bot] in #991
• Evaluation: Gemini batch integration (text) by @vprashrex in #867
• CI: Add GitHub Action to format PR body and title using OpenAI by @vprashrex in #980
• Infra: Move Sensitive Credentials in AWS Secrets by @Ayush8923 in #981
• Release: Update Deployment Script by @Ayush8923 in #988
• Bump pyjwt from 2.12.0 to 2.13.0 in /backend by @dependabot[bot] in #979
• Guardrails: Expose Dedicated Endpoint by @Prajna1999 in #939
• Guardrails: Add Trailing Slash to the POST guardrails endpoint by @Prajna1999 in #984
• Evaluation: Prompt Generation by @AkhileshNegi in #966
• Document: Add JSON format support by @vprashrex in #993
• Organization Management: Delete & Edit Functionality by @Ayush8923 in #956

Full Changelog: v1.2.1...v1.3.0-main.3

v1.2.1

What's Changed

Fixes

• Claude: Agents V2 by @AkhileshNegi in #967
• Claude: SRD creator by @vprashrex in #961
• Claude: Explore to PRD by @AkhileshNegi in #962
• Celery: consolidate task queues to a single default queue with priority support by @vprashrex in #964
• Assessment: Improve topic relevance settings handling in prefilter by @vprashrex in #952

Full Changelog: v1.2.0...v1.2.1-main.1

v1.2.0

What's Changed

Features

• Evaluation: Fast Evals by @AkhileshNegi in #870
• Fast Evals: Hotfix for status by @AkhileshNegi in #940
• API Contract: Automate Schema Updates by @Prajna1999 in #892
• Analytics: Analytics Dashboard APIs by @Ayush8923 in #888
• Release: Semantic Release by @Ayush8923 in #933
• Evaluation: Sorted By Question ID by @Ayush8923 in #927
• Evaluation: Category-wise analytics for Evals by @Ayush8923 in #917

Fixes

• Assessment: Improve topic relevance settings handling in prefilter by @vprashrex in #952
• Evaluation: Fix Partial results by @AkhileshNegi in #948
• Bump aiohttp from 3.13.4 to 3.14.1 in /backend by @dependabot[bot] in #946
• Bump idna from 3.11 to 3.15 in /backend by @dependabot[bot] in #944
• Bump python-multipart from 0.0.22 to 0.0.31 in /backend by @dependabot[bot] in #943
• Bump urllib3 from 2.6.3 to 2.7.0 in /backend by @dependabot[bot] in #942
• Bump mako from 1.3.10 to 1.3.12 in /backend by @dependabot[bot] in #941
• Bump starlette from 0.52.1 to 1.3.1 in /backend by @dependabot[bot] in #945
• ⬆ Bump actions/setup-node from 4 to 6 by @dependabot[bot] in #950
• ⬆ Bump actions/checkout from 4 to 7 by @dependabot[bot] in #949
• ⬆ Bump actions/github-script from 7 to 9 by @dependabot[bot] in #951
• Remove routing from google-vertex to default google-aistudio as a hotfix by @Prajna1999 in #954
• Claude: Agents workflow by @AkhileshNegi in #914
• Postgres: Bump docker image to 17.9 for prod & staging parity by @Ayush8923 in #937
• Docs/architecture by @kartpop in #899
• Config: Remove the Temperature for GPT-5 Models while Config Versioning by @Ayush8923 in #910
• Anthropic and Google Vertex: Add Claude and Gemini to llm_call endpoint by @Prajna1999 in #896
• Assessment: Implement L1 Filtering and Post-Processing by @vprashrex in #895
• Rate Monitor: Per-org request rate alerting on high-cost endpoints by @vprashrex in #911
• Evalution: Step-forward merge by @AkhileshNegi in #918
• API: surface third-party errors in /llm/call and /collections by @Ayush8923 in #906
• Codecov: Upgrade the Codecov Version & Test Cases Updates by @Ayush8923 in #924
• Bump lxml from 6.0.2 to 6.1.0 in /backend by @dependabot[bot] in #779
• ⬆ Bump actions/setup-python from 5 to 6 by @dependabot[bot] in #908
• Model Config: completion_type array + CRUD endpoints + Default Gemini Provider to Vertex + Other enum changes by @vprashrex in #890
• ⬆ Bump actions/checkout from 4 to 6 by @dependabot[bot] in #907
• Unified API: Kaapi Backend as a Proxy by @Prajna1999 in #921
• Collections: one batch processing per task by @nishika26 in #786
• Assessment: Anthropic Batch Integration by @vprashrex in #931
• S2S: Speech-to-Speech with File Search in a Single API Call by @Prajna1999 in #643
• Model Config: relax model validation to warning by @vprashrex in #902

Full Changelog: v1.1.0...v1.2.0-main.3

v1.1.0

What's Changed

• Config: remove version id from response body by @nishika26 in #822
• Documentation: iterating over collection and documents module by @nishika26 in #814
• Notification: Evals Notification for evals completion by @Ayush8923 in #847
• Monitoring: Pending job (LLM, Document, Collection) by @vprashrex in #846
• Revert "Config: remove version id from response body" by @Prajna1999 in #863
• LLMOutput Fix: generate presigned URL for audio output in LLM call response by @vprashrex in #865
• Deployment: Stop automate deployment in ECS by @Ayush8923 in #876
• Collections: Customizable collection names by @Ayush8923 in #878
• Model Config: DB-driven validator, seed sarvamai/elevenlabs/google by @vprashrex in #859
• hotfix: reset model_config sequence before seeding in migration 063 by @vprashrex in #883
• fix(cron): add pending-jobs check to cron by @vprashrex in #882
• Guardrails: added output parameter by @rkritika1508 in #894

Full Changelog: v1.0...v1.1.0

v1.0.0

What's Changed

• Deployment: Staging deploy workflow for EC2 via SSM by @Ayush8923 in #770
• Onboarding: enforce single project per user on onboard by @Ayush8923 in #805
• API: Remove Trailing Slashes by @Ayush8923 in #812
• Claude: PR-reviewer Agent by @AkhileshNegi in #813
• Gevent: Implement soft time limit by @nishika26 in #800
• Chore: Add Coderabbit Config by @Ayush8923 in #811
• Assessment: AI Assessment Pipeline by @vprashrex in #788
• Feature-Flag: org/project feature flags with DB by @vprashrex in #789
• Assessment: Gemini Batch Fix & Dataset Preview Row Limiting by @vprashrex in #820
• Observability: Fix log levels and add tenant/request context to all logs by @vprashrex in #795
• Voicenote Storage: Optimize audio handling by @Prajna1999 in #815
• Feat: Enable Sentry CeleryIntegration in worker init by @vprashrex in #827
• Database Cleanup: b64 to s3 uri by @Prajna1999 in #816
• Kaapi: V1.0: Database optimization by @AkhileshNegi in #817
• chore: upgrade litellm to 1.83.14 by @Prajna1999 in #833
• hotfix: temporary register private router in staging prod by @Prajna1999 in #836
• Hf/b64 s3 private route staging prod temp fix by @Prajna1999 in #838
• LLM CALL: save bypassed entry in db as well by @nishika26 in #826

Full Changelog: v0.8.3...v1.0.0

v0.8.3

What's Changed

• Evaluation: Show cost by @AkhileshNegi in #746
• Auth: User Invitation flow by @Ayush8923 in #739
• Observability: Telemetry and logging for collection and LLM job services by @vprashrex in #772
• Observability: make celery telemetry init pool-agnostic and drop non-app traces by @vprashrex in #775
• Docker: Hotfix ENV variable by @Ayush8923 in #781
• Guardrails: add rephrase support for input validators by @nishika26 in #783
• Observability: Sentry Cron by @AkhileshNegi in #780
• Webhook: Add Fingerprinting to Webhook Payloads by @Prajna1999 in #765

Full Changelog: v0.8.2...v0.8.3

v0.8.2

What's Changed

• fix: add gevent dependency instead of pre-fork by @Prajna1999 in #729
• Support new Open AI model configuration by @Ayush8923 in #717
• Evaluation: Improve error handling for batch job by @AkhileshNegi in #724
• Add pagination and optional query params to config list endpoint by @vprashrex in #725
• Add projects-by-org endpoint and pagination for organizations list by @vprashrex in #727
• Credentials: error handling for unsupported providers by @nishika26 in #707
• Fix/db connection pool limit by @Prajna1999 in #738
• Fix/db connection pool limit by @Prajna1999 in #740
• Fix/db connection pool limit by @Prajna1999 in #743
• Fix/db connection pool limit by @Prajna1999 in #744
• refactor: smol moving around db/network calls by @Prajna1999 in #745
• Feat: Google Integration & Auth Flow by @Ayush8923 in #730
• ⬆ Bump codecov/codecov-action from 5.5.3 to 6.0.0 by @dependabot[bot] in #722
• Bump aiohttp from 3.13.3 to 3.13.4 in /backend by @dependabot[bot] in #752
• Bump requests from 2.32.5 to 2.33.0 in /backend by @dependabot[bot] in #755
• Bump cryptography from 46.0.5 to 46.0.7 in /backend by @dependabot[bot] in #754
• Bump pyasn1 from 0.6.2 to 0.6.3 in /backend by @dependabot[bot] in #756
• Bump pygments from 2.19.2 to 2.20.0 in /backend by @dependabot[bot] in #758
• llm call: polling llm db endpoint by @nishika26 in #726
• Security: Remove Litellm by @AkhileshNegi in #750
• Bump pillow from 12.1.1 to 12.2.0 in /backend by @dependabot[bot] in #761
• ⬆ Bump actions/github-script from 8 to 9 by @dependabot[bot] in #749
• Security: Pytest upgrade by @AkhileshNegi in #762
• Model Config: Add model configuration table and API endpoints by @vprashrex in #669
• Gemini STT: add latest google models for STT by @Prajna1999 in #763
• Collections: Add dynamic batching by @nishika26 in #718

Full Changelog: 0.8.1...v0.8.2

v0.8.1

What's Changed

• TTS Evaluation: Fix processing issue by @AkhileshNegi in #700
• Evaluation: Incomple Langfuse traces sycned by @AkhileshNegi in #702
• fix: import celery issues by @Prajna1999 in #703
• Hotfix/celery import issues by @Prajna1999 in #705
• Hotfix CI by @AkhileshNegi in #710
• hotfix: comment auto_discover tasks by @Prajna1999 in #712
• Feature/celery new execute job by @Prajna1999 in #714
• pre-import llm jobs module on worker starutp by @kartpop in #715
• ⬆ Bump codecov/codecov-action from 5.5.1 to 5.5.3 by @dependabot[bot] in #692
• Celery: Update testcases mock by @AkhileshNegi in #721

Full Changelog: v0.8.0...0.8.1

v0.8.0

What's Changed

Collections

• Batch size defaults to 10 by @nishika26 in #689

Documentation & Tooling

• Update API documentation for endpoints by @vprashrex in #638
• Added issue formatter by @AkhileshNegi in #645

Enhancements

• Dataset signed URLs and improved validation errors by @vprashrex in #652
• Fix validation error related to versioning by @vprashrex in #686

Evaluation

• Added type and signed URL for datasets by @AkhileshNegi in #641
• STT Evaluation, automated metrics and human annotation by @AkhileshNegi and @nishika26 in #639, #657, #632, #655 & #685
• TTS Evaluation and metric for human annotation by @AkhileshNegi in #619, #666 & #681

LLM Chain

• Add foundation for chain execution with database schema by @vprashrex in #616

Multimodal

• Providers Extended to handle image/pdf/multimodal flows by @vprashrex in #628

Security & Dependencies

• Vulnerable Dependencies by @AkhileshNegi in #625
• Bump werkzeug from 3.1.5 to 3.1.6 by @dependabot[bot] in #627
• Bump actions/upload-artifact from 6 to 7 by @dependabot[bot] in #631
• Bump actions/github-script from 7 to 8 by @dependabot[bot] in #649

Unified API (TTS/STT)

• Integrate Sarvam as a Provider for STT and TTS by @rajagopalmotivate @Prajna1999 in #621
• Integrate ElevenLabs as a Provider for STT and TTS by @rajagopalmotivate @Prajna1999 in #650
• Smart Defaults for Config Params in Native and Kaapi Abstracted Flow by @Prajna1999 in #678

New Contributors

• @rajagopalmotivate made their first contribution in #621

Full Changelog: v0.7.0...v0.8.0

v0.7.0

What's Changed

Collections

• Parameter enhancements by @nishika26 in #622

Evaluation

• Add score trace URL to evaluation run by @vprashrex in #558
• Refactor cron by @AkhileshNegi in #594
• STT Evaluation by @AkhileshNegi in #571 & #601

Guardrails

• Guardrails Integration by @rkritika1508 in #575
• Config Management by @rkritika1508 in #599

Language

• Initialization by @AkhileshNegi in #583

Migrations & Deployment

• Auto-run migrations on staging deployment by @vprashrex in #592

Security & Dependencies

• Fix CVE-2026-25990 and CVE-2026-26007 vulnerabilities by @vprashrex in #603
• Bump aws-actions/configure-aws-credentials from 5 to 6 by @dependabot[bot] in #585

Unified API (TTS/STT)

• Speech-To-Text Using Gemini by @Prajna1999 in #550
• Text-To-Speech Using Gemini by @Prajna1999 in #574

New Contributors

• @rkritika1508 made their first contribution in #575

Full Changelog: v0.6.0...v0.7.0