Add Roark to Evals third-party platforms#985
Open
munkhorgil wants to merge 2 commits into
Open
Conversation
Adds Roark as a first-class evaluation platform under Evals → Third-party Platforms, alongside Bluejay, Cekura, and Coval. - New page pipecat/evals/platforms/roark.mdx covering the pipecat-roark observer, Daily-transport simulation on Pipecat Cloud, personas, flows, metrics, and OpenTelemetry tracing - Register the page in docs.json and add a card on the Evals overview - Include integration-setup and create-simulation demo videos plus a Simulations overview screenshot 🤖 Generated with [Claude Code](https://claude.com/claude-code)
- Add 'Create a Roark account and API key' step so the guide is copy-paste ready - Disambiguate the Pipecat Cloud agent name from the Roark agent name in Step 2 - Use os.environ["ROARK_API_KEY"] in the getting-started sample to match the tracing example - Align agent_id across samples (support-bot-v3) - Alphabetize the evals platform cards (overview.mdx + docs.json) - Refresh dashboard screenshot and integration/simulation videos
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds Roark as a third-party evaluation platform in the Pipecat Evals docs: simulation, observability, tracing, and metrics with native Pipecat Cloud integration over the Daily transport.
Preview
Dashboard
Create a Pipecat integration
Create a simulation
What's included
pipecat/evals/platforms/roark.mdx— overview, how the integration works, getting started, simulations (personas + flows), metrics, tracing, and observabilitydocs.jsonnavigation and linked as a card on the Evals overview pageReview feedback addressed
api_key=os.environ["ROARK_API_KEY"]andagent_idacross samples🤖 Generated with Claude Code