Skip to content

Tell agents to read in their rules to reduce the number of denied calls#119

Open
mdeyell-valid-mind wants to merge 7 commits into
mainfrom
mdeyell/gh-91/agent-rules
Open

Tell agents to read in their rules to reduce the number of denied calls#119
mdeyell-valid-mind wants to merge 7 commits into
mainfrom
mdeyell/gh-91/agent-rules

Conversation

@mdeyell-valid-mind

@mdeyell-valid-mind mdeyell-valid-mind commented Jun 23, 2026

Copy link
Copy Markdown
Contributor

We would like agents to be able to read in their rules to reduce the number of denied calls.
A previous version of this pr added a mcp tool for this but it was useless for the agent harnesses. This time around, we have the harnesses hit the rules endpoint every 5 minutes to get their rules. The mcp rule call also got readded.

#91

Open question:
Currently, i only expose static tools to the agent. Should we also expose llm as judge rules? I wonder if an agent knowing about llm as judge rules could make it act differently hmmmmm

Screenshot 2026-06-26 at 16 05 08

@mdeyell-valid-mind

Copy link
Copy Markdown
Contributor Author

#91

@mdeyell-valid-mind mdeyell-valid-mind marked this pull request as ready for review June 26, 2026 23:07

@even-steven even-steven left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Two issues worth addressing before merge:
(1) formatRulesContext/rulesContext/combineContext are copy-pasted identically into all three example files — a shared module or at-minimum sync comments would help;

(2) the request_id fallback in handleAtryumRulesToolCall isn't listed in the MCP tool's InputSchema.

@mdeyell-valid-mind mdeyell-valid-mind force-pushed the mdeyell/gh-91/agent-rules branch from bfcd5f3 to bd27603 Compare July 6, 2026 23:09
@mdeyell-valid-mind mdeyell-valid-mind force-pushed the mdeyell/gh-91/agent-rules branch from 7135aec to bb215d4 Compare July 6, 2026 23:18
@mdeyell-valid-mind

Copy link
Copy Markdown
Contributor Author

(1) formatRulesContext/rulesContext/combineContext are copy-pasted identically into all three example files — a shared module or at-minimum sync comments would help;

The complication with number 1 is that these files would no longer be directly copy able ie cp examples/pi-extension/index.ts /path/to/your/pi-extension/index.ts

@mdeyell-valid-mind

Copy link
Copy Markdown
Contributor Author

(2) the request_id fallback in handleAtryumRulesToolCall isn't listed in the MCP tool's InputSchema.

I updated number 2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants