Tell agents to read in their rules to reduce the number of denied calls#119
Tell agents to read in their rules to reduce the number of denied calls#119mdeyell-valid-mind wants to merge 7 commits into
Conversation
even-steven
left a comment
There was a problem hiding this comment.
Two issues worth addressing before merge:
(1) formatRulesContext/rulesContext/combineContext are copy-pasted identically into all three example files — a shared module or at-minimum sync comments would help;
(2) the request_id fallback in handleAtryumRulesToolCall isn't listed in the MCP tool's InputSchema.
bfcd5f3 to
bd27603
Compare
7135aec to
bb215d4
Compare
The complication with number 1 is that these files would no longer be directly copy able ie |
I updated number 2 |
We would like agents to be able to read in their rules to reduce the number of denied calls.
A previous version of this pr added a mcp tool for this but it was useless for the agent harnesses. This time around, we have the harnesses hit the rules endpoint every 5 minutes to get their rules. The mcp rule call also got readded.
#91
Open question:
Currently, i only expose static tools to the agent. Should we also expose llm as judge rules? I wonder if an agent knowing about llm as judge rules could make it act differently hmmmmm