Skip to content

[DRAFT]: Adding basic scoring in GUI #1980

Draft
jbolor21 wants to merge 4 commits into
microsoft:mainfrom
jbolor21:bjagdagdorj/gui_add_scorers
Draft

[DRAFT]: Adding basic scoring in GUI #1980
jbolor21 wants to merge 4 commits into
microsoft:mainfrom
jbolor21:bjagdagdorj/gui_add_scorers

Conversation

@jbolor21

@jbolor21 jbolor21 commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Description

A working POC for adding scorers into the GUI

Basic Screenshots:
(Score specific message in conversation)
image

(Score full conversation)
image
image
image

vs scoring just one piece
image

(for follow up work or design questions):

  • rescore
  • delete score
  • adding to attack history

@jbolor21 jbolor21 marked this pull request as draft June 9, 2026 22:40

@rlundeen2 rlundeen2 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is so cool!

I wonder if we should have a walk through. I have some initial thoughts through looking at the screenshots.

  1. I think we want to make it REALLY easy to manage the objective score. And for that we also need easy ways to tie objectives to each "attack"
  2. It would be really great to allow humans to score the objective, and this overrides the auto scores. But you could also auto score
  3. It would also be great to have an objective scorer that just scores for you

There is 100% a ton here we can reuse (and it might be a slightly different brainstorm). Can you schedule a meeting and we can look at this? I'd love to prioritize this work (non urgent though)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants