-
Notifications
You must be signed in to change notification settings - Fork 10
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
Is your feature request related to a problem?
Sporadically, the LLM-as-a-judge score does not sync for some evaluations in Kaapi Konsole, despite being available in Langfuse. This issue persists even after attempting to resync the score.
Describe the solution you'd like
- Investigate the syncing issue between LLM-as-a-judge in Kaapi Konsole
- Ensure that resyncing reliably updates the scores in all cases.
- Provide error logging or feedback when syncing fails
Screenshot
This has happened for Antara while running recent evaluations
Langfuse Project: kaapi-antara
Kaapi Konsole Project: Kaapi-antara

Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working
Type
Projects
Status
Closed