Skip to content

Evaluation: Fix LLM score syncing #671

@AkhileshNegi

Description

@AkhileshNegi

Is your feature request related to a problem?
Sporadically, the LLM-as-a-judge score does not sync for some evaluations in Kaapi Konsole, despite being available in Langfuse. This issue persists even after attempting to resync the score.

Describe the solution you'd like

  • Investigate the syncing issue between LLM-as-a-judge in Kaapi Konsole
  • Ensure that resyncing reliably updates the scores in all cases.
  • Provide error logging or feedback when syncing fails

Screenshot
This has happened for Antara while running recent evaluations

Langfuse Project: kaapi-antara
Kaapi Konsole Project: Kaapi-antara

Image Image

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

Status

Closed

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions