Skip to content

Add quark_grader_time_to_verdict_seconds - #146

Merged
pabo99 merged 5 commits into
omegaup:mainfrom
antedotee:feat/time-to-verdict
Aug 14, 2026
Merged

pabo99 merged 5 commits into
omegaup:mainfrom
antedotee:feat/time-to-verdict

Conversation

@antedotee

Copy link
Copy Markdown
Member

Summary

  • Add quark_grader_time_to_verdict_seconds Summary (same quantiles as queue_delay_seconds)
  • Observe at Finished processing run: now - CreationTime

Rides the existing quark_grader_.* remote_write whitelist — no prod change required. New Relic alert/dashboard panel after merge once the series are live.

Test plan

  • /metrics exposes quark_grader_time_to_verdict_seconds
  • After deploy: FROM Metric WHERE metricName LIKE 'quark_grader_time_to_verdict%' returns data in NR

Made with Cursor

Observe end-to-end submission→verdict latency at Finished processing run,
matching the existing queue_delay_seconds summary shape so it rides the
current remote_write whitelist with no prod change.
Comment thread cmd/omegaup-grader/runner_handler.go Outdated
JE retries would otherwise emit a sample before a final verdict.
ManagerRemoved fires once from RunContext.Close() after retry/abandon.
@codecov

codecov Bot commented Aug 14, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 41.29%. Comparing base (a76bc5f) to head (7211798).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #146      +/-   ##
==========================================
+ Coverage   41.09%   41.29%   +0.19%     
==========================================
  Files          25       25              
  Lines        6867     6868       +1     
==========================================
+ Hits         2822     2836      +14     
+ Misses       3783     3770      -13     
  Partials      262      262              

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@pabo99
pabo99 merged commit 97c3a2d into omegaup:main Aug 14, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants