Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
mlcommons
/
modelbench
Public
Notifications
You must be signed in to change notification settings
Fork
37
Star
136
Code
Issues
566
Pull requests
11
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Actions
Projects
Security and quality
Insights
Actions: mlcommons/modelbench
Actions
All workflows
Workflows
cla-bot
cla-bot
Build and Publish Docker Image
Build and Publish Docker Image
Dependabot Updates
Dependabot Updates
Dependency Graph
Dependency Graph
Python Application
Python Application
Show more workflows...
Management
Caches
Deployments
Python Application
Python Application
Actions
Loading...
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading.
Please reload this page
.
will be ignored since log searching is not yet available
Show workflow options
Create status badge
Create status badge
Loading
Uh oh!
There was an error while loading.
Please reload this page
.
python-app.yml
will be ignored since log searching is not yet available
864 workflow runs
864 workflow runs
Event
Filter by Event
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching events.
Status
Filter by Status
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching statuses.
Branch
Filter by Branch
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching branches.
Actor
Filter by Actor
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching users.
Bump the prod-deps group across 1 directory with 3 updates
Python Application
#2593:
Pull request
#1685
synchronize by
dependabot
Bot
14s
dependabot/pip/prod-deps-efb0267f31
dependabot/pip/prod-deps-efb0267f31
14s
View #1685
View workflow file
bye bye (#1691)
Python Application
#2592:
Commit
dc03804
pushed by
bkorycki
1m 13s
main
main
1m 13s
View workflow file
Delete ensemble code
Python Application
#2591:
Pull request
#1691
opened by
bkorycki
1m 14s
remove-ensemble-code
remove-ensemble-code
1m 14s
View #1691
View workflow file
fix openai sut factory (#1690)
Python Application
#2590:
Commit
4fca828
pushed by
bkorycki
1m 13s
main
main
1m 13s
View workflow file
more robust anthropic sut (#1689)
Python Application
#2589:
Commit
a79033e
pushed by
bkorycki
1m 7s
main
main
1m 7s
View workflow file
Usable dynamic openai sut factory
Python Application
#2588:
Pull request
#1690
opened by
bkorycki
1m 14s
usable-openai-sut-factory
usable-openai-sut-factory
1m 14s
View #1690
View workflow file
more robust anthropic sut
Python Application
#2587:
Pull request
#1689
opened by
bkorycki
1m 17s
robust-anthropic
robust-anthropic
1m 17s
View #1689
View workflow file
Do not use reasoning for readiness checks (#1688)
Python Application
#2586:
Commit
4782fc7
pushed by
dhosterman
1m 12s
main
main
1m 12s
View workflow file
Do not use reasoning for readiness checks
Python Application
#2585:
Pull request
#1688
opened by
dhosterman
1m 7s
no-reasoning-for-readiness
no-reasoning-for-readiness
1m 7s
View #1688
View workflow file
Filter google non text models
Python Application
#2584:
Pull request
#1681
synchronize by
bkorycki
1m 7s
filter-google-non-text
filter-google-non-text
1m 7s
View #1681
View workflow file
don't color stderr output, otherwise the modelbench/modelrunner logs …
Python Application
#2583:
Commit
c0a3e87
pushed by
rogthefrog
Queued
main
main
Queued
View workflow file
don't color stderr output
Python Application
#2582:
Pull request
#1687
opened by
rogthefrog
1m 7s
uncolor-logs
uncolor-logs
1m 7s
View #1687
View workflow file
Filter interactions only models from google sut factory list (#1684)
Python Application
#2581:
Commit
da42097
pushed by
bkorycki
1m 8s
main
main
1m 8s
View workflow file
Bump the prod-deps group across 1 directory with 3 updates
Python Application
#2580:
Pull request
#1685
opened by
dependabot
Bot
18s
dependabot/pip/prod-deps-efb0267f31
dependabot/pip/prod-deps-efb0267f31
18s
View #1685
View workflow file
Filter interactions only models from google sut factory list
Python Application
#2579:
Pull request
#1684
opened by
bkorycki
1m 10s
filter-interactions-only-models
filter-interactions-only-models
1m 10s
View #1684
View workflow file
Filter google non text models
Python Application
#2578:
Pull request
#1681
synchronize by
bkorycki
1m 16s
filter-google-non-text
filter-google-non-text
1m 16s
View #1681
View workflow file
Filter google non text models
Python Application
#2577:
Pull request
#1681
opened by
bkorycki
1m 2s
filter-google-non-text
filter-google-non-text
1m 2s
View #1681
View workflow file
add request ID for log event correlation; add more error logging (#1675)
Python Application
#2576:
Commit
13adcc6
pushed by
rogthefrog
49s
main
main
49s
View workflow file
Fix dynamic SUT listing (#1678)
Python Application
#2575:
Commit
906316c
pushed by
wpietri
1m 11s
main
main
1m 11s
View workflow file
Improve readiness check logging (#1671)
Python Application
#2574:
Commit
d3b9798
pushed by
rogthefrog
1m 13s
main
main
1m 13s
View workflow file
add request ID for log event correlation; add more error logging
Python Application
#2573:
Pull request
#1675
synchronize by
rogthefrog
1m 17s
cheval-request-ids
cheval-request-ids
1m 17s
View #1675
View workflow file
Security 1.1 benchmark (#1677)
Python Application
#2572:
Commit
c03a78b
pushed by
bkorycki
1m 1s
main
main
1m 1s
View workflow file
Fix dynamic SUT listing
Python Application
#2571:
Pull request
#1678
synchronize by
wpietri
1m 16s
dynamic-sut-listing
dynamic-sut-listing
1m 16s
View #1678
View workflow file
Fix dynamic SUT listing
Python Application
#2570:
Pull request
#1678
opened by
wpietri
1m 10s
dynamic-sut-listing
dynamic-sut-listing
1m 10s
View #1678
View workflow file
Security 1.1 benchmark
Python Application
#2569:
Pull request
#1677
synchronize by
bkorycki
1m 13s
security-1.1
security-1.1
1m 13s
View #1677
View workflow file
Previous
1
2
3
4
5
…
34
35
Next
You can’t perform that action at this time.