Skip to content

Issues: mlcommons/inference

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

207 Open 698 Closed
207 Open 698 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug] RetinaNet+ONNXRuntime Reference (r5.0-dev): CUDA Error (misaligned/Xid 31) in MultiStream/Offline & ValueError (NaN iscrowd) in Accuracy
#2182 opened Apr 23, 2025 by haonan0x3a1
1
Cleanup/Alignment of submission structure postmortem 5.0
#2181 opened Apr 22, 2025 by pgmpablo157321
Incentivize cooperative behavior and punish uncooperative behavior postmortem 5.0
#2180 opened Apr 22, 2025 by pgmpablo157321
Avoid inadvertently pushed submission results to public repos postmortem 5.0
#2179 opened Apr 22, 2025 by pgmpablo157321
Must preview results be followed by a published result or is a submission + withdrawal acceptable? postmortem 5.0
#2178 opened Apr 22, 2025 by pgmpablo157321
1
Add a requirements for calibration.md postmortem 5.0
#2177 opened Apr 22, 2025 by pgmpablo157321
Consolidate dir structure postmortem 5.0
#2176 opened Apr 22, 2025 by pgmpablo157321
Review meetings automation discussion postmortem 5.0
#2175 opened Apr 22, 2025 by pgmpablo157321
1
Enforce equal issue mode check for open submissions for applicable models postmortem 5.0
#2174 opened Apr 22, 2025 by pgmpablo157321
1
Submission checker should check if the accuracy run is using the complete dataset postmortem 5.0
#2173 opened Apr 22, 2025 by pgmpablo157321
1
Loadgen needs to be updated to help support and enforce the no-sorting outside of the dataset rules for LLMs postmortem 5.0
#2172 opened Apr 22, 2025 by pgmpablo157321
3 tasks
Better support from Loadgen to get optimal server QPS for the submitters postmortem 5.0
#2171 opened Apr 22, 2025 by pgmpablo157321
2 tasks
1
Can we control CPU core usage in MLPerf on NVIDIA Orin?
#2169 opened Apr 16, 2025 by aabhinavg1
Multi-GPU run for Llama2-70b inference
#2165 opened Apr 10, 2025 by mahmoodn
1
V5.0 results table: "download PowerPoint" not really working
#2163 opened Apr 3, 2025 by nvzhihanj
The test result for the inference on 3d-unet-99 model seems abnormal.
#2160 opened Mar 28, 2025 by Bob123Yang
An error occurred when using mlcr to conduct a BERT benchmark test.
#2158 opened Mar 18, 2025 by huagongdiyitupo
1
Seems not support running mlc inferenece on multiple GPUs?
#2157 opened Mar 18, 2025 by Bob123Yang
2
[SDXL] v4.1 nvidia automated benchmark issue
#2154 opened Mar 11, 2025 by Xi0131
1
Problem with run GPTJ-99
#2146 opened Mar 5, 2025 by Agalakdak
Inference 5.0 submission failure for Llama3.1-405b caused by hardcode in submission checker
#2142 opened Feb 28, 2025 by zhonglidaniel
1
Refactor TEST01 message so it's less confusing
#2138 opened Feb 25, 2025 by nvzhihanj
Fail to build the docker for mlc command on Ubuntu 22.04
#2132 opened Feb 25, 2025 by Bob123Yang
7
Resnet50 MLPerf 4.1 Attribute Error: ResNet50EngineBuilder object has no attribute calibrator
#2129 opened Feb 21, 2025 by SomeGuyFarAway
Error in RsNet50 server run
#2128 opened Feb 21, 2025 by KathpaliaChirag
ProTip! Updated in the last three days: updated:>2025-05-04.