Skip to content

Update benchmarking docs and add ResNet results - #276

Open
chloecrozier wants to merge 5 commits into
mainfrom
ccrozier-251-benchmark-docs
Open

Update benchmarking docs and add ResNet results#276
chloecrozier wants to merge 5 commits into
mainfrom
ccrozier-251-benchmark-docs

Conversation

@chloecrozier

@chloecrozier chloecrozier commented Aug 26, 2026

Copy link
Copy Markdown
Member

Numbers disagreed across the README, benchmarking pages, and tutorials.
Consolidates them onto one measured cross-host testbed.

Updated:

  • Raw Ethernet, RoCE, and socket figures; every published row is loss-free
  • README mirrors the benchmarking page, so they cannot diverge again

Added (requested in review):

  • Five-model ResNet inference results
  • Socket core scaling: TCP 52.0 -> 105.2 -> 108.5 Gb/s on 1/2/4 cores, replacing a table that showed 48% loss
  • PCIe Gen5 x4 host attach (126 Gb/s), the ceiling behind every row

RTX PRO 6000 400 GbE benchmarks land in #162.

Test: mkdocs build --strict, check_doc_refs.py, check_html_links.py

@greptile-apps

greptile-apps Bot commented Aug 26, 2026

Copy link
Copy Markdown
Contributor

Greptile Summary

The PR consolidates DGX Spark benchmark documentation around measured cross-host and single-host testbeds and adds five-model ResNet inference results.

  • Adds role-specific cross-host TCP and UDP configurations and reproduction instructions.
  • Adds paced UDP benchmarking and updated TCP/UDP scaling results.
  • Aligns the README, benchmark pages, and tutorials around the revised measurements.

Confidence Score: 5/5

The PR appears safe to merge because both previously reported failures are resolved and no blocking failure remains.

No blocking failure remains.

Important Files Changed

Filename Overview
README.md Updates headline benchmark and ResNet figures; the previous ambiguous socket core-count claim is no longer present.
docs/benchmarks/performance-dgx-spark.md Reworks the benchmark methodology, results, scaling definitions, and reproduction commands; the formerly missing cross-host socket configurations are now referenced by their checked-in names.
docs/benchmarks/socket_benchmarking.md Replaces lossy socket examples with cross-host loss-free TCP and paced UDP results.
docs/tutorials/daqiri-resnet-inference.md Expands the inference tutorial to cover the five measured ResNet variants and their results.
examples/socket_bench.cpp Adds target-rate pacing and benchmark-worker affinity support without leaving an eligible blocking issue from the prior threads.
examples/run_spark_bench.sh Extends benchmark orchestration for the revised socket measurements.
examples/daqiri_bench_socket_udp_server_spark_xhost.yaml Adds the server role configuration needed by the corrected cross-host UDP reproduction command.
examples/daqiri_bench_socket_udp_client_spark_xhost.yaml Adds the matching paced cross-host UDP client configuration.
examples/daqiri_bench_socket_tcp_server_spark_xhost.yaml Adds the server role configuration for cross-host TCP measurements.
examples/daqiri_bench_socket_tcp_client_spark_xhost.yaml Adds the matching cross-host TCP client configuration.

Reviews (8): Last reviewed commit: "#251 - Update cross-host TCP scaling res..." | Re-trigger Greptile

Comment thread README.md Outdated
Comment thread docs/benchmarks/performance-dgx-spark.md Outdated
@chloecrozier chloecrozier changed the title Update DGX Spark benchmarks and add socket core scaling Update benchmarking docs and add ResNet results Aug 26, 2026
@chloecrozier
chloecrozier force-pushed the ccrozier-251-benchmark-docs branch 2 times, most recently from 7ab1004 to 24cb5a7 Compare August 26, 2026 15:17
Benchmark numbers disagreed across the README, the benchmarking pages, and the
tutorials. Consolidate every published figure onto the cross-host 200 GbE pair,
and rerun the socket cells so every published row is loss-free.

- refresh raw Ethernet, RoCE, and socket figures; README mirrors the perf page
- add five-model ResNet inference results
- add socket core scaling, replacing a loopback table that showed 48% loss
- record the PCIe Gen5 x4 host attach (126 Gb/s) as the ceiling behind every row

Signed-off-by: Chloe Crozier <chloecrozier@gmail.com>
@chloecrozier
chloecrozier force-pushed the ccrozier-251-benchmark-docs branch from 24cb5a7 to 0c79c2d Compare August 26, 2026 15:47
Signed-off-by: Denis Leshchev <dleshchev@nvidia.com>
Signed-off-by: Denis Leshchev <dleshchev@nvidia.com>
@dleshchev
dleshchev force-pushed the ccrozier-251-benchmark-docs branch from 18f02ed to ffe79d6 Compare September 1, 2026 23:03
Signed-off-by: Denis Leshchev <dleshchev@nvidia.com>
Signed-off-by: Denis Leshchev <dleshchev@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants