allgather_run() — pytorch Function Reference

Architecture documentation for the allgather_run() function in benchmark.py from the pytorch codebase.

Function python CoreTensor Dispatcher calls 1 called by 1

Entity Profile

CoreTensor→ Dispatcher→ allgather_run() — pytorch Function Reference

Dependency Diagram

graph TD
  d464181f_1726_b6f2_a988_740d44b78bf8["allgather_run()"]
  32bc5158_e977_7f97_b62d_d5c3b8b333f7["main()"]
  32bc5158_e977_7f97_b62d_d5c3b8b333f7 -->|calls| d464181f_1726_b6f2_a988_740d44b78bf8
  9cb370ea_5749_29d9_5dca_4a2b481fcfac["allgather_object()"]
  d464181f_1726_b6f2_a988_740d44b78bf8 -->|calls| 9cb370ea_5749_29d9_5dca_4a2b481fcfac
  style d464181f_1726_b6f2_a988_740d44b78bf8 fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

benchmarks/distributed/ddp/benchmark.py lines 35–41

def allgather_run(cmd):
    proc = subprocess.run(shlex.split(cmd), capture_output=True)
    if proc.returncode != 0:
        raise AssertionError(
            f"Command '{cmd}' failed with return code {proc.returncode}: {proc.stderr.decode('utf-8')}"
        )
    return allgather_object(proc.stdout.decode("utf-8"))