Home / Function/ benchmark() — pytorch Function Reference

benchmark() — pytorch Function Reference

Architecture documentation for the benchmark() function in kernels.py from the pytorch codebase.

Function python DynamoBenchmarks Configuration calls 2

Entity Profile

Dependency Diagram

graph TD
  ab5a067d_4dce_7aad_050e_58d0942293ee["benchmark()"]
  ac3ec141_641f_f518_d148_001672590f69["get_shapes()"]
  ab5a067d_4dce_7aad_050e_58d0942293ee -->|calls| ac3ec141_641f_f518_d148_001672590f69
  38cd02c9_bda5_f921_f4c9_f7772e1a880b["benchmark_single_shape()"]
  ab5a067d_4dce_7aad_050e_58d0942293ee -->|calls| 38cd02c9_bda5_f921_f4c9_f7772e1a880b
  style ab5a067d_4dce_7aad_050e_58d0942293ee fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

benchmarks/dynamo/genai_layers/kernels.py lines 345–353

    def benchmark(self):
        for M, N in self.get_shapes():
            print(f"Tensor dimensions: [{M}, {N}]")
            torch_dtype = cutlass_torch.dtype(cutlass.BFloat16)
            x = 0.1 * torch.randn(
                M, N, device="cuda", dtype=torch_dtype, requires_grad=True
            )
            dy = torch.randn(M, N, device="cuda", dtype=torch_dtype)
            self.benchmark_single_shape((x, dy), setting=f"shape: [{M}, {N}]")

Domain

Subdomains

Calls

Source

Frequently Asked Questions

What does benchmark() do?
benchmark() is a function in the pytorch codebase.
What does benchmark() call?
benchmark() calls 2 function(s): benchmark_single_shape, get_shapes.

Analyze Your Own Codebase

Get architecture documentation, dependency graphs, and domain analysis for your codebase in minutes.

Try Supermodel Free