Home / Function/ benchmark() — pytorch Function Reference

benchmark() — pytorch Function Reference

Architecture documentation for the benchmark() function in kernels.py from the pytorch codebase.

Entity Profile

Dependency Diagram

graph TD
  9ad13df4_e4bb_8645_a1ce_35d8e720f64d["benchmark()"]
  aff66d05_5d3d_4da7_8411_2f17754c512b["get_shapes()"]
  9ad13df4_e4bb_8645_a1ce_35d8e720f64d -->|calls| aff66d05_5d3d_4da7_8411_2f17754c512b
  38cd02c9_bda5_f921_f4c9_f7772e1a880b["benchmark_single_shape()"]
  9ad13df4_e4bb_8645_a1ce_35d8e720f64d -->|calls| 38cd02c9_bda5_f921_f4c9_f7772e1a880b
  style 9ad13df4_e4bb_8645_a1ce_35d8e720f64d fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

benchmarks/dynamo/genai_layers/kernels.py lines 727–734

    def benchmark(self):
        for M, N in self.get_shapes():
            print(f"Tensor dimensions: [{M}, {N}]")
            torch_dtype = cutlass_torch.dtype(cutlass.BFloat16)
            x = torch.randn(M, N, device="cuda", dtype=torch_dtype, requires_grad=True)
            w = torch.randn(N, device="cuda", dtype=torch.float32, requires_grad=True)
            dy = torch.randn(M, N, device="cuda", dtype=torch_dtype)
            self.benchmark_single_shape((x, w, dy), setting=f"shape: [{M}, {N}]")

Subdomains

Frequently Asked Questions

What does benchmark() do?
benchmark() is a function in the pytorch codebase.
What does benchmark() call?
benchmark() calls 2 function(s): benchmark_single_shape, get_shapes.

Analyze Your Own Codebase

Get architecture documentation, dependency graphs, and domain analysis for your codebase in minutes.

Try Supermodel Free