Home / Function/ get_memory_bytes() — pytorch Function Reference

get_memory_bytes() — pytorch Function Reference

Architecture documentation for the get_memory_bytes() function in kernels.py from the pytorch codebase.

Function python DynamoBenchmarks Microbenchmarking

Entity Profile

Relationship Graph

Source Code

benchmarks/dynamo/genai_layers/kernels.py lines 141–150

    def get_memory_bytes(self, args, kwargs) -> int:
        # Read x (M*N elements) + read target (M elements) + read dloss (M elements) + write grad(M*N elements)
        x, target, dloss = args
        # Memory ba
        M, N = x.shape
        return (
            2 * M * N * x.dtype.itemsize
            + M * target.dtype.itemsize
            + M * dloss.dtype.itemsize
        )

Domain

Subdomains

Source

Analyze Your Own Codebase

Get architecture documentation, dependency graphs, and domain analysis for your codebase in minutes.

Try Supermodel Free