Home / Function/ get_memory_bytes() — pytorch Function Reference

get_memory_bytes() — pytorch Function Reference

Architecture documentation for the get_memory_bytes() function in kernels.py from the pytorch codebase.

Function python DynamoBenchmarks Microbenchmarking

Entity Profile

Relationship Graph

Source Code

benchmarks/dynamo/genai_layers/kernels.py lines 666–674

    def get_memory_bytes(self, args, kwargs) -> int:
        x, w, dy = args
        M, N = x.shape
        # Read x ([M, N]), w ([N]), dy ([M, N]), write dx ([M, N]), dw ([N])
        return (
            2 * M * N * x.dtype.itemsize
            + 2 * N * w.dtype.itemsize
            + M * N * dy.dtype.itemsize
        )

Domain

Subdomains

Source

Analyze Your Own Codebase

Get architecture documentation, dependency graphs, and domain analysis for your codebase in minutes.

Try Supermodel Free