__post_init__() — pytorch Function Reference

Architecture documentation for the __post_init__() function in generate_kernels.py from the pytorch codebase.

Function python CoreTensor Dispatcher calls 1 called by 1

Entity Profile

CoreTensor→ Dispatcher→ __post_init__() — pytorch Function Reference

Dependency Diagram

graph TD
  4ef88021_ab7d_96c9_bc9d_caab0cbeafee["__post_init__()"]
  cd417a58_19c8_e2b0_9578_fd8e295187a9["__post_init__()"]
  cd417a58_19c8_e2b0_9578_fd8e295187a9 -->|calls| 4ef88021_ab7d_96c9_bc9d_caab0cbeafee
  cd417a58_19c8_e2b0_9578_fd8e295187a9["__post_init__()"]
  4ef88021_ab7d_96c9_bc9d_caab0cbeafee -->|calls| cd417a58_19c8_e2b0_9578_fd8e295187a9
  style 4ef88021_ab7d_96c9_bc9d_caab0cbeafee fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

aten/src/ATen/native/transformers/cuda/mem_eff_attention/kernels/generate_kernels.py lines 62–75

    def __post_init__(self) -> None:
        # Set kernel selection priority
        # The lowest value that matches inputs
        # will be selected
        self.sort_index = (
            # First select aligned kernel
            0 if self.aligned else 1,
            # Then keep output in RF
            self.max_k,
            self.k,
            # Prefer kernels without dropout/bias if available
            1 if self.supports_dropout else 0,
            1 if self.supports_bias else 0,
        )