User Guide

This section introduces how to use Hints, TLE-Lite, TLE-Struct, and TLE-Raw compiler languages to optimize the compilation. Regarding how to choose between Hints, TLE-Lite, TLE-Struct, and TLE-Raw, you are recommended to read the FlagTree Overview first.

• Use Hints
  • Supported hints
• Use TLE-Lite
  • Memory management
  • Tensor slicing
  • Scan and sort Ops
  • Pipeline
  • Distribution
  • Primitives interactive with local_ptr
• Use TLE-Struct
  • GPU memory management
  • Execution orchestration
  • DSA memory management and data movement
  • Vector operators (Buffer form)
  • Loops and Hints
  • Slicing and view
• Use TLE-Raw
  • Integrate MLIR dialect into LLVM for portability and composable optimization
  • Integrate CUDA into LLVM for maximum fine-grained control
• Use TLE-CPU
  • Architecture Overview
  • Supported CPU architectures
  • Arm64 CPU related links
• Examples
  • Sparse MLA Forward