Megatron-LM-FL User Guide

This section provides detailed guidance on using Megatron-LM-FL. For end-to-end training workflows，see End-to-End Use Case: TransformerEngine-FL + Megatron-LM-FL + FlagScale.

• Override Plugin Mechanism
  • Core Concepts
  • 1. Replacing a Class Method
  • 2. Replacing a Module-Level Function
  • 3. Replacing an Entire Class
  • Multi-Vendor Support
  • method_key Generation Rules
  • Quick Start Checklist