Skip to main content
Back to top
Ctrl
+
K
Search
Ctrl
+
K
MaxText
Getting Started
Install MaxText
Tutorials
Build and upload MaxText Docker images
Pre-training
Post-training
SFT on single-host TPUs
SFT on multi-host TPUs
Preference Optimization (DPO & ORPO) on Single-Host TPUs
Reinforcement Learning on single-host TPUs
Reinforcement Learning on Multi-Host TPUs
Reinforcement Learning with Qwen3-30b-a3b-base on Multi-Host TPUs
Knowledge distillation
LoRA Fine-tuning on single-host TPUs
Multimodal support
Full fine-tuning on single-host TPUs
GEPA Prompt Optimization for MaxText
Inference on MaxText
Run MaxText
Via localhost or single-host VM
Via single-host GPU
At scale with XPK
Via Pathways
Via Decoupled Mode (No Google Cloud Dependencies)
How-to guides
Optimization
Customizing model configs for TPUs
Sharding on TPUs
Customizing mesh and rule for advanced sharding features in MaxText
Optimizing with Pallas kernels
Benchmarking & tuning guide
Data pipelines
Grain pipeline
Hugging Face pipeline
TFDS pipeline
OLMo numpy pipeline (
dataset_type=olmo_grain
)
Optimizing pipeline performance
Checkpointing
GCS bucket-based checkpointing
Emergency checkpointing
Multi-tier checkpointing
Checkpoint Conversion Utilities
Monitoring and debugging
Features and diagnostics
Enable GCP workload observabiltiy
Troubleshooting: Megascale hangs
ML Goodput measurement
Understand logs and metrics
Use Vertex AI Tensorboard
Profiling with XProf
Running a workload with Google Cloud ML Diagnostics Enabled
Run MaxText Python Notebooks on TPUs
MaxText Model Bringup: Community Contributor Guide
Distillation
MaxText vLLM Eval Framework
Reference documentation
Performance metrics
Models
Optimized models tiering
Supported models list
Architecture
Architecture overview
MaxText and the JAX ecosystem
Core concepts
Checkpoints
Comparison to alternatives
Batch Size
Quantization
Tiling
JAX, XLA, and Pallas
Mixture of Experts (MoE) Configuration
How to Contribute
Update MaxText dependencies
Contribute to documentation
HLO Graph Diff Verification Testing
MaxText release notes
Search
Error
Please activate JavaScript to enable the search functionality.
Ctrl
+
K
