MaxText release notes

MaxText release notes#

PyPI Package#

MaxText is available in PyPI and can be installed through pip. Please see our MaxText Installation Guide for setup instructions.

Releases#

v0.2.3#

Changes#

  • Upgraded JAX to version 0.10.0 for pre-training and 0.10.1 for post-training.

  • New vLLM-Powered Evaluation Framework: Introduced an eval framework for running lm-eval, evalchemy, and custom benchmarking against MaxText checkpoints. See the evaluation guide for details.

  • Added support for pre-training new models:

    • Qwen3.5: Qwen3.5 35B & 397B is now supported.

    • Qwen3-Omni: Support for multimodal SFT (PR #3863).

  • Direct Preference Optimization (DPO/ORPO) Support: Full support for DPO and ORPO alignment pipelines. See the DPO tutorial for details.

  • Reinforcement Learning (RL) Recipe: Added a pre-configured RL recipe for Qwen3-30b-a3b.

  • Iterative Quality Monitoring (RL): Added intermediate evaluation hooks to automatically run quality benchmarks during RL training (every eval_interval steps), optimized with a new eval_batch_size configuration knob.

  • Developer Extensibility: Added dataset_processor_path CLI knob for custom dataset integration, and refactored shared post-training hooks to simplify custom SFT, DPO, and RL workflow development.

  • Generalized Learn-to-Init (LTI) for Distillation: Enhanced post-training distillation capabilities with generalized LTI support.

  • Added support for recording elastic goodput events during training to track efficiency (PR #3901).

  • Installation Updates: Updated the [tpu-post-train] installation command to require UV_TORCH_BACKEND=cpu(see Installation Guide).

  • Zero1 AOT Compilation: Added zero1 support to Ahead-Of-Time (AOT) compilation in train compile, improving compilation capabilities for zero1 config.

  • MoE Performance Optimization: Integrated ragged gather reduce into Mixture of Experts (MoE) layers to optimize memory and performance by replacing ragged scatter and supporting backward pass.

  • Added E2E scripts to run checkpoint conversion, pre-training and post-training (SFT, RL) with Gemma3-4B model.

  • Bug Fixes and Usability Enhancements:

    • Attention Masking Fix in RL: Fixed an issue in TunixMaxTextAdapter where queries at non-pad positions could attend to pad-position keys during training, which was corrupting log-probabilities and affecting GRPO training reward trajectories (PR #4016).

    • JAX/NNX Gradient Mutation Fix: Refactored post-training loops (train_distill, train_sft, train_rl) to use jax.value_and_grad with explicit NNX state split/merge instead of nesting nnx.value_and_grad inside nnx.jit (PR #3652).

    • Qwen3-MoE Checkpoint Conversion: Fixed checkpoint conversion issues for Qwen3-MoE models (PR #3868).

    • Duplicate Configuration Failures Fix: Allowed identical config overrides and handled configuration exceptions cleanly (PR #3933).

  • Documentation Improvements: Updated Getting started guide, including new guides for the evaluation framework and the DPO tutorial.

Deprecations#

v0.2.2#

Changes#

  • Upgraded JAX to version 0.9.2, improving support for both pre-training and post-training.

  • Introduced simplified APIs for accessing MaxText models.

  • Included maxtext_with_gepa.ipynb, a new notebook demonstrating AIME prompt optimization using the GEPA framework within MaxText.

  • Added support for Kimi-K2 models and the MuonClip optimizer. Users can explore this with the kimi-k2-1t config (see user guide for details).

  • Kimi-K2-Thinking, Kimi-K2.5 (text), and Kimi-K2.6 (text) are now supported. See Run_Kimi.md for details.

  • DeepSeek-V3.2 is now supported, including DeepSeek Sparse Attention for handling long contexts. Use the deepseek3.2-671b config to try it out (refer to the user guide for more information).

  • Support has been added for Gemma 4 multi-modal models (26B MoE and 31B dense). These can be used with the gemma4-26b and gemma4-31b configs. See Run_Gemma4.md for further details.

  • Support has been added for Gemma 4 inference using MaxText on vLLM plugin.

  • Enhanced RL capabilities with support for the open-r1/OpenR1-Math-220k dataset and nvidia/OpenMathReasoning.

  • Added more evaluation modes for RL like majority voting and pass@1 estimation.

  • Sync weights to vllm prior to pre RL evaluation.

  • More robust usage of math-verify in RL.

  • MaxText’s Supervised Fine-Tuning (SFT) now supports non-instruct models.

  • Added support for tensor parallelism using the Fused MoE kernel for MaxText on vLLM inference.

  • Added support for MaxText to vllm converters for Qwen3 and Gemma4 family of models.

  • validate_converter.py now runs on multislice environment to test larger models with utilities to compare maxtext and vllm weights.

Deprecations#

  • Legacy MaxText.* shims have been removed. Please refer to src/MaxText/README.md for details on the new command locations and how to migrate.

  • Sequence parallelism has been deprecated, please use context parallelism instead.

  • The flag expert_shard_attention_option is deprecated, use custom_mesh_and_rule=ep-as-cp for the same functionality.

v0.2.1#

Changes#

  • Use the new maxtext[runner] installation option to build Docker images without cloning the repository. This can be used for scheduling jobs through XPK. See the MaxText installation instructions for more info.

  • Config can now be inferred for most MaxText commands. If you choose not to provide a config, MaxText will now select an appropriate one.

  • Configs in MaxText PyPI will now be picked up without storing them locally.

  • New features from DeepSeek-AI are now supported: Conditional Memory via Scalable Lookup (Engram) and Manifold-Constrained Hyper-Connections (mHC). Try them out with our deepseek-custom starter config.

  • MaxText now supports customizing your own mesh and logical rules. Two examples guiding how to use your own mesh and rules for sharding are provided in the custom_mesh_and_rule directory.

v0.2.0#

Changes#

Deprecations#

  • Many MaxText modules have changed locations. Core commands like train, decode, sft, etc. will still work as expected temporarily. Please update your commands to the latest file locations

  • install_maxtext_github_deps installation script replaced with install_maxtext_tpu_github_deps

  • tools/setup/setup_post_training_requirements.sh for post training dependency installation is deprecated in favor of pip installation

v0.1.0#

Our first MaxText PyPI package is here! MaxText is a high performance, highly scalable, open-source LLM library and reference implementation written in pure Python/JAX and targeting Google Cloud TPUs and GPUs for training. We are excited to make it easier than ever to get started.

Users can now install MaxText through pip, both for local development and through stable PyPI builds. Please see our MaxText Installation Guide for more setup details.

Going forward, this page will document notable changes as we release new versions of MaxText.