MaxText release notes

MaxText release notes#

PyPI Package#

MaxText is available in PyPI and can be installed through pip. Please see our MaxText Installation Guide for setup instructions.

Releases#

v0.2.2#

Changes#

  • Upgraded JAX to version 0.9.2, improving support for both pre-training and post-training.

  • Introduced simplified APIs for accessing MaxText models.

  • Included maxtext_with_gepa.ipynb, a new notebook demonstrating AIME prompt optimization using the GEPA framework within MaxText.

  • Added support for Kimi-K2 models and the MuonClip optimizer. Users can explore this with the kimi-k2-1t config (see user guide for details).

  • Kimi-K2-Thinking, Kimi-K2.5 (text), and Kimi-K2.6 (text) are now supported. See Run_Kimi.md for details.

  • DeepSeek-V3.2 is now supported, including DeepSeek Sparse Attention for handling long contexts. Use the deepseek3.2-671b config to try it out (refer to the user guide for more information).

  • Support has been added for Gemma 4 multi-modal models (26B MoE and 31B dense). These can be used with the gemma4-26b and gemma4-31b configs. See Run_Gemma4.md for further details.

  • Support has been added for Gemma 4 inference using MaxText on vLLM plugin.

  • Enhanced RL capabilities with support for the open-r1/OpenR1-Math-220k dataset and nvidia/OpenMathReasoning.

  • Added more evaluation modes for RL like majority voting and pass@1 estimation.

  • Sync weights to vllm prior to pre RL evaluation.

  • More robust usage of math-verify in RL.

  • MaxText’s Supervised Fine-Tuning (SFT) now supports non-instruct models.

  • Added support for tensor parallelism using the Fused MoE kernel for MaxText on vLLM inference.

  • Added support for MaxText to vllm converters for Qwen3 and Gemma4 family of models.

  • validate_converter.py now runs on multislice environment to test larger models with utilities to compare maxtext and vllm weights.

Deprecations#

  • Legacy MaxText.* shims have been removed. Please refer to src/MaxText/README.md for details on the new command locations and how to migrate.

  • Sequence parallelism has been deprecated, please use context parallelism instead.

  • The flag expert_shard_attention_option is deprecated, use custom_mesh_and_rule=ep-as-cp for the same functionality.

v0.2.1#

Changes#

  • Use the new maxtext[runner] installation option to build Docker images without cloning the repository. This can be used for scheduling jobs through XPK. See the MaxText installation instructions for more info.

  • Config can now be inferred for most MaxText commands. If you choose not to provide a config, MaxText will now select an appropriate one.

  • Configs in MaxText PyPI will now be picked up without storing them locally.

  • New features from DeepSeek-AI are now supported: Conditional Memory via Scalable Lookup (Engram) and Manifold-Constrained Hyper-Connections (mHC). Try them out with our deepseek-custom starter config.

  • MaxText now supports customizing your own mesh and logical rules. Two examples guiding how to use your own mesh and rules for sharding are provided in the custom_mesh_and_rule directory.

v0.2.0#

Changes#

Deprecations#

  • Many MaxText modules have changed locations. Core commands like train, decode, sft, etc. will still work as expected temporarily. Please update your commands to the latest file locations

  • install_maxtext_github_deps installation script replaced with install_maxtext_tpu_github_deps

  • tools/setup/setup_post_training_requirements.sh for post training dependency installation is deprecated in favor of pip installation

v0.1.0#

Our first MaxText PyPI package is here! MaxText is a high performance, highly scalable, open-source LLM library and reference implementation written in pure Python/JAX and targeting Google Cloud TPUs and GPUs for training. We are excited to make it easier than ever to get started.

Users can now install MaxText through pip, both for local development and through stable PyPI builds. Please see our MaxText Installation Guide for more setup details.

Going forward, this page will document notable changes as we release new versions of MaxText.