List view

Float16 support with loss / gradient scaling

enhancementNew feature or requestNew feature or request

Status: Open.

#2356 In pytorch/torchtitan;

· wwwjn opened on Feb 9, 2026

Checkpoint enhancement (document, async, etc)

better engineeringRepo code quality improvementsRepo code quality improvements

enhancementNew feature or requestNew feature or request

Status: Open.

#2355 In pytorch/torchtitan;

· wwwjn opened on Feb 9, 2026

End-to-end baselines with currently supported models

enhancementNew feature or requestNew feature or request

Status: Open.

#2352 In pytorch/torchtitan;

· wwwjn opened on Feb 9, 2026

Support for VLMs on Roadmap

high priority

triage review

Status: Open.

Feature

#2320 In pytorch/torchtitan;

· Jeremalloch opened on Feb 3, 2026

Expert Parallel Fast Path and Router Dtype Restoration (from solar-open 102B)

high priority

triage review

Status: Open.

Bug

#2225 In pytorch/torchtitan;

· rakkit opened on Jan 13, 2026

perf(pipeline): implement auto-partition algorithm

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

enhancementNew feature or requestNew feature or request

Status: Open (in progress).

pytorch/torchtitannumber 2113

#2113 In pytorch/torchtitan;

· TXacs opened on Dec 5, 2025

[FSDP2] enable per-param mesh FSDP2 for MoE

ciflow/8gpu

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchtitannumber 2281

#2281 In pytorch/torchtitan;

· weifengpy opened on Jan 28, 2026

Support extending RoPE cache at runtime / after the model is initialized

Status: Open.

#2449 In pytorch/torchtitan;

· wwwjn opened on Feb 27, 2026

Flux attention is_causal need be False + Flex Attention support with is_causal=False

high priority

triage review

Status: Open.

#2297 In pytorch/torchtitan;

· yh8899 opened on Jan 29, 2026

[1/N] Add lora adapters for finetune

ciflow/8gpu

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchtitannumber 2484

#2484 In pytorch/torchtitan;

· mori360 opened on Mar 4, 2026

[Compiler Toolkit] Using copy-engine collectives for prefetching

module: torch.compile

Status: Open.

#2514 In pytorch/torchtitan;

· xmfan opened on Mar 6, 2026

Support LoRA at TorchTitan

Status: Open.

#2515 In pytorch/torchtitan;

· mori360 opened on Mar 6, 2026

Adopt Local Map Wrapper for Inner Attention

ciflow/8gpu

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchtitannumber 2557

#2557 In pytorch/torchtitan;

· acisseJZhong opened on Mar 11, 2026