Skip to content

Pull requests: microsoft/DeepSpeed

New pull request New
143 Open 2,682 Closed
143 Open 2,682 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Update the list of supported models in the Chinese README of fastgen
#5773 opened Jul 16, 2024 by beep-bebop • Queued
Use accelerator to replace cuda in setup and runner
#5769 opened Jul 15, 2024 by Andy666G Loading…
3
Add fp8-fused gemm kernel
#5764 opened Jul 11, 2024 by sfc-gh-reyazda Loading…
4
Add DataStates-LLM: Asynchronous Checkpointing Engine Support
#5763 opened Jul 10, 2024 by mauryaavinash95 • Draft
1
move is_checkpointable call reducing torch.compile Graph breaks
#5759 opened Jul 9, 2024 by NirSonnenschein Loading…
2
Launcher mode with SSH bypass
#5728 opened Jul 5, 2024 by dogacancolak-kensho • Queued
5
Misplaced global variable warned
#5725 opened Jul 4, 2024 by anferico Loading…
3
Find ROCm on Fedora
#5705 opened Jun 28, 2024 by trixirt Loading…
11
sequence parallel with communication overlap
#5691 opened Jun 21, 2024 by inkcherry Loading…
3
Switch from torch.cuda.amp.custom_fwd to torch.amp.custom_fwd(device=...)
#5684 opened Jun 18, 2024 by loadams • Draft
1
Switch what versions of python are supported
#5676 opened Jun 17, 2024 by loadams • Draft
Update xpu-max1100.yml with new config and add some tests
#5668 opened Jun 17, 2024 by Liangliang-Ma Loading…
9
Add and Remove ZeRO 3 Hooks
#5658 opened Jun 13, 2024 by jomayeri Loading…
4
Unpin transformers version
#5650 opened Jun 12, 2024 by loadams Loading…
reduce all-to-all communication volume when both expert and non-expert are tensor-parallel
#5626 opened Jun 7, 2024 by taozhiwei Loading…
21
Hybrid Offloading for ZeRO3
#5625 opened Jun 7, 2024 by tohtana • Draft
fix: quantization with DeepSpeed HE
#5624 opened Jun 6, 2024 by Atry Loading…
1
3
Add support for Phi-3 small to FastGen
#5614 opened Jun 4, 2024 by adk9 • Draft
Upgrade HPU image to v1.16.2.
#5610 opened Jun 4, 2024 by vshekhawat-hlab Loading…
6
state_dict_factory: llama checkpoint - support SWIGLU
#5601 opened Jun 2, 2024 by nelyahu Loading…
2
FastGen H100 MoE support: Add PyTorch multi-gemm MOE implementation
#5586 opened May 29, 2024 by HeyangQin Loading…
7
Update profiler.py
#5584 opened May 29, 2024 by gameofdimension Loading…
reduce cpu host overhead when using moe
#5578 opened May 29, 2024 by ranzhejiang Loading…
7
Reuse KV cache of prefixes
#5572 opened May 27, 2024 by tohtana • Draft
3
Add support for Microsoft Phi-3 model to DeepSpeed-FastGen
#5559 opened May 21, 2024 by adk9 Loading…
ProTip! Updated in the last three days: updated:>2024-07-13.