Olatunji Ruwase

Bellevue Hospital Center — United States

Computer Science · Physical Sciences

22h-index3.8kcitations61works10.72yr avg
OpenAlex↗ORCID↗Google Scholar↗Lab page↗

Accepting Students?

No reports yet. Know if this professor is taking students?

Research Topics

Advanced Neural Network Applications(21), Parallel Computing and Optimization Techniques(21), Topic Modeling(12), Security and Verification in Computing(11), Radiation Effects in Electronics(8)

Publications61 total

SuperOffload: Unleashing the Power of Large-Scale LLM Training on Superchips
2025· 1 citedOpen Access
SuperOffload: Unleashing the Power of Large-Scale LLM Training on Superchips
arXiv (Cornell University)·2025Open Access
ZenFlow: Enabling Stall-Free Offloading Training via Asynchronous Updates
arXiv (Cornell University)·2025Open Access
DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training
ArXiv.org·2025Open Access
Mojito: Motion Trajectory and Intensity Control for Video Generation
arXiv (Cornell University)·2024Open Access
RecFlex: Enabling Feature Heterogeneity-Aware Optimization for Deep Recommendation Models with Flexible Schedules
2024
Domino: Eliminating Communication in LLM Training via Generic Tensor Slicing and Overlapping
arXiv (Cornell University)·2024· 1 citedOpen Access
Training Ultra Long Context Language Model with Fully Pipelined Distributed Transformer
arXiv (Cornell University)·2024Open Access
Universal Checkpointing: A Flexible and Efficient Distributed Checkpointing System for Large-Scale DNN Training with Reconfigurable Parallelis
arXiv (Cornell University)·2024· 1 citedOpen Access
FastPersist: Accelerating Model Checkpointing in Deep Learning
arXiv (Cornell University)·2024· 1 citedOpen Access
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
arXiv (Cornell University)·2024· 143 citedOpen Access
Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding
arXiv (Cornell University)·2024Open Access
FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design
arXiv (Cornell University)·2024· 3 citedOpen Access
Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding
2024
ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6-Centric Strategy for Diverse Generative Tasks
arXiv (Cornell University)·2023· 1 citedOpen Access
DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention
arXiv (Cornell University)·2023· 4 citedOpen Access
DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales
arXiv (Cornell University)·2023· 10 citedOpen Access
A Hybrid Tensor-Expert-Data Parallelism Approach to Optimize Mixture-of-Experts Training
2023· 32 citedOpen Access
ZeRO++: Extremely Efficient Collective Communication for Giant Model Training
arXiv (Cornell University)·2023· 15 citedOpen Access
A Hybrid Tensor-Expert-Data Parallelism Approach to Optimize Mixture-of-Experts Training
arXiv (Cornell University)·2023· 1 citedOpen Access
page 1 of 4Next →

Frequent Co-authors

Yuxiong He(28), Samyam Rajbhandari(19), Jeff Rasley(11), Phillip B. Gibbons(11), Todd C. Mowry(11), Minjia Zhang(10), Michael A. Kozuch(9), Ammar Ahmad Awan(7), Trishul Chilimbi(7), Shimin Chen(6), Reza Yazdani Aminabadi(5), Feng Yan(5), Shaden Smith(4), M. B. Wyatt(4), Michael Ryan(4), Michael Carbin(4), Zhewei Yao(4), Kalin Ovtcharov(3), Joo-Young Kim(3), Jeremy Fowers(3)