Barret Zoph

Computer Science · Physical Sciences

42h-index28.0kcitations66works46.72yr avg
OpenAlex↗Google Scholar↗

Accepting Students?

No reports yet. Know if this professor is taking students?

Research Topics

Advanced Neural Network Applications(34), Domain Adaptation and Few-Shot Learning(26), Topic Modeling(15), Multimodal Machine Learning Applications(14), Natural Language Processing Techniques(13)

Publications66 total

OpenAI o1 System Card
arXiv (Cornell University)·2024· 32 citedOpen Access
GPT-4o System Card
arXiv (Cornell University)·2024· 88 citedOpen Access
A Pretrainer’s Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity
2024· 20 citedOpen Access
Mixture-of-Experts Meets Instruction Tuning:A Winning Combination for Large Language Models
arXiv (Cornell University)·2023· 20 citedOpen Access
A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity
arXiv (Cornell University)·2023· 7 citedOpen Access
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
arXiv (Cornell University)·2023· 109 citedOpen Access
Scaling Instruction-Finetuned Language Models
arXiv (Cornell University)·2022· 1.2k citedOpen Access
A Review of Sparse Expert Models in Deep Learning
arXiv (Cornell University)·2022· 33 citedOpen Access
Emergent Abilities of Large Language Models
arXiv (Cornell University)·2022· 1.0k citedOpen Access
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
arXiv (Cornell University)·2022· 546 citedOpen Access
Designing Effective Sparse Expert Models
2022 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)·2022· 52 cited
PaLM: Scaling Language Modeling with Pathways
arXiv (Cornell University)·2022· 2.1k citedOpen Access
ST-MoE: Designing Stable and Transferable Sparse Expert Models
arXiv (Cornell University)·2022· 45 citedOpen Access
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
arXiv (Cornell University)·2021· 168 citedOpen Access
Revisiting ResNets: Improved Training and Scaling Strategies
Neural Information Processing Systems·2021· 9 cited
Multi-Task Self-Training for Learning General Representations
2021 IEEE/CVF International Conference on Computer Vision (ICCV)·2021· 72 cited
Multi-Task Self-Training for Learning General Representations
arXiv (Cornell University)·2021· 5 citedOpen Access
Simple Training Strategies and Model Scaling for Object Detection
arXiv (Cornell University)·2021· 27 citedOpen Access
Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentation
2021· 88 citedOpen Access
Revisiting ResNets: Improved Training and Scaling Strategies
arXiv (Cornell University)·2021· 209 citedOpen Access
page 1 of 4Next →

Frequent Co-authors

Quoc V. Le(26), Ekin D. Cubuk(16), Jonathon Shlens(12), William Fedus(8), Vijay Vasudevan(7), Jeff Dean(7), Tsung-Yi Lin(7), Denny Zhou(6), Jason Lee(6), Hyung Won Chung(5), Golnaz Ghiasi(5), Irwan Bello(5), Adam Roberts(4), Yi Tay(4), Noam Shazeer(4), Nan Du(4), Andrew M. Dai(4), Shayne Longpre(4), Maarten Bosma(3), Daphne Ippolito(3)