Folio: Natural language reasoning with first-order logic

Simeng Han , Hailey Schoelkopf , Yilun Zhao , Zhenting Qi
arXiv preprint arXiv:2209.00840

4
2022
Proofnet: Autoformalizing and formally proving undergraduate-level mathematics

Zhangir Azerbayev , Bartosz Piotrowski , Hailey Schoelkopf , Edward W Ayers
arXiv preprint arXiv:2302.12433

2023
Llemma: An open language model for mathematics

Zhangir Azerbayev , Hailey Schoelkopf , Keiran Paster , Marco Dos Santos
arXiv preprint arXiv:2310.10631

87
2023
Crosslingual Generalization through Multitask Finetuning

Niklas Muennighoff , Thomas Wang , Lintang Sutawika , Adam Roberts
arXiv preprint arXiv:2211.01786

409
2022
BLOOM+ 1: Adding Language Support to BLOOM for Zero-Shot Prompting

Zheng-Xin Yong , Hailey Schoelkopf , Niklas Muennighoff , Alham Fikri Aji
arXiv preprint arXiv:2212.09535

36
2022
Explicit Knowledge Transfer for Weakly-Supervised Code Generation

Zhangir Azerbayev , Ansong Ni , Hailey Schoelkopf , Dragomir Radev
arXiv preprint arXiv:2211.16740

3
2022
Starcoder: may the source be with you!

Raymond Li , Loubna Ben Allal , Yangtian Zi , Niklas Muennighoff
arXiv preprint arXiv:2305.06161

454
2023
SantaCoder: don't reach for the stars!

Loubna Ben Allal , Raymond Li , Denis Kocetkov , Chenghao Mou
arXiv

145
2023
Lessons from the Trenches on Reproducible Evaluation of Language Models

Stella Biderman , Hailey Schoelkopf , Lintang Sutawika , Leo Gao
arXiv preprint arXiv:2405.14782

2024
Social choice for AI alignment: Dealing with diverse human feedback

Vincent Conitzer , Rachel Freedman , Jobst Heitzig , Wesley H Holliday
arXiv preprint arXiv:2404.10271

7
2024
GAIA search: Hugging face and pyserini interoperability for nlp training data exploration

Aleksandra Piktus , Odunayo Ogundepo , Christopher Akiki , Akintunde Oladipo
arXiv preprint arXiv:2306.01481

5
2023
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling

Stella Biderman , Hailey Schoelkopf , Quentin Anthony , Herbie Bradley
International Conference on Machine Learning (ICML)

495
2023
Emergent and predictable memorization in large language models

Stella Biderman , USVSN Sai Prashanth , Lintang Sutawika , Hailey Schoelkopf
NeurIPS

64
2023
Position: Social Choice Should Guide AI Alignment in Dealing with Diverse Human Feedback

Vincent Conitzer , Rachel Freedman , Jobst Heitzig , Wesley H Holliday
Forty-first International Conference on Machine Learning

1
Suppressing Pink Elephants with Direct Principle Feedback

Louis Castricato , Nathan Lile , Suraj Anand , Hailey Schoelkopf
arXiv preprint arXiv:2402.07896

2
2024
Why Has Predicting Downstream Capabilities of Frontier AI Models with Scale Remained Elusive?

Rylan Schaeffer , Hailey Schoelkopf , Brando Miranda , Gabriel Mukobi
arXiv preprint arXiv:2406.04391

2024
Attributing Mode Collapse in the fine-tuning of Large Language Models

Laura O'Mahony , Leo Grinsztajn , Hailey Schoelkopf , Stella Biderman
ICLR 2024 Workshop on Mathematical and Empirical Understanding of Foundation Models

2024
Transformer Math 101

Quentin Anthony , Stella Biderman , Hailey Schoelkopf
https://blog.eleuther.ai/transformer-math/

2023
A framework for few-shot language model evaluation, 12 2023

L Gao , J Tow , B Abbasi , S Biderman
URL https://zenodo. org/records/10256836 7

36
Bloom: A 176b-parameter open-access multilingual language model

Teven Le Scao , Angela Fan , Christopher Akiki , Ellie Pavlick

1,242
2023