2022-7-3 arXiv roundup: Minerva, Beating power laws, Surprising OOD linearity
dblalock.substack.com
This newsletter made possible by MosaicML. ⭐ Solving Quantitative Reasoning Problems with Language Models They finetune PaLM models on a corpus of math and scientific text and it turns out this works really well; their model, Minerva, gets a ton of questions right on high-school and even undergrad-level tests.
2022-7-3 arXiv roundup: Minerva, Beating power laws, Surprising OOD linearity
2022-7-3 arXiv roundup: Minerva, Beating…
2022-7-3 arXiv roundup: Minerva, Beating power laws, Surprising OOD linearity
This newsletter made possible by MosaicML. ⭐ Solving Quantitative Reasoning Problems with Language Models They finetune PaLM models on a corpus of math and scientific text and it turns out this works really well; their model, Minerva, gets a ton of questions right on high-school and even undergrad-level tests.