Davis Summarizes Papers

Home
AI Analysis
Archive
About
2024-8-25: Scaling curves for All of the Things
Good news: we got a bunch of important findings this week.
 • 
Davis Blalock
8
2024-8-4 arXiv roundup: LLama 3.1, training a 100T biological neural net
In case you’re wondering what I’ve been up to instead of posting for the past couple months, I was kicking off a training run for a 100T parameter…
 • 
Davis Blalock
2

April 2024

2024-4-28 arXiv roundup: data and scaling, backlog highlights part 3
Besides getting to cover unusually interesting work, the upside of having a big backlog is that you can group your coverage thematically.
 • 
Davis Blalock
1
Research Archetypes: Scientists, Mathematicians, Inventors
What "research" entails day-to-day varies by field, subfield, problem, and individual researcher.
 • 
Davis Blalock
2024-4-14 arXiv roundup: backlog highlights part 2
Bunch of interesting stuff this week. Before we jump in, one quick clarification from last week: I mentioned how it was an interesting marketing lesson…
 • 
Davis Blalock
1
2024-4-7 arXiv roundup: DBRX, Backlog highlights part 1
It’s good to be back.
 • 
Davis Blalock
7

December 2023

2023-11-26 arXiv roundup: Big potential wins, 1 bit per parameter, Simplifying transformers
Stella Nera: Achieving 161 TOp/s/W with Multiplier-free DNN Acceleration based on Approximate Matrix Multiplication
 • 
Davis Blalock

November 2023

2023-11-19 arXiv roundup: Inverse-free inverse Hessians, Faster LLMs, Closed-form diffusion
A fundamental result in queueing theory is that, if items enter the queue faster than they’re processed, the length of the queue tends to infinity.
 • 
Davis Blalock

October 2023

2023-10-16 arXiv roundup: Cornucopia of easy (claimed) wins for LLMs
Also, I was on the AI Stories podcast!
 • 
Davis Blalock
4
2023-9 arXiv roundup: A bunch of good ML systems and Empirical science papers
Got behind the curve again and ended up taking me more than a week to catch up.
 • 
Davis Blalock

September 2023

2023-8 arXiv roundup: Look I gave a talk, SILO-ing language models, lots of MoE + tool use papers
(I’m still planning on doing weekly installments in general—I just got behind and it took a while to catch up).
 • 
Davis Blalock
2

August 2023

2023-7-30 arXiv roundup: Better image captions, Scaling EMA, Chain of thought empiricism
Heads up that we’ve hit the late summer slump in arXiv submissions, so there’s less content than usual this week.
 • 
Davis Blalock
1
© 2024 Davis Blalock
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great culture