3 Matching Annotations
- Jun 2024
-
-
suppose that GPT 4 training took 3 months in 2027 a leading AI lab will be able to train a GPT 4 00:18:19 level model in a minute
for - stat - AI evolution - prediction 2027 - training time - 6 OOM decrease
stat - AI evolution - prediction 2027 - training time - 6 OOM decrease - today it takes 3 months to train GPT 4 - in 2027, it will take 1 minute - That is, 131,400 minutes vs 1 minute, or - 6 OOM
-
- Jul 2023
-
docdrop.org docdrop.org
-
walking bass, ching-a-ding, oom-pah
-
- Oct 2020
-
www.youtube.com www.youtube.com
-
Linux Memory Management at Scale
"we had to build a complete and compliant operating system in order to perform resource control reliably"
epic real-talk. the only people on the planet who seemed to have tamed linux for workloads. controlling memory. taming io. being on the bleeding edge, it turns out, is almost entirely about forward-progress. what can we reclaim?
- oomd for memory protection
- fbtax2
- psi monitoring for io regulation
- cgroups v2
https://facebookmicrosites.github.io/cgroup2/docs/fbtax-results.html
Tags
Annotators
URL
-