gpjt

1,810 karmajoined January 12, 2009On HN

https://www.gilesthomas.com/

Recent submissions

Extending Raschka's GPT-2: an MoE trained from scratch on an RTX 3090 gilesthomas.com
1gpjt1ddiscuss
Putting my Jax-trained models on the Hugging Face Hub gilesthomas.com
2gpjt8ddiscuss
Why do OpenAI's GPT-2 weights beat mine? Part four: digging into dropout gilesthomas.com
1gpjt15ddiscuss
First patient to undergo live AI-assisted brain surgery has tumour removed bbc.com
6gpjt16ddiscuss
Adding diagrams to my static site generator with D2 gilesthomas.com
3gpjt17ddiscuss
Use the built-in GELU, don't roll your own gilesthomas.com
1gpjt23ddiscuss
A Quick(ish) Chinchilla Check gilesthomas.com
1gpjt1modiscuss
I use AI on this blog gilesthomas.com
1gpjt1mo1 comment
Why do OpenAI's GPT-2 weights beat mine? Part three: testing overtraining gilesthomas.com
2gpjt1modiscuss
Why do OpenAI's GPT-2 weights beat mine? Part two: the bugfix gilesthomas.com
8gpjt1modiscuss
Why do OpenAI's GPT-2 weights beat mine?gilesthomas.com
4gpjt1modiscuss
Benchmarking Qwen 3.6 35B MoE (3B active) on an RTX 3090 gilesthomas.com
16gpjt1modiscuss
Building intuition about LLM parameter counts gilesthomas.com
2gpjt2modiscuss
Poppy the training box, part 1: the beginnings gilesthomas.com
3gpjt2modiscuss
From bigrams to GPT-2, one component at a time (in Jax)gilesthomas.com
1gpjt2modiscuss
Building a Jax training loop for an LLM training run gilesthomas.com
2gpjt2modiscuss
Thoughts on Role Confusion gilesthomas.com
3gpjt2modiscuss
Flax debugging: making a hash of things gilesthomas.com
2gpjt2modiscuss
10Gb/s Ethernet: switching to a Broadcom SFP+ module gilesthomas.com
195gpjt2mo170 comments
Jax: Commitment Issues gilesthomas.com
4gpjt2modiscuss
Jax Back Ends and Devices gilesthomas.com
2gpjt3modiscuss
Using Safetensors with Flax gilesthomas.com
2gpjt3modiscuss
First Looking into Jax gilesthomas.com
3gpjt3modiscuss
10Gb/s Ethernet: using mini-heatsinks with a 10GBASE-T SFP+ module gilesthomas.com
3gpjt3modiscuss
10Gb/s Ethernet: what I did to get it working in my home gilesthomas.com
232gpjt4mo177 comments
10Gb Ethernet: what I had to (re)learn gilesthomas.com
1gpjt4mo1 comment
LLM from scratch, part 33 – what I learned from the appendices gilesthomas.com
5gpjt4modiscuss
LLM from scratch (32l) – Interventions: updated instruction fine-tuning results gilesthomas.com
1gpjt4modiscuss
How an LLM becomes more coherent as we train it gilesthomas.com
3gpjt4modiscuss
LLM from scratch, part 32k – Interventions: gradient accumulation gilesthomas.com
2gpjt4modiscuss

All submissions and comments on Hacker News.