darron li

software engineer
self proclaimed professional musician
Portrait of Me!

about

a very small language model, trained exclusively on me

"There are no men like me. There's only me." - Jaime Lannister (ASOIAF)

darron-0.0001B · temperature 1.0

Darron is ___

next-token probabilities entropy 2.72 bits
  • a Radiohead fan 0.26
  • still waiting on The Winds of Winter 0.19
  • lisan al-gaib 0.16
  • one letter away from Darrow 0.13
  • a Berserk fan (before 2021) 0.11
  • a Walking Dead fan 0.08
  • the LeetCode Club founder 0.05
  • <eos> 0.02

low = always the obvious answer · high = anything goes

projects

"A mind needs books as a sword needs a whetstone, if it is to keep its edge."

- Tyrion Lannister (ASOIAF)

metal_detector

Live
TypeScriptTransformers.jsWebGPU

An interactive tool for looking at logits, one forward pass at a time. Run a small language model in your browser and see every token it considered, the probability it gave each one, and why it picked the one it did.

  • Custom autoregressive generation loop with Transformers.js that captures vocabulary-wide logits across successive forward passes and picks tokens by greedy decoding
  • Numerically stable softmax, top-k selection, and Shannon entropy to analyze next-token probability distributions across sequence positions
  • Turned the theory i was learning in shovel into something visually appealing
try it source

shovel

WIP
PythonPyTorch

Digging for "gold", where gold is learning more about GPU inference and how to optimize it. Basis for my machine learning projects like metal_detector

tModLoader

Merged
C#GitOpen Source

Open-source contribution to tModLoader, the modding API for Terraria

  • Actually kind of fun..
view PR

music

albums I keep on repeat