- formatting
- images
- links
- math
- code
- blockquotes
•
•
•
•
•
-
A good startup idea...
Why I'd like to build a startup that detects LLM generated text
-
My Solutions to "How to scale your model"
My Solutions to "How to scale your model"
-
30 Interview Questions on LLM Inference
How many FLOPs is attention? When does a KV cache hurt performance? Why does beam search cause your KV cache memory to explode?
-
Optimization Problems
Just a boi trying to solve some optimization problems.
-
Can You Solve Dynamic Programming Problems Faster?
We prove you can solve dynamic programming problems polynomially faster if you have a simple transition cost function for kD LWS problems.