Skip to main content

One post tagged with "compression"

View All Tags

· 7 min read
Robin Tubungbanua

I wanted to find out whether I could run a higher-precision local model with less memory, while preserving every weight exactly. The first result looked promising: about 25% smaller weight storage.

Then I asked why the RAM usage was almost unchanged.

That question ended up shaping the experiment. The compression worked, but I had to separate several different claims: a smaller file, a smaller memory footprint, and a model that was actually more practical to run.