Hacker News

Hacker News

FreeToken: Datacenter-class intelligence on the hardware you own (arxiv.org)
3 points by lioeters •                         
andsoitis •                         
Sounds almost too good to be true. Has anyone tried it?
lioeters •                         
Source: https://github.com/FlashML-org/FreeToken

> FreeToken is an edge-native Mixture-of-Experts (MoE) serving engine designed for running frontier-scale open-weight models on personal and consumer hardware. It treats heterogeneous edge resources—GPUs, CPUs, host memory, and interconnects—as a unified, elastic inference platform.