Questions
Is it live?
It runs on Solana devnet: the model is locked in a devnet account, and the program has written a first story there, identical to an off-chain run. It also runs on our rollup at a few hundred tokens a second. Mainnet is next.
Why is the model so small?
Every token costs about one multiply-add per weight, and each Solana transaction has a fixed compute budget. Our first model has 260K weights and a 512-token vocabulary, which keeps a token to a few transactions on stock Solana. Larger models come on the rollup, where the same math runs natively.
Does running it burn SOL?
A little. Solana charges a flat 5,000 lamports per transaction however much compute it uses, and half of that is burned, so a story costs a fraction of a cent per token. Storing the model and sessions takes refundable deposits, and the rollup uses its own fee token.
How is this different from other AI on Solana?
Most AI projects on Solana run the model on a server and use the chain for payments. Here the computation itself happens on chain, so you can check the answer, not just the payment.
What is the Neuron rollup?
Our own chain, built on the same execution engine as Solana, so anything that runs on Solana runs on it unchanged. It adds native math for models and posts checkpoints back to Solana.