sparkllm
A million-token memory that fits in your pocket: SparkLLM open-sources its Spark X2.5 models
The two on-device models, at 4B and 1.7B parameters, ship with native context windows of up to 1 million tokens. Built on a hybrid attention architecture, they are tuned for agents, code and math.