DeepSeek-V4.1-Flash memory compression sparks a Reddit debate on inference costs

A Reddit user argues that the KV cache compression method shipped with DeepSeek-V4.1-Flash makes inference cheaper and erodes the compute advantage held by OpenAI and Anthropic.

Paylaş
DeepSeek-V4.1-Flash memory compression sparks a Reddit debate on inference costs

DeepSeek has published, alongside DeepSeek-V4.1-Flash, a method that sharply compresses the memory needed for the KV value cache. The release drew attention through a post in the r/OpenAI community discussing what it means for the industry.

The argument in the post

According to the post by u/justlikemedics, the method has two effects: models can run with much larger contexts, and serving requests becomes far less memory intensive. From this, the user concludes that inference gets cheaper.

The same post argues that as inference gets cheaper and needs less memory, the advantage OpenAI and Anthropic hold in securing compute becomes less meaningful. The user writes that DeepSeek and other Chinese labs are ruthlessly pushing down the cost of inference, which will make it difficult or impossible for the two companies to recover the money spent on building their top models.

A note on sourcing

This assessment comes from a forum user, not from a company statement or an independent measurement. The post gives no technical detail on the method, no compression ratio and no comparative test. The full discussion is in the original Reddit thread.

Devamını oku

Liquid AI تطلق أكبر نماذج LFM2.5 المفتوحة لتشغيل الوكلاء على الأجهزة

Liquid AI تطلق أكبر نماذج LFM2.5 المفتوحة لتشغيل الوكلاء على الأجهزة

أطلقت Liquid AI نموذج LFM2.5-24B-A2B كنموذج مفتوح، ويضم 24 مليار معامل إجمالا لكنه يشغل نحو 2.5 مليار منها في كل خطوة. وبحسب النتائج التي نشرتها الشركة، يولد النموذج المدرب للوكلاء الذين يستخدمون الأدوات 184 رمزا في الثانية على Apple M5 Max.

GlobalFeed Editor tarafından