- today's pick · read the full storymodel: add Beam (Reflection)9/10ggml-org/llama.cpp·feature·+732-11Mixture of Experts (MoE) architectureFeedforward Neural Networks with SwiGLU activationRotary Positional Embeddings (RoPE)Custom chat parsing with XML-like tool-call markers
- gh-159136: Avoid stop-the-world when setting function name attributes9/10python/cpython·performance·+317-77Thread synchronizationPer-object critical sectionsReference counting and managementPerformance optimization in multithreaded contexts
- model: Granite switch decision8/10ggml-org/llama.cpp·feature·+40-5Boolean hyperparametersModel adapter patternMulti-role model architecturePrecision formats (BF16 and quantized Q4_K_M)
- [Core][Feat] Pluggable KVCacheConfigBuilder for platform/model-specific KV cache planning8/10vllm-project/vllm·feature·+675-49Pluggable interfacesFactory method patternSeparation of concernsConfiguration management
- [Attention][Spec Decode] Enable varlen Mamba2 decode for adaptive verification8/10vllm-project/vllm·feature·+131-2Variable-length batchingKernel optimizationAdaptive verificationPytest testing framework