- today's pick · read the full story[ROCm][Perf][Muse Spark] FlyDSL decode monokernel for DSpark verify steps on MI355X (--monokernel)9/10vllm-project/vllm·performance·+8985-3GPU kernel launchesPerformance optimizationCommand-line flagsBenchmarking and accuracy evaluation
- [Core] Extensible KV cache8/10vllm-project/vllm·feature·+4698-143CUDA graph captureVirtual memory managementLazy memory allocationGPU memory profiling
- Audio from video in jinja8/10huggingface/transformers·feature·+1288-336Multimodal data processingAutomatic audio extraction from videoTemplate-based input processingPyTorch tensor handling
- common : support deferred tools and tool_reference content parts8/10ggml-org/llama.cpp·feature·+220-24Deferred executionJSON-based API interactionFunction objects and parametersUnit testing in C++
- Add Flint model support.8/10huggingface/transformers·feature·+1321-0Class inheritanceAutomatic model registrationCheckpoint serialization and deserializationUnit testing