MLSys 2025 Papers

Skip to yearly menu bar Skip to main content

Layout:

mini compact topic detail

by

Rubick: Exploiting Job Reconfigurability for Deep Learning Cluster Scheduling

Interference-aware Edge Runtime Prediction with Conformal Matrix Completion

A Practical Cross-Layer Approach for ML-Driven Storage Placement in Warehouse-Scale Computers

AI Metropolis: Scaling Large Language Model-based Multi-Agent Simulation with Out-of-order Execution

Balancing Pipeline Parallelism with Vocabulary Parallelism

Context Parallelism for Scalable Million-Token Inference

Efficient On-Device Machine Learning with a Biologically-Plausible Forward-Only Algorithm

Enabling Unstructured Sparse Acceleration on Structured Sparse Accelerators

FedProphet: Memory-Efficient Federated Adversarial Training via Robust and Consistent Cascade Learning

HyC-LoRA: Memory Efficient LoRA Fine-tuning with Hybrid Activation Compression

Marconi: Prefix Caching for the Era of Hybrid LLMs

MEADOW: Memory-efficient Dataflow and Data Packing for Low Power Edge LLMs

Optimizing LLM Queries in Relational Data Analytics Workloads

ReaL: Efficient RLHF Training of Large Language Models with Parameter Reallocation

Scaling Deep Learning Training with MPMD Pipeline Parallelism

Seesaw: High-throughput LLM Inference via Model Re-sharding

Self-Data Distillation for Recovering Quality in Pruned Large Language Models

QServe:W4A8KV4 Quantization and System Co-design for Efficient LLM Serving

Supply-Chain Attacks in Machine Learning Frameworks

Lumos: Efficient Performance Modeling and Estimation for Large-scale LLM Training

The Hidden Bloat in Machine Learning Systems

Rethinking Key-Value Cache Compression Techniques for Large Language Model Serving

SOLA: Optimizing SLO Attainment for Large Language Model Serving with State-Aware Scheduling

TurboAttention: Efficient attention approximation for high throughputs llm

Photon: Federated LLM Pre-Training

ThunderServe: High-performance and Cost-efficient LLM Serving in Cloud Environments

FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Serving

Venn: Resource Management For Collaborative Learning Jobs

COMET: Fine-grained Computation-communication Overlapping for Mixture-of-Experts

TileLink: Generating Efficient Compute-Communication Overlapping Kernels using Tile-Centric Primitives

SPA: SCALING GRAPH NEURAL NETWORK TRAINING ON LARGE GRAPHS VIA PROBABILISTIC SPLITTING

MiLo: Efficient Quantized MoE Inference with Mixture of Low-Rank Compensators

FlexInfer: Flexible LLM Inference with CPU Computations

Youmu: Efficient Columnar Data Pipeline for LLM Training

MAS-ATTENTION: MEMORY-AWARE STREAM PROCESSING FOR ATTENTION ACCELERATION ON RESOURCE-CONSTRAINED EDGE DEVICES

On Distributed Larger-Than-Memory Subset Selection With Pairwise Submodular Functions

NEO: Saving GPU Memory Crisis with CPU Offloading for Online LLM Inference

Efficient LLM Inference using Dynamic Input Pruning and Cache-Aware Masking

VoLUT: Efficient Volumetric streaming enhanced by LUT-based super-resolution

FastTree: Optimizing Attention Kernel and Runtime for Tree-Structured LLM Inference

AdaParse: An Adaptive Parallel PDF Parsing and Resource Scaling Engine

Radius: Range-based Gradient Sparsity for Large Foundation Model Pre-training

XGrammar: Flexible and Efficient Structured Generation Engine for Large Language Models

SwiftVI: Time-Efficient Planning and Learning with MDPs

FLStore: Efficient Federated Learning Storage for non-training workloads

APOLLO: SGD-like Memory, AdamW-level Performance

LeanAttention: Hardware-Aware Scalable Attention Mechanism for the Decode-Phase of Transformers

LServe: Efficient Long-sequence LLM Serving with Unified Sparse Attention

FlexAttention: A Programming Model for Generating Fused Attention Variants.

DiffServe: Efficiently Serving Text-to-Image Diffusion Models with Query-Aware Model Scaling

AIOpsLab: A Holistic Framework to Evaluate AI Agents for Enabling Autonomous Clouds

PipeFill: Using GPUs During Bubbles in Pipeline-parallel LLM Training

SparseTransX: Efficient Training of Translation-Based Knowledge Graph Embeddings Using Sparse Matrix Operations

LAVA: Lifetime-Aware VM Allocation with Learned Distributions and Adaptation to Mispredictions

ProtoRAIL: A Risk-cognizant Imitation Agent for Adaptive vCPU Oversubscription In the Cloud

Graph Learning at Scale: Characterizing and Optimizing Pre-Propagation GNNs

Know Where You’re Uncertain When Planning with Multimodal Foundation Models: A Formal Framework

Training Ultra Long Context Language Model with Fully Pipelined Distributed Transformer

Lightweight Software Kernels and Hardware Extensions for Efficient Sparse Deep Neural Networks on Microcontrollers

SampleAttention: Near-Lossless Acceleration of Long Context LLM Inference with Adaptive Structured Sparse Attention

ScaleFusion: Scalable Inference of Spatial-Temporal Diffusion Transformers for High-Resolution Long Video Generation