distillation — all

53 papers ← all tags

Date	Title	Authors	arXiv
2026-03-27	When Perplexity Lies: Generation-Focused Distillation of Hybrid Sequence Models	Juan Gabriel Kostelec et al.	2603.26556
2026-03-25	Physics-Informed Neural Network Digital Twin for Dynamic Tray-Wise Modeling of Distillation Columns under Transient Operating Conditions anomaly-detection · digital-twin · physics-informed-ml · process-monitoring	Debadutta Patra et al.	2603.24644
2026-03-13	MoEKD: Mixture-of-Experts Knowledge Distillation for Robust and High-Performing Compressed Code Models knowledge-distillation · large-language-models	Md. Abdul Awal et al.	2603.13213
2026-02-12	Pedagogically-Inspired Data Synthesis for Language Model Knowledge Distillation knowledge-distillation · large-language-models	Bowei He et al.	2602.12172
2026-01-14	Advancing Model Refinement: Muon-Optimized Distillation and Quantization for LLM Deployment knowledge-distillation · large-language-models	Jacob Sander et al.	2601.09865
2026-01-12	How to Backdoor the Knowledge Distillation knowledge-distillation	Chen Wu et al.	2504.21323
2026-01-12	InfGraND: An Influence-Guided GNN-to-MLP Knowledge Distillation graph-neural-networks · knowledge-distillation	Amir Eskandari et al.	2601.08033
2026-01-01	Knowledge Distillation for Temporal Knowledge Graph Reasoning with Large Language Models knowledge-distillation · large-language-models	Wang Xing et al.	2601.00202
2025-12-16	KD-PINN: Knowledge-Distilled PINNs for ultra-low-latency real-time neural PDE solvers knowledge-distillation · physics-informed-ml	Karim Bounja et al.	2512.13336
2025-12-06	The Oracle and The Prism: A Decoupled and Efficient Framework for Generative Recommendation Explanation knowledge-distillation · large-language-models	Jiaheng Zhang et al.	2511.16543
2025-11-27	All Centers Are at most a Few Tokens Apart: Knowledge Distillation with Domain Invariant Prompt Tuning knowledge-distillation	Amir Mohammad Ezzati et al.	2511.22739
2025-10-28	SCOUT: A Lightweight Framework for Scenario Coverage Assessment in Autonomous Driving surrogate-modeling	Anil Yildiz et al.	2510.24949
2025-10-19	DistilLock: Safeguarding LLMs from Unauthorized Knowledge Distillation on the Edge knowledge-distillation · large-language-models	Asmita Mohanty et al.	2510.16716
2025-10-19	Leave It to the Experts: Detecting Knowledge Distillation via MoE Expert Signatures knowledge-distillation · large-language-models	Pingzhi Li et al.	2510.16968
2025-10-14	Toward Fair Graph Neural Networks Via Dual-Teacher Knowledge Distillation graph-neural-networks · knowledge-distillation	Chengyu Li et al.	2412.00382
2025-10-13	LLM-Oriented Token-Adaptive Knowledge Distillation knowledge-distillation · large-language-models	Xurong Xie et al.	2510.11615
2025-09-29	BLADE: Block-Sparse Attention Meets Step Distillation for Efficient Video Generation	Youping Gu et al.	2508.10774
2025-09-29	Reusable Surrogate Models for Distillation Columns chemical-engineering · surrogate-modeling	Martin Bubel et al.	2509.06638
2025-09-17	LLM on a Budget: Active Knowledge Distillation for Efficient Classification of Large Text Corpora active-learning · knowledge-distillation · large-language-models	Viviana Luccioli et al.	2511.11574
2025-08-08	Less is More: Selective Reflection for Compatible and Efficient Knowledge Distillation in Large Language Models knowledge-distillation · large-language-models	Lingyuan Liu et al.	2508.06135
2025-07-25	Tuned Reverse Distillation: Enhancing Multimodal Industrial Anomaly Detection with Crossmodal Tuners anomaly-detection · knowledge-distillation	Xinyue Liu et al.	2412.08949
2025-07-25	ProGMLP: A Progressive Framework for GNN-to-MLP Knowledge Distillation with Efficient Trade-offs graph-neural-networks · knowledge-distillation	Weigang Lu et al.	2507.19031
2025-07-01	We Need Knowledge Distillation for Solving Math Word Problems knowledge-distillation · large-language-models	Zhenquan Shen et al.	2507.02982
2025-06-28	ReasonBridge: Efficient Reasoning Transfer from Closed to Open-Source Language Models knowledge-distillation · large-language-models · transfer-learning	Ziqi Zhong et al.	2506.22865
2025-06-25	Enhancing Reasoning Capabilities in SLMs with Reward Guided Dataset Distillation knowledge-distillation · large-language-models	Shreyansh Padarha	2507.00054
2025-06-23	Learning from Stochastic Teacher Representations Using Student-Guided Knowledge Distillation knowledge-distillation	Muhammad Haseeb Aslam et al.	2504.14307
2025-06-23	Federated Learning from Molecules to Processes: A Perspective chemical-engineering · graph-neural-networks · system-identification	Jan G. Rittig et al.	2506.18525
2025-06-13	Brewing Knowledge in Context: Distillation Perspectives on In-Context Learning knowledge-distillation · large-language-models	Chengye Li et al.	2506.11516
2025-06-06	Being Strong Progressively! Enhancing Knowledge Distillation of Large Language Models through a Curriculum Learning Framework knowledge-distillation · large-language-models	Lingyuan Liu et al.	2506.05695
2025-05-31	AVadCLIP: Audio-Visual Collaboration for Robust Video Anomaly Detection anomaly-detection	Peng Wu et al.	2504.04495
2025-05-30	Revisiting Cross-Modal Knowledge Distillation: A Disentanglement Approach for RGBD Semantic Segmentation knowledge-distillation	Roger Ferrod et al.	2505.24361
2025-05-15	DiSCo: LLM Knowledge Distillation for Efficient Sparse Retrieval in Conversational Search large-language-models	Simon Lupart et al.	2410.14609
2025-04-02	Adversarial Curriculum Graph-Free Knowledge Distillation for Graph Neural Networks graph-neural-networks · knowledge-distillation	Yuang Jia et al.	2504.00540
2025-03-25	Pareto-optimal treatment of uncertainties in model-based process design and operation process-design	Jan Schwientek et al.	2503.19680
2025-03-18	MaTVLM: Hybrid Mamba-Transformer for Efficient Vision-Language Modeling knowledge-distillation	Yingyue Li et al.	2503.13440
2025-03-12	Adaptive Temperature Based on Logits Correlation in Knowledge Distillation knowledge-distillation	Kazuhiro Matsuyama et al.	2503.09030
2025-01-27	Logic-Based Discrete-Steepest Descent: A Solution Method for Process Synthesis Generalized Disjunctive Programs catalysis · chemical-engineering	Daniel Ovalle et al.	2405.05358
2025-01-22	Extracting General-use Transformers for Low-resource Languages via Knowledge Distillation knowledge-distillation	Jan Christian Blaise Cruz et al.	2501.12660
2024-12-25	A Unified Framework for Continual Learning and Unlearning knowledge-distillation	Romit Chatterjee et al.	2408.11374
2024-12-19	Self-Evolution Knowledge Distillation for LLM-based Machine Translation knowledge-distillation · large-language-models	Yuncheng Song et al.	2412.15303
2024-11-13	Physics Informed Distillation for Diffusion Models knowledge-distillation · physics-informed-ml	Joshua Tian Jin Tee et al.	2411.08378
2024-11-11	Towards Diverse Device Heterogeneous Federated Learning via Task Arithmetic Knowledge Integration knowledge-distillation	Mahdi Morafah et al.	2409.18461
2024-10-10	CFD-based Shape Optimization of Structured Packings for Enhancing Separation Efficiency in Distillation cfd · mass-transfer	Sebastian Blauth et al.	2407.11099
2024-10-05	Gap Preserving Distillation by Building Bidirectional Mappings with A Dynamic Teacher knowledge-distillation	Yong Guo et al.	2410.04140
2024-10-01	AMR-Evol: Adaptive Modular Response Evolution Elicits Better Knowledge Distillation for Large Language Models in Code Generation knowledge-distillation · large-language-models	Ziyang Luo et al.	2410.00558
2024-09-10	Knowledge Distillation via Query Selection for Detection Transformer knowledge-distillation	Yi Liu et al.	2409.06443
2024-07-28	LLAVADI: What Matters For Multimodal Large Language Models Distillation knowledge-distillation · large-language-models	Shilin Xu et al.	2407.19409
2024-07-23	DDK: Distilling Domain Knowledge for Efficient Large Language Models knowledge-distillation · large-language-models	Jiaheng Liu et al.	2407.16154
2024-07-14	Multi-Granularity Semantic Revision for Large Language Model Distillation knowledge-distillation · large-language-models	Xiaoyu Liu et al.	2407.10068
2024-07-05	AMD: Automatic Multi-step Distillation of Large-scale Vision Models knowledge-distillation	Cheng Han et al.	2407.04208
2024-06-12	Small Scale Data-Free Knowledge Distillation knowledge-distillation	He Liu et al.	2406.07876
2024-06-05	Multi-Task Multi-Scale Contrastive Knowledge Distillation for Efficient Medical Image Segmentation knowledge-distillation	Risab Biswas	2406.03173
2024-05-10	Attend, Distill, Detect: Attention-aware Entropy Distillation for Anomaly Detection anomaly-detection	Sushovan Jena et al.	2405.06467