knowledge-distillation — 360d

41 papers ← all tags

Date	Title	Authors	arXiv
2026-04-15	A Case Study on Energy-Efficient Edge AI Crack Segmentation	Matthias Tschope et al.	2604.13933
2026-03-27	Knowledge Distillation for Efficient Transformer-Based Reinforcement Learning in Hardware-Constrained Energy Management Systems	Pascal Henrich et al.	2603.26249
2026-03-13	MoEKD: Mixture-of-Experts Knowledge Distillation for Robust and High-Performing Compressed Code Models distillation · large-language-models	Md. Abdul Awal et al.	2603.13213
2026-03-12	Gaussian Process Regression-based Knowledge Distillation Framework for Simultaneous Prediction of Physical and Mechanical Properties of Epoxy Polymers gaussian-process	Sindu B. S. et al.	2603.16925
2026-02-12	Pedagogically-Inspired Data Synthesis for Language Model Knowledge Distillation distillation · large-language-models	Bowei He et al.	2602.12172
2026-02-10	Life Cycle-Aware Evaluation of Knowledge Distillation for Machine Translation: Environmental Impact and Translation Quality Trade-offs life-cycle-assessment	Joseph Attieh et al.	2602.09691
2026-01-23	Knowledge Distillation of Noisy Force Labels for Improved Coarse-Grained Force Fields molecular-dynamics	Feranmi V. Olowookere et al.	2510.26650
2026-01-14	Advancing Model Refinement: Muon-Optimized Distillation and Quantization for LLM Deployment distillation · large-language-models	Jacob Sander et al.	2601.09865
2026-01-13	When Smaller Wins: Dual-Stage Distillation and Pareto-Guided Compression of Liquid Neural Networks for Edge Battery Prognostics	Dhivya Dharshini Kannan et al.	2601.06227
2026-01-12	How to Backdoor the Knowledge Distillation distillation	Chen Wu et al.	2504.21323
2026-01-12	InfGraND: An Influence-Guided GNN-to-MLP Knowledge Distillation distillation · graph-neural-networks	Amir Eskandari et al.	2601.08033
2026-01-02	MD-SNN: Membrane Potential-aware Distillation on Quantized Spiking Neural Network	Donghyun Lee et al.	2512.04443
2026-01-01	Knowledge Distillation for Temporal Knowledge Graph Reasoning with Large Language Models distillation · large-language-models	Wang Xing et al.	2601.00202
2025-12-16	KD-PINN: Knowledge-Distilled PINNs for ultra-low-latency real-time neural PDE solvers distillation · physics-informed-ml	Karim Bounja et al.	2512.13336
2025-12-16	Entropy-Reservoir Bregman Projection: An Information-Geometric Unification of Model Collapse	Jingwei Chen	2512.14879
2025-12-13	Cross-Modal Representational Knowledge Distillation for Enhanced Spike-Informed LFP Modeling	Eray Erturk et al.	2512.12461
2025-12-06	Foundation Models Knowledge Distillation For Battery Capacity Degradation Forecast battery-modeling	Joey Chan et al.	2505.08151
2025-12-06	The Oracle and The Prism: A Decoupled and Efficient Framework for Generative Recommendation Explanation distillation · large-language-models	Jiaheng Zhang et al.	2511.16543
2025-11-27	All Centers Are at most a Few Tokens Apart: Knowledge Distillation with Domain Invariant Prompt Tuning distillation	Amir Mohammad Ezzati et al.	2511.22739
2025-11-06	LightPFP: A Lightweight Route to Ab Initio Accuracy at Scale dft · molecular-dynamics · transfer-learning	Wenwen Li et al.	2510.23064
2025-10-24	S$^2$NN: Sub-bit Spiking Neural Networks	Wenjie Wei et al.	2509.24266
2025-10-23	Layer-to-Layer Knowledge Mixing in Graph Neural Network for Chemical Property Prediction graph-neural-networks	Teng Jiek See et al.	2510.20236
2025-10-19	DistilLock: Safeguarding LLMs from Unauthorized Knowledge Distillation on the Edge distillation · large-language-models	Asmita Mohanty et al.	2510.16716
2025-10-19	Leave It to the Experts: Detecting Knowledge Distillation via MoE Expert Signatures distillation · large-language-models	Pingzhi Li et al.	2510.16968
2025-10-14	Toward Fair Graph Neural Networks Via Dual-Teacher Knowledge Distillation distillation · graph-neural-networks	Chengyu Li et al.	2412.00382
2025-10-13	LLM-Oriented Token-Adaptive Knowledge Distillation distillation · large-language-models	Xurong Xie et al.	2510.11615
2025-09-17	LLM on a Budget: Active Knowledge Distillation for Efficient Classification of Large Text Corpora active-learning · distillation · large-language-models	Viviana Luccioli et al.	2511.11574
2025-08-27	Disentangling the Effects of Simultaneous Environmental Variables on Perovskite Synthesis and Device Performance via Interpretable Machine Learning active-learning · bayesian-inference · crystallization	Tianran Liu et al.	2509.09022
2025-08-08	Less is More: Selective Reflection for Compatible and Efficient Knowledge Distillation in Large Language Models distillation · large-language-models	Lingyuan Liu et al.	2508.06135
2025-07-25	Tuned Reverse Distillation: Enhancing Multimodal Industrial Anomaly Detection with Crossmodal Tuners anomaly-detection · distillation	Xinyue Liu et al.	2412.08949
2025-07-25	ProGMLP: A Progressive Framework for GNN-to-MLP Knowledge Distillation with Efficient Trade-offs distillation · graph-neural-networks	Weigang Lu et al.	2507.19031
2025-07-08	Pre-Training Graph Contrastive Masked Autoencoders are Strong Distillers for EEG transfer-learning	Xinxu Wei et al.	2411.19230
2025-07-01	We Need Knowledge Distillation for Solving Math Word Problems distillation · large-language-models	Zhenquan Shen et al.	2507.02982
2025-06-28	ReasonBridge: Efficient Reasoning Transfer from Closed to Open-Source Language Models distillation · large-language-models · transfer-learning	Ziqi Zhong et al.	2506.22865
2025-06-25	Enhancing Reasoning Capabilities in SLMs with Reward Guided Dataset Distillation distillation · large-language-models	Shreyansh Padarha	2507.00054
2025-06-23	Learning from Stochastic Teacher Representations Using Student-Guided Knowledge Distillation distillation	Muhammad Haseeb Aslam et al.	2504.14307
2025-06-20	Knowledge Distillation Framework for Accelerating High-Accuracy Neural Network-Based Molecular Dynamics Simulations dft · molecular-dynamics	Naoki Matsumura et al.	2506.15337
2025-06-13	Brewing Knowledge in Context: Distillation Perspectives on In-Context Learning distillation · large-language-models	Chengye Li et al.	2506.11516
2025-06-12	Ensemble Knowledge Distillation for Machine Learning Interatomic Potentials molecular-dynamics	Sakib Matin et al.	2503.14293
2025-06-06	Being Strong Progressively! Enhancing Knowledge Distillation of Large Language Models through a Curriculum Learning Framework distillation · large-language-models	Lingyuan Liu et al.	2506.05695
2025-05-30	Revisiting Cross-Modal Knowledge Distillation: A Disentanglement Approach for RGBD Semantic Segmentation distillation	Roger Ferrod et al.	2505.24361