knowledge-distillation — all

69 papers ← all tags

Date	Title	Authors	arXiv
2026-04-15	A Case Study on Energy-Efficient Edge AI Crack Segmentation	Matthias Tschope et al.	2604.13933
2026-03-27	Knowledge Distillation for Efficient Transformer-Based Reinforcement Learning in Hardware-Constrained Energy Management Systems	Pascal Henrich et al.	2603.26249
2026-03-13	MoEKD: Mixture-of-Experts Knowledge Distillation for Robust and High-Performing Compressed Code Models distillation · large-language-models	Md. Abdul Awal et al.	2603.13213
2026-03-12	Gaussian Process Regression-based Knowledge Distillation Framework for Simultaneous Prediction of Physical and Mechanical Properties of Epoxy Polymers gaussian-process	Sindu B. S. et al.	2603.16925
2026-02-12	Pedagogically-Inspired Data Synthesis for Language Model Knowledge Distillation distillation · large-language-models	Bowei He et al.	2602.12172
2026-02-10	Life Cycle-Aware Evaluation of Knowledge Distillation for Machine Translation: Environmental Impact and Translation Quality Trade-offs life-cycle-assessment	Joseph Attieh et al.	2602.09691
2026-01-23	Knowledge Distillation of Noisy Force Labels for Improved Coarse-Grained Force Fields molecular-dynamics	Feranmi V. Olowookere et al.	2510.26650
2026-01-14	Advancing Model Refinement: Muon-Optimized Distillation and Quantization for LLM Deployment distillation · large-language-models	Jacob Sander et al.	2601.09865
2026-01-13	When Smaller Wins: Dual-Stage Distillation and Pareto-Guided Compression of Liquid Neural Networks for Edge Battery Prognostics	Dhivya Dharshini Kannan et al.	2601.06227
2026-01-12	How to Backdoor the Knowledge Distillation distillation	Chen Wu et al.	2504.21323
2026-01-12	InfGraND: An Influence-Guided GNN-to-MLP Knowledge Distillation distillation · graph-neural-networks	Amir Eskandari et al.	2601.08033
2026-01-02	MD-SNN: Membrane Potential-aware Distillation on Quantized Spiking Neural Network	Donghyun Lee et al.	2512.04443
2026-01-01	Knowledge Distillation for Temporal Knowledge Graph Reasoning with Large Language Models distillation · large-language-models	Wang Xing et al.	2601.00202
2025-12-16	KD-PINN: Knowledge-Distilled PINNs for ultra-low-latency real-time neural PDE solvers distillation · physics-informed-ml	Karim Bounja et al.	2512.13336
2025-12-16	Entropy-Reservoir Bregman Projection: An Information-Geometric Unification of Model Collapse	Jingwei Chen	2512.14879
2025-12-13	Cross-Modal Representational Knowledge Distillation for Enhanced Spike-Informed LFP Modeling	Eray Erturk et al.	2512.12461
2025-12-06	Foundation Models Knowledge Distillation For Battery Capacity Degradation Forecast battery-modeling	Joey Chan et al.	2505.08151
2025-12-06	The Oracle and The Prism: A Decoupled and Efficient Framework for Generative Recommendation Explanation distillation · large-language-models	Jiaheng Zhang et al.	2511.16543
2025-11-27	All Centers Are at most a Few Tokens Apart: Knowledge Distillation with Domain Invariant Prompt Tuning distillation	Amir Mohammad Ezzati et al.	2511.22739
2025-11-06	LightPFP: A Lightweight Route to Ab Initio Accuracy at Scale dft · molecular-dynamics · transfer-learning	Wenwen Li et al.	2510.23064
2025-10-24	S$^2$NN: Sub-bit Spiking Neural Networks	Wenjie Wei et al.	2509.24266
2025-10-23	Layer-to-Layer Knowledge Mixing in Graph Neural Network for Chemical Property Prediction graph-neural-networks	Teng Jiek See et al.	2510.20236
2025-10-19	DistilLock: Safeguarding LLMs from Unauthorized Knowledge Distillation on the Edge distillation · large-language-models	Asmita Mohanty et al.	2510.16716
2025-10-19	Leave It to the Experts: Detecting Knowledge Distillation via MoE Expert Signatures distillation · large-language-models	Pingzhi Li et al.	2510.16968
2025-10-14	Toward Fair Graph Neural Networks Via Dual-Teacher Knowledge Distillation distillation · graph-neural-networks	Chengyu Li et al.	2412.00382
2025-10-13	LLM-Oriented Token-Adaptive Knowledge Distillation distillation · large-language-models	Xurong Xie et al.	2510.11615
2025-09-17	LLM on a Budget: Active Knowledge Distillation for Efficient Classification of Large Text Corpora active-learning · distillation · large-language-models	Viviana Luccioli et al.	2511.11574
2025-08-27	Disentangling the Effects of Simultaneous Environmental Variables on Perovskite Synthesis and Device Performance via Interpretable Machine Learning active-learning · bayesian-inference · crystallization	Tianran Liu et al.	2509.09022
2025-08-08	Less is More: Selective Reflection for Compatible and Efficient Knowledge Distillation in Large Language Models distillation · large-language-models	Lingyuan Liu et al.	2508.06135
2025-07-25	Tuned Reverse Distillation: Enhancing Multimodal Industrial Anomaly Detection with Crossmodal Tuners anomaly-detection · distillation	Xinyue Liu et al.	2412.08949
2025-07-25	ProGMLP: A Progressive Framework for GNN-to-MLP Knowledge Distillation with Efficient Trade-offs distillation · graph-neural-networks	Weigang Lu et al.	2507.19031
2025-07-08	Pre-Training Graph Contrastive Masked Autoencoders are Strong Distillers for EEG transfer-learning	Xinxu Wei et al.	2411.19230
2025-07-01	We Need Knowledge Distillation for Solving Math Word Problems distillation · large-language-models	Zhenquan Shen et al.	2507.02982
2025-06-28	ReasonBridge: Efficient Reasoning Transfer from Closed to Open-Source Language Models distillation · large-language-models · transfer-learning	Ziqi Zhong et al.	2506.22865
2025-06-25	Enhancing Reasoning Capabilities in SLMs with Reward Guided Dataset Distillation distillation · large-language-models	Shreyansh Padarha	2507.00054
2025-06-23	Learning from Stochastic Teacher Representations Using Student-Guided Knowledge Distillation distillation	Muhammad Haseeb Aslam et al.	2504.14307
2025-06-20	Knowledge Distillation Framework for Accelerating High-Accuracy Neural Network-Based Molecular Dynamics Simulations dft · molecular-dynamics	Naoki Matsumura et al.	2506.15337
2025-06-13	Brewing Knowledge in Context: Distillation Perspectives on In-Context Learning distillation · large-language-models	Chengye Li et al.	2506.11516
2025-06-12	Ensemble Knowledge Distillation for Machine Learning Interatomic Potentials molecular-dynamics	Sakib Matin et al.	2503.14293
2025-06-06	Being Strong Progressively! Enhancing Knowledge Distillation of Large Language Models through a Curriculum Learning Framework distillation · large-language-models	Lingyuan Liu et al.	2506.05695
2025-05-30	Revisiting Cross-Modal Knowledge Distillation: A Disentanglement Approach for RGBD Semantic Segmentation distillation	Roger Ferrod et al.	2505.24361
2025-04-22	OmniScience: A Domain-Specialized LLM for Scientific Reasoning and Discovery large-language-models	Vignesh Prabhakar et al.	2503.17604
2025-04-10	Distilling Knowledge from Heterogeneous Architectures for Semantic Segmentation	Yanglin Huang et al.	2504.07691
2025-04-02	Adversarial Curriculum Graph-Free Knowledge Distillation for Graph Neural Networks distillation · graph-neural-networks	Yuang Jia et al.	2504.00540
2025-03-18	MaTVLM: Hybrid Mamba-Transformer for Efficient Vision-Language Modeling distillation	Yingyue Li et al.	2503.13440
2025-03-12	Adaptive Temperature Based on Logits Correlation in Knowledge Distillation distillation	Kazuhiro Matsuyama et al.	2503.09030
2025-03-07	Spatial Distillation based Distribution Alignment (SDDA) for Cross-Headset EEG Classification transfer-learning	Dingkun Liu et al.	2503.05349
2025-02-12	LLM Pretraining with Continuous Concepts large-language-models	Jihoon Tack et al.	2502.08524
2025-01-31	Towards Fast, Specialized Machine Learning Force Fields: Distilling Foundation Models via Energy Hessians large-language-models · molecular-dynamics	Ishan Amin et al.	2501.09009
2025-01-22	Extracting General-use Transformers for Low-resource Languages via Knowledge Distillation distillation	Jan Christian Blaise Cruz et al.	2501.12660
2025-01-17	VECT-GAN: A variationally encoded generative model for overcoming data scarcity in pharmaceutical science generative-models	Youssef Abdalla et al.	2501.08995
2024-12-25	A Unified Framework for Continual Learning and Unlearning distillation	Romit Chatterjee et al.	2408.11374
2024-12-19	Self-Evolution Knowledge Distillation for LLM-based Machine Translation distillation · large-language-models	Yuncheng Song et al.	2412.15303
2024-12-12	Optimising TinyML with Quantization and Distillation of Transformer and Mamba Models for Indoor Localisation on Edge Devices	Thanaphon Suwannaphong et al.	2412.09289
2024-11-13	Physics Informed Distillation for Diffusion Models distillation · physics-informed-ml	Joshua Tian Jin Tee et al.	2411.08378
2024-11-11	Towards Diverse Device Heterogeneous Federated Learning via Task Arithmetic Knowledge Integration distillation	Mahdi Morafah et al.	2409.18461
2024-11-09	Multi-hop RIS-aided Learning Model Sharing for Urban Air Mobility	Kai Xiong et al.	2411.06015
2024-10-05	Gap Preserving Distillation by Building Bidirectional Mappings with A Dynamic Teacher distillation	Yong Guo et al.	2410.04140
2024-10-01	AMR-Evol: Adaptive Modular Response Evolution Elicits Better Knowledge Distillation for Large Language Models in Code Generation distillation · large-language-models	Ziyang Luo et al.	2410.00558
2024-09-10	Knowledge Distillation via Query Selection for Detection Transformer distillation	Yi Liu et al.	2409.06443
2024-08-26	TSAK: Two-Stage Semantic-Aware Knowledge Distillation for Efficient Wearable Modality and Model Optimization in Manufacturing Lines	Hymalai Bello et al.	2408.14146
2024-07-28	LLAVADI: What Matters For Multimodal Large Language Models Distillation distillation · large-language-models	Shilin Xu et al.	2407.19409
2024-07-23	DDK: Distilling Domain Knowledge for Efficient Large Language Models distillation · large-language-models	Jiaheng Liu et al.	2407.16154
2024-07-14	Multi-Granularity Semantic Revision for Large Language Model Distillation distillation · large-language-models	Xiaoyu Liu et al.	2407.10068
2024-07-05	AMD: Automatic Multi-step Distillation of Large-scale Vision Models distillation	Cheng Han et al.	2407.04208
2024-07-05	DeepLNE++ leveraging knowledge distillation for accelerated multi-state path-like collective variables molecular-dynamics	Thorben Fröhlking et al.	2407.04376
2024-06-12	Small Scale Data-Free Knowledge Distillation distillation	He Liu et al.	2406.07876
2024-06-05	Multi-Task Multi-Scale Contrastive Knowledge Distillation for Efficient Medical Image Segmentation distillation	Risab Biswas	2406.03173
2024-03-14	Adapting OC20-trained EquiformerV2 Models for High-Entropy Materials adsorption · adsorption-energy · catalysis · dft	Christian M. Clausen et al.	2403.09811