A Common Interface for Automatic Differentiation

Guillaume Dalle, Adrian Hill

arXiv:2505.05542·cs.MS·Published 2025-05-08

For scientific machine learning tasks with a lot of custom code, picking the right Automatic Differentiation (AD) system matters. Our Julia package DifferentiationInterface$.$jl provides a common frontend to a dozen AD backends, unlocking easy comparison and modular development. In particular, its built-in preparation mechanism leverages the strengths of each backend by amortizing one-time computations. This is key to enabling sophisticated features like sparsity handling without putting additional burdens on the user.

TopicsScientific Machine Learning & PINNs

Tagsscientific-machine-learning

arXiv categoriescs.MS, cs.LG, math.NA

arXiv abstract pagePDF