AXIOM 2026

Foundations of Efficient Deep Learning

Towards predictive principles for efficient AI connecting deep learning theory, scaling laws, and efficiency

NeurIPS 2026 · Paris, France

December 12, 2026

About the Workshop

Recent advances in deep learning theory suggest that machine learning is gradually evolving from an empirical discipline into a predictive science. Scaling laws, optimization theory, learning dynamics, and representation learning increasingly explain why modern deep learning systems work. Yet these advances have had limited impact on one of today's most pressing challenges: building AI systems that are efficient under realistic constraints of compute, memory, energy, communication, and data. Current efficiency techniques, such as pruning, quantization, sparse computation, adaptive inference, and efficient architecture, remain largely driven by empirical investigation. Conversely, many theoretical advances explain observations only after the fact, rather than predicting which algorithms or architectures will be most effective before expensive experimentation.

The AXIOM Workshop brings together researchers from deep learning theory, machine learning systems, optimization, and efficient AI to explore a central question:

Can we develop predictive principles that guide the design of efficient AI systems?

Our goal is to bridge theory and practice by identifying the mathematical principles underlying efficient learning and by defining the next generation of research challenges for efficient deep learning. The workshop features invited vision talks, contributed papers, posters, panel discussions, and a community-driven Grand Challenges initiative that will collectively shape a research agenda for the foundations of efficient AI.

Invited Speakers

Rahim Entezari

Invited Vision Talk · Efficiency

Rahim Entezari

Starting something new ... (ex-StabilityAI, ex-Wayve), UK

Katharina Eggensperger

Invited Vision Talk · Efficiency

Katharina Eggensperger

Lamarr Institute and TU Dortmund, Germany

Michael Kamp

Invited Vision Talk · Efficiency

Michael Kamp

Lamarr Institute and TU Dortmund, Germany

Bruno Loureiro

Invited Vision Talk · Theory

Bruno Loureiro

CNRS & École Normale Supérieure, France

Alexander van Meegen

Invited Vision Talk · Theory

Alexander van Meegen

RWTH Aachen, Germany

Hannah Pinson

Invited Vision Talk · Theory

Hannah Pinson

Eindhoven University of Technology (TU/e), Netherlands

Call For Papers

Topics of Interest

We welcome submissions addressing theoretical, algorithmic, and systems aspects of efficient deep learning, including but not limited to:

  • Predictive Theory for Efficient Learning: Scaling laws for efficient models, compute-optimal training and inference, predicting capability under resource constraints, optimization and learning dynamics, generalization under limited compute or data, phase transitions in efficient learning;
  • Sparsity, Compression, and Model Structure: Foundations of pruning and quantization, sparse and modular neural networks, lottery tickets and subnetworks, adaptive computation, neural architecture design, representation learning for efficiency;
  • Efficient Foundation Models: Efficient LLMs and multimodal models, efficient reasoning and adaptive inference, mixture-of-experts and modular architectures, test-time adaptation, memory-efficient training and inference, distillation and compression;
  • Foundations and Future Directions: Theoretical limits of efficient AI, new efficiency metrics and benchmarks, predictive models of training dynamics, interpretability of efficient models, mathematical foundations of efficient deep learning, emerging theoretical paradigms for efficient AI.

Interdisciplinary work connecting theory, algorithms, systems, and hardware is particularly encouraged.

Paper Submission

We invite submissions presenting original research, preliminary results, novel ideas, and emerging research directions that advance the theoretical and practical foundations of efficient deep learning. We particularly encourage work that connects deep learning theory with efficient machine learning, including studies that improve our understanding of resource-efficient learning, reveal new theoretical principles, or bridge the gap between mathematical foundations and practical AI systems.

We invite short paper submissions (4 pages, excluding references) which follow the NeurIPS workshop formatting guidelines. This workshop is non-archival. Outstanding submissions will be invited for a 15-minute oral presentation. All accepted papers will be presented during the poster session and published on the workshop website. A Best Paper Award will be presented during the workshop.

Grand Challenges Track

Beyond research papers, AXIOM introduces a Grand Challenges track designed to identify the most important open questions for the future of efficient AI. Instead of reporting completed research, Grand Challenges submissions should articulate important unanswered questions, theoretical gaps, surprising empirical observations, or future research opportunities. We particularly encourage contributions on:

  • Open theoretical questions motivated by efficient AI;
  • Efficiency methods lacking theoretical explanations;
  • Contradictions between theory and practice;
  • Missing benchmarks, evaluation methodologies, or efficiency metrics.

Accepted submissions will be published on the workshop website and synthesized into a community report that will serve as the starting point for an interactive discussion session during the workshop. The insights from this discussion will contribute to a community position paper outlining a research agenda for predictive and efficient AI.

Grand Challenges submissions should consist of a one-page abstract plus references, with no appendix. They will undergo a light review and accepted submissions will be published on the workshop webpage.

Important Dates

Paper submission
August 29, 2026 (11:59 PM UTC-0)
Author notification
September 29, 2026 (AoE)
Camera-ready deadline
TBA

Submission Details

Submission site: OpenReview.

Submission format instructions:

  • Papers: 4 pages excluding references and appendix, double-blind;
  • Grand Challenges: 1 page excluding references, no appendix, double-blind.

Please use the NeurIPS 2026 LaTeX template. All papers will undergo peer review by the Program Committee.

Following the Guidance for NeurIPS Workshop Proposals 2026, workshop submissions must not duplicate work previously published at machine learning or related conferences. Work presented at the main NeurIPS conference must not also appear in the workshop, including as part of an invited talk. All authors, reviewers, presenters, and participants are expected to follow the NeurIPS Code of Conduct.

Submit to OpenReview

Program

Times shown in CET

Time
Session
Speaker(s)
Opening Remarks
Organizers
Invited Vision Talk 1 (Efficiency)
Rahim Entezari
Invited Vision Talk 2 (Efficiency)
Katharina Eggensperger
Invited Vision Talk 3 (Efficiency)
Michael Kamp
Oral Presentations (2 × 15 min)
TBD
Coffee Break
Oral Presentations (5 × 15 min)
TBD
Lunch
Poster Session
TBD
Invited Vision Talk 4 (Theory)
Bruno Loureiro
Invited Vision Talk 5 (Theory)
Alexander van Meegen
Invited Vision Talk 6 (Theory)
Hannah Pinson
Coffee Break
Grand Challenges & Research Directions
Organizers + Panelists
Closing & Best Paper Award
Organizers

Organizing Team

The workshop originates from the ELLIS Mathematics and Efficiency of Deep Learning Reading Group.

ELLIS Unit Graz ELLIS Unit Lausanne ELLIS Unit North Rhine-Westphalia

Contact

For questions or further information regarding the workshop, please contact the organizing committee: axiom.neurips2026@gmail.com