Publications

Preprints/In preparation.

—

Conference proceedings/Workshop papers.

1. Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models [arXiv]
   Alliot Nagle*, A. G.*, Marco Bondaschi, Michael Gastpar, Ashok Vardhan Makkuva, Hyeji Kim
   NeurIPS 2024
   Also at ICML 2024 Workshop on Theoretical Foundations of Foundation Models (TF2M) [Oral (top 4 out of 58)]

2. Local to Global: Learning Dynamics and Effect of Initialization for Transformers [arXiv]
   Ashok Vardhan Makkuva*, Marco Bondaschi*, Chanakya Ekbote, A. G., Alliot Nagle, Hyeji Kim, Michael Gastpar
   NeurIPS 2024
   Also at ICML 2024 Workshop on Theoretical Foundations of Foundation Models (TF2M)

3. Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains [arXiv]
   Ashok Vardhan Makkuva*, Marco Bondaschi*, A. G., Alliot Nagle, Martin Jaggi, Hyeji Kim, Michael Gastpar
   ICML 2024 Workshop on Mechanistic Interpretability (MI)

4. ICQ: A Quantization Scheme for Best-Arm Identification Over Bit-Constrained Channels [IEEE Xplore] [arXiv]
   Fathima Z. Faizal, A. G., Manjesh K. Hanawal, Nikhil Karamchandani
   WiOpt (International Symposium on Modeling and Optimization in Mobile, Ad hoc, and Wireless Networks) 2023

5. Micro-Doppler Parameter Estimation Using Variational Mode Decomposition With Finite Rate of Innovation [IEEE Xplore]
   Shrikant Sharma, A. G., Darin Jeff, Garweet Sresth, Sanket Bhalerao, Vikram M. Gadre, C. H. Srinivas Rao, P. Radhakrishna
   SPCOM (IEEE International Conference on Signal Processing and Communications) 2022

6. Theoretical Analysis of an Inverse Radon Transform Based Multicomponent Micro-Doppler Parameter Estimation Algorithm [IEEE Xplore]
   Shrikant Sharma, A. G., Nikhar P. Rakhashia, Vikram M. Gadre, Shaan ul Haque, Aseer Ansari, Ram Bilas Pachori, P. Radhakrishna, Peeyush Sahay
   NCC (National Conference on Communications) 2022

Machine learning (Transformers/LLMs, bandits; 2022–24).

1. Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models [arXiv]
   Alliot Nagle*, A. G.*, Marco Bondaschi, Michael Gastpar, Ashok Vardhan Makkuva, Hyeji Kim
   NeurIPS 2024
   Also at ICML 2024 Workshop on Theoretical Foundations of Foundation Models (TF2M) [Oral (top 4 out of 58)]

2. Local to Global: Learning Dynamics and Effect of Initialization for Transformers [arXiv]
   Ashok Vardhan Makkuva*, Marco Bondaschi*, Chanakya Ekbote, A. G., Alliot Nagle, Hyeji Kim, Michael Gastpar
   NeurIPS 2024
   Also at ICML 2024 Workshop on Theoretical Foundations of Foundation Models (TF2M)

3. Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains [arXiv]
   Ashok Vardhan Makkuva*, Marco Bondaschi*, A. G., Alliot Nagle, Martin Jaggi, Hyeji Kim, Michael Gastpar
   ICML 2024 Workshop on Mechanistic Interpretability (MI)

4. ICQ: A Quantization Scheme for Best-Arm Identification Over Bit-Constrained Channels [IEEE Xplore] [arXiv]
   Fathima Z. Faizal, A. G., Manjesh K. Hanawal, Nikhil Karamchandani
   WiOpt (International Symposium on Modeling and Optimization in Mobile, Ad hoc, and Wireless Networks) 2023

Signal processing (micro-Doppler parameter estimation; 2020–22).

1. Micro-Doppler Parameter Estimation Using Variational Mode Decomposition With Finite Rate of Innovation [IEEE Xplore]
   Shrikant Sharma, A. G., Darin Jeff, Garweet Sresth, Sanket Bhalerao, Vikram M. Gadre, C. H. Srinivas Rao, P. Radhakrishna
   SPCOM (IEEE International Conference on Signal Processing and Communications) 2022

2. Theoretical Analysis of an Inverse Radon Transform Based Multicomponent Micro-Doppler Parameter Estimation Algorithm [IEEE Xplore]
   Shrikant Sharma, A. G., Nikhar P. Rakhashia, Vikram M. Gadre, Shaan ul Haque, Aseer Ansari, Ram Bilas Pachori, P. Radhakrishna, Peeyush Sahay
   NCC (National Conference on Communications) 2022