Madhura Pande Home Page
MS Scholar ( Roll No: CS17S031 )
Advisor(s) : Mitesh Khapra
Lab(s) : IIL Lab.

Publications : (Last Five, while at IITM)View All

  • The Heads Hypothesis: A Unifying Statistical Approach Towards Understanding Multi-Headed Attention in BERT. 
    Authors : Madhura Pande, Aakriti Budhraja, Preksha Nema, Pratyush Kumar, Mitesh Khapra
    Appeared in Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event, February 2-9, 2021, pp.13613-13621, Feb 2021
  • On the weak link between importance and prunability of attention heads. 
    Authors : Aakriti Budhraja, Madhura Pande, Preksha Nema, Pratyush Kumar, Mitesh Khapra
    Appeared in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020 (EMNLP 2020) ,pp.3230-3235, Nov 2020

(Recent) Teaching Assistantship : View All  |  Back to top

Jan 2019 - May 2019 : - Pattern Recognition and Machine Learning (CS5691)
Jul 2018 - Nov 2018 : - Introduction to Programming (CS1100)