I am a Staff Research Scientist and Manager at Google.

I work on improving the core model quality of Gemini, with a particular emphasis on enhancing its ability to follow instructions and engage in multi-turn conversations.

Prior to this, I contributed to the development of features that enabled users to have more natural conversations with the Google Assistant.

I earned my Ph.D. from the University of Pennsylvania under the guidance of Prof. Dan Roth. I also hold an undergraduate degree in Computer Science and Engineering from the Indian Institute of Technology at Kanpur.

Selected Publications

  1. EACL 2023
    Efficient Encoders for Streaming Sequence Tagging
    Ayush Kaushal, Aditya Gupta, Shyam Upadhyay, and Manaal Faruqui
    In EACL 2023
  2. StarSEM 2023
    Can Sequence-to-Sequence Transformers Naturally Understand Sequential Instructions?
    Xiang Zhou, Aditya Gupta, Shyam Upadhyay, Mohit Bansal, and Manaal Faruqui
    In StarSEM 2023
  3. Interspeech 2022
    Streaming Intended Query Detection using E2E Modeling for Continued Conversation
    Shuo-yiin Chang, Guru Prakash, Zelin Wu, Qiao Liang, Tara N. Sainath, Bo Li, Adam Stambler, Shyam Upadhyay, Manaal Faruqui, and Trevor Strohman
    In Interspeech 2022
  4. ACL 2022
    TableFormer: Robust Transformer Modeling for Table-Text Encoding
    Jingfeng Yang, Aditya Gupta, Shyam Upadhyay, Luheng He, Rahul Goel, and Shachi Paul
    In ACL 2022
  5. ACL 2021
    TIMEDIAL: Temporal Commonsense Reasoning in Dialog
    Lianhui Qin, Aditya Gupta, Shyam Upadhyay, Luheng He, Yejin Choi, and Manaal Faruqui
    In ACL 2021
  6. EMNLP 2018
    Joint Multilingual Supervision for Cross-lingual Entity Linking
    Shyam Upadhyay, Nitish Gupta, and Dan Roth
    In EMNLP 2018
  7. NAACL 2018
    Looking Beyond the Surface: A Challenge Set for Reading Comprehension over Multiple Sentences
    Daniel Khashabi, Snigdha Chaturvedi, Michael Roth, Shyam Upadhyay, and Dan Roth
    In NAACL 2018
  8. ICASSP 2018
    (Almost) Zero-Shot Cross-Lingual Spoken Language Understanding
    Shyam Upadhyay, Manaal Faruqui, Gokhan Tür, Dilek Hakkani-Tür, and Larry Heck
    In ICASSP 2018
  9. EMNLP 2016
    Learning from Explicit and Implicit Supervision Jointly For Algebra Word Problems
    Shyam Upadhyay, Ming-Wei Chang, Kai-Wei Chang, and Wen-tau Yih
    In EMNLP 2016
  10. ACL 2016
    Cross-lingual Models of Word Embeddings: An Empirical Comparison
    Shyam Upadhyay, Manaal Faruqui, Chris Dyer, and Dan Roth
    In ACL 2016