I am a PhD student at York University. I completed my M.Sc. (Thesis-based) in Computer Science from York University where I was working as a research assistant under the supervision of Prof. Enamul Hoque. in collaboration with Prof. Shafiq Joty, who is currently a research director at Salesforce AI Research. My research focused on multimodal charts understanding tasks, such as answering questions about charts, summarizing charts, and extracting data from charts.

Our research work has been accepted in several prestigious conferences such as ACL 2022, CVPR 2021, EuroVis 2022, EMNLP 2023, AAAI 2024, and ACL 2024. Moreover, our work has gained considerable attention; our ChartQA benchmark has been featured as a key multimodal evaluation benchmark by OpenAI’s GPT-4 official blog post and Google’s Gemini paper in evaluating their models visual reasoning capabilities. My google scholar has over 435 citations with an h-index of 6. Our chart understanding models have been downloaded over 40,000 times from Hugging Face, with a monthly average of 5,000 downloads!

Research Interests

• Natural Language Processing
• Large Language Models
• Vision - Language
• Multimodal Large Language Modeling
• Multimodal Chart Understnding
• Multimodal Document Understanding

Education

• York University
  M.Sc. in Computer Science, Sep 2020 - June 2022
  GPA: 9/9, Exceptional A+
• Koc University
  B.Sc. in Computer Engineering, Sep 2017 - June 2020
  GPA: 3.9/4.0

Work Experience

• Arteria AI
  Senior Data Scientist, January 2024 - Present

• Arteria AI
  Data Scientist, May 2022 - December 2023

• York University
  Research Assistant, Sep 2020 - June 2022

• York University
  Teaching Assistant, Jan 2021 - Apr 2022

• ShallowAI
  Data Scientist Intern, July 2020 - Sep 2020

• Koc University
  Undergraduate Research Assistant, June 2019 - Jan 2020

Publications

1. ChartInstruct: Instruction Tuning for Chart Comprehension and Reasoning
   Ahmed Masry*, Mehrad Shahmohammadi*, Md Rizwan Parvez, Enamul Hoque, Shafiq Joty [*Equal Contribution]
   Published at ACL 2024

2. UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoning
   Ahmed Masry*, Parsa Kavehzadeh*, Xuan Long Do, Shafiq Joty, and Enamul Hoque [*Equal Contribution]
   Published at EMNLP 2023

3. Chart-to-Text: A Large-Scale Benchmark for Chart Summarization
   Shankar Kantharaj*, Rixie Tiffany Leong*, Xiang Lin*, Ahmed Masry*, Megh Thakkar*, Enamul Hoque, Shafiq Joty [*Equal Contribution]
   Published at ACL 2022

4. ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning
   Ahmed Masry, Do Long, Jia Qing Tan, Shafiq Joty, and Enamul Hoque.
   Published at ACL 2022

5. Chart Question Answering: State of the Art and Future Directions
   Enamul Hoque, Parsa Kavehzadeh, Ahmed Masry
   Published at EuroVis 2022

6. Chain FL: Decentralized Federated Machine Learning via Blockchain
   C. Korkmaz, H. E. Kocas, A. Uysal, A. Masry, O. Ozkasap and B. Akgun
   Published at BCCA 2020

Workshop Papers

1. LongFin: A Multimodal Document Understanding Model for Long Financial Domain Documents
   Ahmed Masry and Amir Hajian.
   Published at AIFinSI @ AAAI 2024

2. Integrating Image Data Extraction and Table Parsing Methods for Chart Question Answering
   Ahmed Masry, Enamul Hoque Prince
   Published at ChartQA @ CVPR 2021 [Best Paper Award]

Preprints

1. Do LLMs Work on Charts? Designing Few-Shot Prompts for Chart Question Answering and Summarization
   Xuan Long Do, Mohammad Hassanpour, Ahmed Masry, Parsa Kavehzadeh, Enamul Hoque, Shafiq Joty

2. ChartGemma: Visual Instruction-tuning for Chart Reasoning in the Wild
   Ahmed Masry*, Megh Thakkar*, Aayush Bajaj, Aaryaman Kartha, Enamul Hoque, Shafiq Joty

Achievements & ExtraCurricular

• Al Ghurair Foundation for Education STEM Scholarship Program (AGFE)
  A merit-based award for highly achieving Arab students to pursue a fully funded STEM degree.

• Vehbi Koc Scholar And Dean’s Honor Roll
  Merit-based Awards for Academic Excellence

• CVPR 2021 Chart Question Answering Workshop
  Achieved Best Paper Award.

• Al-Ghurair Foundation (AGFE)
  Student Ambassador

• Robotics Craftsmanship International Academy (University of Coimbra)
  Ranked 1st in the sumo robots competition, and in the top 10 out of 84 participants.

Academic Services

• ACL 2024 Reviewer
• EMNLP 2024 Reviewer

Recent News

• Paper accepted at ACL 2024
  May 2024
• Paper accepted at AIFinSI@AAAI 2024
  January 2024
• Promoted to Senior Data Scientist at at Arteria AI
  January 2024
• Paper accepted at EMNLP 2023
  October 2023
• Presented ChartQA Poster at TMLS 2023
  June 2023
• Defended my M.Sc. Thesis at York University
  June 2022
• Presented ChartQA Poster at CVR/VISTA 2022
  June 2022
• Paper accepted at EuroVis 2022
  May 2022
• Started working at ArteriaAI as an NLP Data Scientist.
  May 2022
• Paper accepted at ACL 2022
  March 2022
• Paper accepted at ACL 2022
  March 2022
• Won Best Paper Paper award at ChartQA@CVPR 2021
  June 2021
• Paper accepted at ChartQA@CVPR 2021
  June 2021
• Joined as a Graduate Teaching Student at York University
  January 2021
• Joined as a Graduate Research Assistant at York University
  September 2020
• Started Fully Funded M.Sc. in Computer Science at York University
  September 2020
• Started as a Data Scientist Intern at Shallow AI
  July 2020