Research Staff Member

MIT-IBM Watson AI Lab

650 Harry Road

San Jose, CA 95120

Email: pengyuan [AT] ibm.com

About

Dr. Pengyuan Li is a Research Staff Member from MIT-IBM Watson AI Lab, based in San Jose, California. He is the lead developer of the Granite Vision Models, a large vision model for visual document understanding. Previously, he served as the Data Acquisition Lead and collected more than 10PB data for building Large Language, Code, and Multimodal Models at IBM Research.

Pengyuan’s research focuses on machine learning, multimodal data mining, document analysis, and biomedical informatics. He has served as a visiting scholar at UCLA, UBC, JHU, and Tongji University, collaborating with researchers around the world to explore innovative, cross-disciplinary ideas. He is also an Adjunct Faculty member at the Data Science Institute, University of Delaware.

News

  • 07/2025: Our Granite Vision Models yield more than 100K downloads from HuggingFace
  • 06/2025: Pengyuan gave a demo for Granite Vision Models at CVPR2025
  • 02/2024: Pengyuan co-organized the 'AI and Biodata' workshop at the 18th Annual International Biocuration Conference
  • 02/2024: Pengyuan presented GeneScribe: Leveraging large language models for gene summary generation at the 18th Annual International Biocuration Conference
  • 03/2025: Pengyuan published Large Vision models on behalf of IBM-Research on HuggingFace
  • 02/2024: Pengyuan gave a talk at SILS, University of North Carolina at Chapel Hill
  • 01/2024: Pengyuan gave a talk at DBMI, Columbia University
  • 02/2023: Pengyuan joined the Data Science Institute @ University of Delaware as an adjunct faculty
  • 07/2021: Pengyuan joined the IBM Almaden Research center as a Research Staff Member
  • 04/2021: A paper got accepted to ISMB/ECCB2021
  • 04/2021: Recieved Frank A. Pehrson Graduate Student Award from University of Delaware
  • 04/2020: Recieved Fellowship from Univeristy of Delaware
  • 09/2019: Had summer intern at IBM Research – Almaden
  • 04/2019: A paper got accepted to Bioinformatics
  • 08/2018: A paper got accepted to CIKM 2018
  • 05/2018: Visited at Robotics and Control Lab, UBC for the Summer. Worked with Prof. Abolmaesumi
  • 10/2017: A paper got accepted to Bioinformatics
  • 09/2017: Recieved Student Travel Grant from CLEF2017
  • 06/2017: A paper got accepted to CLEF2017(Best of Lab paper)