Jonathan Bragg
Headshot
Senior Research Scientist
Allen Institute for AI (AI2)
jbragg [at] allenai.org

About

I am a Senior Research Scientist at the Allen Institute for AI (AI2). My main research interests involve how to build multi-agent systems that effectively coordinate work by humans and machines. Currently, I am focused on building systems that accelerate scientific discovery and improve AI (e.g., human-in-the-loop model evaluation). I publish at AI and HCI venues.

Previously, I was in the computer science departments at Stanford (postdoc), University of Washington (Ph.D.), and Harvard College (A.B.). I am also a musician with degrees from New England Conservatory (M.M.) and Harvard College (A.B.).

If you are interested in working with me, please apply to open positions on my team and/or reach out to me directly.

Publications

* denotes equal contribution

2024

  1. Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference
    Mingqi Gao*, Yixin Liu*, Xinyu Hu, Xiaojun Wan, Jonathan Bragg, Arman Cohan
    CoRR, Dec 2024
    To appear NAACL 2025
    arXiv
  2. Cocoa: Co-Planning and Co-Execution with AI Agents
    K. J. Kevin Feng, Kevin Pu, Matt Latzke, Tal August, Pao Siangliulue, Jonathan Bragg, Daniel S. Weld, Amy X. Zhang, Joseph Chee Chang
    CoRR, Dec 2024
    arXiv
  3. Social-RAG: Retrieving from Group Interactions to Socially Ground Proactive AI Generation to Group Preferences
    Ruotong Wang, Xinyi Zhou, Lin Qiu, Joseph Chee Chang, Jonathan Bragg, Amy X. Zhang
    CoRR, Nov 2024
    To appear CHI 2025
    arXiv
  4. IdeaSynth: Iterative Research Idea Development Through Evolving and Composing Idea Facets with Literature-Grounded Feedback
    Kevin Pu, K. J. Kevin Feng, Tovi Grossman, Tom Hope, Bhavana Dalvi Mishra, Matt Latzke, Jonathan Bragg, Joseph Chee Chang, Pao Siangliulue
    CoRR, Oct 2024
    To appear CHI 2025
    arXiv
  5. The Semantic Reader Project
    Kyle Lo, Joseph Chee Chang, Andrew Head, Jonathan Bragg, Amy X. Zhang, Cassidy Trier, Chloe Anastasiades, Tal August, Russell Authur, Danielle Bragg, Erin Bransom, Isabel Cachola, Stefan Candra, Yoganand Chandrasekhar, Yen-Sung Chen, Evie Yu-Yen Cheng, Yvonne Chou, Doug Downey, Rob Evans, Raymond Fok, Fangzhou Hu, Regan Huff, Dongyeop Kang, Tae Soo Kim, Rodney Kinney, Aniket Kittur, Hyeonsu B. Kang, Egor Klevak, Bailey Kuehl, Michael Langan, Matt Latzke, Jaron Lochner, Kelsey MacMillan, Eric Marsh, Tyler Murray, Aakanksha Naik, Ngoc-Uyen Nguyen, Srishti Palani, Soya Park, Caroline Paulic, Napol Rachatasumrit, Smita Rao, Paul Sayre, Zejiang Shen, Pao Siangliulue, Luca Soldaini, Huy Tran, Madeleine Zuylen, Lucy Lu Wang, Chris Wilhelm, Caroline Wu, Jiangjiang Yang, Angele Zamarron, Marti A. Hearst, Daniel S. Weld
    Commun. ACM, Sep 2024
    Publisher arXiv
  6. ARIES: A Corpus of Scientific Paper Edits Made in Response to Peer Reviews
    Mike D’Arcy, Alexis Ross, Erin Bransom, Bailey Kuehl, Jonathan Bragg, Tom Hope, Doug Downey
    ACL 2024
    Publisher arXiv
  7. Let’s Get to the Point: LLM-Supported Planning, Drafting, and Revising of Research-Paper Blog Posts
    Marissa Radensky, Daniel S. Weld, Joseph Chee Chang, Pao Siangliulue, Jonathan Bragg
    CoRR, Jun 2024
    arXiv
  8. Accelerating Scientific Paper Skimming with Augmented Intelligence Through Customizable Faceted Highlights
    Raymond Fok, Luca Soldaini, Cassidy Trier, Erin Bransom, Kelsey MacMillan, Evie Cheng, Hita Kambhamettu, Jonathan Bragg, Kyle Lo, Marti A. Hearst, Andrew Head, Daniel S. Weld
    ACM Trans. Interact. Intell. Syst., May 2024
    Publisher
  9. Mitigating Barriers to Public Social Interaction with Meronymous Communication
    Nouran Soliman, Hyeonsu B. Kang, Matthew Latzke, Jonathan Bragg, Joseph Chee Chang, Amy X. Zhang, David R. Karger
    CHI 2024 Best Paper
    Publisher arXiv
  10. PaperWeaver: Enriching Topical Paper Alerts by Contextualizing Recommended Papers with User-collected Papers
    Yoonjoo Lee, Hyeonsu B. Kang, Matt Latzke, Juho Kim, Jonathan Bragg, Joseph Chee Chang, Pao Siangliulue
    CHI 2024
    Publisher arXiv
  11. FigurA11y: AI Assistance for Writing Scientific Alt Text
    Nikhil Singh, Lucy Lu Wang, Jonathan Bragg
    IUI 2024
    Publisher Code

2023

  1. RCT Rejection Sampling for Causal Estimation Evaluation
    Katherine A. Keith, Sergey Feldman, David Jurgens, Jonathan Bragg, Rohit Bhattacharya
    Transactions on Machine Learning Research 2023
    Publisher arXiv
  2. Papeos: Augmenting Research Papers with Talk Videos
    Tae Soo Kim, Matt Latzke, Jonathan Bragg, Amy X. Zhang, Joseph Chee Chang
    UIST 2023
    Publisher arXiv
  3. Paper Plain: Making Medical Research Papers Approachable to Healthcare Consumers with Natural Language Processing
    Tal August, Lucy Lu Wang, Jonathan Bragg, Marti A. Hearst, Andrew Head, Kyle Lo
    ACM Trans. Comput. Hum. Interact. 2023
    Publisher arXiv
  4. CiteSee: Augmenting Citations in Scientific Papers with Persistent and Personalized Historical Context
    Joseph Chee Chang, Amy X. Zhang, Jonathan Bragg, Andrew Head, Kyle Lo, Doug Downey, Daniel S. Weld
    CHI 2023 Best Paper
    Publisher arXiv
  5. ComLittee: Literature Discovery with Personal Elected Author Committees
    Hyeonsu B. Kang, Nouran Soliman, Matt Latzke, Joseph Chee Chang, Jonathan Bragg
    CHI 2023
    Publisher arXiv
  6. Relatedly: Scaffolding Literature Reviews with Existing Related Work Sections
    Srishti Palani, Aakanksha Naik, Doug Downey, Amy X. Zhang, Jonathan Bragg, Joseph Chee Chang
    CHI 2023
    Publisher arXiv
  7. Beyond Summarization: Designing AI Support for Real-World Expository Writing Tasks
    Zejiang Shen, Tal August, Pao Siangliulue, Kyle Lo, Jonathan Bragg, Jeff Hammerbacher, Doug Downey, Joseph Chee Chang, David A. Sontag
    CoRR, Apr 2023
    arXiv
  8. Scim: Intelligent Skimming Support for Scientific Papers
    Raymond Fok, Hita Kambhamettu, Luca Soldaini, Jonathan Bragg, Kyle Lo, Marti A. Hearst, Andrew Head, Daniel S. Weld
    IUI 2023
    Publisher arXiv
  9. The Semantic Scholar Open Data Platform
    Rodney Kinney, Chloe Anastasiades, Russell Authur, Iz Beltagy, Jonathan Bragg, Alexandra Buraczynski, Isabel Cachola, Stefan Candra, Yoganand Chandrasekhar, Arman Cohan, Miles Crawford, Doug Downey, Jason Dunkelberger, Oren Etzioni, Rob Evans, Sergey Feldman, Joseph Gorney, David Graham, Fangzhou Hu, Regan Huff, Daniel King, Sebastian Kohlmeier, Bailey Kuehl, Michael Langan, Daniel Lin, Haokun Liu, Kyle Lo, Jaron Lochner, Kelsey MacMillan, Tyler Murray, Chris Newell, Smita Rao, Shaurya Rohatgi, Paul Sayre, Zejiang Shen, Amanpreet Singh, Luca Soldaini, Shivashankar Subramanian, Amber Tanaka, Alex D. Wade, Linda Wagner, Lucy Lu Wang, Chris Wilhelm, Caroline Wu, Jiangjiang Yang, Angele Zamarron, Madeleine Zuylen, Daniel S. Weld
    CoRR, Jan 2023
    arXiv

2022

  1. GENIE: Toward Reproducible and Standardized Human Evaluation for Text Generation
    Daniel Khashabi, Gabriel Stanovsky, Jonathan Bragg, Nicholas Lourie, Jungo Kasai, Yejin Choi, Noah A. Smith, Daniel S. Weld
    EMNLP 2022
    Publisher arXiv Code Website
  2. Exploring Team-Sourced Hyperlinks to Address Navigation Challenges for Low-Vision Readers of Scientific Papers
    Soya Park, Jonathan Bragg, Michael Chang, Kevin Larson, Danielle Bragg
    Proc. ACM Hum. Comput. Interact. 2022
    Publisher
  3. A Dataset of Alt Texts from HCI Publications: Analyses and Uses Towards Producing More Descriptive Alt Texts of Data Visualizations in Scientific Papers
    Sanjana Shivani Chintalapati, Jonathan Bragg, Lucy Lu Wang
    ASSETS 2022
    Publisher arXiv Code
  4. FeedLens: Polymorphic Lenses for Personalizing Exploratory Search over Knowledge Graphs
    Harmanpreet Kaur, Doug Downey, Amanpreet Singh, Evie Yu-Yen Cheng, Daniel S. Weld, Jonathan Bragg
    UIST 2022
    Publisher arXiv
  5. From Who You Know to What You Read: Augmenting Scientific Recommendations with Implicit Social Networks
    Hyeonsu B. Kang, Rafal Kocielnik, Andrew Head, Jiangjiang Yang, Matt Latzke, Aniket Kittur, Daniel S. Weld, Doug Downey, Jonathan Bragg
    CHI 2022
    Publisher
  6. CiteRead: Integrating Localized Citation Contexts into Scientific Paper Reading
    Napol Rachatasumrit, Jonathan Bragg, Amy X. Zhang, Daniel S. Weld
    IUI 2022
    Publisher

2021

  1. FLEX: Unifying Evaluation for Few-Shot NLP
    Jonathan Bragg*, Arman Cohan*, Kyle Lo, Iz Beltagy
    NeurIPS 2021
    Publisher arXiv Code
  2. SciA11y: Converting Scientific Papers to Accessible HTML
    Lucy Lu Wang*, Isabel Cachola*, Jonathan Bragg, Evie Yu-Yen Cheng, Chelsea Haupt, Matt Latzke, Bailey Kuehl, Madeleine N. Zuylen, Linda Wagner, Daniel S. Weld
    ASSETS 2021 Best Artifact
    Publisher Website
  3. Improving the Accessibility of Scientific Documents: Current State, User Needs, and a System Solution to Enhance Scientific PDF Accessibility for Blind and Low Vision Users
    Lucy Lu Wang*, Isabel Cachola*, Jonathan Bragg, Evie Yu-Yen Cheng, Chelsea Haupt, Matt Latzke, Bailey Kuehl, Madeleine Zuylen, Linda Wagner, Daniel S. Weld
    CoRR, Apr 2021
    arXiv Website

2019

  2. Cicero: Multi-Turn, Contextual Argumentation for Accurate Crowdsourcing
    Quanze Chen, Jonathan Bragg, Lydia B. Chilton, Daniel S. Weld
    CHI 2019
    Publisher arXiv

2018

  1. Automatic Curriculum Generation Applied to Teaching Novices a Short Bach Piano Segment
    Emma Brunskill, Tong Mu, Karan Goel, Jonathan Bragg
    In NeurIPS ’18 Demonstration Track , Dec 2018
  2. Sprout: Crowd-Powered Task Design for Crowdsourcing
    Jonathan Bragg, Mausam, Daniel S. Weld
    UIST 2018
    Publisher Video Code Slides
  3. Self-Improving Crowdsourcing: Near-Effortless Design of Adaptive Distributed Work
    Jonathan Bragg
    PhD Dissertation, University of Washington, USA , Oct 2018
    Publisher

2017

  1. Subcontracting Microwork
    Meredith Ringel Morris, Jeffrey P. Bigham, Robin Brewer, Jonathan Bragg, Anand Kulkarni, Jessie Li, Saiph Savage
    CHI 2017
    Publisher PDF
  2. Worker-Owned Cooperative Models for Training Artificial Intelligence
    Anand Sriraman, Jonathan Bragg, Anand Kulkarni
    CSCW 2017
    Publisher PDF

2016

  1. MicroTalk: Using Argumentation to Improve Crowdsourcing Accuracy
    Ryan Drapeau, Lydia B. Chilton, Jonathan Bragg, Daniel S. Weld
    HCOMP 2016
    Publisher
  2. Effective Crowd Annotation for Relation Extraction
    Angli Liu, Stephen Soderland, Jonathan Bragg, Christopher H. Lin, Xiao Ling, Daniel S. Weld
    NAACL 2016
    Publisher
  3. Optimal Testing for Crowd Workers
    Jonathan Bragg, Mausam, Daniel S. Weld
    AAMAS 2016
    Publisher Code Slides
  4. Toward Automatic Bootstrapping of Online Communities Using Decision-theoretic Optimization
    Shih-Wen Huang*, Jonathan Bragg*, Isaac Cowhey, Oren Etzioni, Daniel S. Weld
    CSCW 2016
    Publisher PDF Slides

2015

  1. Artificial Intelligence and Collective Intelligence
    Daniel S. Weld, Mausam, Christopher H. Lin, Jonathan Bragg
    In Handbook of Collective Intelligence , Oct 2015
    Publisher PDF
  2. Learning on the Job: Optimal Instruction for Crowdsourcing
    Jonathan Bragg, Mausam, Daniel S. Weld
    In ICML ’15 Workshop on Crowdsourcing and Machine Learning , Jul 2015
    Publisher

2014

  1. Parallel Task Routing for Crowdsourcing
    Jonathan Bragg, Andrey Kolobov, Mausam, Daniel S. Weld
    HCOMP 2014
    Publisher Slides

2013

  1. Crowdsourcing Multi-Label Classification for Taxonomy Creation
    Jonathan Bragg, Mausam, Daniel S. Weld
    HCOMP 2013 Best Paper
    Publisher

2011

  1. Neo-Riemannian Cycle Detection with Weighted Finite-State Transducers
    Jonathan Bragg, Elaine Chew, Stuart M. Shieber
    ISMIR 2011
    Publisher Poster

2010

  1. Mathematics and Computation in Music 2009: John Clough Memorial Conference
    Jonathan Bragg, Cheng-Zhi Anna Huang
    Comput. Music. J., Mar 2010
    HTML Publisher
  2. Detection of Neo-Riemannian Cycles: A Finite State Approach
    Jonathan Bragg
    Honors Undergraduate Thesis, Departments of Computer Science and Music, Harvard University , Mar 2010
    Publisher

Interns