Andrew M. Bean

Oxford Internet Institute

prof_pic.jpg

Andrew Bean is a doctoral researcher in Social Data Science at the Oxford Internet Institute. He studies human-centric artificial intelligence from a technical and sociotechnical perspective.

Andrew has particular expertise with large language models, and has written papers about evaluations, reasoning, alignment and human data in venues such as NeurIPS (1x Best Paper, 2x Oral presentations), EMNLP, and GoodIT. He has been an invited speaker at Meta, the MIT Media Lab, MilaNLP and Ofcom. His research has been covered in the media by publications such as VentureBeat and TechCrunch.

news

Dec 16, 2024

NeurIPS Best Paper for PRISM!

Our project PRISM has won the Best Paper Award for the 2024 NeurIPS Datasets and Benchmarks track! PRISM was selected out of more than 1800 submissions, and had some of the best reviews ever given at NeurIPS (and LingOly was close behind!).
Dec 12, 2024

NeurIPS Oral Presentation for LingOly!

Our project LingOly was selected for an Oral presentation at NeurIPS 2024! Out of more than 1800 submissions, only the top 11 (0.6%) were chosen for oral presentation, and the reviews included a recommendation for an award!

selected publications

  1. The PRISM Alignment Project: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models
    Hannah Rose Kirk, Alexander Whitefield, Paul Röttger, Andrew M. Bean, Katerina Margatina, Juan Ciro, Rafael Mosquera, Max Bartolo, Adina Williams, He He, Bertie Vidgen, and Scott A. Hale
    Apr 2024
  2. LINGOLY: A Benchmark of Olympiad-Level Linguistic Reasoning Puzzles in Low-Resource and Extinct Languages
    Andrew M. Bean, Simi Hellsten, Harry Mayne, Jabez Magomere, Ethan A. Chi, Ryan Chi, Scott A. Hale, and Hannah Rose Kirk
    Jun 2024
  3. JournalUnder Review
    Clinical Knowledge in LLMs Does Not Translate to Human Interactions
    Andrew M. Bean, Rebecca Payne, Guy Parsons, Hannah Rose Kirk, Juan Ciro, Rafael Mosquera, Sara Hincapié Monsalve, Aruna S. Ekanayaka, Lionel Tarassenko, Luc Rocher, and Adam Mahdi
    arXiv.org, Apr 2025