Topic: Plumbing the Breadth and Depth of LLM Evaluation
Time: 14h30-16h00, Monday, Jan 8th, 2024
Speaker: Prof. Tim Baldwin, Acting Provost and Professor of Natural Language Processing at Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Melbourne Laureate Professor in the School of Computing and Information Systems, The University of Melbourne
✅ Location: Hybrid
- Offline at Room 504, B1 Building, HUST (maximum 40 slots)
- Online via Zoom (the link will be sent later)
✅ Registration link:
- For HUST staff and students: https://forms.office.com/r/FNTtN7fMdM
- For external guests: HERE
✅ Abstract:
The recent surge in generative large language models (LLMs) has created even greater challenges for NLP evaluation. In this talk, I will cover a range of LLM evaluation initiatives covering issues including: LLM capabilities across a broad range of tasks; multilingual and multicultural capabilities; the ability of models to capture different aspects of negation; model calibration; and model safety.
✅ Speaker Bio:
Tim Baldwin is Acting Provost and Professor of Natural Language Processing at Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), in addition to being a Melbourne Laureate Professor in the School of Computing and Information Systems, The University of Melbourne.
Tim completed a BSc(CS/Maths) and BA(Linguistics/Japanese) at The University of Melbourne in 1995, and an MEng(CS) and PhD(CS) at the Tokyo Institute of Technology in 1998 and 2001, respectively. He joined MBZUAI at the start of 2022, prior to which he was based at The University of Melbourne for 17 years. His research has been funded by organisations including the Australian Research Council, Google, Microsoft, Xerox, ByteDance, SEEK, NTT, and Fujitsu, and has been featured in MIT Tech Review, Bloomberg, Reuters, CNN, IEEE Spectrum, The Times, ABC News, The Age/Sydney Morning Herald, and Australian Financial Review. He is the author of nearly 500 peer-reviewed publications across diverse topics in natural language processing and AI, with over 22,000 citations and an h-index of 72 (Google Scholar), in addition to being an ARC Future Fellow, and the recipient of a number of awards at top conferences.
Slides: to be updated …
Recording: to be updated…