Experiments in NLP

Course

URL study guide

https://studiegids.vu.nl/en/courses/2024-2025/L_AAMPLIN039

Course Objective

In this course, we cover the knowledge and skills required to carry out scientific experiments to support Natural Language Processing research. We focus in particular on (1) how to define a verifiable hypothesis; (2) how to identify requirements in terms of data, models, settings and runs for a solid methodological set-up (3) practical skills to carry out the experiment (4) drawing the right conclusions on such an experiment (5) reporting on the experiment.

Course Content

In this course, we will run through the steps involved in carrying out experimental research in natural language processing. Building on theory and practical skills covered in previous courses of the HLT specialisation in the linguistics research masters, this hands-on course will walk students through experimental design, data preparation, hyperparameter tuning and evaluation. The learning goals will be addressed by working on a current research topic and will alternate through-out the years. Students can also propose their own topic at the beginning of the course, though the teacher will need to verify whether this is both feasible and substantial enough to meet course goals.

Teaching Methods

The course will be run as a joint experimental project within the CLTL research lab. It is a hands-on course where students actively work through the research process with weekly meetings and feedback through interactive communication channels.

Method of Assessment

A report and code (can be a combination of joint report and individual report) illustrating the motivation behind the setup, describing the methodology, presenting results and correct reasoning about the experiment.

Target Audience

2nd year Research Masters Human Language Technology

Additional Information

PLEASE NOTE: WE NEED TO APPLY FOR STUDENT ACCOUNTS AT SURF A COUPLE OF WEEKS IN ADVANCE. PLEASE TRY TO REGISTER TIMELY (AND DEREGISTER IF YOU CHANGE YOUR MIND), SO WE CAN MAKE SURE THIS WORKS OUT FOR EVERYONE.

Recommended background knowledge

This course requires advanced independent skills in Natural Language Processing, ideally through successful participation in Machine Learning for NLP (RM) and Advanced NLP. Students who do not meet these requirements are strongly advised to contact the teacher prior to enrolling in this course.
Academic year1/09/2431/08/25
Course level6.00 EC

Language of Tuition

  • English

Study type

  • Master