Hi, I'm graduating soon and looking for opportunities. If you know of any, let's chat!
Risto Vuorio
I am a dphil student at Whiteson Research Lab at University of Oxford. My research is focused on Meta-Reinforcement Learning (Meta-RL) and imitation learning. I'm excited about developing AI into a practical technology and I believe pushing these directions will help us get there.
Before joining WhiRL, I worked with Satinder Singh at the University of Michigan on meta-gradient reinforcement learning. And before that, I worked at SK-Telecom AI Research Lab in Seoul. I got my Master's in Computer Science at Aalto University, Finland. More recently, I interned at Qualcomm Research Amsterdam supervised by Taco Cohen and others last year.
Jake Beck and I were recently featured on TalkRL Podcast discussing meta-RL and our recent survey paper on it. If you are interested in the subject consider checking out our tutorial on meta-RL at AAAI 2024 in Vancouver.
Selected publications and preprints
A Survey of Meta-Reinforcement Learning
Jacob Beck (equal contribution), Risto Vuorio (equal contribution), Evan Zheran Liu, Zheng Xiong, Luisa Zintgraf, Chelsea Finn, and Shimon Whiteson. Under review. 2023. paper
Discovering General Reinforcement Learning Algorithms with Adversarial Environment Design
Matthew T. Jackson, Minqi Jiang, Jack Parker-Holder, Risto Vuorio, Chris Lu, Gregory Farquhar, Shimon Whiteson, and Jakob N. Foerster. NeurIPS. 2023. paper
Recurrent Hypernetworks are Surprisingly Strong in Meta-RL
Jacob Beck, Risto Vuorio, Zheng Xiong, and Shimon Whiteson. NeurIPS. 2023. paper
Deconfounded Imitation Learning
Risto Vuorio, Johann Brehmer, Hanno Ackermann, Daniel Dijkman, Taco Cohen, and Pim de Haan. Under review. 2022. paper
Hypernetworks in Meta-Reinforcement Learning
Jacob Beck, Matthew Thomas Jackson, Risto Vuorio, and Shimon Whiteson. Conference on Robot Learning (CoRL). 2022. paper
Pairwise Weights for Temporal Credit Assignment
Zeyu Zheng (equal contribution), Risto Vuorio (equal contribution), Richard Lewis, and Satinder Singh. AAAI. 2022. paper
An Investigation of the Bias-Variance Tradeoff in Meta-Gradients
Risto Vuorio, Jacob Beck, Gregory Farquhar, Jakob Foerster, Shimon Whiteson. NeurIPS Deep RL Workshop. 2021. paper
Multimodal Model-Agnostic Meta-Learning via Task-Aware Modulation
Risto Vuorio (equal contribution), Shao-Hua Sun (equal contribution), Hexiang Hu, and Joseph J. Lim. NeurIPS (Spotlight). 2019. paper
Deep Reinforcement Learning for Dynamic Multi-Driver Dispatching and Repositioning Problem
John Holler (equal contribution), Risto Vuorio (equal contribution), Tiancheng Jin, Satinder Singh, Zhiwei Qin, Jieping Ye, Xiaocheng Tang, Yan Jiao, and Chenxi Wang. ICDM Short Paper. 2019. paper
Education
Dphil Computer Science
University of Oxford OxfordFully funded via Scatcherd European Scholarship in conjunction with Engineering and Physical Sciences Research Council Studentship.
M.Sc. Computer Science (with distinction)
Aalto University Helsinki, FinlandMinor: Mathematics
Thesis: Stream Processing on a Multi-core DSP with Open Event Machine
B.Sc. Industrial Engineering and Management
Aalto University Helsinki, FinlandMinor: Software technology
Research Experience
Research Intern
Qualcomm Research, AmsterdamAdvised by Taco Cohen, Daniel Dijkman
Visiting Scholar
University of Michigan, Ann ArborAdvised by Satinder Singh
Research Engineer
SK Telecom, T-BrainAdvised by Jiwon Kim, Joseph J. Lim
Research Assistant
Machine Learning for Big Data Group, Aalto UniversityAdvised by Alexander Jung
Research Assistant
Embedded Systems Group, Aalto UniversityAdvised by Vesa Hirvisalo, Heikki Saikkonen
Industry Experience
Data Scientist/Software Engineer
Wolt Enterprises OySoftware Engineering Intern / Software Engineer
Apportable IncPresentations and appearances
Meta-RL Tutorial AAAI 2024
Presenters: Jacob Beck, Risto Vuorio
Authors: Jacob Beck (equal contribution), Risto Vuorio (equal contribution), Evan Zheran Liu, Zheng Xiong, Luisa Zintgraf, Chelsea Finn, and Shimon Whiteson. Conference homepage
Meta-RL Tutorial AutoML 2023
Presenters: Jacob Beck, Risto Vuorio
Authors: Jacob Beck (equal contribution), Risto Vuorio (equal contribution), Evan Zheran Liu, Zheng Xiong, Luisa Zintgraf, Chelsea Finn, and Shimon Whiteson. Tutorial homepage
TalkRL Podcast
Featured as a guest with Jake Beck on TalkRL Podcast.
Service and Activities
Junior Organizer:
NeurIPS Deep RL Workshop 2022.
Program Committee:
ICLR 2023.
NeurIPS 2023.
ICML 2022.
AAAI 2021, 2022.
ICML Pre-Training Workshop 2022.
NeurIPS Deep Reinforcement Learning Workshop 2019, 2020, 2021.
Board member:
TK Ventures 2022, 2023.