Kyle Hatch

CV       Education       Publications       Outreach       Presentations
Email: kyle.hatch@tri.global

drawing

I am an AI Resident in the Machine Learning Division at the Toyota Research Institute (TRI). I plan to pursue a PhD in Computer Science, Machine Learning, or Robotics. My research interests lie primarily within robot learning and reinforcement learning (RL).

I am especially excited about exploring solutions to the following questions: How can we leverage foundation models that can reason about both visual and language information for robot learning? How can we utilize video data–which exists on a massive scale on the Internet but does not contain action labels–for training robot policies? Can we use goal-conditioned/self-supervised RL to learn from random play data or autonomously collected robot data?

I was extremely fortunate to work with many wonderful mentors during my time as a master’s and undergraduate student. I worked with Prof. Chelsea Finn in the Stanford IRIS Lab as an undergraduate and master’s student. As a master’s student, I also worked with Prof. Ben Eysenbach. I first started research as an undergraduate student with Prof. Mykel Kochenderfer in the Stanford Intelligent Systems Laboratory (SISL).

Education

Stanford University                                                               Stanford, CA
M.S. in Computer Science                                               Graduated: June 2023
Artificial Intelligence Track                                                             GPA: 4.05
Coterminal Master’s Program

Stanford University                                                               Stanford, CA
B.S. in Computer Science with honors                                  Graduated: June 2022
Artificial Intelligence Track

Publications

Published/Accepted

Rafailov, R.*, Hatch, K. B.*, Kolev, V., Martin, J., Phielipp, M., and Finn, C., ”MOTO: Offline to Online Fine-tuning for Model-Based Reinforcement Learning,” Conference on Robot Learning (CoRL), 2023.   PDF     Website

Hatch, K. B., Eysenbach, B., Yu, T., Rafailov, R., Salakhutdinov, R., Levine, S., and Finn, C., ”Contrastive Example-Based Control,” Learning for Dynamics & Control Conference (L4DC), 2023.   PDF     Website     Presentation (NeurIPS workshop version)

Zhou, G., Dean, V., Srirama, M. K., Rajeswaran, A., Pari, J., Hatch, K. B., Jain, A., Yu, T., Abbeel, P., Pinto, L., Finn, C., and Gupta, A., “Train Offline, Test Online: A Real Robot Learning Benchmark,” 2023 IEEE International Conference on Robotics and Automation (ICRA), 2023.   Website

Mern, J., Hatch, K., Silva, R., Hickert, C., Sookoor, T., and Kochenderfer, M. J., “Autonomous Attack Mitigation for Industrial Control Systems,” International Conference on Dependable Systems and Networks (DSN’22), 2022, pp. 28–36.   PDF

Senanayake, R.*, Hatch, K.*, Zheng, J., and Kochenderfer, M. J., “3D Radar Velocity Maps for Uncertain Dynamic Environments,” IEEE International Conference on Intelligent Robots and Systems (IROS), 2021.   PDF     Presentation

Hatch, K., Mern, J., and Kochenderfer, M. J., “Obstacle Avoidance Using a Monocular Camera,” AIAA SciTech Forum, 2021.   PDF     Presentation

Under Review

Rafailov, R.*, Hatch, K. B.*, Singh, A., Smith, L., Kumar, A., Kostrikov, I., Hansen-Estruch, P., Kolev, V., Ball, P., Wu, J., Finn, C., and Levine, S., “D5RL: Diverse Datasets for Data-Driven Deep Reinforcement Learning,” International Conference on Learning Representations (ICLR), 2024.

* denotes equal contribution

Outreach

Breakthrough Silicon Valley (BTSV)

November 2023 – Present

Volunteer Tutor

Breakthrough Silicon Valley is an organization that provides academic support to middle school and high school students who are on track to becoming first-generation college students. I primarily provide homework support to high school students with mathematics.

East Palo Alto Stanford Academy (EPASA)

October 2018 – March 2020

Volunteer Tutor

EPASA is a program run through Stanford University in which undergraduate students tutor middle school students who attend school in East Palo Alto. I provided homework support to seventh and eighth grade students in math and English, and also helped them to develop effective study skills.

Stanford 1st Ward Volunteer Tutoring Program

September 2017 – June 2019

Volunteer Tutor

The Stanford 1st Ward Volunteer Tutoring Program is a program run through a local religious organization that provides free tutoring to K-12 students from around the South San Francisco Bay Area. I provided homework support students in math, reading, and English.

Video Presentations

“Offline Example-Based Control,” NeurIPS Offline RL and Deep RL Workshops, 2022.

     

“3D Radar Velocity Maps for Uncertain Dynamic Environments,” IEEE International Conference on Intelligent Robots and Systems (IROS), 2021.

     

“Obstacle Avoidance Using a Monocular Camera,” AIAA SciTech Forum, 2021.