I am a first year Ph.D. student of Computer Science at University of Texas at Austin. I am very honored to be advised by Prof. Peter Stone. I have general interests in reinforcement learning, lifelong learning, curriculum learning, and their applicaitons in robotic. My primiary focus is to apply deep reinforcement learning for mobile robot autonomous navigation.
Before I started the CS program, I recieved master’s and bachelor’s degrees in Physics, but was lucky to find my passion in artificial intellegence. Feel free to reach out to me if you are curious about my experience and research!
Classical navigation systems typically operate using a fixed set of hand-picked parameters (e.g. maximum speed, sampling rate, inflation radius, etc.) and require heavy expert re-tuning in order to work in new environments. To mitigate this requirement, it has been proposed to learn parameters for different contexts in a new environment using human demonstrations collected via teleoperation. However, learning from human demonstration limits deployment to the training environment, and limits overall performance to that of a potentially-suboptimal demonstrator. In this paper, we introduce APPLR, Adaptive Planner Parameter Learning from Reinforcement, which allows existing navigation systems to adapt to new scenarios by using a parameter selection scheme discovered via reinforcement learning (RL) in a wide variety of simulation environments. We evaluate APPLR on a robot in both simulated and physical experiments, and show that it can outperform both a fixed set of hand-tuned parameters and also a dynamic parameter tuning scheme learned from human demonstration.
@inproceedings{icra21-xu,bibtex_show={true},conference={true},author={Xu, Zifan and Dhamankar, Gauraang and Nair, Anirudh and Xiao, Xuesu and Warnell, Garrett and Liu, Bo and Wang, Zizhao and Stone, Peter},title={APPLR: Adaptive Planner Parameter Learning from Reinforcement},booktitle={Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA 2021)},location={Xi'an, China},month=jun,year={2021},figure={applr.png},code={https://github.com/Daffan/ros_jackal},video={https://www.youtube.com/watch?v=JKHTAowdGUk&t=26s},pdf={https://www.cs.utexas.edu/users/pstone/Papers/bib2html-links/icra21-xu.pdf},slides={https://www.cs.utexas.edu/users/pstone/Papers/bib2html-links/icra21-xu.slides.pptx},website={https://www.cs.utexas.edu/users/xiao/Research/APPL/APPL.html}}
Machine Learning Methods for Local Motion Planning: A Study of End-to-End vs. Parameter Learning
Zifan Xu,
Xuesu Xiao,
Garrett Warnell,
Anirudh Nair,
and Peter Stone
In Proceedings of the 2021 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR 2021),
While decades of research efforts have been devoted to developing classical autonomous navigation systems to move robots from one point to another in a collision-free manner, machine learning approaches to navigation have been recently proposed to learn navigation behaviors from data. Two representative paradigms are end-to-end learning (directly from perception to motion) and parameter learning (from perception to parameters used by a classical underlying planner). These two types of methods are believed to have complementary pros and cons: parameter learning is expected to be robust to different scenarios, have provable guarantees, and exhibit explainable behaviors; end-to-end learning does not require extensive engineering and has the potential to outperform approaches that rely on classical systems. However, these beliefs have not been verified through real-world experiments in a comprehensive way. In this paper, we report on an extensive study to compare end-to-end and parameter learning for local motion planners in a large suite of simulated and physical experiments. In particular, we test the performance of end-to-end motion policies, which directly compute raw motor commands, and parameter policies, which compute parameters to be used by classical planners, with different inputs (e.g., raw sensor data, costmaps), and provide an analysis of the results.
@inproceedings{ssrr2021-xu,bibtex_show={true},conference={true},author={Xu, Zifan and Xiao, Xuesu and Warnell, Garrett and Nair, Anirudh and Stone, Peter},title={Machine Learning Methods for Local Motion Planning: A Study of End-to-End vs. Parameter Learning},booktitle={Proceedings of the 2021 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR 2021)},location={New York, USA},month=oct,year={2021},figure={ssrr.png},code={https://github.com/Daffan/ros_jackal},video={https://www.youtube.com/watch?v=U592HQ30TsY&t=6s},pdf={https://www.cs.utexas.edu/users/pstone/Papers/bib2html-links/ssrr2021-xu.pdf}}
A Scavenger Hunt for Service Robots
Harel Yedidsion,
Jennifer Suriadinata,
Zifan Xu,
Stefan Debruyn,
and Peter Stone
In Proceedings of the 2021 International Conference on Robotics and Automation (ICRA 2021),
Creating robots that can perform general-purpose service tasks in a human-populated environment has been a longstanding grand challenge for AI and Robotics research.
One particularly valuable skill that is relevant to a wide variety of tasks is the ability to locate and retrieve objects upon request.
This paper models this skill as a Scavenger Hunt (SH) game, which we formulate as a variation of the NP-hard stochastic traveling purchaser problem. In this problem, the goal is to find a set of objects as quickly as possible, given probability distributions of where they may be found.
We investigate the performance of several solution algorithms for the SH problem, both in simulation and on a real mobile robot. We use Reinforcement Learning (RL) to train an agent to plan a minimal cost path, and show that the RL agent can outperform a range of heuristic algorithms, achieving near optimal performance.
In order to stimulate research on this problem, we introduce a publicly available software stack and associated website that enable users to upload scavenger hunts which robots can download, perform, and learn from to continually improve their performance on future hunts.
@inproceedings{ICRA21-Yedidsion,bibtex_show={true},conference={true},author={Yedidsion, Harel and Suriadinata, Jennifer and Xu, Zifan and Debruyn, Stefan and Stone, Peter},title={A Scavenger Hunt for Service Robots},booktitle={Proceedings of the 2021 International Conference on Robotics and Automation (ICRA 2021)},location={Xi'an China},month=may,year={2021},figure={scavenger_hunt.png},code={https://github.com/Daffan/scavenger_hunt_sim},video={http://scavenger-hunt.cs.utexas.edu/},pdf={https://www.cs.utexas.edu/users/pstone/Papers/bib2html-links/ICRA21-Yedidsion.pdf},website={http://scavenger-hunt.cs.utexas.edu/}}
