About Me
I am currently an Associate Professor in the Faculty of Computing at Harbin Institue of Technology and a member in the Pattern Recognition and Intelligent System Research Center.
Previously, I obtained my Ph.D. in computer science under the supervision of Prof. Chongjie Zhang (张崇洁) from the
Institute for Interdisciplinary Information Sciences (IIIS), Tsinghua University. My research interests include
Openings
Our lab has active openings for Master, PhD, and Postdoc positions. Interested applicants please contact me through email with your CV, representative papers, and transcripts.
Publications
2025
-
Safe Planner: Empowering Safety Awareness in Large Pre-Trained Models for Robot Task Planning.
Siyuan Li, Feifan Liu, Lingfei Cui, Jiani Lu, Qinqin Xiao, Xirui Yang, Peng Liu, Kewu Sun#, Zhe Ma, Xun Wang
AAAI 2025: The Thirty-Ninth AAAI Conference on Artificial Intelligence
-
SkillTree: Explainable Skill-Based Deep Reinforcement Learning for Long-Horizon Control Tasks.
Yongyan Wen, Siyuan Li#, Rongchang Zuo, Lei Yuan, Hangyu Mao, Peng Liu
AAAI 2025: The Thirty-Ninth AAAI Conference on Artificial Intelligence
2024
-
Robust Visual Imitation Learning with Inverse Dynamics Representations.
Siyuan Li*, Xun Wang*, Rongchang Zuo, Kewu Sun, Lingfei Cui, Jishiyu Ding, Peng Liu, Zhe Ma
AAAI 2024: The Thirty-Eighth AAAI Conference on Artificial Intelligence
PDF -
IMM: An Imitative Reinforcement Learning Approach with Predictive Representation Learning for Automatic Market Making.
Hui Niu*, Siyuan Li*, Jiahao Zheng, Zhouchi Lin, Bo An, Jian Li, Jian Guo
IJCAI 2024: The Thirty-Third International Joint Conference on Artificial Intelligence
-
MacMic: Executing Iceberg Orders via Hierarchical Reinforcement Learning.
Hui Niu*, Siyuan Li*, Jian Li
IJCAI 2024: The Thirty-Third International Joint Conference on Artificial Intelligence
-
A Multi-Agent Learning Framework for Mixed-Integer Linear Programming.
Yuchen Jing, Binyan Liang, Siyuan Li#, Feifan Liu, Wei Zhao, Peng Liu
INFOR 2024 (JCR-Q1): Information Systems and Operational Research
-
Joint Learning of Volume Scheduling and Order Placement Policies for Optimal Order Execution.
Siyuan Li, Hui Niu, Jiani Lu, Peng Liu
Mathematics 2024 (JCR-Q1)
-
Toward Automatic Market Making: An Imitative Reinforcement Learing Approach with Predictive Representation Learning.
Siyuan Li, Yafei Chen, Hui Niu, Jiahao Zheng, Zhouchi Lin, Jian Li, Jian Guo, Zhen Wang
TETCI 2024 (JCR-Q1): IEEE Transactions on Emerging Topics in Computational Intelligence
2023
-
IOB: integrating optimization transfer and behavior transfer for multi‑policy reuse.
Siyuan Li, Hao Li, Jin Zhang, Zhen Wang, Peng Liu, Chongjie Zhang
JAAMAS 2023: Autonomous Agents and Multi-Agent Systems
PDF -
Learning to Solve Tasks with Exploring Prior Behaviours.
Ruiqi Zhu, Siyuan Li, Tianhong Dai, Chongjie Zhang, Oya Celiktutan
IROS 2023: The 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems
PDF -
Classifying Ambiguous Identities in Stochastic Games with Multi-Agent Reinforcement Learning.
Shijie Han, Siyuan Li#, Bo An, Wei Zhao, Peng Liu
JAAMAS 2023: Autonomous Agents and Multi-Agent Systems
PDF -
Behavior Contrastive Learning for Unsupervised Skill Discovery.
Rushuai Yang, Chenjia Bai, Hongyi Guo, Siyuan Li, Bin Zhao, Zhen Wang, Peng Liu, Xuelong Li
ICML 2023: International Conference on Machine Learning
PDF -
Flow to Control: Offline Reinforcement Learning with Lossless Primitive Discovery.
Yiqin Yang, Hao Hu, Wenzhe Li, Siyuan Li, Jun Yang, Qianchuan Zhao, Chongjie Zhang
AAAI 2023: The Thirty-Seventh AAAI Conference on Artificial Intelligence
PDF
2022 and Before
-
CUP: Critic-Guided Policy Reuse.
Jin Zhang, Siyuan Li, Chongjie Zhang
NeurIPS 2022 (Spotlight): Advances in Neural Information Processing Systems
PDF | Code -
MetaTrader: A Reinforcement Learning Approach Integrating Diverse Policies for Portfolio Optimization.
Hui Niu*, Siyuan Li*, Jian Li
CIKM 2022: The 31st ACM International Conference on Information and Knowledge Management
PDF -
Active Hierarchical Exploration with Stable Subgoal Representation Learning.
Siyuan Li, Jin Zhang, Jianhao Wang, Yang Yu, Chongjie Zhang
ICLR 2022: The Tenth International Conference on Learning Representations
PDF | Video | Code -
Offline Reinforcement Learning with Reverse Model-based Imagination.
Jianhao Wang, Wenzhe Li, Haozhe Jiang, Guangxiang Zhu, Siyuan Li, Chongjie Zhang
NeurIPS 2021: Advances in Neural Information Processing Systems
PDF | Video | Code -
Learning Subgoal Representations with Slow Dynamics.
Siyuan Li*, Lulu Zheng*, Jianhao Wang, Chongjie Zhang
ICLR 2021: The Ninth International Conference on Learning Representations
PDF | Video | Code -
Deep Reinforcement Learning with Hierarchical Structures.
Siyuan Li
IJCAI DC 2021: The Thirtieth International Joint Conference on Artificial Intelligence Doctoral Consortium
PDF -
Hierarchical Reinforcement Learning with Advantage-Based Auxiliary Rewards.
Siyuan Li*, Rui Wang*, Minxue Tang, Chongjie Zhang
NeurIPS 2019: Advances in Neural Information Processing Systems
PDF | Video | Code -
Context-Aware Policy Reuse.
Siyuan Li, Fangda Gu, Guangxiang Zhu, Chongjie Zhang
AAMAS 2019 (Oral): International Conference on Autonomous Agents and MultiAgent Systems
PDF | Code -
An Optimal Online Method of Selecting Source Policies for Reinforcement Learning.
Siyuan Li, Chongjie Zhang
AAAI 2018 (Spotlight): The Thirty-Second AAAI Conference on Artificial Intelligence
PDF
Education
-
Ph.D. in Computer Science
IIIS, Tsinghua University @ Beijing, China, 2017 -- 2022
Deep Reinforcement Learning -
B.Sc. in Telecommunication Engineering
Beijing University of Post and Telecommunications @ Beijing, China, 2013 -- 2017