Bai Liu (刘柏)

bailiu [at]   [CV]   [LinkedIn]   [GitHub]  

I am currently a Ph.D. candidate in Laboratory for Information and Decision Systems (LIDS), Massachusetts Institute of Technology, advised by Prof. Eytan Modiano.

My research interests lie in learning and control problems in networked systems (data networks, logistic networks etc.), with application of reinforcement learning, stochastic optimization, inference methods.

Previously, in Summer 2016, I was selected into Stanford UGVR program and worked as a research assistant in Information Systems Laboratory, advised by Prof. Ayfer Özgür. In Spring 2016, I visited Imperial College London and worked at Centre for Transport Studies, advised by Prof. Ke Han. In 2016, I worked at Institute for Interdisciplinary Information Sciences, advised by Prof. Longbo Huang. In 2015, I worked in Institute of System Engineering, advised by Prof. Jianming Hu.



  • Bai Liu, Qiaomin Xie, and Eytan Modiano. Reinforcement Learning for Optimal Control of Queueing Systems. 57th Annual Allerton Conference on Communication, Control, and Computing, September 2019.
  • Bai Liu, Xiugang Wu, and Ayfer Özgür. Efficiently Reaching the Largest Wireless Capacity with the Fewest Relays. Presented at Stanford UGVR Program Workshop, August 2016.   [Poster]
  • Bai Liu, Ke Han, and Jianming Hu. Global Optimization Framework for Real-time Route Guidance via Variable Message Sign, May 2016.   [arXiv]


  • Jianming Hu, Xin Pei, Bai Liu, et al. An Information Distribution Method of Variable Message Sign Based on Prediction Method. Chinese Invention Patent. Publication Number: CN105303856A. Publication Date: 2016.02.03.

Software Copyright

  • Intelligent Networking Transportation Guidance System Platform [INGSP] V1.0. Computer Software Copyright. Registration Number: 2016SR252223. Date: 2016.06.01.

Selected Research Projects

Reinforcement Learning in Network Control

Bai Liu, Qiaomin Xie, Eytan Modiano

By applying model-based reinforcement learning and Lyapunov analysis, we designe an algorithm for queueing networks with unbounded state spaces. We prove that under our algorithm, the average queue backlog can get arbitrarily close to the optimal result.

Subnetwork Selection of Gaussian Relay Network   [Poster]

Bai Liu, Xiugang Wu, Ayfer Özgür

In wireless communication, some relays can be turned off while the optimal capacity still holds. We can apply traversing search approach to find the trimmed network, but its time cost might be unbearable. To solve the problem, we thoroughly study and rigorously prove properties of layered Gaussian relay network. We then develop and implement an algorithm that can find optimal global subnetwork exponentially faster.

Dynamic Transportation Network Modeling   [arXiv]

Bai Liu, Ke Han

Aiming at improving VMS (variable message sign) display strategy, we formulate transportation network model with feedback scheme. We then design optimization algorithm with linear decision rule and heuristic optimization approach. A simulation case study is conducted on a real-world test network in China, which shows the advantage of the proposed adaptive VMS display strategy.


      Python   MATLAB   C/C++   Wolfram
      LaTeX   Git   SQL   Oracle