Blog
-
Efficiency vs. Expressivity in Offline RL
How to efficiently leverage flow policies and distributional critics in offline reinforcement learning.
-
Efficient Yet General Pretraining for Integrated Circuits
How transistor-level graph contrastive pretraining improves generalization for ICs.
Selected Publications
-
Towards Efficient and Expressive Offline RL via Flow Anchored Noise-conditioned Q-Learning
Sungyoung Lee, Dohyeong Kim, Eshan Balachandar, Zelal Su Mustafaoglu, Keshav K. Pingali
ICML 2026
TL;DR: Offline distributional RL that achieves SOTA robotics task success rates with efficient training and inference.
-
DICE: Device-level Integrated Circuits Encoder with Graph Contrastive Pretraining
Sungyoung Lee, Yao Lai, Ziyi Wang, Seunggeun Kim, Taekyun Lee, David Z. Pan
arXiv 2026
TL;DR: First self-supervised pretraining for transistor-level circuits, using simulation-free graph data augmentation.