People who I have shared grants with
Adrian Barbu (FSU), Elias Bareinboim (Purdue), Terry Boult (UCCS), Joyce Chai (UMichigan), Jason Cong (UCLA), Stuart Geman (Brown), Tao Gao (UCLA), Pablo Garcia (SRI), Tim Groeling (UCLA), Abhinav Gupta (CMU), Martial Hebert (CMU), Derek Hoiem (UIUC), Nancy Kanwisher (MIT), Daphane Koller (Stanford), Feifei Li (Stanford), Jitendra Malik (UC Berkeley), Mike Miller (JHU), Judea Pearl (UCLA), Pietro Perona (Caltech), Deva Ramanan (UC Irvine), Brian Scholl (Yale), Kevin Skadron (UV), Francis Steen (UCLA), Josh Tenenbaum (MIT), Sinisa Todorovic (Oregon State), Antonio Torralba (MIT), Ying Wu (Norhtwestern), Yingnian Wu (UCLA), Alan Yuille (UCLA), Cheng Zhai (UIUC).
Ph.D. Students supervised
1. Zhuowen Tu[CS] Ph.D. 2002, Image Parsing by Data-Driven Markov Chain Monte Carlo.
2. Cheng-En Guo[CS] Ph.D. 2004, A Mathematical Theory for Texton and Primal Sketch.
3. Adrian Barbu[CS] Ph.D. 2005, Cluster Sampling and Its Applications in Segmentation, Stereo and Motion
4. Yizhou Wang[CS] Ph.D. 2005, Modeling Complex Motion: Photometric, Geometric, Topological, and Dynamic Aspects
5. Feng Han[CS] Ph.D. 2005, Computing 3D Scene From A Single Image by Bottom-up/Top-Down Bayesian Inference
6. Romeo Maciuca[Stat] Ph.D. 2006, MCMC Analysis: First Hitting Times, Visiting Scheme, and Auxiliary Variables
7. Zijian Xu[Stat] Ph.D. 2007, A Hierarchical Compositional Model for Representation and Sketching of High-resolution Human Images
8. Kent Shi[Stat] Ph.D. 2009, Mapping Natural Image Patches by Explicit and Implicit Manifolds
9. Jacob Porway[Stat] Ph.D. 2010, A Hierarchical and Contextual Model for Learning and Recognizing Highly Variant Visual Categories
10. Zhangzhang Si[Stat] Ph.D. 2011, Learning And-Or Templates for Object Recognition by Information Projection
11. Mingtian Zhao[Stat] Ph.D. 2011, A Statistical and Computational theory for the Art of Painting
12. Tianfu Wu[Stat] Ph.D. 2011, Integration and Goal-guided Scheduling of Bottom-up and Top-Down Computing Processes in Hierarchical Models
13. Benjamin Yao[Stat] Ph.D. 2011, Learning Spatial-Temporal Models for Understanding Actions and Events in Video
14. Wenze Hu[Stat] Ph.D. 2012, Integrating 3D and 2D Representations for View-invariant Object Recognition
15. Brandon Rothrock[CS] Ph.D. 2013, Stochastic Image Grammars for Human Pose Estimation
16. Maria Pavlovskaia[Stat] Ph.D. 2014, Mapping Highly Non-convex Energy Landscapes in Clustering, Grammar and Curriculum Learning
17. Jungseock Joo[CS] Ph.D. 2015, Visual Persuasion in Mass Media: A Computational Framework for Understanding Visual Communication
18. Yibiao Zhao[Stat] Ph.D. 2015, A Quest for Visual Commonsense: Scene Understanding by Functional and Physics Reasoning
19. Seyoung Park[CS] Ph.D. 2016, Attribute Grammar for Joint Parsing of Human Attribute, Part and Pose
20. Amy Morrow[Stat] Ph.D. 2016, Learning and Inferring Perceptual Causality from Videos
21. Dan Xie[Stat] Ph.D. 2016, Inferring the Intentions and Attentions of Agents from Videos.
22. Weixin Li[CS] Ph.D. 2017, Joint Image-Text Topic Detection and Tracking for Analyzing Social and Political News Events
23. Bruce Nie[Stat] Ph.D. 2017, Spatial-Temporal Hierarchical Model for Joint Learning and Inference of Human Action and Pose
24. Yang Lu[Stat] Ph.D. 2017, Coupling and Learning Hierarchical Generative and Descriptive Models for Image Synthesis and Analysis
25. Chengcheng Yu[Stat] Ph.D. 2017, Single View 3D Scene Reconstruction Using Visual Commonsense
26. Hang Qi[CS] Ph.D. 2018, Joint Spatial, Temporal, and Causal Inference and Restricted Turing Test via Storyline Queries
27. Yixin Zhu[Stat] Ph.D. 2018, Visual Commonsense Reasoning: Functionality, Physics, Causality, and Utility
28. Yuanlu Xu[CS] Ph.D. 2019, 3D Scene and Event Understanding by Joint Spatial and Temporal Inference and Reasoning
29. Siyuan Qi[CS] Ph.D. 2019, Task-oriented Visual Understanding of Scenes and Events
30. Nishant Shukla[CS] Ph.D. 2019, Utility Learning, Non-Markovian Planning, and Task-Oriented Programming Language
31. Tianmin Shu[Stat] Ph.D. 2019, Social Scene Understanding: Group Activity Parsing, Human-Robot Interactions, and Perception of Animacy
32. Yang Liu[Stat] Ph.D. 2019, Learning Fluents for Task Representation
33. Tao Yuan[Stat] Ph.D. 2019, A Cognition Platform for Joint Inference of 3D Geometry, Object States, and Human Belief
34. Mitchell Hill[Stat] Ph.D. 2020, Learning and Mapping Energy Functions of High-Dimensional Image Data
35. Hangxin Liu[CS] Ph.D. 2021, Robot Imitation by Action Understanding, Mirroring, and Interactions
36. Siyuan Huang[Stat] Ph.D. 2021, Human-like Holistic 3D Scene Understanding
37. Xu Xie[Stat] Ph.D. 2021, Robot Learning from Interactions with Physics-realistic Environment: Constructing Big Task Platform for Training AI Agents
38. Zilong Zheng[CS] Ph.D. 2021, Multimodal Conversation Modeling via Neural Perception, Structure Learning, and Communication
39. Feng Shi[CS] Ph.D. 2021, Adaptive AI algorithms & Unified Hardware Acceleration
40. Lifeng Fan[Stat] Ph.D. 2021, A Hierarchical Computational Framework for Social Interaction Understanding
41. Tengyu Liu[CS] Ph.D. 2021, Hierarchical Modeling of Human-Object Interactions: from Concurrent Action Parsing to Physics-Based Grasping
42. Ruiqi Gao[Stat] Ph.D. 2021, Effective Learning of Descriptive and Generator Models and Learning Representations for Grid Cells and V1 Cells
43. Erik Nijkamp[Stat] Ph.D. 2021, Learning Descriptive and Generative Models with Short-Run MCMC
44. Mark Edmonds[CS] Ph.D. 2021, Learning How and Why: Causal Learning and Explanation from Physical, Interactive, and Communicative Environments
45. Arjun Akula[Stat] Ph.D. 2021, Gaining Justified Human Trust by Improving Explainability in Vision and Language Reasoning Models
46. Liang Qiu[EE] Ph.D. 2022, Conversational Modeling with Human Values, Social Relations, Mental States, and Structure Learning
47. Luyao Yuan[CS] Ph.D. 2022, Communicative Learning: A Unified Learning Formalism
48. Yixin Chen[Stat] Ph.D. 2022, Holistic Scene Understanding and Goal-directed Multi-agent Event Parsing
49. Qing Li[Stat] Ph.D. 2022, Closing the Recognition and Reasoning Loop from A Statistical Learning Perspective
50. Xiaofeng Gao[Stat] Ph.D. 2022, Bidirectional Mental State Alignment for Human-Machine Collaboration
51. Chi Zhang[CS] Ph.D. 2022, Few-shot Concept Induction through Lenses of Intelligence Quotient Tests
52. Jonathan Mitchell[CS] Ph.D. 2022, Adversarial Attacks and Defense using Energy-Based Image Models
53. Baoxiong Jia[CS] Ph.D. 2022, Incorporating World Model Knowledge into Event Parsing, Prediction, and Reasoning
54. Ziyuan Jiao[ME] Ph.D. 2022, A Virtual Kinematic Chain Perspective for Robot Task and Motion Planning
55. Zeyu Zhang[CS] Ph.D. 2022, Understanding and Perceiving Actionable Fluent for Robot Planning
56. Xiaojian Ma[CS] Ph.D. 2023, A Unified Framework with Benchmarks for Human-like Visual and Relational Reasoning in the Real World
57. Yizhou Zhao[Stat] Ph.D. 2023, Value Learning for Interactive Games and Embodied AI
58. Pan Lu[CS] Ph.D. 2024, Advancing Mathematical Reasoning with Language Models: A Multimodal and Knowledge-Intensive Perspective
59. Steven Gong[CS] Ph.D. 2024, Advancing Cognitive Abilities in Embodied Agents: Large-scale Simulations and Multi-Agent Collaborations
60. Sirui Xie[CS] Ph.D. 2024, A Generative Account of Latent Abstraction
61. Muzhi Han[ME] Ph.D. 2024, Scene Abstraction for Generalizable Long-horizon Robot Planning
62. Qian Long[CS] Ph.D. 2024, Multi-Agent Systems: Enhancing Scalability, Task-Agent Adaptiveness and Benchmarking
A few students were transferred to colleagues
Ph.D. Students co-supervised at Peking, Tsinghua and Central Conservatory of Music
63. Jiangyong HuangPh.D. 2022, Peking University
64. Liangru XiangPh.D. 2022, Tsinghua University
65. Xinyi TongPh.D. 2022, Central Conservatory of Music
66. Tianle WangPh.D. 2022, Central Conservatory of Music
67. Aoyang QinPh.D. 2022, Tsinghua University
68. Junfeng NiPh.D. 2023, Tsinghua University
69. Puhao LiPh.D. 2023, Tsinghua University
70. Yizhe HuangPh.D. 2023, Peking University
71. Peiyang YuPh.D. 2023, Central Conservatory of Music
72. Xiaoyuan ZhangPh.D. 2023, Peking University
73. Yu LiuPh.D. 2024, Tsinghua University
74. Fanqi KongPh.D. 2024, Peking University
75. Jishang ChenPh.D. 2024, Central Conservatory of Music
76. Sirui ZhangPh.D. 2024, Central Conservatory of Music
77. Liangke ZhaoPh.D. 2024, Central Conservatory of Music
78. Zhihao CaoPh.D. 2024, Tsinghua University
79. Hengli LiPh.D. 2024, Peking University
80. Jingze ZhangPh.D. 2025, Peking University
81. Jiayang WuPh.D. 2025, Tsinghua University
82. Haoxin ZhangPh.D. 2025, Central Conservatory of Music
83. Xinyi HePh.D. 2025, Peking University
84. Zhuofan ZhangPh.D. 2025, Tsinghua University
Postdocs supervised at PKU
Fangwei ZhongPostdoc 2021-2024, Value-driven Agents
Bo DaiPostdoc 2022-2024, Understanding Magic by Causal Reasoning
Zhi GaoPostdoc 2023-2025, Closing the Loop with Neural Symbolic Reasoning and Learning
Lingyun GuPostdoc 2025-2027, AI and Law: Truthworthy AGI Agents
Postdocs supervised at UCLA
Xiuwen LiuPostdoc 1999-2000, Texture modeling and Julesz ensemble
Hong ChenPostdoc 2003-2006, Human face, hair, and cloth modeling and sketching
Haifeng GongPostdoc 2007-2009, Intrackability: An information Theoretical Criterion for pursuing Hybrid Video Representations
Liang LinPostdoc 2007-2009, Layered Graph Matching
Mingtao PeiResearch Associate 2009-2011, Event understanding and Intent Prediction in Video
Tianfu WuPostdoc 2011-2014, Decision policy and learning and-or graph for object detection and tracking.
Bo ZhengResearch Associate 2012-2013, 3D scene parsing by reasoning physical stability and risk
Kewei TuPostdoc 2012-2014, Joint video and text parsing, query answering, and grammar learning
Xiaobai LiuPostdoc 2013-2015, Attributed grammar for scene understanding, camera calibration and 3D reconstruction
Caiming XiongPostdoc 2014-2015, Robot Learning from demonstrations.
Wei LiangResearch Associate, 2013-2015, Container recognition and causality inferrence
Quanshi ZhangPostdoc 2014-2018, Webscale lifelong Communicative Learning.
Ping WeiPostdoc 2015-2017, Inferring the Mind of Agents in Video: Belief, Intent, and Attention
Jianwen XiePostdoc 2016-2017, Generative and Decriptive Models (Deep Networks) for Learning
Changsong LiuPostdoc 2016-2018, Communicative Learning and Situated Dialogues
Yixin ZhuPostdoc 2018-2020, Cognitive Robots
Keze WangPostdoc 2018-2020, Explainable AI and Learning with small labelled examples
Visiting Ph.D students supervised at UCLA
Zhi HanVisiting Ph.D Student 2009-2011, Video Primal Sketch: A Middle Level Generic Representation of Video
Shuo WangVisiting Ph.D Student 2011-2013, Scene Modeling and Recognition with Tangram Model
Ping WeiVisiting Ph.D Student 2011-2012, Modeling 4DHOI and Concurrent Action and Affordance
Jifeng DaiVisiting Ph.D Student 2012-2013, Unsupervised learning for co-segmentation and image parsing
Li BoVisiting Ph.D Student 2014-2016, Modeling Occlusion for vehicle detection, parsing, and fluent reasoning.
Wenguan WangVisiting Ph.D Student 2016-2018, Joint parsing of human poses, attributes and actions by QA learning
Zhenliang ZhangVisiting Ph.D Student 2017-2019, Mixed reality for robot learning.
Zhixiong NanVisiting Ph.D Student 2017-2019, Visual attention and intention inference
Many students were co-supervised at Microsoft Research Asia and Lotus Hill Institute during 1998-2010.