Sitemap
A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.
Pages
Posts
Blog Post number 1
Published:
Hello World
portfolio
publications
In-Context Linear Regression Demystified: Training Dynamics and Mechanistic Interpretability of Multi-Head Softmax Attention
Published in arXiv preprint arXiv:2503.12734, 2025
We study how multi-head softmax attention learns in-context linear regression, characterizing the training dynamics and the kernel estimator a one-layer Transformer converges to.
Recommended citation: Jianliang He, Xintian Pan, Siyu Chen, Zhuoran Yang. "In-Context Linear Regression Demystified: Training Dynamics and Mechanistic Interpretability of Multi-Head Softmax Attention." arXiv preprint arXiv:2503.12734, 2025.
Download Paper
Build Your Personalized Research Group: A Multiagent Framework for Continual and Interactive Science Automation
Published in arXiv preprint arXiv:2510.15624, 2025
freephdlabor: an open-source multiagent framework that automates the full research lifecycle, from hypothesis generation through experimentation to publication-ready manuscripts.
Recommended citation: Ed Li, Junyu Ren, Xintian Pan, Cat Yan, Chuanhao Li, Dirk Bergemann, Zhuoran Yang. "Build Your Personalized Research Group: A Multiagent Framework for Continual and Interactive Science Automation." arXiv preprint arXiv:2510.15624, 2025.
Download Paper