Xintian Pan

Xintian Pan

he/him

M.S. in S&DS @ Yale B.S. in CS @ NJU

Posts by Collection

portfolio

publications

In-Context Linear Regression Demystified: Training Dynamics and Mechanistic Interpretability of Multi-Head Softmax Attention

Published in arXiv preprint arXiv:2503.12734, 2025

We study how multi-head softmax attention learns in-context linear regression, characterizing the training dynamics and the kernel estimator a one-layer Transformer converges to.

Recommended citation: Jianliang He, Xintian Pan, Siyu Chen, Zhuoran Yang. "In-Context Linear Regression Demystified: Training Dynamics and Mechanistic Interpretability of Multi-Head Softmax Attention." arXiv preprint arXiv:2503.12734, 2025.
Download Paper

Build Your Personalized Research Group: A Multiagent Framework for Continual and Interactive Science Automation

Published in arXiv preprint arXiv:2510.15624, 2025

freephdlabor: an open-source multiagent framework that automates the full research lifecycle, from hypothesis generation through experimentation to publication-ready manuscripts.

Recommended citation: Ed Li, Junyu Ren, Xintian Pan, Cat Yan, Chuanhao Li, Dirk Bergemann, Zhuoran Yang. "Build Your Personalized Research Group: A Multiagent Framework for Continual and Interactive Science Automation." arXiv preprint arXiv:2510.15624, 2025.
Download Paper

talks

teaching