← Back to PeopleResearcherTianheng ChengResearcherLinkedIn@tiahchCo-author of Mixture-of-Depths Attention paper on transformer architecture improvements.1Mentions1Articles1OutletsCompanies CoveredByteDance1ArticlesMost recent firstMentioned InReferenced in coverageByteDance researchers upgrades Transformer performance by preserving depth information in attentionarXivpositiveMar 20, 2026“Co-author of Mixture-of-Depths Attention paper on transformer architecture improvements.”