Researcher
Lianghui Zhu is a researcher with a GitHub profile under the username Unrealluver.
Referenced in coverage
“Lead author of Mixture-of-Depths Attention paper introducing mechanism for preserving depth information in transformer attention to improve LLM scaling.”