Machine Learning Systems, Alignment, and Evaluation

July 18, 2026 ยท View on GitHub

I am a research-oriented machine learning systems engineer working on foundation model infrastructure, alignment, and evaluation. I build efficient and reliable systems for large language models while studying the algorithms and data choices that make them more useful, controllable, and cost-effective in real applications.

  • ๐Ÿง My central research interest is model-system co-design: understanding how model architecture, inference algorithms, data curation, hardware utilization, scheduling, and distributed runtimes interact.
  • ๐Ÿ’ผ I work on Model-as-a-Service platforms and high-performance LLM inference, developing production serving infrastructure with vLLM and SGLang.
  • ๐ŸŽ“ My recent research includes distributed disaggregated inference, preference optimization, instruction-tuning data selection, multimodal evaluation.
  • ๐ŸŒฑ I investigate alignment and evaluation methods that connect measurable model behavior with real-world usefulness, controllability, reliability, and serving cost.
  • ๐Ÿ“š My systems work spans model runtime integration, scheduling and continuous batching, KV-cache and memory management, distributed execution, observability, and reliability.
  • โ›ต I am interested in collaborating on open research and infrastructure that make frontier AI systems faster to experiment with, more rigorous to evaluate, and dependable at scale.
  • โœ๐Ÿป I share technical writing on machine learning systems, infrastructure, and software engineering through my personal blog.
Some other achievements about me~e~e
  • ๐Ÿ’™๐Ÿ’› Be proud of the University of California, Berkeley. ๐Ÿป Proud California Golden Bear. Fiat Lux โœจ Go Bears.
  • ๐ŸŒฒ Be proud of Stanford University. โค๏ธ Proud Stanford Cardinal. Die Luft der Freiheit weht.
  • ๐Ÿงฃ Be proud of Carnegie Mellon University. ๐Ÿพ Proud Carnegie Mellon Tartan. My heart is in the work.
  • ๐ŸŽ‰ Professional Membership of ACM / IEEE / IEEE-CS / CCF / Sigma Xi.
  • ๐ŸŽ Apple Developer.๐Ÿ‘จ๐Ÿปโ€๐Ÿ’ป & Apple Teacher.๐Ÿคช

  • ๐Ÿ“Š Open-source activity and repository highlights:

halfrost's top languages halfrost's GitHub stats halfrost's GitHub trophy Repository activity timeline


Explore my repositories, research interests, and technical writing, or reach out to discuss machine learning systems and frontier AI.

visitor badge