UC Berkeley Sky Computing Lab
Undergraduate Researcher
Jul 2026 — Present Now
- SGLang
- LLM inference
- Scheduling
- GCP A100
- Extending Dev Bali's FairInference project (SOSP 2026 submission), implementing scheduling logic in a forked SGLang inference engine using a spec-driven development approach with defined pre/postconditions.
- Designing a fairness policy for hybrid prefill/decode batching, benchmarking against baseline policies on a GCP A100 GPU while implementing parallelization to bound latency interference across concurrent clients.