
Senior ML Engineer | Kimchi (Inference Stack Optimization)
Lead the optimization of the inference stack (throughput, latency, cold starts, cost per token) across GPU fleets and customer clusters. Responsibilities include profiling and benchmarking, scheduler and KV-cache tuning, weight loader and JIT/cache improvements, quantization without quality regressions, and scaling distributed inference topologies. Tech stack includes Python, vLLM, SGLang, TensorRT-LLM, PyTorch, CUDA tooling, Kubernetes, virtiofs/shared filesystems, ClickHouse, observability and CI tooling.


