Cast AI is hiring Senior Software Engineers for teams owning the inference API, harnesses, and agent platform. Responsibilities include end-to-end feature ownership (design, implementation, testing, rollout), building distributed systems, observability, billing/metering, and security. Preferred experience: Go or TypeScript, Kubernetes, cloud platforms (AWS/GCP/Azure), observability tooling (Prometheus/Grafana/OpenTelemetry), CI/CD and performance tuning. Role is remote-first across listed European countries; Cast AI does not provide visa sponsorship.

Join Cast AI to design, build, and operate backend services, Kubernetes operators, and controllers in Go across AWS, GCP, and Azure. Work focuses include cluster/node lifecycle, cross-cloud provisioning, live container migration (CRIU, container runtimes), and storage optimization (CSI, filesystem internals). Location-specific role: hiring candidates residing in Bulgaria, Croatia, Estonia, Greece, Hungary, Latvia, Lithuania, Poland, Romania, Slovakia, Slovenia, or Ukraine. Salary range listed: €6,500–€9,000 gross. No visa sponsorship provided.

Work on inference and serving infrastructure to improve throughput, latency, and KV cache utilization across GPUs and distributed topologies. Responsibilities include kernel-level tuning, quantization without quality regression, profiling and benchmarking, batching and speculative decoding, memory and cold-start optimizations, and setting technical direction. Technology stack includes Python, vLLM, SGLang, TensorRT-LLM, PyTorch, CUDA, Kubernetes and observability/tooling such as Prometheus, Grafana, ClickHouse and GitLab CI.