Hands-on technical leader responsible for architecting and delivering distributed inference hosting on Kubernetes (using frameworks like llm-d, vLLM, Ray Serve), optimizing performance (KV-cache, batching, routing), defining SLOs, operating high-scale services, and contributing to upstream open-source inference projects. Requires strong software engineering (Go/Python, gRPC), distributed systems expertise, and experience with LLM inference engines and optimizations.

DigitalOcean seeks a Senior Engineer to lead design and delivery of a multi-tenant AI inference data plane. The role focuses on distributed LLM serving at scale using Kubernetes-native frameworks (e.g., llm-d, vLLM, Ray Serve), performance optimizations (KV-cache, caching, batching, quantization), operational excellence, and upstream open-source contributions. Requires strong software engineering (Go or Python) and distributed-systems experience.

The Home Depot's BlackLocus team seeks a Senior Data Scientist to design and deploy algorithms and scalable systems for competitive intelligence, product matching, pricing automation and GenAI-driven insights. Role emphasizes Python/SQL, predictive analytics, causal inference, ML model development/deployment, cloud AI platforms and cross-functional communication. Listed pay range: $90,000–$190,000 per year.

NVIDIA seeks a Senior NCX Engineer to work with strategic customers and partners to build, deploy, and optimize AI workloads (training and inference) on NCP, Neo Cloud, DGX Cloud and major CSPs. The role requires customer-facing experience, expertise in Kubernetes, containers, GPU scheduling, Linux, Python/Go, ML frameworks (PyTorch/TensorFlow), observability and infrastructure-as-code practices.

Join the Observability, Monitoring, and Integrations team within GitLab's Monetization org to design, build, and operate telemetry, monitoring, and automated anomaly detection for billing and usage pipelines across CustomersDot, Salesforce, and Zuora. Role emphasizes Prometheus/Grafana/OpenTelemetry, SLOs/SLIs, runbooks, incident handling, reconciliation, and exploring AI/ML techniques. Open at Senior and Staff levels. Remote role with a Bangalore location listed.

Responsible for designing and building GenAI-powered developer tooling (prompts, IDE integrations, Cursor/Claude rules) and running the GenAI developer platform using LiteLLM. Owns guardrails and observability for agentic workflows, integrates with Datadog, DX, FinOut and with systems like Jira and GitHub, and collaborates across Product Engineering. Requires 5+ years professional software engineering experience, hands-on GenAI tooling experience, and experience building cloud-native applications (Golang); AWS and Kubernetes experience are preferred.

NVIDIA seeks a hands-on Senior Solutions Architect to design, prototype, and ship agentic AI applications and high-performance RAG pipelines for M&E customers. Responsibilities include customer-facing technical leadership, optimizing inference on NVIDIA stacks, building reference architectures, and collaborating with engineering and sales. Requires 8+ years as an ML/software engineer or solutions architect, production coding in Python/C/C++, expertise in PyTorch, distributed GPU training/inference, multi-agent frameworks, and cloud or on-prem deployments. Salary range provided: 184,000–287,500 USD per year.

Hands-on senior role to build and tune fraud detection controls, define telemetry and logging requirements, conduct investigations using SIEM and data warehouses, and implement preventive measures and automated workflows. Requires strong SQL, scripting, experience with SIEM/log platforms, familiarity with trading and crypto custody risks, and 5+ years in antifraud, investigations, or related security roles.

Lead the evolution of Grafana's Interactive Learning recommendation system by building, deploying, and operating personalized, real-time recommendation models. Own model training and serving, feature pipelines, evaluation and experimentation, and production monitoring while partnering with software engineers, data analysts, and product teams. Position is fully remote and is considering candidates in the United States.

Role to design, build, deploy, and operate recommendation models and a real-time recommendation service for an in-product Interactive Learning experience. Responsibilities include feature pipeline ownership, model training/serving/monitoring, defining offline/online evaluation and experimentation, and partnering with software engineers, data analysts, and product teams. Strong experience expected in recommender/personalization systems, applied production ML, and relevant engineering skills (Go/TypeScript, HTTP/gRPC, streaming).

Grafana Labs is hiring a Senior Machine Learning Engineer (Developer Advocacy) to evolve a rule-based Interactive Learning recommender into a personalized, continuously improving system. The role involves building and operating real-time recommendation services, owning model training/serving/monitoring, defining evaluation and experimentation methodology, and partnering with engineers, data analysts, and product teams. Position is fully remote and Grafana is considering candidates in Sweden.

Work on Grafana's Interactive Learning recommender: build, deploy, and operate real-time personalized recommendation models; define evaluation methodology and run experiments; own feature pipelines, monitoring, and model iteration. Collaborate with software engineers, data analysts, Product Analytics, and cross-functional teams to productionize models and translate product needs into measurable experiments. Role is remote and Grafana lists a Spain base compensation range of EUR 82,988 - 99,586.

Grafana Labs is hiring a Senior Machine Learning Engineer (Developer Advocacy) to evolve the Interactive Learning plugin’s recommendation system into a personalized, real-time recommender. Responsibilities include building and operating models (training, serving, validation, monitoring), defining evaluation metrics (offline, online, longitudinal), running experiments, owning feature pipelines, and partnering with software engineers, data analysts, and product teams to productionize and safely integrate models. Role is fully remote and being considered for candidates in the Republic of Ireland. Compensation range in Ireland: EUR 104,000–124,800 (base).

Lead development of a personalized, real-time recommendation system for Grafana's Interactive Learning plugin. Responsibilities include building, validating, deploying, and monitoring recommendation models and feature pipelines; defining offline and online evaluation and experimentation; shipping incremental improvements; and partnering with software engineers, data analysts, and product teams to productionize models and measure impact. Role is fully remote and targeting candidates in Germany.

Lead the evolution of an in-product personalized recommendation system: build, deploy, and operate recommendation models; define evaluation metrics and experiments; own feature pipelines and model monitoring; partner with software engineers, data analysts, and product teams to productionize improvements. Role is fully remote and Grafana is considering candidates in Canada. Base compensation range (Canada) CAD 164,490–197,389.

Work on the Duo Chat backend to design and build Flow Registry components using Python and LangGraph, integrate generative AI models and multi-agent orchestration, and implement GraphQL/REST APIs and monolith logic. Responsibilities include improving observability, test coverage (pytest, RSpec), performance and reliability, collaborating with product and UX, and participating in Tier 2 on-call rotations.

Join Datadog's Data Visualization organization to lead the design and delivery of AI-native product experiences (dashboards, notebooks, investigations). Responsibilities include building LLM-powered and agent-enabled interfaces, driving prompt/context engineering and evaluation frameworks, ensuring AI reliability and scalability, and providing technical leadership across product and engineering teams. Positions located in multiple French cities and Madrid, Spain; hybrid workplace.

Build and operate production LLM-based systems and AI infrastructure (Python/Golang) to automate customer support and compliance workflows. Role requires 5+ years of software engineering experience with microservices, experience deploying AI/ML or LLM applications (RAG, prompt engineering), and delivering end-to-end projects. Remote-first (USA) with quarterly in-person sessions. Annual base salary range: $186,065–$218,900 USD.

Lead a cross-functional team to develop, validate, benchmark, and deploy machine learning systems and agentic AI patterns. Responsible for model strategy, technical architecture choices (open source and cloud), and influencing senior business and regulatory stakeholders. Role requires extensive hands-on experience with ML, open-source languages, relational databases, cloud platforms (AWS), and DevOps/CI-CD practices.

Work on building ground truth, defining and collecting training datasets, implementing training pipelines and real-time inference (PyTorch, TensorFlow, TensorRT, Python, C++) for NVIDIA's Autonomous Vehicles effort. Requires advanced experience in deep learning/machine learning and computer vision (PhD+4 years or MS+6 years experience stated), plus skills in sensor fusion (e.g., images and LIDAR), planning/control, software engineering and research. Salary ranges provided: 184,000–356,500 USD/year depending on level.