Staff Software Engineer

Overview DataRobot is hiring a Staff Software Engineer focused on Application Scalability & Performance. Lead the design, implementation, and operation of backend systems that power high-throughput AI applications. Ensure our applications perform with high accuracy, minimal latency, and robust scalability (including autoscaling), while maintaining reliability, cost-effectiveness, and maintainability. Collaborate closely with Product, Platform, and AI/ML teams to deliver high impact. Responsibilities Architect, build, and lead backend services that scale to handle large workloads, high concurrency, and low latency requirements. Design and implement autoscaling strategies (horizontal/vertical), dynamic resource allocation, and load balancing to ensure responsive, cost-efficient service. Improve end-to-end request pipelines, optimizing for latency, throughput, reliability, and correctness. Instrument, monitor, and profile systems in production; identify bottlenecks, troubleshoot performance issues, and proactively tune services. Collaborate with ML/AI teams to ensure models’ serving pipelines uphold accuracy, consistency, and performance under load. Drive best practices in systems reliability, observability, error handling, capacity planning, resilience, and failover. Mentor and coach other engineers; provide technical leadership and influence across teams. Contribute to defining architecture, coding standards, performance benchmarks, and technical roadmap items related to scalability and performance. Knowledge, Skills, and Abilities 7+ years of backend engineering experience building scalable, high-performance distributed systems / services. Strong experience with performance optimization: profiling, latency tuning, concurrency, caching strategies. Deep experience with autoscaling, resource management, load balancing, throughput/latency SLAs. Solid programming skills in one or more backend languages (e.g. Python, Java, Go, C++, or equivalent). Strong understanding of observability and monitoring: metrics, tracing, logging; and instrumentation of services. Design and architect scalable AI-backed services and applications, integrating AI models into production systems with high performance, reliability, and low latency. Ability to solve ambiguous challenges and influence technical direction across teams, balancing performance, accuracy, and cost. Experience operating across multiple cloud providers (AWS, GCP, Azure) and/or hybrid environments. Nice to Have Experience with AI/ML model deployment, serving, inference, and production integration. Experience with Gen AI / serving LLMs, embeddings, etc. Exposure to on-prem delivery models or regulated environments. Experience with Docker and building containerized applications. Open source software development experience or contributions. Benefits The talent and dedication of our employees are at the core of DataRobot’s journey. Benefits may include depending on location and local legal requirements: Medical, Dental & Vision Insurance, Flexible Time Off Program, Paid Holidays, Paid Parental Leave, Global Employee Assistance Program (EAP), and more. EOE & Compliance DataRobot is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based on race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other legally protected characteristics. DataRobot provides reasonable accommodations to applicants with physical and mental disabilities. Please see the U.S. Department of Labor’s EEO poster and EEO poster supplement for additional information. All applicant data is handled in accordance with our Applicant Privacy Policy. Job Details Seniority level: Mid-Senior level Employment type: Full-time Job function: Engineering and Information Technology Industries: Software Development #J-18808-Ljbffr