Infrastructure Foundation & Production Operations

• Build and operate Harvey’s global compute and network infrastructure, ensuring high availability, scalability, reliability, and performance.
• Improve compute utilization, performance, and service availability while supporting rapidly growing AI workloads.
• Develop capacity models, demand forecasts, and fleet lifecycle automation to help infrastructure scale efficiently with business growth.
• Operate and continuously improve Harvey’s Kubernetes platform, including cluster provisioning, upgrades, networking, monitoring, reliability, performance, and operational automation.
• Drive infrastructure cost efficiency through capacity management, resource rightsizing, workload optimization, and utilization monitoring.
• Build secure infrastructure foundations, including identity and access management, network isolation, secrets management, auditing, and compliance controls.
• Develop scalable Infrastructure-as-Code and automation frameworks using technologies such as Terraform and Pulumi.
• Improve observability, monitoring, alerting, incident response, and operational readiness across the infrastructure platform.
• Participate in the on-call rotation, lead incident response when needed, and turn production learnings into durable engineering improvements.

What You Have

• 10+ years of software, infrastructure, site reliability, or production engineering experience.
• Deep experience building and operating large-scale cloud infrastructure on AWS, Azure, or Google Cloud Platform.
• Strong hands-on experience operating Kubernetes in production, including cluster lifecycle management, networking, and reliability.
• Experience building and operating distributed systems with strong reliability, scalability, and performance characteristics.
• Experience with infrastructure automation and Infrastructure-as-Code using tools such as Terraform or Pulumi.
• Strong understanding of compute infrastructure, networking, capacity planning, fleet management, and production operations.
• Experience designing and operating observability systems, including monitoring, logging, alerting, and incident response.
• Strong understanding of infrastructure security, including IAM, network security, secrets management, and compliance best practices.
• A track record of driving complex, cross-functional technical initiatives and influencing engineering decisions without relying on formal authority.
• Excellent communication skills and the ability to explain technical concepts clearly to engineering partners and other stakeholders.
• A systems-thinking mindset and a passion for building simple, reliable, and scalable infrastructure platforms.

Nice to Have

• Experience supporting AI/ML or LLM infrastructure at scale.
• Experience operating GPU fleets, high-performance compute infrastructure, or large-scale capacity planning.
• Experience with multi-cloud infrastructure or hybrid cloud environments.
• Experience building internal platforms or developer tooling that improves engineering velocity and production safety.

Compensation

$231,000 - $340,000 USD

Depending on your location, an Applicant Privacy Notice may apply to you. You can find all of our Applicant Privacy Notices here.

#LI-AN2

Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made by emailing accommodations@harvey.ai