Senior Software Engineer, Vertex 3P AI Platform SRE
Senior Software Engineer, Vertex 3P AI Platform SRE
- linkCopy link
- emailEmail a friend
Minimum qualifications:
- Bachelor’s degree in Computer Science, a related field, or equivalent practical experience.
- 5 years of experience with software development in one or more programming languages.
- 3 years of experience in designing, analyzing, and troubleshooting large-scale distributed systems.
- 2 years of experience leading projects and providing technical leadership.
- Experience with Cloud Compute Platforms (e.g., Kubernetes, Cloud Functions).
- Experience in Site Reliability Engineering, System Design, and Distributed Computing.
Preferred qualifications:
- Master's degree in Computer Science or Engineering.
- Experience with Kubernetes, Google Cloud Platform (GCP), GKE Networking, and Istio.
- Passion for technology and technical depth to uncover root causes of complex technical problems and provide guidance on solving them.
About the job
Site Reliability Engineering (SRE) combines software and systems engineering to build and run large-scale, massively distributed, fault-tolerant systems. SRE ensures that Google Cloud's services—both our internally critical and our externally-visible systems—have reliability, uptime appropriate to customer's needs and a fast rate of improvement. Additionally SRE’s will keep an ever-watchful eye on our systems capacity and performance.
The Vertex Third-Party (3P) AI Platform SRE team is expanding, and we are looking for engineers to help us build and run the infrastructure for third-party AI workloads on Google Cloud's Vertex AI. We enable a seamless experience for third-party AI workloads on Vertex AI, focusing on reliability, performance, scalability, observability, and efficiency. We want to make Vertex AI the best place to run any AI model.
Behind everything our users see online is the architecture built by the Technical Infrastructure team to keep it running. From developing and maintaining our data centers to building the next generation of Google platforms, we make Google's product portfolio possible. We're proud to be our engineers' engineers and love voiding warranties by taking things apart so we can rebuild them. We keep our networks up and running, ensuring our users have the best and fastest experience possible.
Responsibilities
- Manage and scale Google Kubernetes Engine (GKE) fleets (approximately 60 thousand clusters and growing), including specialized mega-clusters designed for AI/ML models.
- Optimize low-latency and high-throughput model serving across all layers of the platform stack to maximize performance for AI/ML inferences.
- Architect and maintain robust connectivity and interactions between the internal Borg-based control planes and the external GCP-based data planes in a complex hybrid environment.
- Implement and configure essential cloud technologies, including Istio for service mesh management, advanced load balancing, Google Compute Engine (GCE), and various GCP networking and security components.
Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.
Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.
If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.
Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.
To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.