Description

Amazon Customer Service’s Shipping and Delivery Support (SDS) provides support to drivers who deliver packages to customers on behalf of Amazon. We are seeking a passionate and talented Machine Learning Engineer (MLE) to join our team in advancing state-of-the-art Generative AI technologies and Large Language Models (LLMs). In this role, you will design, develop, and deploy highly scalable AI models that benefit drivers, customer service associates, and customers. You will work closely with applied scientists and research teams to productionalize Machine Learning (ML) models, focusing on novel LLM training techniques, optimizations, and customization capabilities such as fine-tuning and distillation.

Key job responsibilities
- Collaborate with Applied Scientists to integrate state-of-the-art model architectures into the training pipeline, integrate state-of-the-art ML/LLM into CS system.
- Collaborate with Applied Scientists to process massive data, scale LLM while optimizing GPU utilization, memory management, and the training workflows (like offloading optimizer states, massive parallelization, etc).
- Cross-team collaboration to facilitate deployment and test of models in the production system.
- Design and maintain large-scale distributed training systems to support multi-modal foundation models.
- Optimize GPU utilization for efficient model training and fine-tuning on massive datasets.
- Develop robust monitoring and debugging tools to ensure the reliability and performance of training workflows, support piloting the LLMs and identify the related issues in the system.
- Collaborate with Engineers and Applied Scientists to investigate design approaches, prototype new LLM technique and evaluate technical feasibility, identify and solve complex problems.

A day in the life
If you are not sure that every qualification on the list above describes you exactly, we'd still love to hear from you! At Amazon, we value people with unique backgrounds, experiences, and skillsets. If you’re passionate about this role and want to make an impact on a global scale, please apply!

Amazon offers a full range of benefits that support you and eligible family members, including domestic partners and their children. Benefits can vary by location, the number of regularly scheduled hours you work, length of employment, and job status such as seasonal or temporary employment. The benefits that generally apply to regular, full-time employees include:
1. Medical, Dental, and Vision Coverage
2. Maternity and Parental Leave Options
3. Paid Time Off (PTO)
4. 401(k) Plan

About the team
The Shipping Delivery and Support (SDS) Tech team’s mission is to enable successful deliveries through fast and efficient support experiences for our drivers, recipients, and associates. The science team utilizes advanced scientific methods, including LLM, to support the business, improve driver support quality, and become more efficient with deliveries.