Machine Learning Engineering Manager, Grocery Field AI - Inference

Amazon

Amazon

Software Engineering, Data Science, Other Engineering
Boston, MA, USA
Posted on Aug 19, 2025

DESCRIPTION

Amazon Worldwide Grocery Tech is seeking an exceptional Software Development Manager to lead our Edge ML Inference Systems team. This team is responsible for designing, developing, and operating high-performance machine learning inference systems that power real-time computer vision and AI applications across our grocery store locations. Our solutions run on edge devices and enable crucial in-store experiences, from computer vision-based inventory management to smart checkout systems.

Key job responsibilities
- Lead a team of engineers developing high-performance ML inference systems for edge devices.
- Drive architectural decisions for deploying and managing ML models across distributed edge locations.
- Establish performance benchmarks and optimization strategies for ML inference.
- Collaborate with AI/ML teams to enable efficient deployment of new models to production.
- Define and implement strategies for model compression, quantization, and optimization.
- Develop systems for remote monitoring, updating, and management of edge ML infrastructure.
- Partner with hardware teams to optimize ML workloads for specific edge computing platforms.
- Ensure high availability and reliability of inference systems in production environments.