Description

We are the MIDAS team within the Amazon Search organization. We own the end-to-end human annotation requirements for our product partners. This is an opportunity to join a high-performing team that helps customers worldwide find and discover the best products, meet their personalized needs with the right product details, and receive comparisons, recommendations, and more on Amazon. This role is high-visibility and highly cross-functional, requiring collaboration and influence across global product, design, science, operations, and engineering teams.

We are looking for a Language Engineer to join MIDAS to write intuitive, labeler-friendly annotation guidelines that enable measurement of search quality, support data wrangling and analysis, define specifications for labeling UI templates, and report labeled-data quality metrics to deliver on stakeholder requirements and improve the customer experience. To achieve high accuracy and consistency in labeled data outputs, Language Engineers apply linguistic (e.g., semantics, syntax, pragmatics) and scripting expertise to solve natural language processing and language understanding challenges.

Key job responsibilities
Design and develop data annotation guidelines and workflows.
Manage and process large amounts of structured and unstructured data.
Adopt and design quality control metrics and methodology to evaluate the quality of data annotation.
Maximize productivity, process efficiency and quality through streamlined workflows, process standardization, documentation, audits and investigations on a periodic basis.
Handle annotation & data investigation requests from multiple stakeholders with high efficiency and quality in a fast-paced environment.
Collaborate with scientists, engineers, and product managers in defining metrics, guidelines, and workflows.
Initiate and contribute towards improvement projects, present solution proposals, and implement them.
Establish processes and mechanisms to onboard and train junior data associates on an ongoing basis.
Handle work prioritization and deliver based on business priorities.
Be flexible in changes to conventions deployed in response to customers’ requests and change workflows accordingly.

About the team
Amazon is among the world’s top 10 most-visited websites, and Amazon Search Organization sits at the center of how hundreds of millions of customers shop—processing billions of queries to find products. Within Amazon Search, the MIDAS team delivers high-quality labeled data at scale to train and evaluate AI models and produce metrics that measure customer experience. We operate with agility, deep linguistic expertise, strong data integrity, self-service enablement, and frugal use of resources. We partner closely with applied science, engineering, and product teams to improve semantic matching, ranking, computer vision, image processing, and augmented reality.