Data Engineer I, AGI-DS Customer Analytics
Amazon
DESCRIPTION
Data engineer will develop end-to-end analytics pipelines and build a world-class data platform, deploying scalable business intelligence tools for the AGI team. The ideal candidate should demonstrate expertise in handling large-scale data operations and complex technical environments while maintaining strong business partnerships to drive strategic impact. The candidate will manage complete lifecycle from requirements gathering through implementation of interactive dashboards and reports. They will architect and implement large-scale data warehouse solutions utilizing SQL, Distributed/MPP data storage, Hadoop ecosystem, and AWS services. The ideal candidate will design robust ETL processes and data models to support business intelligence initiatives, while partnering with stakeholders to identify strategic opportunities where enhanced data infrastructure creates significant business value. They will support complex technical projects while maintaining attention to detail in fast-paced environments. The candidate will develop and maintain scalable BI solutions and interactive dashboards for data-driven decision making, leveraging expertise in SQL, data modeling, ETL design, AWS services, Hadoop, and dashboard tools like QuickSight."
Key job responsibilities
· Design, implement, and support a platform providing ad hoc access to large datasets
· Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL
· Implement data structures using best practices in data modeling, ETL/ELT processes, and SQL, Oracle, Redshift, and OLAP technologies
· Model data and metadata for ad hoc and pre-built reporting
· Interface with business customers, gathering requirements and delivering complete reporting solutions
· Build robust and scalable data integration (ETL) pipelines using SQL, Python and Spark.
· Build and deliver high quality datasets to support business analyst and customer reporting needs.
· Continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers
· Participate in strategic & tactical planning discussions, including annual budget processes
About the team
AGI-DS holds a key position in the Generative intelligence space by being the provider of ground truth data for training the models that generate AI models.