SENIOR, DATA ENGINEER
Walmart
Position Summary...
Demonstrates up-to-date expertise and applies this to the development, execution, and improvement of action plans by providing expert advice and guidance to others in the application of information and best practices; supporting and aligning efforts to meet customer and business needs; and building commitment for perspectives and rationales. Provides and supports the implementation of business solutions by building relationships and partnerships with key stakeholders; identifying business needs; determining and carrying out necessary processes and practices; monitoring progress and results; recognizing and capitalizing on improvement opportunities; and adapting to competing demands, organizational changes, and new responsibilities. Models compliance with company policies and procedures and supports company mission, values, and standards of ethics and integrity by incorporating these into the development and implementation of business plans; using the Open Door Policy; and demonstrating and assisting others with how to apply these in executing business processes and practices.What you'll do...
About Team:
The Third party Data Engineering team sits within the Global Tech Platform works closely with data governance, strategy, and enablement partners across the Data Strategy and Enablement team responsible for developing and maintaining innovative data solutions that drive business growth and efficiency. As a Senior Data Engineer, you will be part of a collaborative team that leverages cutting-edge technologies and data analytics to enable data-driven decision-making solutions.You will design robust data architectures, optimize distributed data processing, and build streaming and batch pipelines that process billions of events daily across Edge and Cloud environments.
What you'll do:
- As a Senior Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, Python, Airflow and Google Cloud Platform (GCP).
- Work closely with product, analytics, and data science teams to understand requirements and deliver data models that enable actionable insights.
- You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensuring data quality and integrity.
- Monitor and troubleshoot data pipelines to ensure data availability and reliability
- Conduct performance tuning and optimization of data processing systems for improved efficiency and scalability
- Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Work closely with data scientists and analysts to provide them with the necessary data sets and tools for analysis and reporting
- Create data tools for analytics team members that assist them in building and optimizing our product into an innovative industry leader.
- Stay up-to-date with the latest industry trends and technologies in data engineering and apply them to enhance the data infrastructure
What you'll bring:
- Proven working experience as a Senior Data Engineer with a 6 to 10 years in the field.
- Strong programming skills in Scala/Java and experience with Spark for data processing and analytics
- Familiarity with Google Cloud Platform (GCP) services such as BigQuery, GCS, Dataproc etc.
- Experience of developing near real-time ingestion pipelines using kafka and spark structured streaming.
- Proven experience in designing and developing APIs.
- Experience with Data modelling, Data warehousing and ETL processes
- Understanding of data warehousing concepts and best practices
- Strong knowledge of SQL and NoSQL systems
- Proficiency in version control systems, particularly Git.
- Proficiency in working with large-scale data sets and distributed computing frameworks
- Familiarity with CI/CD pipelines and tools such as Jenkins or GitLab CI.
- Proficiency with schedulers like Airflow.
- Strong problem-solving and analytical skills
- Familiarity with BI and Visualisation tools like Tableau or Looker
- Strong Understanding in Generative Artificial Intelligence (Gen AI), Agentic AI is desirable but not essential
About Walmart Global Tech
Imagine working in an environment where one line of code can make life easier for hundreds of millions of people. That’s what we do at Walmart Global Tech. We’re a team of software engineers, data scientists, cybersecurity expert's and service professionals within the world’s leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered.
We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail.
Benefits:
Benefits Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include a host of best-in-class benefits maternity and parental leave, PTO, health benefits, and much more.
Equal Opportunity Employer:
Walmart, Inc. is an Equal Opportunity Employer – By Choice. We believe we are best equipped to help our associates, customers and the communities we serve live better when we really know them. That means understanding, respecting and valuing diversity- unique styles, experiences, identities, ideas and opinions – while being inclusive of all people.
The above information has been designed to indicate the general nature and level of work performed in the role. It is not designed to contain or be interpreted as a comprehensive inventory of all responsibilities and qualifications required of employees assigned to this job. The full Job Description can be made available as part of the hiring process.
Minimum Qualifications...
Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications.
Minimum Qualifications:Option 1: Bachelor's degree in Computer Science and 3 years' experience in software engineering or related field. Option 2: 5 years' experience in software engineering or related field. Option 3: Master's degree in Computer Science and 1 year's experience in software engineering or related field. 2 years' experience in data engineering, database engineering, business intelligence, or business analytics.Preferred Qualifications...
Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.