Lead Data Engineer with experience in Pyspark, Python
Infosys
Job details
Work Location
Charlotte, NC, Hartford, CT, Raleigh, NC
State / Region / Province
Connecticut, North Carolina
Country
USA
Domain
Delivery
Interest Group
Infosys Limited
Skills
Technology|Analytics - Packages|Python - Big Data, Technology|Cloud Integration|Azure Data Factory (ADF), Technology|Oracle Apps Technical|Oracle Apps PL/SQL
Company
ITL USA
Requisition ID
136168BR
Job description
Infosys is seeking a Lead Data Engineer with experience in Pyspark, Python. This position’s primary responsibility will be to provide technical expertise and coordinate for day-to-day deliverables for the team. The chosen candidate will assist in the technical design of large business systems; builds applications, interfaces between applications, understands data security, retention, and recovery. The role holder should be able to research on technologies independently to recommend appropriate solutions & should contribute to technology-specific best practices & standards; contribute to success criteria from design through deployment, including, reliability, cost-effectiveness, performance, data integrity, maintainability and scalability; contributes expertise on significant application components, program languages, databases, operating systems, etc., and guides/mentors the team during the build and test phases.
Candidate must be located within commuting distance of Hartford CT, Charlotte/Raleigh, NC or be willing to relocate to the area. This position may require travel to project locations.
Required Qualifications
- Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
- At least 4 years of Information Technology experience.
- Experience in creating data engineering pipelines using Python with Object oriented concepts, Pyspark and AWS cloud Native solutions
- Design, develop and implement new features to existing framework using PySpark and Python.
- Write efficient and effective standalone scripts in PySpark with transformations as per the defined business logic.
- Experience in CI/CD pipeline using Jenkins Cloud formations etc.
- Work closely with the team to understand the requirements and develop solutions.
- Test and debug code to ensure it produces the desired results.
- Document all programming tasks and procedures for future reference and troubleshooting
- Use your expertise in Python and Object-oriented concepts to solve complex problems and implement robust solutions.
- Proficient in Python, PySpark, and Object-oriented programming concepts.
- Proven experience as a Senior Data Engineer or similar role.
- Strong problem-solving techniques with an ability to troubleshoot complex software issues.
- Experience with AWS is preferred, but not mandatory.
- Excellent communication skills, both written and verbal.
- Self-motivated and able to work independently with minimal supervision.
- Ability to work in team in diverse/ multiple stakeholder environment.
- Experience and desire to work in a Global delivery environment.
- Ability to learn and adapt to emerging technologies and enhance skills.
About Us
Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.
Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.