Hero Image

AnitaB.org Talent Network

Connecting women in tech with the best professional opportunities!

Hadoop and PySpark Lead Developer

Infosys

Infosys

Software Engineering
United States · Hartford, CT, USA
Posted on Apr 3, 2026

Job details

Job Role

Technology Lead - US


Work Location

Hartford, CT


State / Region / Province

Connecticut


Country

USA


Skills

Technology|Oracle Apps Technical|Oracle Apps PL/SQL


Domain

Delivery


Interest Group

Infosys Limited


Company

ITL USA


Requisition ID

146054BR


careerpage.description_page_field_label_field_job_code

835ATHLDUS Technology Lead


Infosys is seeking a Hadoop and PySpark Lead Developer. In this role, one will enable digital transformation for our clients in a global delivery model, research on technologies independently, recommend appropriate solutions and contribute to technology-specific best practices and standards. One will be responsible to interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle. Candidate will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued.


Required Qualifications:

  • Candidate must be located within commuting distance of Hartford, CT or be willing to relocate to the area.
  • At least 4 years of experience in Information Technology.
  • Experience to develop/lead Big Data solutions at enterprise scale with at least one end‑to‑end implementation
  • Bachelor’s degree or foreign equivalent required from accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education
  • Applicants authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.

Preferred Qualifications:
  • Expertise in software development building large scale distributed data processing systems/application, Data Engineering or large-scale internet systems.
  • Strong experience in programming languages: Big Data, Spark/PySpark, SQL, Python, and Shell scripting.
  • Good experience with Spark/Hadoop/HDFS architecture, YARN, Confluent Kafka, HBase, Hive, Impala, and NoSQL databases
  • Experience with batch processing and AutoSys job scheduling and monitoring
  • Performance analysis, troubleshooting, and resolution (including familiarity with Cloudera/Hadoop logs)
  • Experience working with Cloudera on open issues leading to cluster configuration changes and implementation. Strong experience with databases such as SQL, Hive, Elasticsearch, HBase, etc.
  • Knowledge of Hadoop security, data management, and governance
  • Good understanding of data integration, data quality and data architecture. Experience in Relational Modeling, Dimensional Modeling and Modeling of Unstructured Data

The job entails sitting as well as working at a computer for extended periods of time. Should be able to communicate by telephone, email or face to face. Travel may be required as per the job requirements.

Along with competitive pay, as a full-time Infosys employee you are also eligible for the following benefits: -
  • Medical/Dental/Vision/Life Insurance
  • Long-term/Short-term Disability
  • Health and Dependent Care Reimbursement Accounts
  • Insurance (Accident, Critical Illness, Hospital Indemnity, Legal)
  • 401(k) plan and contributions dependent on salary level

About Us
Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.

Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.