Software Engineer - Data and Platform Engineering in Charlotte, North Carolina
U.S. Bank
At U.S. Bank, we’re on a journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling the communities we support to grow and succeed. We believe it takes all of us to bring our shared ambition to life, and each person is unique in their potential. A career with U.S. Bank gives you a wide, ever-growing range of opportunities to discover what makes you thrive at every stage of your career. Try new things, learn new skills and discover what you excel at—all from Day One.
Job Description
Job Description
U.S. Bank is seeking the position of Software Engineer – Data and Platform Engineering in Charlotte, North Carolina.
Essential Responsibilities:
The Software Engineer – Data and Platform Engineering is responsible for designing, implementing, and maintaining the CI/CD pipelines and workflows that support deployment, cloud-based applications and services for Customer 360 Unix and Database objects. Essential responsibilities include:
Design and develop DAGs (Directed Acyclic Graphs) using Apache Airflow to manage workflow orchestration for Customer360 business objects to perform Extraction and Transformation in standard with business requirements. Write custom operators, sensors, and hooks. Ensure data quality and implement data validation processes for each unique batch operations like normalization on Transaction and Operational data.
Develop batch and real time scheduler to automate processing of Transaction and Operational data in Customer 360 platform by designing Job Information Language processor using Autosys and configuration of Presto drivers to access the customer 360 data over business analytics tools like Toad, Superset, Dbeaver and Synapse.
Develop programs to test, simulate, and design new pieces of automation software using Python or Scala to check different use cases applicable for Customer 360 business demands and cross-check whether the expected output matches with the output given by the program or not by dataframe comparisons using Spark framework.
Responsible for transitioning Analytics and Customer 360 applications, processes, and data management to a cloud-first approach as part of modernization using Microsoft Azure.
Apply Dev/Ops mindset, take ownership of Customer 360 production success, optimize operation success via automation/active alerting/self-healing, and lead the resolution of production issues to ensure high-availability of data in Customer 360 tables and enhance query performance against Customer 360 hive tables using different tools and utilities like Pyspark, SQL Tuning and Spark Utilities.
Develop data storage solutions, integrating databases, and using Azure data services for efficient data management and analytics of Customer 360 data in order for successful API access and Dashboard Visualization like Splunk and Kibana.
Design and develop machine learning algorithms using AI/ML and deep learning applications to solve complex problems with multilayered data sets like Real time transactional data and Reward programming decision system engine in Customer 360 space and optimize existing machine learning libraries and frameworks.
Drive the release planning and execution with end-to-end understanding and insights (effort, risk, priority) of the planned features for end to end successful deployments of Customer 360 operational objects using Service Now by driving parent change and individual task associated with Linux and Hadoop.
Develop high-quality code in Customer 360, define best engineering practice, perform peer code reviews to ensure successful deliverable with engineering excellence using scalable tools and engines like Spark/Object oriented Scala and JAR less Python utilities.
Document engineering artifacts such as technical design document, flowcharts, system context diagrams, code comments on Customer 360 objects using confluence, Microsoft SharePoint and Visio.
Collaborate cross-functionally with product owner, data scientists, business users, project managers and other engineers to achieve elegant solutions in Customer 360 platform.
Collaborate with other engineers on the team to elevate technology and consistently apply best practices in terms of enhancement or new development in Customer platform in the form of code review, Optimization techniques and scalable testing feature enabled.
Position may allow working from home within commuting distance of worksite location. Multiple Positions.
Basic Qualifications:
Requires a Master’s degree in Computer Science or Technology Management plus 3 years of experience as a Software Engineer or Data Engineer. Will accept a Bachelor’s degree in Computer Science or Technology Management plus 5 years of experience as a Software Engineer or Data Engineer in lieu of a Master’s degree plus 3 years of experience..
Required Skills/Experience:
Must possess 3 years of experience with Master’s or 5 years of experience with Bachelor’s with all of the following: building data pipelines; extracting data from sources; performing data conversion or transformation; building or developing ETL processes; creating and using shell scripts; cloud platforms (Azure or Google Cloud); Python; Spark; Spark SQL; Teradata; Hadoop; HDFS files; .xml files; data models; Oracle; Informatica/informatics for orchestration; Parquet; and Json. Position may allow working from home within commuting distance of worksite location. Base pay range may vary if an offer is made for work in a different location. Pay Range: $110,033.00 - $144,400.00. (#LI-NDI #LI-DNI #LI-DNP #DE-DNP).
If there’s anything we can do to accommodate a disability during any portion of the application or hiring process, please refer to our disability accommodations for applicants.
Benefits:
Our approach to benefits and total rewards considers our team members’ whole selves and what may be needed to thrive in and outside work. That's why our benefits are designed to help you and your family boost your health, protect your financial security and give you peace of mind. Our benefits include the following (some may vary based on role, location or hours):
Healthcare (medical, dental, vision)
Basic term and optional term life insurance
Short-term and long-term disability
Pregnancy disability and parental leave
401(k) and employer-funded retirement plan
Paid vacation (from two to five weeks depending on salary grade and tenure)
Up to 11 paid holiday opportunities
Adoption assistance
Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per calendar year unless otherwise provided by law
U.S. Bank is an equal opportunity employer. We consider all qualified applicants without regard to race, religion, color, sex, national origin, age, sexual orientation, gender identity, disability or veteran status, and other factors protected under applicable law.
E-Verify
U.S. Bank participates in the U.S. Department of Homeland Security E-Verify program in all facilities located in the United States and certain U.S. territories. The E-Verify program is an Internet-based employment eligibility verification system operated by the U.S. Citizenship and Immigration Services. Learn more about the E-Verify program.
In addition to salary, U.S. Bank offers a comprehensive benefits package, including incentive and recognition programs, equity stock purchase 401(k) contribution and pension (all benefits are subject to eligibility requirements).U.S. Bank will consider qualified applicants with arrest or conviction records for employment. U.S. Bank conducts background checks consistent with applicable local laws, including the Los Angeles County Fair Chance Ordinance and the California Fair Chance Act as well as the San Francisco Fair Chance Ordinance. U.S. Bank is subject to, and conducts background checks consistent with the requirements of Section 19 of the Federal Deposit Insurance Act (FDIA). In addition, certain positions may also be subject to the requirements of FINRA, NMLS registration, Reg Z, Reg G, OFAC, the NFA, the FCPA, the Bank Secrecy Act, the SAFE Act, and/or federal guidelines applicable to an agreement, such as those related to ethics, safety, or operational procedures.
Applicants must be able to comply with U.S. Bank policies and procedures including the Code of Ethics and Business Conduct and related workplace conduct and safety policies.