Hadoop and PySpark Data Engineer

Infosys•Jacksonville, FL

About The Position

In the assigned role of Technology Consultant 2, the employee will contribute to software and data engineering work for Infosys Financial Services, a unit supporting digital transformation for financial institutions across banking, wealth management, and insurance. The role involves working across the software development life cycle, from requirements and design through coding, testing, deployment support, and production issue resolution. The position focuses on data warehousing and big data technologies, including Hadoop, Hive, Spark, and Python, with production experience in a Hadoop ecosystem such as Cloudera. The role may require relocation and/or travel to the work or project location. The estimated annual compensation range for a candidate based in Jersey City, New Jersey, is $82,419 to $126,600.

Requirements

Bachelor’s degree or foreign equivalent from an accredited institution, or three years of progressive experience in the specialty in lieu of each year of education.
Experience with data warehousing architectural approaches.
Sound understanding of and experience with the Hadoop ecosystem, including Cloudera.
Experience working with a Big Data implementation in a production environment.
Experience with big data technologies such as Hadoop, Hive, Spark, and Python.
Experience with Python and Unix shell scripting.
Experience with an orchestration tool such as Autosys or Airflow.
Sound knowledge of relational databases (SQL) and experience with large SQL-based systems.
Understanding of Agile methodologies and technologies.
Collaborative spirit and excellent communication skills.
Ability to handle SDLC phases from requirements gathering through implementation.
Passion for design and hands-on coding experience; proactive testing, troubleshooting, and application refinement.
Applicants must be authorized to work in the United States.

Nice To Haves

Ability to evaluate evolving tools in the Hadoop ecosystem and apply them to relevant problems.
Knowledge and experience with cloud and containerization technologies.
Experience with data visualization tools such as Tableau.

Responsibilities

Document assigned portions of business requirements as part of requirements elicitation.
Facilitate software application design discussions and document decisions for the technical team.
Participate in coding and integrate features or updates into existing applications while maintaining system stability.
Conduct code reviews, modify the codebase, and maintain code repositories.
Implement testing strategies, analyze results, and coordinate bug fixes to maintain software quality.
Develop user training programs, documentation, and support frameworks for transitions to new applications.
Help resolve production issues and recommend preventive strategies to improve system reliability.
Maintain records of code, testing techniques, and support activities for the knowledge base and related projects.
Work across end-to-end SDLC phases, translate requirements into development tasks, and collaborate with cross-functional teams on software integration.