Hadoop and PySpark Data Engineer

Infosys•Jackson Township, NJ

About The Position

The Hadoop and PySpark Data Engineer is hired into the assigned job role of Technology Consultant 2 within Infosys’s Data and Analytics unit. The role contributes to software development and data-oriented projects through requirements documentation, design discussions, coding, integration, testing, production support, and technical documentation. The position involves working with Hadoop ecosystem technologies, including Cloudera, and supporting Big Data implementations in production environments. The role also requires handling software development lifecycle phases from requirements gathering through implementation, translating complex requirements into development tasks, and collaborating with cross-functional teams on software integration. It may require relocation and/or travel to the work or project location. A bachelor’s degree or foreign equivalent is required, although three years of progressive experience in the specialty may be considered in lieu of each year of education.

Requirements

  • Experience in data warehousing architectural approaches.
  • Sound understanding of and experience with the Hadoop ecosystem, including Cloudera.
  • Experience with a Big Data implementation in a production environment.
  • Experience with Big Data technologies such as Hadoop, Hive, Spark, and Python.
  • Experience with Python and Unix shell scripting.
  • Experience with an orchestration tool such as Autosys or Airflow.
  • Sound knowledge of relational databases (SQL) and experience with large SQL-based systems.
  • Understanding of Agile methodologies and technologies.
  • Bachelor’s degree or foreign equivalent from an accredited institution; three years of progressive specialty experience may be considered in lieu of each year of education.
  • Applicants must be authorized to work in the United States.

Nice To Haves

  • Ability to understand and explore evolving tools in the Hadoop ecosystem and apply them appropriately to relevant problems.
  • Knowledge and experience with cloud and containerization technologies.

Responsibilities

  • Document assigned parts of business requirements as part of requirements elicitation, following provided guidance.
  • Facilitate software application design discussions and document design decisions to guide the technical team.
  • Participate in coding and integrate new features or updates into existing applications while maintaining system stability.
  • Conduct code reviews, make changes to the codebase, and maintain code repositories.
  • Implement test strategies, analyze results, and coordinate bug fixes to uphold software quality standards.
  • Develop user training programs, documentation, and support frameworks to support transitions to new software applications.
  • Help resolve production issues and recommend preventive strategies to improve system reliability.
  • Maintain records of code, testing techniques, and support activities for the knowledge base and similar projects.
  • Contribute to end-to-end SDLC phases, from requirements gathering through implementation.
  • Work with cross-functional teams and participate in software integration.

Benefits

  • Medical, dental, vision, and life insurance.
  • Long-term and short-term disability coverage.
  • Health and dependent care reimbursement accounts.
  • Accident, critical illness, hospital indemnity, and legal insurance.
  • 401(k) plan and contributions dependent on salary level.
  • Paid holidays and paid time off.
  • Competitive pay.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service