Hadoop and PySpark Data Engineer

Infosys•Charlotte, NC

About The Position

The Hadoop and PySpark Data Engineer works as a Technology Consultant 2 within Infosys Data and Analytics (DNA), a unit focused on turning data into actionable insights and developing AI and analytics solutions. The role contributes across the software development lifecycle, from requirements elicitation and design discussions through implementation, testing, release support, and documentation. It involves working with Hadoop and other big data technologies in production environments, supporting data warehousing solutions, and collaborating with cross-functional teams to deliver and maintain applications. The position may require relocation and/or travel to the work or project location. Applicants authorized to work in the United States are encouraged to apply. A bachelor's degree or foreign equivalent from an accredited institution is required; three years of progressive specialty experience may be considered in lieu of each year of education. Infosys describes its work environment as dynamic and supportive, with opportunities to use advanced technologies, collaborate with industry experts, and pursue continuous learning and growth.

Requirements

  • Experience with data warehousing architectural approaches.
  • Sound understanding of and experience with the Hadoop ecosystem, including Cloudera.
  • Experience with a big data implementation in a production environment.
  • Experience with big data technologies such as Hadoop, Hive, Spark, and Python.
  • Experience with Python and Unix shell scripting.
  • Experience with an orchestration tool such as Autosys or Airflow.
  • Sound knowledge of relational databases (SQL) and experience with large SQL-based systems.
  • Understanding of Agile methodologies and technologies.
  • Bachelor's degree or foreign equivalent from an accredited institution, or three years of progressive experience in the specialty in lieu of each year of education.
  • Applicants must be authorized to work in the United States.

Nice To Haves

  • Ability to understand and explore evolving tools in the Hadoop ecosystem and apply them to relevant problems.
  • Knowledge of and experience with cloud and containerization technologies.

Responsibilities

  • Contribute to requirements elicitation by documenting assigned portions of business requirements under guidance.
  • Facilitate software application design discussions and document decisions for the technical team.
  • Participate in coding and integrate features or updates into existing applications while maintaining system stability.
  • Conduct code reviews, make codebase changes, and maintain code repositories.
  • Implement test strategies, analyze results, and coordinate bug fixes to uphold software quality standards.
  • Develop user training programs, documentation, and support frameworks for transitions to new software applications.
  • Help resolve production issues and recommend preventive strategies to improve system reliability.
  • Maintain records of code, testing techniques, and support activities for the knowledge base and similar projects.
  • Handle software development lifecycle phases from requirements gathering through implementation.
  • Translate complex requirements into actionable development tasks and collaborate with cross-functional teams on software integration.

Benefits

  • Medical, dental, vision, and life insurance.
  • Long-term and short-term disability coverage.
  • Health and dependent care reimbursement accounts.
  • Accident, critical illness, hospital indemnity, and legal insurance.
  • 401(k) plan and contributions dependent on salary level.
  • Paid holidays and paid time off.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service