Azure Databricks Engineer
About The Position
In the assigned job role of Technology Consultant 2, the Azure Databricks Engineer contributes to requirements elicitation, facilitates software application design discussions, and documents decisions that guide technical teams. The role participates in coding and integrating features, maintaining code repositories, conducting code reviews, implementing test strategies, coordinating bug fixes, and supporting production issue resolution. It also develops user training, documentation, and support frameworks, and maintains records of code, testing, and support activities. The role is part of Infosys Data and Analytics (DNA), a unit focused on turning data into actionable insights through AI and analytics. The engineer designs and implements data solutions using Microsoft Azure, Azure Databricks, and Azure Data Factory, and delivers complex data engineering solutions. The position involves collaboration with cross-functional teams and may require relocation and/or travel to the work or project location.
Requirements
- Experience architecting and implementing data solutions using Microsoft Azure, Azure Databricks, and Azure Data Factory (ADF).
- Proficiency in Apache Spark, Kafka, SQL, and Python.
- Hands-on experience implementing data warehouses and data marts end to end.
- Understanding of data warehousing concepts, including Data Vault, dimensional modeling, and OLAP design.
- Experience designing and implementing scalable solutions for distributed data systems.
- Hands-on experience with CI/CD pipelines and platforms such as GitHub Actions and Azure Pipelines.
- Experience leading technical teams and mentoring data engineers.
- Problem-solving skills and the ability to design and deliver complex data engineering solutions.
- Ability to handle SDLC phases from requirements gathering through implementation.
- Ability to translate complex requirements into actionable development tasks.
- Passion for design and hands-on coding experience.
- Collaborative spirit and excellent communication skills.
- Ability to work with cross-functional teams and perform software integration.
- Bachelor’s degree or foreign equivalent from an accredited institution, or three years of progressive experience in the specialty in lieu of each year of education.
- Must be authorized to work in the United States for any employer without employer-based visa sponsorship; Infosys cannot provide immigration sponsorship now or in the future.
Nice To Haves
- Understanding of retail data domains and associated use cases.
- Familiarity with vector search and semantic retrieval, preferably for retail use cases.
- Experience with relational modeling, dimensional modeling, and modeling unstructured data.
- Familiarity with logging, monitoring, and observability solutions.
- Experience with development containers, unit testing, code-quality reviews, and linting.
- Understanding of Agile software development methodologies.
- Ability to work effectively in a diverse, multi-stakeholder environment across business and technology teams.
- Experience working in a global delivery environment.
- Experience implementing automation in data engineering or development processes.
- Exposure to Generative AI frameworks and technologies such as OpenAI, Hugging Face, and LangChain.
Responsibilities
- Contribute to requirements elicitation by documenting assigned parts of business requirements.
- Facilitate software application design discussions and document design decisions.
- Participate in coding and integrate features or updates into existing applications while maintaining system stability.
- Conduct code reviews, make changes to the codebase, and maintain code repositories.
- Implement test strategies, analyze results, and coordinate bug fixes to uphold software quality standards.
- Develop user training programs, documentation, and support frameworks for new software applications.
- Help resolve production issues and recommend preventive strategies to enhance system reliability.
- Maintain detailed records of code, testing techniques, and support activities.
- Design and implement data solutions using Microsoft Azure, Azure Databricks, and Azure Data Factory.
- Lead technical teams and mentor data engineers.
Benefits
- Medical, dental, vision, and life insurance
- Long-term and short-term disability coverage
- Health and dependent care reimbursement accounts
- Accident, critical illness, hospital indemnity, and legal insurance
- 401(k) plan and contributions dependent on salary level
- Paid holidays and paid time off
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
