Data Engineer
About The Position
8-10 years of overall experience Strong proficiency in Python. Strong proficiency with Databricks and PySpark Strong proficiency with cloud platforms such as AWS, Azure, or GCP. Experience with data warehousing and data lake technologies. Experience with containerization technologies such as Docker and Kubernetes. Strong proficiency with CI/CD pipelines and DevOps practices. Strong understanding of data structures, algorithms, and software design principles. Understanding of the Software Development Life Cycle, including CI/CD and automation tools Strong experience with modern application development workflows and version control systems like GitHub and GitHub Actions. Ability to lead a technical group in solving problems and moving forward. Strong interpersonal and communication skills Roles & Responsibilities: Available to attend in-person technical and customer evaluation. This is a purely an onsite location role. Remote work is not an option. Flexibility to work with offshore teams which might involve late evening standups is required. Collaborate within and across agile teams to design, develop, validate, deliver, and support technical business solutions. Apply expertise in programming languages and frameworks such as python, pyspark, Databricks, Azure Create, implement and deploy data pipelines including orchestration using GitHub, GitHub Actions and Databricks Bundles and Jobs Ability to upskill and apply new skills rapidly as needed. Use Scrum/Agile methodologies and DevOps principles combined with the latest in internal and external technologies to deliver value to internal customers. Apply expertise in data engineering to make large, distributed data sets accessible and performant. Make recommendations for performance tuning and cost considerations. Encourage innovation, implementation of cutting-edge technologies, inclusion, outside-of-the-box thinking, teamwork, self-organization, and diversity. Escalate concerns to leadership, as needed, and work independently to remove roadblocks for the team. Drive continuous improvement to deliver solutions that are at the forefront of industry leading techniques while also adhering to best practices. #LI-RJ2
Requirements
- 8-10 years of overall experience
- Strong proficiency in Python.
- Strong proficiency with Databricks and PySpark
- Strong proficiency with cloud platforms such as AWS, Azure, or GCP.
- Experience with data warehousing and data lake technologies.
- Experience with containerization technologies such as Docker and Kubernetes.
- Strong proficiency with CI/CD pipelines and DevOps practices.
- Strong understanding of data structures, algorithms, and software design principles.
- Understanding of the Software Development Life Cycle, including CI/CD and automation tools
- Strong experience with modern application development workflows and version control systems like GitHub and GitHub Actions.
- Ability to lead a technical group in solving problems and moving forward.
- Strong interpersonal and communication skills
- Available to attend in-person technical and customer evaluation.
- Flexibility to work with offshore teams which might involve late evening standups is required.
Responsibilities
- Attend in-person technical and customer evaluation.
- Collaborate within and across agile teams to design, develop, validate, deliver, and support technical business solutions.
- Apply expertise in programming languages and frameworks such as python, pyspark, Databricks, Azure
- Create, implement and deploy data pipelines including orchestration using GitHub, GitHub Actions and Databricks Bundles and Jobs
- Upskill and apply new skills rapidly as needed.
- Use Scrum/Agile methodologies and DevOps principles combined with the latest in internal and external technologies to deliver value to internal customers.
- Apply expertise in data engineering to make large, distributed data sets accessible and performant. Make recommendations for performance tuning and cost considerations.
- Encourage innovation, implementation of cutting-edge technologies, inclusion, outside-of-the-box thinking, teamwork, self-organization, and diversity.
- Escalate concerns to leadership, as needed, and work independently to remove roadblocks for the team.
- Drive continuous improvement to deliver solutions that are at the forefront of industry leading techniques while also adhering to best practices.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Industry
Professional, Scientific, and Technical Services
Education Level
No Education Listed
Number of Employees
5,001-10,000 employees
