Databricks Data Engineer
About The Position
CGI is looking for a talented, driven, and experienced Databricks Data Engineer with a passion for solving business problems to join our team in Salt Lake City, UT! This position is located at our client site in Salt Lake City, UT. Do you want to take your career to the next level? Are you ready for the responsibility of working with high-profile clients? At CGI, you will solve challenging business and technical problems as a full-time consultant serving local, enterprise clients. You'll be part of a team of smart, dedicated people like yourself and make an impact with both internal and client stakeholders. You also can work on cutting edge technologies and cloud native development. Tired of the same old thing? Take your talents to a world class consulting firm that inspires personal and professional growth and values your ideas.
Requirements
- 5+ years of development experience with Spark (PySpark), Python and SQL
- Extensive knowledge building data pipelines
- Hands-on experience with Databricks Development
- Strong experience developing on Linux OS.
- Experience with scheduling and orchestration (e.g. Databricks Workflows, airflow, prefect, control-m)
- Solid understanding of distributed systems, data structures, design principles
- Comfortable communicating with teams via showcases/demos
- Agile Development Methodologies (e.g. SAFe, Kanban, Scrum)
Nice To Haves
- 3+ years' experience with GIT
- 3+ years' experience with CI/CD (e.g. Azure Pipelines)
- Experience with streaming technologies, such as Kafka, Spark
- Experience building applications on Docker and Kubernetes
- Cloud experience (e.g. Azure, Google)
Responsibilities
- Play key role in establishing and implementing migration patterns for the Data Lake Modernization project
- Actively migrate use cases from our on-premises Data Lake to Databricks on GCP
- Collaborate with Product Management and business partners to understand case requirements and reporting
- Adhere to internal development best practices/lifecycle (e.g. Testing, Code Reviews, CI/CD, Documentation)
- Document and showcase feature designs/workflows
- Participate in team meetings and discussions around product development
- Stay up to date on industry latest industry trends and design patterns
Benefits
- Competitive compensation
- Comprehensive insurance options
- Matching contributions through the 401(k) plan and the share purchase plan
- Paid time off for vacation, holidays, and sick time
- Paid parental leave
- Learning opportunities and tuition assistance
- Wellness and Well-being programs
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Number of Employees
5,001-10,000 employees
