Data Engineer - Senior Databricks Engineer
About The Position
Capgemini is looking to hire a Databricks Engineer to join our team in Seattle. Some of the responsibilitiesas below: Your role Responsibilities and essential job functions include but are not limited to the following Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch,distributed) & real-time, highly available data, data pipeline, and technology capabilities Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines Provide consultation and lead the implementation of complex programs Develop and maintain documentation relating to all assigned systems and projects Tune queries running over billions of rows of data running in a distributed query engine Perform root cause analysis to identify permanent resolutions to software or business process issues
Requirements
- Bachelor’s degree in computer science, management information systems, or related discipline, orequivalent work experience
- Strong/expert Spark (PySpark) DataBricks
- Hands-on data pipeline development, ingest patterns in Azure
- Orchestration tools, ADF or Airflow
- SQL,Python, Pyspark
- Denormalized Data modeling for big data systems
Responsibilities
- Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch,distributed) & real-time, highly available data, data pipeline, and technology capabilities
- Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines
- Provide consultation and lead the implementation of complex programs
- Develop and maintain documentation relating to all assigned systems and projects
- Tune queries running over billions of rows of data running in a distributed query engine
- Perform root cause analysis to identify permanent resolutions to software or business process issues
Benefits
- Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave
- Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
- Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
- Life and disability insurance
- Employee assistance programs
- Other benefits as provided by local policy and eligibility
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
