Senior Data Engineer

SunnyData

1d

About The Position

At SunnyData, our mission is to help customers build a highly scalable architecture, robust data engineering pipelines, easy data consumption layers and more importantly build ML and AI applications to power their business and drive outstanding business outcomes. As a Senior Data Engineer, you will play a critical role during this customer journey. You will directly work with internal teams and customers to design, build and deploy data solutions that capture, explore, transform, and utilize data to support Artificial Intelligence, Machine Learning and business intelligence / insights.
The Impact You Will Have
You will be part of a team responsible for supporting new and existing customers in their data engineering needs.
You will guide customers to make the best technical decisions to achieve their goals
You will actively work across multiple customer accounts which you would need to track and report on their progress.
You will design, build, and operationalize complex data solutions, correct problems, apply transformations, and recommend data cleansing /quality solutions.
You will analyze sources to determine value and recommend data to include in analytical processes.
You will incorporate core data management competencies including data governance, data security and data quality.
You will collaborate within and across teams to support delivery and educate end users on data products / analytic environments.
You will perform data and system analysis, assessment and resolution for defects and incidents of moderate complexity and correct as appropriate.
You will test data movement, transformation code, and data components.

Requirements

• 5+ years of related experience in data engineering and data product development.
• Experience in one or more of the following: Data Engineering technologies (e.g., Spark, Hadoop, Kafka), Databricks platform, Data Science and Machine Learning technologies (e.g., pandas, scikit-learn, HPO), Data Warehousing (e.g., SQL, OLTP/OLAP/DSS).
• Solid understanding of the end to end data analytics workflow.
• Demonstrated track record of domain expertise including the ability to understand technical concepts and possess in-depth knowledge of immediate systems worked on.
• Proven problem solving skills including debugging skills.
• Strong verbal and written communication skills.
• Intermediate leadership skills with a proven track record of self-motivation in identifying personal growth opportunities.
• Excellent time management and prioritization skills.

Nice To Haves

• Databricks platform - data engineering and/or ML ops experience would be a huge bonus.
• Knowledge of public cloud platforms AWS, Azure or GCP would be a plus.
• Databricks Certification.

Responsibilities

• Support new and existing customers in their data engineering needs.
• Guide customers to make the best technical decisions to achieve their goals.
• Actively work across multiple customer accounts, tracking and reporting on their progress.
• Design, build, and operationalize complex data solutions, correct problems, apply transformations, and recommend data cleansing/quality solutions.
• Analyze sources to determine value and recommend data to include in analytical processes.
• Incorporate core data management competencies including data governance, data security, and data quality.
• Collaborate within and across teams to support delivery and educate end users on data products/analytic environments.
• Perform data and system analysis, assessment, and resolution for defects and incidents of moderate complexity and correct as appropriate.
• Test data movement, transformation code, and data components.

Benefits

• Health Insurance: Employees and their eligible family members including spouses, domestic partners, and children are eligible for coverage from the first day of employment.
• Paid Time Off: Start your career at SunnyData with a minimum of 15 days Paid Time Off annually, plus nine paid company Holidays.
• An opportunity to grow your technical and people skills, lead teams on complex customer projects that are highly innovative and cutting edge.
• Great opportunity to grow in your career with the right level of focus, innovation and customer centricity with a high growth consulting company dedicated to Databricks.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior