Senior Data Engineer
Pinnacle Reliability India•Pasadena, TX
•Onsite
About The Position
As a Senior Data Engineer, you will play a critical role in developing a data platform that allows our Data Scientist and Software Engineers to get from concept to production with less friction. You will be responsible for the end to end process of designing, developing, testing, and deploying data integration workflows. The Senior Data Engineer will also be responsible for guiding and mentoring new members of the data engineering team and developing cloud-native solutions with low time to market by leveraging Agile, DevOps methodologies.
Requirements
- 6+ years of software/data engineering experience
- 5+ years of experience with dimensional data modeling & schema design in data warehouses or PaaS that replaces the need for a DW
- 3+ years of data pipeline/processing experience
- Experience working with Azure Cloud tools and architecture
- Candidates must have direct work experience developing and deploying at least one project where they implemented the full cloud data pipeline documented on their resume
Nice To Haves
- Experience with Docker contains, including containerizing services and deploy in a cloud environment
- Experience using scripting languages, such as bash or PowerShell
- Experience with Cognite Data Fusion is a plus
- Basic understanding of ins and outs of data science algorithms
Responsibilities
- Integrate with 3rd party data integration platforms
- Partner with the DevOps team to build the optimal solutions for extract, transform, and load between SQL DB’s, data API’s, and a yet to be determined solution for dynamic reporting
- Empower data scientists and software developers to develop their own ETL pipelines while serving as gatekeeper for ETL that goes to production
- Find hidden patterns using data
- Discover tasks that can be automated
- Articulate and document designs as needed
- Provide estimates and status for development tasks
- Work effectively in a highly collaborative and iterative development process
- Work effectively with Product, QA, and DevOps teams
- Troubleshoot issues and correct defects when required
- Designing, Developing, & Maintaining Data Stores & Pipelines: Designing and implementing high quality data engineering solutions meeting the needs of the data scientists and ultimately our end users
- Driving Technology Innovation: Spur innovation that allows data scientists to move from prototype running on the laptop to production-hardened and scalable product in less time
- Planning Software Releases: Participating in sprint and release planning, including defining tasks and providing estimates
Benefits
- Health, vision, and dental insurance
- Life insurance
- 401(k) matching
- Paid time off (PTO)
- Nine paid holidays
- 8 hours of volunteer paid time off (VPTO)
- Maternity and parental leave
- Onsite gym with full amenities
- Walking workstations
- Free parking
- Mini mart/snack machines
- Gourmet coffee machines
- Multiple indoor and outdoor collaboration areas
- Huddle rooms
- Deep workspaces
- Lactation facilities
- Quarterly town hall and fellowships
- Length of service awards where employees receive additional paid time off and bonuses to cover travel expenses for anniversary milestone trips (5, 10, and 15 years)
- Opportunity to participate in customer-focused project management groups (PODs) that help facilitate collaboration and project support
- Access to company technology stack of Microsoft Office 365 Suite and MS Teams
- Comprehensive onboarding
- On-demand training
- Regular lunch and learns
- Supervisor and accountability training
- Leadership development programs
- Continuous learning opportunities
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
