Data Engineer IV, Data Feeds

Advisor360 • Needham, MA

1d

About The Position

Will be responsible for creating and maintaining widespread data capabilities and processes across the Advisor360° platform, leveraging modern technology and building scalable and efficient data pipelines, processes, and capabilities. Will also be responsible for updating data integration capabilities across Advisor360°’s extensive data environment, working with both external and internal teams to expand our data integration processes and operational capabilities.

Requirements

• Bachelor’s degree (or an equivalent foreign degree) in Computer Science, Computer Engineering, IT or a closely related field
• 7 years of experience as a data-focused software developer
• 5 years of experience working with leading and completing design and development projects across a variety of data platforms including specifically Oracle, SQL Server and Azure
• 5 years of experience working with SQL and Big Data technologies including Oracle, SQL Server and PySpark (Python API)
• 5 years of experience working with designing, implementing and operating data ingestion routines both in real time and batch using best practices in data modeling
• 5 years of experience working with ETL/ELT processes by leveraging a variety of technologies and big data tools including SQL Server Integration Services (SSIS), Azure Data Lake Storage, Azure Databricks and Azure Data Factory

Responsibilities

• Planning, implementing, deploying and maintaining mid-to large-scale projects from conception to completion
• Developing software solutions by studying information needs, conferring with users, and studying systems flow, data usage, and work stream processes
• Troubleshooting, debugging, and upgrading existing systems
• Providing ongoing maintenance, support, and enhancements to existing systems and platforms
• Documenting technical processes and considerations
• Working with multiple data platforms, integration techniques and design patterns
• Delivering data solutions that are customer focused, easy to consume and create business impact
• Developing a strategic and long-term view on designing advanced data eco systems
• Building efficient and scalable data services and integrating data systems with a variety of platforms and services to support our customers and internal processes
• Leading the deployment of solutions across an array of data platforms in a Continuous Integration/Continuous Deployment (CI/CD) environment
• Developing, building and implementing dependable automated build and deploy processes in our CI/CD environment
• Providing trusted feedback around coding standards, code reviews, source control management, build processes, testing, and operations
• Providing technical leadership and mentor other engineers for the best practices in the data engineering space
• Designing, implementing and operating data ingestion routines both in real time and batch using best practices in data modeling, Extract, Transform and Load/Extract, Load and Transform (ETL/ELT) processes by leveraging a variety of technologies and big data tools including data lakes
• Extending and improving the business’s data pipeline through the collection, storage, processing, and transformation of large datasets with high velocity and variability
• Selecting and utilizing the best data exchange protocol and process for the task at hand

Benefits

• Competitive base salaries
• Annual performance-based bonuses
• Chance to share in the equity value
• Comprehensive health benefits, including dental, life, and disability insurance
• Unlimited paid time off program

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Number of Employees: 251-500 employees