Sr. Data Engineer
About The Position
Allworth Financial is seeking a Senior Data Engineer to join their Analytics & Insights team. This role will focus on optimizing the company's data infrastructure to support robust data analytics and reporting. The position involves guiding the evolution of the data platform, modernizing legacy SQL-based processes into scalable cloud data pipelines, identifying architectural gaps, improving engineering standards, and maturing data governance practices. The ideal candidate will have broad hands-on experience in data engineering, cloud data platforms, ETL/ELT design, data modeling, orchestration, performance tuning, data quality, and governance. This individual will be responsible for building production-quality pipelines, reviewing existing architecture, mentoring team members, and identifying risks, patterns, and opportunities. The role is crucial in transitioning from legacy stored procedures and fragmented reporting processes to a more reliable, transparent, and well-governed modern data architecture. This is a full-time Exempt position with a hybrid work schedule in the Addison office.
Requirements
- 5+ years of professional experience in data engineering, analytics engineering, data architecture, or a closely related role.
- Strong SQL skills, including stored procedures, joins, window functions, CTEs, merge logic, and performance tuning.
- Hands-on experience with PySpark or distributed data processing frameworks.
- Experience designing and maintaining ETL/ELT pipelines in a cloud environment.
- Experience with data lake or lakehouse architecture, including Delta Lake or similar table formats.
- Strong understanding of data modeling concepts, including dimensional modeling, staging layers, curated layers, and semantic/reporting models.
- Experience with pipeline orchestration, scheduling, dependency management, and failure recovery.
- Ability to troubleshoot data quality issues, pipeline failures, schema drift, performance bottlenecks, and source system inconsistencies.
- Familiarity with modern data governance concepts, including cataloging, lineage, ownership, access control, data definitions, and data quality monitoring.
- Ability to communicate clearly with both technical and non-technical stakeholders.
- Experience reviewing existing systems and recommending practical, incremental improvements.
- Experience with Azure Synapse Analytics, Azure Data Lake Storage, Microsoft Fabric, Azure Data Factory, or related Azure data services.
Responsibilities
- Design, build, and optimize data pipelines using PySpark, Delta Lake, SQL, and cloud-based data engineering tools.
- Improve data pipeline reliability, observability, logging, error handling, and restartability.
- Review existing notebooks, SQL scripts, data models, and orchestration workflows for maintainability and performance.
- Guide best practices for Azure Synapse, Spark, Delta Lake, data lake storage, and related cloud data services.
- Identify architectural gaps, technical debt, and modernization risks.
- Help design and implement data quality checks, reconciliation processes, and validation frameworks.
- Support development of canonical IDs, master data patterns, and entity resolution processes.
- Assist with data cataloging, lineage, metadata management, and governance practices.
- Partner with business stakeholders to understand reporting, analytics, and data product requirements.
- Help structure scalable data models for BI tools such as ThoughtSpot, Power BI, or similar platforms.
- Mentor data team members and help raise the overall engineering maturity of the team.
- Provide guidance on areas such as security, performance, cost, governance, orchestration, testing, and long-term maintainability.
Benefits
- Medical: Blue Shield (PPOs and HDHP with HSA) plans and Kaiser (HMO) plans for California associates
- Dental insurance with MetLife
- Vision insurance with VSP
- Optional supplemental benefits
- Healthcare savings accounts with company contribution
- Flexible spending accounts
- Flexible working arrangements
- Generous 401K contributions
- Flexible paid time off policy for Exempt associates
- 15 days of paid time off annually during the first three years of employment for Non-Exempt associates
- 11 Paid Holidays
- Option to participate in our Equity Purchase Program (Contract, intern, and part-time employees are not eligible)
- Future growth opportunities within the company
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
