Sr. Data Engineer
About The Position
The Sr. Data Engineer contributes to the architecture and evolution of the data platform, building and operating highly available distributed systems for extracting, ingesting, and processing large datasets. The role develops and maintains automated data flows and products, monitors data quality and related infrastructure, and implements API interfaces to improve accessibility. It also delivers secure cloud data solutions aligned with privacy and security controls and supports data and analytics capabilities that meet business requirements and technical standards. The position researches and recommends technical approaches to complex development and integration challenges, applies modern data architectures such as Data Mesh and Data Lakehouse, and enables scalable data engineering solutions across data warehousing, ETL/ELT, BI, master data management, and stream analytics. The role also applies emerging technologies and modern engineering practices, including agile development, CI/CD, and DevOps. Sonata Software is an Equal Opportunity Employer that encourages diversity in the workplace. Qualified applicants receive consideration without regard to legally protected characteristics.
Requirements
- 10+ years of experience.
- Experience building and operating highly available, distributed systems for data extraction, ingestion, and processing of large datasets.
- Working knowledge of modern data architectures and trends, such as Data Mesh and Data Lakehouse.
- Experience with data concepts including SQL, NoSQL, and normalization, and with sophisticated data structures.
- Experience with infrastructure-as-code tools such as CloudFormation and Terraform.
- Experience designing and implementing cloud data solutions using AWS technologies, including EC2, EMR, DMS, Glue, S3, Lake Formation, Redshift, VPC, IAM, CloudWatch, SQS, Lambda, CloudTrail, Systems Manager, KMS, and Kinesis Streams.
- Experience implementing master data management solutions, including platforms such as Reltio or Informatica.
- Proficiency in one or more of SQL, Python, Scala, C#, or Go.
- Solid understanding of scripting languages such as Bash or PowerShell.
- Track record of building scalable data lake solutions connected to distributed data storage through multiple data connectors.
- Background in data engineering, including data warehousing, ETL/ELT, and BI experience.
- Working experience with stream analytics technologies.
- Familiarity with modern engineering practices, including agile development, CI/CD, and DevOps.
- A passion for working with data at scale and getting the most out of it.
Nice To Haves
- Working knowledge of Master Data Management; Reltio is preferred.
Responsibilities
- Build and operate highly available distributed systems for data extraction, ingestion, and processing of large datasets.
- Research, analyze, recommend, and select technical approaches for sophisticated development and integration problems.
- Build and maintain automated methods for orchestrating data flows and products while supervising data quality and related infrastructure status.
- Implement API interfaces to make project components accessible.
- Implement secure cloud data solutions aligned with privacy and security controls.
- Enable and support data and analytics capabilities and technologies, ensuring functional specifications meet business and technical requirements and standards.
- Contribute to the overall data platform architecture and its evolution.
- Serve as an authority on data technologies, envision and integrate emerging technologies, and anticipate trends to solve business and technical problems.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
