Data Engineer
About The Position
Redapt Inc. is a pioneering world-class data center infrastructure integrator, technology engineering firm, and cloud services provider. Our teams focus on delivering innovative solutions and services that power our customers' most demanding applications and enable them to extract powerful insights from data that drive true business value. We are looking for an experienced Data Engineer who can design and implement modern architectures for a diverse set of customers and industries. This is a mid-level position and requires a candidate with deep experience in designing and building data solutions using technologies implemented on AWS, Azure, and on-premises. The Data Engineer will own all aspects of solution development. The ideal candidate will have deep experience in Azure Synapse, Azure Data Factory and data processing engines. The position is also responsible for ensuring that the solution is tested and documented to ensure a successful hand-off to clients.
Requirements
- Expert knowledge of Azure, Data Factory, and Synapse Pipelines.
- Expert knowledge of AWS, AWS Glue, Redshift, and Athena pipelines.
- Rest API’s (building/integration, file-based integrations, change data capture, message ques/event-driven integration.
- Ability to troubleshoot and performance tune complex TSQL queries.
- Familiarity with source control, DevOps and CI/CD concepts in an AWS DevOps Azure DevOps or Github environment.
- Ability to create and troubleshoot calculations in DAX and/or MDX.
- Knowledge of open source and NoSQL databases such as PostgreSQL, MySQL, DynamoDB, and Cosmos DB.
- Spark/Pystak, Delta Lake/Lakehouse concepts, Kafka or EventHub’s
- Proficient in distributed computing principles. Familiar with key architectures including lambda and kappa architectures.
- Adept at Transact SQL. Able to create along with understand complex DML queries, views, stored procedures, and functions.
- Strong understanding of scripting/programming languages including one of the following.
- R, Python, Scala, C# or PowerShell
- Hands-on experience deploying, configuring common Azure data services along with basic familiarity of Azure portal and ARM templates.
- Bachelor’s degree in Computer Science, Electronics, Information Systems (related field) or equivalent experience.
- 5-8+ years of experience with master data management, data quality and data governance concepts.
- Experience in designing and building reports on SQL Server Reporting Services or Power BI using visualization best practices.
- Experience with other cloud providers and data services such as AWS and GCP.
- Experience in ingesting and performing advance analytics on data from multiple sources, including batch analytics, interactive analytics, real-time/streaming analytics.
- Experience designing dimensional models using Kimball methodology and proficiency with data modeling tools.
- Experience in designing and building robust ETL pipelines in one or more of the following technologies and tools: SSIS, ADF, Azure Databricks and Snowflake.
Responsibilities
- Interfacing directly with clients to solve broad business goals with database solutions.
- You will be responsible for gathering requirements, designing solutions, along with overseeing the development and execution of projects.
- This role will be directly involved in the business development process; specifically delivering customer demos to show how data can drive business goals.
- Be able to build pilot solutions and proof of concept with minimal direction.
- Provide support to project manager through developing tasks, estimates, and dependencies to meet expectations.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Number of Employees
101-250 employees
