Data Engineer

Cortex • Irving, TX

21d

About The Position

Duties and Responsibilities: Partner with end users to learn the business, understand requirements and design complete solutions that meet user expectations. Design, Develop and Test data pipelines and advanced analytics solutions using Azure Databricks and other relevant tools. Assume responsibility and takes initiative to achieve desired results. Design and implement technical solutions based on business requirements. Develop complex stored procedures and SQL queries. Support production reporting and SSIS applications. Analyze and improve SQL performance. Collaborate with the data engineering team and foster a culture of continuous learning and improvement. Stay current with industry trends and advancements in Databricks and cloud technologies.

Requirements

• Bachelor’s degree in Computer Science or a related field.
• 8+ years of experience as a Data Engineer designing and developing data pipelines using SSIS/Azure Data Factory.
• 3+ years of experience developing data pipelines with Databricks.
• Solid understanding and hands-on experience with Delta Lake, and Azure Data Lake Storage Gen2, Databricks Dashboards and Genie.
• Strong understanding and hands-on experience with Medallion Architecture, Unity Catalog, Delta Live Tables, Workflows and Databricks SQL.
• Strong T-SQL and performance tuning skills.
• 3+ years of experience working with Azure Cloud Services including Azure DevOps pipelines.
• Excellent written and verbal communication skills.
• Desire to learn modern technologies and tools to expand existing skill sets.

Nice To Haves

• Databricks Certification
• Python
• Power BI
• 3+ years working in an Agile environment.
• History of working with financial data and loan processing.
• Azure Data Factory
• Database Administration
• Jira and Azure DevOps management tools

Responsibilities

• Partner with end users to learn the business, understand requirements and design complete solutions that meet user expectations.
• Design, Develop and Test data pipelines and advanced analytics solutions using Azure Databricks and other relevant tools.
• Assume responsibility and takes initiative to achieve desired results.
• Design and implement technical solutions based on business requirements.
• Develop complex stored procedures and SQL queries.
• Support production reporting and SSIS applications.
• Analyze and improve SQL performance.
• Collaborate with the data engineering team and foster a culture of continuous learning and improvement.
• Stay current with industry trends and advancements in Databricks and cloud technologies.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level