Data Engineer

Perficientcorp • Fort Worth, TX

5d • Hybrid

About The Position

We are seeking a Sr. Data Engineer to join our team in Fort Worth, TX. This role requires a minimum of 5-7 years of experience in software solution development using agile and DevOps methodologies, operating within a product model that includes designing, developing, and implementing large-scale applications or data engineering solutions. The ideal candidate will also have 5-7 years of data analytics experience using SQL and 5-7 years of cloud development and data lake experience, with a preference for Microsoft Azure. This includes experience with Azure EventHub, Azure Data Factory, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps, and Power BI. A combination of Development, Administration, and Support experience in several of the following tools/platforms is required: Scripting (Python, Spark, Unix, SQL), Data Platforms (Teradata, Cassandra, MongoDB, Oracle, SQL Server, ADLS, Snowflake, Azure Data Explorer), Azure Cloud Technologies (Azure Data Factory, Azure Databricks, Azure Blob Storage, Azure Data Lake, Azure Power Apps, Azure Functions), CI/CD (GitHub, Jenkins, Azure DevOps, Terraform), BI Analytics Tool Stack (Cognos, Tableau, Power BI, Alteryx, Denodo, Grafana), Data Warehousing concepts, Data Governance and Privacy (Informatica Axon and EDC, BigID), and Orchestration (Azure Data Factory, Tivoli). Administration skills are a plus.

Requirements

• 5-7 years software solution development using agile, DevOps, operating in a product model that includes designing, developing, and implementing large-scale applications or data engineering solutions.
• 5-7 years data analytics experience using SQL.
• 5-7 years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub, Azure Data Factory, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI.
• Combination of Development, Administration & Support experience in several of the following tools/platforms required: Scripting: Python, Spark, Unix, SQL; Data Platforms: Teradata, Cassandra, MongoDB, Oracle, SQL Server, ADLS, Snowflake, Azure Data Explorer; Azure Cloud Technologies: Azure Data Factory, Azure Databricks, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Azure Functions; CI/CD: GitHub, Jenkins, Azure DevOps, Terraform; BI Analytics Tool Stack - Cognos, Tableau, Power BI, Alteryx, Denodo, and Grafana; Clear understanding on Data Warehousing concept; Data Governance and Privacy: Informatica Axon and EDC, BigID; Orchestration: Azure Data Factory, Tivoli.

Nice To Haves

• Administration skills a plus.
• Azure Development Track Certification (preferred).
• Spark Certification (preferred).
• Expertise with the Azure Technology stack for data management, data ingestion, capture, processing and curation.
• Expertise in providing practical direction within the Azure Native cloud services.
• 5-7 years software solution development using agile, dev ops, product model that includes designing, developing, and implementing large-scale applications or data engineering solutions.
• 5-7 years data analytics experience using SQL.
• 5-7 years of cloud development and data lake experience (prefer Microsoft Azure) including Azure Data Factory, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI.
• Azure (Data Factory, Azure Functions, ADX, Event Hub, ASA) experience.

Responsibilities

• Designing, developing, and implementing large-scale applications or data engineering solutions.
• Performing data analytics using SQL.
• Developing and managing cloud-based data lakes, preferably on Microsoft Azure.
• Utilizing Azure services such as Azure EventHub, Azure Data Factory, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps, and Power BI.
• Working with scripting languages like Python, Spark, Unix, and SQL.
• Managing and supporting various data platforms including Teradata, Cassandra, MongoDB, Oracle, SQL Server, ADLS, Snowflake, and Azure Data Explorer.
• Implementing and managing Azure Cloud Technologies.
• Utilizing CI/CD tools such as GitHub, Jenkins, Azure DevOps, and Terraform.
• Working with BI Analytics tools like Cognos, Tableau, Power BI, Alteryx, Denodo, and Grafana.
• Applying knowledge of Data Warehousing concepts.
• Implementing Data Governance and Privacy solutions using tools like Informatica Axon and EDC, and BigID.
• Utilizing orchestration tools such as Azure Data Factory and Tivoli.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed