IT - Data Engineer

ADEX Corporation • Dallas, TX

437d

About The Position

The Data Engineer position at Frontier Communications involves designing and delivering data solutions for the Advanced Analytics team within the Wholesale organization. The role focuses on building modern data infrastructure to support data science workflows, utilizing various data types to enhance predictive modeling and sales strategies for the consumer base.

Requirements

• 2+ years of experience as a Data Engineer in a similar role
• Experience with data modeling, warehousing and building pipelines
• Proven experience in designing and implementing comprehensive data pipelines for a variety of flows (data integration across systems, ETL processes, machine learning infrastructures)
• Proficient in SQL and Python
• Experience in Databricks ETL

Nice To Haves

• Experience with the AWS ecosystem (e.g. GLUE, Athena, S3, Lambda, IAM, SageMaker, CloudWatch, API Gateway)
• Familiarity with Delta Lake, PySpark, Apache Spark, Airflow, APIs (REST, SOAP, RPC), streaming event data
• Understanding of system architecture and experience with large distributed systems (familiarity with the Apache Spark ecosystem)
• Prior experience working with Teradata SQL, MS SQL, and IBM DB2 or similar dialects
• Prior experience in continuous integration and continuous deployment of large scalable data systems
• Prior experience working with and supporting a data science team
• Familiarity with working on data involving telecoms, mobile providers, ISPs or cable companies

Responsibilities

• Develop and implement ETL pipelines to efficiently transfer data from SQL Server to Databricks, ensuring accuracy, scalability, and optimal performance.
• Validate and transform data within Databricks, including testing for data integrity, consistency, and quality across ingestion and processing stages.
• Collaborate with cross-functional teams to design, build, and optimize curated tables in Databricks for analytics and reporting purposes.
• Monitor and troubleshoot data workflows, addressing any issues related to performance, reliability, or data anomalies.
• Document data engineering processes and provide technical support for ongoing maintenance and enhancements to the Databricks environment.

What This Job Offers

• Job Type: Full-time
• Industry: Administrative and Support Services
• Education Level: No Education Listed