Senior Data Engineer III

arrivia. Go far in the travel industry.-posted 6 days ago
Full-time • Mid Level
Scottsdale, AZ
1,001-5,000 employees
Resume
Match Score
Upload and Match ResumeTrack Jobs with Teal

At arrivia , we’re transforming the travel experience for millions of members worldwide through our high-performance, scalable, and personalized platform. We are seeking a motivated experienced Senior Data Engineer III to join our team. In this role, you'll work primarily with Microsoft SQL Server, SSIS, mySQL and Azure to manage, transform large volumes of data. You will be responsible for importing, polling, and aggregating data from various sources, creating summarized datasets that support both business intelligence and e-commerce site search functionality. You will also lead the adoption of AI and machine learning to unlock new insights and efficiencies. We are unable to provide sponsorship for this role.

  • Design, develop, and maintain data pipelines to import, clean, and transform data from multiple structured and semi-structured sources, including JSON, XML, and CSV files.
  • Aggregate and create optimized datasets to support business intelligence reporting, analytics, and e-commerce site search functionality.
  • Collaborate with cross-functional teams to improve data models and processes, ensuring scalability, reliability, and efficiency.
  • Monitor and troubleshoot data pipelines, proactively addressing performance bottlenecks, data quality issues, and system inconsistencies.
  • Drive the adoption of AI-assisted tools (e.g., GitHub Copilot, ChatGPT, Azure OpenAI) to enhance productivity, code quality, and innovation across the team.
  • Troubleshoot and resolve data-related issues, including root cause analysis, to ensure the reliability and performance of data systems.
  • Implement best practices for query optimization, leveraging execution plans and advanced SQL techniques, such as window functions, to ensure efficient data handling.
  • Lead the evaluation and integration of cloud and distributed data technologies such as Azure, Databricks, and Spark.
  • Contribute to enhancing data accuracy and integrity across systems by identifying and resolving data discrepancies, duplicates, and inconsistencies.
  • Participate in the continuous improvement of the data infrastructure, including supporting batch data processing workflows and ETL/ELT processes.
  • Bachelor’s degree in Computer Science, Information Technology, or a related field, or equivalent relevant experience in data engineering or related disciplines.
  • 6 years plus of hands-on experience in data engineering, data management, or similar roles, with demonstrated expertise in working with large datasets and data pipelines.
  • Proficient in SQL and relational database concepts, with a solid understanding of advanced ETL/ELT processes and data transformation.
  • Experienced in working with structured and semi-structured data formats, including JSON, XML, CSV, and TXT, as well as managing data pipelines using SSIS (SQL Server Integration Services) or equivalent tools.
  • Experience with C# programming.
  • Experience with DTS packages, Azure services, Redis cache and message queues
  • Strong knowledge of batch data processing and executing batch transactions for DML operations in production environments.
  • Skilled in query optimization, with experience interpreting and leveraging execution plans to improve database performance.
  • Expertise in advanced SQL techniques, including window functions, CTEs, and performance tuning for analytical and operational use cases.
  • Passionate about driving adoption of AI and machine learning to improve automation, efficiency, and insight generation.
  • Proven ability to identify and resolve data quality issues, including troubleshooting, de-duplication, and consistency checks across multiple systems.
  • Comfortable working independently to solve complex data engineering challenges while collaborating effectively within cross-functional teams.
  • Experience thriving in a high-paced Agile development environment" to emphasize working in a dynamic setting while balancing priorities and delivering results.
  • Proactive learner with a passion for leveraging modern data engineering tools and techniques to drive continuous improvement.
  • Certifications in Microsoft SQL Server or related technologies are a strong plus.
  • Any Python experience is preferred and may be used for scripting or data processing tasks.
  • Hands-on experience or familiarity with Azure Data Factory, Databricks, or Spark is preferred.
  • Exclusive Employee Travel Rates on Cruises, Resorts & Hotels, Tours, Car Rentals
  • Medical Health Insurance
  • Dental & Vision Coverage
  • 401K Plan
  • Long Term Disability & Life Insurance
  • Pet Care Insurance
  • Legal Insurance
  • Flexible Spending Accounts (FSA)
  • Employee Assistance Program
  • Dedicated Employee Enrichment & Recognition Programs
  • Special local, dining and merchandise offerings
Track Jobs with Teal

Job Search Resources

•
AI Resume Builder
•
Senior Data Engineer Resume Examples
•
Senior Data Engineer Cover Letter Examples

Tools

Career Hubs

Guides

Company

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service