Data Engineering Lead - Hybrid (Open)

Aegon-posted 3 months ago
$130,000 - $160,000/Yr
Full-time • Mid Level
Hybrid • Philadelphia, PA
Performing Arts, Spectator Sports, and Related Industries
Resume
Match Score
Upload and Match ResumeTrack Jobs with Teal

The Data Engineering Technical Delivery Lead role needs a combination of technical hands-on skills and oversight experience to be able to influence the outcome of the strategic suppliers (vendors) responsible for delivery of various projects. The role is focused on the design and development of modern architectures to enable data-driven digital business across the enterprise. Helps define data strategies, grow capabilities, and develop the enterprise data platform by providing technology leadership, insight on new developments within the data engineering space, and guidance in architectural and design decisions.

  • Work collaboratively with other engineers, data scientists, analytics teams, scrum masters and business product owners in an agile environment.
  • Architect, build and support the operation of Cloud and On-Premises enterprise data infrastructure and tools.
  • Design robust, reusable and scalable data driven solutions and data pipeline frameworks to automate the ingestion, processing and delivery of both structured and unstructured batch and real-time streaming data.
  • Lead the development of data APIs and data delivery services to support critical operational processes, analytical models and machine learning applications.
  • Lead the selection and integration of data related tools, frameworks and applications required to expand our platform capabilities.
  • Understand and implement best practices in management of enterprise data, including master data, reference data, metadata, data quality and lineage.
  • Participate in an Agile implementation and maintenance of source control and release procedures.
  • Be an effective communicator while interacting with technical and non-technical audiences.
  • Communicate with business stakeholders to understand goals and translate them to technical solution architecture and requirements.
  • Have an iterative, collaborative and transparent approach to building technical solutions and data products.
  • Lead and mentor other data engineers to follow best engineering practices.
  • Produce technical solutions that satisfy business requirements with a focus on scalability, stability, efficiency, maintainability and extensibility.
  • Bachelor's degree in computer science, math, engineering, or relevant technical field.
  • Six years of collective experience in the application of data engineering, data modeling, data analytics, data warehousing, business intelligence, database administration and data integration concepts and methodologies.
  • Five years of experience architecting, building, and administering big data and real-time streaming analytics architectures in on premises and cloud environments using but not limited to technologies like Kinesis, Apache Kafka, Apache Spark.
  • Four years of experience architecting, building, and administering large-scale distributed applications frameworks like Spark, Hadoop etc.
  • Three years of experience with Linux operations and development, including basic commands and shell scripting.
  • Three years of experience executing DevOps, DevSecOps methodologies and continuous integration/continuous delivery.
  • Strong understanding of ETL concepts and REST-oriented APIs for creating and managing data integration jobs.
  • Experience with AWS services like Lambda, EC2, EMR, EKS, Redshift, Glue, S3, IAM, RDS, Aurora, DynamoDB etc.
  • Knowledge of cloud networking, security, storage, and compute services.
  • Infrastructure provisioning experience using Cloud Formation, Terraform etc.
  • Data Modeling experience in NoSQL databases like Dynamo DB, Cassandra.
  • Demonstrated skills in detailed-oriented delivery management.
  • Expertise in SQL for data profiling, analysis, and extraction.
  • Familiarity with data science techniques and frameworks.
  • Results oriented and with a strong customer focus.
  • Creative thinker with strong analytical and problem-solving skills.
  • Ability to prioritize work to meet tight deadlines.
  • Ability to learn and keep pace with the latest technology advances and quickly grasp new technologies to support the environment and contribute to project deliverables.
  • Master's degree in a technical field (e.g. computer science, math, engineering).
  • Software development experience in relevant programming languages (e.g. Java, Python, Scala, Node.js).
  • Understanding of big data and real time streaming analytics processing architecture and data lake ecosystems.
  • Experience with data warehousing architecture and implementation, including hands on experience with source to target mappings and developing ETL code.
  • Experience with advanced analytics and machine learning concepts and technology implementations.
  • Experience with data analysis and using data visualization tools to describe data.
  • Experience with implementing RESTful APIs and Micro services using the design-first approach and focused on asset reusability.
  • Relevant technology or platform certification (AWS Solutions Architect Associate or AWS Data Engineer or AWS Solutions Architect Professional).
  • Competitive Pay
  • Bonus for Eligible Employees
  • Pension Plan
  • 401k Match
  • Employee Stock Purchase Plan
  • Tuition Reimbursement
  • Disability Insurance
  • Medical Insurance
  • Dental Insurance
  • Vision Insurance
  • Employee Discounts
  • Career Training & Development Opportunities
  • Paid Time Off starting at 160 hours annually for employees in their first year of service.
  • Ten (10) paid holidays per year (typically mirroring the New York Stock Exchange (NYSE) holidays).
  • Be Well Company holistic wellness program, which includes Wellness Coaching and Reward Dollars.
  • Parental Leave - fifteen (15) days of paid parental leave per calendar year to eligible employees with at least one year of service at the time of birth, placement of an adopted child, or placement of a foster care child.
  • Adoption Assistance
  • Employee Assistance Program
  • College Coach Program
  • Back-Up Care Program
  • PTO for Volunteer Hours
  • Employee Matching Gifts Program
  • Employee Resource Groups
  • Inclusion and Diversity Programs
  • Employee Recognition Program
  • Referral Bonus Programs
Track Jobs with Teal

Job Search Resources

•
AI Resume Builder
•
Data Engineer Resume Examples
•
Data Engineer Cover Letter Examples

Tools

Career Hubs

Guides

Company

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service