Associate Principal Data Engineer

InvestcloudWarren Twp, NJ
65d$165,000 - $175,000

About The Position

The Senior Data Engineer will join InvestCloud's newly formed AI, Data & Analytics team, whose mission is to drive increased value from the data InvestCloud captures to enable a smarter financial future for our clients focused on enhanced intelligence. This is a unique opportunity to shape the architecture and technical execution patterns of a greenfield ecosystem to create a next-generation advisor and client experience. The team is building for scale - the technology and infrastructure designed today will serve thousands of clients and petabyte-level data volumes.

Requirements

  • Bachelor's degree in Computer Science, Data Engineering, or a related field; advanced degree is a plus
  • 6+ years of professional experience in Data Engineering
  • Experience shaping the architecture of a mature cloud data platform (AWS, GCP, or Azure) designed for different consumer types and delivering measurable business value
  • Hands-on experience building resilient batch (Airflow, Fivetran, Mage AI, Airbyte) and streaming (Kafka, Kinesis, Flink, Spark) data pipelines at scale (>1 TB/day)
  • Experience designing and implementing performant, reusable, and scalable data models in a cloud data warehouse (dbt, BigQuery, Snowflake) and with legacy ecosystems (Oracle, Postgres)
  • Proven experience running PoCs, leading large data or code migrations, and contributing to roadmap planning
  • Ability to build and maintain infrastructure using IaC (Terraform, OpenTofu, Ansible), containerization (Docker), and CI/CD tools (Jenkins, GitHub Actions)
  • Experience with operational monitoring tools for data and infrastructure observability (Monte Carlo, Datadog, Prometheus), and incident management (PagerDuty, incident.io)
  • Proficiency in SQL and Python, with confidence applying them across data engineering tasks
  • Strong communication and collaboration skills with both technical and non-technical stakeholders
  • AI-proficient or AI-curious, with interest in using emerging technologies to enhance productivity
  • Exposure to Machine Learning frameworks (TensorFlow, PyTorch, Scikit-learn) and LLM frameworks (LangChain)

Responsibilities

  • Build reliable and scalable data pipelines and capabilities across the platform, and monitor and support the capabilities offered
  • Construct complex architectures integrating multiple services, SaaS tools, and third-party data sources in a cloud-based environment
  • Contribute to the team's technical strategy and its execution through prioritization and delivery management
  • Set and enforce high standards for documentation, testing, resiliency, monitoring, and code quality
  • Drive efficiency, optimize cloud spend, reduce technical debt, and simplify code, infrastructure, and data models
  • Write reusable and well-documented code that captures the essential nature of the solution
  • Inspire and guide team members through design sessions, code reviews, and operational process ownership
  • Promote data quality, governance, and security as core principles of the platform, ensuring compliance with relevant regulations

Benefits

  • medical/Rx insurance
  • dental insurance
  • vision insurance
  • disability insurance
  • life/AD&D insurance plans
  • Flexible Savings Account (FSA)
  • Health Savings Account (HSA)
  • Employee Assistance Plan (EAP)
  • health advocacy
  • voluntary ancillary plans (accident, critical illness, hospital indemnity, legal, identity theft, auto/home, and pet insurance)
  • 401(k) retirement savings plan with company match
  • paid time off

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Senior

Industry

Publishing Industries

Education Level

Bachelor's degree

Number of Employees

1,001-5,000 employees

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service