Data Platform Engineer

Noetica • New York, NY

157d • $180,000 - $220,000

About The Position

As a Senior/Staff Data Platform Engineer at Noetica, you will be responsible for developing and maintaining the core infrastructure that processes and enriches complex data at scale. The Data Platform team is at the heart of our cutting edge AI/ML research, connecting it directly to our data product that delivers market-moving insights to our users. You will also play a vital role in scaling up the platform to meet the needs and expectations of our rapidly growing user base. The team is also the efficiency engine that removes the burden of productionization from our researchers, and offers readily accessible, high-quality structured data that enables product teams to build exceptional end-user experiences.

Requirements

• Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent experience).
• 3+ years of industry experience as a Software Engineer.
• 3+ years working with Python.
• Strong understanding of AWS services and architectures, with hands-on experience in managing cloud infrastructure.

Nice To Haves

• Proven Experience in Microservices: Hands-on experience developing backend applications with microservice architectures, ideally deployed on Kubernetes.
• Familiar with Data Processing Workflows: Practical exposure to stateful data processing workflows and tools like Airflow, Prefect, Dagster, or Flyte.
• Passionate about Fintech/Legaltech: Genuine interest in the intersection of finance and law.
• Driven and Agile Learner: Quick learner, eager to explore new technologies and adapt to a fast-paced environment.
• Collaborative Communicator: Excellent communication skills, thriving in a team setting.

Responsibilities

• Build and Maintain the Core Data Platform: Design, develop, and operate the shared data platform infrastructure that powers our data products. Ensure high availability and high performance at scale. Ensure data security and compliance in a highly-regulated industry.
• Empower AI/ML Research: Productionize cutting-edge research results into data pipelines. Design, develop, and operate internal systems that enable research experimentations and enable rapid iterations on our AI/ML technology.
• Enable Product Team Velocity: Design, develop, and operate performant and highly-available data serving systems that accelerate end-user product development.
• Solve Complex Data Processing Challenges: Implement elegant, robust, and highly scalable solutions to address cutting-edge data processing requirements and performance/efficiency bottlenecks.
• Reliability and Observability: Design and develop full observabilities into the entire data processing platform. Design and develop internal systems for monitoring the quality of our foundational datasets. Ensure that our foundational datasets are reproducible and trackable.
• Scale Infrastructure for Growth: Proactively scale the infrastructure to meet the increasing demands of our rapidly expanding client-facing products and user base.

Benefits

• Hybrid in-office schedule
• Amazing office location next to Bryant Park/Grand Central
• 401(k) retirement plan
• Wellhub (Gympass) fitness membership
• Unlimited PTO
• Unlimited sick days
• Medical, dental, and vision insurance
• Company offsites
• Commuter benefits

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: Bachelor's degree
• Number of Employees: 11-50 employees