Data Engineer

Percepta

15d•Remote

About The Position

At Percepta, we bring first-class service across each market we support. As a Data Engineer working remotely, you’ll be a part of creating and delivering amazing customer experiences, while also enjoying the satisfaction of being part of a unique culture. The Data Engineer, Business Analytics will be the leader in building, developing, and expanding data strategy in support of artificial intelligence products for the organization. The data engineer will work with internal and external clients identifying opportunities for optimization in processing, storing, and retrieve unstructured data across the product pipeline including ingestion, transformations, storage, access, and design that facilitates operational interactions.

Requirements

Undergraduate Degree required
Graduate Degree in STEM related field or equivalent
3+ years of relevant work experience
Understanding of Agile Software Development Lifecycle and Scrum project planning/execution skills
Understanding of complex data flows, identification of data processing bottlenecks and designing and implementing solutions
Ability to assess business rules, collaborate with stakeholders and perform source-to-target data mapping, design and review
Proficient in Python, SQL, Scala
Experience in software development in a production environment.
Experience in cloud computing and data storage
Experience with vector databases and various lookup techniques (Pinecone, Faiss, etc.)
Experience processing large sets of structured, semi-structured, and unstructured data (cleansing, storage, retrieval)

Nice To Haves

Experience working with MLOps teams is preferred
Experience supporting Web Applications is preferred
Work experience with batch and real-time processing frameworks (Hadoop, Apache Storm, Apache Kafka, Apache Spark etc.) is a plus
Proven ability to balance and manage multiple, competing priorities
Collaborative interpersonal skills and ability to work within cross-functional teams

Responsibilities

Provide thought leadership on architecture and design for Generative AI products
Be a SME in technical and functional aspects of products and data integrations
Proactive identification of internal and external dependencies, highlighting issues, scope changes, and progress against project plan
Facilitate cross team development with technical team including ML Engineers, Data Analysts, and Web App/Dashboard Developers to implement feature pipelines and product databases
Collaborate with business stakeholders to understand data requirements
Provide technical support to assist clients and partners during and after product implementation
Develop and expand our data strategy best practices for developing Gen AI products
Engage in professional development opportunities to remain up to date on best practices surrounding data strategy to support Gen AI products