Data Engineer/Lead Developer

Capio Group•Sacramento, CA

4d•$135,000 - $145,000•Hybrid

About The Position

Capio Group is looking for an experienced Data Engineer/Lead Developer to work as part of a team in assisting with maintaining, enhancing, and advancing the client Investment Data Warehouse (IDW) architecture/platform. This platform is designed for Generative Business Intelligence (GenBI), and Artificial Intelligence, Machine Learning (AI/ML) to provide deeper insights, predictive analytics, and automated decision-making capabilities. The role is expected to drastically accelerate the development and deployment of Investment-related BI or GenBI, AI/ML, or agentic AI use cases onto the IDW within the AWS and Snowflake ecosystems. All work must adhere to client AI policies, technology governance, standards, and guidelines.

Requirements

At least ten (10) years of experience in data/BI engineering or analytics.
At least five (5) years of experience in leading a team (at least 3 members) to implement enterprise-level BI and/or large data warehouse solutions.
At least five (5) years of experience working with AI/ML or GenAI technologies.
At least two (2) proven deliveries of production-grade BI or data products (dashboards, data models, APIs).
At least two (2) years of experience with ETL/ELT pipelines, data warehousing platforms such as Snowflake, Amazon Redshift, and orchestration tools (Airflow, dbt, etc.).
At least two (2) years of experience using OpenAI APIs or similar LLM platforms, building natural language to SQL/query systems, designing prompt strategies for business insights and analytics, and prompt engineering to guide the platform's system behavior.
At least two (2) years of experience in SQL (advanced joins, window functions, performance tuning), data modeling (star/snowflake schemas, semantic layers), and hands-on experience with at least one major BI tool such as Power BI, Tableau, Looker.
At least two (2) years of experience leading a team of analysts and developers, as well as collaborating with stakeholders, to discover, document, and implement requirements and stakeholder requests for data warehouse or business intelligence projects.
Must be able to adhere to the hybrid working model by working on-site 2 to 3 business days per week at the client headquarters in West Sacramento, CA.

Nice To Haves

Holding technical certifications in the areas of: AWS certifications, Snowflake certifications, BI certifications (Power BI, Tableau), AI/ML or GenAI-related coursework or credentials.
Have a bachelor’s degree in computer science, computer engineering, or related fields from an accredited or government sanctioned college/university.

Responsibilities

Apply User Interface (UI)/ User Experience (UX) design principles for designing and building analytics dashboards with technologies such as Chainlit, Streamlit, and React.
Create interactive reporting and storytelling based on data visualization best practices, and human-centered design.
Leverage Out-of-Box (OOB) services/functions/APIs (e.g., calling SNOWFLAKE.CORTEX functions via SQL or configuring AWS Bedrock Knowledge Bases) to accelerate the design and implementation of use cases.
Build automated tests to ensure the platform's Text-to-SQL engine isn't hallucinating incorrect numbers.
Perform continuous prompt engineering to guide and finetune the platform's system behavior.
Execute statistical analysis, predictive analytics, optimization; conduct AI/ML model prototyping with ML frameworks such as TensorFlow, PyTorch, scikit-learn.
Apply expertise in platform-specific semantic layers or dbt (Data Build Tool), advanced SQL and dimensional modeling (Star Schema), and cloud ML platforms (e.g., AWS SageMaker, Azure ML, GCP Vertex AI).
Implement containerization and orchestration (Docker, Kubernetes).
Operate CI/CD pipelines for ML and data workflows, data integration, cleaning, and transformation processes.
Responsible for monitoring, tuning, and logging for AI/ML and GenBI solutions, Extract, Transform, Load (ETL)/ Extract, Load, Transform, (ELT) pipelines (e.g., Airflow, Matillion), cloud data warehouses & lakes (e.g., Snowflake, Redshift, BigQuery, Azure Synapse), and cloud infrastructure automation (e.g., Terraform, Ansible).
Continuously enhance and verify that the entire IDW ecosystem/solution is cost-effective, secure, and scalable.
Provide technical leadership, solution guidance to project teams in support of solution design and development, and act as a technical liaison among Investment stakeholders, technical developers, 3rd party vendor teams and tech support.
Apply vast experience and multidisciplinary expertise in AI Infrastructure & Agentic Workflows/Orchestration, Generative AI Design Patterns, Cloud Strategy & FinOps, and Security & Compliance (AI Governance) to support key Investment’s initiatives.
Analyze solutions and technologies and make recommendations based on knowledge of client Investment Branch's current and future needs.
Proactively monitor and assess strategic direction of solution vendors, technology and market trends, and determine their potential impact and value to the IDW; prepare presentations, documents, diagrams, models, and other artifacts as required to communicate analysis, recommendations, or designs.
Transfer of knowledge to appropriate client staff is required, along with any requested materials and content for transfer of knowledge.