Principal Data & ML Ops Architect (Remote, Continental United States)
About The Position
ICA, Inc. is seeking a hands-on Principal Data & ML Ops Architect to lead the architecture of our data and document-intelligence platforms. ICA works across healthcare, federal health, regulatory and life-sciences environments, building systems that turn complex structured and unstructured data into reliable, actionable intelligence. This role is responsible for designing scalable platforms that ingest, process, govern, and serve large volumes of data and documents for analytics, AI/ML, RAG, search, and operational applications. You will help modernize and unify existing platforms while establishing reusable architectural patterns for new solutions.
Requirements
- Deep experience architecting and owning production data platforms or distributed data systems.
- Strong Python, SQL, data modeling, ETL/ELT, workflow orchestration, and cloud-data-platform experience.
- Significant experience with unstructured data or document-processing systems at scale.
- Strong understanding of metadata, schema evolution, lineage, provenance, data quality, observability, retries, replay, backfills, and recovery.
- Experience designing systems with sensitive-data controls, governance, access management, and audit requirements.
- Strong understanding of how modern AI/ML and retrieval systems depend on production data architecture.
- Demonstrated technical judgment, ownership, problem solving, and ability to challenge fragile or overly complex designs.
- Strong technical communication and decision-making skills.
- Must be authorized to work in the United States and have lived in the US for 3 or more consecutive years.
- Must be able and willing to obtain a Public Trust Clearance
Nice To Haves
- Experience in healthcare, life sciences, government, regulated industries, PHI/PII, or GDPR environments is valuable, but not required.
Responsibilities
- Architect large-scale data and document-processing platforms, from ingestion through downstream consumption.
- Design robust patterns for document parsing, extraction, normalization, validation, storage, search, human review, and reprocessing.
- Establish standards for schemas, metadata, lineage, provenance, data quality, reproducibility, and auditability.
- Design reliable ingestion and transformation pipelines using APIs, files, batch processing, and streaming where appropriate.
- Create platform patterns that enable Data Science and AI prototypes to become secure, maintainable production solutions.
- Architect data and retrieval foundations supporting RAG, analytics, AI workflows, evaluation, and feedback loops.
- Make architecture decisions involving scalability, reliability, security, privacy, cost, and operational complexity.
- Lead technical design reviews, investigate production failures, mentor engineers, and work across Data Engineering, Data Science, DevOps/MLOps, Product, Security, and client teams.
- Remain technically hands-on enough to review and develop Python, SQL, schemas, APIs, and production data pipelines.
Benefits
- Health Insurance - 100% employer-paid premiums – ICA covers the full cost of one of three offered medical plans
- Dental Insurance
- Vision insurance
- Health Spending Account
- Flexible Spending Account
- Life and Disability insurance
- 401(k) plan with company match
- Paid Time Off (Vacation, Sick Leave and Holidays)
- Education and Professional Development Assistance
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Principal
Education Level
No Education Listed
