Senior AI Platform Engineer
Glint Tech Solutions LLC•New York, NY
•Hybrid
About The Position
Our client, a leading enterprise organization, is seeking a Senior AI Platform Engineer to drive AI platform enablement across the enterprise. This role sits at the intersection of engineering, governance, and user enablement, working closely with Information Security, Risk, Legal, and Compliance teams to define platform controls and implement them through configuration and code. The engineer will also manage enterprise AI cost — ensuring tokens, credits, and platform spend are tracked and optimized.
Requirements
- 6+ years progressive engineering experience, including 1-2+ years in AI/cloud platform or emerging-tech enablement
- Experience partnering with InfoSec, Risk, and Compliance teams to implement technical controls in regulated environments
- Hands-on experience with IAM/access policies, guardrails, audit logging, and quota/rate limiting
- GenAI models (GPT, Claude, Gemini, LLaMA) and prompt engineering
- Agentic AI, MCP, and Graph/RAG architectures
- AWS services: Bedrock, EC2, ELB/GLB/NLB, EKS, Fargate, Lambda, Athena, Glue, Lake Formation
- Infrastructure as Code (Terraform, Puppet, Docker) and containerized deployments
- Python (NumPy, Pandas, Boto3) for automation and platform tooling
- Vector/Graph databases (Weaviate, Milvus, PGVector, Neo4j, Neptune)
- Automated testing/evaluation frameworks (Ragas, Playwright, Selenium, Zephyr)
- SDLC, DevSecOps, Agile Scrum/Kanban, JIRA/Confluence/JIRA Align
- Strong stakeholder management and communication across technical and business teams
Nice To Haves
- BI tools (QuickSight, Tableau) for usage/cost reporting
- Knowledge of financial markets and enterprise data systems
Responsibilities
- Lead AI platform enablement across enterprise AI tools (OpenAI, Gemini, Anthropic, Amazon Bedrock, LLM gateways, agentic frameworks)
- Coordinate with Security, Risk, Compliance, and Legal to review and agree on platform controls and guardrails
- Translate agreed compliance/security requirements into technical controls (IAM policies, guardrails, content filters, logging, rate limits, data-access controls)
- Document controls and maintain audit/compliance evidence
- Manage token budgets, usage quotas, and rate limits across providers; build cost dashboards and anomaly alerting
- Provide user support on credit/usage limits, quota management, and AI usage best practices
- Troubleshoot issues related to skills, agents, MCP integrations, and API usage
- Design and maintain LLM pipelines, agentic workflows, and Graph/RAG architectures using Python and AWS-native tooling
- Implement cloud-native solutions (EKS, Lambda, Fargate, Glue, Athena)
- Automate provisioning and cost guardrails using Infrastructure as Code
- Own end-to-end delivery of platform initiatives using Agile (Scrum/Kanban)
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
