Machine Learning Senior Software Engineer (AWS, LLMs, Python)

Financial Industry Regulatory Authority, Inc. • Rockville, MD

73d • $95,300 - $206,200 • Hybrid

About The Position

We are seeking a highly skilled Machine Learning Engineer with strong experience in AWS, Large Language Models (LLMs)-especially Amazon Bedrock, Python, and modern CI/CD pipelines (Jenkins or GitLab). You will help design, build, and deploy scalable ML systems, integrate generative AI capabilities, and support end-to-end model lifecycle workflows in production.

Requirements

• Bachelor's degree in Computer Science, Information Systems or related discipline with at least 5 years of related experience, or equivalent training and/or work experience.
• System design experience
• Strong experience in object-oriented development
• Strong experience with cloud technologies
• Strong experience in data storage technologies
• Experience in performance tuning and optimization
• Experience in DevOps and CI\CD technologies
• Experience test automation and unit testing
• Experience software security

Responsibilities

• Design, build, and deploy machine learning models and pipelines using Python, AWS services, and Amazon Bedrock.
• Develop scalable APIs and microservices to expose ML/LLM capabilities using FastAPI
• Build automated CI/CD pipelines using Jenkins or GitLab CI/CD for model training, testing, and deployment with robust monitoring, logging, and alerting for ML systems in production.
• Optimize ML workloads using AWS services such as SageMaker, Lambda, ECS/EKS, Step Functions, and KMS.
• Familiarity with containerization using Docker and orchestration with ECS, EKS, or Kubernetes..
• Experience implementing RAG pipelines with vector databases (e.g., OpenSearch, Pinecone, DynamoDB, Aurora PostgreSQL + pgvector)
• Knowledge of modern MLOps tools (MLflow, SageMaker Pipelines, Weights & Biases)
• Experience working with API frameworks (FastAPI, Flask)
• Background in security, compliance, or responsible AI principles.

Benefits

• Employees may be eligible for a discretionary bonus in addition to base pay.
• Non-exempt employees are also eligible for overtime pay in accordance with federal, state, or local law.
• As part of its dedication to employee wellness, FINRA provides comprehensive health, dental and vision insurance.
• Additional insurance includes basic life, accidental death and dismemberment, supplemental life, spouse/domestic partner and dependent life, and spouse/domestic partner and dependent accidental death and dismemberment, short- and long-term disability, long-term care, business travel accident, disability and legal.
• FINRA offers immediate participation and vesting in a 401(k) plan with company match and eligibility for participation in an additional FINRA-funded retirement contribution, tuition reimbursement, commuter benefits, and other benefits that support employee wellness, such as adoption assistance, backup family care, surrogacy benefits, employee assistance, and wellness programs.
• FINRA encourages its employees to focus on their health and wellness in many ways, including through a generous time-off program of 15 days of paid time off, 5 personal days and 9 sick days, unless otherwise required by law (all pro-rated in the first year).
• Additionally, we are proud to support our communities by providing two volunteer service days (based on full-time schedule).
• Other paid leave includes military leave, jury duty leave, bereavement leave, voting and election official leave for federal, state or local primary and general elections, care of a family member leave (available after 90 days of employment); and childbirth and parental leave (available after 90 days of employment).
• Full-time employees receive nine paid holidays.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Industry: Religious, Grantmaking, Civic, Professional, and Similar Organizations
• Number of Employees: 1,001-5,000 employees