Principal - Security Architect - Artificial Intelligence (AI/LLM)

Ally•Charlotte, NC

33d•$110,000 - $180,000•Hybrid

About The Position

As the Principal - Security Architect - Artificial Intelligence (AI/LLM), you will lead the design, implementation, and governance of security architectures for AI-driven systems and platforms. You will ensure that AI solutions are secure by design, compliant with regulatory requirements, and resilient against evolving threats. Your expertise will guide cross-functional teams in adopting best practices, developing secure patterns, and shaping the technology strategy and roadmap for AI security across the organization. This is a mid-level to senior-level highly technical role that will serve as a mentor to more junior architects and will report to Head of Security Architecture. At Ally, you get a startup feel, but experience the benefits of a company that has worked out the kinks and is fulfilling its purpose. We are always evolving and see that as a good thing. From owning our work to seeing its impact in the real world, our team is relentless in finding new ways technology can help make experiences better and help people. We are problem solvers, we value diverse thinking, we support one another, and we challenge ourselves to think bigger in the journey to deliver customer-obsessed tech solutions. To read more about what our tech team does, be sure to visit our tech blog at ally.tech At this time, Ally will not sponsor a new applicant for employment authorization for this position.

Requirements

5+ years of experience in security architecture, with significant exposure to AI/ML systems and cloud environments.
Experience with Model Context Protocol (MCP) and securing the infrastructure that supports it.
Ability to mentor and coach a technical team, leading by example.
Deep knowledge of network security, data security, cloud security (AWS, Azure, GCP), and IAM principles.
Proven experience conducting security reviews, threat modeling, and vendor/technology evaluations.
Demonstrated ability to develop technology strategies, roadmaps, and secure architecture patterns based on evolving security threats and industry trends.
Strong understanding of financial industry regulatory frameworks (such as is FFIEC, PCI DSS, and SOX) and cybersecurity frameworks (such as NIST and CIS)
Excellent communication and presentation skills, with the ability to convey complex concepts to diverse audiences.
Exceptional relationship-building and collaboration skills across technical and business teams.
Relevant certifications (e.g., CISSP, CCSP, AWS/Azure Security, TOGAF) are highly desirable.
Bachelor's or equivalent experience in Computer Science, Information Security, or related field.

Responsibilities

Lead comprehensive security reviews of AI systems, applications, and infrastructure to identify and mitigate risks.
Conduct threat modeling for AI and machine learning solutions, ensuring robust protection against adversarial attacks and data breaches.
Evaluate vendors and emerging technologies for security posture, integration capabilities, and alignment with organizational standards.
Develop and maintain technology strategy and security roadmaps for AI initiatives, ensuring alignment with business objectives and regulatory requirements.
Establish and promote secure architecture patterns, frameworks, and guidelines for AI development and deployment.
Collaborate with engineering, data science, product, and compliance teams to embed security throughout the AI lifecycle.
Provide expert guidance on network security, data security, cloud security, and identity & access management (IAM) in the context of AI systems.
Present complex security concepts and recommendations to technical and non-technical stakeholders, including executive leadership.
Build and nurture relationships with internal and external partners to advance the organization's AI security posture.
Stay abreast of emerging threats, technologies, and regulatory changes impacting AI security.

Benefits

Time Away: Program starts at 20 paid time off days in addition to 11 paid holidays and 8 hours of volunteer time off yearly (time off days are prorated based on start date and program varies based on full or part-time status and management level).
Planning for the Future: plan for the near and long term with an industry-leading 401K retirement savings plan with matching and company contributions, student loan pay downs and 529 educational save up assistance programs, tuition reimbursement, employee stock purchase plan, and financial learning center and financial coach access.
Supporting your Health & Well-being: flexible health and insurance options including medical, dental and vision, employee, spouse and child life insurance, short- and long-term disability, pre-tax Health Savings Account with employer contributions, Healthcare FSA, critical illness, accident & hospital indemnity insurance, and a total well-being program that helps you and your family stay on track physically, socially, emotionally, and financially.
Building a Family: adoption, surrogacy and fertility assistance as well as paid parental and caregiver leave, Dependent Day Care FSA back-up child and adult/elder care days and childcare discounts.
Work-Life Integration: other benefits including Mentally Fit Employee Assistance Program, subsidized and discounted Weight Watchers program and other employee discount programs.
Other compensations: depending on the role for which you are considered, you may be eligible for travel allowances, relocation assistance, a signing bonus and/or equity.

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume