Consulting/Principal Software Engineer (Python)

Remitly • Raleigh, NC

4d • Hybrid

About The Position

The Principal Software Engineer role performs complex research, design, and software development assignments within a software functional area or product line. Provides direct input to project plans, schedules, and methodologies in the development of cross-functional software products. This SWE performs software design — typically across multiple systems; mentors more-junior members of the team; and talks to users/customers and translates their requests into solutions. This role will also act as a technical leader in designing AI-driven solutions, including systems leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and agent-based architectures, particularly in client-facing and consulting engagements.

Requirements

• 10+ years of proven experience as a Principal Software Engineer or similar role.
• Strong proficiency in Python programming language.
• Strong proficiency in database technology (SQL, NoSQL).
• Extensive experience with Azure/AWS cloud services (e.g., EC2, S3, Lambda, RDS).
• Solid understanding of software architecture and design patterns.
• Proven experience designing end-to-end system architectures for complex, distributed applications.
• Experience with containerization and orchestration tools (e.g., Docker, Kubernetes, Terraform).
• Knowledge of CI/CD pipelines and DevOps practices.
• Experience working on client-facing or consulting engagements, translating ambiguous business requirements into technical architectures.
• Excellent problem-solving skills and attention to detail.
• Strong communication and leadership abilities.
• Ability to work effectively in a fast-paced, collaborative environment.
• Hands-on experience building AI-enabled applications, including LLM integrations and generative AI use cases.
• Experience designing and implementing RAG architectures, including document ingestion, embedding pipelines, and retrieval optimization.
• Familiarity with vector databases and semantic search technologies (e.g., Solr, Qdrant, OpenSearch, Elasticsearch).
• Experience with agent-based systems, including tool orchestration, multi-step workflows, and API integrations.
• Understanding of prompt engineering, evaluation frameworks, and techniques to improve model reliability (e.g., hallucination mitigation).
• Experience integrating AI systems into production environments, including monitoring, observability, and cost/performance trade-offs.

Nice To Haves

• Experience delivering AI/LLM solutions from prototype to production in enterprise environments.
• Experience with ML pipelines: model deployment, model serving, and debugging.
• Experience with other programming languages (e.g., Java, Go, C++).
• Experience with web frameworks (Django, Flask, FastAPI).
• Deep familiarity with generative AI ecosystems and tooling (e.g., OpenAI, Hugging Face, LangChain, LlamaIndex).
• Experienced with system architecture, design patterns, and API design.
• Experience with infrastructure as code tools.
• Proven experience in a mentorship and/or leadership role.

Responsibilities

• Lead the design, development, and deployment of scalable software solutions using Python and AWS.
• Lead architecture design for AI-driven systems, including LLM-based applications, RAG pipelines, and intelligent automation workflows.
• Architect and implement robust, high-performance systems that meet business requirements.
• Define end-to-end solution architectures that integrate AI components with existing enterprise systems.
• Collaborate with cross-functional teams to define technical specifications and ensure alignment with project goals.
• Work directly with clients/stakeholders to understand business challenges and translate them into scalable AI/ML solutions.
• Mentor and guide junior engineers, fostering a culture of continuous learning and improvement.
• Provide technical leadership on AI architecture decisions, trade-offs, and best practices.
• Conduct code reviews and ensure adherence to best practices and coding standards.
• Troubleshoot and resolve complex technical issues, ensuring system reliability and performance.
• Evaluate and optimize AI system performance, including latency, cost, and output quality.
• Stay updated with the latest industry trends and technologies, integrating them into the development process.
• Drive adoption of emerging AI technologies and frameworks where appropriate.
• All other duties as assigned.

Benefits

• Comprehensive, multi-carrier program for medical, dental and vision benefits
• 401(k) with match and an Employee Share Purchase Plan
• Wellness platform with incentives, Headspace app subscription, Employee Assistance and Time-off Programs
• Short-and-Long Term Disability, Life and Accidental Death Insurance, Critical Illness, and Hospital Indemnity
• Family Benefits, including bonding and family care leaves, adoption and surrogacy benefits
• Health Savings, Health Care, Dependent Care and Commuter Spending Accounts
• Up to two days of paid leave each to participate in Employee Resource Groups and to volunteer with your charity of choice
• Working flexible hours

What This Job Offers

• Job Type: Full-time
• Career Level: Principal
• Education Level: No Education Listed