Principal Software Engineer- GenAI

Duck Creek Technologies

88d • $136,100 - $219,600

About The Position

As a Principal Software Engineer on the GenAI team, you will drive the technical vision and execution of advanced AI-powered solutions across multiple initiatives. You will design and implement scalable, secure, and high-performing systems that leverage large language models (LLMs), retrieval-augmented generation (RAG), and AI-driven services. This role requires deep technical expertise, hands-on coding, and the ability to align multiple engineering teams toward a shared vision.

Requirements

• Bachelor’s degree, or higher education level, or its foreign equivalent, in Computer Science, Computer Information Sciences, and/or related field.
• Total Work Experience: 7+ years (software development), 5+ years of strategic leadership experience.
• Expert of scalable, resilient, modern, cloud-native microservice development with Java, .NET, Python, or Typescript.
• Expert in distributed software patterns, such as DDD, microservices, serverless, and event-driven architecture.
• Expert with CI/CD to deliver software enhancements to customers with full automation.
• Expertise in AI/ML systems: LLM integration, RAG pipelines, vector databases, and prompt engineering.
• Experience in Cloud platforms and cloud-native architectures, including Serverless.
• Hands-on experience with transformer-based models, Hugging Face, LangChain, or similar frameworks.
• Knowledge of data security, compliance, and responsible AI principles.
• Experience with Terraform/Ansible or other IaC platforms.
• Experience with CQRS, event-driven architecture, and Kafka.
• Experience building monitoring, alerting, and observability for maintaining high customer SLAs for SaaS delivered products.
• Excels in the ability to lead, teach, and guide modern software-development practices across Product Development, operating independently with guidance.

Responsibilities

• Lead technical strategy for GenAI-based products and platforms, ensuring alignment with enterprise architecture and business goals.
• Design and implement core AI services, including model orchestration, prompt engineering frameworks, and inference pipelines.
• Collaborate with data scientists and ML engineers to integrate LLMs and fine-tuned models into production systems.
• Architect and deliver solutions for high-complexity Agile stories across multiple domains, ensuring scalability and resilience.
• Mentor and guide engineers on modern AI development practices, including distributed systems, model deployment, and performance optimization.
• Ensure compliance and security in AI solutions, including data privacy, responsible AI principles, and model governance.
• Debug and resolve complex issues in distributed AI systems, ensuring minimal downtime and high availability.
• Champion CI/CD and MLOps practices for continuous delivery of AI features and models.
• Participate in hiring and talent development for the GenAI team.
• Perform other related duties and activities as required.

Benefits

• Flexible work environment
• Medical, dental, vision, life and disability insurance
• 401(k) Retirement Plan
• Flexible Spending & Health Savings Account
• Paid holidays, vacation, and volunteer time
• Employee assistance program and other benefits.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: Bachelor's degree
• Number of Employees: 1,001-5,000 employees