Senior Software Engineer, Internal Tools
About The Position
This role is centered on building and expanding the internal software that allows Syllo to scale smoothly. You’ll take ownership of internally built custom tools that keep our operations running efficiently across every department. At Syllo, AI is integral to how we engineer solutions. You will leverage modern AI coding agents and automated testing toolsets as primary capabilities in your workflow, maintaining a high velocity while upholding high standards for system design, code clarity, and reliability. We are looking for an engineer who loves building high-leverage tools, actively refines their AI-assisted engineering methodology, and enjoys crafting thoughtful solutions to unique internal operational challenges.
Requirements
- 5+ years of professional software engineering experience, including ownership of production software systems.
- Consistent experience using AI coding agents or assistants as part of a modern software development workflow.
- Experience building automated testing workflows or evaluation systems for AI/LLM applications.
- Hands-on experience integrating large language model APIs into user-facing applications or internal platforms.
- Experience building internal applications, workflow automation, or platform services used daily by non-technical teams.
- Proficiency in Python and modern frontend frameworks (e.g., React), alongside practical experience with web APIs and cloud integrations.
- Bachelor's degree in computer science or a technical field, or equivalent practical experience.
Nice To Haves
- Modern AI development habits: Daily experience using AI coding agents to accelerate development, paired with a sharp eye for code quality, security, and architecture.
- Testing & evaluation rigor: Hands-on experience creating robust automated tests and developing benchmarking tools for non-deterministic model outputs.
- Production LLM experience: Practical knowledge building on LLM APIs, including prompt design, output parsing, performance tuning, and cost management.
- Full-stack problem solving: Ability to take open-ended business needs and turn them into fully functional, user-friendly internal tools.
- Maintainable engineering: Dedication to writing readable, modular, and well-instrumented code that remains easy for others to collaborate on.
- Agile, evolving mindset: Excitement to try new tooling, adapt to changing requirements, and continuously improve how internal tools are delivered.
- Experience with document processing, contract workflows, or legal technology is a strong plus.
Responsibilities
- Build, maintain, and scale internal software tools, including document/contract parsing engines, interactive Slack applications, and custom operational utilities.
- Utilize AI coding agents and assistants to supercharge your execution, writing clean, well-architected code while applying strong engineering discernment to agent output.
- Implement automated testing strategies and evaluation pipelines using AI tooling to ensure test coverage keeps pace with product releases.
- Build scoring frameworks and evaluation harnesses to assess and improve the reliability and accuracy of LLM-backed workflows over time.
- Partner with teams across Finance, Legal, Customer Success, and Revenue Operations to engineer tools tailored to their evolving processes.
- Collaborate on best practices for integrating AI-generated code into the codebase, sharing methodologies that elevate velocity across the wider engineering team.
Benefits
- Medical, dental, vision, and voluntary insurance options.
- Vacation, sick leave, and paid holidays.
- Access to benefit counselors and fitness class reimbursements.
- Annual learning and development budget.
- Competitive base salary + equity options.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
