webAI-posted 3 months ago
Full-time • Senior
Austin, TX
51-100 employees
Publishing Industries

We are looking for a Senior C++ Systems Engineer with deep expertise in high-performance computing and machine learning inference. In this role, you'll design and optimize inference engines for on-device applications on Apple platforms (macOS & iOS), leveraging Metal and MLX to push performance to its limits. This is an ideal opportunity for someone who thrives at the intersection of low-level systems programming, applied machine learning, and hardware-aware optimization.

  • Implement and optimize advanced ML architectures (Transformers, Mixture of Experts, Diffusion models) in C++, with a focus on performance and memory efficiency.
  • Develop and fine-tune custom Metal kernels for performance-critical inference operations.
  • Apply advanced model quantization techniques (low-bit, mixed-precision) to accelerate performance while minimizing footprint.
  • Profile, benchmark, and tune inference on Apple Silicon (M-series, A-series), identifying and eliminating bottlenecks.
  • Collaborate on API design and build Python bindings for C++ libraries.
  • Contribute to robust testing frameworks to ensure reliability and performance.
  • Bachelor's degree in CS, EE, or a related field, or equivalent experience.
  • 4+ years of professional experience in C++ systems programming.
  • Strong understanding of computer architecture, data structures, and algorithms.
  • Demonstrated experience with performance profiling and low-level optimization.
  • Familiarity with deep learning concepts and architectures (Transformers, Diffusion models, Mixture of Experts).
  • Deep expertise with Apple's MLX framework.
  • Demonstrable experience writing and optimizing custom Metal kernels.
  • Experience with model quantization techniques and their performance implications.
  • Familiarity with the iOS/macOS development ecosystem and build systems (CMake).
  • Experience creating Python bindings for C++ libraries.
  • Competitive salary and performance-based incentives.
  • Comprehensive health, dental, and vision benefits package.
  • 401k Match (US-based only)
  • $200/mos Health and Wellness Stipend
  • $400/year Continuing Education Credit
  • $500/year Function Health subscription (US-based only)
  • Free parking, for in-office employees
  • Unlimited Approved PTO
  • Parental Leave for Eligible Employees
  • Supplemental Life Insurance
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service