Large Language Model Specialist

Bright Vision Technologies•Highlands Ranch, CO

2d•$100,000 - $150,000•Remote

About The Position

Bright Vision Technologies is seeking an LLM Fine-Tuning Engineer to design, execute, and operationalize fine-tuning workflows for large language models using supervised, preference-based, and reinforcement learning approaches. The role calls for practical experience with modern training stacks, dataset construction, rigorous evaluation, and reliable operation of complex training pipelines. The successful candidate will balance data quality, compute budgets, evaluation rigor, and delivery speed while applying production-grade engineering practices. The specialist will work with product, design, engineering, operations, and business stakeholders to turn ambiguous requirements into well-engineered solutions. They will contribute to code and design reviews, mentor junior engineers, communicate clearly, and deliver work that performs reliably in production. The role is 100% remote in the United States and is full-time, direct W2 employment. The stated annual salary range is $100,000–$150,000.

Requirements

Master’s or PhD in Computer Science, Machine Learning, or a related field, or equivalent experience.
Six or more years of combined ML research and engineering experience, with significant LLM exposure.
Strong proficiency in Python and modern deep learning frameworks, especially PyTorch.
Hands-on experience fine-tuning transformer-based language models at non-trivial scale.
Familiarity with distributed training strategies, including FSDP, ZeRO, and pipeline parallelism.
Experience with RLHF, DPO, or other preference optimization techniques.
Strong understanding of evaluation methodology, benchmarks, and human evaluation design.
Experience operating training jobs on GPU clusters and recovering from failures.
Strong written and verbal communication skills.
Track record of shipping or publishing impactful LLM work.

Nice To Haves

Publications at top-tier ML venues.
Experience with multimodal model fine-tuning.
Familiarity with synthetic data generation and dataset distillation.
Open-source contributions to LLM training libraries.
Exposure to responsible AI evaluation and red-teaming practices.

Responsibilities

Design and execute large language model fine-tuning experiments using supervised learning, DPO, RLHF, and related techniques.
Lead dataset construction, curation, and quality assurance for instruction tuning and preference data.
Build scalable training pipelines using modern distributed training frameworks.
Tune hyperparameters, optimizer configurations, and training stability strategies for large-model fine-tuning.
Implement parameter-efficient fine-tuning techniques such as LoRA, QLoRA, and adapter-based methods.
Design rigorous evaluation suites, including automated benchmarks, human evaluation, and capability-specific probes.
Implement safety, refusal, and policy evaluations to track model behavior across releases.
Operate large-scale training jobs on GPU clusters, diagnose failures, and reliably recover training state.
Optimize training throughput using mixed precision, sequence packing, and efficient attention implementations.
Manage model artifacts, lineage tracking, and reproducibility across concurrent experiments.
Collaborate with product, research, and platform teams to align fine-tuning roadmaps with business needs.
Document training methodology, results, and decisions for technical and non-technical audiences.
Mentor engineers on fine-tuning best practices, evaluation rigor, and responsible deployment.
Stay current with LLM research and translate advances into production-ready fine-tuning recipes.
Contribute to code reviews and design reviews and help raise engineering standards.