Pod Lead - Life Science

Careerflow.ai•, CO

About The Position

Careerflow Human Data Labs partners with AI companies to bring real-world professional expertise into their products. The Pod Lead will lead a team of approximately 5–10 technical trainers developing realistic, terminal-based scientific and engineering tasks for a frontier AI training and evaluation initiative. The role oversees task quality, reproducibility, evaluation standards, trainer mentoring, and consistent delivery of challenging tasks across life-science workflows. The Pod Lead will design realistic, multi-step agentic scientific workflows and develop their input files, datasets, instructions, constraints, and expected deliverables. They will create reproducible expert solutions and objectively verifiable ground truths, with robust automated or semi-automated grading criteria. Tasks must be self-contained and executable in controlled, network-isolated environments, and should require agents to inspect data, choose methods, run analyses, troubleshoot, and synthesize results. This is a contractor assignment for three weeks, with an expected start date next week. The commitment is at least four hours per day and a minimum of 40 hours per week, including four hours of overlap with PST. The role is available in Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Indonesia, Nigeria, and Turkey. No medical or paid leave is provided.

Requirements

Ph.D., postdoctoral, or equivalent research experience in the life sciences, with strong demonstrated computational and scientific-programming experience.
Strong scientific programming experience, particularly in Python.
Prior experience working as a pod lead on previous projects.
Ability to independently validate scientific reasoning and computational outputs.
Expertise in one or more of bioinformatics, computational genomics, systems biology, computational neuroscience, biostatistics, computational drug discovery, computational biochemistry, structural biology, protein engineering, or computational microbiology.
Commitment of at least four hours per day and a minimum of 40 hours per week, with four hours of overlap with PST.

Nice To Haves

Familiarity with samtools, bcftools, GATK, BWA, STAR, Salmon, DESeq2, edgeR, Seurat, Scanpy, Biopython, Bioconductor, Nextflow, or Snakemake.
Familiarity with RDKit, OpenMM, GROMACS, AutoDock Vina, PyMOL, or Biopython structure tools.
Familiarity with medical imaging and clinical tools such as pydicom, nibabel, SimpleITK, MONAI, FSL, lifelines, statsmodels, or FHIR data formats.
Familiarity with Docker, Conda, Git, CI systems, automated testing, and HPC environments.
Experience designing benchmarks, analysis challenges, or computational evaluations.

Responsibilities

Lead and mentor a pod of approximately 5–10 technical trainers, ensuring consistent quality, productivity, and timely delivery.
Review trainer tasks end to end, including task statements, biological and clinical datasets, reference files, pipelines, environments, reference solutions, and automated tests.
Verify that tasks reflect authentic research or clinical analysis workflows and require genuine multi-step scientific reasoning.
Check that tools, reference genomes, annotation versions, databases, and dependencies are pinned and pipelines are reproducible.
Validate scientific correctness, including genome builds, coordinate conventions, normalization, batch-effect handling, statistical assumptions, multiple-testing correction, units, dosing conventions, imaging orientation and spacing, and random-seed control.
Ensure graders verify substantive outputs, such as variant calls, differential expression results, cluster assignments, binding or structural metrics, survival estimates, model performance, segmentation accuracy, and pharmacokinetic parameters, rather than formatting.
Ensure grading tolerances account for legitimate stochastic and numerical variation without accepting incorrect analyses.
Ensure tasks cannot be gamed through hard-coded outputs, reading test files, or bypassing the intended analysis.
Confirm that data is synthetic, public, appropriately licensed, and de-identified, with no protected health information or restricted-access data.
Screen tasks for biosafety and dual-use concerns and escalate content involving dangerous pathogens, toxins, or enhancement of harmful biological capabilities.
Provide clear, actionable written feedback and track revisions through closure.
Onboard and mentor trainers; allocate work, track quality and throughput, and escalate blockers.
Maintain pod documentation covering guidelines, recurring issues, and exemplary tasks.
Design challenging, realistic agentic scientific workflows across the life sciences that require multiple computational steps.
Develop realistic input files, scientific datasets, instructions, constraints, and expected deliverables.
Build tasks requiring agents to inspect data, select appropriate methods, execute analyses, troubleshoot problems, and synthesize results.
Create reproducible expert solutions, objectively verifiable ground truths, and robust automated or semi-automated grading criteria.
Validate scientific assumptions, calculations, code, intermediate outputs, and final answers, ensuring tasks are self-contained and executable in controlled, network-isolated environments.