Machine Learning Researcher
Astera Institute•Emeryville, CA
7h•Hybrid
About The Position
Datasets in many areas, science in particular, are often small, heterogeneous, and expensive. Human scientists can take these datasets and generate models to describe them, but this process of model induction is labor-intensive and error-prone. Machine learning is a general and scalable solution, but it is not uniformly sample efficient. The Astera Institute is seeking a Machine Learning Researcher to help surmount this barrier with new architectures for data-efficient and general model induction. This includes bootstrapped program synthesis, along with components for a system that synthesizes its own learning algorithms - a machine learning strange loop. This is a full time position that reports to Timothy Hanson.
Requirements
- Masters or equivalent in machine learning, mathematics, or equivalent fields (strong candidates from neuroscience are encouraged to apply).
- Fluency with Pytorch, and familiarity with JAX, CUDA, and/or Triton + their open-source ecosystems.
- Demonstrated ability do fundamental research.
- Demonstrated ability to work in teams.
Responsibilities
- Hypothesize, test, and refine means of improving generalization performance of common architectural elements, including different forms of attention. This includes devising controlled datasets to elucidate e.g. learning order & learned representations.
- Think both mathematically and empirically about problems of runtime inference in gradient-trained networks, with an eye to the extensive literature on statistical learning.
- Contribute to a well-documented and well-instrumented code base that is performant where necessary yet expeditious where experimental throughput demands.
