Job alerts, saved jobs and deadline reminders on your phone

Open app

Research Scientist / Engineer – Training Infrastructure

Distributed Training Engineer

Posted Oct 8 (45 days ago)

Key facts

Build distributed training systems for multimodal models across thousands of GPUs; remote within the EU.

Where and how
Remote, EUEU
Work model
On-siteHybridRemote
Level
Languages required
English

Original job ad

You’ll build the distributed systems that train Luma’s large-scale multimodal models across thousands of GPUs, so researchers can focus on innovation on top of reliable, efficient, scalable infrastructure. This is hard PyTorch, CUDA, and distributed-systems work — advanced parallelism, training stability, and utilization across massive clusters. It fits an engineer who’s solved real problems training foundation models at scale. If you haven’t worked at the level of FSDP and multi-node training, this is the wrong depth. What You’ll Own - Design, implement, and optimize efficient distributed training systems for models across thousands of GPUs. - Research and implement advanced parallelization (FSDP, Tensor Parallel, Pipeline Parallel, Expert Parallel). - Build monitoring, visualization, and debugging tools for large-scale training runs. - Optimize training stability, convergence, and resource utilization across massive clusters. First 90 Days One way the first 90 could unfold. - Days 1–30 — Immerse & Diagnose: Learn the current training stack and where stability and utilization hurt at scale. - Days 30–60 — Ship & Validate: Land a parallelization or stability improvement that measurably helps a real training run. - Days 60–90 — Scale & Systemize: Build the monitoring and tooling that keeps large runs reliable and efficient. What You Bring - Extensive distributed PyTorch training and parallelisms in foundation-model training. - Deep understanding of GPU clusters, networking, and storage systems. - Familiarity with communication libraries (NCCL, MPI) and distributed-system optimization. Nice to Have - Strong Linux systems administration and scripting. - Experience managing training runs across 100+ GPUs. - Experience with containerization, orchestration, and cloud infrastructure. About Luma: Luma’s mission is to build unified general intelligence that can generate, understand, and operate in the physical world. We believe multimodality is critical for intelligence — the next step beyond language models comes from vision. Luma is an equal opportunity employer.

About the role

Summarised by JobCrawls from the job ad above.

Requirements

  • Extensive experience with distributed PyTorch training and parallelism for foundation models.
  • Deep understanding of GPU clusters, networking and storage systems.
  • Familiarity with NCCL, MPI and distributed-system optimization.

Responsibilities

  • Design, implement and optimize distributed training systems for models running across thousands of GPUs.
  • Research and implement FSDP, tensor, pipeline and expert parallelism.
  • Build monitoring, visualization and debugging tools for large training runs.
  • Optimize training stability, convergence and resource utilization across large clusters.

Skills & technologies

PyTorchCUDAFSDPTensor ParallelismPipeline ParallelismExpert ParallelismNCCLMPI
Show 6 more
GPU ClustersLinux System AdministrationScriptingContainerizationOrchestrationCloud Infrastructure

About Luma AI

Luma AI logo
Luma AI · 3 open roles
Top locations (all time): Remote, EU · 6 · London, UK · 2 · New York, NY · 2 · +5 other locations
View company
Current open roles at Luma AI on JobCrawls
LocationActive listings
Remote, EU6
London, UK2
New York, NY2
Redwood City, CA2
Remote, US2
Seattle, WA2
Remote, INT1
Remote, UK1
Current role mix at Luma AI on JobCrawls
Role typeActive listings
Performance Optimization Engineer2
Distributed Training Engineer1
Inference Software Engineer1
Reinforcement Learning Infrastructure Engineer1
Training Infrastructure Engineer1
Current role-level mix at Luma AI on JobCrawls
Role levelActive listings
Senior4
Expert2
About the employer

Luma aims to build unified general intelligence that can generate, understand and operate in the physical world. It believes multimodality is critical to intelligence, with vision as the next step beyond language models.

Never miss a new Distributed Training Engineer job in Remote, EU

Weekly or daily digest. Unsubscribe anytime.

or

We'll email you a link to confirm. Confirming creates a free JobCrawls account for this address so you can manage your alerts. No password. Unsubscribe or delete it any time.