Nebius B.V. logo
Monthly
€14,121 - €18,968
Posted August 29, 2026 · 0 days agoLast seen August 29, 2026Est. expiry October 3, 2026

Senior Machine Learning Engineer

About the role

Nebius Token Factory is building an AI training and model post-training capability for frontier model improvement. This role owns the infrastructure that makes large-scale training and RL experiments possible, reliable, reproducible, and efficient. The work sits at the intersection of distributed systems, GPU performance, model training frameworks, RL pipelines, and production engineering. Your responsibilities include designing and running model-training and post-training experiments (including SFT, continued pretraining, DPO/IPO/KTO, RL methods like RLHF/RLAIF, PPO, GRPO), building reward functions and evaluation sets, creating synthetic data and data pipelines, analyzing model-behavior failures, building distributed training and RL infrastructure using Megatron-LM, DeepSpeed, PyTorch FSDP/DTensor, Ray, and more, implementing parallelism strategies, optimizing GPU utilization, and writing experiment plans and runbooks. Must-haves: strong Python and PyTorch engineering, hands-on experience in at least two areas among model training, post-training/RL, data pipelines, or large-scale ML systems, ability to design rigorous experiments, understanding of modern LLM behavior and training bottlenecks, strong communication skills. Nice-to-haves: experience with RL frameworks/pipelines and Megatron-LM/DeepSpeed, CUDA and NCCL familiarity, publications or production impact in LLM domains. In the US, key benefits are Health insurance, 401(k), Parental leave, Remote work reimbursement, Disability & life insurance. Pay: Base Compensation Range $195,200 - $262,200 USD annually. We offer competitive compensation and benefits. This is an onsite role in Palo Alto with US-based benefits.

Job Details

Responsibilities

  • Design and run model-training and post-training experiments including SFT, continued pretraining, DPO/IPO/KTO, RL methods such as RLHF/RLAIF, PPO, and GRPO
  • Build reward functions, verifiers, task environments, and evaluation sets for reasoning, coding, tool use, and agentic workflows
  • Create synthetic data and data pipelines including teacher-student generation, self-play, rejection sampling, filtering, and quality scoring
  • Analyze model-behavior failures and turn them into targeted data, reward, or algorithm improvements
  • Build and maintain distributed training and RL infrastructure using Megatron-LM, DeepSpeed, PyTorch FSDP/DTensor, Ray, Verl, slime, AReaL, or OpenRLHF
  • Implement and debug parallelism strategies (tensor, pipeline, sequence/context, expert, data) and build rollout, reward-serving, checkpointing, and experiment-orchestration components
  • Profile and improve GPU utilization, memory usage, communication efficiency, training throughput, and inference/serving performance
  • Design rigorous evaluations and ablations for capability, instruction following, reasoning, tool use, safety, and regression risk
  • Write experiment plans, design docs, benchmark reports, and runbooks, and partner across research and platform teams
  • Must-haves: strong Python and PyTorch engineering, experience with at least two areas among model training, post-training/RL, data pipelines, or large-scale ML systems
  • Nice-to-haves: experience with RL frameworks/pipelines and Megatron-LM/DeepSpeed, CUDA, NCCL familiarity, publications or production impact in LLM domains

Requirements

  • Strong Python and PyTorch engineering skills
  • Hands-on experience across at least two of: model training, post-training/RL, data pipelines, large-scale ML systems

Skills & Technologies

PythonPyTorchDistributed systemsMegatron-LMDeepSpeedPyTorch FSDP/DTensorRayOpenRLHFRLHFRLAIFPPOGRPORL pipelines
Seen 5 hours agoPartial Schema
Nebius B.V. logo
Nebius B.V. · 772 open roles
Top locations: Remote - Global · 398 · Remote - Europe · 126 · Amsterdam, Netherlands · 57+54 other locations
View company
Current open roles at Nebius B.V. on JobCrawls
LocationActive listings
Remote - Global398
Remote - Europe126
Amsterdam, Netherlands57
London, United Kingdom22
Remote - United States20
Remote - Finland18
Berlin, Germany16
Mäntsälä, Finland12
Helsinki, Finland10
Lappeenranta, Finland10
Prague, Czech Republic8
Israel6
Amsterdam5
United Kingdom5
Canada4
Tel Aviv, Israel3
Singapore3
Remote3
Abu Dhabi2
New York City, United States2
London2
Paris, France2
Austin, United States2
Dubai2
France, Paris2
Canada, Remote - United States1
East London, United Kingdom1
Singapore, Singapore1
Minnesota, United States1
Remote - Israel1
Munich, Germany1
UK1
Berlin1
New Jersey, United States1
Remote - Germany1
Abu Dhabi, Dubai1
Prague1
New Jersey, US1
Remote - United Kingdom1
Oklahoma, United States1
Finland1
California, United States1
Abu Dhabi, United Arab Emirates1
Czechia1
Alabama, US1
Béthune, France1
Netherlands1
Austin, Texas1
San Francisco Bay Area, United States1
Kansas City, United States1
Béthune, Pas-de-Calais, France1
Philadelphia, United States1
Dallas, United States1
London, UK1
Israel, Israel1
Remote - EU1
Paris1
Current role mix at Nebius B.V. on JobCrawls
Role typeActive listings
Backend Engineer308
Software Engineer82
Account Executive54
Site Reliability Engineer6
Technical Product Manager5
Technical Project Manager5
Technical Program Manager5
Product Manager4
Sales Representative4
System Engineer4
Data Center Technician3
ML Engineer3
Data Center Operations Technician3
IT Technician2
Product Designer2
Hypervisor Engineer2
Delivery Manager2
Backend engineers, Frontend engineers, Site reliability engineers2
Open Positions at Nebius2
Applied AI Researcher2
Head of Channel Marketing1
Forward Deployment Engineer1
Site Selection & Colocation Manager1
Network Engineer1
DC IT Support Manager1
Application Security Engineer1
MEP Engineer1
Datacenter IT Technician1
Partner Solutions Architect1
Customer Engineer1
Internal Control Business Partner1
Solutions Partner1
Senior System Engineer1
Senior Technical Program Manager1
Solutions Architecture Leader1
Electrical Engineer1
Data Scientist1
Compensation Analyst1
Network Planning Project Manager1
Data Center IT Manager1
Technical Account Manager1
Security Solutions Engineer1
Cloud Solution Architect1
AI and ISV Partner Business Development Manager1
Structured Cabling Design Engineer1
ML Infrastructure Engineer1
Senior Applied AI Solutions Engineer1
VP of Developer Relations & Community1
Senior Support Engineer1
Operations Specialist1
Project Development Manager1
Backend Developer1
Data Center Operations Manager1
Data Center IT Technician1
Mechanical Design Engineer1
Generalist1
HPC Engineer1
Solutions Architect1
Data Center Electrical Lead1
Pricing Director1
Manager, ML Solutions Architecture1
Senior Technical Project Manager1
Accountant1
Product Growth Analytics Lead1
Group Product Manager1
Infrastructure Security Engineer1
Senior Research Scientist1
GTM Recruiting Manager1
Technical Due Diligence Manager1
Technical Support Engineer1
Data Engineer1
Machine Learning Engineer1
Mechanical Data Center Technician1
Sales Engineer1
Senior Software Developer1
AI/ML Specialist Solutions Architect1
Instructional Designer1
Vendor Security & Standards Manager1
ML Solutions Architect1
Physical Security Systems Technician1
Mechanical Engineer1
Vulnerability Operations Center Lead1
IT Risk and Control Manager1
VP of Strategic Sales1
Human Resources Specialist1
Educational Content Author1
Offensive Security Lead1
Data Center Logistics Specialist1
Financial Controller1
Applied ML Engineer1
Field Technical Lead1
Data Center Facilities Manager1
Principal1
Systems HPC Engineer1
Backend Engineers1
Current role-level mix at Nebius B.V. on JobCrawls
Role levelActive listings
Mid-Level387
Senior67
Manager14
Executive3

Help us improve JobCrawls — sign in to sync saved jobs across devices, or send feedback anytime.