Job alerts, saved jobs and deadline reminders on your phone

Open app

Software Engineer, Distributed Systems

Distributed Systems Software Engineer

Posted Mar 13 (249 days ago)

Key facts

Senior systems role building global AI inference and GPU infrastructure; requires 3+ years in production systems.

How this salary compares

€13,145 - €18,257

Good pay229% above our estimate

The marked figures are our estimate for this job if its ad stated no pay.

Est. take-home €7,417 - €9,919

Where and how
Global
Work model
On-siteHybridRemote
Level
Languages required
English
Experience
3 years experience

Original job ad

fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and do it at scale without compromise. For developers and enterprises, fal is the foundation that makes generative media not just possible, but practical: a unified platform where high-performance inference, orchestration, and observability come together to unlock new categories of AI-native products. As generative media reshapes industries across a market projected to grow by hundreds of billions over the next decade, fal is becoming the ecosystem that ambitious teams build on. ABOUT THIS ROLE: You are an experienced software engineer who is passionate about building large-scale computing platforms. You have experience building systems that remain reliable under high traffic, partial failures, and changing capacity. You know how to deliver reliability, performance, and scale with minimum operational load. WHAT YOU'LL DO: - Take ownership of one or more of the Rust/Python systems that power our AI inference and large-scale GPU computing platform - Design for 100x growth in workloads and GPU capacity, with reliable, low-latency execution across the globe - Use AI aggressively to accelerate development and automate repetitive operations, alerting, and recovery You will specialize in one or more of these critical areas: - Request routing and queuing on a global scale - App deployment and autoscaling - Worker orchestration and placement - GPU fleet autoscaling and capacity management - GPU fleet lifecycle automation: provisioning, diagnostics & recovery, upgrades, tracking - Global file storage, caching and distribution - Global IP backbone: private networking across datacenters, elastic public IPs, ACLs/firewalls, private connectivity - Workload execution: containerization, globally distributed filesystems, RAM/VRAM snapshotting QUALIFICATIONS/NICE TO HAVE: - 3+ years building and operating large-scale production systems, with a track record of reliability and scale - Strong Rust and/or Python skills - Strong systems fundamentals, with technical depth relevant to your specialization: distributed coordination, scheduling, fault tolerance, Linux, networking, storage, or capacity management - Experience building and using observability to drive performance and reliability decisions - Clear communication, sound technical judgment, and the initiative to move quickly, drive decisions across teams, and own systems from design through production - Multi-tenant compute platforms, AI inference or training infrastructure, GPU workload scheduling - High-performance systems programming: async runtimes, zero-copy, memory-safe concurrency - Linux systems engineering and fleet automation: configuration management, kernel and driver debugging, safe upgrades, and automated recovery - Distributed filesystems like JuiceFS and Lustre - Experience with Nvidia/AMD GPU infrastructure; DCGM, NVLink, RDMA, InfiniBand/RoCEv2 - Global networking and routing: BGP, ECMP, tunnels, eBPF, Geneve WHAT WE OFFER AT FAL: - Interesting and challenging work - A lot of learning and growth opportunities - Regular team events and offsites U.S. EQUAL EMPLOYMENT OPPORTUNITY INFORMATION: fal provides equal employment opportunities to applicants and employees without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, or any other classification protected by applicable law.

About the role

Summarised by JobCrawls from the job ad above.

Requirements

  • At least 3 years building and operating large-scale production systems
  • Strong Rust and/or Python skills
  • Systems expertise relevant to the chosen specialization
  • Experience using observability to guide performance and reliability decisions
  • Clear communication, sound technical judgment and initiative

Responsibilities

  • Own Rust or Python systems powering AI inference and large-scale GPU computing
  • Design for major workload and GPU capacity growth
  • Ensure reliable, low-latency global execution
  • Use AI to accelerate development and automate operations, alerting and recovery
  • Specialize in one or more listed platform infrastructure areas

Skills & technologies

RustPythonDistributed CoordinationSchedulingFault ToleranceLinuxNetworkingStorage
Show 14 more
ObservabilityAsync RuntimesZero-copyMemory-safe ConcurrencyJuiceFSLustreDCGMNVLinkRDMAInfiniBand/RoCEv2BGPECMPeBPFGeneve

Benefits & perks

About Fal

Fal logo
Fal · 2 open roles
Top locations (all time): Remote - Global · 2
View company
Current open roles at Fal on JobCrawls
LocationActive listings
Remote - Global2
Current role mix at Fal on JobCrawls
Role typeActive listings
Distributed Systems Software Engineer1
Site Reliability Engineer1
Current role-level mix at Fal on JobCrawls
Role levelActive listings
Senior2
About the employer

fal builds infrastructure, tools and model access for generative media and AI products.

Never miss a new Distributed Systems Software Engineer job in Remote - Global

Weekly or daily digest. Unsubscribe anytime.

or

We'll email you a link to confirm. Confirming creates a free JobCrawls account for this address so you can manage your alerts. No password. Unsubscribe or delete it any time.