Software Engineer, Pretraining Data

📋 Description

• Build the platform that turns raw web, code, multimodal, and acquired data into training-ready
• Own the pipelines, orchestration, and tooling that make pretraining data iteration fast, reliable
• Create clear signals for data quality, lineage, freshness, and pipeline health so researchers can
• Partner with initial training, crawling, data quality, and acquisition teams to turn new data ideas
• Build and own high-throughput, fully telemetered data pipelines that process frontier-scale data
• Train and ship models that classify, rank, filter, clean, and identify data at extreme throughput

🎯 Requirements

• Minimum of 3 years of software engineering experience
• Software engineering experience building distributed systems and/or large-scale data infrastructure
• Able to architect and ship end-to-end with high ownership, debug complex systems independently, and
• Strong intuitions about large-scale distributed systems
• Excited to learn how pre-training data shapes model quality
• Onsite role: must be able to work in person at the Palo Alto office

🎁 Benefits

• Equity
• Comprehensive medical coverage
• Vision coverage
• Dental coverage
• 401(k) retirement plan
• Short & long-term disability insurance