Senior Software Engineer (Data Platform)

📋 Description

• Lead the design and implementation of internal SDKs and self-service frameworks that enable
• Shift from 'pipeline building' to 'platform engineering,' creating reusable patterns for batch and
• Take full ownership of the cost-effectiveness of the Databricks ecosystem, tuning Spark execution
• Ensure the platform remains performant as volume grows, managing trade-offs between latency
• Implement Schema-on-Write validation and Data Contracts to ensure data from hundreds of internal
• Partner with the Data Architect & Data Stewards to enforce data privacy (PII), security

🎯 Requirements

• Scale Specialist: 5+ years of experience building and operating production-grade data systems at
• Databricks Expert: Deep, hands-on mastery of the Databricks/Spark ecosystem (Delta Lake, DLT, Spark
• Streaming Veteran: Proven track record of building Real-time/Streaming architectures (Spark
• Optimisation Mindset: Experience managing and optimizing cloud costs in a high-growth environment.
• Platform Thinker: Experience building APIs, tools, or frameworks used by other internal engineering

🎁 Benefits

• Generous paid parental leave
• Flexible time off
• Spending accounts
• Medical insurance
• Dental insurance
• Vision insurance