Databricks Solution Architect at Bounteous
Job Description
📋 Description
- Architect and lead enterprise lakehouse on Databricks (Delta Lake, Unity Catalog).
- Design scalable batch and streaming pipelines with PySpark, Spark SQL, Delta Live Tables.
- Define platform standards for data modeling, CI/CD, code quality, testing, and observability.
- Lead governance using Unity Catalog; data lineage, access control, audit, and PII.
- Optimize Spark workloads for performance and cost: clustering, Photon, tuning.
- Mentor data engineers; lead architecture reviews and engineering standards.
🎯 Requirements
- 8+ years data engineering experience, 4+ years building production workloads on Databricks.
- Deep expertise in Apache Spark (PySpark, Spark SQL); performance tuning, partitioning, Catalyst/Photon.
- Hands-on with Delta Lake, Unity Catalog, Databricks Workflows, and Delta Live Tables.
- Production cloud experience on AWS, Azure, or GCP; networking, IAM, storage (S3/ADLS/GCS).
- Proficiency in Python and SQL; Scala is a plus.
- Experience designing medallion architectures and dimensional models.
More Current Jobs at Bounteous
Apply to other open positions at Bounteous
