Databricks Lakehouse Lead

Description:

We are seeking an experienced Databricks Lakehouse Lead / Architect to drive enterprise data architecture, Lakehouse platform administration, data engineering, governance, and production pipeline optimization.

🔹 MUST-HAVE SKILLS
✅ Databricks Lakehouse Architecture & Leadership
✅ Databricks Workspace Administration
✅ PySpark & Spark SQL
✅ Delta Lake
✅ Unity Catalog & Data Governance
✅ AWS / S3 Integration
✅ Auto Loader & Structured Streaming
✅ CI/CD & Production Data Pipelines
✅ MLflow
✅ Performance Optimization & Workflow Orchestration

🔹 KEY RESPONSIBILITIES
• Lead Databricks Lakehouse architecture and implementation
• Manage Databricks workspaces and platform administration
• Develop scalable data pipelines using PySpark and Spark SQL
• Implement Delta Lake architecture and optimization strategies
• Configure Unity Catalog governance, access controls, and security
• Integrate AWS data services and S3 ingestion pipelines
• Implement Auto Loader and Structured Streaming solutions
• Optimize Spark workloads and production pipeline performance
• Manage CI/CD, deployment, and workflow orchestration
• Coordinate technical delivery and enterprise data initiatives

🔹 PREFERRED EXPERIENCE
⭐ Enterprise Data Architecture
⭐ Insurance Data Domain
⭐ Metadata Management & Data Modeling
⭐ Enterprise Data Integration
⭐ Security, Governance & Compliance