Azure Databricks Technical Lead

Role:

Azure Databricks Technical Lead

Duration:

3%2B Months (Contract with Possible Extension)

City:

Boston Area

State:

Massachusetts

Title:

Azure Databricks Technical Lead

Primary Skills:
Azure Databricks, PySpark, Spark SQL, Azure Synapse Analytics, Delta Lake, Azure Data Lake Storage (ADLS), Power BI, Python, Advanced SQL

Secondary Skills:
Oracle EBS R12, Oracle PBCS, Data Warehousing, ETL/ELT Pipelines, Data Modeling, Performance Tuning, Lakehouse Architecture, Offshore Team Leadership, Client Stakeholder Management

Total Required Experience in Years: 12%2B Years

Mode of Work: Remote (Occasional Travel Required)

Job Description:

Seeking an experienced Azure Databricks Technical Lead to drive the design, architecture, and implementation of a modern Azure Data Platform. The consultant will work closely with client stakeholders, provide technical leadership, architect scalable data solutions, and mentor offshore development teams.

The ideal candidate will possess deep expertise in Azure Databricks, Azure Synapse Analytics, Lakehouse architecture, enterprise data warehousing, and Power BI while serving as the primary technical lead for client-facing engagements.

Key Responsibilities:

• Lead Azure Databricks architecture, development, and implementation activities.

• Design and develop scalable ETL/ELT pipelines using PySpark and Spark SQL.

• Build and optimize Lakehouse solutions using Delta Lake and Azure Data Lake Storage (ADLS).

• Design enterprise-grade Azure Synapse Analytics data warehouse solutions.

• Develop and maintain Power BI semantic models, datasets, and dashboards.

• Integrate data from Oracle EBS R12 and Oracle PBCS source systems.

• Perform data modeling, SQL optimization, and performance tuning.

• Lead technical discussions, architecture reviews, and solution design sessions.

• Mentor and guide offshore development teams.

• Support deployment, testing, release management, and production stabilization activities.

• Collaborate with business stakeholders to define data platform requirements and solutions.

• Establish best practices for data engineering, governance, and performance optimization.

Required Skills:

• Azure Databricks

• PySpark

• Spark SQL

• Azure Synapse Analytics

• Delta Lake

• Azure Data Lake Storage (ADLS)

• Power BI

• Python

• Advanced SQL

• Data Warehousing

• ETL/ELT Development

• Data Modeling

• Performance Tuning

• Lakehouse Architecture

• Oracle EBS R12

• Oracle PBCS

• Technical Leadership

• Client-Facing Consulting

Preferred Skills:

• Enterprise Azure Data Platform Architecture

• Data Lakehouse Implementations

• Offshore Team Management

• Data Governance

• Cloud Data Migration

• Business Intelligence Architecture

• Solution Design Reviews

• Agile Delivery Methodologies

Required Qualifications:

• 12%2B years of Data Engineering, Data Warehousing, or Data Architecture experience.

• Expert-level experience with Azure Databricks.

• Strong experience with PySpark and Spark SQL.

• Experience designing Azure Synapse Analytics solutions.

• Experience building Lakehouse architectures using Delta Lake and ADLS.

• Strong Power BI development and semantic modeling experience.

• Experience integrating Oracle EBS R12 and Oracle PBCS data sources.

• Advanced SQL and performance tuning expertise.

• Strong communication and stakeholder management skills.

• Experience leading technical teams and architecture discussions.

Preferred Qualifications:

• Experience leading enterprise Azure Data Warehouse initiatives.

• Experience managing offshore development teams.

• Strong consulting and client engagement experience.

• Experience supporting production deployments and stabilization activities.

• Azure certifications preferred.

Deliverables:

• Azure Data Platform Architecture

• Databricks ETL/ELT Pipelines

• Lakehouse Solutions

• Azure Synapse Data Warehouse Designs

• Power BI Dashboards and Semantic Models

• Data Integration Frameworks

• Technical Design Documents

• Performance Optimization Reports

• Deployment and Release Documentation

• Knowledge Transfer Documentation

• Production Support Documentation

Education:

• Bachelor\'s Degree in Computer Science, Information Systems, Engineering, Data Science, or related field.

Certifications:

• Microsoft Azure Certifications (Preferred)

• Databricks Certifications (Preferred)

• Azure Data Engineer Associate (Preferred)

• Azure Solutions Architect Expert (Preferred)