Sr. Databricks Lead/Architect
Location: Boston, MA (5 days onsite)
Duration: 12 Months
Note: Need some local to Boston area.
Key Responsibilities
Customer & Stakeholder Engagement
- Act as the primary technical point of contact for customer stakeholders (Business, Product Owners, Architects, and IT Leadership).
- Lead requirements discovery workshops , solution discussions, and architecture reviews.
- Translate business requirements into scalable Azure Databricks based data architectures .
- Present architecture options, trade offs, and roadmaps to senior stakeholders and decision makers.
- Provide technical leadership during program inception, design sign off, and critical milestones .
- Design end to end data platforms using Azure Databricks, Azure Data Lake (ADLS), Delta Lake, and surrounding Azure services.
- Define lake house architectures supporting batch, streaming, and near real time use cases.
- Establish data modeling standards (bronze/silver/gold layers, dimensional models, curated data marts).
- Ensure solutions align with security, governance, performance, and cost optimization best practices .
- Define integration patterns with upstream and downstream systems (APIs, Kafka/Event Hub, Power BI, Azure Synapse, ML workloads).
- Support cloud migration, modernization, and legacy platform replacement initiatives .
- Review and validate offshore team deliverables for architecture adherence, quality, and performance .
- Resolve technical blockers and guide te ams on complex implementations.
- Enforce coding standards, CI/CD practices, and reusable frameworks .
- Ensure ontime, high quality delivery aligned with customer expectations.
- Drive DevOps enablement (Azure DevOps, Git, CI/CD pipelines).
- Establish monitoring, logging, and cost optimization strategies.
Technical Skills
- Strong hands on expertise with Azure Databricks (Spark, Delta Lake, Unity Catalog) .
- Deep experience with:
- Azure Data Lake Storage (ADLS Gen2)
- Azure Data Factory / Synapse Pipelines
- Streaming (Kafka / Event Hub / Structured Streaming)
- Python, SQL, Spark optimization
- Solid understanding of data warehousing, lakehouse, and analytics architectures .
- Experience with Power BI or other BI/analytics tools .
- Familiarity with ML/AI integration with Databricks is a plus.
- Proven experience working directly with customers in an onshore role .
- Strong communication, presentation, and stakeholder management skills.
- Experience managing distributed / offshore delivery teams .
- Ability to balance hands on architecture work with leadership responsibilities .
- Strong ownership mindset and decision making ability.
- 10+ years in data engineering / data architecture roles.
- 5+ years designing solutions on Azure data platforms.
- 3+ years in a technical lead or solution architect role .
- Azure or Databricks certifications preferred.
Recommended Jobs
Accounts Payable & Payroll Accountant
Job Title: Accounts Payable & Payroll Accountant Location (city, state): Rockland, MA Compensation: $80,000-$85,000 Benefits: Health, Dental, and Vision coverage. 401k eligibility. We …
Deli Manager
Position Title: Deli Manager Department: Deli Supervisor: Assistant Branch Manager/Branch Manager FLSA: Exempt Position Summary: Responsible for receiving product and ensures that ai…
PR Assistant Account Executive - Tech
Public Relations Assistant Account Executive, Tech Boston, MA; Newburyport, MA; Providence, RI; Dallas, TX; Rochester, NY Hybrid: In office Mon-Thurs, Remote - Fri Matter is an independent a…
Cost Accounting Manager
About the Wellness Pet Company The Wellness Pet Company is on a mission to help the next generation of pet parents fulfill a shared life of wellbeing with their pets through a foundation of proven n…
Psychiatrist - Director
Mission Centered Federally Qualified Community Health Center is looking a Director of Psychiatrist in the Boston MA area! The position is partially remote (2 days can be done from home, 3 days fro…
Analyst II Assortment Tools & Analytics
Category/Area of Expertise: Merchandising Marketing Support Job Requisition: 479187 Address: USA-MA-Quincy-1385 Hancock Street Store Code: Assortment Services (5139442) Ahold Delhaize US…
Non-CDL DRIVERS (Class E)
**ONSITE JOB OFFERS!!!** Hiring Drivers We are the largest independently owned local residential moving and storage company. We pride ourselves on taking care of our customers and …
Resource Support Assistant
Why Seyfarth: At Seyfarth, we understand that great people are the key to our success, and we provide the opportunities to match. If you join us, you’ll work in a friendly and professional …
Senior Systems Administration Lead
Job Title: Senior Systems Administration Lead Location-Type: Hybrid (3 days onsite in Boston, MA) Start Date Is: ASAP Duration: 3–6 months (contract) Compensation Range: $45/hr – $55/h…
Jewelry Sales Consultant
Jewelry Sales Consultant- Chestnut Hill Our Jewelry Sales Consultants provide an exceptional experience for every Brilliant Earth customer. As a Jewelry Sales Consultant you will guide the custome…