Lead Data Engineer

C The Signs
Boston, MA

We are seeking a Lead Data Engineer to architect, build, and scale our next-generation healthcare data platform. In this role, you will lead the effort to design robust pipelines, modernize data architecture, and ensure high-quality ingestion and transformation of clinical and operational data. You’ll collaborate closely with product, analytics, clinical informatics, machine learning, and engineering teams to deliver trusted, timely, and compliant insights.

This is a hands-on leadership role ideal for someone who enjoys setting technical direction while still contributing code and guiding stakeholders through complex healthcare data challenges.

Responsibilities

Architecture & Strategy

  • Lead design and evolution of our cloud-native data platform built primarily on Google Cloud Platform, including BigQuery, Cloud Storage, Pub/Sub, Cloud Run, Airflow (Cloud Composer), and Healthcare API.
  • Inform strategic decisions around multi-cloud or AWS interoperability when needed.
  • Establish data engineering best practices, coding standards, and architectural patterns.

Pipeline Development

  • Build scalable ETL/ELT pipelines using dbt for transformations and Airflow for orchestration.
  • Develop ingestion pipelines for clinical and administrative data in HL7, FHIR, DICOM, and custom formats.
  • Develop ingestion and transformation pipelines to be used for AI/ML development and model training.
  • Implement streaming and batch dataflows using Pub/Sub, Dataflow, and serverless compute.
  • Support or guide integrations with AWS-based partner systems or AWS-hosted data sources when applicable.

Data Modeling & Warehousing

  • Design and maintain BigQuery datasets, semantic layers, and warehouse structures.
  • Leverage industry standards such as FHIR resources for canonical healthcare models.
  • Provide guidance on data modeling and warehouse best practices across both GCP and AWS ecosystems.

Data Quality, Observability & Governance

  • Implement data quality frameworks, automated testing, and monitoring.
  • Ensure HIPAA compliance and proper handling of PHI/PII across all pipelines and cloud environments.
  • Drive lineage, documentation, metadata governance, and dbt docs adoption.

Leadership & Collaboration

  • Partner with analytics, product, clinical informatics, and security teams to deliver high-quality, trustworthy data products.
  • Provide oversight and technical direction for multi-cloud data integrations with AWS-based systems or partners.
  • Assist in the recruitment and development of junior data engineers
  • 7+ years of data engineering experience; 2–3+ years in a lead or senior technical role.
  • Deep, hands-on expertise in GCP, particularly:
    • BigQuery
    • GCP Healthcare API (FHIR and DICOM stores)
    • Cloud Storage, Pub/Sub, Cloud Run/Functions
  • Strong proficiency with:
    • dbt (Core or Cloud)
    • Airflow (Cloud Composer or self-managed)
    • Python and advanced SQL (BigQuery preferred)
  • Hands-on experience with healthcare standards:
    • FHIR (R4/US Core), HL7 v2/v3, DICOM, C-CDA, X12
  • Strong understanding of PHI handling, HIPAA compliance, and healthcare interoperability.

Preferred

  • AWS experience, especially with:
    • Redshift, Lambda, S3, Glue, Kinesis, Athena, API Gateway, Step Functions
  • Experience building or maintaining multi-cloud pipelines bridging GCP and AWS.
  • Background with Dataflow/Beam or other stream processing frameworks.
  • Experience working with EHR integrations, claims processing, HIEs, or clinical data networks.
  • Familiarity with ML-enabled data pipelines or feature engineering in healthcare contexts.

Why Join Us?

Joining C the Signs is not just about building AI; it’s about shaping the future of healthcare. If you are a technical leader with an unshakable belief in the power of AI to save lives and the ability to make it happen at scale, this is your opportunity to create a tangible, global impact.

Benefits:

  • Competitive salary and benefits package.
  • Flexible working arrangements (remote or hybrid options available).
  • The opportunity to work on life-changing AI technology that directly impacts patient outcomes.
  • Join a team that combines cutting-edge innovation with a mission to save lives and improve health equity.
  • Continuous learning opportunities with access to the latest tools and advancements in AI and healthcare.
Posted 2025-11-25

Recommended Jobs

Python API Engineer Contract

Cloud Analytics Technologies LLC
Boston, MA

Full job description 6+ months contract Skill Requirements: We are looking for skilled Python API engineers with a strong background in backend development. The ideal candidate will have hands-on e…

View Details
Posted 2026-01-06

Membership Ambassador

The Boys & Girls Club of Marshfield
Marshfield, MA

Part-Time Membership Ambassador Boys & Girls Club of Marshfield Part-Time (As Scheduled Weekly) | $18–$22/hour (DOE) Job Summary The Membership Ambassador serves as the welcoming first…

View Details
Posted 2026-01-11

Medical Assistant

Cambridge Health Alliance
Somerville, MA

Requisition Number: 10765 Location:  Somerville Work Days: Various shifts Monday through Friday Category: Medical Assistant Department:  Broadway Family Health Job Type: Temporary Work Shift…

View Details
Posted 2025-12-20

Principal Product Manager, Unity AI

Unity Technologies
Boston, MA

Remote, USA Principal Product Manager, Unity AI Location Remote, USA Department Product Management Requisition ID JOBREQ-2514895 Role description The oppo…

View Details
Posted 2026-01-12

Sales Professional

Catchlight Painting
West Newton, MA

Job Opening at Catchlight Painting: Sales and Estimating Specialist Job Description Catchlight Painting, a leader in residential painting services, is excited to announce an opportunity for a ded…

View Details
Posted 2025-11-12

ICU Technician 36 Hours (Nights)

Boston Medical Center
Brighton, MA

ICU Tech, 36 hours/week, 7pm-7:30am, every third weekend required Job Summary – The ICU Technician functions under the direction of the Nurse Manager and/or Charge RN. He/she provides direct patien…

View Details
Posted 2025-12-17

Senior Manager, Feasibility

Takeda Pharmaceutical (US)
Boston, MA

By clicking the “Apply” button, I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda…

View Details
Posted 2026-01-12

Material Handler

Manufacturing Inc
Worcester, MA

We are looking for a proactive and organized Material Handler to manage the flow of goods within our facility. In this role, you will be the backbone of our logistics operations, responsible for the …

View Details
Posted 2026-01-05

Manufacturing Test Engineer

Anduril Industries
Lexington, MA

ABOUT THE JOB As a Production Test Engineer you will be responsible for ensuring that we are testing our systems to stringent standards ensuring that we are consistently shipping the highest qua…

View Details
Posted 2026-01-07