Data Engineer II
Overview
The Data Engineer II helps advance oncology research and patient care by enabling the generation, management, and interpretation of clinical and research data at Dana-Farber Cancer Institute in collaboration with Boston Children’s Hospital and other partners. This role contributes to the development and maintenance of databases, scalable ETL pipelines, automated quality monitoring, and the integration of data into consumer applications while leveraging cloud infrastructure and APIs.
The Data Engineer II translates stakeholder requirements into data resource designs, documents data lineage, and builds metrics and dashboards to optimize ETL performance and data quality. This role also provides operational support, resolves incidents through root-cause analysis, and stays current on industry tools and best practices, consistently representing DFCI’s mission and patients. The Data Engineer II will contribute to the generation, management, and interpretation of data for DFCI’s portfolio of clinical decision support algorithms including Treatment Pathways and Symptom Management Pathways. Treatment pathways are evidence-based decision trees built to help providers choose the best care for their patient based on the patient’s disease and condition. Symptom Management pathways are algorithms built to help manage side effects of cancer treatment. Reporting to the Lead Data Engineer, this role is a data team member supporting the Solutions Team within the Business Strategy department at DFCI. The responsibilities of the Data Engineer include contributing to the development and maintenance of a variety of data resources and ensuring high quality data are consistently delivered to Data Analysts and other team members who rely on data to perform their roles. Located in Boston and the surrounding communities, Dana-Farber Cancer Institute is a leader in life changing breakthroughs in cancer research and patient care. We are united in our mission of conquering cancer, HIV/AIDS, and related diseases. We strive to create an inclusive, diverse, and equitable environment where we provide compassionate and comprehensive care to patients of all backgrounds, and design programs to promote public health particularly among high-risk and underserved populations. We conduct groundbreaking research that advances treatment, we educate tomorrow's physician/researchers, and we work with amazing partners, including other Harvard Medical School-affiliated hospitals.
Primary Duties and Responsibilities
- Understand data consumer requirements and translate them to data resource designs
- Develop and maintain databases and ETL processes for large-scale data ingestion from various data sources
- Develop and maintain data pipeline monitoring to ensure optimal ETL execution and highest data quality; develop metrics and dashboards to monitor and improve ETL data pipelines
- Document data pipelines and transformations so data consumers can understand data lineage
- Leverage cloud infrastructure and Application Programming Interfaces (APIs) where appropriate
- Stay current with industry trends and technologies, and evaluate and adapt new tools as needed
- Provide operational support for data platforms, including resolving incidents and performing root cause analysis
- Ability to represent the interests and mission of DFCI consistently and ethically and act on behalf of its current and future patients
Knowledge, Skills and Abilities
- Expert with SQL programming language and exploration
- Proficient with data warehousing and ETL pipelines
- Proficient with Excel and other Microsoft Office tools
- Proficient with Python
- Familiar with SDLC and understanding of cloud computing concepts
- Familiar with project management practices
- Familiar with writing technical requirements and specifications
- Understanding of software engineering practices such as code review, version control, testing, and continuous integration/continuous deployment (CI/CD)
- Proficient with R, Scala, Java, or another modern programming language used in data engineering (preferred, but not required)
- Hands-on experience with clinical data (preferred, but not required)
- Hands-on experience with Business intelligence tools (i.e., Tableau, neo4j, or R Shiny) (preferred, but not required)
Minimum Job Qualifications
- Bachelor’s Degree in Data Engineering, Computer Science, Biomedical Informatics, Health Services Research, Epidemiology, Biostatistics, or Public Health required.
- 2 years of hands-on SQL programming and data warehousing experience required.
License/Certification/Registration Required: None
Supervisory Responsibilities: No
Patient Contact: No
At Dana-Farber Cancer Institute, we work every day to create an innovative, caring, and inclusive environment where every patient, family, and staff member feels they belong. As relentless as we are in our mission to reduce the burden of cancer for all, we are committed to having faculty and staff who offer multifaceted experiences. Cancer knows no boundaries and when it comes to hiring the most dedicated and compassionate professionals, neither do we. If working in this kind of organization inspires you, we encourage you to apply.
Dana-Farber Cancer Institute is an equal opportunity employer and affirms the right of every qualified applicant to receive consideration for employment without regard to race, color, religion, sex, gender identity or expression, national origin, sexual orientation, genetic information, disability, age, ancestry, military service, protected veteran status, or other characteristics protected by law.
.Pay Transparency Statement
The hiring range is based on market pay structures, with individual salaries determined by factors such as business needs, market conditions, internal equity, and based on the candidate’s relevant experience, skills and qualifications.
For union positions, the pay range is determined by the Collective Bargaining Agreement (CBA).
$101,300.00 - $129,400.00Recommended Jobs
Volunteer Opportunity (Hospice)
Job Description Job Description Overview Are you looking to make a meaningful impact in your community? Join Brookhaven Hospice's dedicated volunteer team and bring joy, comfort, and support t…
COOK (FULL TIME)
Job Description Job Description Location: American International College We are hiring immediately for full time COOK positions. Location: American International College - 1000 State Str…
Tax Manager
Head of Tax JOB TITLE Tax Manager EMPLOYMENT CLASSIFICATION Negotiable LOCATION Remote PITCH Prix Fixe Accounting is an industry leading accounting firm in the hospitality space, …
Senior Software Engineer, AI-Augmented Development
The Company Tutor Intelligence is building the technology and processes to let robots go where they've never gone before: the average American factory. We understand that general-purpose and gener…
Radiology Technologist - Full Time, 15k Sign-On Bonus!
At Boston Medical Center Brighton, we are committed to improving the health of our communities by delivering exceptional, personalized health care with dignity, compassion and respect. Our continued …
Substitute Teacher (hourly)
The Meadowbrook School of Weston, a pre-kindergarten through 8th grade school located in Weston, MA, seven miles west of Boston, is seeking substitute teachers for all grade levels for the 2024-2025 …
Manager Surgical Services, Clinical Transformation & Quality
POSITION SUMMARY : Reporting to the Senior Director of Surgical Services, the Surgical Services Manager is responsible for executing strategic initiatives and ensuring successful outcomes that op…
Remote Travel Consultant
As a Remote Travel Consultant, you’ll play a mission-critical role in supporting our clients from their very first trip idea all the way to their safe return home. You’ll be the steady, knowledgeable…
Licensed Clinician
Licensed Mental Health Clinician (LMHC, LMFT, LICSW) 📍 Peabody , MA | Hybrid, In-Person & Telehealth Options 🕒 Part-Time to Full-Time 💰 Up to $70/hour (based on billable services) Jo…
PW 10.5 MEO II Watchperson
Must Hold: Valid Class B CDL Driver’s License. At least One (1) year of experience as a truck driver. High school or GED. DEPARTMENT: Department of Public Works HOURS OF WORK: (40 hours/week)…