Data Engineer

At the MBTA, we envision a thriving region enabled by a best-in-class transit system. Our mission is to serve the public by providing safe, reliable, and accessible transportation. MBTA’s Core Values are built around safety, service, equity, sustainability, and culture. Each employee that works for the MBTA performs their roles based on our vision, mission, and values. This includes attendance, participation, and contribution in local safety committee meetings as needed.

Job Summary

The Data Engineer will be responsible for expanding, enhancing, and maintaining MBTA’s data warehouse and related infrastructure for effective utilization by internal and external stakeholders. The position will be a vital partner in implementing the MBTA’s broader data strategy. The role involves data warehouse management (including SQL-based programming to structure data flows and data sources, providing input on data architecture, as well as managing the Extract, Transform and Load (ETL) process, automated data flows, error handling, and other related tasks), and working closely with other members of the Information Management and Technology teams team to promote effective data utilization. This individual will ensure a positive end-user experience, application availability, and address errors efficiently, as well as oversee the mapping of data sources, data movement, interfaces, and analytics, with the goal of ensuring data quality.

Duties & Responsibilities

• Design, develop, and document ETL processes, technical architecture, data pipelines, and performance.
• Develop integration process data flows and data mapping analyses.
• Address application and data-related problems regarding systems integration, compatibility, and multiple-platform integration.
• Develop and promote data integration methodologies and standards.
• Develop and implement key components as needed to create testing criteria to guarantee the fidelity and performance of application and data architecture.
• Identify and develop opportunities for code and data reuse, migration, or retirement of systems.
• Work independently and collaboratively to identify issues, perform root-cause analysis that would lead to proper and timely issue resolutions.
• Take ownership over data flow errors, communicating about them and working to resolve them as efficiently as possible.
• Establish methods and procedures for tracking data quality, completeness, redundancy, and improvement.
• Work closely with the rest of the Business Intelligence team and other internal stakeholders to understand the needs of the business and build data resources to best meet those needs.
• Perform all other duties and projects that may be assigned.

Supervision

• No direct reports.

Minimum Requirements & Qualifications

• Bachelor’s Degree from an accredited institution in Computer Science, Information Systems, Business Administration or another related field.
• Three (3) years of experience in data engineering or a related role.
• Experience working within an application or Database Production support role and/or experience with scripting and object-oriented programming languages and/or experience with Relational Databases.
• Experience using ETL tools in a data analyses, data engineering, or similar role.
• Business Intelligence (BI) knowledge with exposure to BI from an ETL perspective.
• Demonstrable experience SQL and core data management principles (such as ETL/ELT, data warehousing architecture, query design, and performance tuning).
• Experience defining/modeling/implementing an Enterprise Data Warehouse using best practices.
• Experience with database schema, objection management, data modeling & architecture, and data warehouse design.
• Experience with interactive reporting platforms (Tableau, Power BI, etc.).
• Proven track record of self-starting and growth in related field(s).
• Developing and maintaining formal documentation that describes data and data structures including data modelling.
• Superior attention to detail skills and an ability to think critically and conceptually.
• Team oriented and flexible with proven track record in collaborating with multiple stakeholders.
• Strong verbal and written skills.
• Ability to quickly learn new technologies.

Substitutions Include

• A High School Diploma or GED with an additional seven (7) years of directly related experience substitutes for the Bachelor’s degree requirement.
• An Associate’s degree from an accredited institution an additional three (3) years of directly related experience substitutes for the Bachelor’s degree requirement.
• A Master’s degree in a related subject substitute for two (2) years of general experience.
• A nationally recognized certification, or statewide/professional certification in a related field substitutes for one year of experience

Preferred Experience and Skills

• Hands-on experience and expertise in Advanced SQL, Advanced Python programming, AWS Services (such as S3, Redshift, Glue ETL, IAM, DMS, Appflow, VPC and others), SnowFlake, FiveTran, Informatica, KAFKA, Airflow, Oracle Cloud and other open-source tools.
• Six (6) years of DWH experience.
• Three (3) years of exposure to Business Intelligence (BI) from an ETL perspective.
• Six (6) years of ETL development experience.
• Three (3) years of Cloud based technological experience.
• Proficiency with interactive reporting platforms (Tableau, Power BI, etc.).
• Proven success with documentation of processes, distributing to end-users and supporting those users.
• Five (5) years' experience with advanced data management systems (e.g., PostgreSQL, etc.).
• Deep expertise in data modeling and structuring using Python/R.
• Experience with systems migration experience is highly desirable.
• Experience in high volume data environments.

Job Conditions:

• Ability to effectively read, comprehend, communicate, and respond to instructions, orders, signs, notices, inquiries, etc. in English.
• Be at least eighteen (18) years of age, except if participating in an approved high school internship / co-op program.
• Ability to commute to assigned work locations in the Boston, MA metro area, as required by the role.
• Ability to provide internal and external customers with courteous and professional experiences.
• Ability to work effectively, independently, and as part of a diverse workforce team (or supervise, if required).
• Ability to uphold the rights and interests of the MBTA while building and maintaining effective relationships with employees and co-workers.
• Ability to adhere to rules, regulations, collective bargaining agreements (if applicable), and policies of the MBTA, including the EEO, anti-discrimination, anti-harassment, and anti-retaliation policies.
• Have a satisfactory work record for the two (2) years immediately prior to the closing date of this posting (unless if current student or recent graduate), including overall employment, job performance, discipline, and safety records (infractions and/or offenses occurring after the closing of the posting and before the filling of a vacancy may preclude a candidate from consideration for selection).
• Ability to pass a Criminal Offender Record Information (CORI) check, comprehensive background screening, and / or medical Clinic screening, potentially including physical examination and drug and alcohol screenings.
• Ability to work all shifts and / or locations assigned, directed, or necessary for this position, including (for some transit / operations roles) up to twenty-four (24) hours per day, seven (7) days per week as necessary to accommodate severe weather conditions, emergencies, or any other circumstances that may potentially impact service or the safety of service.
• Intern / co-op staff must be enrolled full or part-time in an accredited educational program and maintain a cumulative GPA of at least 2.5 for the entire duration of the internship / co-op. Additionally, interns / co-ops must have valid work authorization and U.S. Social Security Number prior to starting pre-employment screenings / pre-boarding, working in their positions, and throughout the duration of their program.

Disclaimers and Definitions:

• General Disclaimer: The statements contained in this job description are intended to describe a summary, general nature, and complexity of typical job functions and do not represent an exhaustive list of all duties, tasks, and responsibilities required of staff assigned to this position.

• Application Completion: It is each applicant’s responsibility to ensure application details are entered completely and correctly, including updated work and education histories (past and current). Incomplete applications may not be considered. Attachments do not substitute for application fields. The recruitment team does not have access to existing employee data / history.

• Application Deadlines: Applicants should apply as soon as possible, as the MBTA may stop considering applicants after a sufficiently large applicant pool is established.

• Work Environment: The physical demands and work environment characteristics described here-in are representative of those an employee may encounter while performing the essential functions of this job. Reasonable accommodations can be made to enable individuals with disabilities to perform essential functions. See job description for role-specific requirements.

• Work Eligibility: All employees must be legally authorized to work in the United States and on an unrestricted basis. The MBTA does not have an employer work sponsorship program. However, if you have unrestricted work authorization, or are sponsored by a separate entity, you are welcome to apply. Further, all persons hired will require a U.S. Social Security Number prior to starting the position and employees will be required to complete a Form I-9 to verify their identity and eligibility to work in the U.S.

• Interviews: Candidates should ensure they arrive on time, are prepared, can remain for the duration, and if remote, are in a quiet place without distraction, for the interview. Candidates who do not attend their interview without advance authorization, including an email confirmation of a rescheduled time/date from Human Resources, will be considered a no-show and disqualified from consideration for the position. Related to rescheduling, on a one-time basis, and due to something emergent, you may be allowed to reschedule the interview. In addition, Human Resources may require documentation supporting the request. However, should you need to reschedule, you will need to contact your Recruiter directly by email.

• Safety Sensitive Positions: Employees working in this classification will be subject to periodic physical examinations plus random drug and alcohol testing.

• On-call or 24/7 Positions: Employees working in this classification must be available to respond to page / text / call and report to work as determined by assigned department or the Authority.

• Essential / Emergency Staff: During declared "states of emergency," employees working in this classification are required to report to work for their assigned work hours or as directed by management.

• ADA Accommodations: The MBTA makes reasonable accommodations for applicants with disabilities. If you require an accommodation during this process, please contact the MBTA's ADA Unit at 617-222-5751 or [email protected].

• Diversity, Equity, and Inclusion: The MBTA is an Equal Employment Opportunity Employer. For terms, descriptions, and definitions related to diversity, equity, inclusion, veteran status, and immediate family members that you may find on the application form, please visit mbta.com/careers-app-definitions.

• Intern / Co-Op Benefits: Employees taking part in an internship or co-op at the MBTA are eligible to receive accrued paid sick leave as well as a monthly transportation pass, based on the city from which the intern / co-op commutes to work, at no cost. However, no additional benefits are currently offered for interns or co-ops.