Senior Associate Data Engineer
Position Type: Hybrid
Hybrid Schedule: 4 days/week onsite
Contract Length: 7 months, contract-to-hire Position Overview:
This role involves designing, building, and optimizing modern data platforms that power intelligent, data-driven experiences for global clients. Responsibilities include enabling scalable ingestion, transformation, and storage of enterprise data across lakehouse and warehouse architectures while operating at the intersection of cloud, data engineering, and analytics. The position also includes close collaboration with architects, analysts, and product teams to ensure data solutions are reliable, high-performing, and aligned with business objectives. Duties:
- Design and implement end-to-end data ingestion pipelines using Azure services, including API-based ingestion and Azure Data Factory (ADF).
- Build and manage lakehouse and data warehouse solutions using modern data storage formats to support analytical and operational workloads.
- Develop and optimize data transformations using PySpark, ensuring scalability, performance, and cost efficiency.
- Apply medallion architecture (bronze, silver, gold layers) to enable high-quality, governed, and reusable datasets.
- Partner with cross-functional teams to support data modeling, analytics, and downstream consumption use cases.
- Contribute to best practices around data quality, reliability, and maintainability across the data platform.
- Hands-on experience or strong working knowledge of Microsoft Fabric, including its role in modern analytics and lakehouse architectures.
- Proven experience working in Azure for data ingestion and orchestration.
- Strong experience with Azure Data Factory (ADF) for pipeline development and scheduling.
- Experience building API-based data ingestion solutions.
- Solid understanding of data storage formats, including CSV, JSON, and Parquet.
- Experience designing and working with data warehouses and lakehouse architectures.
- Strong foundation in data modeling concepts for analytical workloads.
- Practical experience implementing medallion architecture patterns.
- Proficiency in PySpark for large-scale data transformations and optimization.
- Ability to write clean, maintainable, and well-documented data pipelines.
- Experience optimizing Spark jobs for performance and cost in cloud environments.
- Familiarity with data governance, data quality, or observability practices in large-scale data platforms.
- Experience collaborating with analytics, data science, or AI teams on production-grade data solutions.
- Exposure to agile delivery models and working in cross-functional, client-facing teams.
Recommended Jobs
Admissions Director
Overview: At Genesis Healthcare, we are dedicated to improving the lives we touch through the delivery of high-quality care and exceptional service. As a leading provider in the long-term care indust…
Estimator
Job Details: Construction Estimator Join a forward-thinking company where your skills in estimating will be highly valued and contribute to exciting projects on a grand scale. We offer a dynami…
Junior Accountant
Job Description Job Description AgeSpan About Us: Since 1974 our agency has strived towards supporting an individual's desire to make their own decisions, secure their independence and remain…
Robotics Engineer (Software and Controls), Unmanned Maritime Systems
Job Description Job Description Robotics Engineer (Software and Controls), Unmanned Maritime Systems Company Summary Triton Systems, Inc combines 30+ years of experience with exciting growt…
Inside Parts Sales & Customer Service Representative - $65k+ Potential
Job Description Job Description Description: Advantage Truck Group – Westfield, MA Are you a driven problem-solver with a great attitude? Ready to build a high-paying career that doesn't re…
Marketing and Communications Internship
The International Institute of New England is a 501(c)(3) non-profit serving refugees and immigrants in Boston, MA, Lowell, MA, and Manchester, NH. The Institute offers internships to students, gradua…
Universal Banker I-Part-Time/20-25 hours
Job Description Job Description Role: The Universal Banker I provides exceptional member service by cultivating, maintaining, and enhancing lasting relationships with existing and prospective …
Legal Assistant
Job Description Job Description Legal Assistant Employment Type: Full-Time, Entry Level Department: Legal As a CGS Legal Assistant, you will work under the direction of a Supervisory …