Sr. Data Engineer
We are seeking a highly skilled Data Engineer with strong backend engineering expertise and solid finance/analytics domain knowledge. This role is focused on building, optimizing, and maintaining scalable data pipelines, improving data architecture, enhancing operational reliability, and driving data quality initiatives. The ideal candidate will have extensive experience with Python, PostgreSQL, AWS services, and modern data engineering practices, along with exposure to AI/RAG-based solutions.
- Contract Duration: 6+ Months
- Rate Range: $50-60/hr on W2
Responsibilities:
- Design, develop, optimize, and maintain scalable data pipelines and ETL/ELT workflows.
- Refactor and enhance existing data processing frameworks to improve performance and reliability.
- Perform extensive data validation, testing, and quality assurance across data platforms.
- Optimize SQL queries, database structures, and table performance within PostgreSQL environments.
- Implement and support backend services and APIs using Python and FastAPI.
- Develop and maintain data solutions leveraging AWS services including EKS and Lambda.
- Work with Parquet files and large-scale datasets to support analytics and reporting requirements.
- Improve overall data architecture, operational stability, and system performance.
- Maintain detailed task tracking, status reporting, and execution transparency through Excel-based project tracking.
- Proactively identify risks, communicate project status, and manage timelines effectively.
- Collaborate with business, analytics, and engineering teams to support data-driven initiatives.
- Contribute to AI and Retrieval-Augmented Generation (RAG) use cases and data integrations.
Required Qualifications:
- 6+ years of experience in Data Engineering, Backend Engineering, or related roles.
- Strong hands-on experience with Python development.
- Extensive experience with PostgreSQL and advanced SQL optimization.
- Experience building and maintaining ETL/ELT pipelines and data integration workflows.
- Strong knowledge of data engineering concepts, data modeling, and data architecture.
- Experience working with Parquet file formats and large-scale datasets.
- Hands-on experience with AWS services including EKS, Lambda, and cloud-native architectures.
- Experience developing APIs and microservices using FastAPI or similar frameworks.
- Strong data testing, validation, troubleshooting, and performance tuning skills.
- Excellent organizational skills with the ability to manage timelines, priorities, and status reporting.
- Strong communication skills and ability to work independently in a remote environment.
- Must be located within the EST time zone.
Required Skills
- Python
- PostgreSQL
- SQL
- AWS (EKS, Lambda)
- FastAPI
- ETL/ELT Development
- Data Testing & Validation
- Performance Optimization
- Parquet
- Data Architecture
- Backend Engineering
Technical Skills
- Python Development
- PostgreSQL Administration & Optimization
- SQL Query Performance Tuning
- AWS Cloud Services
- FastAPI
- Data Pipeline Development
- Data Quality & Validation
- Parquet Data Processing
- API Development
- Data Architecture & Reliability Engineering
Preferred Qualifications
- Experience within financial services, investment management, analytics, or related domains.
- Experience with AI solutions and Retrieval-Augmented Generation (RAG) frameworks.
- Familiarity with machine learning data pipelines and AI-powered applications.
- Experience working in highly data-intensive environments.
- Strong understanding of operational monitoring and reliability practices.
#LI-NC5
Recommended Jobs
Neurointerventional Radiology Physician Assistant
Boston Medical Center (BMC) is more than a hospital. It's a network of support and care that touches the lives of hundreds of thousands of people in need each year. It is the largest and busiest prov…
Restaurant Manager
Job Description Job Description Benefits/Perks Flexible Scheduling Competitive Compensation Career Advancement Opportunities Job Summary We are seeking an experienced Restaurant M…
Assistant Deli Manager
Position Title: Assistant Deli Manager Department: Deli Supervisor: Deli Manager FLSA: Full-Time, Hourly, 8-10 hour shift, Overtime Restaurant Depot is a wholesale cash-and-carry foodse…
Urgent Care Clinician
Position Summary The Urgent Care Clinician will work in a community behavioral health setting, providing services for children, adults and families who are in crisis and experiencing a mental heal…
Primary Care Physician (PCP)
Primary Care Physician Lynn, Massachusetts We’re hiring a Primary Care Physician in Lynn, Massachusetts who wants to practice high-quality geriatric medicine in a mission-driven outpatient sett…
Cannabis Dispensary Retail Associate (Budtender)
The Cannabis Retail Associate (referred to as budtender) is responsible for providing outstanding service and assistance to the patients and guests visiting our dispensary operations in Framingham, MA…
Diesel Truck Mechanic - Stoughton, MA
Job Description Job Description Diesel Direct is currently seeking a full-time Diesel Truck Mechanic for our Stoughton, MA location. Duties include working on fleet delivery vehicles and customer…
Marcotte Ford General Application
Join the Marcotte Ford Team and become part of the Marcotte Ford Family!! We are a family owned and operated Ford Dealership with 100+ employees! We are excited our campus continues to grow! If you …
Road Service Diesel Technician *No Weekends
Location: Agawam, MA Schedule: Monday–Friday | 8:00 AM–4:30 PM | No Weekends & No On-Call Pay: Up to $40/hr + Monthly Bonuses Road Service Diesel Technician FleetPride is seeking…
Certified Medical Assistant - Per Diem
Job Description Job Description Who we are: EHE Health is the leading national preventive healthcare provider network partnering with mid- and large-sized employers to help their employees and…