Data Engineer

Job Title: Data Engineer - AI Platform

Location: Boston, Chicago, New York City, San Francisco, Silicon Valley, Washington DC

Number of openings: 1

Experience: 5+ years of professional experience as a data engineer

Salary: $165,000 - $175,000

Clearance: Secret (prefer TS)

Position Summary

We are hiring a skilled Data Engineer to contribute to the development of a sophisticated AI-powered platform that supports advanced, data-driven solutions. This role offers the opportunity to work on cutting-edge initiatives involving generative AI, large-scale data systems, and cloud-native architectures.

You will partner with a multidisciplinary team of engineers, data scientists, and product stakeholders to design and implement scalable data infrastructure. The primary focus will be enabling platform capabilities tailored for government and defense-related environments.

Key Responsibilities

• Design and build robust data ingestion and processing pipelines to support AI and GenAI applications

• Develop and maintain high-quality Python-based data workflows , including testing and validation

• Collaborate with cross-functional teams including software engineers, data scientists, and UI/UX designers

• Implement and enhance CI/CD pipelines (including GitHub Actions) to streamline deployment and integration processes

• Work across multi-cloud environments (AWS primarily; exposure to Azure and GCP is beneficial)

• Utilize containerization technologies (Docker) to support scalable and portable deployments

• Contribute to the development and optimization of data systems used by generative AI applications

• Ensure performance, reliability, and scalability of data pipelines through monitoring and diagnostics

What You'll Experience

• Opportunity to work on high-impact AI platform initiatives

• A fast-paced, performance-driven environment with strong technical mentorship

• Continuous learning through structured development programs and real-world problem solving

• A collaborative culture that values innovation, ownership, and diverse perspectives

• Exposure to globally distributed teams and modern engineering practices

• Competitive compensation along with a comprehensive benefits package

Required Qualifications

• U.S. Citizenship is required

• Prior experience supporting defense or government environments , including handling classified or sensitive data

• Active Secret clearance required (Top Secret or higher preferred)

• 5+ years of experience in data engineering, with a strong focus on cloud-based solutions

Technical Skills & Expertise

• Strong proficiency in Python for data engineering and pipeline development

• Hands-on experience with AWS-based data engineering (experience with Azure or GCP is a plus)

• Deep understanding of data modeling , data ingestion frameworks , and pipeline architecture

• Experience working with knowledge graphs , particularly using Neo4j , and familiarity with relational databases

• Expertise in writing clean, maintainable, and testable code, including automation and error handling best practices

• Practical experience with Docker and containerized workflows

• Strong background in data pipeline performance tuning, monitoring, and troubleshooting

• Excellent analytical and problem-solving capabilities

• Effective communication skills and ability to collaborate within cross-functional teams