Senior Engineering Manager, ML Platform
- Own the strategy, roadmap, and execution for GPU compute infrastructure, ensuring it scales to meet growing model training and fine-tuning demands
- Contribute directly to infrastructure design and implementation, particularly in the near term as the team grows
- Drive reliability, performance, and cost efficiency across distributed training clusters. Optimize existing and new training workloads to achieve scale.
- Evaluate and adopt new hardware (GPUs, TPUs, custom accelerators) and cloud/on-prem infrastructure as the team's needs evolve
- Oversee the design and operation of data storage, indexing, and retrieval systems that support large-scale dataset generation
- Ensure data pipelines are performant, fault-tolerant, and meet the quality and freshness requirements of ML teams
- Establish early-stage standards for data access, lineage, and governance — pragmatic and scalable, not over-engineered
- Lead the development and maintenance of shared libraries and frameworks for data transformation pipelines
- Partner with ML researchers and engineers to understand their workflows and translate them into reliable, reusable platform capabilities
- Champion developer productivity - reduce friction for teams consuming platform services
- Lay the architectural foundations of the platform, making decisions that are pragmatic today but designed to scale to a 10–12 person team and beyond
- Make key architectural decisions around compute orchestration (e.g. Kubernetes, Slurm, Ray), storage systems, and pipeline frameworks
- Balance short-term delivery with long-term platform health -knowing when to build, buy, or borrow
- Act as a technical partner to ML research, data engineering, and product teams - translating needs into platform priorities
- Communicate roadmap, incidents, and technical tradeoffs clearly to both engineers and senior leadership
- Help ML teams become self-sufficient on the platform, reducing bottlenecks on the platform team itself
- Actively participate in hiring to grow the team from 4 to ~10–12 engineers, including defining roles and leveling
- Mentor and develop engineers, establishing a team culture early that will hold as headcount scales
- Define lightweight but durable team processes - on-call rotations, incident response, and engineering standards that won't need to be rebuilt at scale
- Be comfortable doing IC work yourself while simultaneously building the team's capacity to take it on
- 7–12 years of engineering experience, with at least 2–3 years in a formal management or tech lead capacity
- Demonstrated experience building or scaling a platform, infrastructure, or ML systems team from the ground up
- Technical credibility in one or more of: GPU/distributed compute infrastructure, large-scale data storage and retrieval, or data pipeline frameworks
- Experience making foundational architectural decisions in an early-stage or greenfield environment
- Strong cross-functional communication skills - able to translate between ML researchers, engineers, and senior leadership
- Comfortable with ambiguity; able to define the roadmap rather than just execute against one
- A hands-on mindset - willing and able to write code, review designs, and debug production issues alongside your team
- Familiarity with compute orchestration frameworks such as Kubernetes, Slurm, or Ray
- Experience with ML training workflows, dataset generation pipelines, or feature stores
- Prior experience growing a team through a hiring ramp (e.g. doubling or tripling headcount)
Recommended Jobs
Dining Room Server/Utility Worker
Job Description Job Description The Dining Room Serve r constantly improves our residents' dining experience through quality service, wholesome food, and positive behaviors in a clean and comfo…
Core Banking Systems Analyst
Job Description Job Description Description: River Run is a shared services organization that supports banking affiliates, Newburyport Bank, Pentucket Bank and Rollstone Bank & Trust. The …
BARTENDER (FULL TIME AND PART TIME)
Job Description Job Description We have an opening for full time and part time BARTENDER positions. Location: Delta One BOS - 500 Terminal E, East Boston, MA 02128. Note: online applicat…
Dance Instructor
Job Description Job Description Description Schedule: Part Time Hours Position Summary Under the direction of the Program Director the dance instructor will develop and facilitate dan…
Registered Nurse (RN) Health Care Coordinator
About us! Empowering People. Supporting Independence. Inspiring Dreams. Here at Communitas, we are dedicated to delivering individualized, family-centered services, programs, and support for peo…
Senior Project Manager - Water/Wastewater
Industry Water At Jacobs, we're challenging today to reinvent tomor…
Room Attendant/Housekeeper (includes Weekends)
Job Description Job Description We are looking for an energetic and professional Room Attendant to attend to our guest rooms with care and attention to detail. Room Attendants are responsible for…
Territory Manager
Job Description Job Description Territory Manager Location: Boston, Massachusetts, United States Compensation: $250,000 Role Overview Responsible for managing and expanding a new sales te…
Senior FMS Program Manager
Job Description Job Description Overview SENIOR FMS PROGRAM MANAGER WORK LOCATION: Hanscom AFB, MA SALARY RANGE : $135,000 - $150,000 annually* *depending on experience, certifi…
Finance Associate Attorney - Debt
Job Details: Finance Associate Attorney - Debt Responsibilities: - Represent startup, venture-backed, and public companies in debt financing and secured transactions - Structure, negotiate,…