Software Development Engineer - Generative AI, AGIF | Inference Engine
DESCRIPTION
Are you interested in advancing Amazon's Generative AI capabilities? Come work with a talented team of engineers and scientists in a highly collaborative and friendly team. We are building state-of-the-art Generative AI technology that will benefit all Amazon businesses and customers. Key job responsibilitiesAs a Software Development Engineer, you will be responsible for designing, developing, testing, and deploying high performance model inference capabilities, including but not limited to multi-modality, SOTA model architectures, latency, throughput, and cost. You will collaborate closely with a team of engineers and scientists to influence our overall strategy, and define the team’s roadmap. You will drive system architecture, spearhead best practices, and mentor junior engineers. A day in the life
You will consult with scientists to get inspiration of emerging techniques, and blend those into our roadmap; You will design and experiment with new algorithms from public and internal papers, benchmark the latency and accuracy of your implementations; Most importantly you will implement production grade solutions, and see them through the deployments swiftly; You may need to collaborate with other science and engineering teams to get things done properly; You will hold highest bar in operational excellence and support production systems, and constantly create solutions to minimize the ops load. About the team
Our mission is to build best-in-class, fast, accurate, and cost-efficient frontier model inference solutions and infrastructure that will enable Amazon businesses to deliver more value to their customers.
BASIC QUALIFICATIONS
- 3+ years of non-internship professional software development experience- Must have one of the following two: 1) Prior experience with software performance optimization Or 2) Knowledge of Deep Learning and Transformer architectures
Recommended Jobs
General or Child Psychiatrist
A thriving healthcare system is seeking a General or Child Psychiatrist to work in the Pembroke, MA area! Come make a difference within a growing team of providers that focus to enhance the lives…
IT Project Analyst
We are actively recruiting on behalf of our client for an experienced IT Project Analyst with a strong background in business process automation, data analytics, and IT project coordination. The idea…
Residential Cleaner
Job Description Job Description We are currently seeking a dedicated Cleaner to join our team. As a Cleaner, you will be responsible for maintaining cleanliness and hygiene standards at our clien…
Service Manager
Sudbay Automotive has been a family owned business serving the people of Cape Ann and beyond for over 50 years! We pride ourselves on our quality staff, updated facilities and company culture. To join…
Temporary Support Associate
Coach is seeking a Temporary Support Associate in Braintree, MA, to join its retail team. This role involves assisting with store organization, inventory management, and customer service. Ideal candid…
Account Manager
Mon, 10/06/2025 - 03:55 About the Role: Are you ready to take your career to the next level in the exciting world of real estate technology? Join our Resident Screening Team as an Account Manag…
Consulting data scientist
Job Description This role is part of an elite overlay consulting organization providing expert-level solution building and product knowledge to support Oracle Health's strategic engagements. As…
Automotive Sales Associate
If you are looking for an opportunity to work for a fast growing, family owned dealership, Central Buick GMC of Norwood is for you! Central Buick GMC of Norwood is always looking for a qualified indiv…
Python Developer
Python Developer Our client, a leading federal defense contractor has multiple openings for Secret cleared Python Developer for their Secure Network and Voice Product Development Team. This posit…
Senior Research Technician
Overview The Targeted Protein Degradation (TPD) Proteomics Core within the Fischer Lab at Dana-Farber Cancer Institute serves as a resource for the Cancer Biology Department, aiding investigat…