Software Development Engineer - Generative AI, AGIF | Inference Engine

Amazon.com Services LLC
Boston, MA

DESCRIPTION

Are you interested in advancing Amazon's Generative AI capabilities? Come work with a talented team of engineers and scientists in a highly collaborative and friendly team. We are building state-of-the-art Generative AI technology that will benefit all Amazon businesses and customers.

Key job responsibilities
As a Software Development Engineer, you will be responsible for designing, developing, testing, and deploying high performance model inference capabilities, including but not limited to multi-modality, SOTA model architectures, latency, throughput, and cost. You will collaborate closely with a team of engineers and scientists to influence our overall strategy, and define the team’s roadmap. You will drive system architecture, spearhead best practices, and mentor junior engineers.

A day in the life
You will consult with scientists to get inspiration of emerging techniques, and blend those into our roadmap; You will design and experiment with new algorithms from public and internal papers, benchmark the latency and accuracy of your implementations; Most importantly you will implement production grade solutions, and see them through the deployments swiftly; You may need to collaborate with other science and engineering teams to get things done properly; You will hold highest bar in operational excellence and support production systems, and constantly create solutions to minimize the ops load.

About the team
Our mission is to build best-in-class, fast, accurate, and cost-efficient frontier model inference solutions and infrastructure that will enable Amazon businesses to deliver more value to their customers.

BASIC QUALIFICATIONS

- 3+ years of non-internship professional software development experience
- Must have one of the following two: 1) Prior experience with software performance optimization Or 2) Knowledge of Deep Learning and Transformer architectures
Posted 2025-07-30

Recommended Jobs

Project Manager-Hybrid (Atlanta or Boston)

RG Vanderweil.com
Boston, MA

Job Description Job Description About Us! Vanderweil Engineers is a top ranked national full-service engineering firm specializing in MEP/FP, and technology services. Working in multiple sect…

View Details
Posted 2025-07-25

Registered Nurse- N. Reading, Reading, Wakefield, Saugus- Monday-Friday- Home Health

VNA Care
Woburn, MA

Job Description Job Description VNA Care is currently looking for compassionate and organized Registered Nurses (RNs) to join our Home Health team. Visits are available in N. Reading, Reading, Wa…

View Details
Posted 2025-07-23

Human Resources Safety Generalist

Rodney Hunt Inc.
Orange, MA

Job Overview: The HR & Safety Generalist is responsible for supporting a variety of Human Resource and Safety functions in partnership with onsite management. This role provides onsite support to …

View Details
Posted 2025-07-24

Senior Social Media Strategist

Gupta Media
Boston, MA

Job Description Job Description Salary: Gupta Media is looking for an experienced and passionate storyteller to help our clients amplify their brands. As a Senior Social Media Strategist, they…

View Details
Posted 2025-07-26

Oral Surgery Dental Assistant

Advanced Surgical Associates
Tewksbury, MA

Job Description Job Description Dental Assistant – Oral Surgery Surgical Assistant – Oral Surgery Location: Advanced Surgical Associates | Tewksbury, MA Position Highlights: Step …

View Details
Posted 2025-07-25

Clinical Research Financial Analyst

Dana-Farber Cancer Institute
Brookline, MA

Overview Under general supervision of the Clinical Research Budgets Manager, the Clinical Research Financial Analyst (CRFA-II) is responsible for financial planning, developing budgets, negotiat…

View Details
Posted 2025-07-30

Pediatrician in Lowell/Chelmsford, MA Board Certified / Board Eligible

Cardinal Pediatrics PLLC
Chelmsford, MA

Job Description Job Description We are currently seeking a full-time/part-time board certified/board eligible pediatrician to join an established practice with three pediatricians, two nurse prac…

View Details
Posted 2025-07-27

Growth Marketing Manager - Remote

Get It - Marketing
Boston, MA

About Us: Approximately 40% of people in the U.S. struggle with insufficient sleep, and mobile device distractions are a major contributor. We are dedicated to tackling these challenges by developing …

View Details
Posted 2025-07-22

Plumber Technician

Bristol Myers Squibb
Devens, MA

Working with Us Challenging. Meaningful. Life-changing. Those aren't words that are usually associated with a job. But working at Bristol Myers Squibb is anything but usual. Here, uniquely interes…

View Details
Posted 2025-07-26

Dental Assistant-Boston

Enable Dental
Boston, MA

ABOUT ENABLE DENTAL Enable Dental is redefining dental care by bringing high-quality, comprehensive services directly to those who need it most—patients in assisted living facilities, skilled nu…

View Details
Posted 2025-07-24