LLM Engineer (INTL - India)

Insight Global
Boston, MA

Job Description

Insight Global is seeking an LLM Engineer to join our clients dynamic development team. This individual will enhance and expand a complex application, requiring strong communication skills and full-stack technical expertise. This role involves collaborating with global teams across multiple time zones (IST, UST, and other countries) and actively contributing to ongoing feature development.

Key Responsibilities:

-Enhance and expand a complex, dynamic application.

-Collaborate with global teams across multiple time zones.

-Actively contribute to ongoing feature development.

Ideal Candidate:

-Highly skilled Senior Python and LLM engineer.

-Capable of executing both planning and hands-on technical work independently.

-Effective collaborator with Product Owners and other stakeholders to solve complex problems.

-Able to work cross-functionally to deliver impactful solutions.

-Committed to continuously developing technical expertise and staying current with new technologies.

-Passionate, intellectually curious, and driven to expand skills and knowledge.

-Utilizes a data-driven approach to solve technical challenges and make informed decisions.

-Applies systems-level thinking, integrating data science and engineering principles.

-Takes full ownership of features and projects, delivering high-quality solutions independently.

Compensation:

$15.00/hr to $20.00/hr.

Exact compensation may vary based on several factors, including skills, experience, and education

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected] learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:

Skills and Requirements

Years of Experience:

-2+ years of experience developing and experimenting with LLMs

-8+ years of experience developing APIs with Python

Background:

-Extensive experience with Python, particularly in building REST APIs using frameworks like FastAPI or Flask.

-Expertise in microservices architecture and deployment in containerized environments (e.g., Docker, Kubernetes).

-Strong knowledge in AI, machine learning, and natural language processing.

-Proficient in working with key LLM model APIs (e.g., OpenAI, Anthropic) and LLM frameworks (e.g., LangChain, LlamaIndex).

-Experience with MCP (Model Context Protocol).

-Understanding of multi-agent systems and their applications in complex problem-solving scenarios.

-Familiarity with RAG concepts and fundamentals (vectorDBs, semantic search, etc.).

-Expertise in implementing RAG systems that combine knowledge bases with generative AI models.

-Skilled in prompt writing for various use cases.

-Experience with deploying generative solutions to production at scale, beyond POCs.

-Proficiency with server-side events, event-driven architectures, and messaging systems.

-Strong problem-solving skills and experience in debugging and optimizing backend systems.

-Solid understanding of security best practices for backend systems, including authentication and data protection.

-Can work IST and UST hours -Experience with LLM guardrails

-Experience with LLM monitoring and observability

-Experience developing AI/ML technologies within large and business critical applications

Posted 2025-12-06

Recommended Jobs

Director, AI Operations & Services

Dana-Farber Cancer Institute
Boston, MA

Overview Dana-Farber Cancer Institute’s Informatics & Analytics (I&A) department serves patients present and future, by collaboratively building a sustainable informatics and analytics ecosyste…

View Details
Posted 2025-12-06

100% Outpatient Internal Medicine Opportunity North of Boston - Signing Bonus

Enterprise Medical Recruiting
Massachusetts

Well-established practice in desirable Boston suburb . is actively recruiting for an Internal Medicine physician to join their team. Practice Highlights ~ UMass affiliation ~ Accepting H…

View Details
Posted 2025-09-29

Hematology/Oncology Opening in Coastal Massachusetts - 4-Day Work Week

Enterprise Medical Recruiting
Massachusetts

A 170-bed nonprofit hospital in coastal southeastern Massachusetts is adding a Hematology/ Oncology Physician. Join one of the fastest-growing Hospitals in Massachusetts. We've received a top safety …

View Details
Posted 2025-11-05

Nursing Informatics Specialist

Dana-Farber Cancer Institute
Brookline, MA

Overview The Nursing Informatics Specialist is a member of the Nursing and Epic Operations teams and is responsible to ensure clinical information system implementations are consistent with Dana…

View Details
Posted 2025-12-15

Associate District Sales Manager | Enterprise Accounts

ADP
Massachusetts

ADP is hiring a **Sales Representative, Enterprise Accounts.** + **_Are you ready to control your financial future with unlimited upside earnings potential?_** + **_Do you want a lasting career with a…

View Details
Posted 2025-11-13

Payment Poster - Healthcare Billing

Addison Group
Braintree, MA

Role: Payment Poster- Healthcare Billing Location: Braintree, MA Employment Type: Contract Pay: $24 – $28 / hour Schedule: Monday–Friday | 8.5-hour days | Flexible start between 7–9 A…

View Details
Posted 2025-11-11

SP - Associate Broker

CBRE
Boston, MA

SP - Associate Broker Job ID 247144 Posted 17-Nov-2025 Service line Advisory Segment Role type Full-time Areas of Interest Sales/Brokerage Location(s) Boston - Massachusetts - United States of America…

View Details
Posted 2025-11-25

Onsite Navigator

Get Well
Springfield, MA

Title: Onsite Navigator - Get Well   Location: This role will be based at a healthcare system in south central Massachusetts Primary Working Hours: Monday - Friday, daytime hours, 40 hrs…

View Details
Posted 2025-11-26

Payer CO&I AI Consultant, Director Save for Later Remove job

PwC
Boston, MA

Job Title Payer CO&I AI Consultant, Director Job Category Operations Consulting Level Director Specialty/Competency Operations Industry/Sector Health Services Job Type Regular Time Type …

View Details
Posted 2025-12-11

HVAC Project Manager

Gulfstream Strategic Placements, LLC
Worcester, MA

HVAC Project Manager position in Worcester, MA We are a large, growing mechanical contractor currently hiring a Project Manager in our Massachusetts area. Responsibilities for HVAC Project Mana…

View Details
Posted 2025-09-28