Business
What Is an LLM Engineer? Skills, Salary and How to Hire One
Renata Kobayashi4 min de lectura
An LLM engineer builds products and systems on top of large language models: connecting models to company data, designing prompts and agents, measuring quality, and running it all reliably in production. In open US AI engineering roles on Refer (liarefer.com), about 57% require LLM experience, 41% mention AI agents and the median posted base salary is around $222,000.
This guide explains what LLM engineers do, the skills companies ask for, what they earn, and how to hire one.
TL;DR
- LLM engineers build on top of models; they usually don’t train them from scratch.
- Core skills: LLMs, Python, agents, APIs, plus evaluation and production experience.
- Median posted base for AI engineering roles: about $222,000.
- To hire one, test shipped LLM work, not only prompts.
- Refer is free for companies and introduces LLM engineers who already want to talk.
What Does an LLM Engineer Do?
- Connects models to data: retrieval over documents, databases and tools.
- Builds agents: systems that plan and take actions.
- Designs prompts and workflows that are reliable, not just clever.
- Measures quality: evaluation suites, error rates, latency and cost.
- Runs it in production: monitoring, safety and scaling.
What Skills Do Companies Ask For?
In open US AI engineering roles on Refer:
| Skill | Required in |
|---|---|
| LLMs or generative AI | 57% |
| Python | 54% |
| AI agents | 41% |
| Machine learning fundamentals | 39% |
| APIs | 23% |
| System design | 21% |
| Fine-tuning | 16% |
What Do LLM Engineers Earn?
AI engineering roles on Refer center around $222,000 in posted base salary, with most between about $195,000 and $253,000. San Francisco AI and ML roles center around $235,000.
How Do You Hire an LLM Engineer?
- Define the product: what will this person ship in six months?
- Ask for shipped work: “Walk me through an LLM feature you put in front of users. How did you measure it?”
- Test trade-offs: “When would you fine-tune instead of using retrieval?”
- Run a short, paid exercise on a real problem.
“We’re hiring an LLM engineer to own our AI assistant: retrieval, evaluation and the path to production.”
How Can Refer’s Lia Help?
- Companies: Lia, Refer’s AI recruiter, checks each candidate’s LLM experience and introduces those who already want to talk. Free for companies.
- Engineers: Lia, Refer’s AI career agent, introduces you directly to hiring managers for LLM roles. Free to use; you pay only if you’re hired through one of her introductions.
Lia has made more than 5,000 introductions.
How-To: Become an LLM Engineer in 4 Steps
- Get strong in Python and APIs.
- Build one retrieval feature with an evaluation suite.
- Build a small agent that takes real actions.
- Ship it to real users and measure the results.
Focused FAQ
What is an LLM engineer?
An engineer who builds products on top of large language models: retrieval, agents, prompts, evaluation and production systems.
How much do LLM engineers make?
AI engineering roles on Refer center around $222,000 in posted base salary.
How do I hire an LLM engineer?
Define what they’ll ship, ask about shipped LLM work and how it was measured, and test trade-offs with a short, paid exercise.
How We Got These Numbers
We analyzed open US AI engineering roles (titles such as AI engineer, applied AI, LLM or generative AI engineer) at companies hiring through Refer (liarefer.com), November 2026. Pay is the midpoint of posted base salary ranges. Percentages are rounded to the nearest whole number. Figures reflect roles on Refer, not the entire market.
About the Author
Renata is on the founding team at Refer.
Sources
- Refer analysis of open US AI engineering roles, November 2026
- Refer: Lia for organizations