What is a system prompt?
A model answers the text it is given. If that text is only the user's sentence, you get a generic answer. So products put their own instructions first: who the assistant is, how it should sound, what it knows, what it must never do.
The user does not see these instructions, but the model reads them on every single request. They are written once by the team and then sent again and again.
Together, the instructions, any examples and the conversation are called the prompt. Changing the prompt is the fastest and cheapest way to change how a product behaves.
Why does a system prompt matter?
The same model powers a legal assistant, a children's tutor and a shop's help desk. What makes them different is mostly the system prompt. It is where a product's purpose, tone and limits are stated, and it is the first thing to change when an assistant behaves in a way you do not want.
How does a system prompt work?
- The product's makers write a block of text: who the assistant is, how it should speak, what it may and may not do.
- On every call, your server places that text ahead of the conversation. The person never sees it.
- The model reads it first and treats it as standing instructions for everything that follows.
- When the behaviour needs to change, the text is edited, tested and released as a new version.
When should you use a system prompt?
Use it when
- Setting the role, tone and length of replies
- Stating what to do when the model does not know
- Describing the product, its users and its limits
Think twice when
- Holding facts that change, such as prices. Fetch those when asked
- Enforcing safety. A prompt is a request, and can be argued with
Where does a system prompt sit in a real system?
It is the first part of the prompt, before tools, fetched text and the conversation. Because it is the same on every call, the provider can keep it ready and charge less for it, which is one reason it goes first and stays unchanged.
What goes wrong with a system prompt?
- Writing rules in capitals and hoping. Clear, specific instructions work better than loud ones.
- Letting it grow by accretion until two instructions contradict each other.
- Relying on it for security. Anything that must not happen needs a check in code.
What does a system prompt look like in practice?
A shop's assistant answered a returns question with four paragraphs of general advice. Three lines were added to its system prompt: you work for an outdoor shop, answer in two or three sentences, and say so if you do not know. The next answer was two sentences and correct.