What is rewriting the question?
People do not write search queries. They write “and what about the blue one?” or “it says E-417”. Those only make sense with the conversation around them, and a search engine sees none of that.
So before searching, a quick model call rewrites the message into a standalone question, filling in what “it” refers to from the earlier turns.
The same step can produce several versions of the question, or expand abbreviations. It adds a fraction of a second and often makes the difference between finding the right page and missing it.
Why does rewriting the question matter?
People do not ask questions the way documents are written. They use slang, leave things out, and rely on what was said earlier. Searching for their exact words often finds nothing useful. Rewriting the question first is one of the cheapest ways to improve what a search returns.
How does rewriting the question work?
- The person's message arrives, along with the conversation so far.
- A quick model call is asked to rewrite it as a complete question that stands on its own.
- Optionally it produces several versions, with different wordings.
- The search runs on the rewritten question. The person never sees it.
When should you use rewriting the question?
Use it when
- A follow-up leans on earlier messages, such as "and for children?"
- People use casual words and documents use formal ones
- The first search often comes back empty or off-topic
Think twice when
- The question is already clear and complete
- Every fraction of a second counts. The rewrite adds a model call
Where does rewriting the question sit in a real system?
It sits between receiving the message and running the search. It uses a small, fast model, because the job is simple and the delay is felt by everyone.
What goes wrong with rewriting the question?
- Letting the rewrite change the meaning of the question.
- Rewriting without the conversation, so a follow-up still makes no sense.
- Showing the rewritten question to the person as though they had asked it.
What does rewriting the question look like in practice?
A member asks about cancelling a trip, reads the answer and types "and for children?". Searched alone, those words find nothing. Rewritten, they become "How late can a child's place on a trip be cancelled for a refund?", which finds the right paragraph.