Exploring how we built AI Powered search in Rails. This AI workflow included:
- semantic/vector search with Elastic,
- using LLM for extracting semantic and non-semantic criteria from user’s query,
- expanding query based on application context,
- re-ranking results with LLM.
The presentation also touches on the challenges of non-deterministic aspect of LLMs and prompt testing.