Exploring how we built AI Powered search in Rails. This AI workflow included:

  • semantic/vector search with Elastic,
  • using LLM for extracting semantic and non-semantic criteria from user’s query,
  • expanding query based on application context,
  • re-ranking results with LLM.

The presentation also touches on the challenges of non-deterministic aspect of LLMs and prompt testing.