Author here. The linked Jupyter notebook shows how to use tvalmetrics, a RAG metrics Python package, to evaluate RAG query engines built using LlamaIndex on a dataset of Paul Graham essays about startup founders. The RAG parameters chunk size and number of retrieved context chunks are varied and tvalmetrics is used to show which choice of chunk size and number of retrieved context chunks is optimal.
Comments
Author here. The linked Jupyter notebook shows how to use tvalmetrics, a RAG metrics Python package, to evaluate RAG query engines built using LlamaIndex on a dataset of Paul Graham essays about startup founders. The RAG parameters chunk size and number of retrieved context chunks are varied and tvalmetrics is used to show which choice of chunk size and number of retrieved context chunks is optimal.