Comparing Models

So far, for this lab, we have used the model Mistral-7B Instruct v2. Although lighter than other models, it is still quite heavy and we need a large GPU to run it. Would we get as good results with a smaller model? Let’s try!

In this exercise, we’ll pitch it against a much smaller LLM called flan-t5-small.

From the insurance-claim-processing/lab-materials/03 folder, please open the notebook called 03-04-comparing-models.ipynb and follow the instructions.

When done, you can close the notebook and head to the next page.