Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Creating your own programs might seem daunting. It’s a lot easier than you think.

Comprehensive Python API for Google NotebookLM. Full programmatic access to NotebookLM's features—including capabilities the web UI doesn't expose—from Python or the command line. 📚 Research ...