Test your prompts, models, RAGs. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality. LLM evals for OpenAI/Azure GPT, Anthropic Claude, VertexAI Gemini, Ollama, Local & …

Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines

Repository for Automatic Prompt Engineering Resources

LLM Prompting Engineering Simplified Book

Implementing a ChatGPT-like LLM from scratch, step by step

Public runnable examples of using John Snow Labs' OCR for Apache Spark.

💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

A principled instruction benchmark on formulating effective queries and prompts for large language models (LLMs). Our paper: https://arxiv.org/abs/2312.16171

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.

Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

Public runnable examples of using John Snow Labs' NLP for Apache Spark.

MTEB: Massive Text Embedding Benchmark

Reference implementations of several LangChain agents as Streamlit apps

Streamlit LLM app examples for getting started

Streamlit — A faster way to build and share data apps.

The Security Toolkit for LLM Interactions

An LLM-powered advanced RAG pipeline built from scratch

A full spaCy pipeline and models for scientific/biomedical documents.

OpenAgents: An Open Platform for Language Agents in the Wild

LangChain & Prompt Engineering tutorials on Large Language Models (LLMs) such as ChatGPT with custom data. Jupyter notebooks on loading and indexing data, creating prompt templates, CSV agents, and…

Langchain + Docker + Neo4j

Files for Udemy LlamaIndex course