aman-goel
Follow
Stars
Prompt Engineering at Your Fingertips!
A framework for prompt tuning using Intent-based Prompt Calibration
This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc
Official repo for SAC3: Reliable Hallucination Detection in Black-Box Language Models via Semantic-aware Cross-check Consistency
A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation"
RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Language Models.
SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.
Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.
Improving Alignment and Robustness with Circuit Breakers
A reading list for large models safety, security, and privacy (including Awesome LLM Security, Safety, etc.).
Bitwuzla is a Satisfiability Modulo Theories (SMT) solver for the theories of fixed-size bit-vectors, floating-point arithmetic, arrays and uninterpreted functions and their combinations. Its name …
Universal and Transferable Attacks on Aligned Language Models
Supercharge your API testing, catch bugs, and ensure compliance
A collection of examples to help users get up and running with Smithy
A Ruby gem that provides a command-line validator for Amazon States Language JSON files.
RESTler is the first stateful REST API fuzzing tool for automatically testing cloud services through their REST APIs and finding security and reliability bugs in these services.
Extension adding support for optimizer hints in PostgreSQL
A toolchain for automatically detecting, reporting, and diagnosing performance bugs in DBMSs.
Quantified Symmetric Minimization of the Reachable States of Distributed Protocols
Curated list of resources on testing distributed systems
What are the differences between the transaction isolation levels in databases? This is a suite of test cases which differentiate isolation levels.
Peasy: An Intuitive Development Environment for P