[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

🐍λ✨ - A collection of useful decorators for making AWS Lambda handlers

🛵 The stylish Node.js middleware engine for AWS Lambda 🛵

A JavaScript / TypeScript / Python / C# / PHP / Go cryptocurrency trading API with support for more than 100 bitcoin/altcoin exchanges

Bundling Chrome Extensions can be pretty complex. It doesn't have to be.

A project structure aware autonomous software engineer aiming for autonomous program improvement. Resolved 37.3% tasks (pass@1) in SWE-bench lite and 46.2% tasks (pass@1) in SWE-bench verified with…

Agentless🐱: an agentless approach to automatically solve software development problems

Remote debugging AWS Lambda functions

MerLoc is a live AWS Lambda function development and debugging tool. MerLoc allows you to run AWS Lambda functions on your local while they are still part of a flow in the AWS cloud remote.

Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your permission every step of the way.

ASGI specification and utilities

Asyncer, async and await, focused on developer experience.

AWS Lambda support for ASGI applications

Unified framework for building enterprise RAG pipelines with small, specialized models

A reactive notebook for Python — run reproducible experiments, execute as a script, deploy as an app, and version with git.

🐢 Open-Source Evaluation & Testing for AI & LLM systems

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

A virtual monitor for screen sharing

Collection of useful resources for TypingMind

GroqCasters is a Python application that generates podcast scripts and corresponding audio using AI technologies. It leverages PocketGroq for script generation and Bark for text-to-speech conversio…

modest natural-language processing

A CLI tool for proxying an AWS Lambda to your local machine for faster development. Using AWS IOT

Moved to https://github.com/sst/sst

React app for inspecting, building and debugging with the Realtime API

Generate and render a 3d call graph for a Python project

Open-source Next.js adapter for AWS

No code AI agents

SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2…