Add Docs

Author: Luke Hinds

docs/configuration.md

@@ -16,6 +16,10 @@ The configuration system in Codegate is managed through the `Config` class in `c
 - Log Level: "INFO"
 - Log Format: "JSON"
 - Prompts: Default prompts from prompts/default.yaml
+- Provider URLs:
+  - vLLM: "http://localhost:8000"
+  - OpenAI: "https://api.openai.com/v1"
+  - Anthropic: "https://api.anthropic.com/v1"
 
 ## Configuration Methods
 
@@ -27,6 +31,18 @@ Load configuration from a YAML file:
 config = Config.from_file("config.yaml")
 ```
 
+Example config.yaml:
+```yaml
+port: 8989
+host: localhost
+log_level: INFO
+log_format: JSON
+provider_urls:
+  vllm: "https://vllm.example.com"
+  openai: "https://api.openai.com/v1"
+  anthropic: "https://api.anthropic.com/v1"
+```
+
 ### From Environment Variables
 
 Environment variables are automatically loaded with these mappings:
@@ -36,13 +52,42 @@ Environment variables are automatically loaded with these mappings:
 - `CODEGATE_APP_LOG_LEVEL`: Logging level
 - `CODEGATE_LOG_FORMAT`: Log format
 - `CODEGATE_PROMPTS_FILE`: Path to prompts YAML file
+- `CODEGATE_PROVIDER_VLLM_URL`: vLLM provider URL
+- `CODEGATE_PROVIDER_OPENAI_URL`: OpenAI provider URL
+- `CODEGATE_PROVIDER_ANTHROPIC_URL`: Anthropic provider URL
 
 ```python
 config = Config.from_env()
 ```
 
 ## Configuration Options
 
+### Provider URLs
+
+Provider URLs can be configured in several ways:
+
+1. In Configuration File:
+   ```yaml
+   provider_urls:
+     vllm: "https://vllm.example.com"  # /v1 path is added automatically
+     openai: "https://api.openai.com/v1"
+     anthropic: "https://api.anthropic.com/v1"
+   ```
+
+2. Via Environment Variables:
+   ```bash
+   export CODEGATE_PROVIDER_VLLM_URL=https://vllm.example.com
+   export CODEGATE_PROVIDER_OPENAI_URL=https://api.openai.com/v1
+   export CODEGATE_PROVIDER_ANTHROPIC_URL=https://api.anthropic.com/v1
+   ```
+
+3. Via CLI Flags:
+   ```bash
+   codegate serve --vllm-url https://vllm.example.com
+   ```
+
+Note: For the vLLM provider, the /v1 path is automatically appended to the base URL if not present.
+
 ### Log Levels
 
 Available log levels (case-insensitive):

docs/development.md

@@ -9,6 +9,7 @@ Codegate is a configurable Generative AI gateway designed to protect developers
 - Secure coding recommendations
 - Prevention of AI recommending deprecated/malicious libraries
 - Modular system prompts configuration
+- Multiple AI provider support with configurable endpoints
 
 ## Development Setup
 
@@ -53,7 +54,11 @@ codegate/
 │       ├── logging.py       # Logging setup
 │       ├── prompts.py       # Prompts management
 │       ├── server.py        # Main server implementation
-│       └── providers/*      # External service providers (anthropic, openai, etc.)
+│       └── providers/       # External service providers
+│           ├── anthropic/   # Anthropic provider implementation
+│           ├── openai/      # OpenAI provider implementation
+│           ├── vllm/        # vLLM provider implementation
+│           └── base.py      # Base provider interface
 ├── tests/           # Test files
 └── docs/            # Documentation
 ```
@@ -128,9 +133,87 @@ Codegate uses a hierarchical configuration system with the following priority (h
 - Log Level: Logging level (ERROR|WARNING|INFO|DEBUG)
 - Log Format: Log format (JSON|TEXT)
 - Prompts: System prompts configuration
+- Provider URLs: AI provider endpoint configuration
 
 See [Configuration Documentation](configuration.md) for detailed information.
 
+## Working with Providers
+
+Codegate supports multiple AI providers through a modular provider system.
+
+### Available Providers
+
+1. **vLLM Provider**
+   - Default URL: http://localhost:8000
+   - Supports OpenAI-compatible API
+   - Automatically adds /v1 path to base URL
+   - Model names are prefixed with "hosted_vllm/"
+
+2. **OpenAI Provider**
+   - Default URL: https://api.openai.com/v1
+   - Standard OpenAI API implementation
+
+3. **Anthropic Provider**
+   - Default URL: https://api.anthropic.com/v1
+   - Anthropic Claude API implementation
+
+### Configuring Providers
+
+Provider URLs can be configured through:
+
+1. Config file (config.yaml):
+   ```yaml
+   provider_urls:
+     vllm: "https://vllm.example.com"
+     openai: "https://api.openai.com/v1"
+     anthropic: "https://api.anthropic.com/v1"
+   ```
+
+2. Environment variables:
+   ```bash
+   export CODEGATE_PROVIDER_VLLM_URL=https://vllm.example.com
+   export CODEGATE_PROVIDER_OPENAI_URL=https://api.openai.com/v1
+   export CODEGATE_PROVIDER_ANTHROPIC_URL=https://api.anthropic.com/v1
+   ```
+
+3. CLI flags:
+   ```bash
+   codegate serve --vllm-url https://vllm.example.com
+   ```
+
+### Implementing New Providers
+
+To add a new provider:
+
+1. Create a new directory in `src/codegate/providers/`
+2. Implement required components:
+   - `provider.py`: Main provider class extending BaseProvider
+   - `adapter.py`: Input/output normalizers
+   - `__init__.py`: Export provider class
+
+Example structure:
+```python
+from codegate.providers.base import BaseProvider
+
+class NewProvider(BaseProvider):
+    def __init__(self, ...):
+        super().__init__(
+            InputNormalizer(),
+            OutputNormalizer(),
+            completion_handler,
+            pipeline_processor,
+            fim_pipeline_processor
+        )
+
+    @property
+    def provider_route_name(self) -> str:
+        return "provider_name"
+
+    def _setup_routes(self):
+        # Implement route setup
+        pass
+```
+
 ## Working with Prompts
 
 ### Default Prompts
@@ -188,8 +271,9 @@ codegate serve --port 8989 --host localhost --log-level DEBUG
 
 # Start with custom prompts
 codegate serve --prompts my-prompts.yaml
+
+# Start with custom provider URL
+codegate serve --vllm-url https://vllm.example.com
 ```
 
 See [CLI Documentation](cli.md) for detailed command information.
-
-[Rest of development.md content remains unchanged...]