clyrdia-cli


Nameclyrdia-cli JSON
Version 2.0.1 PyPI version JSON
download
home_pagehttps://clyrdia.com
SummaryState-of-the-Art AI Benchmarking for CI/CD
upload_time2025-09-08 16:25:53
maintainerNone
docs_urlNone
authorClyrdia Team
requires_python>=3.8
licenseMIT
keywords ai benchmarking machine learning testing evaluation openai anthropic
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # Clyrdia CLI MVP

🚀 **Lean, powerful, and rapidly deployable AI quality gates for CI/CD**

> **Note**: This is the MVP version of Clyrdia CLI. For the full version, see the main repository.

Clyrdia MVP is a streamlined version focused exclusively on providing automated AI quality gates in CI/CD pipelines. This version eliminates complexity and focuses on the core value proposition: helping teams run `clyrdia-cli benchmark` inside a GitHub Action and see clear, valuable results.

## 🎯 MVP Focus

- **Single Use Case**: Automated AI quality gates in CI/CD
- **Two Providers Only**: OpenAI and Anthropic (production-ready models)  
- **Two-Tier System**: Developer (Free) and Business ($500/month)
- **Zero Complexity**: No team management, no complex features, just benchmarking

## 🚀 Quick Start

### 1. Installation

```bash
pip install clyrdia-cli
```

### 2. Authentication

```bash
clyrdia-cli login
```

### 3. Initialize Benchmark

```bash
clyrdia-cli init --name "My CI/CD Quality Gate"
```

### 4. Set API Keys

```bash
export OPENAI_API_KEY="your-openai-key"
export ANTHROPIC_API_KEY="your-anthropic-key"
```

### 5. Run Benchmark

```bash
clyrdia-cli benchmark
```

### 6. View Results

```bash
clyrdia-cli dashboard
```

## 📋 Available Commands

### Authentication
- `login` - Authenticate with API key
- `logout` - Remove authentication  
- `status` - Show account status

### Core Benchmarking
- `init` - Initialize benchmark configuration
- `benchmark` - Run AI benchmark tests
- `models` - List available models
- `compare` - Compare two models

### Results & Dashboard
- `dashboard` - Start local dashboard
- `dashboard-status` - Check dashboard status

### Management
- `cache` - Manage result cache
- `tutorial` - Show quick start guide
- `version` - Show version info
- `commands` - Show command reference

### CI/CD Integration
- `cicd generate` - Generate CI/CD templates
- `cicd platforms` - List CI/CD platforms
- `cicd test` - Test CI/CD functionality

## 🤖 Supported Models

### OpenAI
- `gpt-4o` - Flagship multimodal model
- `gpt-4o-mini` - Fast, cost-effective model
- `gpt-4o-2024-08-01` - Specific version

### Anthropic
- `claude-3-5-sonnet-20241022` - Balanced performance
- `claude-3-5-haiku-20241022` - Fast and efficient
- `claude-3-opus-20240229` - Most capable model

## 💰 Pricing

- **Developer**: Free - 100 credits/month
- **Business**: $500/month - 25,000 credits/month + CI/CD features

## 🔧 CI/CD Integration

Generate GitHub Actions workflow:

```bash
clyrdia-cli cicd generate --platform github-actions
```

This creates a workflow that:
- Runs on every push and PR
- Executes AI quality gates
- Fails the build if quality thresholds aren't met
- Uploads results as artifacts

## 📊 Dashboard

The local dashboard provides:
- Real-time metrics and analytics
- Model performance comparison
- Cost analysis and optimization
- Historical trend analysis
- Detailed result inspection

## 🏗️ Architecture

The MVP uses a simplified architecture:

```
clyrdia/
├── core/           # Consolidated core logic
│   ├── licensing.py    # Authentication & credits
│   ├── benchmarking.py # Benchmark execution
│   ├── providers.py    # OpenAI & Anthropic only
│   ├── evaluator.py    # Quality assessment
│   ├── caching.py      # Result caching
│   ├── database.py     # SQLite storage
│   └── models.py       # All data classes
├── cli_mvp.py      # MVP CLI implementation
├── dashboard.py    # Local dashboard
└── config.py       # Configuration
```

## 🎯 Key Simplifications

1. **Consolidated Core**: All core logic in single `core/` directory
2. **Two Providers Only**: OpenAI and Anthropic (no Google, Cohere, etc.)
3. **Two-Tier System**: Developer and Business only (no Pro tier)
4. **Essential Commands**: Only commands that directly support CI/CD quality gates
5. **Simplified Database**: No complex team management tables
6. **Decoupled Dashboard**: No Node.js process management

## 🚀 Getting to $100k MRR

This MVP is designed for rapid deployment and customer acquisition:

1. **Fast Testing**: Minimal surface area for bugs
2. **Clear Value**: Focused on one high-value use case
3. **Easy Sales**: Simple two-tier pricing
4. **Quick Onboarding**: Streamlined user experience
5. **CI/CD Native**: Built for the target market

## 📈 Next Steps

1. Deploy MVP to production
2. Get first 10 paying customers
3. Iterate based on feedback
4. Add features only if they directly support the core use case
5. Scale to $100k MRR

---

**Built for speed. Built for value. Built for CI/CD.**

            

Raw data

            {
    "_id": null,
    "home_page": "https://clyrdia.com",
    "name": "clyrdia-cli",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.8",
    "maintainer_email": "Clyrdia Team <team@clyrdia.com>",
    "keywords": "ai, benchmarking, machine learning, testing, evaluation, openai, anthropic",
    "author": "Clyrdia Team",
    "author_email": "Clyrdia Team <team@clyrdia.com>",
    "download_url": "https://files.pythonhosted.org/packages/d6/5e/e1e16409bab185a373e7613b2d15f554077b0288c86fa62fef30b3ba6bff/clyrdia_cli-2.0.1.tar.gz",
    "platform": null,
    "description": "# Clyrdia CLI MVP\n\n\ud83d\ude80 **Lean, powerful, and rapidly deployable AI quality gates for CI/CD**\n\n> **Note**: This is the MVP version of Clyrdia CLI. For the full version, see the main repository.\n\nClyrdia MVP is a streamlined version focused exclusively on providing automated AI quality gates in CI/CD pipelines. This version eliminates complexity and focuses on the core value proposition: helping teams run `clyrdia-cli benchmark` inside a GitHub Action and see clear, valuable results.\n\n## \ud83c\udfaf MVP Focus\n\n- **Single Use Case**: Automated AI quality gates in CI/CD\n- **Two Providers Only**: OpenAI and Anthropic (production-ready models)  \n- **Two-Tier System**: Developer (Free) and Business ($500/month)\n- **Zero Complexity**: No team management, no complex features, just benchmarking\n\n## \ud83d\ude80 Quick Start\n\n### 1. Installation\n\n```bash\npip install clyrdia-cli\n```\n\n### 2. Authentication\n\n```bash\nclyrdia-cli login\n```\n\n### 3. Initialize Benchmark\n\n```bash\nclyrdia-cli init --name \"My CI/CD Quality Gate\"\n```\n\n### 4. Set API Keys\n\n```bash\nexport OPENAI_API_KEY=\"your-openai-key\"\nexport ANTHROPIC_API_KEY=\"your-anthropic-key\"\n```\n\n### 5. Run Benchmark\n\n```bash\nclyrdia-cli benchmark\n```\n\n### 6. View Results\n\n```bash\nclyrdia-cli dashboard\n```\n\n## \ud83d\udccb Available Commands\n\n### Authentication\n- `login` - Authenticate with API key\n- `logout` - Remove authentication  \n- `status` - Show account status\n\n### Core Benchmarking\n- `init` - Initialize benchmark configuration\n- `benchmark` - Run AI benchmark tests\n- `models` - List available models\n- `compare` - Compare two models\n\n### Results & Dashboard\n- `dashboard` - Start local dashboard\n- `dashboard-status` - Check dashboard status\n\n### Management\n- `cache` - Manage result cache\n- `tutorial` - Show quick start guide\n- `version` - Show version info\n- `commands` - Show command reference\n\n### CI/CD Integration\n- `cicd generate` - Generate CI/CD templates\n- `cicd platforms` - List CI/CD platforms\n- `cicd test` - Test CI/CD functionality\n\n## \ud83e\udd16 Supported Models\n\n### OpenAI\n- `gpt-4o` - Flagship multimodal model\n- `gpt-4o-mini` - Fast, cost-effective model\n- `gpt-4o-2024-08-01` - Specific version\n\n### Anthropic\n- `claude-3-5-sonnet-20241022` - Balanced performance\n- `claude-3-5-haiku-20241022` - Fast and efficient\n- `claude-3-opus-20240229` - Most capable model\n\n## \ud83d\udcb0 Pricing\n\n- **Developer**: Free - 100 credits/month\n- **Business**: $500/month - 25,000 credits/month + CI/CD features\n\n## \ud83d\udd27 CI/CD Integration\n\nGenerate GitHub Actions workflow:\n\n```bash\nclyrdia-cli cicd generate --platform github-actions\n```\n\nThis creates a workflow that:\n- Runs on every push and PR\n- Executes AI quality gates\n- Fails the build if quality thresholds aren't met\n- Uploads results as artifacts\n\n## \ud83d\udcca Dashboard\n\nThe local dashboard provides:\n- Real-time metrics and analytics\n- Model performance comparison\n- Cost analysis and optimization\n- Historical trend analysis\n- Detailed result inspection\n\n## \ud83c\udfd7\ufe0f Architecture\n\nThe MVP uses a simplified architecture:\n\n```\nclyrdia/\n\u251c\u2500\u2500 core/           # Consolidated core logic\n\u2502   \u251c\u2500\u2500 licensing.py    # Authentication & credits\n\u2502   \u251c\u2500\u2500 benchmarking.py # Benchmark execution\n\u2502   \u251c\u2500\u2500 providers.py    # OpenAI & Anthropic only\n\u2502   \u251c\u2500\u2500 evaluator.py    # Quality assessment\n\u2502   \u251c\u2500\u2500 caching.py      # Result caching\n\u2502   \u251c\u2500\u2500 database.py     # SQLite storage\n\u2502   \u2514\u2500\u2500 models.py       # All data classes\n\u251c\u2500\u2500 cli_mvp.py      # MVP CLI implementation\n\u251c\u2500\u2500 dashboard.py    # Local dashboard\n\u2514\u2500\u2500 config.py       # Configuration\n```\n\n## \ud83c\udfaf Key Simplifications\n\n1. **Consolidated Core**: All core logic in single `core/` directory\n2. **Two Providers Only**: OpenAI and Anthropic (no Google, Cohere, etc.)\n3. **Two-Tier System**: Developer and Business only (no Pro tier)\n4. **Essential Commands**: Only commands that directly support CI/CD quality gates\n5. **Simplified Database**: No complex team management tables\n6. **Decoupled Dashboard**: No Node.js process management\n\n## \ud83d\ude80 Getting to $100k MRR\n\nThis MVP is designed for rapid deployment and customer acquisition:\n\n1. **Fast Testing**: Minimal surface area for bugs\n2. **Clear Value**: Focused on one high-value use case\n3. **Easy Sales**: Simple two-tier pricing\n4. **Quick Onboarding**: Streamlined user experience\n5. **CI/CD Native**: Built for the target market\n\n## \ud83d\udcc8 Next Steps\n\n1. Deploy MVP to production\n2. Get first 10 paying customers\n3. Iterate based on feedback\n4. Add features only if they directly support the core use case\n5. Scale to $100k MRR\n\n---\n\n**Built for speed. Built for value. Built for CI/CD.**\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "State-of-the-Art AI Benchmarking for CI/CD",
    "version": "2.0.1",
    "project_urls": {
        "Homepage": "https://clyrdia.com"
    },
    "split_keywords": [
        "ai",
        " benchmarking",
        " machine learning",
        " testing",
        " evaluation",
        " openai",
        " anthropic"
    ],
    "urls": [
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "775e3eacb6a5a2dfac641723850d8e6085b677dd48d354afe3139534dcbd3885",
                "md5": "1e552655e3a3d959ee27dee11c46ab68",
                "sha256": "88b74de3db36775fbe8fd67684db6ca35cfd4ce1e193af65ad037ac1ff4de6fc"
            },
            "downloads": -1,
            "filename": "clyrdia_cli-2.0.1-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "1e552655e3a3d959ee27dee11c46ab68",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.8",
            "size": 55924,
            "upload_time": "2025-09-08T16:25:52",
            "upload_time_iso_8601": "2025-09-08T16:25:52.271479Z",
            "url": "https://files.pythonhosted.org/packages/77/5e/3eacb6a5a2dfac641723850d8e6085b677dd48d354afe3139534dcbd3885/clyrdia_cli-2.0.1-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "d65ee1e16409bab185a373e7613b2d15f554077b0288c86fa62fef30b3ba6bff",
                "md5": "27d55d5e11974c8ddfe191863e72ad39",
                "sha256": "183d46e50a4d8b77ecbabd7dc294854bc0a2f56e51d3c4d61e43abb1cce4e484"
            },
            "downloads": -1,
            "filename": "clyrdia_cli-2.0.1.tar.gz",
            "has_sig": false,
            "md5_digest": "27d55d5e11974c8ddfe191863e72ad39",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.8",
            "size": 54390,
            "upload_time": "2025-09-08T16:25:53",
            "upload_time_iso_8601": "2025-09-08T16:25:53.568582Z",
            "url": "https://files.pythonhosted.org/packages/d6/5e/e1e16409bab185a373e7613b2d15f554077b0288c86fa62fef30b3ba6bff/clyrdia_cli-2.0.1.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2025-09-08 16:25:53",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "lcname": "clyrdia-cli"
}
        
Elapsed time: 2.04408s