# Kailash Python SDK
<p align="center">
<a href="https://pypi.org/project/kailash/"><img src="https://img.shields.io/pypi/v/kailash.svg" alt="PyPI version"></a>
<a href="https://pypi.org/project/kailash/"><img src="https://img.shields.io/pypi/pyversions/kailash.svg" alt="Python versions"></a>
<a href="https://pepy.tech/project/kailash"><img src="https://static.pepy.tech/badge/kailash" alt="Downloads"></a>
<img src="https://img.shields.io/badge/license-MIT-green.svg" alt="MIT License">
<img src="https://img.shields.io/badge/code%20style-black-000000.svg" alt="Code style: black">
<img src="https://img.shields.io/badge/tests-2400%2B%20passing-brightgreen.svg" alt="Tests: 2400+ Passing">
<img src="https://img.shields.io/badge/performance-11x%20faster-yellow.svg" alt="Performance: 11x Faster">
<img src="https://img.shields.io/badge/docker-integrated-blue.svg" alt="Docker: Integrated">
<img src="https://img.shields.io/badge/AI-MCP%20validated-purple.svg" alt="AI: MCP Validated">
</p>
<p align="center">
<strong>Enterprise-Grade Workflow Orchestration Platform</strong>
</p>
<p align="center">
Build production-ready applications with zero-config database operations, multi-channel platforms, and comprehensive AI integration. From rapid prototyping to enterprise deployment.
</p>
---
## 🔥 Latest Release: v0.8.5 (January 20, 2025)
**Architecture Cleanup & Enterprise Security**
- 🏗️ **Architecture Clarity**: Removed confusing `src/kailash/nexus` module
- 🔒 **Connection Validation**: Enterprise-grade parameter validation with type safety
- 🌐 **Edge Computing**: 50+ new nodes for geo-distributed infrastructure
- 📊 **Advanced Monitoring**: AlertManager with proactive threshold monitoring
- 🚀 **Performance**: <1ms validation overhead with intelligent caching
- ✅ **Breaking Changes**: See [migration guide](sdk-users/6-reference/changelogs/releases/v0.8.5-2025-07-20.md)
[Full Changelog](sdk-users/6-reference/changelogs/releases/v0.8.5-2025-07-20.md) | [PyPI Packages](https://pypi.org/project/kailash/0.8.5/)
## 🎯 What Makes Kailash Different
### 🏗️ **Complete Application Framework**
Not just a toolkit - complete production-ready applications built on enterprise-grade infrastructure:
- **DataFlow**: Zero-config database operations with MongoDB-style queries
- **Nexus**: Multi-channel platform (API + CLI + MCP) from single codebase
- **AI Registry**: Advanced RAG with 47+ specialized nodes
- **User Management**: Enterprise RBAC system with comprehensive security
### 🚀 **Performance & Scale**
- **11x faster test execution** (117s → 10.75s) with smart isolation
- **31.8M operations/second** query performance baseline
- **30,000+ iterations/second** cyclic workflow execution
- **100% test pass rate** across 2,400+ tests
### 🤖 **AI-First Architecture**
- **A2A Google Protocol** for enterprise multi-agent coordination
- **Real MCP execution** by default for all AI agents
- **47+ specialized RAG nodes** for document processing
- **Semantic memory systems** with context-aware retrieval
- **Hybrid search algorithms** for intelligent agent discovery
- **Self-organizing agent pools** with advanced coordination patterns
## 🏗️ Project Architecture
### Three-Layer Architecture
```
┌─────────────────────────────────────────────────────────────────┐
│ 🎨 Studio UI Layer │
│ Visual workflow builder (coming soon) │
└─────────────────────────────────────────────────────────────────┘
│
┌─────────────────────────────────────────────────────────────────┐
│ 🏢 Application Framework │
│ DataFlow │ Nexus │ AI Registry │ User Management │... │
└─────────────────────────────────────────────────────────────────┘
│
┌─────────────────────────────────────────────────────────────────┐
│ 🎯 Core SDK Foundation │
│ 115+ Nodes │ Workflows │ Runtime │ Security │ Testing │
└─────────────────────────────────────────────────────────────────┘
```
### Current Project Structure
```
kailash_python_sdk/
├── src/kailash/ # Core SDK - 115+ nodes, workflows, runtime
├── apps/ # Complete Applications
│ ├── kailash-dataflow/ # Zero-config database operations
│ ├── kailash-nexus/ # Multi-channel platform
│ ├── kailash-mcp/ # Enterprise MCP platform
│ ├── ai_registry/ # Advanced RAG capabilities
│ └── user_management/ # Enterprise RBAC system
├── tests/ # 2,400+ tests (100% pass rate)
├── docs/ # Comprehensive documentation
└── examples/ # Feature validation examples
```
## 🚀 Quick Start
### Installation Options
```bash
# Core SDK only
pip install kailash
# With complete app frameworks
pip install kailash[dataflow,nexus] # Database + multi-channel
pip install kailash[all] # Everything
# Or install apps directly
pip install kailash-dataflow # Zero-config database framework
pip install kailash-nexus # Multi-channel platform
```
### DataFlow: Zero-Config Database Operations
```python
from dataflow import DataFlow
# Zero-configuration database operations
app = DataFlow()
# MongoDB-style queries across any database
users = app.query("users").where({"age": {"$gt": 18}}).limit(10)
# Redis-powered caching with smart invalidation
cached_result = app.cache().get("user_stats",
lambda: app.query("users").aggregate([
{"$group": {"_id": "$department", "count": {"$sum": 1}}}
])
)
# Start enterprise API server
app.start() # Automatic API generation, monitoring, health checks
```
### Nexus: Multi-Channel Platform
```python
from nexus import Nexus
# Single codebase → API + CLI + MCP
app = Nexus()
# Register workflow once, available on all channels
@app.workflow
def process_data(input_data):
return {"processed": len(input_data)}
# Zero-config startup
app.start()
# Now available as:
# - REST API: POST /workflows/process_data
# - CLI: nexus run process_data
# - MCP: AI agents can call process_data tool
```
### A2A Multi-Agent Coordination
```python
from kailash.workflow.builder import WorkflowBuilder
from kailash.runtime.local import LocalRuntime
# Build A2A coordination workflow
workflow = WorkflowBuilder()
workflow.add_node("A2ACoordinatorNode", "coordinator", {
"use_google_protocol": True,
"enable_semantic_memory": True,
"delegation_strategy": "skill_based"
})
workflow.add_node("HybridSearchNode", "discovery", {
"strategies": ["semantic", "keyword", "skill_based"],
"adaptive_optimization": True
})
workflow.add_node("SemanticMemoryNode", "memory", {
"embedding_provider": "openai",
"memory_type": "long_term",
"context_window": 8192
})
# Connect for intelligent agent coordination
workflow.add_connection("coordinator", "discovery", "agent_request", "search_query")
workflow.add_connection("discovery", "memory", "agent_matches", "context")
# Execute with enterprise monitoring
runtime = LocalRuntime()
results, run_id = runtime.execute(workflow.build())
```
## 🎯 Key Features
### 🧪 **Testing Excellence**
- **2,400+ tests** with 100% pass rate
- **11x performance improvement** (117s → 10.75s execution)
- **Docker integration** for real PostgreSQL, Redis, MongoDB
- **Smart isolation** without process forking overhead
### 🏢 **Enterprise Ready**
- **Multi-tenant architecture** with complete isolation
- **RBAC/ABAC security** with fine-grained permissions
- **Audit logging** with compliance frameworks (GDPR, CCPA)
- **Distributed transactions** with Saga/2PC patterns
- **Circuit breaker** and resilience patterns
### 🤖 **AI Integration**
- **115+ production nodes** including 47+ specialized RAG nodes
- **Real MCP execution** by default for all AI agents
- **Self-organizing agent pools** with intelligent coordination
- **Complete LLM integration** with embeddings and vector search
### ⚡ **Performance & Scale**
- **31.8M operations/second** query performance baseline
- **Connection pooling** with automatic resource management
- **Redis caching** with intelligent invalidation patterns
- **Async/await** throughout with proper separation
## 🏗️ Node Ecosystem (115+ Nodes)
### Core Categories
- **Data Nodes**: CSVReaderNode, AsyncSQLDatabaseNode, QueryBuilderNode, QueryCacheNode
- **AI Nodes**: LLMAgentNode, IterativeLLMAgentNode, EmbeddingGeneratorNode, SelfOrganizingAgentNode
- **A2A Nodes**: A2ACoordinatorNode, HybridSearchNode, AdaptiveSearchNode, SemanticMemoryNode, StreamingAnalyticsNode
- **RAG Nodes**: 47+ specialized nodes for document processing and retrieval
- **Security Nodes**: ThreatDetectionNode, AuditLogNode, AccessControlManager
- **Monitoring Nodes**: TransactionMetricsNode, DeadlockDetectorNode, PerformanceAnomalyNode
- **Transaction Nodes**: DistributedTransactionManagerNode, SagaCoordinatorNode
### Advanced Features
- **A2A Communication**: Google Protocol-based multi-agent coordination
- **Semantic Memory**: Long-term memory management for agent interactions
- **Hybrid Search**: Multi-strategy agent discovery and matching
- **Cyclic Workflows**: CycleBuilder API with convergence detection
- **Distributed Transactions**: Automatic Saga/2PC pattern selection
- **Real-time Monitoring**: WebSocket streaming with performance metrics
- **Enterprise Security**: Multi-factor auth, threat detection, compliance
## 📊 Performance Metrics
### Recent Achievements
- **11x faster test execution**: 117s → 10.75s with smart isolation
- **100% test pass rate**: 2,400+ tests across all categories
- **31.8M operations/second**: Query performance baseline
- **30,000+ iterations/second**: Cyclic workflow execution
### Enterprise Benchmarks
- **Query Cache**: 99.9% hit rate with intelligent invalidation
- **Connection Pooling**: 10,000+ concurrent connections
- **MCP Integration**: 407 tests with 100% pass rate
- **Security**: Zero vulnerabilities in production deployment
## 🚀 Applications Built with Kailash
### 1. DataFlow - Zero-Config Database Platform (v0.3.1)
```bash
pip install kailash-dataflow
```
- **MongoDB-style queries** across PostgreSQL, MySQL, SQLite
- **Redis caching** with enterprise-grade invalidation
- **Automatic API generation** with OpenAPI documentation
- **4 production examples** with complete deployment guides
- **Latest**: v0.3.1 - Enhanced transaction support and schema management
### 2. Nexus - Multi-Channel Platform (v1.0.3)
```bash
pip install kailash-nexus
```
- **Unified API, CLI, and MCP** from single codebase
- **Enterprise orchestration** with multi-tenancy
- **Session management** with cross-channel synchronization
- **105 tests** with comprehensive validation
- **Latest**: v1.0.3 - Production-ready release with enhanced stability
### 3. AI Registry - Advanced RAG Platform
```bash
pip install kailash-ai-registry
```
- **47+ specialized RAG nodes** for document processing
- **Advanced retrieval** with semantic search and re-ranking
- **Multi-modal support** with image and text processing
- **Enterprise deployment** with scalable architecture
### 4. User Management - Enterprise RBAC
```bash
pip install kailash-user-management
```
- **Complete RBAC system** with role hierarchy
- **Multi-factor authentication** with enterprise integration
- **Audit logging** with compliance frameworks
- **Django-style capabilities** built on SDK architecture
## 🧪 Testing & Quality
### Comprehensive Test Suite
```bash
# All tests (2,400+ tests)
pytest
# Fast unit tests (11x faster execution)
pytest tests/unit/ --timeout=1
# Integration tests with Docker
pytest tests/integration/ --timeout=5
# End-to-end scenarios
pytest tests/e2e/ --timeout=10
```
### Test Infrastructure
- **Docker Integration**: Real PostgreSQL, Redis, MongoDB for testing
- **Smart Isolation**: Fixture-based isolation without process forking
- **Performance Monitoring**: Automated benchmarks and regression detection
- **100% Pass Rate**: Comprehensive fixes across all test categories
## 🛡️ Security & Compliance
### Enterprise Security
- **Multi-factor Authentication**: TOTP, WebAuthn, SMS integration
- **Threat Detection**: Real-time analysis with behavior monitoring
- **Access Control**: Fine-grained RBAC/ABAC with policy engines
- **Audit Logging**: Comprehensive trails with integrity verification
### Compliance Frameworks
- **GDPR/CCPA**: Built-in data protection and privacy controls
- **SOX**: Financial reporting controls and audit trails
- **HIPAA**: Healthcare data protection patterns
- **Multi-tenant Isolation**: Complete tenant-aware operations
## 📚 Documentation & Resources
### For Users
- **[SDK Users Guide](sdk-users/)**: Complete workflow development guide
- **[Node Selection Guide](sdk-users/2-core-concepts/nodes/node-selection-guide.md)**: Smart node selection with decision trees
- **[Enterprise Patterns](sdk-users/5-enterprise/)**: Production deployment patterns
- **[API Documentation](https://integrum.github.io/kailash-python-sdk)**: Complete API reference
### For Contributors
- **[SDK Contributors Guide](sdk-contributors/)**: Internal SDK development
- **[Architecture Decisions](sdk-contributors/architecture/)**: ADRs and design decisions
- **[Testing Guide](tests/README.md)**: 3-tier testing strategy
### Quick References
- **[Cheatsheet](sdk-users/2-core-concepts/cheatsheet/)**: 53 copy-paste patterns
- **[Common Mistakes](sdk-users/2-core-concepts/validation/common-mistakes.md)**: Error patterns and solutions
- **[Performance Guide](sdk-users/5-enterprise/performance/)**: Optimization patterns
## 🚢 Production Deployment
### Container Deployment
```bash
# Export workflow to container format
python -c "
from kailash.utils.export import export_workflow
export_workflow(workflow, 'production.yaml', format='kailash')
"
# Deploy to Kailash platform
kailash deploy production.yaml --environment prod
```
### Monitoring & Observability
```python
from kailash.visualization import DashboardServer
# Real-time monitoring dashboard
server = DashboardServer(port=8080)
server.start()
# Open http://localhost:8080 for live metrics
```
### Enterprise Features
- **Multi-tenant deployment** with complete isolation
- **Distributed transactions** with automatic recovery
- **Circuit breaker patterns** for resilience
- **Health monitoring** with automated alerting
## 🤝 Contributing
We use a **Claude Code-driven workflow** for all development:
### New Team Member?
**Start Here → [NEW_TEAM_MEMBER.md](NEW_TEAM_MEMBER.md)**
### Development Workflow
```bash
# Clone and setup
git clone https://github.com/integrum/kailash-python-sdk.git
cd kailash-python-sdk
uv sync
# Run tests (2,400+ tests)
pytest tests/unit/ --timeout=1 # Fast unit tests
pytest tests/integration/ --timeout=5 # Integration tests
pytest tests/e2e/ --timeout=10 # End-to-end tests
# Code quality
black .
isort .
ruff check .
```
### Claude Code Workflow
All project management through conversational AI:
- **No manual TODO editing** - Claude Code handles all updates
- **No direct GitHub issues** - Created through planning sessions
- **All progress tracked** - Through natural conversation
See [Contributing Guide](CONTRIBUTING.md) and [sdk-contributors/CLAUDE.md](sdk-contributors/CLAUDE.md).
## 📈 Project Status
### ✅ v0.8.4 - A2A Google Protocol Enhancement
- **Advanced Agent Coordination**: A2ACoordinatorNode with Google Protocol patterns
- **Hybrid Search System**: Multi-strategy agent discovery and matching
- **Semantic Memory**: Long-term memory management for agent interactions
- **Real-time Analytics**: Streaming performance monitoring for A2A workflows
- **Backward Compatible**: Seamless integration with existing implementations
- **Production Ready**: Enterprise-grade multi-agent coordination patterns
### ✅ v0.8.1 - Complete App Framework
- **Complete Application Framework**: DataFlow, Nexus, AI Registry, User Management
- **PyPI Integration**: All packages available with proper extras support
- **Performance Breakthrough**: 11x faster test execution
- **Testing Excellence**: 2,400+ tests with 100% pass rate
- **Enterprise Ready**: Production deployment patterns
### ✅ v0.7.0 - Major Framework Release
- **DataFlow Platform**: Zero-config database operations
- **Nexus Platform**: Multi-channel orchestration
- **AI Registry**: Advanced RAG capabilities
- **User Management**: Enterprise RBAC system
- **Testing Infrastructure**: Docker integration, comprehensive validation
### 🚧 Roadmap
- **Visual Workflow Builder**: Studio UI for drag-and-drop workflow creation
- **Advanced Analytics**: ML-powered workflow optimization
- **Cloud Integration**: Native AWS/GCP/Azure deployment
- **Mobile SDKs**: iOS and Android workflow execution
## 📄 License
This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
## 🙏 Acknowledgments
Built with ❤️ by the Integrum team for the Kailash ecosystem.
Special recognition for the **11x performance breakthrough** and **100% test pass rate** achieved through innovative engineering and comprehensive testing strategies.
---
<p align="center">
<strong>Ready to build enterprise-grade applications?</strong><br>
<a href="https://pypi.org/project/kailash/">Install from PyPI</a> •
<a href="sdk-users/README.md">Documentation</a> •
<a href="examples/">Examples</a> •
<a href="https://github.com/integrum/kailash-python-sdk">GitHub</a>
</p>
Raw data
{
"_id": null,
"home_page": "https://github.com/integrum/kailash-python-sdk",
"name": "kailash",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.11",
"maintainer_email": null,
"keywords": null,
"author": "Integrum",
"author_email": "Integrum <info@integrum.com>",
"download_url": "https://files.pythonhosted.org/packages/cb/20/13d28cc5decc65def6b57e9256d64e851b93a8503fa6dc955ebdfa66da8a/kailash-0.9.3.tar.gz",
"platform": null,
"description": "# Kailash Python SDK\n\n<p align=\"center\">\n <a href=\"https://pypi.org/project/kailash/\"><img src=\"https://img.shields.io/pypi/v/kailash.svg\" alt=\"PyPI version\"></a>\n <a href=\"https://pypi.org/project/kailash/\"><img src=\"https://img.shields.io/pypi/pyversions/kailash.svg\" alt=\"Python versions\"></a>\n <a href=\"https://pepy.tech/project/kailash\"><img src=\"https://static.pepy.tech/badge/kailash\" alt=\"Downloads\"></a>\n <img src=\"https://img.shields.io/badge/license-MIT-green.svg\" alt=\"MIT License\">\n <img src=\"https://img.shields.io/badge/code%20style-black-000000.svg\" alt=\"Code style: black\">\n <img src=\"https://img.shields.io/badge/tests-2400%2B%20passing-brightgreen.svg\" alt=\"Tests: 2400+ Passing\">\n <img src=\"https://img.shields.io/badge/performance-11x%20faster-yellow.svg\" alt=\"Performance: 11x Faster\">\n <img src=\"https://img.shields.io/badge/docker-integrated-blue.svg\" alt=\"Docker: Integrated\">\n <img src=\"https://img.shields.io/badge/AI-MCP%20validated-purple.svg\" alt=\"AI: MCP Validated\">\n</p>\n\n<p align=\"center\">\n <strong>Enterprise-Grade Workflow Orchestration Platform</strong>\n</p>\n\n<p align=\"center\">\n Build production-ready applications with zero-config database operations, multi-channel platforms, and comprehensive AI integration. From rapid prototyping to enterprise deployment.\n</p>\n\n---\n\n## \ud83d\udd25 Latest Release: v0.8.5 (January 20, 2025)\n\n**Architecture Cleanup & Enterprise Security**\n\n- \ud83c\udfd7\ufe0f **Architecture Clarity**: Removed confusing `src/kailash/nexus` module\n- \ud83d\udd12 **Connection Validation**: Enterprise-grade parameter validation with type safety\n- \ud83c\udf10 **Edge Computing**: 50+ new nodes for geo-distributed infrastructure\n- \ud83d\udcca **Advanced Monitoring**: AlertManager with proactive threshold monitoring\n- \ud83d\ude80 **Performance**: <1ms validation overhead with intelligent caching\n- \u2705 **Breaking Changes**: See [migration guide](sdk-users/6-reference/changelogs/releases/v0.8.5-2025-07-20.md)\n\n[Full Changelog](sdk-users/6-reference/changelogs/releases/v0.8.5-2025-07-20.md) | [PyPI Packages](https://pypi.org/project/kailash/0.8.5/)\n\n## \ud83c\udfaf What Makes Kailash Different\n\n### \ud83c\udfd7\ufe0f **Complete Application Framework**\nNot just a toolkit - complete production-ready applications built on enterprise-grade infrastructure:\n\n- **DataFlow**: Zero-config database operations with MongoDB-style queries\n- **Nexus**: Multi-channel platform (API + CLI + MCP) from single codebase\n- **AI Registry**: Advanced RAG with 47+ specialized nodes\n- **User Management**: Enterprise RBAC system with comprehensive security\n\n### \ud83d\ude80 **Performance & Scale**\n- **11x faster test execution** (117s \u2192 10.75s) with smart isolation\n- **31.8M operations/second** query performance baseline\n- **30,000+ iterations/second** cyclic workflow execution\n- **100% test pass rate** across 2,400+ tests\n\n### \ud83e\udd16 **AI-First Architecture**\n- **A2A Google Protocol** for enterprise multi-agent coordination\n- **Real MCP execution** by default for all AI agents\n- **47+ specialized RAG nodes** for document processing\n- **Semantic memory systems** with context-aware retrieval\n- **Hybrid search algorithms** for intelligent agent discovery\n- **Self-organizing agent pools** with advanced coordination patterns\n\n## \ud83c\udfd7\ufe0f Project Architecture\n\n### Three-Layer Architecture\n```\n\u250c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2510\n\u2502 \ud83c\udfa8 Studio UI Layer \u2502\n\u2502 Visual workflow builder (coming soon) \u2502\n\u2514\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518\n \u2502\n\u250c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2510\n\u2502 \ud83c\udfe2 Application Framework \u2502\n\u2502 DataFlow \u2502 Nexus \u2502 AI Registry \u2502 User Management \u2502... \u2502\n\u2514\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518\n \u2502\n\u250c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2510\n\u2502 \ud83c\udfaf Core SDK Foundation \u2502\n\u2502 115+ Nodes \u2502 Workflows \u2502 Runtime \u2502 Security \u2502 Testing \u2502\n\u2514\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518\n```\n\n### Current Project Structure\n```\nkailash_python_sdk/\n\u251c\u2500\u2500 src/kailash/ # Core SDK - 115+ nodes, workflows, runtime\n\u251c\u2500\u2500 apps/ # Complete Applications\n\u2502 \u251c\u2500\u2500 kailash-dataflow/ # Zero-config database operations\n\u2502 \u251c\u2500\u2500 kailash-nexus/ # Multi-channel platform\n\u2502 \u251c\u2500\u2500 kailash-mcp/ # Enterprise MCP platform\n\u2502 \u251c\u2500\u2500 ai_registry/ # Advanced RAG capabilities\n\u2502 \u2514\u2500\u2500 user_management/ # Enterprise RBAC system\n\u251c\u2500\u2500 tests/ # 2,400+ tests (100% pass rate)\n\u251c\u2500\u2500 docs/ # Comprehensive documentation\n\u2514\u2500\u2500 examples/ # Feature validation examples\n```\n\n## \ud83d\ude80 Quick Start\n\n### Installation Options\n\n```bash\n# Core SDK only\npip install kailash\n\n# With complete app frameworks\npip install kailash[dataflow,nexus] # Database + multi-channel\npip install kailash[all] # Everything\n\n# Or install apps directly\npip install kailash-dataflow # Zero-config database framework\npip install kailash-nexus # Multi-channel platform\n```\n\n### DataFlow: Zero-Config Database Operations\n\n```python\nfrom dataflow import DataFlow\n\n# Zero-configuration database operations\napp = DataFlow()\n\n# MongoDB-style queries across any database\nusers = app.query(\"users\").where({\"age\": {\"$gt\": 18}}).limit(10)\n\n# Redis-powered caching with smart invalidation\ncached_result = app.cache().get(\"user_stats\",\n lambda: app.query(\"users\").aggregate([\n {\"$group\": {\"_id\": \"$department\", \"count\": {\"$sum\": 1}}}\n ])\n)\n\n# Start enterprise API server\napp.start() # Automatic API generation, monitoring, health checks\n```\n\n### Nexus: Multi-Channel Platform\n\n```python\nfrom nexus import Nexus\n\n# Single codebase \u2192 API + CLI + MCP\napp = Nexus()\n\n# Register workflow once, available on all channels\n@app.workflow\ndef process_data(input_data):\n return {\"processed\": len(input_data)}\n\n# Zero-config startup\napp.start()\n\n# Now available as:\n# - REST API: POST /workflows/process_data\n# - CLI: nexus run process_data\n# - MCP: AI agents can call process_data tool\n```\n\n### A2A Multi-Agent Coordination\n\n```python\nfrom kailash.workflow.builder import WorkflowBuilder\nfrom kailash.runtime.local import LocalRuntime\n\n# Build A2A coordination workflow\nworkflow = WorkflowBuilder()\nworkflow.add_node(\"A2ACoordinatorNode\", \"coordinator\", {\n \"use_google_protocol\": True,\n \"enable_semantic_memory\": True,\n \"delegation_strategy\": \"skill_based\"\n})\nworkflow.add_node(\"HybridSearchNode\", \"discovery\", {\n \"strategies\": [\"semantic\", \"keyword\", \"skill_based\"],\n \"adaptive_optimization\": True\n})\nworkflow.add_node(\"SemanticMemoryNode\", \"memory\", {\n \"embedding_provider\": \"openai\",\n \"memory_type\": \"long_term\",\n \"context_window\": 8192\n})\n\n# Connect for intelligent agent coordination\nworkflow.add_connection(\"coordinator\", \"discovery\", \"agent_request\", \"search_query\")\nworkflow.add_connection(\"discovery\", \"memory\", \"agent_matches\", \"context\")\n\n# Execute with enterprise monitoring\nruntime = LocalRuntime()\nresults, run_id = runtime.execute(workflow.build())\n```\n\n## \ud83c\udfaf Key Features\n\n### \ud83e\uddea **Testing Excellence**\n- **2,400+ tests** with 100% pass rate\n- **11x performance improvement** (117s \u2192 10.75s execution)\n- **Docker integration** for real PostgreSQL, Redis, MongoDB\n- **Smart isolation** without process forking overhead\n\n### \ud83c\udfe2 **Enterprise Ready**\n- **Multi-tenant architecture** with complete isolation\n- **RBAC/ABAC security** with fine-grained permissions\n- **Audit logging** with compliance frameworks (GDPR, CCPA)\n- **Distributed transactions** with Saga/2PC patterns\n- **Circuit breaker** and resilience patterns\n\n### \ud83e\udd16 **AI Integration**\n- **115+ production nodes** including 47+ specialized RAG nodes\n- **Real MCP execution** by default for all AI agents\n- **Self-organizing agent pools** with intelligent coordination\n- **Complete LLM integration** with embeddings and vector search\n\n### \u26a1 **Performance & Scale**\n- **31.8M operations/second** query performance baseline\n- **Connection pooling** with automatic resource management\n- **Redis caching** with intelligent invalidation patterns\n- **Async/await** throughout with proper separation\n\n## \ud83c\udfd7\ufe0f Node Ecosystem (115+ Nodes)\n\n### Core Categories\n- **Data Nodes**: CSVReaderNode, AsyncSQLDatabaseNode, QueryBuilderNode, QueryCacheNode\n- **AI Nodes**: LLMAgentNode, IterativeLLMAgentNode, EmbeddingGeneratorNode, SelfOrganizingAgentNode\n- **A2A Nodes**: A2ACoordinatorNode, HybridSearchNode, AdaptiveSearchNode, SemanticMemoryNode, StreamingAnalyticsNode\n- **RAG Nodes**: 47+ specialized nodes for document processing and retrieval\n- **Security Nodes**: ThreatDetectionNode, AuditLogNode, AccessControlManager\n- **Monitoring Nodes**: TransactionMetricsNode, DeadlockDetectorNode, PerformanceAnomalyNode\n- **Transaction Nodes**: DistributedTransactionManagerNode, SagaCoordinatorNode\n\n### Advanced Features\n- **A2A Communication**: Google Protocol-based multi-agent coordination\n- **Semantic Memory**: Long-term memory management for agent interactions\n- **Hybrid Search**: Multi-strategy agent discovery and matching\n- **Cyclic Workflows**: CycleBuilder API with convergence detection\n- **Distributed Transactions**: Automatic Saga/2PC pattern selection\n- **Real-time Monitoring**: WebSocket streaming with performance metrics\n- **Enterprise Security**: Multi-factor auth, threat detection, compliance\n\n## \ud83d\udcca Performance Metrics\n\n### Recent Achievements\n- **11x faster test execution**: 117s \u2192 10.75s with smart isolation\n- **100% test pass rate**: 2,400+ tests across all categories\n- **31.8M operations/second**: Query performance baseline\n- **30,000+ iterations/second**: Cyclic workflow execution\n\n### Enterprise Benchmarks\n- **Query Cache**: 99.9% hit rate with intelligent invalidation\n- **Connection Pooling**: 10,000+ concurrent connections\n- **MCP Integration**: 407 tests with 100% pass rate\n- **Security**: Zero vulnerabilities in production deployment\n\n## \ud83d\ude80 Applications Built with Kailash\n\n### 1. DataFlow - Zero-Config Database Platform (v0.3.1)\n```bash\npip install kailash-dataflow\n```\n- **MongoDB-style queries** across PostgreSQL, MySQL, SQLite\n- **Redis caching** with enterprise-grade invalidation\n- **Automatic API generation** with OpenAPI documentation\n- **4 production examples** with complete deployment guides\n- **Latest**: v0.3.1 - Enhanced transaction support and schema management\n\n### 2. Nexus - Multi-Channel Platform (v1.0.3)\n```bash\npip install kailash-nexus\n```\n- **Unified API, CLI, and MCP** from single codebase\n- **Enterprise orchestration** with multi-tenancy\n- **Session management** with cross-channel synchronization\n- **105 tests** with comprehensive validation\n- **Latest**: v1.0.3 - Production-ready release with enhanced stability\n\n### 3. AI Registry - Advanced RAG Platform\n```bash\npip install kailash-ai-registry\n```\n- **47+ specialized RAG nodes** for document processing\n- **Advanced retrieval** with semantic search and re-ranking\n- **Multi-modal support** with image and text processing\n- **Enterprise deployment** with scalable architecture\n\n### 4. User Management - Enterprise RBAC\n```bash\npip install kailash-user-management\n```\n- **Complete RBAC system** with role hierarchy\n- **Multi-factor authentication** with enterprise integration\n- **Audit logging** with compliance frameworks\n- **Django-style capabilities** built on SDK architecture\n\n## \ud83e\uddea Testing & Quality\n\n### Comprehensive Test Suite\n```bash\n# All tests (2,400+ tests)\npytest\n\n# Fast unit tests (11x faster execution)\npytest tests/unit/ --timeout=1\n\n# Integration tests with Docker\npytest tests/integration/ --timeout=5\n\n# End-to-end scenarios\npytest tests/e2e/ --timeout=10\n```\n\n### Test Infrastructure\n- **Docker Integration**: Real PostgreSQL, Redis, MongoDB for testing\n- **Smart Isolation**: Fixture-based isolation without process forking\n- **Performance Monitoring**: Automated benchmarks and regression detection\n- **100% Pass Rate**: Comprehensive fixes across all test categories\n\n## \ud83d\udee1\ufe0f Security & Compliance\n\n### Enterprise Security\n- **Multi-factor Authentication**: TOTP, WebAuthn, SMS integration\n- **Threat Detection**: Real-time analysis with behavior monitoring\n- **Access Control**: Fine-grained RBAC/ABAC with policy engines\n- **Audit Logging**: Comprehensive trails with integrity verification\n\n### Compliance Frameworks\n- **GDPR/CCPA**: Built-in data protection and privacy controls\n- **SOX**: Financial reporting controls and audit trails\n- **HIPAA**: Healthcare data protection patterns\n- **Multi-tenant Isolation**: Complete tenant-aware operations\n\n## \ud83d\udcda Documentation & Resources\n\n### For Users\n- **[SDK Users Guide](sdk-users/)**: Complete workflow development guide\n- **[Node Selection Guide](sdk-users/2-core-concepts/nodes/node-selection-guide.md)**: Smart node selection with decision trees\n- **[Enterprise Patterns](sdk-users/5-enterprise/)**: Production deployment patterns\n- **[API Documentation](https://integrum.github.io/kailash-python-sdk)**: Complete API reference\n\n### For Contributors\n- **[SDK Contributors Guide](sdk-contributors/)**: Internal SDK development\n- **[Architecture Decisions](sdk-contributors/architecture/)**: ADRs and design decisions\n- **[Testing Guide](tests/README.md)**: 3-tier testing strategy\n\n### Quick References\n- **[Cheatsheet](sdk-users/2-core-concepts/cheatsheet/)**: 53 copy-paste patterns\n- **[Common Mistakes](sdk-users/2-core-concepts/validation/common-mistakes.md)**: Error patterns and solutions\n- **[Performance Guide](sdk-users/5-enterprise/performance/)**: Optimization patterns\n\n## \ud83d\udea2 Production Deployment\n\n### Container Deployment\n```bash\n# Export workflow to container format\npython -c \"\nfrom kailash.utils.export import export_workflow\nexport_workflow(workflow, 'production.yaml', format='kailash')\n\"\n\n# Deploy to Kailash platform\nkailash deploy production.yaml --environment prod\n```\n\n### Monitoring & Observability\n```python\nfrom kailash.visualization import DashboardServer\n\n# Real-time monitoring dashboard\nserver = DashboardServer(port=8080)\nserver.start()\n# Open http://localhost:8080 for live metrics\n```\n\n### Enterprise Features\n- **Multi-tenant deployment** with complete isolation\n- **Distributed transactions** with automatic recovery\n- **Circuit breaker patterns** for resilience\n- **Health monitoring** with automated alerting\n\n## \ud83e\udd1d Contributing\n\nWe use a **Claude Code-driven workflow** for all development:\n\n### New Team Member?\n**Start Here \u2192 [NEW_TEAM_MEMBER.md](NEW_TEAM_MEMBER.md)**\n\n### Development Workflow\n```bash\n# Clone and setup\ngit clone https://github.com/integrum/kailash-python-sdk.git\ncd kailash-python-sdk\nuv sync\n\n# Run tests (2,400+ tests)\npytest tests/unit/ --timeout=1 # Fast unit tests\npytest tests/integration/ --timeout=5 # Integration tests\npytest tests/e2e/ --timeout=10 # End-to-end tests\n\n# Code quality\nblack .\nisort .\nruff check .\n```\n\n### Claude Code Workflow\nAll project management through conversational AI:\n- **No manual TODO editing** - Claude Code handles all updates\n- **No direct GitHub issues** - Created through planning sessions\n- **All progress tracked** - Through natural conversation\n\nSee [Contributing Guide](CONTRIBUTING.md) and [sdk-contributors/CLAUDE.md](sdk-contributors/CLAUDE.md).\n\n## \ud83d\udcc8 Project Status\n\n### \u2705 v0.8.4 - A2A Google Protocol Enhancement\n- **Advanced Agent Coordination**: A2ACoordinatorNode with Google Protocol patterns\n- **Hybrid Search System**: Multi-strategy agent discovery and matching\n- **Semantic Memory**: Long-term memory management for agent interactions\n- **Real-time Analytics**: Streaming performance monitoring for A2A workflows\n- **Backward Compatible**: Seamless integration with existing implementations\n- **Production Ready**: Enterprise-grade multi-agent coordination patterns\n\n### \u2705 v0.8.1 - Complete App Framework\n- **Complete Application Framework**: DataFlow, Nexus, AI Registry, User Management\n- **PyPI Integration**: All packages available with proper extras support\n- **Performance Breakthrough**: 11x faster test execution\n- **Testing Excellence**: 2,400+ tests with 100% pass rate\n- **Enterprise Ready**: Production deployment patterns\n\n### \u2705 v0.7.0 - Major Framework Release\n- **DataFlow Platform**: Zero-config database operations\n- **Nexus Platform**: Multi-channel orchestration\n- **AI Registry**: Advanced RAG capabilities\n- **User Management**: Enterprise RBAC system\n- **Testing Infrastructure**: Docker integration, comprehensive validation\n\n### \ud83d\udea7 Roadmap\n- **Visual Workflow Builder**: Studio UI for drag-and-drop workflow creation\n- **Advanced Analytics**: ML-powered workflow optimization\n- **Cloud Integration**: Native AWS/GCP/Azure deployment\n- **Mobile SDKs**: iOS and Android workflow execution\n\n## \ud83d\udcc4 License\n\nThis project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.\n\n## \ud83d\ude4f Acknowledgments\n\nBuilt with \u2764\ufe0f by the Integrum team for the Kailash ecosystem.\n\nSpecial recognition for the **11x performance breakthrough** and **100% test pass rate** achieved through innovative engineering and comprehensive testing strategies.\n\n---\n\n<p align=\"center\">\n <strong>Ready to build enterprise-grade applications?</strong><br>\n <a href=\"https://pypi.org/project/kailash/\">Install from PyPI</a> \u2022\n <a href=\"sdk-users/README.md\">Documentation</a> \u2022\n <a href=\"examples/\">Examples</a> \u2022\n <a href=\"https://github.com/integrum/kailash-python-sdk\">GitHub</a>\n</p>\n",
"bugtrack_url": null,
"license": null,
"summary": "Python SDK for the Kailash container-node architecture",
"version": "0.9.3",
"project_urls": {
"Bug Tracker": "https://github.com/integrum/kailash-python-sdk/issues",
"Homepage": "https://github.com/integrum/kailash-python-sdk"
},
"split_keywords": [],
"urls": [
{
"comment_text": null,
"digests": {
"blake2b_256": "0b458fd246cc27e61405e7993a3b7b4e08c5bc5e943fe1b3d9c8e4045861eb6b",
"md5": "652d7b867287b6fa9e31c765df68409f",
"sha256": "b8028b8c3f5601f15015f9cff6fbae6aa2e319f5a375e76d8fe410482ba98f37"
},
"downloads": -1,
"filename": "kailash-0.9.3-py3-none-any.whl",
"has_sig": false,
"md5_digest": "652d7b867287b6fa9e31c765df68409f",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.11",
"size": 1935265,
"upload_time": "2025-07-30T14:49:25",
"upload_time_iso_8601": "2025-07-30T14:49:25.023299Z",
"url": "https://files.pythonhosted.org/packages/0b/45/8fd246cc27e61405e7993a3b7b4e08c5bc5e943fe1b3d9c8e4045861eb6b/kailash-0.9.3-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "cb2013d28cc5decc65def6b57e9256d64e851b93a8503fa6dc955ebdfa66da8a",
"md5": "976b1b1eff7ad234c20fd2aa77b8a078",
"sha256": "5b941d563829a97ddded86fd970dbbec00fac37f5b2f7a5ebd862c60e59f1c7e"
},
"downloads": -1,
"filename": "kailash-0.9.3.tar.gz",
"has_sig": false,
"md5_digest": "976b1b1eff7ad234c20fd2aa77b8a078",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.11",
"size": 1714206,
"upload_time": "2025-07-30T14:49:27",
"upload_time_iso_8601": "2025-07-30T14:49:27.661618Z",
"url": "https://files.pythonhosted.org/packages/cb/20/13d28cc5decc65def6b57e9256d64e851b93a8503fa6dc955ebdfa66da8a/kailash-0.9.3.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2025-07-30 14:49:27",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "integrum",
"github_project": "kailash-python-sdk",
"github_not_found": true,
"lcname": "kailash"
}
JSON
