# 🚀 UnrealOn - Next-Generation Web Scraping Platform
> **Enterprise-grade browser automation framework that makes web scraping simple, reliable, and scalable**
UnrealOn is a revolutionary web scraping platform that **solves all developer problems** once and for all. Forget about CAPTCHAs, blocks, browser setup, and infrastructure - **just write business logic!**
[](https://badge.fury.io/py/unrealon)
[](https://www.python.org/downloads/)
[](https://opensource.org/licenses/MIT)
---
## ✨ Why UnrealOn?
### 🛡️ **Unbreakable Stealth Mode**
- **100% bot detection bypass** - enterprise-level anti-detection
- Automatic User-Agent, fingerprint, and TLS parameter rotation
- Human-like behavior simulation at browser level
- **No CAPTCHAs or blocks** - the system handles everything
### 🧠 **AI-Powered Parsing**
- **Smart parsing by URL** - just provide a link, get structured data
- Automatic content recognition using LLM
- Adapts to website structure changes
- **Zero selector configuration**
### 🎯 **Zero-Configuration Approach**
- **Works out of the box** - no complex setup required
- Automatic browser and proxy management
- Built-in logging and monitoring system
- **Just run and it works**
### 📊 **UnrealOn Cloud Platform**
- Real-time monitoring of all parsers
- Centralized logging and analytics
- Task management through web interface
- **Complete control over your parsing farm**
---
## 🎮 Quick Start
### 1️⃣ Installation (30 seconds)
```bash
pip install unrealon
```
### 2️⃣ Your First Parser (2 minutes)
```python
from unrealon import ParserManager
import asyncio
class MyParser(ParserManager):
async def parse_products(self, url: str):
# Navigate with built-in stealth
await self.browser.navigate(url)
# AI-powered extraction - no selectors needed!
result = await self.extract_with_ai(
url,
"Extract all products with title, price, and image"
)
return result.data
# Usage
async def main():
parser = MyParser()
await parser.setup()
products = await parser.parse_products("https://example.com/products")
print(f"Found {len(products)} products!")
await parser.cleanup()
asyncio.run(main())
```
### 3️⃣ Daemon Mode with Cloud Platform
```python
# Run as daemon with real-time dashboard
await parser.start_daemon()
# Now control via web interface at https://cloud.unrealon.com
```
**That's it! You have a production-ready parser in 3 steps!**
---
## 🏗️ Architecture Overview
### 🎯 **Developer's Perspective - Simple & Clean**
**Architecture Overview - Developer's Perspective:**
- **💻 Your Parser Code (Python Script)**
- Simple class extending ParserManager
- Focus on business logic only
- Example: `async def parse_products(url): return await self.extract_with_ai(url)`
- **🚀 Built-in Browser (Playwright + Stealth)**
- ✅ Anti-Detection
- ✅ Proxy Rotation
- ✅ CAPTCHA Solving
- **🌐 Target Websites**
- 🛒 E-commerce Sites
- 📰 News Portals
- 📱 Social Media
- 🌍 Any Website
- **📊 UnrealOn Dashboard**
- 📈 Real-time Monitoring
- 📋 Logs & Analytics
- ⚙️ Task Management
- 💾 Data Storage
**Flow:** Your code → Built-in Browser → Target Websites
**Automatic Sync:** Your code ⟷ UnrealOn Dashboard (metrics, logs, parsed data)
### 🔄 **Two Operation Modes**
#### 🔧 **Standalone Mode** (Local Development)
**Standalone Mode Flow:**
- 💻 Your Parser (Local Python Script)
- 🚀 Built-in Browser with Stealth Enabled
- 🌐 Target Website (E-commerce/News)
- 💾 Local Results (JSON/CSV/Database)
**Process:** Your Parser → Browser → Target Website → Local Results
#### 🚀 **Dashboard Mode** (Production)
**Dashboard Mode Flow:**
- 💻 Your Parser (Production Script)
- 🚀 Built-in Browser with Enterprise Stealth
- 🌐 Target Website (E-commerce/News)
- 📊 UnrealOn Dashboard (Cloud Platform)
- 👥 Team Collaboration & Role Management
- 📈 Analytics & Business Intelligence Reports
- 📤 Data Export via API/Webhooks
**Process:**
- Parser → Browser → Target Website
- Parser → Dashboard → Team/Analytics/Export
### 🎯 **What You Focus On vs What UnrealOn Handles**
**What You Focus On vs What UnrealOn Handles:**
**🎯 Your Focus - Business Logic Only:**
1. 🎯 Define Target URLs
- Example: `urls = ['amazon.com', 'ebay.com']`
2. 🔍 Specify Data to Extract
- Example: `'Extract title, price, rating'`
3. 📊 Handle Results
- Save to database/API
4. ⏰ Schedule Tasks
- Run every hour/daily
**🚀 UnrealOn Handles All Infrastructure:**
1. 🌐 Browser Management (Playwright + Chrome)
2. 🛡️ Stealth & Anti-Detection (Fingerprint Spoofing)
3. 🔄 Proxy Rotation (Global IP Pool)
4. 🤖 CAPTCHA Solving (Automatic Resolution)
5. ⚠️ Error Handling (Retry Logic)
6. 📈 Logging & Monitoring (Real-time Metrics)
7. 💾 Data Storage (Cloud Database)
8. ⚡ Performance Optimization (Auto-scaling)
**Each of your actions automatically triggers the corresponding infrastructure components.**
**🎉 Result: You write 10 lines of business logic, UnrealOn handles 1000+ lines of infrastructure!**
---
## 🎛️ Multiple Operation Modes
### 🔧 **Standalone Mode** (Simplest)
Perfect for quick tasks and development:
```python
from unrealon import quick_parse
# One-liner magic - AI does everything
products = await quick_parse("https://shop.com/products")
```
### 🤖 **Traditional Mode** (Full Control)
For developers who prefer CSS selectors:
```python
from unrealon import ParserManager
from bs4 import BeautifulSoup
class TraditionalParser(ParserManager):
async def parse_products(self, url: str):
html = await self.browser.get_html(url)
soup = BeautifulSoup(html, "html.parser")
products = []
for item in soup.select(".product"):
products.append({
"title": item.select_one(".title").text,
"price": item.select_one(".price").text
})
return products
```
### 🚀 **Daemon Mode** (Production)
For enterprise deployments with dashboard:
```python
class ProductionParser(ParserManager):
async def handle_parse_command(self, command):
"""Handle remote commands from dashboard"""
url = command.data.get("url")
return await self.parse_products(url)
# Start daemon
await parser.start_daemon(
api_key="your_api_key"
)
```
### ⏰ **Scheduled Mode** (Automation)
For regular data collection:
```python
class ScheduledParser(ParserManager):
async def run_scheduled(self):
"""Called automatically by scheduler"""
urls = self.get_target_urls()
results = []
for url in urls:
data = await self.parse_products(url)
results.extend(data)
return results
# Run every hour
await parser.start_daemon(schedule="1h")
```
---
## 🛡️ Advanced Stealth Technologies
### Built-in Anti-Detection Features:
- **Playwright Stealth** - Browser fingerprint modification
- **Proxy Rotation** - Automatic IP address switching
- **User-Agent Spoofing** - Mimicking different browsers
- **Request Timing** - Human-like delays
- **Cookie Management** - Session persistence
- **CAPTCHA Solving** - Automatic CAPTCHA resolution
- **Behavioral Patterns** - User action simulation
### Stealth Levels:
```python
# Configure stealth level
parser = ParserManager(stealth_level="maximum") # minimal | balanced | maximum
```
- **Minimal** - Basic protection (fast)
- **Balanced** - Optimal balance (recommended)
- **Maximum** - Maximum protection (slower but bulletproof)
---
## 🧠 AI-Powered Features
```python
# Smart content extraction - AI understands page structure
result = await parser.extract_with_ai(
url="https://ecommerce.com/products",
instruction="Extract product name, price, rating"
)
print(f"Extracted {len(result.data)} products")
print(f"Confidence: {result.confidence}")
# AI adapts to website changes automatically
result = await parser.adaptive_parse(
url="https://news.com",
data_type="articles",
fields=["title", "author", "date"]
)
```
---
## 📊 Enterprise Dashboard Features
- 📈 **Live Metrics** - RPS, success rate, errors
- 📋 **Task Management** - Create, stop, schedule tasks
- 🔍 **Log Search** - Instant search across all events
- 🚨 **Alerts** - Slack, Email, Telegram notifications
- 👥 **Team Collaboration** - Roles and permissions
**Access:** [https://cloud.unrealon.com](https://cloud.unrealon.com)
```python
# Control parsers via API
response = requests.post("https://api.unrealon.com/parsers/start", {
"parser_id": "my_parser", "config": {"max_pages": 10}
})
```
---
## 🎯 Working Examples
### E-commerce Parser
```python
class EcommerceParser(ParserManager):
async def parse_products(self, url: str):
await self.browser.navigate(url)
# AI extracts all product data automatically
products = await self.extract_with_ai(
url, "Extract products with title, price, rating"
)
return products.data
# Usage - Parse multiple sites
parser = EcommerceParser()
await parser.setup()
amazon_products = await parser.parse_products("https://amazon.com/s?k=laptop")
ebay_products = await parser.parse_products("https://ebay.com/sch/laptop")
await parser.cleanup()
```
### News & Social Media
```python
class NewsParser(ParserManager):
async def parse_articles(self, url: str):
await self.browser.navigate(url)
return await self.extract_with_ai(url, "Extract articles with title, author, date")
# Parse multiple sources
sources = ["https://news.ycombinator.com", "https://techcrunch.com"]
all_articles = []
for source in sources:
articles = await parser.parse_articles(source)
all_articles.extend(articles)
```
---
## 🔧 Configuration
```yaml
# config.yaml
parser:
name: "My Parser"
target_urls:
- https://example.com/products
browser:
headless: true
bridge:
enabled: true
api_key: "your_api_key"
processing:
delay_between_requests: 1.0
max_pages: 1
logging:
level: INFO
to_bridge: true
```
---
## 🚀 CLI Tools
```bash
# Quick parsing
unrealon parse --url https://example.com --ai-instruction "Extract products"
# Start daemon
unrealon daemon --config config.yaml
# Test stealth
unrealon browser test-stealth --url https://bot.sannysoft.com
# Export results
unrealon export --format csv --output results.csv
```
---
## 🎉 Real-World Success Stories
### 🚗 **CarAPIs** - Automotive Data Platform
**Platform**: [carapis.com](https://carapis.com)
**Challenge**: Extract vehicle data from 500+ dealership websites
**Solution**: UnrealOn with AI-powered extraction
**Results**: 95% accuracy, 10M+ vehicles processed monthly
### 🛒 **ShopAPIs** - E-commerce Intelligence
**Platform**: [shopapis.com](https://shopapis.com)
**Challenge**: Monitor prices across 50+ e-commerce platforms
**Solution**: UnrealOn cluster with real-time monitoring
**Results**: 99.9% uptime, 1M+ products tracked daily
### 📊 **StockAPIs** - Financial Data Platform
**Platform**: [stockapis.com](https://stockapis.com)
**Challenge**: High-frequency financial data collection
**Solution**: UnrealOn with millisecond precision
**Results**: 100K+ data points per second, 99.99% accuracy
### 🏠 **PropAPIs** - Real Estate Intelligence
**Platform**: [propapis.com](https://propapis.com)
**Challenge**: Aggregate listings from 200+ real estate sites
**Solution**: UnrealOn with geographic clustering
**Results**: 5M+ properties indexed, real-time updates
**All platforms built with UnrealOn - proving enterprise reliability!**
---
## 💎 Enterprise Features
Need **enterprise capabilities**?
### 🏢 **Enterprise Edition Includes:**
- 🛡️ **Dedicated Infrastructure** - Private cloud deployment
- 🔒 **Advanced Security** - SOC2/GDPR compliance
- 🤝 **24/7 Support** - Dedicated success manager
- 📊 **Custom Analytics** - Tailored reporting and insights
- 🚀 **Priority Features** - Early access to new capabilities
- 🔧 **Custom Integrations** - Bespoke API development
### 📞 **Contact Enterprise Sales:**
- **Email**: [enterprise@unrealon.com](mailto:enterprise@unrealon.com)
- **Phone**: +1 (555) 123-4567
- **Schedule Demo**: [calendly.com/unrealon-demo](https://calendly.com/unrealon-demo)
---
## 📚 Documentation & Support
### 📖 **Resources:**
- [📘 Complete Documentation](https://docs.unrealon.com)
- [🎥 Video Tutorials](https://youtube.com/unrealon)
- [💬 Discord Community](https://discord.gg/unrealon)
- [📧 Technical Support](mailto:support@unrealon.com)
### 🎓 **Learning Path:**
1. [🚀 Quick Start (5 minutes)](https://docs.unrealon.com/quickstart)
2. [🏗️ Platform Architecture](https://docs.unrealon.com/architecture)
3. [🛡️ Advanced Stealth Guide](https://docs.unrealon.com/stealth)
4. [🤖 AI Parsing Tutorial](https://docs.unrealon.com/ai-parsing)
5. [📊 Dashboard Management](https://docs.unrealon.com/dashboard)
### 🆘 **Getting Help:**
- **GitHub Issues**: [Report bugs](https://github.com/unrealon/unrealon-rpc/issues)
- **GitHub Discussions**: [Ask questions](https://github.com/unrealon/unrealon-rpc/discussions)
- **Stack Overflow**: Tag your questions with `unrealon`
- **Email Support**: [support@unrealon.com](mailto:support@unrealon.com)
---
## 🤝 Contributing
We welcome contributions! Here's how to get started:
### Development Setup
```bash
# Clone repository
git clone https://github.com/unrealon/unrealon-rpc.git
cd unrealon-rpc
# Install development dependencies
poetry install
# Install pre-commit hooks
pre-commit install
# Run tests
pytest
# Run linting
black src/
isort src/
mypy src/
```
### Contribution Guidelines
- Follow PEP 8 style guide
- Add type hints to all functions
- Write comprehensive docstrings
- Include tests for new features
- Update documentation as needed
---
## 📄 License
This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
---
<div align="center">
## 🚀 Start Building Amazing Parsers Today!
```bash
pip install unrealon
```
**UnrealOn Platform** - The Future of Web Scraping is Here! 🌟
[](https://github.com/unrealon)
[](https://discord.gg/unrealon)
[](https://docs.unrealon.com)
[](https://twitter.com/unrealon)
*Built with ❤️ by the UnrealOn Team*
**Ready to revolutionize your web scraping?** [Get Started Now!](https://docs.unrealon.com/quickstart)
</div>
Raw data
{
"_id": null,
"home_page": null,
"name": "unrealon",
"maintainer": null,
"docs_url": null,
"requires_python": "<4.0,>=3.10",
"maintainer_email": "UnrealOS Team <dev@unrealos.com>",
"keywords": "ai-parsing, anti-detection, bot-protection, browser-automation, captcha-bypass, data-mining, distributed-parsing, enterprise-scraping, html-extraction, playwright, proxy-rotation, scalable-scraping, stealth-scraping, web-scraping, websocket-bridge, zero-config",
"author": null,
"author_email": "UnrealOS Team <dev@unrealos.com>",
"download_url": "https://files.pythonhosted.org/packages/87/57/5da9a858d9c8a1e2b35c3ee3307e727add5d42a125ea56e6de515a34f768/unrealon-1.1.5.tar.gz",
"platform": null,
"description": "# \ud83d\ude80 UnrealOn - Next-Generation Web Scraping Platform\n\n> **Enterprise-grade browser automation framework that makes web scraping simple, reliable, and scalable**\n\nUnrealOn is a revolutionary web scraping platform that **solves all developer problems** once and for all. Forget about CAPTCHAs, blocks, browser setup, and infrastructure - **just write business logic!**\n\n[](https://badge.fury.io/py/unrealon)\n[](https://www.python.org/downloads/)\n[](https://opensource.org/licenses/MIT)\n\n---\n\n## \u2728 Why UnrealOn?\n\n### \ud83d\udee1\ufe0f **Unbreakable Stealth Mode**\n- **100% bot detection bypass** - enterprise-level anti-detection\n- Automatic User-Agent, fingerprint, and TLS parameter rotation\n- Human-like behavior simulation at browser level\n- **No CAPTCHAs or blocks** - the system handles everything\n\n### \ud83e\udde0 **AI-Powered Parsing**\n- **Smart parsing by URL** - just provide a link, get structured data\n- Automatic content recognition using LLM\n- Adapts to website structure changes\n- **Zero selector configuration**\n\n### \ud83c\udfaf **Zero-Configuration Approach**\n- **Works out of the box** - no complex setup required\n- Automatic browser and proxy management\n- Built-in logging and monitoring system\n- **Just run and it works**\n\n### \ud83d\udcca **UnrealOn Cloud Platform**\n- Real-time monitoring of all parsers\n- Centralized logging and analytics\n- Task management through web interface\n- **Complete control over your parsing farm**\n\n---\n\n## \ud83c\udfae Quick Start\n\n### 1\ufe0f\u20e3 Installation (30 seconds)\n```bash\npip install unrealon\n```\n\n### 2\ufe0f\u20e3 Your First Parser (2 minutes)\n```python\nfrom unrealon import ParserManager\nimport asyncio\n\nclass MyParser(ParserManager):\n async def parse_products(self, url: str):\n # Navigate with built-in stealth\n await self.browser.navigate(url)\n \n # AI-powered extraction - no selectors needed!\n result = await self.extract_with_ai(\n url,\n \"Extract all products with title, price, and image\"\n )\n \n return result.data\n\n# Usage\nasync def main():\n parser = MyParser()\n await parser.setup()\n \n products = await parser.parse_products(\"https://example.com/products\")\n print(f\"Found {len(products)} products!\")\n \n await parser.cleanup()\n\n asyncio.run(main())\n```\n\n### 3\ufe0f\u20e3 Daemon Mode with Cloud Platform\n```python\n# Run as daemon with real-time dashboard\nawait parser.start_daemon()\n\n# Now control via web interface at https://cloud.unrealon.com\n```\n\n**That's it! You have a production-ready parser in 3 steps!**\n\n---\n\n## \ud83c\udfd7\ufe0f Architecture Overview\n\n### \ud83c\udfaf **Developer's Perspective - Simple & Clean**\n\n**Architecture Overview - Developer's Perspective:**\n\n- **\ud83d\udcbb Your Parser Code (Python Script)**\n - Simple class extending ParserManager\n - Focus on business logic only\n - Example: `async def parse_products(url): return await self.extract_with_ai(url)`\n\n- **\ud83d\ude80 Built-in Browser (Playwright + Stealth)**\n - \u2705 Anti-Detection\n - \u2705 Proxy Rotation\n - \u2705 CAPTCHA Solving\n\n- **\ud83c\udf10 Target Websites**\n - \ud83d\uded2 E-commerce Sites\n - \ud83d\udcf0 News Portals\n - \ud83d\udcf1 Social Media\n - \ud83c\udf0d Any Website\n\n- **\ud83d\udcca UnrealOn Dashboard**\n - \ud83d\udcc8 Real-time Monitoring\n - \ud83d\udccb Logs & Analytics\n - \u2699\ufe0f Task Management\n - \ud83d\udcbe Data Storage\n\n**Flow:** Your code \u2192 Built-in Browser \u2192 Target Websites\n**Automatic Sync:** Your code \u27f7 UnrealOn Dashboard (metrics, logs, parsed data)\n\n### \ud83d\udd04 **Two Operation Modes**\n\n#### \ud83d\udd27 **Standalone Mode** (Local Development)\n**Standalone Mode Flow:**\n\n- \ud83d\udcbb Your Parser (Local Python Script)\n- \ud83d\ude80 Built-in Browser with Stealth Enabled\n- \ud83c\udf10 Target Website (E-commerce/News)\n- \ud83d\udcbe Local Results (JSON/CSV/Database)\n\n**Process:** Your Parser \u2192 Browser \u2192 Target Website \u2192 Local Results\n\n#### \ud83d\ude80 **Dashboard Mode** (Production)\n**Dashboard Mode Flow:**\n\n- \ud83d\udcbb Your Parser (Production Script)\n- \ud83d\ude80 Built-in Browser with Enterprise Stealth\n- \ud83c\udf10 Target Website (E-commerce/News)\n- \ud83d\udcca UnrealOn Dashboard (Cloud Platform)\n - \ud83d\udc65 Team Collaboration & Role Management\n - \ud83d\udcc8 Analytics & Business Intelligence Reports\n - \ud83d\udce4 Data Export via API/Webhooks\n\n**Process:** \n- Parser \u2192 Browser \u2192 Target Website\n- Parser \u2192 Dashboard \u2192 Team/Analytics/Export\n\n### \ud83c\udfaf **What You Focus On vs What UnrealOn Handles**\n\n**What You Focus On vs What UnrealOn Handles:**\n\n**\ud83c\udfaf Your Focus - Business Logic Only:**\n1. \ud83c\udfaf Define Target URLs\n - Example: `urls = ['amazon.com', 'ebay.com']`\n2. \ud83d\udd0d Specify Data to Extract\n - Example: `'Extract title, price, rating'`\n3. \ud83d\udcca Handle Results\n - Save to database/API\n4. \u23f0 Schedule Tasks\n - Run every hour/daily\n\n**\ud83d\ude80 UnrealOn Handles All Infrastructure:**\n1. \ud83c\udf10 Browser Management (Playwright + Chrome)\n2. \ud83d\udee1\ufe0f Stealth & Anti-Detection (Fingerprint Spoofing)\n3. \ud83d\udd04 Proxy Rotation (Global IP Pool)\n4. \ud83e\udd16 CAPTCHA Solving (Automatic Resolution)\n5. \u26a0\ufe0f Error Handling (Retry Logic)\n6. \ud83d\udcc8 Logging & Monitoring (Real-time Metrics)\n7. \ud83d\udcbe Data Storage (Cloud Database)\n8. \u26a1 Performance Optimization (Auto-scaling)\n\n**Each of your actions automatically triggers the corresponding infrastructure components.**\n\n**\ud83c\udf89 Result: You write 10 lines of business logic, UnrealOn handles 1000+ lines of infrastructure!**\n\n---\n\n## \ud83c\udf9b\ufe0f Multiple Operation Modes\n\n### \ud83d\udd27 **Standalone Mode** (Simplest)\nPerfect for quick tasks and development:\n\n```python\nfrom unrealon import quick_parse\n\n# One-liner magic - AI does everything\nproducts = await quick_parse(\"https://shop.com/products\")\n```\n\n### \ud83e\udd16 **Traditional Mode** (Full Control)\nFor developers who prefer CSS selectors:\n\n```python\nfrom unrealon import ParserManager\nfrom bs4 import BeautifulSoup\n\nclass TraditionalParser(ParserManager):\n async def parse_products(self, url: str):\n html = await self.browser.get_html(url)\n soup = BeautifulSoup(html, \"html.parser\")\n \n products = []\n for item in soup.select(\".product\"):\n products.append({\n \"title\": item.select_one(\".title\").text,\n \"price\": item.select_one(\".price\").text\n })\n \n return products\n```\n\n### \ud83d\ude80 **Daemon Mode** (Production)\nFor enterprise deployments with dashboard:\n\n```python\nclass ProductionParser(ParserManager):\n async def handle_parse_command(self, command):\n \"\"\"Handle remote commands from dashboard\"\"\"\n url = command.data.get(\"url\")\n return await self.parse_products(url)\n \n# Start daemon\nawait parser.start_daemon(\n api_key=\"your_api_key\"\n)\n```\n\n### \u23f0 **Scheduled Mode** (Automation)\nFor regular data collection:\n\n```python\nclass ScheduledParser(ParserManager):\n async def run_scheduled(self):\n \"\"\"Called automatically by scheduler\"\"\"\n urls = self.get_target_urls()\n results = []\n \n for url in urls:\n data = await self.parse_products(url)\n results.extend(data)\n \n return results\n\n# Run every hour\nawait parser.start_daemon(schedule=\"1h\")\n```\n\n---\n\n## \ud83d\udee1\ufe0f Advanced Stealth Technologies\n\n### Built-in Anti-Detection Features:\n- **Playwright Stealth** - Browser fingerprint modification\n- **Proxy Rotation** - Automatic IP address switching\n- **User-Agent Spoofing** - Mimicking different browsers\n- **Request Timing** - Human-like delays\n- **Cookie Management** - Session persistence\n- **CAPTCHA Solving** - Automatic CAPTCHA resolution\n- **Behavioral Patterns** - User action simulation\n\n### Stealth Levels:\n```python\n# Configure stealth level\nparser = ParserManager(stealth_level=\"maximum\") # minimal | balanced | maximum\n```\n\n- **Minimal** - Basic protection (fast)\n- **Balanced** - Optimal balance (recommended)\n- **Maximum** - Maximum protection (slower but bulletproof)\n\n---\n\n## \ud83e\udde0 AI-Powered Features\n\n```python\n# Smart content extraction - AI understands page structure\nresult = await parser.extract_with_ai(\n url=\"https://ecommerce.com/products\",\n instruction=\"Extract product name, price, rating\"\n)\n\nprint(f\"Extracted {len(result.data)} products\")\nprint(f\"Confidence: {result.confidence}\")\n\n# AI adapts to website changes automatically\nresult = await parser.adaptive_parse(\n url=\"https://news.com\",\n data_type=\"articles\",\n fields=[\"title\", \"author\", \"date\"]\n)\n```\n\n---\n\n## \ud83d\udcca Enterprise Dashboard Features\n\n- \ud83d\udcc8 **Live Metrics** - RPS, success rate, errors\n- \ud83d\udccb **Task Management** - Create, stop, schedule tasks\n- \ud83d\udd0d **Log Search** - Instant search across all events\n- \ud83d\udea8 **Alerts** - Slack, Email, Telegram notifications\n- \ud83d\udc65 **Team Collaboration** - Roles and permissions\n\n**Access:** [https://cloud.unrealon.com](https://cloud.unrealon.com)\n\n```python\n# Control parsers via API\nresponse = requests.post(\"https://api.unrealon.com/parsers/start\", {\n \"parser_id\": \"my_parser\", \"config\": {\"max_pages\": 10}\n})\n```\n\n---\n\n## \ud83c\udfaf Working Examples\n\n### E-commerce Parser\n```python\nclass EcommerceParser(ParserManager):\n async def parse_products(self, url: str):\n await self.browser.navigate(url)\n \n # AI extracts all product data automatically\n products = await self.extract_with_ai(\n url, \"Extract products with title, price, rating\"\n )\n \n return products.data\n\n# Usage - Parse multiple sites\nparser = EcommerceParser()\nawait parser.setup()\n\namazon_products = await parser.parse_products(\"https://amazon.com/s?k=laptop\")\nebay_products = await parser.parse_products(\"https://ebay.com/sch/laptop\")\n\nawait parser.cleanup()\n```\n\n### News & Social Media\n```python\nclass NewsParser(ParserManager):\n async def parse_articles(self, url: str):\n await self.browser.navigate(url)\n return await self.extract_with_ai(url, \"Extract articles with title, author, date\")\n\n# Parse multiple sources\nsources = [\"https://news.ycombinator.com\", \"https://techcrunch.com\"]\nall_articles = []\nfor source in sources:\n articles = await parser.parse_articles(source)\n all_articles.extend(articles)\n```\n\n---\n\n## \ud83d\udd27 Configuration\n\n```yaml\n# config.yaml\nparser:\n name: \"My Parser\"\n target_urls:\n - https://example.com/products\n\nbrowser:\n headless: true\n\nbridge:\n enabled: true\n api_key: \"your_api_key\"\n\nprocessing:\n delay_between_requests: 1.0\n max_pages: 1\n\nlogging:\n level: INFO\n to_bridge: true\n```\n\n---\n\n## \ud83d\ude80 CLI Tools\n\n```bash\n# Quick parsing\nunrealon parse --url https://example.com --ai-instruction \"Extract products\"\n\n# Start daemon\nunrealon daemon --config config.yaml\n\n# Test stealth\nunrealon browser test-stealth --url https://bot.sannysoft.com\n\n# Export results\nunrealon export --format csv --output results.csv\n```\n\n---\n\n## \ud83c\udf89 Real-World Success Stories\n\n### \ud83d\ude97 **CarAPIs** - Automotive Data Platform\n**Platform**: [carapis.com](https://carapis.com) \n**Challenge**: Extract vehicle data from 500+ dealership websites \n**Solution**: UnrealOn with AI-powered extraction \n**Results**: 95% accuracy, 10M+ vehicles processed monthly \n\n### \ud83d\uded2 **ShopAPIs** - E-commerce Intelligence\n**Platform**: [shopapis.com](https://shopapis.com) \n**Challenge**: Monitor prices across 50+ e-commerce platforms \n**Solution**: UnrealOn cluster with real-time monitoring \n**Results**: 99.9% uptime, 1M+ products tracked daily \n\n### \ud83d\udcca **StockAPIs** - Financial Data Platform\n**Platform**: [stockapis.com](https://stockapis.com) \n**Challenge**: High-frequency financial data collection \n**Solution**: UnrealOn with millisecond precision \n**Results**: 100K+ data points per second, 99.99% accuracy \n\n### \ud83c\udfe0 **PropAPIs** - Real Estate Intelligence\n**Platform**: [propapis.com](https://propapis.com) \n**Challenge**: Aggregate listings from 200+ real estate sites \n**Solution**: UnrealOn with geographic clustering \n**Results**: 5M+ properties indexed, real-time updates \n\n**All platforms built with UnrealOn - proving enterprise reliability!**\n\n---\n\n## \ud83d\udc8e Enterprise Features\n\nNeed **enterprise capabilities**?\n\n### \ud83c\udfe2 **Enterprise Edition Includes:**\n- \ud83d\udee1\ufe0f **Dedicated Infrastructure** - Private cloud deployment\n- \ud83d\udd12 **Advanced Security** - SOC2/GDPR compliance\n- \ud83e\udd1d **24/7 Support** - Dedicated success manager\n- \ud83d\udcca **Custom Analytics** - Tailored reporting and insights\n- \ud83d\ude80 **Priority Features** - Early access to new capabilities\n- \ud83d\udd27 **Custom Integrations** - Bespoke API development\n\n### \ud83d\udcde **Contact Enterprise Sales:**\n- **Email**: [enterprise@unrealon.com](mailto:enterprise@unrealon.com)\n- **Phone**: +1 (555) 123-4567\n- **Schedule Demo**: [calendly.com/unrealon-demo](https://calendly.com/unrealon-demo)\n\n---\n\n## \ud83d\udcda Documentation & Support\n\n### \ud83d\udcd6 **Resources:**\n- [\ud83d\udcd8 Complete Documentation](https://docs.unrealon.com)\n- [\ud83c\udfa5 Video Tutorials](https://youtube.com/unrealon)\n- [\ud83d\udcac Discord Community](https://discord.gg/unrealon)\n- [\ud83d\udce7 Technical Support](mailto:support@unrealon.com)\n\n### \ud83c\udf93 **Learning Path:**\n1. [\ud83d\ude80 Quick Start (5 minutes)](https://docs.unrealon.com/quickstart)\n2. [\ud83c\udfd7\ufe0f Platform Architecture](https://docs.unrealon.com/architecture)\n3. [\ud83d\udee1\ufe0f Advanced Stealth Guide](https://docs.unrealon.com/stealth)\n4. [\ud83e\udd16 AI Parsing Tutorial](https://docs.unrealon.com/ai-parsing)\n5. [\ud83d\udcca Dashboard Management](https://docs.unrealon.com/dashboard)\n\n### \ud83c\udd98 **Getting Help:**\n- **GitHub Issues**: [Report bugs](https://github.com/unrealon/unrealon-rpc/issues)\n- **GitHub Discussions**: [Ask questions](https://github.com/unrealon/unrealon-rpc/discussions)\n- **Stack Overflow**: Tag your questions with `unrealon`\n- **Email Support**: [support@unrealon.com](mailto:support@unrealon.com)\n\n---\n\n## \ud83e\udd1d Contributing\n\nWe welcome contributions! Here's how to get started:\n\n### Development Setup\n```bash\n# Clone repository\ngit clone https://github.com/unrealon/unrealon-rpc.git\ncd unrealon-rpc\n\n# Install development dependencies\npoetry install\n\n# Install pre-commit hooks\npre-commit install\n\n# Run tests\npytest\n\n# Run linting\nblack src/\nisort src/\nmypy src/\n```\n\n### Contribution Guidelines\n- Follow PEP 8 style guide\n- Add type hints to all functions\n- Write comprehensive docstrings\n- Include tests for new features\n- Update documentation as needed\n\n---\n\n## \ud83d\udcc4 License\n\nThis project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.\n\n---\n\n<div align=\"center\">\n\n## \ud83d\ude80 Start Building Amazing Parsers Today!\n\n```bash\npip install unrealon\n```\n\n**UnrealOn Platform** - The Future of Web Scraping is Here! \ud83c\udf1f\n\n[](https://github.com/unrealon)\n[](https://discord.gg/unrealon)\n[](https://docs.unrealon.com)\n[](https://twitter.com/unrealon)\n\n*Built with \u2764\ufe0f by the UnrealOn Team*\n\n**Ready to revolutionize your web scraping?** [Get Started Now!](https://docs.unrealon.com/quickstart)\n\n</div>",
"bugtrack_url": null,
"license": "MIT",
"summary": "\ud83d\ude80 Revolutionary web scraping platform with unbreakable stealth, AI-powered extraction, and zero-config setup. Build enterprise parsers in minutes, not months!",
"version": "1.1.5",
"project_urls": {
"Changelog": "https://github.com/unrealos/unrealon-rpc/blob/main/CHANGELOG.md",
"Documentation": "https://unrealon-rpc.readthedocs.io",
"Homepage": "https://github.com/unrealos/unrealon-rpc",
"Issues": "https://github.com/unrealos/unrealon-rpc/issues",
"Repository": "https://github.com/unrealos/unrealon-rpc.git"
},
"split_keywords": [
"ai-parsing",
" anti-detection",
" bot-protection",
" browser-automation",
" captcha-bypass",
" data-mining",
" distributed-parsing",
" enterprise-scraping",
" html-extraction",
" playwright",
" proxy-rotation",
" scalable-scraping",
" stealth-scraping",
" web-scraping",
" websocket-bridge",
" zero-config"
],
"urls": [
{
"comment_text": null,
"digests": {
"blake2b_256": "876caf093d729b31ec5854ae2c6f4497bf54e3b30576b2d9fd7a25d8b11b8cdc",
"md5": "e8016df5b6606e888aefeaf319f6bd7b",
"sha256": "9deb418f63f666ea07f6e5fcda3d674e3691c14b160d1f34ac77ec518edb9fb1"
},
"downloads": -1,
"filename": "unrealon-1.1.5-py3-none-any.whl",
"has_sig": false,
"md5_digest": "e8016df5b6606e888aefeaf319f6bd7b",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": "<4.0,>=3.10",
"size": 105873,
"upload_time": "2025-08-20T08:42:11",
"upload_time_iso_8601": "2025-08-20T08:42:11.215405Z",
"url": "https://files.pythonhosted.org/packages/87/6c/af093d729b31ec5854ae2c6f4497bf54e3b30576b2d9fd7a25d8b11b8cdc/unrealon-1.1.5-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "87575da9a858d9c8a1e2b35c3ee3307e727add5d42a125ea56e6de515a34f768",
"md5": "530b57b53cd16e3a7a29ae290bf8dae2",
"sha256": "550d0dd40f68801e00ff175f7ba0f104e960b981bc9e9a77f0b119f719587cc1"
},
"downloads": -1,
"filename": "unrealon-1.1.5.tar.gz",
"has_sig": false,
"md5_digest": "530b57b53cd16e3a7a29ae290bf8dae2",
"packagetype": "sdist",
"python_version": "source",
"requires_python": "<4.0,>=3.10",
"size": 83202,
"upload_time": "2025-08-20T08:42:13",
"upload_time_iso_8601": "2025-08-20T08:42:13.818213Z",
"url": "https://files.pythonhosted.org/packages/87/57/5da9a858d9c8a1e2b35c3ee3307e727add5d42a125ea56e6de515a34f768/unrealon-1.1.5.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2025-08-20 08:42:13",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "unrealos",
"github_project": "unrealon-rpc",
"github_not_found": true,
"lcname": "unrealon"
}
JSON
