SuperDuperDB


NameSuperDuperDB JSON
Version 0.0.2 PyPI version JSON
download
home_pagehttps://github.com/blythed/superduperdb
SummarySuper power your database with AI.
upload_time2023-01-13 12:12:45
maintainer
docs_urlNone
authorDuncan Blythe
requires_python>=3.6
licenseApache 2.0
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage
            <a href="https://www.superduperdb.com"><img src="https://raw.githubusercontent.com/blythed/superduperdb/main/img/symbol_purple.png" width="150" align="right" /></a>

# Welcome to SuperDuperDB!

> An AI-database management system for the full PyTorch model-development lifecycle

Full documentation [here](https://superduperdb.github.io/superduperdb).

## Installation

Requires:

- MongoDB
- RedisDB

Then install the python requirements

```
pip install -r requirements.txt
```

## Architecture

![](https://raw.githubusercontent.com/SuperDuperDB/superduperdb/main/img/architecture.png)

1. Client - run on client to send off requests to various work horses.
1. MongoDB - standard mongo deployment.
1. Vector lookup - deployment of sddb with faiss/ scaNN.
1. Job master - master node for job cluster, sends messages to redis (rq)
1. Redis database - database instance for rq master
1. Job worker - worker node(s) for jobs, computes vectors, and performs model trainings.
   Retrieves jobs from redis.

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/blythed/superduperdb",
    "name": "SuperDuperDB",
    "maintainer": "",
    "docs_url": null,
    "requires_python": ">=3.6",
    "maintainer_email": "",
    "keywords": "",
    "author": "Duncan Blythe",
    "author_email": "opensource@superduperdb.com",
    "download_url": "https://files.pythonhosted.org/packages/bf/de/90a3a67174a479aed3c116ec60a87a3b24bd1f629e7b7ef879dee1eebca4/SuperDuperDB-0.0.2.tar.gz",
    "platform": null,
    "description": "<a href=\"https://www.superduperdb.com\"><img src=\"https://raw.githubusercontent.com/blythed/superduperdb/main/img/symbol_purple.png\" width=\"150\" align=\"right\" /></a>\n\n# Welcome to SuperDuperDB!\n\n> An AI-database management system for the full PyTorch model-development lifecycle\n\nFull documentation [here](https://superduperdb.github.io/superduperdb).\n\n## Installation\n\nRequires:\n\n- MongoDB\n- RedisDB\n\nThen install the python requirements\n\n```\npip install -r requirements.txt\n```\n\n## Architecture\n\n![](https://raw.githubusercontent.com/SuperDuperDB/superduperdb/main/img/architecture.png)\n\n1. Client - run on client to send off requests to various work horses.\n1. MongoDB - standard mongo deployment.\n1. Vector lookup - deployment of sddb with faiss/ scaNN.\n1. Job master - master node for job cluster, sends messages to redis (rq)\n1. Redis database - database instance for rq master\n1. Job worker - worker node(s) for jobs, computes vectors, and performs model trainings.\n   Retrieves jobs from redis.\n",
    "bugtrack_url": null,
    "license": "Apache 2.0",
    "summary": "Super power your database with AI.",
    "version": "0.0.2",
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "bfde90a3a67174a479aed3c116ec60a87a3b24bd1f629e7b7ef879dee1eebca4",
                "md5": "d8449d4c643242d4256516c7e81fb74a",
                "sha256": "28f27939405a006397edd6b025cda6f6280922ddb9775ba6c847bb8ff85a5ea9"
            },
            "downloads": -1,
            "filename": "SuperDuperDB-0.0.2.tar.gz",
            "has_sig": false,
            "md5_digest": "d8449d4c643242d4256516c7e81fb74a",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.6",
            "size": 108252,
            "upload_time": "2023-01-13T12:12:45",
            "upload_time_iso_8601": "2023-01-13T12:12:45.733688Z",
            "url": "https://files.pythonhosted.org/packages/bf/de/90a3a67174a479aed3c116ec60a87a3b24bd1f629e7b7ef879dee1eebca4/SuperDuperDB-0.0.2.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-01-13 12:12:45",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "github_user": "blythed",
    "github_project": "superduperdb",
    "travis_ci": false,
    "coveralls": true,
    "github_actions": false,
    "requirements": [],
    "lcname": "superduperdb"
}
        
Elapsed time: 0.03924s