## Spare Cores Data
[](https://github.com/SpareCores/sc-data/actions/workflows/tests.yaml)
[](https://github.com/SpareCores/sc-data/actions/workflows/crawl-spot.yaml)<!-- provided by https://runkit.com/daroczig/sc-data-lastrun -->
<picture><source media="(prefers-color-scheme: dark)" srcset="https://img.shields.io/badge/status-alpha-blue"><source media="(prefers-color-scheme: light)" srcset="https://img.shields.io/badge/status-alpha-blue"><img alt="Project Status: Alpha" src="https://img.shields.io/badge/status-alpha-blue"></picture>
<picture><source media="(prefers-color-scheme: dark)" srcset="https://img.shields.io/maintenance/yes/2024"><source media="(prefers-color-scheme: light)" srcset="https://img.shields.io/maintenance/yes/2024"><img alt="Maintenance Status: Active" src="https://img.shields.io/maintenance/yes/2024"></picture>
[](https://github.com/SpareCores/sc-data/blob/main/LICENSE)
[](https://pypi.org/project/sparecores-data/)
[](https://www.ngisearch.eu/view/Events/OC3Searchers)
SC Data is a Python package and related tools making use of
[`sparecores-crawler`](https://github.com/SpareCores/sc-crawler) to pull and
standardize data on cloud compute resources. This repository actually
runs the crawler every 5 minutes to update spot prices, and every hour
to update all cloud resources in an internal SCD table and public
SQLite snapshot as well.
## Installation
Stable version from PyPI:
```
pip install sparecores-data
```
Most recent version from GitHub:
```
pip install "sparecores-data @ git+https://git@github.com/SpareCores/sc-data.git"
```
## Usage
For easy access to the most recent version of the SQLite database
file, import the `db` object of the `sc_data` Python package, which
runs an updater thread in the background to keep the SQLite file
up-to-date:
```py
from sc_data import db
print(db.path)
```
By default, the SQLite file will be updated every 600 seconds, which
can be overwritten by the `sc_data_db_refresh_seconds` builtins
attribute or the `SC_DATA_DB_REFRESH_SECONDS` environment variable.
Similarly, you van set the following environment variables:
- `SC_DATA_NO_UPDATE`
- `SC_DATA_DB_PATH`
- `SC_DATA_DB_URL`
- `SC_DATA_HTTP_TIMEOUT`
## References
- [`sparecores-crawler` documentation](https://sparecores.github.io/sc-crawler/)
- [Database schemas](https://dbdocs.io/spare-cores/sc-crawler)
- [Latest SQLite database release](https://sc-data-public-40e9d310.s3.amazonaws.com/sc-data-all.db.bz2)
- [sparecores.com](https://sparecores.com)
Raw data
{
"_id": null,
"home_page": null,
"name": "sparecores-data",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": "Spare Cores team <pkg@sparecores.com>",
"keywords": "cloud, compute, etl, sqlite, spot-instances, cost-optimization",
"author": "Attila Nagy, Gergely Daroczi, Balazs Hodobay",
"author_email": null,
"download_url": "https://files.pythonhosted.org/packages/0f/4b/34560f24ce86df4e3239d848b023dcd5c01270ddeb163e9414b1c7f2b88e/sparecores_data-0.3.0.tar.gz",
"platform": null,
"description": "## Spare Cores Data\n\n[](https://github.com/SpareCores/sc-data/actions/workflows/tests.yaml)\n[](https://github.com/SpareCores/sc-data/actions/workflows/crawl-spot.yaml)<!-- provided by https://runkit.com/daroczig/sc-data-lastrun -->\n<picture><source media=\"(prefers-color-scheme: dark)\" srcset=\"https://img.shields.io/badge/status-alpha-blue\"><source media=\"(prefers-color-scheme: light)\" srcset=\"https://img.shields.io/badge/status-alpha-blue\"><img alt=\"Project Status: Alpha\" src=\"https://img.shields.io/badge/status-alpha-blue\"></picture>\n<picture><source media=\"(prefers-color-scheme: dark)\" srcset=\"https://img.shields.io/maintenance/yes/2024\"><source media=\"(prefers-color-scheme: light)\" srcset=\"https://img.shields.io/maintenance/yes/2024\"><img alt=\"Maintenance Status: Active\" src=\"https://img.shields.io/maintenance/yes/2024\"></picture>\n[](https://github.com/SpareCores/sc-data/blob/main/LICENSE)\n[](https://pypi.org/project/sparecores-data/)\n[](https://www.ngisearch.eu/view/Events/OC3Searchers)\n\nSC Data is a Python package and related tools making use of\n[`sparecores-crawler`](https://github.com/SpareCores/sc-crawler) to pull and\nstandardize data on cloud compute resources. This repository actually\nruns the crawler every 5 minutes to update spot prices, and every hour\nto update all cloud resources in an internal SCD table and public\nSQLite snapshot as well.\n\n## Installation\n\nStable version from PyPI:\n\n```\npip install sparecores-data\n```\n\nMost recent version from GitHub:\n\n```\npip install \"sparecores-data @ git+https://git@github.com/SpareCores/sc-data.git\"\n```\n\n## Usage\n\nFor easy access to the most recent version of the SQLite database\nfile, import the `db` object of the `sc_data` Python package, which\nruns an updater thread in the background to keep the SQLite file\nup-to-date:\n\n```py\nfrom sc_data import db\nprint(db.path)\n```\n\nBy default, the SQLite file will be updated every 600 seconds, which\ncan be overwritten by the `sc_data_db_refresh_seconds` builtins\nattribute or the `SC_DATA_DB_REFRESH_SECONDS` environment variable.\n\nSimilarly, you van set the following environment variables:\n\n- `SC_DATA_NO_UPDATE`\n- `SC_DATA_DB_PATH`\n- `SC_DATA_DB_URL`\n- `SC_DATA_HTTP_TIMEOUT`\n\n## References\n\n- [`sparecores-crawler` documentation](https://sparecores.github.io/sc-crawler/)\n- [Database schemas](https://dbdocs.io/spare-cores/sc-crawler)\n- [Latest SQLite database release](https://sc-data-public-40e9d310.s3.amazonaws.com/sc-data-all.db.bz2)\n- [sparecores.com](https://sparecores.com)\n",
"bugtrack_url": null,
"license": null,
"summary": "Structured data collected by sparecores-crawler.",
"version": "0.3.0",
"project_urls": {
"homepage": "https://sparecores.com",
"issues": "https://github.com/SpareCores/sc-data/issues",
"repository": "https://github.com/SpareCores/sc-data"
},
"split_keywords": [
"cloud",
" compute",
" etl",
" sqlite",
" spot-instances",
" cost-optimization"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "c8e00d7d6bc725b154f4340b53cc8daf343eb7c5dd9b92f55ac16e16595729bc",
"md5": "bee72ef352bf9418d88c68bfce8bcb17",
"sha256": "902e5639937295204d1012e80bce159c1a60e4fd0b8beeb307d26c2768e3416a"
},
"downloads": -1,
"filename": "sparecores_data-0.3.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "bee72ef352bf9418d88c68bfce8bcb17",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 125159,
"upload_time": "2024-08-20T22:11:38",
"upload_time_iso_8601": "2024-08-20T22:11:38.503875Z",
"url": "https://files.pythonhosted.org/packages/c8/e0/0d7d6bc725b154f4340b53cc8daf343eb7c5dd9b92f55ac16e16595729bc/sparecores_data-0.3.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "0f4b34560f24ce86df4e3239d848b023dcd5c01270ddeb163e9414b1c7f2b88e",
"md5": "c31e5fb6f248b32f66a624abfb670fa5",
"sha256": "6a633f67b4025a445666561a8917c6220058fa050306eca8ebc54dc180e31f2a"
},
"downloads": -1,
"filename": "sparecores_data-0.3.0.tar.gz",
"has_sig": false,
"md5_digest": "c31e5fb6f248b32f66a624abfb670fa5",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 128375,
"upload_time": "2024-08-20T22:11:40",
"upload_time_iso_8601": "2024-08-20T22:11:40.280370Z",
"url": "https://files.pythonhosted.org/packages/0f/4b/34560f24ce86df4e3239d848b023dcd5c01270ddeb163e9414b1c7f2b88e/sparecores_data-0.3.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-08-20 22:11:40",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "SpareCores",
"github_project": "sc-data",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"tox": true,
"lcname": "sparecores-data"
}
JSON
