# sparc-curation
[](https://pypi.org/project/sparcur/)
[](https://travis-ci.org/SciCrunch/sparc-curation)
[](https://coveralls.io/github/SciCrunch/sparc-curation?branch=master)
This repo contains `sparcur`, a python implementation of a validator for the SPARC Data Structure (SDS).
It also contains code, files, and documentation for curation and knowledge management workflows for SPARC datasets, protocols, and anatomical connectivity.
## SDS Validator
To use `sparcur` to validate an SDS formatted dataset run
```bash
pip install sparcur
pushd path/to/my/dataset
python -m sparcur.simple.validate
```
The result is written to `path/to/my/dataset/curation-export.json`.
General issues with the dataset can be found under the `path_error_report` property.
## Background
For a general introduction to the SPARC curpation process see [background.org](https://github.com/SciCrunch/sparc-curation/blob/master/docs/background.org).
For background on the SDS (with out-of-date technical details) see this [paper](https://doi.org/10.1101/2021.02.10.430563).
## Workflows
Documentation for curation workflows can be found in [workflows.org](https://github.com/SciCrunch/sparc-curation/blob/master/docs/workflows.org).
## Developer guide
See the [developer guide](https://github.com/SciCrunch/sparc-curation/blob/master/docs/developer-guide.org) for examples of how to reuse and develop sparcur.
## Setup
New developers or curators should start by following [setup.org](https://github.com/SciCrunch/sparc-curation/blob/master/docs/setup.org).
## Curation viewer
The [curation viewer](https://github.com/SciCrunch/sparc-curation/blob/master/sparcur_internal/sparcur/viewer.rkt) is a GUI application written in [Racket](https://racket-lang.org) that
streamlines the processes of downloading, validating, and correcting
SDS formatted datasets. The setup is currently quite involved because
it needs to run directly on the OS where curators work. It supports
windows, macos, and linux. Once the initial setup is complete there is
an update mechanism which simplifies keeping the pipelines in sync.
## SCKAN
This repo contains the core of the [SCKAN release pipelines](https://github.com/SciCrunch/sparc-curation/blob/master/docs/developer-guide.org#sckan) as well as the [documentation](https://github.com/SciCrunch/sparc-curation/blob/master/docs/sckan) for running and querying SCKAN.
## Related links
- [SODA](https://github.com/fairdataihub/SODA-for-SPARC) GUI app for creating, validating, and uploading SDS formatted datasets.
- [SDS Viewer](https://github.com/MetaCell/sds-viewer) a web UI for SDS formatted datatsets via the SDS validator.
- [dockerfiles/source.org](https://github.com/tgbugs/dockerfiles/blob/master/source.org#kg-dev-user) spec for developer docker image for this repo. Also has specs for the image that runs the [sparcron](https://github.com/SciCrunch/sparc-curation/blob/master/sparcur/sparcron/core.py) single dataset pipelines, SCKAN images, and more.
- [tgbugs/musl](https://hub.docker.com/r/tgbugs/musl) dockerhub repo with latest build of images.
- [open-physiology-viewer](https://github.com/open-physiology/open-physiology-viewer) code for converting ApiNATOMY models to OWL/RDF needed for [apinatomy pipelines](https://github.com/SciCrunch/sparc-curation/blob/master/docs/apinatomy.org).
Raw data
{
"_id": null,
"home_page": "https://github.com/SciCrunch/sparc-curation",
"name": "sparcur",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.6",
"maintainer_email": "",
"keywords": "SPARC curation biocuration ontology pennsieve protc protocols hypothesis",
"author": "Tom Gillespie",
"author_email": "tgbugs@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/61/e8/3d7953fc60f3b638905ec7c869783506069b0fd1bcbb45b4dc1bef654936/sparcur-0.0.1.dev4.tar.gz",
"platform": null,
"description": "# sparc-curation\n[](https://pypi.org/project/sparcur/)\n[](https://travis-ci.org/SciCrunch/sparc-curation)\n[](https://coveralls.io/github/SciCrunch/sparc-curation?branch=master)\n\nThis repo contains `sparcur`, a python implementation of a validator for the SPARC Data Structure (SDS).\n\nIt also contains code, files, and documentation for curation and knowledge management workflows for SPARC datasets, protocols, and anatomical connectivity.\n\n## SDS Validator\nTo use `sparcur` to validate an SDS formatted dataset run\n```bash\npip install sparcur\npushd path/to/my/dataset\npython -m sparcur.simple.validate\n```\nThe result is written to `path/to/my/dataset/curation-export.json`.\nGeneral issues with the dataset can be found under the `path_error_report` property.\n\n## Background\nFor a general introduction to the SPARC curpation process see [background.org](https://github.com/SciCrunch/sparc-curation/blob/master/docs/background.org).\n\nFor background on the SDS (with out-of-date technical details) see this [paper](https://doi.org/10.1101/2021.02.10.430563).\n\n## Workflows\nDocumentation for curation workflows can be found in [workflows.org](https://github.com/SciCrunch/sparc-curation/blob/master/docs/workflows.org).\n\n## Developer guide\nSee the [developer guide](https://github.com/SciCrunch/sparc-curation/blob/master/docs/developer-guide.org) for examples of how to reuse and develop sparcur.\n\n## Setup\nNew developers or curators should start by following [setup.org](https://github.com/SciCrunch/sparc-curation/blob/master/docs/setup.org).\n\n## Curation viewer\nThe [curation viewer](https://github.com/SciCrunch/sparc-curation/blob/master/sparcur_internal/sparcur/viewer.rkt) is a GUI application written in [Racket](https://racket-lang.org) that\nstreamlines the processes of downloading, validating, and correcting\nSDS formatted datasets. The setup is currently quite involved because\nit needs to run directly on the OS where curators work. It supports\nwindows, macos, and linux. Once the initial setup is complete there is\nan update mechanism which simplifies keeping the pipelines in sync.\n\n## SCKAN\nThis repo contains the core of the [SCKAN release pipelines](https://github.com/SciCrunch/sparc-curation/blob/master/docs/developer-guide.org#sckan) as well as the [documentation](https://github.com/SciCrunch/sparc-curation/blob/master/docs/sckan) for running and querying SCKAN.\n\n## Related links\n- [SODA](https://github.com/fairdataihub/SODA-for-SPARC) GUI app for creating, validating, and uploading SDS formatted datasets. \n- [SDS Viewer](https://github.com/MetaCell/sds-viewer) a web UI for SDS formatted datatsets via the SDS validator. \n- [dockerfiles/source.org](https://github.com/tgbugs/dockerfiles/blob/master/source.org#kg-dev-user) spec for developer docker image for this repo. Also has specs for the image that runs the [sparcron](https://github.com/SciCrunch/sparc-curation/blob/master/sparcur/sparcron/core.py) single dataset pipelines, SCKAN images, and more. \n- [tgbugs/musl](https://hub.docker.com/r/tgbugs/musl) dockerhub repo with latest build of images. \n- [open-physiology-viewer](https://github.com/open-physiology/open-physiology-viewer) code for converting ApiNATOMY models to OWL/RDF needed for [apinatomy pipelines](https://github.com/SciCrunch/sparc-curation/blob/master/docs/apinatomy.org).\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "assorted",
"version": "0.0.1.dev4",
"split_keywords": [
"sparc",
"curation",
"biocuration",
"ontology",
"pennsieve",
"protc",
"protocols",
"hypothesis"
],
"urls": [
{
"comment_text": "",
"digests": {
"md5": "77adc9d94967ae78368c5cabcde175cc",
"sha256": "a8da993f840618fcc39068329b29022a07ab61bad02a13ca255dbed14d6834c1"
},
"downloads": -1,
"filename": "sparcur-0.0.1.dev4-py2.py3-none-any.whl",
"has_sig": false,
"md5_digest": "77adc9d94967ae78368c5cabcde175cc",
"packagetype": "bdist_wheel",
"python_version": "py2.py3",
"requires_python": ">=3.6",
"size": 287685,
"upload_time": "2022-12-23T07:02:34",
"upload_time_iso_8601": "2022-12-23T07:02:34.866703Z",
"url": "https://files.pythonhosted.org/packages/5c/c5/f7b7850234695c467af3506a9a79e842b899f64b939cd85e453c636c20eb/sparcur-0.0.1.dev4-py2.py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"md5": "be422b073d7c1bc056f8c643af0df7a1",
"sha256": "35a279d1e3b0c73a090122c922589d17055ee27b1dd78cf36a21105683734c7e"
},
"downloads": -1,
"filename": "sparcur-0.0.1.dev4.tar.gz",
"has_sig": false,
"md5_digest": "be422b073d7c1bc056f8c643af0df7a1",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.6",
"size": 651141,
"upload_time": "2022-12-23T07:02:36",
"upload_time_iso_8601": "2022-12-23T07:02:36.374183Z",
"url": "https://files.pythonhosted.org/packages/61/e8/3d7953fc60f3b638905ec7c869783506069b0fd1bcbb45b4dc1bef654936/sparcur-0.0.1.dev4.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2022-12-23 07:02:36",
"github": true,
"gitlab": false,
"bitbucket": false,
"github_user": "SciCrunch",
"github_project": "sparc-curation",
"travis_ci": true,
"coveralls": false,
"github_actions": false,
"lcname": "sparcur"
}
JSON
