# exaSPIM pipeline utils
[](LICENSE)
Code repository to be installed in exaSPIM processing capsules.
## Features
- Wrapper code for ImageJ automation.
- n5 to zarr converter to be run in a Code Ocean capsule.
### ImageJ wrapper module
The ImageJ wrapper module contains Fiji macro templates and wrapper code to
automatically run interest point detection and interest point based registration
in the Code Ocean capsule. This functionality is set as the main entry point of
the package if the whole package is invoked on the command line or the
`aind_exaspim_pipeline` command is run.
```bash
#!/usr/bin/env bash
set -ex
cd ~/capsule
imagej_wrapper "$@"
```
### N5 to Zarr converter
The N5 to zarr converter sets up a local dask cluster with multiple python processes
as workers to read in an N5 dataset and write it out in a multiscale Zarr dataset.
Both datasets may be local or directly on S3. AWS credentials must be available in the
environment (Code Ocean credential assignment to environment variables).
This implementation is based on dask.array (da).
This command takes a manifest json file as the only command line argument or looks it
up at the hard-wired `data/manifest/exaspim_manifest.json` location if not specified.
To set up a code ocean capsule, use the following `run.sh` script:
```bash
#!/usr/bin/env bash
set -ex
cd ~/capsule
n5tozarr_da_converter "$@"
```
## Installation
To use the software, in the root directory, run
```bash
pip install -e .
```
To develop the code, run
```bash
pip install -e .[dev]
```
For n5tozarr and zarr multiscale conversion, install as
```bash
pip install -e .[n5tozarr]
```
## Contributing
### Linters and testing
There are several libraries used to run linters, check documentation, and run tests.
- Please test your changes using the **coverage** library, which will run the tests and log a coverage report:
```bash
coverage run -m unittest discover && coverage report
```
- Use **interrogate** to check that modules, methods, etc. have been documented thoroughly:
```bash
interrogate .
```
- Use **flake8** to check that code is up to standards (no unused imports, etc.):
```bash
flake8 .
```
- Use **black** to automatically format the code into PEP standards:
```bash
black .
```
- Use **isort** to automatically sort import statements:
```bash
isort .
```
### Pull requests
For internal members, please create a branch. For external members, please fork the repository and open a pull request from the fork. We'll primarily use [Angular](https://github.com/angular/angular/blob/main/CONTRIBUTING.md#commit) style for commit messages. Roughly, they should follow the pattern:
```text
<type>(<scope>): <short summary>
```
where scope (optional) describes the packages affected by the code changes and type (mandatory) is one of:
- **build**: Changes that affect build tools or external dependencies (example scopes: pyproject.toml, setup.py)
- **ci**: Changes to our CI configuration files and scripts (examples: .github/workflows/ci.yml)
- **docs**: Documentation only changes
- **feat**: A new feature
- **fix**: A bugfix
- **perf**: A code change that improves performance
- **refactor**: A code change that neither fixes a bug nor adds a feature
- **test**: Adding missing tests or correcting existing tests
### Documentation
To generate the rst files source files for documentation, run
```bash
sphinx-apidoc -o doc_template/source/ src
```
Then to create the documentation HTML files, run
```bash
sphinx-build -b html doc_template/source/ doc_template/build/html
```
More info on sphinx installation can be found [here](https://www.sphinx-doc.org/en/master/usage/installation.html).
Raw data
{
"_id": null,
"home_page": null,
"name": "aind-exaspim-pipeline-utils",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": null,
"keywords": null,
"author": "Allen Institute for Neural Dynamics",
"author_email": null,
"download_url": "https://files.pythonhosted.org/packages/e4/0d/e3da5974438ab07780ab6f88ba8bffb9a6228e7dfd6078ed89c70d5b559e/aind_exaspim_pipeline_utils-0.11.1.tar.gz",
"platform": null,
"description": "# exaSPIM pipeline utils\n\n[](LICENSE)\n\n\nCode repository to be installed in exaSPIM processing capsules.\n\n## Features\n\n - Wrapper code for ImageJ automation.\n - n5 to zarr converter to be run in a Code Ocean capsule.\n\n### ImageJ wrapper module\n\nThe ImageJ wrapper module contains Fiji macro templates and wrapper code to \nautomatically run interest point detection and interest point based registration\nin the Code Ocean capsule. This functionality is set as the main entry point of\nthe package if the whole package is invoked on the command line or the \n`aind_exaspim_pipeline` command is run.\n\n```bash\n#!/usr/bin/env bash\nset -ex\ncd ~/capsule\nimagej_wrapper \"$@\"\n```\n\n### N5 to Zarr converter\n\nThe N5 to zarr converter sets up a local dask cluster with multiple python processes \nas workers to read in an N5 dataset and write it out in a multiscale Zarr dataset.\nBoth datasets may be local or directly on S3. AWS credentials must be available in the\nenvironment (Code Ocean credential assignment to environment variables).\n\nThis implementation is based on dask.array (da).\n\nThis command takes a manifest json file as the only command line argument or looks it \nup at the hard-wired `data/manifest/exaspim_manifest.json` location if not specified.\n\nTo set up a code ocean capsule, use the following `run.sh` script:\n\n```bash\n#!/usr/bin/env bash\nset -ex\ncd ~/capsule\nn5tozarr_da_converter \"$@\"\n```\n\n\n## Installation\nTo use the software, in the root directory, run\n```bash\npip install -e .\n```\n\nTo develop the code, run\n```bash\npip install -e .[dev]\n```\n\nFor n5tozarr and zarr multiscale conversion, install as\n```bash\npip install -e .[n5tozarr]\n```\n\n## Contributing\n\n### Linters and testing\n\nThere are several libraries used to run linters, check documentation, and run tests.\n\n- Please test your changes using the **coverage** library, which will run the tests and log a coverage report:\n\n```bash\ncoverage run -m unittest discover && coverage report\n```\n\n- Use **interrogate** to check that modules, methods, etc. have been documented thoroughly:\n\n```bash\ninterrogate .\n```\n\n- Use **flake8** to check that code is up to standards (no unused imports, etc.):\n```bash\nflake8 .\n```\n\n- Use **black** to automatically format the code into PEP standards:\n```bash\nblack .\n```\n\n- Use **isort** to automatically sort import statements:\n```bash\nisort .\n```\n\n### Pull requests\n\nFor internal members, please create a branch. For external members, please fork the repository and open a pull request from the fork. We'll primarily use [Angular](https://github.com/angular/angular/blob/main/CONTRIBUTING.md#commit) style for commit messages. Roughly, they should follow the pattern:\n```text\n<type>(<scope>): <short summary>\n```\n\nwhere scope (optional) describes the packages affected by the code changes and type (mandatory) is one of:\n\n- **build**: Changes that affect build tools or external dependencies (example scopes: pyproject.toml, setup.py)\n- **ci**: Changes to our CI configuration files and scripts (examples: .github/workflows/ci.yml)\n- **docs**: Documentation only changes\n- **feat**: A new feature\n- **fix**: A bugfix\n- **perf**: A code change that improves performance\n- **refactor**: A code change that neither fixes a bug nor adds a feature\n- **test**: Adding missing tests or correcting existing tests\n\n### Documentation\nTo generate the rst files source files for documentation, run\n```bash\nsphinx-apidoc -o doc_template/source/ src \n```\nThen to create the documentation HTML files, run\n```bash\nsphinx-build -b html doc_template/source/ doc_template/build/html\n```\nMore info on sphinx installation can be found [here](https://www.sphinx-doc.org/en/master/usage/installation.html).\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "AIND exaSPIM pipeline utilities.",
"version": "0.11.1",
"project_urls": null,
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "148b4f5abd0eb1f541fec6a8c739bf960dead9039cc6e25cf27b3cd637c5c5f0",
"md5": "177a290f7a4ee80f5c6764fe6eccf0c9",
"sha256": "4fb838a064499240d535b86a79946d59e54841d73614397fb8499bf434ac3468"
},
"downloads": -1,
"filename": "aind_exaspim_pipeline_utils-0.11.1-py3-none-any.whl",
"has_sig": false,
"md5_digest": "177a290f7a4ee80f5c6764fe6eccf0c9",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 69897,
"upload_time": "2024-06-03T02:25:03",
"upload_time_iso_8601": "2024-06-03T02:25:03.576593Z",
"url": "https://files.pythonhosted.org/packages/14/8b/4f5abd0eb1f541fec6a8c739bf960dead9039cc6e25cf27b3cd637c5c5f0/aind_exaspim_pipeline_utils-0.11.1-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "e40de3da5974438ab07780ab6f88ba8bffb9a6228e7dfd6078ed89c70d5b559e",
"md5": "d207e5f759864c2e17cdcf201035af1e",
"sha256": "b873d76ef965692d4e1b1588fadaec601102c8c6fd41d4151746513fa84fce24"
},
"downloads": -1,
"filename": "aind_exaspim_pipeline_utils-0.11.1.tar.gz",
"has_sig": false,
"md5_digest": "d207e5f759864c2e17cdcf201035af1e",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 93583,
"upload_time": "2024-06-03T02:25:06",
"upload_time_iso_8601": "2024-06-03T02:25:06.064330Z",
"url": "https://files.pythonhosted.org/packages/e4/0d/e3da5974438ab07780ab6f88ba8bffb9a6228e7dfd6078ed89c70d5b559e/aind_exaspim_pipeline_utils-0.11.1.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-06-03 02:25:06",
"github": false,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"lcname": "aind-exaspim-pipeline-utils"
}
JSON