# HEA Server Buckets Microservice
[Research Informatics Shared Resource](https://risr.hci.utah.edu), [Huntsman Cancer Institute](https://hci.utah.edu),
Salt Lake City, UT
The HEA Server Buckets Microservice is a service for managing buckets and their data within the cloud.
## Version 1.6.2
* Fixed 500 error when attempting to populate collaborators and when there is no authorization info.
## Version 1.6.1
* Performance improvements.
## Version 1.6.0
* Added support for python 3.12.
## Version 1.5.0
* Removed most integration tests because they overlapped with the unit tests.
* Accept the data query parameter for get requests for a speed boost.
## Version 1.4.6
* Dependency upgrades for compatibility with heaserver-keychain 1.5.0.
## Version 1.4.5
* Missed a place where json needed to be replaced by orjson.
## Version 1.4.4
* Permissions calculation speedup.
## Version 1.4.3
* Caching optimizations.
## Version 1.4.2
* Don't create collaborator groups, roles, etc. if the user has non-collaborator bucket access already.
* Changed the group paths to /Collaborator/AWS Accounts/account id/user id.
## Version 1.4.1
* Addressed potential concurrency issues.
* Fixed bug causing duplicate collaborators in an organization.
## Version 1.4.0
* We now support adding and removing collaborators who are not an admin/manager/member/PI of the organization so that
they can access selected buckets.
## Version 1.3.4
* Improved performance getting a bucket.
## Version 1.3.3
* Fixed type hint errors.
* Updated AWS region list.
* Restored accurate bucket permissions feature.
## Version 1.3.2
* Avoid timeouts loading buckets, which sporadically caused buckets not to be returned.
## Version 1.3.1
* Install setuptools first during installation.
* Correct issue where some users lost access to buckets because the user lacked permissions in AWS to simulate permissions. Instead, such users will appear to receive full permission for everything, which was the behavior prior to version 1.3.0. As before, AWS will still reject requests that users lack permission for.
## Version 1.3.0
* Present accurate bucket permissions.
## Version 1.2.0
* Added deletecontents query parameter the bucket delete endpoint. If true/yes/y, requesting a bucket delete will
delete the bucket's contents first. If false/no/n or omitted, the bucket delete will succeed only if the bucket is
empty.
## Version 1.1.4
* Grant all users DELETER privileges to buckets so that the webclient permits deletion (the backend will still deny
users without permissions to delete buckets).
## Version 1.1.3
* Fixed potential issue preventing the service from updating temporary credentials.
## Version 1.1.2
* Fixed new folder form submission.
## Version 1.1.1
* Display type display name in properties card, and return the type display name from GET calls.
## Version 1.1.0
* Fixed support for uploading to a bucket.
* Pass desktop object permissions back to clients.
## Version 1.0.4
* Changed presented bucket owner to system|aws.
* Omitted shares from the properties template.
## Version 1.0.3
* Improved performance getting all buckets.
## Version 1.0.2
* Improved performance.
## Version 1.0.1
* Improved performance.
## Version 1
Initial release.
## Runtime requirements
* Python 3.10, 3.11, or 3.12.
## Development environment
### Build requirements
* Any development environment is fine.
* On Windows, you also will need:
* Build Tools for Visual Studio 2019, found at https://visualstudio.microsoft.com/downloads/. Select the C++ tools.
* git, found at https://git-scm.com/download/win.
* On Mac, Xcode or the command line developer tools is required, found in the Apple Store app.
* Python 3.10, 3.11, or 3.12: Download and install Python from https://www.python.org, and select the options to install
for all users and add Python to your environment variables. The install for all users option will help keep you from
accidentally installing packages into your Python installation's site-packages directory instead of to your virtualenv
environment, described below.
* Create a virtualenv environment using the `python -m venv <venv_directory>` command, substituting `<venv_directory>`
with the directory name of your virtual environment. Run `source <venv_directory>/bin/activate` (or `<venv_directory>/Scripts/activate` on Windows) to activate the virtual
environment. You will need to activate the virtualenv every time before starting work, or your IDE may be able to do
this for you automatically. **Note that PyCharm will do this for you, but you have to create a new Terminal panel
after you newly configure a project with your virtualenv.**
* From the project's root directory, and using the activated virtualenv, run `pip install wheel` followed by
`pip install -r requirements_dev.txt`. **Do NOT run `python setup.py develop`. It will break your environment.**
### Running tests
Run tests with the `pytest` command from the project root directory. To improve performance, run tests in multiple
processes with `pytest -n auto`.
### Running integration tests
* Install Docker
* On Windows, install pywin32 version >= 223 from https://github.com/mhammond/pywin32/releases. In your venv, make sure that
`include-system-site-packages` is set to `true`.
### Trying out the APIs
This microservice has Swagger3/OpenAPI support so that you can quickly test the APIs in a web browser. Do the following:
* Install Docker, if it is not installed already.
* Run the `run-swaggerui.py` file in your terminal. This file contains some test objects that are loaded into a MongoDB
Docker container.
* Go to `http://127.0.0.1:8080/docs` in your web browser.
Once `run-swaggerui.py` is running, you can also access the APIs via `curl` or other tool. For example, in Windows
PowerShell, execute:
```
Invoke-RestMethod -Uri http://localhost:8080/buckets/ -Method GET -Headers @{'accept' = 'application/json'}`
```
In MacOS or Linux, the equivalent command is:
```
curl -X GET http://localhost:8080/buckets/ -H 'accept: application/json'
```
### Packaging and releasing this project
See the [RELEASING.md](RELEASING.md) file for details.
Raw data
{
"_id": null,
"home_page": "https://risr.hci.utah.edu",
"name": "heaserver-buckets",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.10",
"maintainer_email": null,
"keywords": "heaserver-buckets, microservice, healthcare, cancer, research, informatics",
"author": "Research Informatics Shared Resource, Huntsman Cancer Institute, Salt Lake City, UT",
"author_email": "Andrew.Post@hci.utah.edu",
"download_url": "https://files.pythonhosted.org/packages/cc/bb/540dff38872831416fea1805a53525226d06c8b461238fbed5b847ad1357/heaserver_buckets-1.6.2.tar.gz",
"platform": null,
"description": "# HEA Server Buckets Microservice\r\n[Research Informatics Shared Resource](https://risr.hci.utah.edu), [Huntsman Cancer Institute](https://hci.utah.edu),\r\nSalt Lake City, UT\r\n\r\nThe HEA Server Buckets Microservice is a service for managing buckets and their data within the cloud.\r\n\r\n## Version 1.6.2\r\n* Fixed 500 error when attempting to populate collaborators and when there is no authorization info.\r\n\r\n## Version 1.6.1\r\n* Performance improvements.\r\n\r\n## Version 1.6.0\r\n* Added support for python 3.12.\r\n\r\n## Version 1.5.0\r\n* Removed most integration tests because they overlapped with the unit tests.\r\n* Accept the data query parameter for get requests for a speed boost.\r\n\r\n## Version 1.4.6\r\n* Dependency upgrades for compatibility with heaserver-keychain 1.5.0.\r\n\r\n## Version 1.4.5\r\n* Missed a place where json needed to be replaced by orjson.\r\n\r\n## Version 1.4.4\r\n* Permissions calculation speedup.\r\n\r\n## Version 1.4.3\r\n* Caching optimizations.\r\n\r\n## Version 1.4.2\r\n* Don't create collaborator groups, roles, etc. if the user has non-collaborator bucket access already.\r\n* Changed the group paths to /Collaborator/AWS Accounts/account id/user id.\r\n\r\n## Version 1.4.1\r\n* Addressed potential concurrency issues.\r\n* Fixed bug causing duplicate collaborators in an organization.\r\n\r\n## Version 1.4.0\r\n* We now support adding and removing collaborators who are not an admin/manager/member/PI of the organization so that\r\nthey can access selected buckets.\r\n\r\n## Version 1.3.4\r\n* Improved performance getting a bucket.\r\n\r\n## Version 1.3.3\r\n* Fixed type hint errors.\r\n* Updated AWS region list.\r\n* Restored accurate bucket permissions feature.\r\n\r\n## Version 1.3.2\r\n* Avoid timeouts loading buckets, which sporadically caused buckets not to be returned.\r\n\r\n## Version 1.3.1\r\n* Install setuptools first during installation.\r\n* Correct issue where some users lost access to buckets because the user lacked permissions in AWS to simulate permissions. Instead, such users will appear to receive full permission for everything, which was the behavior prior to version 1.3.0. As before, AWS will still reject requests that users lack permission for.\r\n\r\n## Version 1.3.0\r\n* Present accurate bucket permissions.\r\n\r\n## Version 1.2.0\r\n* Added deletecontents query parameter the bucket delete endpoint. If true/yes/y, requesting a bucket delete will\r\ndelete the bucket's contents first. If false/no/n or omitted, the bucket delete will succeed only if the bucket is\r\nempty.\r\n\r\n## Version 1.1.4\r\n* Grant all users DELETER privileges to buckets so that the webclient permits deletion (the backend will still deny\r\nusers without permissions to delete buckets).\r\n\r\n## Version 1.1.3\r\n* Fixed potential issue preventing the service from updating temporary credentials.\r\n\r\n## Version 1.1.2\r\n* Fixed new folder form submission.\r\n\r\n## Version 1.1.1\r\n* Display type display name in properties card, and return the type display name from GET calls.\r\n\r\n## Version 1.1.0\r\n* Fixed support for uploading to a bucket.\r\n* Pass desktop object permissions back to clients.\r\n\r\n## Version 1.0.4\r\n* Changed presented bucket owner to system|aws.\r\n* Omitted shares from the properties template.\r\n\r\n## Version 1.0.3\r\n* Improved performance getting all buckets.\r\n\r\n## Version 1.0.2\r\n* Improved performance.\r\n\r\n## Version 1.0.1\r\n* Improved performance.\r\n\r\n## Version 1\r\nInitial release.\r\n\r\n## Runtime requirements\r\n* Python 3.10, 3.11, or 3.12.\r\n\r\n## Development environment\r\n\r\n### Build requirements\r\n* Any development environment is fine.\r\n* On Windows, you also will need:\r\n * Build Tools for Visual Studio 2019, found at https://visualstudio.microsoft.com/downloads/. Select the C++ tools.\r\n * git, found at https://git-scm.com/download/win.\r\n* On Mac, Xcode or the command line developer tools is required, found in the Apple Store app.\r\n* Python 3.10, 3.11, or 3.12: Download and install Python from https://www.python.org, and select the options to install\r\nfor all users and add Python to your environment variables. The install for all users option will help keep you from\r\naccidentally installing packages into your Python installation's site-packages directory instead of to your virtualenv\r\nenvironment, described below.\r\n* Create a virtualenv environment using the `python -m venv <venv_directory>` command, substituting `<venv_directory>`\r\nwith the directory name of your virtual environment. Run `source <venv_directory>/bin/activate` (or `<venv_directory>/Scripts/activate` on Windows) to activate the virtual\r\nenvironment. You will need to activate the virtualenv every time before starting work, or your IDE may be able to do\r\nthis for you automatically. **Note that PyCharm will do this for you, but you have to create a new Terminal panel\r\nafter you newly configure a project with your virtualenv.**\r\n* From the project's root directory, and using the activated virtualenv, run `pip install wheel` followed by\r\n `pip install -r requirements_dev.txt`. **Do NOT run `python setup.py develop`. It will break your environment.**\r\n\r\n### Running tests\r\nRun tests with the `pytest` command from the project root directory. To improve performance, run tests in multiple\r\nprocesses with `pytest -n auto`.\r\n\r\n### Running integration tests\r\n* Install Docker\r\n* On Windows, install pywin32 version >= 223 from https://github.com/mhammond/pywin32/releases. In your venv, make sure that\r\n`include-system-site-packages` is set to `true`.\r\n\r\n### Trying out the APIs\r\nThis microservice has Swagger3/OpenAPI support so that you can quickly test the APIs in a web browser. Do the following:\r\n* Install Docker, if it is not installed already.\r\n* Run the `run-swaggerui.py` file in your terminal. This file contains some test objects that are loaded into a MongoDB\r\n Docker container.\r\n* Go to `http://127.0.0.1:8080/docs` in your web browser.\r\n\r\nOnce `run-swaggerui.py` is running, you can also access the APIs via `curl` or other tool. For example, in Windows\r\nPowerShell, execute:\r\n```\r\nInvoke-RestMethod -Uri http://localhost:8080/buckets/ -Method GET -Headers @{'accept' = 'application/json'}`\r\n```\r\nIn MacOS or Linux, the equivalent command is:\r\n```\r\ncurl -X GET http://localhost:8080/buckets/ -H 'accept: application/json'\r\n```\r\n\r\n### Packaging and releasing this project\r\nSee the [RELEASING.md](RELEASING.md) file for details.\r\n",
"bugtrack_url": null,
"license": null,
"summary": "a service for managing buckets and their data within the cloud",
"version": "1.6.2",
"project_urls": {
"Homepage": "https://risr.hci.utah.edu"
},
"split_keywords": [
"heaserver-buckets",
" microservice",
" healthcare",
" cancer",
" research",
" informatics"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "3802cf2b21e438d3c8a02be8145631889b1a39978ec6523a6929786cef0a5ba3",
"md5": "833bd3215781064b6b2c828581c34a6c",
"sha256": "03361279e8c1f277cc93ae6c00c749fce55329265ac4ad341ff66a147c5dce2b"
},
"downloads": -1,
"filename": "heaserver_buckets-1.6.2-py3-none-any.whl",
"has_sig": false,
"md5_digest": "833bd3215781064b6b2c828581c34a6c",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.10",
"size": 28615,
"upload_time": "2024-12-04T22:56:15",
"upload_time_iso_8601": "2024-12-04T22:56:15.955137Z",
"url": "https://files.pythonhosted.org/packages/38/02/cf2b21e438d3c8a02be8145631889b1a39978ec6523a6929786cef0a5ba3/heaserver_buckets-1.6.2-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "ccbb540dff38872831416fea1805a53525226d06c8b461238fbed5b847ad1357",
"md5": "50d407b97a002d69a06d2ce405a53973",
"sha256": "6742178d359c19f3517db7af69608d46d6f103febdce2a57d8c77decdfebc76a"
},
"downloads": -1,
"filename": "heaserver_buckets-1.6.2.tar.gz",
"has_sig": false,
"md5_digest": "50d407b97a002d69a06d2ce405a53973",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.10",
"size": 39519,
"upload_time": "2024-12-04T22:56:17",
"upload_time_iso_8601": "2024-12-04T22:56:17.003781Z",
"url": "https://files.pythonhosted.org/packages/cc/bb/540dff38872831416fea1805a53525226d06c8b461238fbed5b847ad1357/heaserver_buckets-1.6.2.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-12-04 22:56:17",
"github": false,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"lcname": "heaserver-buckets"
}
JSON