# Filesystem interface to Azure Machine Learning defined URIs
## Getting started
This package can be installed using:
```bash
pip install azureml-fsspec
```
## Examples
Accepted uri format is Azure Machcine Learning defined datastore uri: azureml://subscriptions/([^\/]+)/resourcegroups/([^\/]+)/workspaces/([^\/]+)/datastores/([^\/]+)/paths/([^\/]+)
```python
# load parquet file to pandas
import pandas
df = pandas.read_parquet('azureml://subscriptions/{sub_id}/resourcegroups/{rs_group}/workspaces/{ws}
/datastores/workspaceblobstore/paths/myfolder/mydata.parquet')
# load csv file to pandas
import pandas
df = pandas.read_csv('azureml://subscriptions/{sub_id}/resourcegroups/{rs_group}/workspaces/{ws}
/datastores/workspaceblobstore/paths/myfolder/mydata.csv')
# load parquet file to dask
import dask.dataframe as dd
df = dd.read_parquet('azureml://subscriptions/{sub_id}/resourcegroups/{rs_group}/workspaces/{ws}
/datastores/workspaceblobstore/paths/myfolder/mydata.parquet')
# load csv file to dask
import dask.dataframe as dd
df = dd.read_csv('azureml://subscriptions/{sub_id}/resourcegroups/{rs_group}/workspaces/{ws}
/datastores/workspaceblobstore/paths/myfolder/mydata.csv')
```
# Release History
## 1.3.1 (02-05-2024)
### Features Added
- added support for using mlclient for authorization
## 1.3.0 (01-17-2024)
### Features Added
- added registry support for fsspec.
## 1.2.0 (08-14-2023)
### Features Added
- added auth dict support (SP and managedIdentity) for fsspec.
- added user exception mapping
## 1.1.0 (06-01-2023)
### Features Added
- upload/download performance improvement
## 1.0.0 (04-07-2023)
### Features Added
- Added upload/download API
- bugfix(root behavior)
## 0.1.0b1
### Features Added
- Initial public preview release of FileSystem for Azure Machine Learning defined datastore uri
## 0.1.0b2
### Features Added
- Fix release notes
## 0.1.0b3
### Features Added
- Add mode in open API
- Add validation
- Upgrade dataprep to 4.8
Raw data
{
"_id": null,
"home_page": "https://docs.microsoft.com/python/api/overview/azure/ml/?view=azure-ml-py",
"name": "azureml-fsspec",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.6,< 4.0",
"maintainer_email": "",
"keywords": "file-system,dask,azure",
"author": "Microsoft Corp",
"author_email": "",
"download_url": "",
"platform": null,
"description": "# Filesystem interface to Azure Machine Learning defined URIs\r\n\r\n## Getting started\r\n\r\nThis package can be installed using:\r\n\r\n```bash\r\npip install azureml-fsspec\r\n```\r\n\r\n## Examples\r\nAccepted uri format is Azure Machcine Learning defined datastore uri: azureml://subscriptions/([^\\/]+)/resourcegroups/([^\\/]+)/workspaces/([^\\/]+)/datastores/([^\\/]+)/paths/([^\\/]+)\r\n\r\n```python\r\n# load parquet file to pandas\r\nimport pandas\r\ndf = pandas.read_parquet('azureml://subscriptions/{sub_id}/resourcegroups/{rs_group}/workspaces/{ws}\r\n /datastores/workspaceblobstore/paths/myfolder/mydata.parquet')\r\n\r\n# load csv file to pandas\r\nimport pandas\r\ndf = pandas.read_csv('azureml://subscriptions/{sub_id}/resourcegroups/{rs_group}/workspaces/{ws}\r\n /datastores/workspaceblobstore/paths/myfolder/mydata.csv')\r\n\r\n# load parquet file to dask\r\nimport dask.dataframe as dd\r\ndf = dd.read_parquet('azureml://subscriptions/{sub_id}/resourcegroups/{rs_group}/workspaces/{ws}\r\n /datastores/workspaceblobstore/paths/myfolder/mydata.parquet')\r\n\r\n# load csv file to dask\r\nimport dask.dataframe as dd\r\ndf = dd.read_csv('azureml://subscriptions/{sub_id}/resourcegroups/{rs_group}/workspaces/{ws}\r\n /datastores/workspaceblobstore/paths/myfolder/mydata.csv')\r\n```\r\n\r\n\r\n# Release History\r\n\r\n## 1.3.1 (02-05-2024)\r\n\r\n### Features Added\r\n- added support for using mlclient for authorization\r\n\r\n## 1.3.0 (01-17-2024)\r\n\r\n### Features Added\r\n- added registry support for fsspec. \r\n\r\n## 1.2.0 (08-14-2023)\r\n\r\n### Features Added\r\n- added auth dict support (SP and managedIdentity) for fsspec. \r\n- added user exception mapping\r\n\r\n## 1.1.0 (06-01-2023)\r\n\r\n### Features Added\r\n- upload/download performance improvement\r\n\r\n## 1.0.0 (04-07-2023)\r\n\r\n### Features Added\r\n- Added upload/download API\r\n- bugfix(root behavior)\r\n\r\n## 0.1.0b1\r\n\r\n### Features Added\r\n- Initial public preview release of FileSystem for Azure Machine Learning defined datastore uri \r\n\r\n## 0.1.0b2\r\n\r\n### Features Added\r\n- Fix release notes\r\n\r\n\r\n## 0.1.0b3\r\n\r\n### Features Added\r\n- Add mode in open API\r\n- Add validation\r\n- Upgrade dataprep to 4.8\r\n\r\n",
"bugtrack_url": null,
"license": "Proprietary https://aka.ms/azureml-preview-sdk-license",
"summary": "Access datastore uri with fsspec",
"version": "1.3.1",
"project_urls": {
"Homepage": "https://docs.microsoft.com/python/api/overview/azure/ml/?view=azure-ml-py"
},
"split_keywords": [
"file-system",
"dask",
"azure"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "6107d467f174509d19b9f89018b59500901fdcabb7e83aad35a49aa1d76663d1",
"md5": "1556df1460e3bbe0946af9faee1c518f",
"sha256": "a0cf479e74bb213513a9995c7131f83e15b85cf7fb3a9fe56e65aad8c24b04f8"
},
"downloads": -1,
"filename": "azureml_fsspec-1.3.1-py3-none-any.whl",
"has_sig": false,
"md5_digest": "1556df1460e3bbe0946af9faee1c518f",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.6,< 4.0",
"size": 16287,
"upload_time": "2024-02-08T23:22:48",
"upload_time_iso_8601": "2024-02-08T23:22:48.318331Z",
"url": "https://files.pythonhosted.org/packages/61/07/d467f174509d19b9f89018b59500901fdcabb7e83aad35a49aa1d76663d1/azureml_fsspec-1.3.1-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-02-08 23:22:48",
"github": false,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"lcname": "azureml-fsspec"
}
JSON