| Name | mindpandas JSON |
| Version |
0.2.0
JSON |
| download |
| home_page | https://www.mindspore.cn |
| Summary | mindpandas platform: linux, cpu: x86_64, git version: [sha1]:e07dbf1, [branch]: (HEAD -> master, origin/master, origin/HEAD) |
| upload_time | 2023-04-24 12:18:08 |
| maintainer | |
| docs_url | None |
| author | The MindSpore Authors |
| requires_python | >=3.7, <3.10 |
| license | Apache 2.0 |
| keywords |
mindpandas
|
| VCS |
|
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
# Welcome to MindPandas
[查看中文](./README_CN.md)
<!-- TOC -->
- [What Is MindPandas](#what-is-mindpandas)
- [Overview](#overview)
- [Architecture](#architecture)
- [Installation Methods](#installation-methods)
- [Confirming System Environment Information](#confirming-system-environment-information)
- [Installing from pip command](#installing-from-pip-command)
- [Installing from source code](#installing-from-source-code)
- [Installation Verification](#installation-verification)
- [Quickstart](#quickstart)
- [Docs](#docs)
- [Contributing](#contributing)
- [Release Notes](#release-notes)
- [License](#license)
<!-- /TOC -->
## What Is MindPandas
### Overview
MindPandas uses distributed computing engine to accelerate pandas operations, seamlessly integrated and compatible with existing pandas code. Using MindPandas for calculations can use all CPU cores on the computer, which makes MindPandas works especially well on larger datasets.
### Architecture
MindPandas is implemented based on distribution, while native pandas is implemented based on single thread. This means that only one CPU core can be used at a time.
However, MindPandas can use more threads and cores on the machine, or all cores of the entire cluster.
For detailed architecture design, please refer to [official website document](https://www.mindspore.cn/mindpandas/docs/en/master/index.html).
## Installation Methods
### Confirming System Environment Information
The following table lists the environment required for installing, compiling and running MindPandas:
| software | version |
| :------: | :-----: |
| Linux-x86_64 | Ubuntu \>=18.04<br/>Euler \>=2.9 |
| Python | 3.8 |
| glibc | \>=2.25 |
- Make sure libxml2-utils is installed in your environment.
- Please refer to [requirements](https://gitee.com/mindspore/mindpandas/blob/master/requirements.txt) for other third party dependencies.
### Installing from pip command
If you use the pip, please download the whl package from [MindPandas](https://www.mindspore.cn/versions/en) page and install it.
> Installing whl package will download MindPandas dependencies automatically (detail of dependencies is shown in requirements.txt) in the networked state, and other dependencies should be installed manually.
### Installing from source code
Download [source code](https://gitee.com/mindspore/mindpandas), then enter the `mindpandas` directory to run build.sh script.
```shell
git clone https://gitee.com/mindspore/mindpandas.git
cd mindpandas
bash build.sh
```
The package is in output directory after compiled and you can install with pip.
```shell
pip install output/mindpandas-0.1.0-cp38-cp38-linux_x86_64.whl
```
## Installation Verification
Execute the following command in shell. If no `No module named 'mindpandas'` error is reported, the installation is successful.
```shell
python -c "import mindpandas"
```
## Quickstart
First import MindPandas with the following command.
```python
import mindpandas as pd
```
Set the running mode of MindPandas with the following command, which can speed up your MindPandas workflow.
```python
pd.set_concurrency_mode('multithread')
```
The complete example is as follows:
```python
>>> import mindpandas as pd
>>> pd.set_concurrency_mode('multithread')
>>> pd.set_partition_shape((16, 2))
>>> pd_df = pd.DataFrame([[1, 2, 3], [4, 5, 6]])
>>> sum = pd_df.sum()
>>> print(sum)
0 5
1 7
2 9
Name: sum, dtype: int64
```
## Docs
More details about installation guide, tutorials and APIs, please see the
[User Documentation](https://www.mindspore.cn/mindpandas/docs/en/master/mindpandas_install.html).
## Contributing
Welcome contributions. See our [Contributor Wiki](https://gitee.com/mindspore/mindspore/blob/master/CONTRIBUTING.md) for
more details.
## Release Notes
The release notes, see our [RELEASE](https://gitee.com/mindspore/mindpandas/blob/master/RELEASE.md).
## License
[Apache License 2.0](https://gitee.com/mindspore/mindpandas/blob/master/LICENSE)
Raw data
{
"_id": null,
"home_page": "https://www.mindspore.cn",
"name": "mindpandas",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.7, <3.10",
"maintainer_email": "",
"keywords": "mindpandas",
"author": "The MindSpore Authors",
"author_email": "contact@mindspore.cn",
"download_url": "https://gitee.com/mindspore/mindpandas/tags",
"platform": "linux",
"description": "# Welcome to MindPandas\n\n[\u67e5\u770b\u4e2d\u6587](./README_CN.md)\n\n<!-- TOC -->\n\n- [What Is MindPandas](#what-is-mindpandas)\n - [Overview](#overview)\n - [Architecture](#architecture)\n- [Installation Methods](#installation-methods)\n - [Confirming System Environment Information](#confirming-system-environment-information)\n - [Installing from pip command](#installing-from-pip-command)\n - [Installing from source code](#installing-from-source-code)\n- [Installation Verification](#installation-verification)\n- [Quickstart](#quickstart)\n- [Docs](#docs)\n- [Contributing](#contributing)\n- [Release Notes](#release-notes)\n- [License](#license)\n\n<!-- /TOC -->\n\n## What Is MindPandas\n\n### Overview\n\nMindPandas uses distributed computing engine to accelerate pandas operations, seamlessly integrated and compatible with existing pandas code. Using MindPandas for calculations can use all CPU cores on the computer, which makes MindPandas works especially well on larger datasets.\n\n### Architecture\n\nMindPandas is implemented based on distribution, while native pandas is implemented based on single thread. This means that only one CPU core can be used at a time.\n\nHowever, MindPandas can use more threads and cores on the machine, or all cores of the entire cluster.\n\nFor detailed architecture design, please refer to [official website document](https://www.mindspore.cn/mindpandas/docs/en/master/index.html).\n\n## Installation Methods\n\n### Confirming System Environment Information\n\nThe following table lists the environment required for installing, compiling and running MindPandas:\n\n| software | version |\n| :------: | :-----: |\n| Linux-x86_64 | Ubuntu \\>=18.04<br/>Euler \\>=2.9 |\n| Python | 3.8 |\n| glibc | \\>=2.25 |\n\n- Make sure libxml2-utils is installed in your environment.\n- Please refer to [requirements](https://gitee.com/mindspore/mindpandas/blob/master/requirements.txt) for other third party dependencies.\n\n### Installing from pip command\n\nIf you use the pip, please download the whl package from [MindPandas](https://www.mindspore.cn/versions/en) page and install it.\n\n> Installing whl package will download MindPandas dependencies automatically (detail of dependencies is shown in requirements.txt) in the networked state, and other dependencies should be installed manually.\n\n### Installing from source code\n\nDownload [source code](https://gitee.com/mindspore/mindpandas), then enter the `mindpandas` directory to run build.sh script.\n\n```shell\ngit clone https://gitee.com/mindspore/mindpandas.git\ncd mindpandas\nbash build.sh\n```\n\nThe package is in output directory after compiled and you can install with pip.\n\n```shell\npip install output/mindpandas-0.1.0-cp38-cp38-linux_x86_64.whl\n```\n\n## Installation Verification\n\nExecute the following command in shell. If no `No module named 'mindpandas'` error is reported, the installation is successful.\n\n```shell\npython -c \"import mindpandas\"\n```\n\n## Quickstart\n\nFirst import MindPandas with the following command.\n\n```python\nimport mindpandas as pd\n```\n\nSet the running mode of MindPandas with the following command, which can speed up your MindPandas workflow.\n\n```python\npd.set_concurrency_mode('multithread')\n```\n\nThe complete example is as follows:\n\n```python\n>>> import mindpandas as pd\n>>> pd.set_concurrency_mode('multithread')\n>>> pd.set_partition_shape((16, 2))\n>>> pd_df = pd.DataFrame([[1, 2, 3], [4, 5, 6]])\n>>> sum = pd_df.sum()\n>>> print(sum)\n0 5\n1 7\n2 9\nName: sum, dtype: int64\n```\n\n## Docs\n\nMore details about installation guide, tutorials and APIs, please see the\n[User Documentation](https://www.mindspore.cn/mindpandas/docs/en/master/mindpandas_install.html).\n\n## Contributing\n\nWelcome contributions. See our [Contributor Wiki](https://gitee.com/mindspore/mindspore/blob/master/CONTRIBUTING.md) for\nmore details.\n\n## Release Notes\n\nThe release notes, see our [RELEASE](https://gitee.com/mindspore/mindpandas/blob/master/RELEASE.md).\n\n## License\n\n[Apache License 2.0](https://gitee.com/mindspore/mindpandas/blob/master/LICENSE)\n",
"bugtrack_url": null,
"license": "Apache 2.0",
"summary": "mindpandas platform: linux, cpu: x86_64, git version: [sha1]:e07dbf1, [branch]: (HEAD -> master, origin/master, origin/HEAD)",
"version": "0.2.0",
"split_keywords": [
"mindpandas"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "82fd9cb77d1c7e121cea2e29657f365339cbc09f1ce36e193e4e2c75e552d795",
"md5": "913066ab048a46f7ef0f8549644032a4",
"sha256": "a7c24241caa91add38600cbd100954935aa40738db81f2614b35f20731468035"
},
"downloads": -1,
"filename": "mindpandas-0.2.0-cp38-cp38-manylinux1_x86_64.whl",
"has_sig": false,
"md5_digest": "913066ab048a46f7ef0f8549644032a4",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.7, <3.10",
"size": 74466490,
"upload_time": "2023-04-24T12:18:08",
"upload_time_iso_8601": "2023-04-24T12:18:08.152654Z",
"url": "https://files.pythonhosted.org/packages/82/fd/9cb77d1c7e121cea2e29657f365339cbc09f1ce36e193e4e2c75e552d795/mindpandas-0.2.0-cp38-cp38-manylinux1_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "cc22161441994373067a2cf0f640bb6bf4e8c21fc4c51748523ac795d60204c8",
"md5": "61aa84989cacef35bba287799b272536",
"sha256": "3bc2f0d2e5f06d1fc39db998366c3342312829c28c9159f71e22b806973dbf68"
},
"downloads": -1,
"filename": "mindpandas-0.2.0-cp39-cp39-manylinux1_x86_64.whl",
"has_sig": false,
"md5_digest": "61aa84989cacef35bba287799b272536",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": ">=3.7, <3.10",
"size": 94799328,
"upload_time": "2023-04-24T12:17:37",
"upload_time_iso_8601": "2023-04-24T12:17:37.321487Z",
"url": "https://files.pythonhosted.org/packages/cc/22/161441994373067a2cf0f640bb6bf4e8c21fc4c51748523ac795d60204c8/mindpandas-0.2.0-cp39-cp39-manylinux1_x86_64.whl",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-04-24 12:18:08",
"github": false,
"gitlab": false,
"bitbucket": false,
"lcname": "mindpandas"
}
