# Flytekit Dask Plugin
Flyte can execute `dask` jobs natively on a Kubernetes Cluster, which manages the virtual `dask` cluster's lifecycle
(spin-up and tear down). It leverages the open-source Kubernetes Dask Operator and can be enabled without signing up
for any service. This is like running a transient (ephemeral) `dask` cluster - a type of cluster spun up for a specific
task and torn down after completion. This helps in making sure that the Python environment is the same on the job-runner
(driver), scheduler and the workers.
To install the plugin, run the following command:
```bash
pip install flytekitplugins-dask
```
To configure Dask in the Flyte deployment's backed, follow
[these directions](https://docs.flyte.org/en/latest/deployment/plugins/k8s/index.html)ernetes/k8s_dask/index.html#step-2-environment-setup)
An [usage example](https://docs.flyte.org/en/latest/flytesnacks/examples/k8s_dask_plugin/index.html)
can be found in the documentation.
Raw data
{
"_id": null,
"home_page": "https://github.com/flyteorg/flytekit/tree/master/plugins/flytekit-dask",
"name": "flytekitplugins-dask",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.9",
"maintainer_email": null,
"keywords": null,
"author": "flyteorg",
"author_email": "admin@flyte.org",
"download_url": "https://files.pythonhosted.org/packages/10/e2/f7d45db6e8b89dc614f33d03981e8de6a4807a817da73d77dfd5026fef14/flytekitplugins_dask-1.15.0.tar.gz",
"platform": null,
"description": "# Flytekit Dask Plugin\n\nFlyte can execute `dask` jobs natively on a Kubernetes Cluster, which manages the virtual `dask` cluster's lifecycle\n(spin-up and tear down). It leverages the open-source Kubernetes Dask Operator and can be enabled without signing up\nfor any service. This is like running a transient (ephemeral) `dask` cluster - a type of cluster spun up for a specific\ntask and torn down after completion. This helps in making sure that the Python environment is the same on the job-runner\n(driver), scheduler and the workers.\n\nTo install the plugin, run the following command:\n\n```bash\npip install flytekitplugins-dask\n```\n\nTo configure Dask in the Flyte deployment's backed, follow\n[these directions](https://docs.flyte.org/en/latest/deployment/plugins/k8s/index.html)ernetes/k8s_dask/index.html#step-2-environment-setup)\n\nAn [usage example](https://docs.flyte.org/en/latest/flytesnacks/examples/k8s_dask_plugin/index.html)\ncan be found in the documentation.\n",
"bugtrack_url": null,
"license": "apache2",
"summary": "Dask plugin for flytekit",
"version": "1.15.0",
"project_urls": {
"Homepage": "https://github.com/flyteorg/flytekit/tree/master/plugins/flytekit-dask"
},
"split_keywords": [],
"urls": [
{
"comment_text": null,
"digests": {
"blake2b_256": "afa82fff3c1654149f748f1f3b29f7d8b42547752420d3c0ac1284fccb8f4693",
"md5": "669ba0b632886f8abac96d40950e65bb",
"sha256": "9cff7afe1f767d5834c1b9f576fd5efa6736f8e95820361050d91fa2aa633c7a"
},
"downloads": -1,
"filename": "flytekitplugins_dask-1.15.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "669ba0b632886f8abac96d40950e65bb",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.9",
"size": 5428,
"upload_time": "2025-02-15T01:58:29",
"upload_time_iso_8601": "2025-02-15T01:58:29.170181Z",
"url": "https://files.pythonhosted.org/packages/af/a8/2fff3c1654149f748f1f3b29f7d8b42547752420d3c0ac1284fccb8f4693/flytekitplugins_dask-1.15.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "10e2f7d45db6e8b89dc614f33d03981e8de6a4807a817da73d77dfd5026fef14",
"md5": "4bdad3eb6c3fd7fc4fa4cbc412e0dc59",
"sha256": "92eafc8d1fcca37e385cf5d99bcacdfa0d59008c405c1f351312ed74cd38fff1"
},
"downloads": -1,
"filename": "flytekitplugins_dask-1.15.0.tar.gz",
"has_sig": false,
"md5_digest": "4bdad3eb6c3fd7fc4fa4cbc412e0dc59",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.9",
"size": 5320,
"upload_time": "2025-02-15T01:59:28",
"upload_time_iso_8601": "2025-02-15T01:59:28.581999Z",
"url": "https://files.pythonhosted.org/packages/10/e2/f7d45db6e8b89dc614f33d03981e8de6a4807a817da73d77dfd5026fef14/flytekitplugins_dask-1.15.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2025-02-15 01:59:28",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "flyteorg",
"github_project": "flytekit",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "flytekitplugins-dask"
}
JSON
