hybridbackend-tf115-cu118

Name	hybridbackend-tf115-cu118 JSON
Version	0.7.0.dev1672985131 JSON
	download
home_page	https://github.com/alibaba/HybridBackend
Summary	A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster
upload_time	2023-01-06 06:31:04
maintainer
docs_url	None
author	Alibaba Group Holding Limited
requires_python
license	Apache License 2.0
keywords	deep learning recommendation system
VCS
bugtrack_url
requirements	No requirements were recorded.
Travis-CI	No Travis.
coveralls test coverage	No coveralls.

            # HybridBackend

[![cibuild](https://github.com/alibaba/HybridBackend/actions/workflows/cibuild.yaml/badge.svg?branch=main&event=push)](https://github.com/alibaba/HybridBackend/actions/workflows/cibuild.yaml)
[![readthedocs](https://readthedocs.org/projects/hybridbackend/badge/?version=latest)](https://hybridbackend.readthedocs.io/en/latest/?badge=latest)
[![PRs Welcome](https://img.shields.io/badge/PRs-welcome-brightgreen.svg)](http://makeapullrequest.com)
[![license](https://img.shields.io/badge/License-Apache%202.0-brightgreen.svg)](https://opensource.org/licenses/Apache-2.0)

HybridBackend is a high-performance framework for training wide-and-deep
recommender systems on heterogeneous cluster.

## Features

- Memory-efficient loading of categorical data

- GPU-efficient orchestration of embedding layers

- Communication-efficient training and evaluation at scale

- Easy to use with existing AI workflows

## Usage

A minimal example:

```python
import tensorflow as tf
import hybridbackend.tensorflow as hb

ds = hb.data.ParquetDataset(filenames, batch_size=batch_size)
ds = ds.apply(hb.data.parse())
# ...

with tf.device('/gpu:0'):
  embs = tf.nn.embedding_lookup_sparse(weights, input_ids)
  # ...
```

Please see [documentation](https://hybridbackend.readthedocs.io/en/latest/) for
more information.

## Install

### Method 1: Install from PyPI

`pip install {PACKAGE}`

`{PACKAGE}` | Dependency | Python  | CUDA | GLIBC | Columnar Data Loading | Embedding Orchestration | Hybrid Parallelism
----------- | ---------- | ------- | ---- | ----- | ------------ | ----------------------- | ------------------
[hybridbackend-deeprec2208-cu114](https://pypi.org/project/hybridbackend-deeprec2208-cu114/) | [DeepRec 22.08](https://github.com/alibaba/DeepRec/tree/deeprec2208) | 3.6 | 11.4 | >=2.27 | &check; | &check; | &check;
[hybridbackend-tf115-cu116](https://pypi.org/project/hybridbackend-tf115-cu116/) | [TensorFlow 1.15](https://github.com/NVIDIA/tensorflow) | 3.8 | 11.6 | >=2.31 | &check; | &check; | &check;
[hybridbackend-tf115-cu100](https://pypi.org/project/hybridbackend-tf115-cu100/) | [TensorFlow 1.15](https://github.com/tensorflow/tensorflow/tree/r1.15) | 3.6 | 10.0 | >=2.27 | &check; | &check; | &cross;
[hybridbackend-tf115-cpu](https://pypi.org/project/hybridbackend-tf115-cpu/) | [TensorFlow 1.15](https://github.com/tensorflow/tensorflow/tree/r1.15) | 3.6 | - | >=2.24 | &check; | &cross; | &cross;

### Method 2: Build from source

See [Building Instructions](https://github.com/alibaba/HybridBackend/blob/main/BUILD.md).

## License

HybridBackend is licensed under the [Apache 2.0 License](LICENSE).

## Community

- Please see [Contributing Guide](https://github.com/alibaba/HybridBackend/blob/main/CONTRIBUTING.md)
before your first contribution.

- Please [register as an adopter](https://github.com/alibaba/HybridBackend/blob/main/ADOPTERS.md)
if your organization is interested in adoption. We will discuss
[RoadMap](https://github.com/alibaba/HybridBackend/blob/main/ROADMAP.md) with
registered adopters in advance.

- Please cite [HybridBackend](https://ieeexplore.ieee.org/document/9835450) in your publications if it helps:

  ```text
  @inproceedings{zhang2022picasso,
    title={PICASSO: Unleashing the Potential of GPU-centric Training for Wide-and-deep Recommender Systems},
    author={Zhang, Yuanxing and Chen, Langshi and Yang, Siran and Yuan, Man and Yi, Huimin and Zhang, Jie and Wang, Jiamang and Dong, Jianbo and Xu, Yunlong and Song, Yue and others},
    booktitle={2022 IEEE 38th International Conference on Data Engineering (ICDE)},
    year={2022},
    organization={IEEE}
  }
  ```

## Contact Us

If you would like to share your experiences with others, you are welcome to
contact us in DingTalk:

[<img src="https://github.com/alibaba/HybridBackend/raw/main/docs/images/dingtalk.png" alt="dingtalk" width="200"/>](https://h5.dingtalk.com/circle/healthCheckin.html?dtaction=os&corpId=ding14f3e2ea4b79994cadf6428847a62d4a&51951ad=a84b419&cbdbhh=qwertyuiop)

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/alibaba/HybridBackend",
    "name": "hybridbackend-tf115-cu118",
    "maintainer": "",
    "docs_url": null,
    "requires_python": "",
    "maintainer_email": "",
    "keywords": "deep learning,recommendation system",
    "author": "Alibaba Group Holding Limited",
    "author_email": "",
    "download_url": "https://github.com/alibaba/HybridBackend/tags",
    "platform": null,
    "description": "# HybridBackend\n\n[![cibuild](https://github.com/alibaba/HybridBackend/actions/workflows/cibuild.yaml/badge.svg?branch=main&event=push)](https://github.com/alibaba/HybridBackend/actions/workflows/cibuild.yaml)\n[![readthedocs](https://readthedocs.org/projects/hybridbackend/badge/?version=latest)](https://hybridbackend.readthedocs.io/en/latest/?badge=latest)\n[![PRs Welcome](https://img.shields.io/badge/PRs-welcome-brightgreen.svg)](http://makeapullrequest.com)\n[![license](https://img.shields.io/badge/License-Apache%202.0-brightgreen.svg)](https://opensource.org/licenses/Apache-2.0)\n\nHybridBackend is a high-performance framework for training wide-and-deep\nrecommender systems on heterogeneous cluster.\n\n## Features\n\n- Memory-efficient loading of categorical data\n\n- GPU-efficient orchestration of embedding layers\n\n- Communication-efficient training and evaluation at scale\n\n- Easy to use with existing AI workflows\n\n## Usage\n\nA minimal example:\n\n```python\nimport tensorflow as tf\nimport hybridbackend.tensorflow as hb\n\nds = hb.data.ParquetDataset(filenames, batch_size=batch_size)\nds = ds.apply(hb.data.parse())\n# ...\n\nwith tf.device('/gpu:0'):\n  embs = tf.nn.embedding_lookup_sparse(weights, input_ids)\n  # ...\n```\n\nPlease see [documentation](https://hybridbackend.readthedocs.io/en/latest/) for\nmore information.\n\n## Install\n\n### Method 1: Install from PyPI\n\n`pip install {PACKAGE}`\n\n`{PACKAGE}` | Dependency | Python  | CUDA | GLIBC | Columnar Data Loading | Embedding Orchestration | Hybrid Parallelism\n----------- | ---------- | ------- | ---- | ----- | ------------ | ----------------------- | ------------------\n[hybridbackend-deeprec2208-cu114](https://pypi.org/project/hybridbackend-deeprec2208-cu114/) | [DeepRec 22.08](https://github.com/alibaba/DeepRec/tree/deeprec2208) | 3.6 | 11.4 | >=2.27 | &check; | &check; | &check;\n[hybridbackend-tf115-cu116](https://pypi.org/project/hybridbackend-tf115-cu116/) | [TensorFlow 1.15](https://github.com/NVIDIA/tensorflow) | 3.8 | 11.6 | >=2.31 | &check; | &check; | &check;\n[hybridbackend-tf115-cu100](https://pypi.org/project/hybridbackend-tf115-cu100/) | [TensorFlow 1.15](https://github.com/tensorflow/tensorflow/tree/r1.15) | 3.6 | 10.0 | >=2.27 | &check; | &check; | &cross;\n[hybridbackend-tf115-cpu](https://pypi.org/project/hybridbackend-tf115-cpu/) | [TensorFlow 1.15](https://github.com/tensorflow/tensorflow/tree/r1.15) | 3.6 | - | >=2.24 | &check; | &cross; | &cross;\n\n### Method 2: Build from source\n\nSee [Building Instructions](https://github.com/alibaba/HybridBackend/blob/main/BUILD.md).\n\n## License\n\nHybridBackend is licensed under the [Apache 2.0 License](LICENSE).\n\n## Community\n\n- Please see [Contributing Guide](https://github.com/alibaba/HybridBackend/blob/main/CONTRIBUTING.md)\nbefore your first contribution.\n\n- Please [register as an adopter](https://github.com/alibaba/HybridBackend/blob/main/ADOPTERS.md)\nif your organization is interested in adoption. We will discuss\n[RoadMap](https://github.com/alibaba/HybridBackend/blob/main/ROADMAP.md) with\nregistered adopters in advance.\n\n- Please cite [HybridBackend](https://ieeexplore.ieee.org/document/9835450) in your publications if it helps:\n\n  ```text\n  @inproceedings{zhang2022picasso,\n    title={PICASSO: Unleashing the Potential of GPU-centric Training for Wide-and-deep Recommender Systems},\n    author={Zhang, Yuanxing and Chen, Langshi and Yang, Siran and Yuan, Man and Yi, Huimin and Zhang, Jie and Wang, Jiamang and Dong, Jianbo and Xu, Yunlong and Song, Yue and others},\n    booktitle={2022 IEEE 38th International Conference on Data Engineering (ICDE)},\n    year={2022},\n    organization={IEEE}\n  }\n  ```\n\n## Contact Us\n\nIf you would like to share your experiences with others, you are welcome to\ncontact us in DingTalk:\n\n[<img src=\"https://github.com/alibaba/HybridBackend/raw/main/docs/images/dingtalk.png\" alt=\"dingtalk\" width=\"200\"/>](https://h5.dingtalk.com/circle/healthCheckin.html?dtaction=os&corpId=ding14f3e2ea4b79994cadf6428847a62d4a&51951ad=a84b419&cbdbhh=qwertyuiop)\n",
    "bugtrack_url": null,
    "license": "Apache License 2.0",
    "summary": "A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster",
    "version": "0.7.0.dev1672985131",
    "split_keywords": [
        "deep learning",
        "recommendation system"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "ca4364eb949db9a588bf278585370c9dd36d2c14d1e0f0612a3b0baa2b9cf9b4",
                "md5": "d5a0e965f10ba99be44e9744e399ed7d",
                "sha256": "d1591e871cefd0e3fe874a986e6d40f33eec51e1716225288bde3c3176049ff9"
            },
            "downloads": -1,
            "filename": "hybridbackend_tf115_cu118-0.7.0.dev1672985131-cp38-cp38-manylinux_2_31_x86_64.whl",
            "has_sig": false,
            "md5_digest": "d5a0e965f10ba99be44e9744e399ed7d",
            "packagetype": "bdist_wheel",
            "python_version": "cp38",
            "requires_python": null,
            "size": 62804501,
            "upload_time": "2023-01-06T06:31:04",
            "upload_time_iso_8601": "2023-01-06T06:31:04.335369Z",
            "url": "https://files.pythonhosted.org/packages/ca/43/64eb949db9a588bf278585370c9dd36d2c14d1e0f0612a3b0baa2b9cf9b4/hybridbackend_tf115_cu118-0.7.0.dev1672985131-cp38-cp38-manylinux_2_31_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-01-06 06:31:04",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "github_user": "alibaba",
    "github_project": "HybridBackend",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "hybridbackend-tf115-cu118"
}

Alibaba Group Holding Limited