# ML Metadata
[![Python](https://img.shields.io/badge/python%7C3.9%7C3.10%7C3.11-blue)](https://github.com/google/ml-metadata)
[![PyPI](https://badge.fury.io/py/ml-metadata.svg)](https://badge.fury.io/py/ml-metadata)
*ML Metadata (MLMD)* is a library for recording and retrieving metadata
associated with ML developer and data scientist workflows.
NOTE: ML Metadata may be backwards incompatible before version 1.0.
## Getting Started
For more background on MLMD and instructions on using it, see the
[getting started guide](https://github.com/google/ml-metadata/blob/master/g3doc/get_started.md)
## Installing from PyPI
The recommended way to install ML Metadata is to use the
[PyPI package](https://pypi.org/project/ml-metadata/):
```bash
pip install ml-metadata
```
Then import the relevant packages:
```python
from ml_metadata import metadata_store
from ml_metadata.proto import metadata_store_pb2
```
### Nightly Packages
ML Metadata (MLMD) also hosts nightly packages at
https://pypi-nightly.tensorflow.org on Google Cloud. To install the latest
nightly package, please use the following command:
```bash
pip install --extra-index-url https://pypi-nightly.tensorflow.org/simple ml-metadata
```
## Installing with Docker
This is the recommended way to build ML Metadata under Linux, and is
continuously tested at Google.
Please first install `docker` and `docker-compose` by following the directions:
[docker](https://docs.docker.com/install/);
[docker-compose](https://docs.docker.com/compose/install/).
Then, run the following at the project root:
```bash
DOCKER_SERVICE=manylinux-python${PY_VERSION}
sudo docker-compose build ${DOCKER_SERVICE}
sudo docker-compose run ${DOCKER_SERVICE}
```
where `PY_VERSION` is one of `{39, 310, 311}`.
A wheel will be produced under `dist/`, and installed as follows:
```shell
pip install dist/*.whl
```
## Installing from source
### 1. Prerequisites
To compile and use ML Metadata, you need to set up some prerequisites.
#### Install Bazel
If Bazel is not installed on your system, install it now by following [these
directions](https://bazel.build/versions/master/docs/install.html).
#### Install cmake
If cmake is not installed on your system, install it now by following [these
directions](https://cmake.org/install/).
### 2. Clone ML Metadata repository
```shell
git clone https://github.com/google/ml-metadata
cd ml-metadata
```
Note that these instructions will install the latest master branch of ML
Metadata. If you want to install a specific branch (such as a release branch),
pass `-b <branchname>` to the `git clone` command.
### 3. Build the pip package
ML Metadata uses Bazel to build the pip package from source:
```shell
python setup.py bdist_wheel
```
You can find the generated `.whl` file in the `dist` subdirectory.
### 4. Install the pip package
```shell
pip install dist/*.whl
```
### 5.(Optional) Build the grpc server
ML Metadata uses Bazel to build the c++ binary from source:
```shell
bazel build -c opt --define grpc_no_ares=true //ml_metadata/metadata_store:metadata_store_server
```
## Supported platforms
MLMD is built and tested on the following 64-bit operating systems:
* macOS 10.14.6 (Mojave) or later.
* Ubuntu 20.04 or later.
* [DEPRECATED] Windows 10 or later. For a Windows-compatible library, please
refer to MLMD 1.14.0 or earlier versions.
Raw data
{
"_id": null,
"home_page": "https://github.com/google/ml-metadata",
"name": "ml-metadata",
"maintainer": null,
"docs_url": null,
"requires_python": "<4,>=3.9",
"maintainer_email": null,
"keywords": "machine learning metadata tfx",
"author": "Google LLC",
"author_email": "tensorflow-extended-dev@googlegroups.com",
"download_url": "https://github.com/google/ml-metadata/tags",
"platform": null,
"description": "\n# ML Metadata\n\n[![Python](https://img.shields.io/badge/python%7C3.9%7C3.10%7C3.11-blue)](https://github.com/google/ml-metadata)\n[![PyPI](https://badge.fury.io/py/ml-metadata.svg)](https://badge.fury.io/py/ml-metadata)\n\n*ML Metadata (MLMD)* is a library for recording and retrieving metadata\nassociated with ML developer and data scientist workflows.\n\nNOTE: ML Metadata may be backwards incompatible before version 1.0.\n\n## Getting Started\n\nFor more background on MLMD and instructions on using it, see the\n[getting started guide](https://github.com/google/ml-metadata/blob/master/g3doc/get_started.md)\n\n## Installing from PyPI\n\nThe recommended way to install ML Metadata is to use the\n[PyPI package](https://pypi.org/project/ml-metadata/):\n\n```bash\npip install ml-metadata\n```\n\nThen import the relevant packages:\n\n```python\nfrom ml_metadata import metadata_store\nfrom ml_metadata.proto import metadata_store_pb2\n```\n\n### Nightly Packages\n\nML Metadata (MLMD) also hosts nightly packages at\nhttps://pypi-nightly.tensorflow.org on Google Cloud. To install the latest\nnightly package, please use the following command:\n\n```bash\npip install --extra-index-url https://pypi-nightly.tensorflow.org/simple ml-metadata\n```\n\n## Installing with Docker\n\nThis is the recommended way to build ML Metadata under Linux, and is\ncontinuously tested at Google.\n\nPlease first install `docker` and `docker-compose` by following the directions:\n[docker](https://docs.docker.com/install/);\n[docker-compose](https://docs.docker.com/compose/install/).\n\nThen, run the following at the project root:\n\n```bash\nDOCKER_SERVICE=manylinux-python${PY_VERSION}\nsudo docker-compose build ${DOCKER_SERVICE}\nsudo docker-compose run ${DOCKER_SERVICE}\n```\n\nwhere `PY_VERSION` is one of `{39, 310, 311}`.\n\nA wheel will be produced under `dist/`, and installed as follows:\n\n```shell\npip install dist/*.whl\n```\n\n## Installing from source\n\n\n### 1. Prerequisites\n\nTo compile and use ML Metadata, you need to set up some prerequisites.\n\n\n#### Install Bazel\n\nIf Bazel is not installed on your system, install it now by following [these\ndirections](https://bazel.build/versions/master/docs/install.html).\n\n#### Install cmake\nIf cmake is not installed on your system, install it now by following [these\ndirections](https://cmake.org/install/).\n\n### 2. Clone ML Metadata repository\n\n```shell\ngit clone https://github.com/google/ml-metadata\ncd ml-metadata\n```\n\nNote that these instructions will install the latest master branch of ML\nMetadata. If you want to install a specific branch (such as a release branch),\npass `-b <branchname>` to the `git clone` command.\n\n### 3. Build the pip package\n\nML Metadata uses Bazel to build the pip package from source:\n\n```shell\npython setup.py bdist_wheel\n```\n\nYou can find the generated `.whl` file in the `dist` subdirectory.\n\n### 4. Install the pip package\n\n```shell\npip install dist/*.whl\n```\n\n### 5.(Optional) Build the grpc server\n\nML Metadata uses Bazel to build the c++ binary from source:\n\n```shell\nbazel build -c opt --define grpc_no_ares=true //ml_metadata/metadata_store:metadata_store_server\n```\n\n## Supported platforms\n\nMLMD is built and tested on the following 64-bit operating systems:\n\n* macOS 10.14.6 (Mojave) or later.\n* Ubuntu 20.04 or later.\n* [DEPRECATED] Windows 10 or later. For a Windows-compatible library, please\n refer to MLMD 1.14.0 or earlier versions.\n",
"bugtrack_url": null,
"license": "Apache 2.0",
"summary": "A library for maintaining metadata for artifacts.",
"version": "1.15.0",
"project_urls": {
"Download": "https://github.com/google/ml-metadata/tags",
"Homepage": "https://github.com/google/ml-metadata"
},
"split_keywords": [
"machine",
"learning",
"metadata",
"tfx"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "b6bcd098c49859de8de390d03fa88ecd0ad548075c7feecb34db7148440bc058",
"md5": "af2e64414e7cd6f5a83a171a3c9971b5",
"sha256": "47b1267839b780cf78a0b4d3c89f48c85441f9b1ae15e4945fc1d66721ba80b9"
},
"downloads": -1,
"filename": "ml_metadata-1.15.0-cp310-cp310-macosx_12_0_x86_64.whl",
"has_sig": false,
"md5_digest": "af2e64414e7cd6f5a83a171a3c9971b5",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": "<4,>=3.9",
"size": 20070614,
"upload_time": "2024-04-23T05:23:23",
"upload_time_iso_8601": "2024-04-23T05:23:23.279192Z",
"url": "https://files.pythonhosted.org/packages/b6/bc/d098c49859de8de390d03fa88ecd0ad548075c7feecb34db7148440bc058/ml_metadata-1.15.0-cp310-cp310-macosx_12_0_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "935f01eddd4e52605474972040a8cc8124b7b588e20040f853bfe196628005e1",
"md5": "770a0226c1e76cc2d34274317d0b1bf8",
"sha256": "96f9acac134314f721b14e9c8d878694ca55dabd6d3587956c51de7a48459fec"
},
"downloads": -1,
"filename": "ml_metadata-1.15.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "770a0226c1e76cc2d34274317d0b1bf8",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": "<4,>=3.9",
"size": 7489248,
"upload_time": "2024-04-23T05:19:26",
"upload_time_iso_8601": "2024-04-23T05:19:26.666888Z",
"url": "https://files.pythonhosted.org/packages/93/5f/01eddd4e52605474972040a8cc8124b7b588e20040f853bfe196628005e1/ml_metadata-1.15.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "d486f64e6e3f3df25c8783657c7a4d369b11f1e332bf7fcc87632a4a00c68367",
"md5": "3f5f6d4eb1ac3c67a594aa6cde19e05a",
"sha256": "9e4255d8ddb7ce77dbf76e8bda8e1de3867d54990d47fb313682f53edc28d48e"
},
"downloads": -1,
"filename": "ml_metadata-1.15.0-cp39-cp39-macosx_12_0_x86_64.whl",
"has_sig": false,
"md5_digest": "3f5f6d4eb1ac3c67a594aa6cde19e05a",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": "<4,>=3.9",
"size": 20070978,
"upload_time": "2024-04-23T05:25:00",
"upload_time_iso_8601": "2024-04-23T05:25:00.389636Z",
"url": "https://files.pythonhosted.org/packages/d4/86/f64e6e3f3df25c8783657c7a4d369b11f1e332bf7fcc87632a4a00c68367/ml_metadata-1.15.0-cp39-cp39-macosx_12_0_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "b85a238b52803eaccbd2757e8b8a6303ea7048c3079c9475c4ea33607b281070",
"md5": "523daf9ce712feb52397e2479322f3e4",
"sha256": "9bb79d9984b308f2a5a8b0aea7b71985bbf5510a890cac31726f5e0425478620"
},
"downloads": -1,
"filename": "ml_metadata-1.15.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "523daf9ce712feb52397e2479322f3e4",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": "<4,>=3.9",
"size": 7489402,
"upload_time": "2024-04-23T05:17:11",
"upload_time_iso_8601": "2024-04-23T05:17:11.543454Z",
"url": "https://files.pythonhosted.org/packages/b8/5a/238b52803eaccbd2757e8b8a6303ea7048c3079c9475c4ea33607b281070/ml_metadata-1.15.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-04-23 05:23:23",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "google",
"github_project": "ml-metadata",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "ml-metadata"
}