# TAO Toolkit Quick Start Guide
This page provides a quick start guide for installing and running TAO Toolkit.
## Requirements
### Hardware
The following system configuration is recommended to achieve reasonable training performance with TAO Toolkit and supported models provided:
* 32 GB system RAM
* 32 GB of GPU RAM
* 8 core CPU
* 1 NVIDIA GPU
* 100 GB of SSD space
TAO Toolkit is supported on A100, V100 and RTX 30x0 GPUs.
### Software Requirements
| **Software** | **Version** |
| :----- | :---- |
| Ubuntu 18.04 LTS | 18.04 |
| python | >=3.6.9 |
| docker-ce | >19.03.5 |
| docker-API | 1.40 |
| [nvidia-container-toolkit](https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/overview.html) | >1.3.0-1 |
| nvidia-container-runtime | 3.4.0-1 |
| nvidia-docker2 | 2.5.0-1 |
| nvidia-driver | >465 |
| python-pip | >21.06 |
| python-dev | |
## Installing the Pre-requisites
The tao-launcher is strictly a python3 only package, capable of running on python 3.6.9 or 3.7.
1. Install `docker-ce` by following the [official instructions](https://docs.docker.com/engine/install).
Once you have installed docker-ce, follow the [post-installation steps](https://docs.docker.com/engine/install/linux-postinstall/) to ensure that the
docker can be run without `sudo`.
2. Install `nvidia-container-toolkit` by following the [install-guide](https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html).
3. Get an [NGC](https://ngc.nvidia.com) account and API key:
a. Go to NGC and click the **TAO Toolkit** container in the **Catalog** tab. This
message is displayed: `Sign in to access the PULL feature of this repository`.
b. Enter your Email address and click **Next**, or click **Create an Account**.
c. Choose your organization when prompted for **Organization/Team**.
d. Click **Sign In**.
4. Log in to the NGC docker registry (`nvcr.io`) using the command
`docker login nvcr.io` and enter the following credentials:
```sh
a. Username: $oauthtoken
b. Password: YOUR_NGC_API_KEY
```
where `YOUR_NGC_API_KEY` corresponds to the key you generated from step 3.
*DeepStream 6.0 - [NVIDIA SDK for IVA inference](https://developer.nvidia.com/deepstream-sdk) is recommended.*
## Installing TAO Toolkit
TAO Toolkit is a Python pip package that is hosted on the NVIDIA PyIndex.
The package uses the docker restAPI under the hood to interact with the NGC Docker registry to
pull and instantiate the underlying docker containers. You must have an NGC account and an API
key associated with your account. See the [Installation Prerequisites](#installing-the-pre-requisites) section
for details on creating an NGC account and obtaining an API key.
1. Create a new `virtualenv` using `virtualenvwrapper`.
You may follow the instructions in this [link](https://python-guide-cn.readthedocs.io/en/latest/dev/virtualenvs.html)
to set up a Python virtualenv using a virtualenvwrapper.
Once you have followed the instructions to install `virtualenv` and `virtualenvwrapper`,
set the Python version in the `virtualenv`. This can be done in either of the following ways:
* Defining the environment variable called VIRTUALENVWRAPPER_PYTHON.
This variable should point to the path where the python3 binary is installed in your local
machine. You can also add it to your `.bashrc` or `.bash_profile` for setting
your Python `virtualenv` by default.
```sh
export VIRTUALENVWRAPPER_PYTHON=/usr/bin/python3
```
* Setting the path to the python3 binary when creating your `virtualenv` using the
`virtualenvwrapper` wrapper
```sh
mkvirtualenv launcher -p /path/to/your/python3
```
Once you have logged into the `virtualenv`, the command prompt should show the name of
your virtual environment
```sh
(launcher) py-3.6.9 desktop:
```
When you are done with you session, you may deactivate your `virtualenv` using the
`deactivate` command:
```sh
deactivate
```
You may re-instantiate this created `virtualenv` env using the `workon` command.
```sh
workon launcher
```
2. Install the TAO Launcher Python package called `nvidia-tao`.
```sh
pip3 install nvidia-tao
```
>
>If you had installed an older version of :code:`nvidia-tao` launcher, you may upgrade
>to the latest version by running the following command.
>
> ```sh
> pip3 install --upgrade nvidia-tao
> ```
3. Invoke the entrypoints using the :code:`tao` command.
```sh
tao --help
```
The sample output of the above command is:
```sh
usage: tao [-h]
{list,stop,info,augment,bpnet,classification,detectnet_v2,dssd,emotionnet,faster_rcnn,fpenet,gazenet,gesturenet,
heartratenet,intent_slot_classification,lprnet,mask_rcnn,punctuation_and_capitalization,question_answering,
retinanet,speech_to_text,ssd,text_classification,converter,token_classification,unet,yolo_v3,yolo_v4,yolo_v4_tiny}
...
Launcher for TAO
optional arguments:
-h, --help show this help message and exit
tasks:
{list,stop,info,augment,bpnet,classification,detectnet_v2,dssd,emotionnet,faster_rcnn,fpenet,gazenet,gesturenet,heartratenet
,intent_slot_classification,lprnet,mask_rcnn,punctuation_and_capitalization,question_answering,retinanet,speech_to_text,
ssd,text_classification,converter,token_classification,unet,yolo_v3,yolo_v4,yolo_v4_tiny}
```
Note that under tasks you can see all the launcher-invokable tasks. The following are the
specific tasks that help with handling the launched commands using the TAO Launcher:
* list
* stop
* info
>
> When installing the TAO Toolkit Launcher to your host machine's native python3 as opposed to the recommended route of using virtual
> environment, you may get an error saying that `tao` binary wasn't found. This is because the path to your `tao` binary
> installed by pip wasn't added to the `PATH` environment variable in your local machine. In this case, please run the
> following command:
>
>```sh
>export PATH=$PATH:~/.local/bin
>```
## Running the TAO Toolkit
Information about the TAO Launcher CLI and details on using it to run TAO supported tasks are
captured in the [TAO Toolkit Launcher](https://docs.nvidia.com/tao/tao-toolkit/text/tao_launcher.html#tao-toolkit-launcher)
section of the [TAO Toolkit User Guide](https://docs.nvidia.com/tao/tao-toolkit).
Raw data
{
"_id": null,
"home_page": "",
"name": "nvidia-tao",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.6",
"maintainer_email": "",
"keywords": "nvidia,tao,launcher",
"author": "Varun Praveen, Arun George Zachariah",
"author_email": "vpraveen@nvidia.com, azachariah@nvidia.com",
"download_url": "",
"platform": null,
"description": "# TAO Toolkit Quick Start Guide\n\nThis page provides a quick start guide for installing and running TAO Toolkit.\n\n## Requirements\n\n### Hardware\n\nThe following system configuration is recommended to achieve reasonable training performance with TAO Toolkit and supported models provided:\n\n* 32 GB system RAM\n* 32 GB of GPU RAM\n* 8 core CPU\n* 1 NVIDIA GPU\n* 100 GB of SSD space\n\nTAO Toolkit is supported on A100, V100 and RTX 30x0 GPUs.\n\n### Software Requirements\n\n| **Software** | **Version** |\n| :----- | :---- |\n| Ubuntu 18.04 LTS | 18.04 |\n| python | >=3.6.9 |\n| docker-ce | >19.03.5 |\n| docker-API | 1.40 |\n| [nvidia-container-toolkit](https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/overview.html) | >1.3.0-1 |\n| nvidia-container-runtime | 3.4.0-1 |\n| nvidia-docker2 | 2.5.0-1 |\n| nvidia-driver | >465 |\n| python-pip | >21.06 |\n| python-dev | |\n\n## Installing the Pre-requisites\n\nThe tao-launcher is strictly a python3 only package, capable of running on python 3.6.9 or 3.7.\n\n1. Install `docker-ce` by following the [official instructions](https://docs.docker.com/engine/install).\n\n Once you have installed docker-ce, follow the [post-installation steps](https://docs.docker.com/engine/install/linux-postinstall/) to ensure that the\n docker can be run without `sudo`.\n\n2. Install `nvidia-container-toolkit` by following the [install-guide](https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html).\n\n3. Get an [NGC](https://ngc.nvidia.com) account and API key:\n\n a. Go to NGC and click the **TAO Toolkit** container in the **Catalog** tab. This\n message is displayed: `Sign in to access the PULL feature of this repository`.\n b. Enter your Email address and click **Next**, or click **Create an Account**.\n c. Choose your organization when prompted for **Organization/Team**.\n d. Click **Sign In**.\n\n4. Log in to the NGC docker registry (`nvcr.io`) using the command\n `docker login nvcr.io` and enter the following credentials:\n\n ```sh\n a. Username: $oauthtoken\n b. Password: YOUR_NGC_API_KEY\n ```\n\n where `YOUR_NGC_API_KEY` corresponds to the key you generated from step 3.\n\n*DeepStream 6.0 - [NVIDIA SDK for IVA inference](https://developer.nvidia.com/deepstream-sdk) is recommended.*\n\n## Installing TAO Toolkit\n\nTAO Toolkit is a Python pip package that is hosted on the NVIDIA PyIndex.\nThe package uses the docker restAPI under the hood to interact with the NGC Docker registry to\npull and instantiate the underlying docker containers. You must have an NGC account and an API\nkey associated with your account. See the [Installation Prerequisites](#installing-the-pre-requisites) section\nfor details on creating an NGC account and obtaining an API key.\n\n1. Create a new `virtualenv` using `virtualenvwrapper`.\n\n You may follow the instructions in this [link](https://python-guide-cn.readthedocs.io/en/latest/dev/virtualenvs.html)\n to set up a Python virtualenv using a virtualenvwrapper.\n\n Once you have followed the instructions to install `virtualenv` and `virtualenvwrapper`,\n set the Python version in the `virtualenv`. This can be done in either of the following ways:\n \n * Defining the environment variable called VIRTUALENVWRAPPER_PYTHON.\n This variable should point to the path where the python3 binary is installed in your local\n machine. You can also add it to your `.bashrc` or `.bash_profile` for setting\n your Python `virtualenv` by default.\n\n ```sh\n export VIRTUALENVWRAPPER_PYTHON=/usr/bin/python3\n ```\n\n * Setting the path to the python3 binary when creating your `virtualenv` using the\n `virtualenvwrapper` wrapper\n \n ```sh\n mkvirtualenv launcher -p /path/to/your/python3\n ```\n\n Once you have logged into the `virtualenv`, the command prompt should show the name of\n your virtual environment\n\n ```sh\n (launcher) py-3.6.9 desktop:\n ```\n\n When you are done with you session, you may deactivate your `virtualenv` using the\n `deactivate` command:\n\n ```sh\n deactivate\n ```\n\n You may re-instantiate this created `virtualenv` env using the `workon` command.\n\n ```sh\n workon launcher\n ```\n\n2. Install the TAO Launcher Python package called `nvidia-tao`.\n\n ```sh\n pip3 install nvidia-tao\n ```\n\n >\n >If you had installed an older version of :code:`nvidia-tao` launcher, you may upgrade\n >to the latest version by running the following command.\n >\n > ```sh\n > pip3 install --upgrade nvidia-tao\n > ```\n\n3. Invoke the entrypoints using the :code:`tao` command.\n\n ```sh\n tao --help\n ```\n \n The sample output of the above command is:\n \n ```sh\n usage: tao [-h]\n {list,stop,info,augment,bpnet,classification,detectnet_v2,dssd,emotionnet,faster_rcnn,fpenet,gazenet,gesturenet,\n heartratenet,intent_slot_classification,lprnet,mask_rcnn,punctuation_and_capitalization,question_answering,\n retinanet,speech_to_text,ssd,text_classification,converter,token_classification,unet,yolo_v3,yolo_v4,yolo_v4_tiny}\n ...\n\n Launcher for TAO\n\n optional arguments:\n -h, --help show this help message and exit\n\n tasks:\n {list,stop,info,augment,bpnet,classification,detectnet_v2,dssd,emotionnet,faster_rcnn,fpenet,gazenet,gesturenet,heartratenet\n ,intent_slot_classification,lprnet,mask_rcnn,punctuation_and_capitalization,question_answering,retinanet,speech_to_text,\n ssd,text_classification,converter,token_classification,unet,yolo_v3,yolo_v4,yolo_v4_tiny} \n ```\n\n Note that under tasks you can see all the launcher-invokable tasks. The following are the\n specific tasks that help with handling the launched commands using the TAO Launcher:\n\n * list\n * stop\n * info\n\n >\n > When installing the TAO Toolkit Launcher to your host machine's native python3 as opposed to the recommended route of using virtual \n > environment, you may get an error saying that `tao` binary wasn't found. This is because the path to your `tao` binary\n > installed by pip wasn't added to the `PATH` environment variable in your local machine. In this case, please run the\n > following command:\n >\n >```sh\n >export PATH=$PATH:~/.local/bin\n >```\n\n## Running the TAO Toolkit\n\nInformation about the TAO Launcher CLI and details on using it to run TAO supported tasks are\ncaptured in the [TAO Toolkit Launcher](https://docs.nvidia.com/tao/tao-toolkit/text/tao_launcher.html#tao-toolkit-launcher)\nsection of the [TAO Toolkit User Guide](https://docs.nvidia.com/tao/tao-toolkit).\n",
"bugtrack_url": null,
"license": "NVIDIA Proprietary Software",
"summary": "NVIDIA's Launcher for TAO Toolkit.",
"version": "5.3.0",
"project_urls": null,
"split_keywords": [
"nvidia",
"tao",
"launcher"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "e98af77cbc5e08f1229b7607b1cd5c9e64afbf9661230b6a52574df315704d95",
"md5": "80090b5429c1a79593f52f75fdfe97b9",
"sha256": "c8034a8ed65a239abad59c82554bd5a97438a6218192eaca44be945412326e72"
},
"downloads": -1,
"filename": "nvidia_tao-5.3.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "80090b5429c1a79593f52f75fdfe97b9",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.6",
"size": 35643,
"upload_time": "2024-03-14T18:39:35",
"upload_time_iso_8601": "2024-03-14T18:39:35.301685Z",
"url": "https://files.pythonhosted.org/packages/e9/8a/f77cbc5e08f1229b7607b1cd5c9e64afbf9661230b6a52574df315704d95/nvidia_tao-5.3.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-03-14 18:39:35",
"github": false,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"lcname": "nvidia-tao"
}
JSON