# jetson-examples
<div align="">
<img alt="jetson" width="1200px" src="https://files.seeedstudio.com/wiki/reComputer-Jetson/jetson-examples/Jetson1200x300.png">
</dev>
[](https://discord.gg/5BQCkty7vN)
This repository provides examples for running AI models and applications on [NVIDIA Jetson devices](https://www.seeedstudio.com/reComputer-J4012-p-5586.html) with a single command.
This repo builds upon the work of the [jetson-containers](https://github.com/dusty-nv/jetson-containers), [ultralytics](https://github.com/ultralytics/ultralytics) and other excellent projects.
## Features
- 🚀 **Easy Deployment:** Deploy state-of-the-art AI models on Jetson devices in one line.
- 🔄 **Versatile Examples:** Supports text generation, image generation, computer vision and so on.
- ⚡ **Optimized for Jetson:** Leverages Nvidia Jetson hardware for efficient performance.
## Install
To install the package, run:
```sh
pip3 install jetson-examples
```
> Notes:
> - Check [here](./docs/install.md) for more installation methods
> - To upgrade to the latest version, use: `pip3 install jetson-examples --upgrade`.
## Quickstart
To run and chat with [LLaVA](https://www.jetson-ai-lab.com/tutorial_llava.html), execute:
```sh
reComputer run llava
```
<div align="center">
<img alt="jetson" width="1200px" src="./docs/assets/llava.png">
</div>
## Example list
Here are some examples that can be run:
| Example | Type | Model/Data Size | Docker Image Size | Command |
| ------------------------------------------------ | ------------------------ | --------------- | ---------- | --------------------------------------- |
| 🆕 [Ultralytics-yolo](/reComputer/scripts/ultralytics-yolo/README.md) | Computer Vision | | 15.4GB | `reComputer run ultralytics-yolo` |
| 🆕 [Deep-Live-Cam](/reComputer/scripts/deep-live-cam/README.md) | Face-swapping | 0.5GB | 20GB | `reComputer run deep-live-cam` |
| 🆕 llama-factory | Finetune LLM | | 13.5GB | `reComputer run llama-factory` |
| 🆕 [ComfyUI](/reComputer/scripts/comfyui/README.md) |Computer Vision | | 20GB | `reComputer run comfyui` |
| [Depth-Anything-V2](/reComputer/scripts/depth-anything-v2/README.md) |Computer Vision | | 15GB | `reComputer run depth-anything-v2` |
| [Depth-Anything](/reComputer/scripts/depth-anything/README.md) |Computer Vision | | 12.9GB | `reComputer run depth-anything` |
| [Yolov10](/reComputer/scripts/yolov10/README.md) | Computer Vision | 7.2M | 5.74 GB | `reComputer run yolov10` |
| Llama3 | Text (LLM) | 4.9GB | 10.5GB | `reComputer run llama3` |
| [Ollama](https://github.com/ollama/ollama) | Inference Server | * | 10.5GB | `reComputer run ollama` |
| LLaVA | Text + Vision (VLM) | 13GB | 14.4GB | `reComputer run llava` |
| Live LLaVA | Text + Vision (VLM) | 13GB | 20.3GB | `reComputer run live-llava` |
| Stable-diffusion-webui | Image Generation | 3.97G | 7.3GB | `reComputer run stable-diffusion-webui` |
| Nanoowl | Vision Transformers(ViT) | 613MB | 15.1GB | `reComputer run nanoowl` |
| [Nanodb](../reComputer/scripts/nanodb/readme.md) | Vector Database | 76GB | 7.0GB | `reComputer run nanodb` |
| Whisper | Audio | 1.5GB | 6.0GB | `reComputer run whisper` |
| [Yolov8-rail-inspection](/reComputer/scripts/yolov8-rail-inspection/readme.md) | Computer Vision | 6M | 13.8GB | `reComputer run yolov8-rail-inspection` |
| [TensorFlow MoveNet Thunder](/reComputer/scripts/MoveNet-Thunder/readme.md) |Computer Vision | | 7.7GB | `reComputer run MoveNet-Thunder` |
| [Parler-TTS mini: expresso](/reComputer/scripts/parler-tts/readme.md) | Audio | | 6.9GB | `reComputer run parler-tts` |
> Note: You should have enough space to run example, like `LLaVA`, at least `27.4GB` totally
More Examples can be found [examples.md](./docs/examples.md)
## Calling Contributors Join Us!
### How to work with us?
Want to add your own example? Check out the [development guide](./docs/develop.md).
We welcome contributions to improve jetson-examples! If you have an example you'd like to share, please submit a pull request. Thank you to all of our contributors! 🙏
This open call is listed in our [Contributor Project](https://github.com/orgs/Seeed-Studio/projects/6/views/1?filterQuery=jetson&pane=issue&itemId=64891723). If this is your first time joining us, [click here](https://github.com/orgs/Seeed-Studio/projects/6/views/1?pane=issue&itemId=30957479) to learn how the project works. We follow the steps with:
- Assignments: We offer a variety of assignments to enhance wiki content, each with a detailed description.
- Submission: Contributors can submit their content via a Pull Request after completing the assignments.
- Review: Maintainers will merge the submission and record the contributions.
**Contributors receive a $250 cash bonus as a token of appreciation.**
For any questions or further information, feel free to reach out via the GitHub issues page or contact edgeai@seeed.cc
## TODO List
- [ ] detect host environment and install what we need
- [ ] all type jetson support checking list
- [ ] try jetpack 6.0
- [ ] check disk space enough or not before run
- [ ] allow to setting some configs, such as `BASE_PATH`
- [ ] support jetson-containers update
- [ ] better table to show example's difference
## License
This project is licensed under the MIT License.
## Resources
- https://github.com/dusty-nv/jetson-containers
- https://www.jetson-ai-lab.com/
- https://www.ultralytics.com/
Raw data
{
"_id": null,
"home_page": null,
"name": "jetson-examples",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": null,
"keywords": "llama, llava, gpt, llm, nvidia, jetson, multimodal, jetson orin",
"author": null,
"author_email": "luozhixin <zhixin.luo@seeed.cc>",
"download_url": "https://files.pythonhosted.org/packages/2b/50/33cd84b1c35354927eded99b69f9999a6149eb9f260c63b5877b104bece0/jetson_examples-0.2.2.tar.gz",
"platform": null,
"description": "# jetson-examples\n\n<div align=\"\">\n <img alt=\"jetson\" width=\"1200px\" src=\"https://files.seeedstudio.com/wiki/reComputer-Jetson/jetson-examples/Jetson1200x300.png\">\n</dev>\n\n[](https://discord.gg/5BQCkty7vN)\n\nThis repository provides examples for running AI models and applications on [NVIDIA Jetson devices](https://www.seeedstudio.com/reComputer-J4012-p-5586.html) with a single command.\n\nThis repo builds upon the work of the [jetson-containers](https://github.com/dusty-nv/jetson-containers), [ultralytics](https://github.com/ultralytics/ultralytics) and other excellent projects. \n\n## Features\n- \ud83d\ude80 **Easy Deployment:** Deploy state-of-the-art AI models on Jetson devices in one line.\n- \ud83d\udd04 **Versatile Examples:** Supports text generation, image generation, computer vision and so on.\n- \u26a1 **Optimized for Jetson:** Leverages Nvidia Jetson hardware for efficient performance.\n\n\n## Install\nTo install the package, run:\n\n```sh\npip3 install jetson-examples\n```\n\n> Notes: \n> - Check [here](./docs/install.md) for more installation methods \n> - To upgrade to the latest version, use: `pip3 install jetson-examples --upgrade`.\n\n\n\n## Quickstart\nTo run and chat with [LLaVA](https://www.jetson-ai-lab.com/tutorial_llava.html), execute:\n\n```sh\nreComputer run llava\n```\n<div align=\"center\">\n <img alt=\"jetson\" width=\"1200px\" src=\"./docs/assets/llava.png\">\n</div>\n\n## Example list\n\nHere are some examples that can be run:\n\n| Example | Type | Model/Data Size | Docker Image Size | Command |\n| ------------------------------------------------ | ------------------------ | --------------- | ---------- | --------------------------------------- |\n| \ud83c\udd95 [Ultralytics-yolo](/reComputer/scripts/ultralytics-yolo/README.md) | Computer Vision | | 15.4GB | `reComputer run ultralytics-yolo` |\n| \ud83c\udd95 [Deep-Live-Cam](/reComputer/scripts/deep-live-cam/README.md) | Face-swapping | 0.5GB | 20GB | `reComputer run deep-live-cam` |\n| \ud83c\udd95 llama-factory | Finetune LLM | | 13.5GB | `reComputer run llama-factory` |\n| \ud83c\udd95 [ComfyUI](/reComputer/scripts/comfyui/README.md) |Computer Vision | | 20GB | `reComputer run comfyui` |\n| [Depth-Anything-V2](/reComputer/scripts/depth-anything-v2/README.md) |Computer Vision | | 15GB | `reComputer run depth-anything-v2` |\n| [Depth-Anything](/reComputer/scripts/depth-anything/README.md) |Computer Vision | | 12.9GB | `reComputer run depth-anything` |\n| [Yolov10](/reComputer/scripts/yolov10/README.md) | Computer Vision | 7.2M | 5.74 GB | `reComputer run yolov10` |\n| Llama3 | Text (LLM) | 4.9GB | 10.5GB | `reComputer run llama3` |\n| [Ollama](https://github.com/ollama/ollama) | Inference Server | * | 10.5GB | `reComputer run ollama` |\n| LLaVA | Text + Vision (VLM) | 13GB | 14.4GB | `reComputer run llava` |\n| Live LLaVA | Text + Vision (VLM) | 13GB | 20.3GB | `reComputer run live-llava` |\n| Stable-diffusion-webui | Image Generation | 3.97G | 7.3GB | `reComputer run stable-diffusion-webui` |\n| Nanoowl | Vision Transformers(ViT) | 613MB | 15.1GB | `reComputer run nanoowl` |\n| [Nanodb](../reComputer/scripts/nanodb/readme.md) | Vector Database | 76GB | 7.0GB | `reComputer run nanodb` |\n| Whisper | Audio | 1.5GB | 6.0GB | `reComputer run whisper` |\n| [Yolov8-rail-inspection](/reComputer/scripts/yolov8-rail-inspection/readme.md) | Computer Vision | 6M | 13.8GB | `reComputer run yolov8-rail-inspection` |\n| [TensorFlow MoveNet Thunder](/reComputer/scripts/MoveNet-Thunder/readme.md) |Computer Vision | | 7.7GB | `reComputer run MoveNet-Thunder` |\n| [Parler-TTS mini: expresso](/reComputer/scripts/parler-tts/readme.md) | Audio | | 6.9GB | `reComputer run parler-tts` |\n\n\n> Note: You should have enough space to run example, like `LLaVA`, at least `27.4GB` totally\n\nMore Examples can be found [examples.md](./docs/examples.md)\n\n## Calling Contributors Join Us!\n\n### How to work with us? \n\nWant to add your own example? Check out the [development guide](./docs/develop.md).\n\nWe welcome contributions to improve jetson-examples! If you have an example you'd like to share, please submit a pull request. Thank you to all of our contributors! \ud83d\ude4f \n\nThis open call is listed in our [Contributor Project](https://github.com/orgs/Seeed-Studio/projects/6/views/1?filterQuery=jetson&pane=issue&itemId=64891723). If this is your first time joining us, [click here](https://github.com/orgs/Seeed-Studio/projects/6/views/1?pane=issue&itemId=30957479) to learn how the project works. We follow the steps with: \n\n\n- Assignments: We offer a variety of assignments to enhance wiki content, each with a detailed description.\n- Submission: Contributors can submit their content via a Pull Request after completing the assignments.\n- Review: Maintainers will merge the submission and record the contributions.\n\n**Contributors receive a $250 cash bonus as a token of appreciation.**\n\nFor any questions or further information, feel free to reach out via the GitHub issues page or contact edgeai@seeed.cc \n\n\n\n## TODO List\n\n- [ ] detect host environment and install what we need\n- [ ] all type jetson support checking list\n- [ ] try jetpack 6.0\n- [ ] check disk space enough or not before run\n- [ ] allow to setting some configs, such as `BASE_PATH`\n- [ ] support jetson-containers update\n- [ ] better table to show example's difference\n\n\n\n## License\nThis project is licensed under the MIT License. \n\n## Resources\n- https://github.com/dusty-nv/jetson-containers\n- https://www.jetson-ai-lab.com/\n- https://www.ultralytics.com/\n\n",
"bugtrack_url": null,
"license": null,
"summary": "Running Gen AI models and applications on NVIDIA Jetson devices with one-line command",
"version": "0.2.2",
"project_urls": {
"Homepage": "https://github.com/Seeed-Projects/jetson-examples",
"Issues": "https://github.com/Seeed-Projects/jetson-examples/issues"
},
"split_keywords": [
"llama",
" llava",
" gpt",
" llm",
" nvidia",
" jetson",
" multimodal",
" jetson orin"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "f4f42a943045a40d99f18ba2b8a24d67eda2c1848164df1c71ec018ee8a45d59",
"md5": "afe26aee14219e1aac2baeb214bdcf3a",
"sha256": "03cca1512108f59dffcb3bbe068401ebc5087516f5fcb4fc406e2f18eb22bd3d"
},
"downloads": -1,
"filename": "jetson_examples-0.2.2-py3-none-any.whl",
"has_sig": false,
"md5_digest": "afe26aee14219e1aac2baeb214bdcf3a",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 83872,
"upload_time": "2024-10-12T03:44:09",
"upload_time_iso_8601": "2024-10-12T03:44:09.304677Z",
"url": "https://files.pythonhosted.org/packages/f4/f4/2a943045a40d99f18ba2b8a24d67eda2c1848164df1c71ec018ee8a45d59/jetson_examples-0.2.2-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "2b5033cd84b1c35354927eded99b69f9999a6149eb9f260c63b5877b104bece0",
"md5": "8a4957756dd22b254b54bf2eef982758",
"sha256": "a52de3c6f012a5f11aa18fdcdfdc5c7fc2136ace2c4acc6ef98f49a07572aa01"
},
"downloads": -1,
"filename": "jetson_examples-0.2.2.tar.gz",
"has_sig": false,
"md5_digest": "8a4957756dd22b254b54bf2eef982758",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 39497,
"upload_time": "2024-10-12T03:44:11",
"upload_time_iso_8601": "2024-10-12T03:44:11.009253Z",
"url": "https://files.pythonhosted.org/packages/2b/50/33cd84b1c35354927eded99b69f9999a6149eb9f260c63b5877b104bece0/jetson_examples-0.2.2.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-10-12 03:44:11",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "Seeed-Projects",
"github_project": "jetson-examples",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "jetson-examples"
}
JSON
