# Nendo Plugin Embed CLAP
<br>
<p align="left">
<img src="https://okio.ai/docs/assets/nendo_core_logo.png" width="350" alt="nendo core">
</p>
<br>
<p align="left">
<a href="https://okio.ai" target="_blank">
<img src="https://img.shields.io/website/https/okio.ai" alt="Website">
</a>
<a href="https://twitter.com/okio_ai" target="_blank">
<img src="https://img.shields.io/twitter/url/https/twitter.com/okio_ai.svg?style=social&label=Follow%20%40okio_ai" alt="Twitter">
</a>
<a href="https://discord.gg/gaZMZKzScj" target="_blank">
<img src="https://dcbadge.vercel.app/api/server/XpkUsjwXTp?compact=true&style=flat" alt="Discord">
</a>
</p>
---
A plugin to create joint embeddings from text and audio using CLAP by LAION.
## Features
- Create joint embeddings from text and audio
- Use the embeddings in combination with nendo's vector search functionality
## Requirements
Please make sure you have the correct version of Pytorch installed.
Go to [pytorch.org](https://pytorch.org/get-started/locally/) and select your OS,
package manager and CUDA version to get the correct installation command.
## Installation
1. [Install Nendo](https://github.com/okio-ai/nendo#installation)
2. `pip install nendo-plugin-embed-clap`
## Usage
Take a look at a basic usage example below.
For more detailed information, please refer to the [documentation](https://okio.ai/docs/plugins).
```pycon
>>> from nendo import Nendo
>>> nd = Nendo(plugins=["nendo_plugin_embed_clap"])
>>> track = nd.library.add_track(file_path="path/to/file.mp3")
>>> embedding = nd.plugins.embed_clap(track=track)
```
## Contributing
Visit our docs to learn all about how to contribute to Nendo: [Contributing](https://okio.ai/docs/contributing/)
## License
Nendo: MIT License
Pretrained models: The weights are released by LAION under the Apache 2.0 license.
Raw data
{
"_id": null,
"home_page": "https://okio.ai",
"name": "nendo-plugin-embed-clap",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.8,<3.11",
"maintainer_email": "",
"keywords": "AI,generative,music,okio,nendo,music production,music generation,music information retrieval,MIR,music analysis,song analysis",
"author": "Aaron Abebe",
"author_email": "aaron@okio.ai",
"download_url": "https://files.pythonhosted.org/packages/a0/4a/94a476b3de1465982a7a993b794bdd38e7aef352788490a13d1c836194c2/nendo_plugin_embed_clap-0.1.0.tar.gz",
"platform": null,
"description": "# Nendo Plugin Embed CLAP\n\n<br>\n<p align=\"left\">\n <img src=\"https://okio.ai/docs/assets/nendo_core_logo.png\" width=\"350\" alt=\"nendo core\">\n</p>\n<br>\n\n<p align=\"left\">\n<a href=\"https://okio.ai\" target=\"_blank\">\n <img src=\"https://img.shields.io/website/https/okio.ai\" alt=\"Website\">\n</a>\n<a href=\"https://twitter.com/okio_ai\" target=\"_blank\">\n <img src=\"https://img.shields.io/twitter/url/https/twitter.com/okio_ai.svg?style=social&label=Follow%20%40okio_ai\" alt=\"Twitter\">\n</a>\n<a href=\"https://discord.gg/gaZMZKzScj\" target=\"_blank\">\n <img src=\"https://dcbadge.vercel.app/api/server/XpkUsjwXTp?compact=true&style=flat\" alt=\"Discord\">\n</a>\n</p>\n\n---\n\nA plugin to create joint embeddings from text and audio using CLAP by LAION.\n\n## Features \n\n- Create joint embeddings from text and audio\n- Use the embeddings in combination with nendo's vector search functionality\n\n## Requirements\n\nPlease make sure you have the correct version of Pytorch installed. \nGo to [pytorch.org](https://pytorch.org/get-started/locally/) and select your OS, \npackage manager and CUDA version to get the correct installation command.\n\n\n## Installation\n\n1. [Install Nendo](https://github.com/okio-ai/nendo#installation)\n2. `pip install nendo-plugin-embed-clap`\n\n## Usage\n\nTake a look at a basic usage example below.\nFor more detailed information, please refer to the [documentation](https://okio.ai/docs/plugins).\n\n```pycon\n>>> from nendo import Nendo\n>>> nd = Nendo(plugins=[\"nendo_plugin_embed_clap\"])\n>>> track = nd.library.add_track(file_path=\"path/to/file.mp3\")\n\n>>> embedding = nd.plugins.embed_clap(track=track)\n```\n\n## Contributing\n\nVisit our docs to learn all about how to contribute to Nendo: [Contributing](https://okio.ai/docs/contributing/)\n\n\n## License\n\nNendo: MIT License\n\nPretrained models: The weights are released by LAION under the Apache 2.0 license.\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "A plugin to create joint text and audio embeddings using CLAP.",
"version": "0.1.0",
"project_urls": {
"Homepage": "https://okio.ai",
"Repository": "https://github.com/okio-ai/nendo_plugin_embed_clap"
},
"split_keywords": [
"ai",
"generative",
"music",
"okio",
"nendo",
"music production",
"music generation",
"music information retrieval",
"mir",
"music analysis",
"song analysis"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "353a99310bfa81394f12802981e62f9b179165e0aec8b8d85f1778704ddd3b62",
"md5": "054931b3cdeca3d17a11a1cc3c0aeac1",
"sha256": "4c3c38901b9083ebd620380a184740f852392383beef7fce746f1fb3706801b7"
},
"downloads": -1,
"filename": "nendo_plugin_embed_clap-0.1.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "054931b3cdeca3d17a11a1cc3c0aeac1",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8,<3.11",
"size": 4475,
"upload_time": "2024-02-21T10:33:55",
"upload_time_iso_8601": "2024-02-21T10:33:55.271312Z",
"url": "https://files.pythonhosted.org/packages/35/3a/99310bfa81394f12802981e62f9b179165e0aec8b8d85f1778704ddd3b62/nendo_plugin_embed_clap-0.1.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "a04a94a476b3de1465982a7a993b794bdd38e7aef352788490a13d1c836194c2",
"md5": "4013dc4e503da7d3021bdf4612d940cf",
"sha256": "1a76fa8c1ec5ed635bac9d53daba5068055b162c6427fa51893a8cc500b66db9"
},
"downloads": -1,
"filename": "nendo_plugin_embed_clap-0.1.0.tar.gz",
"has_sig": false,
"md5_digest": "4013dc4e503da7d3021bdf4612d940cf",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8,<3.11",
"size": 4611,
"upload_time": "2024-02-21T10:33:57",
"upload_time_iso_8601": "2024-02-21T10:33:57.156727Z",
"url": "https://files.pythonhosted.org/packages/a0/4a/94a476b3de1465982a7a993b794bdd38e7aef352788490a13d1c836194c2/nendo_plugin_embed_clap-0.1.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-02-21 10:33:57",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "okio-ai",
"github_project": "nendo_plugin_embed_clap",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "nendo-plugin-embed-clap"
}
JSON
