# Nendo Plugin Musicgen
<br>
<p align="left">
<img src="https://okio.ai/docs/assets/nendo_core_logo.png" width="350" alt="nendo core">
</p>
<br>
<p align="left">
<a href="https://okio.ai" target="_blank">
<img src="https://img.shields.io/website/https/okio.ai" alt="Website">
</a>
<a href="https://twitter.com/okio_ai" target="_blank">
<img src="https://img.shields.io/twitter/url/https/twitter.com/okio_ai.svg?style=social&label=Follow%20%40okio_ai" alt="Twitter">
</a>
<a href="https://discord.gg/gaZMZKzScj" target="_blank">
<img src="https://dcbadge.vercel.app/api/server/XpkUsjwXTp?compact=true&style=flat" alt="Discord">
</a>
</p>
---
MusicGen: A state-of-the-art controllable text-to-music model (by [Meta Research](https://github.com/facebookresearch/audiocraft))
## Features
- Generate conditional and unconditional music
- Generate outpaintings from a prompt and a `NendoTrack`
- Use a `NendoTrack` as melody conditioning to generate music
- Use custom finetuned musicgen models
## Community Finetunes 🔥
For a list of community finetunes check out [`community_finetunes.json`](docs/community_finetunes.json).
If you want to contribute one to the list, open a PR
or contact us via [Twitter](https://twitter.com/okio_ai)
or [Discord](https://discord.gg/gaZMZKzScj)!
## Requirements
Since we depend on `audiocraft`, please make sure that you fulfill their requirements.
You need Pytorch 2.0.0 or higher, which can be installed via
`pip install "torch>=2.0"`
> Note: On Mac OSX, the instructions for installing pytorch differ. Please refer to the [pytorch installation instructions](https://pytorch.org/get-started/locally/). For all other problems please refer to the [audiocraft repository](https://github.com/facebookresearch/audiocraft/).
To run the plugin you also need to install `audiocraft` by Meta AI Research, run:
`pip install git+https://github.com/facebookresearch/audiocraft`
## Installation
1. [Install Nendo](https://github.com/okio-ai/nendo#installation)
2. `pip install nendo-plugin-musicgen`
## Usage
Take a look at a basic usage example below.
For more detailed information, please refer to the [documentation](https://okio.ai/docs/plugins).
For more advanced examples, check out the examples folder.
or try it in colab:
<a target="_blank" href="https://colab.research.google.com/drive/1krbzz1OqwCXcLWm5JUIa-otas4TeKZCt?usp=sharing">
<img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/>
</a>
```python
from nendo import Nendo, NendoConfig
nd = Nendo(config=NendoConfig(plugins=["nendo_plugin_musicgen"]))
# load track
track = nd.library.add_track(file_path='/path/to/track.mp3')
# run musicgen with custom model
generated_collection = nd.plugins.musicgen(
track=track,
n_samples=5,
prompt="janelle monae, rnb, funky, fast, futuristic",
bpm=116,
key="C",
scale="Major",
duration=30,
conditioning_length=10
)
generated_collection[0].play()
```
## Contributing
Visit our docs to learn all about how to contribute to Nendo: [Contributing](https://okio.ai/docs/contributing/)
## License
Nendo: MIT License
AudioCraft: MIT License
Pretrained models: The weights are released under the CC-BY-NC 4.0 license
Raw data
{
"_id": null,
"home_page": "https://okio.ai",
"name": "nendo-plugin-musicgen",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.8,<3.11",
"maintainer_email": "",
"keywords": "Nendo,Plugin,AI,Machine Learning,Audio,Generative,Music,Audio Production,Audio Generation",
"author": "Aaron Abebe",
"author_email": "aaron@okio.ai",
"download_url": "https://files.pythonhosted.org/packages/db/ff/3634e9c533007b45d78f05423af26040dd4c6d458236fdb868b814cdd919/nendo_plugin_musicgen-0.1.6.tar.gz",
"platform": null,
"description": "# Nendo Plugin Musicgen \n\n<br>\n<p align=\"left\">\n <img src=\"https://okio.ai/docs/assets/nendo_core_logo.png\" width=\"350\" alt=\"nendo core\">\n</p>\n<br>\n\n<p align=\"left\">\n<a href=\"https://okio.ai\" target=\"_blank\">\n <img src=\"https://img.shields.io/website/https/okio.ai\" alt=\"Website\">\n</a>\n<a href=\"https://twitter.com/okio_ai\" target=\"_blank\">\n <img src=\"https://img.shields.io/twitter/url/https/twitter.com/okio_ai.svg?style=social&label=Follow%20%40okio_ai\" alt=\"Twitter\">\n</a>\n<a href=\"https://discord.gg/gaZMZKzScj\" target=\"_blank\">\n <img src=\"https://dcbadge.vercel.app/api/server/XpkUsjwXTp?compact=true&style=flat\" alt=\"Discord\">\n</a>\n</p>\n\n---\n\nMusicGen: A state-of-the-art controllable text-to-music model (by [Meta Research](https://github.com/facebookresearch/audiocraft))\n\n## Features\n\n- Generate conditional and unconditional music\n- Generate outpaintings from a prompt and a `NendoTrack`\n- Use a `NendoTrack` as melody conditioning to generate music\n- Use custom finetuned musicgen models\n\n## Community Finetunes \ud83d\udd25\n\nFor a list of community finetunes check out [`community_finetunes.json`](docs/community_finetunes.json).\nIf you want to contribute one to the list, open a PR \nor contact us via [Twitter](https://twitter.com/okio_ai) \nor [Discord](https://discord.gg/gaZMZKzScj)!\n\n## Requirements\n\nSince we depend on `audiocraft`, please make sure that you fulfill their requirements. \nYou need Pytorch 2.0.0 or higher, which can be installed via\n\n`pip install \"torch>=2.0\"`\n\n> Note: On Mac OSX, the instructions for installing pytorch differ. Please refer to the [pytorch installation instructions](https://pytorch.org/get-started/locally/). For all other problems please refer to the [audiocraft repository](https://github.com/facebookresearch/audiocraft/).\n\nTo run the plugin you also need to install `audiocraft` by Meta AI Research, run:\n\n`pip install git+https://github.com/facebookresearch/audiocraft`\n\n## Installation\n\n1. [Install Nendo](https://github.com/okio-ai/nendo#installation)\n2. `pip install nendo-plugin-musicgen`\n\n## Usage\n\nTake a look at a basic usage example below. \nFor more detailed information, please refer to the [documentation](https://okio.ai/docs/plugins).\n\nFor more advanced examples, check out the examples folder.\nor try it in colab:\n\n<a target=\"_blank\" href=\"https://colab.research.google.com/drive/1krbzz1OqwCXcLWm5JUIa-otas4TeKZCt?usp=sharing\">\n <img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/>\n</a>\n\n\n```python\nfrom nendo import Nendo, NendoConfig\n\nnd = Nendo(config=NendoConfig(plugins=[\"nendo_plugin_musicgen\"]))\n\n# load track\ntrack = nd.library.add_track(file_path='/path/to/track.mp3')\n\n# run musicgen with custom model\ngenerated_collection = nd.plugins.musicgen(\n track=track,\n n_samples=5,\n prompt=\"janelle monae, rnb, funky, fast, futuristic\",\n bpm=116,\n key=\"C\",\n scale=\"Major\",\n duration=30,\n conditioning_length=10\n)\ngenerated_collection[0].play()\n```\n\n## Contributing\n\nVisit our docs to learn all about how to contribute to Nendo: [Contributing](https://okio.ai/docs/contributing/)\n\n\n## License \n\nNendo: MIT License\n\nAudioCraft: MIT License\n\nPretrained models: The weights are released under the CC-BY-NC 4.0 license\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "Nendo MusicGen plugin: A state-of-the-art controllable text-to-music model (by Meta Research)",
"version": "0.1.6",
"project_urls": {
"Homepage": "https://okio.ai",
"Repository": "https://github.com/okio-ai/nendo_plugin_musicgen"
},
"split_keywords": [
"nendo",
"plugin",
"ai",
"machine learning",
"audio",
"generative",
"music",
"audio production",
"audio generation"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "d29963fe47df195263450ae248c550cc81a4a4eec542d77a5ddb62670ca6718a",
"md5": "617a44bce76443af3202e885209ed226",
"sha256": "8d1ada075f8be8173b4aa090b0374e9f34502abea0cbdfc33f83f8a6e494fbef"
},
"downloads": -1,
"filename": "nendo_plugin_musicgen-0.1.6-py3-none-any.whl",
"has_sig": false,
"md5_digest": "617a44bce76443af3202e885209ed226",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8,<3.11",
"size": 10880,
"upload_time": "2024-03-19T17:11:31",
"upload_time_iso_8601": "2024-03-19T17:11:31.048069Z",
"url": "https://files.pythonhosted.org/packages/d2/99/63fe47df195263450ae248c550cc81a4a4eec542d77a5ddb62670ca6718a/nendo_plugin_musicgen-0.1.6-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "dbff3634e9c533007b45d78f05423af26040dd4c6d458236fdb868b814cdd919",
"md5": "616cdd9abc9330ca9487f8912f8a7eef",
"sha256": "1fbf39cddfc5388f8723c2a11e2faafdb4db8d8217457f09c78870c2cabc4439"
},
"downloads": -1,
"filename": "nendo_plugin_musicgen-0.1.6.tar.gz",
"has_sig": false,
"md5_digest": "616cdd9abc9330ca9487f8912f8a7eef",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8,<3.11",
"size": 11739,
"upload_time": "2024-03-19T17:14:14",
"upload_time_iso_8601": "2024-03-19T17:14:14.346478Z",
"url": "https://files.pythonhosted.org/packages/db/ff/3634e9c533007b45d78f05423af26040dd4c6d458236fdb868b814cdd919/nendo_plugin_musicgen-0.1.6.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-03-19 17:14:14",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "okio-ai",
"github_project": "nendo_plugin_musicgen",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "nendo-plugin-musicgen"
}
JSON
