# aiSFX
Representation Learning for the Automatic Indexing of Sound Effects Libraries (ISMIR 2022): Deep audio embeddings pre-trained on UCS & Non-UCS-compliant datasets.
This work was inspired by the creation of the [Universal Category System (UCS)](https://universalcategorysystem.com), an industry-proposed public domain initiative initialized by [Tim Nielsen](https://www.imdb.com/name/nm0631004), [Justin Drury](https://twitter.com/jaydee2190), [Kai Paquin](https://www.imdb.com/name/nm5226068), and others. First launching in the fall of 2020, UCS offers a standardized framework for sound effects library metadata designed by and for sound designers and editors.
# How To Use
Please refer to this package's [documentation](https://aisfx.readthedocs.io/en/latest/) for [**Installation Instructions**](https://aisfx.readthedocs.io/en/latest/installation.html) and [**Tutorials**](https://aisfx.readthedocs.io/en/latest/notebooks/tutorial.html) of how to extract embeddings.
# [Visualizations of UCS Classes](https://public.tableau.com/views/X-Sequential-CE_UCS/TRAIN-ProSoundEffectsPSE?:language=en-US&:display_count=n&:origin=viz_share_link)
Click the above to visualize coarse-level "Category" UCS classes in Pro Sound Effects (PSE), Soundly (SDLY), and UCS Mixed (UMIX).
# Cite This Work
Please cite the paper below if you use it in your work.
This paper has been accepted at the 23rd International Society for Music Information Retrieval Conference (ISMIR) in Bengaluru, India (December 04-08, 2022). To cite our work, please refer to the following.
[1] [Representation Learning for the Automatic Indexing of Sound Effects Libraries](https://zenodo.org/record/7316800#.ZAU5pezMLzd)
@inproceedings{ismir_aisfx,
title={Representation Learning for the Automatic Indexing of Sound Effects Libraries},
author={Ma, Alison Bernice and Lerch, Alexander},
booktitle={Proceedings of the 23rd International Society for Music Information Retrieval Conference (ISMIR)},
year={2022},
pages={866--875}
}
# Acknowledgements
We would like to thank those who provided the data required to conduct this research as well as those who took the time to share their insights and software licenses for tools regarding sound search, query, and retrieval.
[Universal Category System (UCS)](https://universalcategorysystem.com) • [Alex Lane](https://www.alex-lane.com) • [All You Can Eat Audio](https://allyoucaneataudio.com) • [Articulated Sounds](https://articulatedsounds.com) • [Audio Shade](https://audioshade.com) • [aXLSound](https://axlsound.com) • [Big Sound Bank](https://bigsoundbank.com) • [BaseHead](https://baseheadinc.com) • [Bonson](https://www.bonson.ca) • [BOOM Library](https://www.boomlibrary.com) • [Frick & Traa](https://www.frickandtraa.com) • [Hzandbits](https://www.hzandbits.com) • [InspectorJ](https://www.jshaw.co.uk/inspectorj) • [Kai Paquin](https://www.imdb.com/name/nm5226068) • [KEDR Audio](https://www.asoundeffect.com/sounddesigner/kedr-audio) • [Krotos Audio](https://www.krotosaudio.com) • [Nikola Simikic](https://www.imdb.com/name/nm4851270) • [Penguin Grenade](https://www.paulstoughton.com) • [Pro Sound Effects](https://www.prosoundeffects.com) • [Rick Allen Creative](https://www.rickallencreative.com) • [Sononym](https://www.sononym.net/) • [Sound Ideas](https://www.sound-ideas.com) • [Soundly](https://www.getsoundly.com) • [Soundminer](https://store.soundminer.com) • [Storyblocks](https://www.storyblocks.com) • [Tim Nielsen](https://www.imdb.com/name/nm0631004) • [Thomas Rex Beverly](https://thomasrexbeverly.com) • [ZapSplat](https://www.zapsplat.com)
# License: Pre-trained Model & Paper
This pre-trained model and paper [1] is made available under a Creative Commons Attribution 4.0 International License (CC BY 4.0).
Raw data
{
"_id": null,
"home_page": "",
"name": "aisfx",
"maintainer": "",
"docs_url": null,
"requires_python": "",
"maintainer_email": "",
"keywords": "audio,deep,embeddings,learning,machine,pytorch,representation,sound effects library,universal category system",
"author": "",
"author_email": "Alison Bernice Ma <ama67@gatech.edu>, Alexander Lerch <alexander.lerch@gatech.edu>",
"download_url": "https://files.pythonhosted.org/packages/f3/f9/1986170d9937f5f1cb2ae1b821a01fa5f42e8f0bbe640194fd7724a52d24/aisfx-0.1.2.tar.gz",
"platform": null,
"description": "# aiSFX\n\n\n\n Representation Learning for the Automatic Indexing of Sound Effects Libraries (ISMIR 2022): Deep audio embeddings pre-trained on UCS & Non-UCS-compliant datasets.\n\nThis work was inspired by the creation of the [Universal Category System (UCS)](https://universalcategorysystem.com), an industry-proposed public domain initiative initialized by [Tim Nielsen](https://www.imdb.com/name/nm0631004), [Justin Drury](https://twitter.com/jaydee2190), [Kai Paquin](https://www.imdb.com/name/nm5226068), and others. First launching in the fall of 2020, UCS offers a standardized framework for sound effects library metadata designed by and for sound designers and editors.\n\n# How To Use\n\nPlease refer to this package's [documentation](https://aisfx.readthedocs.io/en/latest/) for [**Installation Instructions**](https://aisfx.readthedocs.io/en/latest/installation.html) and [**Tutorials**](https://aisfx.readthedocs.io/en/latest/notebooks/tutorial.html) of how to extract embeddings.\n\n# [Visualizations of UCS Classes](https://public.tableau.com/views/X-Sequential-CE_UCS/TRAIN-ProSoundEffectsPSE?:language=en-US&:display_count=n&:origin=viz_share_link)\n\nClick the above to visualize coarse-level \"Category\" UCS classes in Pro Sound Effects (PSE), Soundly (SDLY), and UCS Mixed (UMIX).\n\n# Cite This Work\n\nPlease cite the paper below if you use it in your work.\n\nThis paper has been accepted at the 23rd International Society for Music Information Retrieval Conference (ISMIR) in Bengaluru, India (December 04-08, 2022). To cite our work, please refer to the following.\n\n[1] [Representation Learning for the Automatic Indexing of Sound Effects Libraries](https://zenodo.org/record/7316800#.ZAU5pezMLzd)\n\n @inproceedings{ismir_aisfx,\n title={Representation Learning for the Automatic Indexing of Sound Effects Libraries},\n author={Ma, Alison Bernice and Lerch, Alexander},\n booktitle={Proceedings of the 23rd International Society for Music Information Retrieval Conference (ISMIR)},\n year={2022},\n pages={866--875}\n }\n \n \n# Acknowledgements\nWe would like to thank those who provided the data required to conduct this research as well as those who took the time to share their insights and software licenses for tools regarding sound search, query, and retrieval.\n\n[Universal Category System (UCS)](https://universalcategorysystem.com) \u2022 [Alex Lane](https://www.alex-lane.com) \u2022 [All You Can Eat Audio](https://allyoucaneataudio.com) \u2022 [Articulated Sounds](https://articulatedsounds.com) \u2022\u00a0[Audio Shade](https://audioshade.com) \u2022 [aXLSound](https://axlsound.com) \u2022 [Big Sound Bank](https://bigsoundbank.com) \u2022 [BaseHead](https://baseheadinc.com) \u2022 [Bonson](https://www.bonson.ca) \u2022 [BOOM Library](https://www.boomlibrary.com) \u2022 [Frick & Traa](https://www.frickandtraa.com) \u2022 [Hzandbits](https://www.hzandbits.com) \u2022 [InspectorJ](https://www.jshaw.co.uk/inspectorj) \u2022 [Kai Paquin](https://www.imdb.com/name/nm5226068) \u2022 [KEDR Audio](https://www.asoundeffect.com/sounddesigner/kedr-audio) \u2022 [Krotos Audio](https://www.krotosaudio.com) \u2022 [Nikola Simikic](https://www.imdb.com/name/nm4851270) \u2022 [Penguin Grenade](https://www.paulstoughton.com) \u2022 [Pro Sound Effects](https://www.prosoundeffects.com) \u2022 [Rick Allen Creative](https://www.rickallencreative.com) \u2022 [Sononym](https://www.sononym.net/) \u2022 [Sound Ideas](https://www.sound-ideas.com) \u2022 [Soundly](https://www.getsoundly.com) \u2022 [Soundminer](https://store.soundminer.com) \u2022 [Storyblocks](https://www.storyblocks.com) \u2022 [Tim Nielsen](https://www.imdb.com/name/nm0631004) \u2022 [Thomas Rex Beverly](https://thomasrexbeverly.com) \u2022 [ZapSplat](https://www.zapsplat.com)\n\n# License: Pre-trained Model & Paper\n\nThis pre-trained model and paper [1] is made available under a Creative Commons Attribution 4.0 International License (CC BY 4.0).\n",
"bugtrack_url": null,
"license": "",
"summary": "Representation Learning for the Automatic Indexing of Sound Effects Libraries (ISMIR 2022): Deep audio embeddings pre-trained on UCS & Non-UCS-compliant datasets.",
"version": "0.1.2",
"project_urls": {
"Source": "https://github.com/alisonbma/aisfx",
"Tracker": "https://github.com/alisonbma/aisfx/issues"
},
"split_keywords": [
"audio",
"deep",
"embeddings",
"learning",
"machine",
"pytorch",
"representation",
"sound effects library",
"universal category system"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "fddb25d653f8beeae1277c77da6fbfbc8965ad599afd4218e901406d69cf5551",
"md5": "74d1e85462c0e051fdd1c03facbffef6",
"sha256": "bfe219950715af179e9a1653e7117cc1852baef267cd6596c42cad74afe1d194"
},
"downloads": -1,
"filename": "aisfx-0.1.2-py2.py3-none-any.whl",
"has_sig": false,
"md5_digest": "74d1e85462c0e051fdd1c03facbffef6",
"packagetype": "bdist_wheel",
"python_version": "py2.py3",
"requires_python": null,
"size": 23140952,
"upload_time": "2023-06-21T02:24:05",
"upload_time_iso_8601": "2023-06-21T02:24:05.828806Z",
"url": "https://files.pythonhosted.org/packages/fd/db/25d653f8beeae1277c77da6fbfbc8965ad599afd4218e901406d69cf5551/aisfx-0.1.2-py2.py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "f3f91986170d9937f5f1cb2ae1b821a01fa5f42e8f0bbe640194fd7724a52d24",
"md5": "f2f9be96c966e55a37394a1d2588cb04",
"sha256": "f1beb34ab0502e97a4dea18ea09e189abaf7fc6480b160cb3ddb73750827cc7d"
},
"downloads": -1,
"filename": "aisfx-0.1.2.tar.gz",
"has_sig": false,
"md5_digest": "f2f9be96c966e55a37394a1d2588cb04",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 23149361,
"upload_time": "2023-06-21T02:24:15",
"upload_time_iso_8601": "2023-06-21T02:24:15.571098Z",
"url": "https://files.pythonhosted.org/packages/f3/f9/1986170d9937f5f1cb2ae1b821a01fa5f42e8f0bbe640194fd7724a52d24/aisfx-0.1.2.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-06-21 02:24:15",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "alisonbma",
"github_project": "aisfx",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "aisfx"
}
JSON
