[](https://github.com/meinardmueller/synctoolbox/actions/workflows/test_conda.yml)
[](https://github.com/meinardmueller/synctoolbox/actions/workflows/test_pip.yml)
# Sync Toolbox
This repository contains a Python package called Sync Toolbox, which provides open-source reference implementations for full-fledged music synchronization pipelines and yields state-of-the-art alignment results for a wide range of Western music.
Using suitable feature representations and cost measures, the toolbox's core technology is based on dynamic time warping (DTW), which brings the feature sequences into temporal correspondence. To account for efficiency, robustness and, accuracy, our toolbox integrates and combines techniques such as [multiscale DTW (MsDTW)](https://www.audiolabs-erlangen.de/fau/professor/mueller/publications/2006_MuellerMattesKurth_MultiscaleAudioSynchronization_ISMIR.pdf), [memory-restricted MsDTW (MrMsDTW)](https://www.audiolabs-erlangen.de/fau/professor/mueller/publications/2016_PraetzlichDriedgerMueller_MrMsDTW_ICASSP.pdf), and [high-resolution music synchronization](https://www.audiolabs-erlangen.de/fau/professor/mueller/publications/2009_EwertMuellerGrosche_HighResAudioSync_ICASSP.pdf).
If you use the Sync Toolbox in your research, please consider the following references.
## References
Meinard Müller, Yigitcan Özer, Michael Krause, Thomas Prätzlich, and Jonathan Driedger. [Sync Toolbox: A Python Package for Efficient, Robust, and Accurate Music Synchronization.](https://joss.theoj.org/papers/10.21105/joss.03434) Journal of Open Source Software (JOSS), 6(64), 2021.
Meinard Müller, Henning Mattes, and Frank Kurth.
[An Efficient Multiscale Approach to Audio Synchronization](https://www.audiolabs-erlangen.de/fau/professor/mueller/publications/2006_MuellerMattesKurth_MultiscaleAudioSynchronization_ISMIR.pdf).
In Proceedings of the International Society for Music Information Retrieval Conference (ISMIR): 192–197, 2006.
Sebastian Ewert, Meinard Müller, and Peter Grosche.
[High Resolution Audio Synchronization Using Chroma Onset Features](https://www.audiolabs-erlangen.de/fau/professor/mueller/publications/2009_EwertMuellerGrosche_HighResAudioSync_ICASSP.pdf).
In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP): 1869–1872, 2009.
Thomas Prätzlich, Jonathan Driedger, and Meinard Müller
[Memory-Restricted Multiscale Dynamic Time Warping](https://www.audiolabs-erlangen.de/fau/professor/mueller/publications/2016_PraetzlichDriedgerMueller_MrMsDTW_ICASSP.pdf).
In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP): 569–573, 2016.
## Installing
If you just want to try our example notebooks, you can run them using Binder directly in your browser: [](https://notebooks.gesis.org/binder/v2/gh/meinardmueller/synctoolbox/master)
To install the Sync Toolbox locally, you can use the Python package manager pip:
```
pip install synctoolbox
```
We recommend to do this inside a conda or virtual environment (requiring at least Python 3.7). As an alternative, you may also create the environment ``synctoolbox`` as provided by the file ``environment.yml`` (which includes the synctoolbox package as well as the jupyter package to run the demo files):
```
conda env create -f environment.yml
```
**Note:** On some systems, you may see errors related with ``soundfile`` when calling some functions or executing our example notebooks. ``soundfile`` is a dependency of ``librosa``, which is used by the Sync Toolbox. In case of errors, you may have to install libsndfile using your package manager, e.g., ``sudo apt install libsndfile1``. Alternatively, you may create a conda environment, install ``librosa`` using conda and then install the Sync Toolbox with the pip command from above. See [here](https://github.com/librosa/librosa#hints-for-the-installation) for further information if you are experiencing these issues.
If you want to run the example notebooks locally, you **must** first install the Sync Toolbox to resolve all dependencies. Then, you can clone this repository using
```
git clone https://github.com/meinardmueller/synctoolbox.git
```
install Jupyter using
```
pip install jupyter
```
and then start the notebook server via
```
jupyter notebook
```
Finally, HTML exports of the example notebooks are provided under "[Releases](https://github.com/meinardmueller/synctoolbox/releases)".
## Usage
Fully worked examples for using the sync toolbox are provided in the accompanying Jupyter notebooks. In ``sync_audio_audio_simple.ipynb``, we show how to use the toolbox to synchronize two recordings of the same piece of music using standard chroma features. We also compare runtimes for standard DTW and MrMsDTW. In ``sync_audio_audio_full.ipynb``, we expand this example and demonstrate how to build a full synchronization pipeline that yields state-of-the-art results. Finally, ``sync_audio_score_full.ipynb`` shows a similar pipeline for synchronizing a music recording with the corresponding score.
There is also an API documentation for the Sync Toolbox:
https://meinardmueller.github.io/synctoolbox
## Contributing
We are happy for suggestions and contributions. We would be grateful for either directly contacting us via email (meinard.mueller@audiolabs-erlangen.de) or for creating an issue in our Github repository. Please do not submit a pull request without prior consultation with us.
## Tests
We provide automated tests for each feature and different variants of MrMsDTW. These ensure that the outputs match the ground truth matrices provided in the **tests/data** folder.
To execute the test script, you will need to install extra requirements for testing:
```
pip install 'synctoolbox[tests]'
pytest tests
```
## Licence
The code for this toolbox is published under an MIT licence. This does not apply to the data files. Schubert songs are taken from the [Schubert Winterreise Dataset](https://zenodo.org/record/4122060). The Chopin prelude example files are taken from the [FMP notebooks](https://www.audiolabs-erlangen.de/resources/MIR/FMP/C0/C0.html).
## Acknowledgements
The synctoolbox package builds on results, material, and insights that have been obtained in close collaboration with different people. We would like to express our gratitude to former and current students, collaborators, and colleagues who have influenced and supported us in creating this package, including Vlora Arifi-Müller, Michael Clausen, Sebastian Ewert, Christian Fremerey, and Frank Kurth. The main authors of Sync Toolbox are associated with the International Audio Laboratories Erlangen, which are a joint institution of the Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU) and Fraunhofer Institute for Integrated Circuits IIS. We also thank the German Research Foundation (DFG) for various research grants that allowed us for conducting fundamental research in music processing (in particular, MU 2686/7-2, DFG-MU 2686/14-1).
Raw data
{
"_id": null,
"home_page": "https://github.com/meinardmueller/synctoolbox",
"name": "synctoolbox",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.8, <4.0",
"maintainer_email": "",
"keywords": "audio music sound synchronization dtw mrmsdtw",
"author": "Meinard M\u00fcller, Yigitcan \u00d6zer, Michael Krause, Thomas Pr\u00e4tzlich and Jonathan Driedger",
"author_email": "meinard.mueller@audiolabs-erlangen.de",
"download_url": "https://files.pythonhosted.org/packages/02/c0/303742db542cc340fc2928f096f61d37cb64aaa6a87a3d15a0637a166926/synctoolbox-1.3.2.tar.gz",
"platform": null,
"description": "[](https://github.com/meinardmueller/synctoolbox/actions/workflows/test_conda.yml)\n[](https://github.com/meinardmueller/synctoolbox/actions/workflows/test_pip.yml)\n\n\n# Sync Toolbox\n\nThis repository contains a Python package called Sync Toolbox, which provides open-source reference implementations for full-fledged music synchronization pipelines and yields state-of-the-art alignment results for a wide range of Western music. \n\nUsing suitable feature representations and cost measures, the toolbox's core technology is based on dynamic time warping (DTW), which brings the feature sequences into temporal correspondence. To account for efficiency, robustness and, accuracy, our toolbox integrates and combines techniques such as [multiscale DTW (MsDTW)](https://www.audiolabs-erlangen.de/fau/professor/mueller/publications/2006_MuellerMattesKurth_MultiscaleAudioSynchronization_ISMIR.pdf), [memory-restricted MsDTW (MrMsDTW)](https://www.audiolabs-erlangen.de/fau/professor/mueller/publications/2016_PraetzlichDriedgerMueller_MrMsDTW_ICASSP.pdf), and [high-resolution music synchronization](https://www.audiolabs-erlangen.de/fau/professor/mueller/publications/2009_EwertMuellerGrosche_HighResAudioSync_ICASSP.pdf). \n\nIf you use the Sync Toolbox in your research, please consider the following references.\n\n## References\n\nMeinard M\u00fcller, Yigitcan \u00d6zer, Michael Krause, Thomas Pr\u00e4tzlich, and Jonathan Driedger. [Sync Toolbox: A Python Package for Efficient, Robust, and Accurate Music Synchronization.](https://joss.theoj.org/papers/10.21105/joss.03434) Journal of Open Source Software (JOSS), 6(64), 2021.\n\nMeinard M\u00fcller, Henning Mattes, and Frank Kurth.\n[An Efficient Multiscale Approach to Audio Synchronization](https://www.audiolabs-erlangen.de/fau/professor/mueller/publications/2006_MuellerMattesKurth_MultiscaleAudioSynchronization_ISMIR.pdf).\nIn Proceedings of the International Society for Music Information Retrieval Conference (ISMIR): 192\u2013197, 2006.\n\nSebastian Ewert, Meinard M\u00fcller, and Peter Grosche.\n[High Resolution Audio Synchronization Using Chroma Onset Features](https://www.audiolabs-erlangen.de/fau/professor/mueller/publications/2009_EwertMuellerGrosche_HighResAudioSync_ICASSP.pdf).\nIn Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP): 1869\u20131872, 2009.\n\nThomas Pr\u00e4tzlich, Jonathan Driedger, and Meinard M\u00fcller\n[Memory-Restricted Multiscale Dynamic Time Warping](https://www.audiolabs-erlangen.de/fau/professor/mueller/publications/2016_PraetzlichDriedgerMueller_MrMsDTW_ICASSP.pdf).\nIn Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP): 569\u2013573, 2016. \n\n## Installing\n\nIf you just want to try our example notebooks, you can run them using Binder directly in your browser: [](https://notebooks.gesis.org/binder/v2/gh/meinardmueller/synctoolbox/master)\n\nTo install the Sync Toolbox locally, you can use the Python package manager pip:\n\n```\npip install synctoolbox\n```\n\nWe recommend to do this inside a conda or virtual environment (requiring at least Python 3.7). As an alternative, you may also create the environment ``synctoolbox`` as provided by the file ``environment.yml`` (which includes the synctoolbox package as well as the jupyter package to run the demo files):\n\n```\nconda env create -f environment.yml\n```\n\n**Note:** On some systems, you may see errors related with ``soundfile`` when calling some functions or executing our example notebooks. ``soundfile`` is a dependency of ``librosa``, which is used by the Sync Toolbox. In case of errors, you may have to install libsndfile using your package manager, e.g., ``sudo apt install libsndfile1``. Alternatively, you may create a conda environment, install ``librosa`` using conda and then install the Sync Toolbox with the pip command from above. See [here](https://github.com/librosa/librosa#hints-for-the-installation) for further information if you are experiencing these issues.\n\n\nIf you want to run the example notebooks locally, you **must** first install the Sync Toolbox to resolve all dependencies. Then, you can clone this repository using\n\n```\ngit clone https://github.com/meinardmueller/synctoolbox.git\n```\ninstall Jupyter using\n\n```\npip install jupyter\n```\n\nand then start the notebook server via\n\n```\njupyter notebook\n```\n\nFinally, HTML exports of the example notebooks are provided under \"[Releases](https://github.com/meinardmueller/synctoolbox/releases)\".\n\n\n## Usage\n\nFully worked examples for using the sync toolbox are provided in the accompanying Jupyter notebooks. In ``sync_audio_audio_simple.ipynb``, we show how to use the toolbox to synchronize two recordings of the same piece of music using standard chroma features. We also compare runtimes for standard DTW and MrMsDTW. In ``sync_audio_audio_full.ipynb``, we expand this example and demonstrate how to build a full synchronization pipeline that yields state-of-the-art results. Finally, ``sync_audio_score_full.ipynb`` shows a similar pipeline for synchronizing a music recording with the corresponding score.\n\nThere is also an API documentation for the Sync Toolbox:\n\nhttps://meinardmueller.github.io/synctoolbox\n\n## Contributing\n\nWe are happy for suggestions and contributions. We would be grateful for either directly contacting us via email (meinard.mueller@audiolabs-erlangen.de) or for creating an issue in our Github repository. Please do not submit a pull request without prior consultation with us.\n\n## Tests\n\nWe provide automated tests for each feature and different variants of MrMsDTW. These ensure that the outputs match the ground truth matrices provided in the **tests/data** folder.\n\nTo execute the test script, you will need to install extra requirements for testing:\n\n```\npip install 'synctoolbox[tests]'\npytest tests\n```\n\n## Licence\n\nThe code for this toolbox is published under an MIT licence. This does not apply to the data files. Schubert songs are taken from the [Schubert Winterreise Dataset](https://zenodo.org/record/4122060). The Chopin prelude example files are taken from the [FMP notebooks](https://www.audiolabs-erlangen.de/resources/MIR/FMP/C0/C0.html).\n\n## Acknowledgements\n\nThe synctoolbox package builds on results, material, and insights that have been obtained in close collaboration with different people. We would like to express our gratitude to former and current students, collaborators, and colleagues who have influenced and supported us in creating this package, including Vlora Arifi-M\u00fcller, Michael Clausen, Sebastian Ewert, Christian Fremerey, and Frank Kurth. The main authors of Sync Toolbox are associated with the International Audio Laboratories Erlangen, which are a joint institution of the Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU) and Fraunhofer Institute for Integrated Circuits IIS. We also thank the German Research Foundation (DFG) for various research grants that allowed us for conducting fundamental research in music processing (in particular, MU 2686/7-2, DFG-MU 2686/14-1).\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "Python Package for Efficient, Robust, and Accurate Music Synchronization (SyncToolbox)",
"version": "1.3.2",
"project_urls": {
"Download": "https://github.com/meinardmueller/synctoolbox",
"Homepage": "https://github.com/meinardmueller/synctoolbox"
},
"split_keywords": [
"audio",
"music",
"sound",
"synchronization",
"dtw",
"mrmsdtw"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "9b128f90d65da4c9c2708a2a48bf091938c8b32b2939ce9ec5a3bda7ffe078f0",
"md5": "c70d82b861dc189e458f7008e4666c6b",
"sha256": "fdf125711f552a2ad757a4d68c03db2ba174bdcd3c50252b345bcf6603b5c2db"
},
"downloads": -1,
"filename": "synctoolbox-1.3.2-py3-none-any.whl",
"has_sig": false,
"md5_digest": "c70d82b861dc189e458f7008e4666c6b",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8, <4.0",
"size": 41238,
"upload_time": "2023-12-04T12:06:19",
"upload_time_iso_8601": "2023-12-04T12:06:19.320878Z",
"url": "https://files.pythonhosted.org/packages/9b/12/8f90d65da4c9c2708a2a48bf091938c8b32b2939ce9ec5a3bda7ffe078f0/synctoolbox-1.3.2-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "02c0303742db542cc340fc2928f096f61d37cb64aaa6a87a3d15a0637a166926",
"md5": "b76cb60c50f00704cd5a126e6187f96d",
"sha256": "149119abeb4bc5224e05a51917c86aed9ebf48e6965da5f4cc963becc161fef0"
},
"downloads": -1,
"filename": "synctoolbox-1.3.2.tar.gz",
"has_sig": false,
"md5_digest": "b76cb60c50f00704cd5a126e6187f96d",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8, <4.0",
"size": 38631,
"upload_time": "2023-12-04T12:06:21",
"upload_time_iso_8601": "2023-12-04T12:06:21.061747Z",
"url": "https://files.pythonhosted.org/packages/02/c0/303742db542cc340fc2928f096f61d37cb64aaa6a87a3d15a0637a166926/synctoolbox-1.3.2.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-12-04 12:06:21",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "meinardmueller",
"github_project": "synctoolbox",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "synctoolbox"
}
JSON
