matchms


Namematchms JSON
Version 0.24.4 PyPI version JSON
download
home_pagehttps://github.com/matchms/matchms
SummaryPython library for large-scale comparisons and processing of tandem mass spectral data
upload_time2024-04-13 18:21:59
maintainerNone
docs_urlNone
authormatchms developer team
requires_python<3.13,>=3.8
licenseApache-2.0
keywords similarity measures mass spectrometry fuzzy matching fuzzy search
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            `fair-software.nl <https://fair-software.nl/>`_ recommendations:

|GitHub Badge|
|License Badge|
|Conda Badge| |Pypi Badge| |Research Software Directory Badge|
|Zenodo Badge|
|CII Best Practices Badge| |Howfairis Badge|

Code quality checks:

|CI First Code Checks| |CI Build|
|ReadTheDocs Badge|
|Sonarcloud Quality Gate Badge| |Sonarcloud Coverage Badge|

.. image:: readthedocs/_static/matchms_header.png
   :target: readthedocs/_static/matchms.png
   :align: left
   :alt: matchms

Matchms is a versatile open-source Python package developed for importing, processing, cleaning, and comparing mass spectrometry data (MS/MS). It facilitates the implementation of straightforward, reproducible workflows, transforming raw data from common mass spectra file formats into pre- and post-processed spectral data, and enabling large-scale spectral similarity comparisons.

The software supports a range of popular spectral data formats, including mzML, mzXML, msp, metabolomics-USI, MGF, and JSON. Matchms offers an array of tools for metadata cleaning and validation, alongside basic peak filtering, to ensure data accuracy and integrity. A key feature of matchms is its ability to apply various pairwise similarity measures for comparing extensive amounts of spectra. This encompasses not only common Cosine-related scores but also molecular fingerprint-based comparisons and other metadata-related assessments.

One of the strengths of matchms is its extensibility, allowing users to integrate custom similarity measures. Notable examples of spectrum similarity measures tailored for Matchms include `Spec2Vec <https://github.com/iomega/spec2vec>`_ and `MS2DeepScore <https://github.com/matchms/ms2deepscore>`_. Additionally, Matchms enhances efficiency by using faster similarity measures for initial pre-selection and supports storing results in sparse data formats, enabling the comparison of several hundred thousands of spectra. This combination of features positions Matchms as a comprehensive tool for mass spectrometry data analysis.

If you use matchms in your research, please cite the following software papers:  

F Huber, S. Verhoeven, C. Meijer, H. Spreeuw, E. M. Villanueva Castilla, C. Geng, J.J.J. van der Hooft, S. Rogers, A. Belloum, F. Diblen, J.H. Spaaks, (2020). matchms - processing and similarity evaluation of mass spectrometry data. Journal of Open Source Software, 5(52), 2411, https://doi.org/10.21105/joss.02411

de Jonge NF, Hecht H, van der Hooft JJJ, Huber F. (2023). Reproducible MS/MS library cleaning pipeline in matchms. ChemRxiv. Cambridge: Cambridge Open Engage; 2023, https://doi.org/10.26434/chemrxiv-2023-l44cm


.. |GitHub Badge| image:: https://img.shields.io/badge/github-repo-000.svg?logo=github&labelColor=gray&color=blue
   :target: https://github.com/matchms/matchms
   :alt: GitHub Badge

.. |License Badge| image:: https://img.shields.io/github/license/matchms/matchms
   :target: https://github.com/matchms/matchms
   :alt: License Badge

.. |Conda Badge| image:: https://anaconda.org/bioconda/matchms/badges/version.svg
   :target: https://anaconda.org/bioconda/matchms
   :alt: Conda Badge

.. |Pypi Badge| image:: https://img.shields.io/pypi/v/matchms?color=blue
   :target: https://pypi.org/project/matchms/
   :alt: Pypi Badge

.. |Research Software Directory Badge| image:: https://img.shields.io/badge/rsd-matchms-00a3e3.svg
   :target: https://www.research-software.nl/software/matchms
   :alt: Research Software Directory Badge

.. |Zenodo Badge| image:: https://zenodo.org/badge/DOI/10.5281/zenodo.3859772.svg
   :target: https://doi.org/10.5281/zenodo.3859772
   :alt: Zenodo Badge

.. |JOSS Badge| image:: https://joss.theoj.org/papers/10.21105/joss.02411/status.svg
   :target: https://doi.org/10.21105/joss.02411
   :alt: JOSS Badge

.. |CII Best Practices Badge| image:: https://bestpractices.coreinfrastructure.org/projects/3792/badge
   :target: https://bestpractices.coreinfrastructure.org/projects/3792
   :alt: CII Best Practices Badge

.. |Howfairis Badge| image:: https://img.shields.io/badge/fair--software.eu-%E2%97%8F%20%20%E2%97%8F%20%20%E2%97%8F%20%20%E2%97%8F%20%20%E2%97%8F-green
   :target: https://fair-software.eu
   :alt: Howfairis badge

.. |CI First Code Checks| image:: https://github.com/matchms/matchms/actions/workflows/CI_first_code_check.yml/badge.svg
    :alt: Continuous integration workflow
    :target: https://github.com/matchms/matchms/actions/workflows/CI_first_code_check.yml

.. |CI Build| image:: https://github.com/matchms/matchms/actions/workflows/CI_build.yml/badge.svg
    :alt: Continuous integration workflow
    :target: https://github.com/matchms/matchms/actions/workflows/CI_build.yml

.. |ReadTheDocs Badge| image:: https://readthedocs.org/projects/matchms/badge/?version=latest
    :alt: Documentation Status
    :scale: 100%
    :target: https://matchms.readthedocs.io/en/latest/?badge=latest

.. |Sonarcloud Quality Gate Badge| image:: https://sonarcloud.io/api/project_badges/measure?project=matchms_matchms&metric=alert_status
   :target: https://sonarcloud.io/dashboard?id=matchms_matchms
   :alt: Sonarcloud Quality Gate

.. |Sonarcloud Coverage Badge| image:: https://sonarcloud.io/api/project_badges/measure?project=matchms_matchms&metric=coverage
   :target: https://sonarcloud.io/component_measures?id=matchms_matchms&metric=Coverage&view=list
   :alt: Sonarcloud Coverage

**********************************
Latest changes (matchms >= 0.18.0)
**********************************

Pipeline class
==============

To make typical matchms workflows (data import, processing, score computations) more accessible to users, matchms now offers a `Pipeline` class to handle complex workflows. This also allows to create, import, export, or modify workflows using yaml files. See code examples below (and soon: updated tutorial).

Sparse scores array
===================

We realized that many matchms-based workflows aim to compare many-to-many spectra whereby not all pairs and scores are equally important. Often, for instance, it will be about searching similar or related spectra/compounds. This also means that often not all scores need to be stored (or computed). For this reason, we now shifted to a sparse handling of scores in matchms (that means: only storing actually computed, non-null values).

.. image:: readthedocs/_static/matchms_sketch.png
   :target: readthedocs/_static/matchms_sketch.png
   :align: left
   :alt: matchms code design


***********************
Documentation for users
***********************
For more extensive documentation `see our readthedocs <https://matchms.readthedocs.io/en/latest/>`_ and our `matchms introduction tutorial <https://blog.esciencecenter.nl/build-your-own-mass-spectrometry-analysis-pipeline-in-python-using-matchms-part-i-d96c718c68ee>`_.

Installation
============

Prerequisites:  

- Python 3.8 - 3.11, (higher versions should work as well, but are not yet tested systematically)
- Anaconda (recommended)

We recommend installing matchms in a new virtual environment to avoid dependency clashes

.. code-block:: console

  conda create --name matchms python=3.9
  conda activate matchms
  conda install --channel bioconda --channel conda-forge matchms

Alternatively, matchms can also be installed using ``pip``. In the most basic version matchms will then come without ``rdkit`` so that several filter functions related to processing and cleaning chemical metadata will not run. To include ``rdkit`` install matchms as ``matchms[chemistry]``:

.. code-block:: console

  pip install matchms  # simple install w/o rdkit
  pip install matchms[chemistry]  # full install including rdkit

matchms ecosystem -> additional functionalities
===============================================

Matchms functionalities can be complemented by additional packages.  
To date, we are aware of:

+ `Spec2Vec <https://github.com/iomega/spec2vec>`_ an alternative machine-learning spectral similarity score that can simply be installed by `pip install spec2vec` and be imported as `from spec2vec import Spec2Vec` following the same API as the scores in `matchms.similarity`.

+ `MS2DeepScore <https://github.com/matchms/ms2deepscore>`_ a supervised, deep-learning based spectral similarity score that can simply be installed by `pip install ms2deepscore` and be imported as `from ms2deepscore import MS2DeepScore` following the same API as the scores in `matchms.similarity`.

+ `matchmsextras <https://github.com/matchms/matchmsextras>`_ which contains additional functions to create networks based on spectral similarities, to run spectrum searchers against `PubChem`, or additional plotting methods.

+ `MS2Query <https://github.com/iomega/ms2query>`_ Reliable and fast MS/MS spectral-based analogue search, running on top of matchms.

+ `memo <https://github.com/mandelbrot-project/memo>`_ a method allowing a Retention Time (RT) agnostic alignment of metabolomics samples using the fragmentation spectra (MS2) of their constituents.

+ `RIAssigner <https://github.com/RECETOX/RIAssigner>`_ a tool for retention index calculation for gas chromatography - mass spectrometry (GC-MS) data.

+ `MSMetaEnhancer <https://github.com/RECETOX/MSMetaEnhancer>`_ is a python package to collect mass spectral library metadata using various web services and computational chemistry packages.

*(if you know of any other packages that are fully compatible with matchms, let us know!)*

Introduction
============

To get started with matchms, we recommend following our `matchms introduction tutorial <https://blog.esciencecenter.nl/build-your-own-mass-spectrometry-analysis-pipeline-in-python-using-matchms-part-i-d96c718c68ee>`_.

Below is an example of using default filter steps for cleaning spectra, 
followed by calculating the Cosine score between mass Spectrums in the `tests/testdata/pesticides.mgf <https://github.com/matchms/matchms/blob/master/tests/testdata/pesticides.mgf>`_ file.

.. code-block:: python

    from matchms.Pipeline import Pipeline, create_workflow

    workflow = create_workflow(
        yaml_file_name="my_config_file.yaml", # The workflow will be stored in a yaml file, this can be used to rerun your workflow or to share it with others.
        score_computations=[["cosinegreedy", {"tolerance": 1.0}]],
        )
    pipeline = Pipeline(workflow)
    pipeline.logging_file = "my_pipeline.log"  # for pipeline and logging message
    pipeline.run("tests/testdata/pesticides.mgf")
    
Below is a more advanced code example showing how you can make a specific pipeline for your needs.

.. code-block:: python

    import os
    from matchms.Pipeline import Pipeline, create_workflow
    from matchms.filtering.default_pipelines import DEFAULT_FILTERS, LIBRARY_CLEANING
    
    results_folder = "./results"
    os.makedirs(results_folder, exist_ok=True)
    
    workflow = create_workflow(
        yaml_file_name=os.path.join(results_folder, "my_config_file.yaml"),  # The workflow will be stored in a yaml file.
        query_filters=DEFAULT_FILTERS,
        reference_filters=LIBRARY_CLEANING + ["add_fingerprint"],
        score_computations=[["precursormzmatch", {"tolerance": 100.0}],
                            ["cosinegreedy", {"tolerance": 1.0}],
                            ["filter_by_range", {"name": "CosineGreedy_score", "low": 0.2}]],
    )
    pipeline = Pipeline(workflow)
    pipeline.logging_file = os.path.join(results_folder, "my_pipeline.log")  # for pipeline and logging message
    pipeline.logging_level = "WARNING"  # To define the verbosety of the logging
    pipeline.run("tests/testdata/pesticides.mgf", "my_reference_library.mgf",
                 cleaned_query_file=os.path.join(results_folder, "cleaned_query_spectra.mgf"),
                 cleaned_reference_file=os.path.join(results_folder,
                                                     "cleaned_library_spectra.mgf"))  # choose your own files


Alternatively, in particular, if you need more room to add custom functions and steps, the individual steps can run without using the matchms ``Pipeline``:

.. code-block:: python
    
    from matchms.importing import load_from_mgf
    from matchms.filtering import default_filters, normalize_intensities
    from matchms import calculate_scores
    from matchms.similarity import CosineGreedy

    # Read spectrums from a MGF formatted file, for other formats see https://matchms.readthedocs.io/en/latest/api/matchms.importing.html 
    file = load_from_mgf("tests/testdata/pesticides.mgf")

    # Apply filters to clean and enhance each spectrum
    spectrums = []
    for spectrum in file:
        # Apply default filter to standardize ion mode, correct charge and more.
        # Default filter is fully explained at https://matchms.readthedocs.io/en/latest/api/matchms.filtering.html .
        spectrum = default_filters(spectrum)
        # Scale peak intensities to maximum of 1
        spectrum = normalize_intensities(spectrum)
        spectrums.append(spectrum)

    # Calculate Cosine similarity scores between all spectrums
    # For other similarity score methods see https://matchms.readthedocs.io/en/latest/api/matchms.similarity.html .
    scores = calculate_scores(references=spectrums,
                              queries=spectrums,
                              similarity_function=CosineGreedy())

    # Matchms allows to get the best matches for any query using scores_by_query
    query = spectrums[15]  # just an example
    best_matches = scores.scores_by_query(query, 'CosineGreedy_score', sort=True)

    # Print the calculated scores for each spectrum pair
    for (reference, score) in best_matches[:10]:
        # Ignore scores between same spectra
        if reference is not query:
            print(f"Reference scan id: {reference.metadata['scans']}")
            print(f"Query scan id: {query.metadata['scans']}")
            print(f"Score: {score[0]:.4f}")
            print(f"Number of matching peaks: {score[1]}")
            print("----------------------------")


Different spectrum similarity scores
====================================

Matchms comes with numerous different scoring methods in `matchms.similarity` and can further seamlessly work with `Spec2Vec` or `MS2DeepScore`.

Code example: 

.. code-block:: python

    from matchms.importing import load_from_usi
    import matchms.filtering as msfilters
    import matchms.similarity as mssim


    usi1 = "mzspec:GNPS:GNPS-LIBRARY:accession:CCMSLIB00000424840"
    usi2 = "mzspec:MSV000086109:BD5_dil2x_BD5_01_57213:scan:760"

    mz_tolerance = 0.1

    spectrum1 = load_from_usi(usi1)
    spectrum1 = msfilters.select_by_mz(spectrum1, 0, spectrum1.get("precursor_mz"))
    spectrum1 = msfilters.remove_peaks_around_precursor_mz(spectrum1,
                                                           mz_tolerance=0.1)

    spectrum2 = load_from_usi(usi2)
    spectrum2 = msfilters.select_by_mz(spectrum2, 0, spectrum1.get("precursor_mz"))
    spectrum2 = msfilters.remove_peaks_around_precursor_mz(spectrum2,
                                                           mz_tolerance=0.1)
    # Compute scores:
    similarity_cosine = mssim.CosineGreedy(tolerance=mz_tolerance).pair(spectrum1, spectrum2)
    similarity_modified_cosine = mssim.ModifiedCosine(tolerance=mz_tolerance).pair(spectrum1, spectrum2)
    similarity_neutral_losses = mssim.NeutralLossesCosine(tolerance=mz_tolerance).pair(spectrum1, spectrum2)

    print(f"similarity_cosine: {similarity_cosine}")
    print(f"similarity_modified_cosine: {similarity_modified_cosine}")
    print(f"similarity_neutral_losses: {similarity_neutral_losses}")

    spectrum1.plot_against(spectrum2)


****************************
Documentation for developers
****************************

Installation
============

To install matchms, do:

.. code-block:: console

  git clone https://github.com/matchms/matchms.git
  cd matchms
  conda create --name matchms-dev python=3.8
  conda activate matchms-dev
  # Install rdkit using conda, rest of dependencies can be installed with pip
  conda install -c conda-forge rdkit
  python -m pip install --upgrade pip
  pip install --editable .[dev]  # if this won't work try "poetry install"

Run the linter with:

.. code-block:: console

  prospector

Automatically fix incorrectly sorted imports:

.. code-block:: console

  isort .

Files will be changed in place and need to be committed manually. If you only want to inspect the isort suggestions then simply run:

.. code-block:: console

  isort --check-only --diff .


Run tests (including coverage) with:

.. code-block:: console

  pytest


Conda package
=============

The conda packaging is handled by a `recipe at Bioconda <https://github.com/bioconda/bioconda-recipes/blob/master/recipes/matchms/meta.yaml>`_.

Publishing to PyPI will trigger the creation of a `pull request on the bioconda recipes repository <https://github.com/bioconda/bioconda-recipes/pulls?q=is%3Apr+is%3Aopen+matchms>`_
Once the PR is merged the new version of matchms will appear on `https://anaconda.org/bioconda/matchms <https://anaconda.org/bioconda/matchms>`_

Flowchart
=========

.. figure:: paper/flowchart_matchms.png
  :width: 400
  :alt: Flowchart
  
  Flowchart of matchms workflow. Reference and query spectrums are filtered using the same
  set of set filters (here: filter A and filter B). Once filtered, every reference spectrum is compared to
  every query spectrum using the matchms.Scores object.

Contributing
============

If you want to contribute to the development of matchms,
have a look at the `contribution guidelines <CONTRIBUTING.md>`_.

*******
License
*******

Copyright (c) 2023, Düsseldorf University of Applied Sciences & Netherlands eScience Center

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.

*******
Credits
*******

This package was created with `Cookiecutter
<https://github.com/audreyr/cookiecutter>`_ and the `NLeSC/python-template
<https://github.com/NLeSC/python-template>`_.

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/matchms/matchms",
    "name": "matchms",
    "maintainer": null,
    "docs_url": null,
    "requires_python": "<3.13,>=3.8",
    "maintainer_email": null,
    "keywords": "similarity measures, mass spectrometry, fuzzy matching, fuzzy search",
    "author": "matchms developer team",
    "author_email": "florian.huber@hs-duesseldorf.de",
    "download_url": "https://files.pythonhosted.org/packages/6c/a0/796e60f28f4bf431fa521b8c411852ac15d8d9108df17fc713217074cfa8/matchms-0.24.4.tar.gz",
    "platform": null,
    "description": "`fair-software.nl <https://fair-software.nl/>`_ recommendations:\n\n|GitHub Badge|\n|License Badge|\n|Conda Badge| |Pypi Badge| |Research Software Directory Badge|\n|Zenodo Badge|\n|CII Best Practices Badge| |Howfairis Badge|\n\nCode quality checks:\n\n|CI First Code Checks| |CI Build|\n|ReadTheDocs Badge|\n|Sonarcloud Quality Gate Badge| |Sonarcloud Coverage Badge|\n\n.. image:: readthedocs/_static/matchms_header.png\n   :target: readthedocs/_static/matchms.png\n   :align: left\n   :alt: matchms\n\nMatchms is a versatile open-source Python package developed for importing, processing, cleaning, and comparing mass spectrometry data (MS/MS). It facilitates the implementation of straightforward, reproducible workflows, transforming raw data from common mass spectra file formats into pre- and post-processed spectral data, and enabling large-scale spectral similarity comparisons.\n\nThe software supports a range of popular spectral data formats, including mzML, mzXML, msp, metabolomics-USI, MGF, and JSON. Matchms offers an array of tools for metadata cleaning and validation, alongside basic peak filtering, to ensure data accuracy and integrity. A key feature of matchms is its ability to apply various pairwise similarity measures for comparing extensive amounts of spectra. This encompasses not only common Cosine-related scores but also molecular fingerprint-based comparisons and other metadata-related assessments.\n\nOne of the strengths of matchms is its extensibility, allowing users to integrate custom similarity measures. Notable examples of spectrum similarity measures tailored for Matchms include `Spec2Vec <https://github.com/iomega/spec2vec>`_ and `MS2DeepScore <https://github.com/matchms/ms2deepscore>`_. Additionally, Matchms enhances efficiency by using faster similarity measures for initial pre-selection and supports storing results in sparse data formats, enabling the comparison of several hundred thousands of spectra. This combination of features positions Matchms as a comprehensive tool for mass spectrometry data analysis.\n\nIf you use matchms in your research, please cite the following software papers:  \n\nF Huber, S. Verhoeven, C. Meijer, H. Spreeuw, E. M. Villanueva Castilla, C. Geng, J.J.J. van der Hooft, S. Rogers, A. Belloum, F. Diblen, J.H. Spaaks, (2020). matchms - processing and similarity evaluation of mass spectrometry data. Journal of Open Source Software, 5(52), 2411, https://doi.org/10.21105/joss.02411\n\nde Jonge NF, Hecht H, van der Hooft JJJ, Huber F. (2023). Reproducible MS/MS library cleaning pipeline in matchms. ChemRxiv. Cambridge: Cambridge Open Engage; 2023, https://doi.org/10.26434/chemrxiv-2023-l44cm\n\n\n.. |GitHub Badge| image:: https://img.shields.io/badge/github-repo-000.svg?logo=github&labelColor=gray&color=blue\n   :target: https://github.com/matchms/matchms\n   :alt: GitHub Badge\n\n.. |License Badge| image:: https://img.shields.io/github/license/matchms/matchms\n   :target: https://github.com/matchms/matchms\n   :alt: License Badge\n\n.. |Conda Badge| image:: https://anaconda.org/bioconda/matchms/badges/version.svg\n   :target: https://anaconda.org/bioconda/matchms\n   :alt: Conda Badge\n\n.. |Pypi Badge| image:: https://img.shields.io/pypi/v/matchms?color=blue\n   :target: https://pypi.org/project/matchms/\n   :alt: Pypi Badge\n\n.. |Research Software Directory Badge| image:: https://img.shields.io/badge/rsd-matchms-00a3e3.svg\n   :target: https://www.research-software.nl/software/matchms\n   :alt: Research Software Directory Badge\n\n.. |Zenodo Badge| image:: https://zenodo.org/badge/DOI/10.5281/zenodo.3859772.svg\n   :target: https://doi.org/10.5281/zenodo.3859772\n   :alt: Zenodo Badge\n\n.. |JOSS Badge| image:: https://joss.theoj.org/papers/10.21105/joss.02411/status.svg\n   :target: https://doi.org/10.21105/joss.02411\n   :alt: JOSS Badge\n\n.. |CII Best Practices Badge| image:: https://bestpractices.coreinfrastructure.org/projects/3792/badge\n   :target: https://bestpractices.coreinfrastructure.org/projects/3792\n   :alt: CII Best Practices Badge\n\n.. |Howfairis Badge| image:: https://img.shields.io/badge/fair--software.eu-%E2%97%8F%20%20%E2%97%8F%20%20%E2%97%8F%20%20%E2%97%8F%20%20%E2%97%8F-green\n   :target: https://fair-software.eu\n   :alt: Howfairis badge\n\n.. |CI First Code Checks| image:: https://github.com/matchms/matchms/actions/workflows/CI_first_code_check.yml/badge.svg\n    :alt: Continuous integration workflow\n    :target: https://github.com/matchms/matchms/actions/workflows/CI_first_code_check.yml\n\n.. |CI Build| image:: https://github.com/matchms/matchms/actions/workflows/CI_build.yml/badge.svg\n    :alt: Continuous integration workflow\n    :target: https://github.com/matchms/matchms/actions/workflows/CI_build.yml\n\n.. |ReadTheDocs Badge| image:: https://readthedocs.org/projects/matchms/badge/?version=latest\n    :alt: Documentation Status\n    :scale: 100%\n    :target: https://matchms.readthedocs.io/en/latest/?badge=latest\n\n.. |Sonarcloud Quality Gate Badge| image:: https://sonarcloud.io/api/project_badges/measure?project=matchms_matchms&metric=alert_status\n   :target: https://sonarcloud.io/dashboard?id=matchms_matchms\n   :alt: Sonarcloud Quality Gate\n\n.. |Sonarcloud Coverage Badge| image:: https://sonarcloud.io/api/project_badges/measure?project=matchms_matchms&metric=coverage\n   :target: https://sonarcloud.io/component_measures?id=matchms_matchms&metric=Coverage&view=list\n   :alt: Sonarcloud Coverage\n\n**********************************\nLatest changes (matchms >= 0.18.0)\n**********************************\n\nPipeline class\n==============\n\nTo make typical matchms workflows (data import, processing, score computations) more accessible to users, matchms now offers a `Pipeline` class to handle complex workflows. This also allows to create, import, export, or modify workflows using yaml files. See code examples below (and soon: updated tutorial).\n\nSparse scores array\n===================\n\nWe realized that many matchms-based workflows aim to compare many-to-many spectra whereby not all pairs and scores are equally important. Often, for instance, it will be about searching similar or related spectra/compounds. This also means that often not all scores need to be stored (or computed). For this reason, we now shifted to a sparse handling of scores in matchms (that means: only storing actually computed, non-null values).\n\n.. image:: readthedocs/_static/matchms_sketch.png\n   :target: readthedocs/_static/matchms_sketch.png\n   :align: left\n   :alt: matchms code design\n\n\n***********************\nDocumentation for users\n***********************\nFor more extensive documentation `see our readthedocs <https://matchms.readthedocs.io/en/latest/>`_ and our `matchms introduction tutorial <https://blog.esciencecenter.nl/build-your-own-mass-spectrometry-analysis-pipeline-in-python-using-matchms-part-i-d96c718c68ee>`_.\n\nInstallation\n============\n\nPrerequisites:  \n\n- Python 3.8 - 3.11, (higher versions should work as well, but are not yet tested systematically)\n- Anaconda (recommended)\n\nWe recommend installing matchms in a new virtual environment to avoid dependency clashes\n\n.. code-block:: console\n\n  conda create --name matchms python=3.9\n  conda activate matchms\n  conda install --channel bioconda --channel conda-forge matchms\n\nAlternatively, matchms can also be installed using ``pip``. In the most basic version matchms will then come without ``rdkit`` so that several filter functions related to processing and cleaning chemical metadata will not run. To include ``rdkit`` install matchms as ``matchms[chemistry]``:\n\n.. code-block:: console\n\n  pip install matchms  # simple install w/o rdkit\n  pip install matchms[chemistry]  # full install including rdkit\n\nmatchms ecosystem -> additional functionalities\n===============================================\n\nMatchms functionalities can be complemented by additional packages.  \nTo date, we are aware of:\n\n+ `Spec2Vec <https://github.com/iomega/spec2vec>`_ an alternative machine-learning spectral similarity score that can simply be installed by `pip install spec2vec` and be imported as `from spec2vec import Spec2Vec` following the same API as the scores in `matchms.similarity`.\n\n+ `MS2DeepScore <https://github.com/matchms/ms2deepscore>`_ a supervised, deep-learning based spectral similarity score that can simply be installed by `pip install ms2deepscore` and be imported as `from ms2deepscore import MS2DeepScore` following the same API as the scores in `matchms.similarity`.\n\n+ `matchmsextras <https://github.com/matchms/matchmsextras>`_ which contains additional functions to create networks based on spectral similarities, to run spectrum searchers against `PubChem`, or additional plotting methods.\n\n+ `MS2Query <https://github.com/iomega/ms2query>`_ Reliable and fast MS/MS spectral-based analogue search, running on top of matchms.\n\n+ `memo <https://github.com/mandelbrot-project/memo>`_ a method allowing a Retention Time (RT) agnostic alignment of metabolomics samples using the fragmentation spectra (MS2) of their constituents.\n\n+ `RIAssigner <https://github.com/RECETOX/RIAssigner>`_ a tool for retention index calculation for gas chromatography - mass spectrometry (GC-MS) data.\n\n+ `MSMetaEnhancer <https://github.com/RECETOX/MSMetaEnhancer>`_ is a python package to collect mass spectral library metadata using various web services and computational chemistry packages.\n\n*(if you know of any other packages that are fully compatible with matchms, let us know!)*\n\nIntroduction\n============\n\nTo get started with matchms, we recommend following our `matchms introduction tutorial <https://blog.esciencecenter.nl/build-your-own-mass-spectrometry-analysis-pipeline-in-python-using-matchms-part-i-d96c718c68ee>`_.\n\nBelow is an example of using default filter steps for cleaning spectra, \nfollowed by calculating the Cosine score between mass Spectrums in the `tests/testdata/pesticides.mgf <https://github.com/matchms/matchms/blob/master/tests/testdata/pesticides.mgf>`_ file.\n\n.. code-block:: python\n\n    from matchms.Pipeline import Pipeline, create_workflow\n\n    workflow = create_workflow(\n        yaml_file_name=\"my_config_file.yaml\", # The workflow will be stored in a yaml file, this can be used to rerun your workflow or to share it with others.\n        score_computations=[[\"cosinegreedy\", {\"tolerance\": 1.0}]],\n        )\n    pipeline = Pipeline(workflow)\n    pipeline.logging_file = \"my_pipeline.log\"  # for pipeline and logging message\n    pipeline.run(\"tests/testdata/pesticides.mgf\")\n    \nBelow is a more advanced code example showing how you can make a specific pipeline for your needs.\n\n.. code-block:: python\n\n    import os\n    from matchms.Pipeline import Pipeline, create_workflow\n    from matchms.filtering.default_pipelines import DEFAULT_FILTERS, LIBRARY_CLEANING\n    \n    results_folder = \"./results\"\n    os.makedirs(results_folder, exist_ok=True)\n    \n    workflow = create_workflow(\n        yaml_file_name=os.path.join(results_folder, \"my_config_file.yaml\"),  # The workflow will be stored in a yaml file.\n        query_filters=DEFAULT_FILTERS,\n        reference_filters=LIBRARY_CLEANING + [\"add_fingerprint\"],\n        score_computations=[[\"precursormzmatch\", {\"tolerance\": 100.0}],\n                            [\"cosinegreedy\", {\"tolerance\": 1.0}],\n                            [\"filter_by_range\", {\"name\": \"CosineGreedy_score\", \"low\": 0.2}]],\n    )\n    pipeline = Pipeline(workflow)\n    pipeline.logging_file = os.path.join(results_folder, \"my_pipeline.log\")  # for pipeline and logging message\n    pipeline.logging_level = \"WARNING\"  # To define the verbosety of the logging\n    pipeline.run(\"tests/testdata/pesticides.mgf\", \"my_reference_library.mgf\",\n                 cleaned_query_file=os.path.join(results_folder, \"cleaned_query_spectra.mgf\"),\n                 cleaned_reference_file=os.path.join(results_folder,\n                                                     \"cleaned_library_spectra.mgf\"))  # choose your own files\n\n\nAlternatively, in particular, if you need more room to add custom functions and steps, the individual steps can run without using the matchms ``Pipeline``:\n\n.. code-block:: python\n    \n    from matchms.importing import load_from_mgf\n    from matchms.filtering import default_filters, normalize_intensities\n    from matchms import calculate_scores\n    from matchms.similarity import CosineGreedy\n\n    # Read spectrums from a MGF formatted file, for other formats see https://matchms.readthedocs.io/en/latest/api/matchms.importing.html \n    file = load_from_mgf(\"tests/testdata/pesticides.mgf\")\n\n    # Apply filters to clean and enhance each spectrum\n    spectrums = []\n    for spectrum in file:\n        # Apply default filter to standardize ion mode, correct charge and more.\n        # Default filter is fully explained at https://matchms.readthedocs.io/en/latest/api/matchms.filtering.html .\n        spectrum = default_filters(spectrum)\n        # Scale peak intensities to maximum of 1\n        spectrum = normalize_intensities(spectrum)\n        spectrums.append(spectrum)\n\n    # Calculate Cosine similarity scores between all spectrums\n    # For other similarity score methods see https://matchms.readthedocs.io/en/latest/api/matchms.similarity.html .\n    scores = calculate_scores(references=spectrums,\n                              queries=spectrums,\n                              similarity_function=CosineGreedy())\n\n    # Matchms allows to get the best matches for any query using scores_by_query\n    query = spectrums[15]  # just an example\n    best_matches = scores.scores_by_query(query, 'CosineGreedy_score', sort=True)\n\n    # Print the calculated scores for each spectrum pair\n    for (reference, score) in best_matches[:10]:\n        # Ignore scores between same spectra\n        if reference is not query:\n            print(f\"Reference scan id: {reference.metadata['scans']}\")\n            print(f\"Query scan id: {query.metadata['scans']}\")\n            print(f\"Score: {score[0]:.4f}\")\n            print(f\"Number of matching peaks: {score[1]}\")\n            print(\"----------------------------\")\n\n\nDifferent spectrum similarity scores\n====================================\n\nMatchms comes with numerous different scoring methods in `matchms.similarity` and can further seamlessly work with `Spec2Vec` or `MS2DeepScore`.\n\nCode example: \n\n.. code-block:: python\n\n    from matchms.importing import load_from_usi\n    import matchms.filtering as msfilters\n    import matchms.similarity as mssim\n\n\n    usi1 = \"mzspec:GNPS:GNPS-LIBRARY:accession:CCMSLIB00000424840\"\n    usi2 = \"mzspec:MSV000086109:BD5_dil2x_BD5_01_57213:scan:760\"\n\n    mz_tolerance = 0.1\n\n    spectrum1 = load_from_usi(usi1)\n    spectrum1 = msfilters.select_by_mz(spectrum1, 0, spectrum1.get(\"precursor_mz\"))\n    spectrum1 = msfilters.remove_peaks_around_precursor_mz(spectrum1,\n                                                           mz_tolerance=0.1)\n\n    spectrum2 = load_from_usi(usi2)\n    spectrum2 = msfilters.select_by_mz(spectrum2, 0, spectrum1.get(\"precursor_mz\"))\n    spectrum2 = msfilters.remove_peaks_around_precursor_mz(spectrum2,\n                                                           mz_tolerance=0.1)\n    # Compute scores:\n    similarity_cosine = mssim.CosineGreedy(tolerance=mz_tolerance).pair(spectrum1, spectrum2)\n    similarity_modified_cosine = mssim.ModifiedCosine(tolerance=mz_tolerance).pair(spectrum1, spectrum2)\n    similarity_neutral_losses = mssim.NeutralLossesCosine(tolerance=mz_tolerance).pair(spectrum1, spectrum2)\n\n    print(f\"similarity_cosine: {similarity_cosine}\")\n    print(f\"similarity_modified_cosine: {similarity_modified_cosine}\")\n    print(f\"similarity_neutral_losses: {similarity_neutral_losses}\")\n\n    spectrum1.plot_against(spectrum2)\n\n\n****************************\nDocumentation for developers\n****************************\n\nInstallation\n============\n\nTo install matchms, do:\n\n.. code-block:: console\n\n  git clone https://github.com/matchms/matchms.git\n  cd matchms\n  conda create --name matchms-dev python=3.8\n  conda activate matchms-dev\n  # Install rdkit using conda, rest of dependencies can be installed with pip\n  conda install -c conda-forge rdkit\n  python -m pip install --upgrade pip\n  pip install --editable .[dev]  # if this won't work try \"poetry install\"\n\nRun the linter with:\n\n.. code-block:: console\n\n  prospector\n\nAutomatically fix incorrectly sorted imports:\n\n.. code-block:: console\n\n  isort .\n\nFiles will be changed in place and need to be committed manually. If you only want to inspect the isort suggestions then simply run:\n\n.. code-block:: console\n\n  isort --check-only --diff .\n\n\nRun tests (including coverage) with:\n\n.. code-block:: console\n\n  pytest\n\n\nConda package\n=============\n\nThe conda packaging is handled by a `recipe at Bioconda <https://github.com/bioconda/bioconda-recipes/blob/master/recipes/matchms/meta.yaml>`_.\n\nPublishing to PyPI will trigger the creation of a `pull request on the bioconda recipes repository <https://github.com/bioconda/bioconda-recipes/pulls?q=is%3Apr+is%3Aopen+matchms>`_\nOnce the PR is merged the new version of matchms will appear on `https://anaconda.org/bioconda/matchms <https://anaconda.org/bioconda/matchms>`_\n\nFlowchart\n=========\n\n.. figure:: paper/flowchart_matchms.png\n  :width: 400\n  :alt: Flowchart\n  \n  Flowchart of matchms workflow. Reference and query spectrums are filtered using the same\n  set of set filters (here: filter A and filter B). Once filtered, every reference spectrum is compared to\n  every query spectrum using the matchms.Scores object.\n\nContributing\n============\n\nIf you want to contribute to the development of matchms,\nhave a look at the `contribution guidelines <CONTRIBUTING.md>`_.\n\n*******\nLicense\n*******\n\nCopyright (c) 2023, D\u00fcsseldorf University of Applied Sciences & Netherlands eScience Center\n\nLicensed under the Apache License, Version 2.0 (the \"License\");\nyou may not use this file except in compliance with the License.\nYou may obtain a copy of the License at\n\nhttp://www.apache.org/licenses/LICENSE-2.0\n\nUnless required by applicable law or agreed to in writing, software\ndistributed under the License is distributed on an \"AS IS\" BASIS,\nWITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\nSee the License for the specific language governing permissions and\nlimitations under the License.\n\n*******\nCredits\n*******\n\nThis package was created with `Cookiecutter\n<https://github.com/audreyr/cookiecutter>`_ and the `NLeSC/python-template\n<https://github.com/NLeSC/python-template>`_.\n",
    "bugtrack_url": null,
    "license": "Apache-2.0",
    "summary": "Python library for large-scale comparisons and processing of tandem mass spectral data",
    "version": "0.24.4",
    "project_urls": {
        "Documentation": "https://matchms.readthedocs.io/en/latest/",
        "Homepage": "https://github.com/matchms/matchms",
        "Repository": "https://github.com/matchms/matchms"
    },
    "split_keywords": [
        "similarity measures",
        " mass spectrometry",
        " fuzzy matching",
        " fuzzy search"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "b36942516d5c51742ea29afd18e8d67ad436b7c2dc72cf9469adce28a82f35f8",
                "md5": "20407759785da18dd8edfd6cf420082a",
                "sha256": "1fb218acc0a4d212519f76b10aafc7e9a1a3e4e8eabbf55d61f7ae6403f23655"
            },
            "downloads": -1,
            "filename": "matchms-0.24.4-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "20407759785da18dd8edfd6cf420082a",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": "<3.13,>=3.8",
            "size": 147285,
            "upload_time": "2024-04-13T18:21:57",
            "upload_time_iso_8601": "2024-04-13T18:21:57.510219Z",
            "url": "https://files.pythonhosted.org/packages/b3/69/42516d5c51742ea29afd18e8d67ad436b7c2dc72cf9469adce28a82f35f8/matchms-0.24.4-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "6ca0796e60f28f4bf431fa521b8c411852ac15d8d9108df17fc713217074cfa8",
                "md5": "8265b81de28a7069916813490b8797ef",
                "sha256": "012afda1e28ea0f06592e3b7fab07748ed348d31349416869b35af25859d7619"
            },
            "downloads": -1,
            "filename": "matchms-0.24.4.tar.gz",
            "has_sig": false,
            "md5_digest": "8265b81de28a7069916813490b8797ef",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": "<3.13,>=3.8",
            "size": 101182,
            "upload_time": "2024-04-13T18:21:59",
            "upload_time_iso_8601": "2024-04-13T18:21:59.468545Z",
            "url": "https://files.pythonhosted.org/packages/6c/a0/796e60f28f4bf431fa521b8c411852ac15d8d9108df17fc713217074cfa8/matchms-0.24.4.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-04-13 18:21:59",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "matchms",
    "github_project": "matchms",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "matchms"
}
        
Elapsed time: 0.22092s