# Multi-label Separate-and-Conquer Rule Learning Algorithm
[](https://opensource.org/licenses/MIT) [](https://badge.fury.io/py/mlrl-seco) [](https://mlrl-boomer.readthedocs.io/en/latest/?badge=latest)
**Important links:** [Documentation](https://mlrl-boomer.readthedocs.io/en/latest/user_guide/seco/index.html) | [Issue Tracker](https://github.com/mrapp-ke/MLRL-Boomer/issues) | [Changelog](https://mlrl-boomer.readthedocs.io/en/latest/misc/CHANGELOG.html) | [Contributors](https://mlrl-boomer.readthedocs.io/en/latest/misc/CONTRIBUTORS.html) | [Code of Conduct](https://mlrl-boomer.readthedocs.io/en/latest/misc/CODE_OF_CONDUCT.html) | [License](https://mlrl-boomer.readthedocs.io/en/latest/misc/LICENSE.html)
This software package provides an implementation of a **Multi-label Separate-and-Conquer (SeCo) Rule Learning Algorithm** that integrates with the popular [scikit-learn](https://scikit-learn.org) machine learning framework.
The goal of [multi-label classification](https://en.wikipedia.org/wiki/Multi-label_classification) is the automatic assignment of sets of labels to individual data points, for example, the annotation of text documents with topics. The algorithm that is provided by this package uses the SeCo paradigm for learning interpretable rule lists.
## Functionalities
The algorithm that is provided by this project currently supports the following core functionalities to learn a binary classification rules:
- **A large variety of heuristics is available** to assess the quality of candidate rules.
- **Rules may predict for a single label or multiple ones** (which enables to model local label dependencies).
- **Rules can be constructed via a greedy search or a beam search.** The latter may help to improve the quality of individual rules.
- **Sampling techniques and stratification methods** can be used to learn new rules on a subset of the available training examples, features, or labels.
- **Fine-grained control over the specificity/generality of rules** is provided via hyper-parameters.
- **Incremental reduced error pruning** can be used to remove overly specific conditions from rules and prevent overfitting.
- **Sequential post-optimization** may help to improve the predictive performance of a model by reconstructing each rule in the context of the other rules.
- **Native support for numerical, ordinal, and nominal features** eliminates the need for pre-processing techniques such as one-hot encoding.
- **Handling of missing feature values**, i.e., occurrences of NaN in the feature matrix, is implemented by the algorithm.
## Runtime and Memory Optimizations
In addition, the following features that may speed up training or reduce the memory footprint are currently implemented:
- **Sparse feature matrices** can be used for training and prediction. This may speed up training significantly on some data sets.
- **Sparse label matrices** can be used for training. This may reduce the memory footprint in case of large data sets.
- **Sparse prediction matrices** can be used to store predicted labels. This may reduce the memory footprint in case of large data sets.
- **Multi-threading** can be used to parallelize the evaluation of a rule's potential refinements across several features or to obtain predictions for several examples in parallel.
## License
This project is open source software licensed under the terms of the [MIT license](https://mlrl-boomer.readthedocs.io/en/latest/misc/LICENSE.html). We welcome contributions to the project to enhance its functionality and make it more accessible to a broader audience. A frequently updated list of contributors is available [here](https://mlrl-boomer.readthedocs.io/en/latest/misc/CONTRIBUTORS.html).
Raw data
{
"_id": null,
"home_page": "https://github.com/mrapp-ke/MLRL-Boomer",
"name": "mlrl-seco",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.10",
"maintainer_email": null,
"keywords": "machine learning, scikit-learn, multi-label classification, rule learning, separate-and-conquer",
"author": "Michael Rapp",
"author_email": "michael.rapp.ml@gmail.com",
"download_url": "https://github.com/mrapp-ke/MLRL-Boomer/releases",
"platform": "Linux",
"description": "# Multi-label Separate-and-Conquer Rule Learning Algorithm\n\n[](https://opensource.org/licenses/MIT) [](https://badge.fury.io/py/mlrl-seco) [](https://mlrl-boomer.readthedocs.io/en/latest/?badge=latest)\n\n**Important links:** [Documentation](https://mlrl-boomer.readthedocs.io/en/latest/user_guide/seco/index.html) | [Issue Tracker](https://github.com/mrapp-ke/MLRL-Boomer/issues) | [Changelog](https://mlrl-boomer.readthedocs.io/en/latest/misc/CHANGELOG.html) | [Contributors](https://mlrl-boomer.readthedocs.io/en/latest/misc/CONTRIBUTORS.html) | [Code of Conduct](https://mlrl-boomer.readthedocs.io/en/latest/misc/CODE_OF_CONDUCT.html) | [License](https://mlrl-boomer.readthedocs.io/en/latest/misc/LICENSE.html)\n\nThis software package provides an implementation of a **Multi-label Separate-and-Conquer (SeCo) Rule Learning Algorithm** that integrates with the popular [scikit-learn](https://scikit-learn.org) machine learning framework.\n\nThe goal of [multi-label classification](https://en.wikipedia.org/wiki/Multi-label_classification) is the automatic assignment of sets of labels to individual data points, for example, the annotation of text documents with topics. The algorithm that is provided by this package uses the SeCo paradigm for learning interpretable rule lists.\n\n## Functionalities\n\nThe algorithm that is provided by this project currently supports the following core functionalities to learn a binary classification rules:\n\n- **A large variety of heuristics is available** to assess the quality of candidate rules.\n- **Rules may predict for a single label or multiple ones** (which enables to model local label dependencies).\n- **Rules can be constructed via a greedy search or a beam search.** The latter may help to improve the quality of individual rules.\n- **Sampling techniques and stratification methods** can be used to learn new rules on a subset of the available training examples, features, or labels.\n- **Fine-grained control over the specificity/generality of rules** is provided via hyper-parameters.\n- **Incremental reduced error pruning** can be used to remove overly specific conditions from rules and prevent overfitting.\n- **Sequential post-optimization** may help to improve the predictive performance of a model by reconstructing each rule in the context of the other rules.\n- **Native support for numerical, ordinal, and nominal features** eliminates the need for pre-processing techniques such as one-hot encoding.\n- **Handling of missing feature values**, i.e., occurrences of NaN in the feature matrix, is implemented by the algorithm.\n\n## Runtime and Memory Optimizations\n\nIn addition, the following features that may speed up training or reduce the memory footprint are currently implemented:\n\n- **Sparse feature matrices** can be used for training and prediction. This may speed up training significantly on some data sets.\n- **Sparse label matrices** can be used for training. This may reduce the memory footprint in case of large data sets.\n- **Sparse prediction matrices** can be used to store predicted labels. This may reduce the memory footprint in case of large data sets.\n- **Multi-threading** can be used to parallelize the evaluation of a rule's potential refinements across several features or to obtain predictions for several examples in parallel.\n\n## License\n\nThis project is open source software licensed under the terms of the [MIT license](https://mlrl-boomer.readthedocs.io/en/latest/misc/LICENSE.html). We welcome contributions to the project to enhance its functionality and make it more accessible to a broader audience. A frequently updated list of contributors is available [here](https://mlrl-boomer.readthedocs.io/en/latest/misc/CONTRIBUTORS.html).\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "A scikit-learn implementation of a separate-and-conquer multi-label rule learning algorithm",
"version": "0.11.1",
"project_urls": {
"Documentation": "https://mlrl-boomer.readthedocs.io/en/latest",
"Download": "https://github.com/mrapp-ke/MLRL-Boomer/releases",
"Homepage": "https://github.com/mrapp-ke/MLRL-Boomer",
"Issue Tracker": "https://github.com/mrapp-ke/MLRL-Boomer/issues"
},
"split_keywords": [
"machine learning",
" scikit-learn",
" multi-label classification",
" rule learning",
" separate-and-conquer"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "7fd067d3c7d09f00bc66ba4220fcd7e259a63ea140a00c7db5280f54bdff1178",
"md5": "6d623793aee901920c6721309aba33a5",
"sha256": "3b04f6745246e873ec5015e1bfa197a4dc26346add774be7aa3d6f2ff78ad00b"
},
"downloads": -1,
"filename": "mlrl_seco-0.11.1-cp310-cp310-macosx_11_0_arm64.whl",
"has_sig": false,
"md5_digest": "6d623793aee901920c6721309aba33a5",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.10",
"size": 1079597,
"upload_time": "2024-09-24T21:24:45",
"upload_time_iso_8601": "2024-09-24T21:24:45.105782Z",
"url": "https://files.pythonhosted.org/packages/7f/d0/67d3c7d09f00bc66ba4220fcd7e259a63ea140a00c7db5280f54bdff1178/mlrl_seco-0.11.1-cp310-cp310-macosx_11_0_arm64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "a0486eb40845f5bdd6ab23aa0f87505cd1946727dd7036f24e85fa3941769ca7",
"md5": "44f3b2b06cb59315927025bc22f03d7c",
"sha256": "82f40c28691e3701a606ce18c04aa7921b35f418bb0402e32db150495c1af8b6"
},
"downloads": -1,
"filename": "mlrl_seco-0.11.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "44f3b2b06cb59315927025bc22f03d7c",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.10",
"size": 1959382,
"upload_time": "2024-09-24T21:27:34",
"upload_time_iso_8601": "2024-09-24T21:27:34.763588Z",
"url": "https://files.pythonhosted.org/packages/a0/48/6eb40845f5bdd6ab23aa0f87505cd1946727dd7036f24e85fa3941769ca7/mlrl_seco-0.11.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "689c980afb9126c1573f604ae4b3d723731ae37813c734d1c0bdcd16b4495384",
"md5": "679840d8f8e18f1fd28fb4feb2ea9db5",
"sha256": "9709c869b954b0de765572e0ba2cd2eff4b06a2b89e57790324558eb22d7b14b"
},
"downloads": -1,
"filename": "mlrl_seco-0.11.1-cp310-cp310-win_amd64.whl",
"has_sig": false,
"md5_digest": "679840d8f8e18f1fd28fb4feb2ea9db5",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.10",
"size": 577238,
"upload_time": "2024-09-24T21:33:33",
"upload_time_iso_8601": "2024-09-24T21:33:33.817718Z",
"url": "https://files.pythonhosted.org/packages/68/9c/980afb9126c1573f604ae4b3d723731ae37813c734d1c0bdcd16b4495384/mlrl_seco-0.11.1-cp310-cp310-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "eb32a745a3511da75b9050d35e82fb2d790e601ba337c869ecd174a1527d6d33",
"md5": "8fe614f0b1315855215fe79469ee0d56",
"sha256": "b206ab97b9a59adcbd070a07c198b62409a779ddf517d8277412662c62539b22"
},
"downloads": -1,
"filename": "mlrl_seco-0.11.1-cp311-cp311-macosx_11_0_arm64.whl",
"has_sig": false,
"md5_digest": "8fe614f0b1315855215fe79469ee0d56",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.10",
"size": 1074955,
"upload_time": "2024-09-24T21:24:47",
"upload_time_iso_8601": "2024-09-24T21:24:47.022240Z",
"url": "https://files.pythonhosted.org/packages/eb/32/a745a3511da75b9050d35e82fb2d790e601ba337c869ecd174a1527d6d33/mlrl_seco-0.11.1-cp311-cp311-macosx_11_0_arm64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "ab46e1515bcd3422cd3bfe36e59dceb577ef3f95d9f68fca1b4571128e6e6ac3",
"md5": "e07605ca54c8916bda026112f256d0e5",
"sha256": "67d968c24eb26073106fe184b8307f6a4aa42fdf53e7bb31bd038e995ef26a35"
},
"downloads": -1,
"filename": "mlrl_seco-0.11.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "e07605ca54c8916bda026112f256d0e5",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.10",
"size": 1944080,
"upload_time": "2024-09-24T21:27:36",
"upload_time_iso_8601": "2024-09-24T21:27:36.559775Z",
"url": "https://files.pythonhosted.org/packages/ab/46/e1515bcd3422cd3bfe36e59dceb577ef3f95d9f68fca1b4571128e6e6ac3/mlrl_seco-0.11.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "7567bfdbde48802337e7ef8c54d5235948d89f78c707e7d6c6a39c4e5a8183fd",
"md5": "a8c45b15db3ccc97c81d682919baf124",
"sha256": "f7d6f30acce94450df468c3c1ed8cb2cc9f961839fc6bcfd0dccabbeff981dd4"
},
"downloads": -1,
"filename": "mlrl_seco-0.11.1-cp311-cp311-win_amd64.whl",
"has_sig": false,
"md5_digest": "a8c45b15db3ccc97c81d682919baf124",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.10",
"size": 574685,
"upload_time": "2024-09-24T21:33:35",
"upload_time_iso_8601": "2024-09-24T21:33:35.634337Z",
"url": "https://files.pythonhosted.org/packages/75/67/bfdbde48802337e7ef8c54d5235948d89f78c707e7d6c6a39c4e5a8183fd/mlrl_seco-0.11.1-cp311-cp311-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "74f971931d3e8a3062510f472e5983fb656a4a7c33c8ddc2e36a8b7c5bf91818",
"md5": "9a3aca7e9db08ef417257bf13366276e",
"sha256": "8378f8733bfbd45ea9b6e2d258262d4c3d2e1464a53a4bc20dcfd21a91328519"
},
"downloads": -1,
"filename": "mlrl_seco-0.11.1-cp312-cp312-macosx_11_0_arm64.whl",
"has_sig": false,
"md5_digest": "9a3aca7e9db08ef417257bf13366276e",
"packagetype": "bdist_wheel",
"python_version": "cp312",
"requires_python": ">=3.10",
"size": 1078003,
"upload_time": "2024-09-24T21:24:48",
"upload_time_iso_8601": "2024-09-24T21:24:48.606532Z",
"url": "https://files.pythonhosted.org/packages/74/f9/71931d3e8a3062510f472e5983fb656a4a7c33c8ddc2e36a8b7c5bf91818/mlrl_seco-0.11.1-cp312-cp312-macosx_11_0_arm64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "b8e9c6f1415ab3be2203e7bfa9e8a6eab37e460419e9f0f29da4aeb580f76d70",
"md5": "c602f34549895041e4d3a83b6761dbfa",
"sha256": "3cd802e7de280978dfd5124116b72a9c0cfd1914da54eb5c560ce3352b443df3"
},
"downloads": -1,
"filename": "mlrl_seco-0.11.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "c602f34549895041e4d3a83b6761dbfa",
"packagetype": "bdist_wheel",
"python_version": "cp312",
"requires_python": ">=3.10",
"size": 1944346,
"upload_time": "2024-09-24T21:27:38",
"upload_time_iso_8601": "2024-09-24T21:27:38.442672Z",
"url": "https://files.pythonhosted.org/packages/b8/e9/c6f1415ab3be2203e7bfa9e8a6eab37e460419e9f0f29da4aeb580f76d70/mlrl_seco-0.11.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "274076a5a5a082db64a097171c1892c2b23978b389bdc90d7c2b0a55d758876d",
"md5": "e661ec435f05a9883605cd640a0d314a",
"sha256": "e1147c465a299ded022e27a93e0ac033ae02202a9e2adf7be5b876a6a575d282"
},
"downloads": -1,
"filename": "mlrl_seco-0.11.1-cp312-cp312-win_amd64.whl",
"has_sig": false,
"md5_digest": "e661ec435f05a9883605cd640a0d314a",
"packagetype": "bdist_wheel",
"python_version": "cp312",
"requires_python": ">=3.10",
"size": 575646,
"upload_time": "2024-09-24T21:33:36",
"upload_time_iso_8601": "2024-09-24T21:33:36.799584Z",
"url": "https://files.pythonhosted.org/packages/27/40/76a5a5a082db64a097171c1892c2b23978b389bdc90d7c2b0a55d758876d/mlrl_seco-0.11.1-cp312-cp312-win_amd64.whl",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-09-24 21:24:45",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "mrapp-ke",
"github_project": "MLRL-Boomer",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "mlrl-seco"
}
JSON
