<div align="center">
<br>
<img align="center" src="https://github.com/AI-team-UoA/pyJedAI/blob/main/docs/img/pyjedai.logo.drawio.png?raw=true" alt="pyJedAI" width="400"/>
</div>
<br>
<br>
<div align="center">
An open-source library that leverages Python’s data science ecosystem to build <br> powerful end-to-end Entity Resolution workflows.
</div>
---
# Overview
pyJedAI is a python framework, aiming to offer experts and novice users, robust and fast solutions for multiple types of Entity Resolution problems. It is builded using state-of-the-art python frameworks. pyJedAI constitutes the sole open-source Link Discovery tool that is capable of exploiting the latest breakthroughs in Deep Learning and NLP techniques, which are publicly available through the Python data science ecosystem. This applies to both blocking and matching, thus ensuring high time efficiency, high scalability as well as high effectiveness, without requiring any labelled instances from the user.
### Key-Features
- Input data-type independent. Both structured and semi-structured data can be processed.
- Various implemented algorithms.
- Easy-to-use.
- Utilizes some of the famous and cutting-edge machine learning packages.
- Offers supervised and un-supervised ML techniques.
__Open demos are available in:__
<div align="center">
<a href="https://nbviewer.org/github/AI-team-UoA/pyJedAI/blob/main/docs/tutorials/Demo.ipynb">
<img align="center" src="https://nbviewer.org/static/img/nav_logo.svg" width=120/>
</a>
<a href="https://github.com/AI-team-UoA/pyJedAI/blob/main/docs/tutorials/Demo.ipynb">
<img align="center" src="https://miro.medium.com/max/1400/1*Edn_LpbSpLeNKfWkEdG2Jg.png" width=120/>
</a>
</div>
__Google Colab Hands-on demo:__
<div align="center">
<a href="https://colab.research.google.com/drive/18VgEOKAc2ObFFxDNb2sjhBLKKsNvfEPo?usp=sharing">
<img align="center" src="https://3.bp.blogspot.com/-apoBeWFycKQ/XhKB8fEprwI/AAAAAAAACM4/Sl76yzNSNYwlShIBrheDAum8L9qRtWNdgCLcBGAsYHQ/s1600/colab.png" width=120/>
</a>
</div>
# Install
pyJedAI has been tested in Windows and Linux OS.
__Basic requirements:__
- Python version greater or equal to **3.8**.
- For Windows, Microsoft Visual C++ 14.0 is required. Download it from [Microsoft Official site](https://visualstudio.microsoft.com/visual-cpp-build-tools/).
### PyPI
Install the latest version of pyjedai:
```
pip install pyjedai
```
More on [PyPI](https://pypi.org/project/pyjedai).
### Git
Set up locally:
```
git clone https://github.com/AI-team-UoA/pyJedAI.git
```
go to the root directory with `cd pyJedAI` and type:
```
pip install .
```
### Docker
Available at [Docker Hub](https://hub.docker.com/r/aiteamuoa/pyjedai), or clone this repo and:
```
docker build -f Dockerfile
```
# Dependencies
<div align="center">
<img align="center" src="https://upload.wikimedia.org/wikipedia/commons/thumb/e/ed/Pandas_logo.svg/2560px-Pandas_logo.svg.png" width=120/>
<img align="center" src="https://upload.wikimedia.org/wikipedia/commons/thumb/3/31/NumPy_logo_2020.svg/1280px-NumPy_logo_2020.svg.png" width=120/>
<img align="center" src="https://logoeps.com/wp-content/uploads/2012/10/python-logo-vector.png" width=120/>
<img align="center" src="https://upload.wikimedia.org/wikipedia/commons/thumb/3/38/Jupyter_logo.svg/883px-Jupyter_logo.svg.png" width=70/> <br>
<img align="center" src="https://raw.githubusercontent.com/optuna/optuna/master/docs/image/optuna-logo.png" width=150/>
<img align="center" src="https://upload.wikimedia.org/wikipedia/commons/thumb/8/8a/Plotly_logo_for_digital_final_%286%29.png/1200px-Plotly_logo_for_digital_final_%286%29.png" width=150/>
<img align="center" src="https://pytorch.org/tutorials/_static/img/thumbnails/cropped/profiler.png" width=160/>
<img align="center" src="https://www.fullstackpython.com/img/logos/scipy.png" width=150/> <br><br>
<img align="center" src="https://www.kornosk.me/resources/language-model/featured.png" width=150/>
<img align="center" src="https://repository-images.githubusercontent.com/1349775/202c4680-8f7c-11e9-91c6-745fdcbeffe8" width=150/>
<img align="center" src="https://networkx.org/_static/networkx_logo.svg" width=150/>
<img align="center" src="https://raw.githubusercontent.com/RDFLib/OWL-RL/master/OWL-RL.png" width=70/>
</div>
<br>
See the full list of dependencies and all versions used, in this [file](https://github.com/AI-team-UoA/pyJedAI/blob/main/pyproject.toml).
__Status__
[](https://github.com/AI-team-UoA/pyJedAI/actions/workflows/tests.yml)
[](https://github.com/AI-team-UoA/pyJedAI/actions/workflows/pypi-publish.yml)
[](https://pyjedai.readthedocs.io/en/latest/?badge=latest)
[](https://codecov.io/gh/AI-team-UoA/pyjedai)
__Statistics & Info__
[](https://pypi.org/project/pyjedai/)
# Bugs, Discussions & News
[GitHub Discussions](https://github.com/AI-team-UoA/pyJedAI/discussions) is the discussion forum for general questions and discussions and our recommended starting point. Please report any bugs that you find [here](https://github.com/AI-team-UoA/pyJedAI/issues).
# Java - Web Application
<img align="left" src="https://github.com/scify/JedAIToolkit/blob/master/documentation/JedAI_logo.png?raw=true" alt="pyJedAI" width="130"/>
For Java users checkout the initial [JedAI](https://github.com/scify/JedAIToolkit). There you can find Java based code and a Web Application for interactive creation of ER workflows. <br><br> JedAI constitutes an open source, high scalability toolkit that offers out-of-the-box solutions for any data integration task, e.g., Record Linkage, Entity Resolution and Link Discovery. At its core lies a set of domain-independent, state-of-the-art techniques that apply to both RDF and relational data.
<br>
# Team & Authors
<img align="right" src="https://github.com/AI-team-UoA/.github/blob/main/AI_LOGO.png?raw=true" alt="pyJedAI" width="200"/>
- [Konstantinos Nikoletos](https://nikoletos-k.github.io), Research Associate at University of Athens, Greece
- [Jakub Maciejewski](https://www.linkedin.com/in/jakub-maciejewski-0270291b7/), Research Associate at University of Athens, Greece
- [George Papadakis](https://gpapadis.wordpress.com), Senior Researcher at University of Athens, Greece
- [Ekaterini Ioannou](https://www.tilburguniversity.edu/staff/ekaterini-ioannou), Assistant Professor at Tilburg University, The Netherlands
- [Manolis Koubarakis](https://cgi.di.uoa.gr/~koubarak/), Professor at University of Athens, Greece
This is a research project by the [AI-Team](https://ai.di.uoa.gr) of the Department of Informatics and Telecommunications at the University of Athens.
# License
Released under the Apache-2.0 license (see [LICENSE.txt](https://github.com/AI-team-UoA/pyJedAI/blob/main/LICENSE)).
Copyright © 2024 AI-Team, University of Athens
<div align="center">
<hr>
<br>
<a href="https://stelar-project.eu">
<img align="center" src="https://stelar-project.eu/wp-content/uploads/2022/08/Logo-Stelar-1-f.png" width=180/>
</a>
<a href="https://ec.europa.eu/info/index_en">
<img align="center" src="https://upload.wikimedia.org/wikipedia/commons/thumb/b/b7/Flag_of_Europe.svg/1200px-Flag_of_Europe.svg.png" width=140/>
</a>
<br>
<br>
<b>This project is being funded in the context of <a href="https://stelar-project.eu">STELAR</a> that is an <a href="https://research-and-innovation.ec.europa.eu/funding/funding-opportunities/funding-programmes-and-open-calls/horizon-europe_en">HORIZON-Europe</a> project.
</b>
<br>
</div>
Raw data
{
"_id": null,
"home_page": null,
"name": "pyjedai",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": null,
"keywords": "deduplication, entity-resolution, link-discovery",
"author": null,
"author_email": "Lefteris Stetsikas <skantzoxoiros45@gmail.com>, Konstantinos Nikoletos <nikoletos.kon@gmail.com>, George Papadakis <gpapadis84@gmail.com>, Jakub Maciejewski <jacobb.maciejewski@gmail.com>, Manolis Koubarakis <koubarak@di.uoa.gr>",
"download_url": "https://files.pythonhosted.org/packages/37/2d/489b91a183d84b83f69f94607da4993701b1c9a7a61d0b805df94557d3f4/pyjedai-0.2.0.tar.gz",
"platform": null,
"description": "<div align=\"center\">\n <br>\n <img align=\"center\" src=\"https://github.com/AI-team-UoA/pyJedAI/blob/main/docs/img/pyjedai.logo.drawio.png?raw=true\" alt=\"pyJedAI\" width=\"400\"/>\n</div>\n<br>\n<br>\n<div align=\"center\">\nAn open-source library that leverages Python\u2019s data science ecosystem to build <br> powerful end-to-end Entity Resolution workflows.\n</div>\n\n\n---\n\n\n# Overview\n\npyJedAI is a python framework, aiming to offer experts and novice users, robust and fast solutions for multiple types of Entity Resolution problems. It is builded using state-of-the-art python frameworks. pyJedAI constitutes the sole open-source Link Discovery tool that is capable of exploiting the latest breakthroughs in Deep Learning and NLP techniques, which are publicly available through the Python data science ecosystem. This applies to both blocking and matching, thus ensuring high time efficiency, high scalability as well as high effectiveness, without requiring any labelled instances from the user.\n\n### Key-Features\n\n- Input data-type independent. Both structured and semi-structured data can be processed.\n- Various implemented algorithms.\n- Easy-to-use.\n- Utilizes some of the famous and cutting-edge machine learning packages.\n- Offers supervised and un-supervised ML techniques.\n\n__Open demos are available in:__\n\n<div align=\"center\">\n <a href=\"https://nbviewer.org/github/AI-team-UoA/pyJedAI/blob/main/docs/tutorials/Demo.ipynb\">\n <img align=\"center\" src=\"https://nbviewer.org/static/img/nav_logo.svg\" width=120/> \n </a> \n <a href=\"https://github.com/AI-team-UoA/pyJedAI/blob/main/docs/tutorials/Demo.ipynb\">\n <img align=\"center\" src=\"https://miro.medium.com/max/1400/1*Edn_LpbSpLeNKfWkEdG2Jg.png\" width=120/> \n </a>\n</div>\n\n__Google Colab Hands-on demo:__ \n\n<div align=\"center\">\n <a href=\"https://colab.research.google.com/drive/18VgEOKAc2ObFFxDNb2sjhBLKKsNvfEPo?usp=sharing\">\n <img align=\"center\" src=\"https://3.bp.blogspot.com/-apoBeWFycKQ/XhKB8fEprwI/AAAAAAAACM4/Sl76yzNSNYwlShIBrheDAum8L9qRtWNdgCLcBGAsYHQ/s1600/colab.png\" width=120/> \n </a>\n</div>\n\n# Install\n\npyJedAI has been tested in Windows and Linux OS. \n\n__Basic requirements:__\n\n- Python version greater or equal to **3.8**.\n- For Windows, Microsoft Visual C++ 14.0 is required. Download it from [Microsoft Official site](https://visualstudio.microsoft.com/visual-cpp-build-tools/).\n\n### PyPI\nInstall the latest version of pyjedai:\n```\npip install pyjedai\n```\nMore on [PyPI](https://pypi.org/project/pyjedai).\n\n### Git\n\nSet up locally:\n```\ngit clone https://github.com/AI-team-UoA/pyJedAI.git\n```\ngo to the root directory with `cd pyJedAI` and type:\n```\npip install .\n```\n\n### Docker\n\nAvailable at [Docker Hub](https://hub.docker.com/r/aiteamuoa/pyjedai), or clone this repo and:\n```\ndocker build -f Dockerfile\n```\n\n# Dependencies\n\n<div align=\"center\">\n <img align=\"center\" src=\"https://upload.wikimedia.org/wikipedia/commons/thumb/e/ed/Pandas_logo.svg/2560px-Pandas_logo.svg.png\" width=120/> \n <img align=\"center\" src=\"https://upload.wikimedia.org/wikipedia/commons/thumb/3/31/NumPy_logo_2020.svg/1280px-NumPy_logo_2020.svg.png\" width=120/> \n <img align=\"center\" src=\"https://logoeps.com/wp-content/uploads/2012/10/python-logo-vector.png\" width=120/> \n <img align=\"center\" src=\"https://upload.wikimedia.org/wikipedia/commons/thumb/3/38/Jupyter_logo.svg/883px-Jupyter_logo.svg.png\" width=70/> <br>\n <img align=\"center\" src=\"https://raw.githubusercontent.com/optuna/optuna/master/docs/image/optuna-logo.png\" width=150/>\n <img align=\"center\" src=\"https://upload.wikimedia.org/wikipedia/commons/thumb/8/8a/Plotly_logo_for_digital_final_%286%29.png/1200px-Plotly_logo_for_digital_final_%286%29.png\" width=150/>\n <img align=\"center\" src=\"https://pytorch.org/tutorials/_static/img/thumbnails/cropped/profiler.png\" width=160/> \n <img align=\"center\" src=\"https://www.fullstackpython.com/img/logos/scipy.png\" width=150/> <br><br>\n <img align=\"center\" src=\"https://www.kornosk.me/resources/language-model/featured.png\" width=150/> \n <img align=\"center\" src=\"https://repository-images.githubusercontent.com/1349775/202c4680-8f7c-11e9-91c6-745fdcbeffe8\" width=150/> \n <img align=\"center\" src=\"https://networkx.org/_static/networkx_logo.svg\" width=150/> \n <img align=\"center\" src=\"https://raw.githubusercontent.com/RDFLib/OWL-RL/master/OWL-RL.png\" width=70/> \n</div>\n<br>\n\nSee the full list of dependencies and all versions used, in this [file](https://github.com/AI-team-UoA/pyJedAI/blob/main/pyproject.toml).\n\n__Status__\n\n[](https://github.com/AI-team-UoA/pyJedAI/actions/workflows/tests.yml)\n[](https://github.com/AI-team-UoA/pyJedAI/actions/workflows/pypi-publish.yml)\n[](https://pyjedai.readthedocs.io/en/latest/?badge=latest)\n[](https://codecov.io/gh/AI-team-UoA/pyjedai)\n\n\n__Statistics & Info__\n\n\n[](https://pypi.org/project/pyjedai/)\n\n\n# Bugs, Discussions & News\n\n[GitHub Discussions](https://github.com/AI-team-UoA/pyJedAI/discussions) is the discussion forum for general questions and discussions and our recommended starting point. Please report any bugs that you find [here](https://github.com/AI-team-UoA/pyJedAI/issues).\n\n# Java - Web Application \n\n<img align=\"left\" src=\"https://github.com/scify/JedAIToolkit/blob/master/documentation/JedAI_logo.png?raw=true\" alt=\"pyJedAI\" width=\"130\"/>\n\nFor Java users checkout the initial [JedAI](https://github.com/scify/JedAIToolkit). There you can find Java based code and a Web Application for interactive creation of ER workflows. <br><br> JedAI constitutes an open source, high scalability toolkit that offers out-of-the-box solutions for any data integration task, e.g., Record Linkage, Entity Resolution and Link Discovery. At its core lies a set of domain-independent, state-of-the-art techniques that apply to both RDF and relational data.\n\n<br>\n\n# Team & Authors\n\n<img align=\"right\" src=\"https://github.com/AI-team-UoA/.github/blob/main/AI_LOGO.png?raw=true\" alt=\"pyJedAI\" width=\"200\"/>\n\n- [Konstantinos Nikoletos](https://nikoletos-k.github.io), Research Associate at University of Athens, Greece\n- [Jakub Maciejewski](https://www.linkedin.com/in/jakub-maciejewski-0270291b7/), Research Associate at University of Athens, Greece\n- [George Papadakis](https://gpapadis.wordpress.com), Senior Researcher at University of Athens, Greece\n- [Ekaterini Ioannou](https://www.tilburguniversity.edu/staff/ekaterini-ioannou), Assistant Professor at Tilburg University, The Netherlands \n- [Manolis Koubarakis](https://cgi.di.uoa.gr/~koubarak/), Professor at University of Athens, Greece\n\nThis is a research project by the [AI-Team](https://ai.di.uoa.gr) of the Department of Informatics and Telecommunications at the University of Athens.\n\n# License\n\nReleased under the Apache-2.0 license (see [LICENSE.txt](https://github.com/AI-team-UoA/pyJedAI/blob/main/LICENSE)).\n\nCopyright \u00a9 2024 AI-Team, University of Athens\n\n<div align=\"center\">\n <hr>\n <br>\n <a href=\"https://stelar-project.eu\">\n <img align=\"center\" src=\"https://stelar-project.eu/wp-content/uploads/2022/08/Logo-Stelar-1-f.png\" width=180/>\n </a> \n <a href=\"https://ec.europa.eu/info/index_en\">\n <img align=\"center\" src=\"https://upload.wikimedia.org/wikipedia/commons/thumb/b/b7/Flag_of_Europe.svg/1200px-Flag_of_Europe.svg.png\" width=140/>\n </a>\n <br>\n <br>\n <b>This project is being funded in the context of <a href=\"https://stelar-project.eu\">STELAR</a> that is an <a href=\"https://research-and-innovation.ec.europa.eu/funding/funding-opportunities/funding-programmes-and-open-calls/horizon-europe_en\">HORIZON-Europe</a> project.\n </b>\n <br>\n</div>\n",
"bugtrack_url": null,
"license": "Apache Software License 2.0",
"summary": "An open-source library that builds powerful end-to-end Entity Resolution workflows.",
"version": "0.2.0",
"project_urls": {
"Bug Tracker": "https://github.com/AI-team-UoA/pyJedAI/issues",
"Documentation": "http://pyjedai.rtfd.io",
"Homepage": "http://pyjedai.rtfd.io",
"Source code": "https://github.com/AI-team-UoA/pyJedAI/tree/main/pyjedai"
},
"split_keywords": [
"deduplication",
" entity-resolution",
" link-discovery"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "56620ddeb29c58d2029bd1483619a4589c33470eae99aa54aec1257ae9ddf585",
"md5": "eb7e6e50e3026974ea04078a586f666f",
"sha256": "d4fe8d53abdf4da2f24035f6de8f1d1dc8f104b039cc1507df1bc544d85286e9"
},
"downloads": -1,
"filename": "pyjedai-0.2.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "eb7e6e50e3026974ea04078a586f666f",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 109173,
"upload_time": "2024-11-11T11:55:23",
"upload_time_iso_8601": "2024-11-11T11:55:23.307421Z",
"url": "https://files.pythonhosted.org/packages/56/62/0ddeb29c58d2029bd1483619a4589c33470eae99aa54aec1257ae9ddf585/pyjedai-0.2.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "372d489b91a183d84b83f69f94607da4993701b1c9a7a61d0b805df94557d3f4",
"md5": "dfd10ef53df6d029666381acd791156f",
"sha256": "a86d0ee5cba0a4cccd3544aaab505e4543eeab40bb7b5e8a12cafa76e6813a81"
},
"downloads": -1,
"filename": "pyjedai-0.2.0.tar.gz",
"has_sig": false,
"md5_digest": "dfd10ef53df6d029666381acd791156f",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 102974,
"upload_time": "2024-11-11T11:55:25",
"upload_time_iso_8601": "2024-11-11T11:55:25.012492Z",
"url": "https://files.pythonhosted.org/packages/37/2d/489b91a183d84b83f69f94607da4993701b1c9a7a61d0b805df94557d3f4/pyjedai-0.2.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-11-11 11:55:25",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "AI-team-UoA",
"github_project": "pyJedAI",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "pyjedai"
}
JSON
