oapapersloader

Name	oapapersloader JSON
Version	1.0.1 JSON
	download
home_page	https://github.com/KNOT-FIT-BUT/OAPapersLoader
Summary	Package for working with OAPapers dataset.
upload_time	2024-04-25 08:38:43
maintainer	None
docs_url	None
author	Martin Dočekal
requires_python	>=3.9
license	The Unlicense
keywords	dataset oapapers loader oapapers dataset
VCS
bugtrack_url
requirements	No requirements were recorded.
Travis-CI	No Travis.
coveralls test coverage	No coveralls.

            # OAPapersLoader
This repository contains python loaders for OAPapers corpus and derived datasets. It accompanies the repository [https://github.com/KNOT-FIT-BUT/OAPapers](https://github.com/KNOT-FIT-BUT/OAPapers) and provides more lightweight solution without exhaustive dependencies to load the OAPapers corpus and derived datasets.


## Install

    pip install oapaersloader

## Usage
An example of loading OARelatedWork dataset with references:

```python
from oapapersloader.datasets import OARelatedWork, OADataset

with OARelatedWork("train.jsonl", "train.jsonl.index") as dataset, \
            OADataset("references.jsonl", "references.jsonl.index") as references:
    d = dataset[0]
    print("Document:", dataset[0].title)
    print("Cited paper:", references.get_by_id(d.citations[0]).title)
```
The OARelatedWork will load the target papers with related work sections and the OADataset will load dataset of all references
that can be used for loading cited papers.

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/KNOT-FIT-BUT/OAPapersLoader",
    "name": "oapapersloader",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.9",
    "maintainer_email": null,
    "keywords": "dataset, OAPapers loader, OAPapers dataset",
    "author": "Martin Do\u010dekal",
    "author_email": null,
    "download_url": "https://files.pythonhosted.org/packages/f9/f5/8acd472a97de80ba8c17413a1f865a409ad78754923c90def6597da07dc3/oapapersloader-1.0.1.tar.gz",
    "platform": null,
    "description": "# OAPapersLoader\nThis repository contains python loaders for OAPapers corpus and derived datasets. It accompanies the repository [https://github.com/KNOT-FIT-BUT/OAPapers](https://github.com/KNOT-FIT-BUT/OAPapers) and provides more lightweight solution without exhaustive dependencies to load the OAPapers corpus and derived datasets.\n\n\n## Install\n\n    pip install oapaersloader\n\n## Usage\nAn example of loading OARelatedWork dataset with references:\n\n```python\nfrom oapapersloader.datasets import OARelatedWork, OADataset\n\nwith OARelatedWork(\"train.jsonl\", \"train.jsonl.index\") as dataset, \\\n            OADataset(\"references.jsonl\", \"references.jsonl.index\") as references:\n    d = dataset[0]\n    print(\"Document:\", dataset[0].title)\n    print(\"Cited paper:\", references.get_by_id(d.citations[0]).title)\n```\nThe OARelatedWork will load the target papers with related work sections and the OADataset will load dataset of all references\nthat can be used for loading cited papers.\n",
    "bugtrack_url": null,
    "license": "The Unlicense",
    "summary": "Package for working with OAPapers dataset.",
    "version": "1.0.1",
    "project_urls": {
        "Homepage": "https://github.com/KNOT-FIT-BUT/OAPapersLoader"
    },
    "split_keywords": [
        "dataset",
        " oapapers loader",
        " oapapers dataset"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "ff66095e216b779364c0512279fdf387d7aaff72f9395b9abae2a969c0e02724",
                "md5": "b7b0c8d38a7b3146a15190dd22429105",
                "sha256": "5ddc48e901e497ce5ea013f6ea52efb7c31f17ea45d0a4e1114ad2d3c9d400d9"
            },
            "downloads": -1,
            "filename": "oapapersloader-1.0.1-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "b7b0c8d38a7b3146a15190dd22429105",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.9",
            "size": 15951,
            "upload_time": "2024-04-25T08:38:41",
            "upload_time_iso_8601": "2024-04-25T08:38:41.308668Z",
            "url": "https://files.pythonhosted.org/packages/ff/66/095e216b779364c0512279fdf387d7aaff72f9395b9abae2a969c0e02724/oapapersloader-1.0.1-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "f9f58acd472a97de80ba8c17413a1f865a409ad78754923c90def6597da07dc3",
                "md5": "1f5e800a8efe4983247285d2b41cc671",
                "sha256": "ed6d9b07590c0db010909362873ca5b1a2cb383ef5d7bd0fc8e11c80f32a95e8"
            },
            "downloads": -1,
            "filename": "oapapersloader-1.0.1.tar.gz",
            "has_sig": false,
            "md5_digest": "1f5e800a8efe4983247285d2b41cc671",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.9",
            "size": 18366,
            "upload_time": "2024-04-25T08:38:43",
            "upload_time_iso_8601": "2024-04-25T08:38:43.015650Z",
            "url": "https://files.pythonhosted.org/packages/f9/f5/8acd472a97de80ba8c17413a1f865a409ad78754923c90def6597da07dc3/oapapersloader-1.0.1.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-04-25 08:38:43",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "KNOT-FIT-BUT",
    "github_project": "OAPapersLoader",
    "github_not_found": true,
    "lcname": "oapapersloader"
}