# FOLIO Migration Tools
[](https://codecov.io/gh/FOLIO-FSE/folio_migration_tools) [](https://folio-migration-tools.readthedocs.io/)
A toolkit that enables you to migrate data over from a legacy ILS system into [FOLIO LSP](https://www.folio.org/)
# What is it good for?
FOLIO Migration tools enables you to migrate libraries with the most common ILS:s over to FOLIO without data losses or any major data transformation tasks.
The tools transforms and loads the data providing you and the library with good actionable logs and data cleaning task lists together with the migrated data.
## What data does it cover?
FOLIO Migration Tools currently covers the following data sets:
* Catalog (Inventory and SRS in FOLIO terminology)
* Circulation transactions (Open loans and requests)
* Users/Patrons (In FOLIO, these share the same app/database)
* Courses and Reserves (Course reserves)
* Organizations (Vendor records)
* Orders (limited support)
### What additional functionality is on the roadmap?
This is the loose roadmap, in order of most likely implementations first
* ERM-related objects
* Financial records
### Can I use the tools for ongoing imports and integrations?
The tools are primarliy maintained for performing initial data migrations. We recommend that you use native FOLIO functionality for ongoing loads where possible.
In theory, these tools can be used for ongoing patron loads from systems like Banner, Workday, or PeopleSoft. But we recommend you to weigh your options carefully before going down this path.
# Contributing
Want to contribute? Read the [CONTRIBUTING.MD](https://github.com/FOLIO-FSE/folio_migration_tools/blob/main/CONTRIBUTING.md)
# Found an issue?
Report it on the [Github Issue tracker](https://github.com/FOLIO-FSE/folio_migration_tools/issues)
The scripts requires a FOLIO tenant with reference data properly set up. The script will throw messages telling what reference data is missing.
# Installing
Make sure you are running Python 3.9 or above.
## 1. Using pip and venv
### 2.1. Create and activate a [virtual environment](https://packaging.python.org/en/latest/guides/installing-using-pip-and-virtual-environments/#creating-a-virtual-environment)
```
python -m venv ./.venv # Creates a virtual env in the current folder
source .venv/bin/activate # Activates the venv
```
### 2. Install using pip:
```
python -m pip install folio_migration_tools
```
### 3. Test the installation by showing the help pages
```
python -m folio_migration_tools -h
```
## 2. Using pipenv
### 1. Run
```
pipenv install folio-migration-tools
```
### 2. Test the installation by showing the help pages
```
pipenv run python3 -m folio_migration_tools -h
```
# FOLIO migration process
This repo plays the main part in a process using a collection of tools. The process itself is documented in more detail, including example configuration files, at [this template repository](https://github.com/FOLIO-FSE/migration_repo_template)
In order to perform migrations according to this process, you need the following:
* An Installation of [FOLIO Migration Tools](https://pypi.org/project/folio-migration-tools/). Installation instructions above.
* A clone, or a separate repo created from [migration_repo_template](https://github.com/FOLIO-FSE/migration_repo_template)
* Access to the [Data mapping file creator](https://data-mapping-file-creator.folio.ebsco.com/data_mapping_creation) web tool
* A FOLIO tenant running the latest or the second latest version of FOLIO
# Internationalization
This repo uses [Python-i18n](https://github.com/danhper/python-i18n) to translate reports between languages, and to handle large strings for templates.
**Any English string which will end up in a report** should be wrapped in the function `i18n.t` from `i18n`:
## Keys/Usage
```js
i18n.t("Reports")+":"
```
Templating is achieved with `%{[key]}` blocks, and keyword arguments in the internationaliation:
```js
i18n.t("Code '%{code}' not found in FOLIO",code=folio_code)
```
Long strings can use a placeholder key:
```js
i18n.t("blurbs.Introduction.description")
```
With the full string in ```translations/en.json```:
```json
"blurbs.Introduction.description": "<br/>Data errors preventing records from being migrated
```
## Translations Files
Translation files live in the `translations` directory, with `en.json` as the default.
Extract template files with the `extract_translations` script:
```bash
python scripts/extract_translations.py
```
## Internationalizations
Other langauges translations live in `translations/[locale].json`.
For example, Spanish would be `es.json`.
The keys must match the English keys, but the Values should be translated.
You can update a language file's keys with:
```bash
python scripts/update_language.py --target-lang [locale]
```
Translate all new strings, which begin with `TRANSLATE`, then commit.
## Tips
* Internationalize entire phrases or paragraphs, not just the constitutent words. Syntax and grammar vary significantly between languages.
* Name template variables as generically as possible in the circumstance, and check translations for reusable translations.
* In a block with sentences separately followed by values, such as a table, you only need to translate the sentences.
# Running the scripts
For information on syntax, what files are needed and produced by the toolkit, refer to the documentation and example files in the [template repository](https://github.com/FOLIO-FSE/migration_repo_template). We are building out the docs section in this repository as well:[Documentation](https://folio-migration-tools.readthedocs.io/en/latest/)
ยจ
Raw data
{
"_id": null,
"home_page": "https://github.com/FOLIO-FSE/folio_migration_tools",
"name": "folio-migration-tools",
"maintainer": null,
"docs_url": null,
"requires_python": "<4.0,>=3.9",
"maintainer_email": null,
"keywords": "FOLIO, ILS, LSP, Library Systems, MARC21, Library data",
"author": "Theodor Tolstoy",
"author_email": "github.teddes@tolstoy.se",
"download_url": "https://files.pythonhosted.org/packages/8b/73/4ca12f103480ff8e3c6042a6eb19c776553c28a02ef886bc6139f7f3bbfb/folio_migration_tools-1.8.10.tar.gz",
"platform": null,
"description": "# FOLIO Migration Tools\n[](https://codecov.io/gh/FOLIO-FSE/folio_migration_tools) [](https://folio-migration-tools.readthedocs.io/)\n\nA toolkit that enables you to migrate data over from a legacy ILS system into [FOLIO LSP](https://www.folio.org/)\n\n# What is it good for?\nFOLIO Migration tools enables you to migrate libraries with the most common ILS:s over to FOLIO without data losses or any major data transformation tasks. \nThe tools transforms and loads the data providing you and the library with good actionable logs and data cleaning task lists together with the migrated data.\n\n## What data does it cover?\nFOLIO Migration Tools currently covers the following data sets:\n* Catalog (Inventory and SRS in FOLIO terminology)\n* Circulation transactions (Open loans and requests)\n* Users/Patrons (In FOLIO, these share the same app/database)\n* Courses and Reserves (Course reserves)\n* Organizations (Vendor records)\n* Orders (limited support)\n\n### What additional functionality is on the roadmap?\nThis is the loose roadmap, in order of most likely implementations first\n* ERM-related objects\n* Financial records\n\n### Can I use the tools for ongoing imports and integrations?\nThe tools are primarliy maintained for performing initial data migrations. We recommend that you use native FOLIO functionality for ongoing loads where possible. \nIn theory, these tools can be used for ongoing patron loads from systems like Banner, Workday, or PeopleSoft. But we recommend you to weigh your options carefully before going down this path. \n\n# Contributing\nWant to contribute? Read the [CONTRIBUTING.MD](https://github.com/FOLIO-FSE/folio_migration_tools/blob/main/CONTRIBUTING.md)\n\n# Found an issue?\nReport it on the [Github Issue tracker](https://github.com/FOLIO-FSE/folio_migration_tools/issues)\n\nThe scripts requires a FOLIO tenant with reference data properly set up. The script will throw messages telling what reference data is missing.\n# Installing\nMake sure you are running Python 3.9 or above. \n## 1. Using pip and venv\n### 2.1. Create and activate a [virtual environment](https://packaging.python.org/en/latest/guides/installing-using-pip-and-virtual-environments/#creating-a-virtual-environment) \n``` \npython -m venv ./.venv # Creates a virtual env in the current folder\nsource .venv/bin/activate # Activates the venv \n```\n### 2. Install using pip: \n```\npython -m pip install folio_migration_tools\n```\n### 3. Test the installation by showing the help pages \n``` \npython -m folio_migration_tools -h\n``` \n\n## 2. Using pipenv\n### 1. Run\n``` \npipenv install folio-migration-tools\n``` \n### 2. Test the installation by showing the help pages\n``` \npipenv run python3 -m folio_migration_tools -h\n```\n\n# FOLIO migration process\nThis repo plays the main part in a process using a collection of tools. The process itself is documented in more detail, including example configuration files, at [this template repository](https://github.com/FOLIO-FSE/migration_repo_template)\nIn order to perform migrations according to this process, you need the following:\n* An Installation of [FOLIO Migration Tools](https://pypi.org/project/folio-migration-tools/). Installation instructions above.\n* A clone, or a separate repo created from [migration_repo_template](https://github.com/FOLIO-FSE/migration_repo_template)\n* Access to the [Data mapping file creator](https://data-mapping-file-creator.folio.ebsco.com/data_mapping_creation) web tool\n* A FOLIO tenant running the latest or the second latest version of FOLIO\n\n# Internationalization\n\nThis repo uses [Python-i18n](https://github.com/danhper/python-i18n) to translate reports between languages, and to handle large strings for templates.\n\n**Any English string which will end up in a report** should be wrapped in the function `i18n.t` from `i18n`:\n\n## Keys/Usage\n\n```js\ni18n.t(\"Reports\")+\":\"\n```\n\nTemplating is achieved with `%{[key]}` blocks, and keyword arguments in the internationaliation:\n\n```js\ni18n.t(\"Code '%{code}' not found in FOLIO\",code=folio_code)\n```\n\nLong strings can use a placeholder key:\n\n```js\ni18n.t(\"blurbs.Introduction.description\")\n```\n\nWith the full string in ```translations/en.json```:\n\n```json\n\"blurbs.Introduction.description\": \"<br/>Data errors preventing records from being migrated\n```\n\n## Translations Files\n\nTranslation files live in the `translations` directory, with `en.json` as the default.\n\nExtract template files with the `extract_translations` script:\n\n```bash\npython scripts/extract_translations.py\n```\n\n## Internationalizations\n\nOther langauges translations live in `translations/[locale].json`.\nFor example, Spanish would be `es.json`. \n\nThe keys must match the English keys, but the Values should be translated.\n\nYou can update a language file's keys with:\n\n```bash\npython scripts/update_language.py --target-lang [locale]\n```\n\nTranslate all new strings, which begin with `TRANSLATE`, then commit.\n\n## Tips\n\n* Internationalize entire phrases or paragraphs, not just the constitutent words. Syntax and grammar vary significantly between languages.\n* Name template variables as generically as possible in the circumstance, and check translations for reusable translations.\n* In a block with sentences separately followed by values, such as a table, you only need to translate the sentences. \n\n# Running the scripts\nFor information on syntax, what files are needed and produced by the toolkit, refer to the documentation and example files in the [template repository](https://github.com/FOLIO-FSE/migration_repo_template). We are building out the docs section in this repository as well:[Documentation](https://folio-migration-tools.readthedocs.io/en/latest/)\n\u00a8\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "A tool allowing you to migrate data from legacy ILS:s (Library systems) into FOLIO LSP",
"version": "1.8.10",
"project_urls": {
"Homepage": "https://github.com/FOLIO-FSE/folio_migration_tools",
"Repository": "https://github.com/FOLIO-FSE/folio_migration_tools"
},
"split_keywords": [
"folio",
" ils",
" lsp",
" library systems",
" marc21",
" library data"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "9fe6a4d7216eaab77a5b424581f17bfe2cd936fa99f6856c92227c5ace022ef6",
"md5": "f5273f7ad53e2ea9a9cff8ff1a3bc8b7",
"sha256": "67fa49a718ba1ae59a9212499782911ce0c12d0171dbbfece988f74be1c74129"
},
"downloads": -1,
"filename": "folio_migration_tools-1.8.10-py3-none-any.whl",
"has_sig": false,
"md5_digest": "f5273f7ad53e2ea9a9cff8ff1a3bc8b7",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": "<4.0,>=3.9",
"size": 211621,
"upload_time": "2024-03-27T17:40:10",
"upload_time_iso_8601": "2024-03-27T17:40:10.364399Z",
"url": "https://files.pythonhosted.org/packages/9f/e6/a4d7216eaab77a5b424581f17bfe2cd936fa99f6856c92227c5ace022ef6/folio_migration_tools-1.8.10-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "8b734ca12f103480ff8e3c6042a6eb19c776553c28a02ef886bc6139f7f3bbfb",
"md5": "1472141001157c682a894e233277bc07",
"sha256": "1a355b0050d797fc80847f5499a8a64360736ec9f8522cbf9f4cc2ad93d8b295"
},
"downloads": -1,
"filename": "folio_migration_tools-1.8.10.tar.gz",
"has_sig": false,
"md5_digest": "1472141001157c682a894e233277bc07",
"packagetype": "sdist",
"python_version": "source",
"requires_python": "<4.0,>=3.9",
"size": 174843,
"upload_time": "2024-03-27T17:40:12",
"upload_time_iso_8601": "2024-03-27T17:40:12.708470Z",
"url": "https://files.pythonhosted.org/packages/8b/73/4ca12f103480ff8e3c6042a6eb19c776553c28a02ef886bc6139f7f3bbfb/folio_migration_tools-1.8.10.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-03-27 17:40:12",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "FOLIO-FSE",
"github_project": "folio_migration_tools",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "folio-migration-tools"
}
JSON
