================
pytest-datafiles
================
.. image:: https://img.shields.io/travis/omarkohl/pytest-datafiles.svg
:target: https://travis-ci.org/omarkohl/pytest-datafiles
.. image:: https://coveralls.io/repos/omarkohl/pytest-datafiles/badge.svg?branch=master&service=github
:target: https://coveralls.io/github/omarkohl/pytest-datafiles?branch=master
.. image:: https://img.shields.io/pypi/v/pytest-datafiles.svg
:target: https://pypi.python.org/pypi/pytest-datafiles
.. image:: https://codeclimate.com/github/omarkohl/pytest-datafiles/badges/gpa.svg
:target: https://codeclimate.com/github/omarkohl/pytest-datafiles
:alt: Code Climate
`pytest`_ plugin to create a `tmp_path`_ containing a preconfigured set of
files and/or directories.
**Note about maintenance:** This project is maintained and bug reports or pull
requests will be addressed. There is little activity because it simply works and
no changes are required.
Features
--------
This plugin allows you to specify one or several files/directories that are
copied to a temporary directory (`tmp_path`_) before the execution of the test.
This means the original files are not modified and every test runs on its own
version of the same files.
Files/directories can be specified either as *strings* or as *pathlib.Path* objects.
To take advantage of the *datafiles* fixture in a test function, add
*datafiles* as one of the test function parameters (per usual with `pytest`_
fixtures) and decorate the test function with *@pytest.mark.datafiles(file1,
file2, dir1, dir2, ...)*. See the examples below.
The *datafiles* variable in your test function is a pathlib.Path object
(`tmp_path`_) where the copied files are located. Under Linux systems this
will most likely be some subdirectory of */tmp/*.
Options
-------
The following options can be specified as keyword arguments (kwargs) to the
*@pytest.mark.datafiles* decorator function:
- **keep_top_dir:** For all parameters that represent directories, keep that
directory instead of only (recursively) copying its content. Possible values
are *True* or *False*. *False* is the default value.
- **on_duplicate:** Specify the action to take when duplicate files/directories
are found. Possible values are: *exception*, *ignore* and *replace*. The
default value is *exception*.
- *exception:* An exception is raised instead of copying the duplicate
file/directory.
- *ignore:* The second (or subsequent) files/directories with the same name
as the first one are simply ignored (i.e., the first file/directory with the
duplicate name is kept).
- *replace:* The second (or subsequent) files/directories with the same name
replace the previous ones (i.e., the last file/directory with the duplicate
name is kept).
See below for some *examples*.
Installation
------------
.. code-block:: bash
pip install pytest-datafiles
Upgrade to 3.0
--------------
Version 3 now uses `tmp_path`_, resulting in `pathlib.Path` objects
instead of `py.path`.
Your tests may need to be adjusted. In `examples/example_upgradev3.py` you see some possible
variations.
Usage
-----
The full code with more details for the examples can be found in `examples/`.
Example 1
~~~~~~~~~
One possible use case is when you are running tests on very big files that are
not included or packaged with your tests. For example, your test files are
large video files stored under */opt/big_files/* . You don't want your tests modifying
the original files, but the files are required by the tests. You can reference these
data files in your test method as follows:
.. code-block:: python
# more details in `examples/example_1.py`
@pytest.mark.datafiles('/opt/big_files/film1.mp4')
def test_fast_forward(datafiles):
# ...
Example 2
~~~~~~~~~
Now for another use case: let's say in the directory where your tests are located, you
place a directory named *test_files*. Here you have a lot of images you want to run tests
on. By using this plugin, you make sure the original files under *test_files* are not
modified by every test.
.. code-block:: python
# more details in `examples/example_2.py`
@pytest.mark.datafiles(
FIXTURE_DIR / 'img1.jpg',
FIXTURE_DIR / 'img2.jpg',
FIXTURE_DIR / 'img3.jpg',
)
def test_find_borders(datafiles):
# ...
Example 3
~~~~~~~~~
If all (or many) of your tests rely on the same files it can be easier to
define one decorator beforehand and apply it to every test like this example:
.. code-block:: python
# more details in `examples/example_3.py`
ALL_IMGS = pytest.mark.datafiles(
FIXTURE_DIR / 'img1.jpg',
FIXTURE_DIR / 'img2.jpg',
FIXTURE_DIR / 'img3.jpg',
)
@ALL_IMGS
def test_something1(datafiles):
# ...
Example 4
~~~~~~~~~
Imagine you have 3 directories (*dir1*, *dir2*, *dir3*) each containing the files
(*fileA* and *fileB*).
This example clarifies the options **on_duplicate** and **keep_top_dir**.
Example 5
~~~~~~~~~
You can also use a str paths.
.. code-block:: python
# more details in `examples/example_5.py`
@pytest.mark.datafiles(
os.path.join(FIXTURE_DIR, 'img1.jpg'),
os.path.join(FIXTURE_DIR, 'img2.jpg'),
os.path.join(FIXTURE_DIR, 'img3.jpg'),
)
def test_str(datafiles):
# ...
Contributing
------------
Contributions are very welcome. Tests can be run with `tox`_. Please
ensure the coverage stays at least the same before you submit a pull
request.
To create and upload a new package first update the version number and then:
.. code-block:: bash
pip3 install --user -U twine
make clean
make dist
twine upload --repository-url https://test.pypi.org/legacy/ dist/*
# Verify the package is usable
virtualenv -p python3 test-venv
test-venv/bin/pip install pytest
test-venv/bin/pip install --index-url https://test.pypi.org/simple/ pytest-datafiles
# Create some test_example.py (e.g. with one of the examples above)
test-venv/bin/pytest test_example.py
# Set the git tag for final release
git tag -a 3.0
git push --tags
# Upload the package for final release
twine upload dist/*
Finally create a release on GitHub and add the packages from dist/* to it.
Of course this will only work if you have the necessary PyPI credentials for
this package.
License
-------
Distributed under the terms of the `MIT license`_, "pytest-datafiles" is
free and open source software.
Issues
------
If you encounter any problems, please `file an issue`_ along with a
detailed description.
Acknowledgements
----------------
Thanks to `@flub`_ for the idea to use `pytest`_ marks to solve the
problem this plugin is trying to solve.
Some ideas to improve this project were taken from the `Cookiecutter`_
templates `cookiecutter-pypackage`_ and `cookiecutter-pytest-plugin`_.
.. _`pytest`: https://docs.pytest.org/en/latest/contents.html
.. _`tmp_path`: https://docs.pytest.org/en/latest/tmp_path.html
.. _`tox`: https://tox.readthedocs.org/en/latest/
.. _`MIT License`: http://opensource.org/licenses/MIT
.. _`file an issue`: https://github.com/omarkohl/pytest-datafiles/issues
.. _`@flub`: https://github.com/flub
.. _`Cookiecutter`: https://github.com/audreyr/cookiecutter
.. _`cookiecutter-pypackage`: https://github.com/audreyr/cookiecutter-pypackage
.. _`cookiecutter-pytest-plugin`: https://github.com/pytest-dev/cookiecutter-pytest-plugin
.. :changelog:
Change Log
----------
All notable changes to this project will be documented in this file.
This project adheres to `Semantic Versioning`_. The change log is
formatted as suggested by `Keep a CHANGELOG`_.
`Unreleased`_
~~~~~~~~~~~~~
Added
Changed
Deprecated
Removed
Fixed
Security
`3.0`_
~~~~~~
Changed
* BREAKING CHANGE: Using `pathlib.Path` instead of `py.path` (`#7`_)
* BREAKING CHANGE: Removed support for Python 2.7 and Python 3 <= 3.6
`2.0.1`_
~~~~~~~~
Fixed
* Register custom marker 'datafiles' to avoid PytestUnknownMarkWarning
(`#18`_)
`2.0`_
~~~~~~
Added
* Explicit support for Python 3.6 (no changes were necessary)
Removed
* BREAKING CHANGE: Python 2.6 is no longer supported (because we rely on pytest
>= 3.6)
Fixed
* Use the new pytest mark API to fix MarkInfo warnings (`#2`_)
* BREAKING CHANGE: Symlinks are now copied as links instead of copying the
target they point to (`#1`_)
`1.0`_
~~~~~~
Changed
* Bump version to 1.0 to signal that the plugin is stable
* Minor refactorization without repercussions for users
* Only use regular 'paths' (str) instead of py.path objects in documentation
examples because they were confusing to some people (unfamiliar with py.path)
`0.2`_
~~~~~~
Added
* Support for directories
* Option 'keep_top_dir' to keep the top level directory (instead of only
copying its content). Possible values are: True, False (default)
* Option 'on_duplicate' to specify what to do when duplicate files or
directories are encountered. Possible values are: 'exception' (default),
'ignore', 'overwrite'
`0.1`_
~~~~~~
Added
* Specify one or multiple files to be copied by decorating the test
function
.. _`Unreleased`: https://github.com/omarkohl/pytest-datafiles/compare/3.0...master
.. _`3.0`: https://github.com/omarkohl/pytest-datafiles/compare/2.0.1...3.0
.. _`2.0.1`: https://github.com/omarkohl/pytest-datafiles/compare/2.0...2.0.1
.. _`2.0`: https://github.com/omarkohl/pytest-datafiles/compare/1.0...2.0
.. _`1.0`: https://github.com/omarkohl/pytest-datafiles/compare/0.2...1.0
.. _`0.2`: https://github.com/omarkohl/pytest-datafiles/compare/0.1...0.2
.. _`0.1`: https://github.com/omarkohl/pytest-datafiles/compare/3c31b2c...0.1
.. _`#1`: https://github.com/omarkohl/pytest-datafiles/issues/1
.. _`#2`: https://github.com/omarkohl/pytest-datafiles/issues/2
.. _`#7`: https://github.com/omarkohl/pytest-datafiles/issues/7
.. _`#18`: https://github.com/omarkohl/pytest-datafiles/issues/18
.. _`Semantic Versioning`: http://semver.org/
.. _`Keep a CHANGELOG`: http://keepachangelog.com/
Raw data
{
"_id": null,
"home_page": "https://github.com/omarkohl/pytest-datafiles",
"name": "pytest-datafiles",
"maintainer": "Omar Kohl",
"docs_url": null,
"requires_python": "",
"maintainer_email": "omarkohl@gmail.com",
"keywords": "pytest datafiles tmp_path",
"author": "Omar Kohl",
"author_email": "omarkohl@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/e7/1d/723fa4be3dec5384eb332888c1a22b4eeff848f9121efdded6859420902a/pytest-datafiles-3.0.0.tar.gz",
"platform": null,
"description": "================\npytest-datafiles\n================\n\n.. image:: https://img.shields.io/travis/omarkohl/pytest-datafiles.svg\n :target: https://travis-ci.org/omarkohl/pytest-datafiles\n\n\n.. image:: https://coveralls.io/repos/omarkohl/pytest-datafiles/badge.svg?branch=master&service=github\n :target: https://coveralls.io/github/omarkohl/pytest-datafiles?branch=master\n\n\n.. image:: https://img.shields.io/pypi/v/pytest-datafiles.svg\n :target: https://pypi.python.org/pypi/pytest-datafiles\n\n\n.. image:: https://codeclimate.com/github/omarkohl/pytest-datafiles/badges/gpa.svg\n :target: https://codeclimate.com/github/omarkohl/pytest-datafiles\n :alt: Code Climate\n\n\n`pytest`_ plugin to create a `tmp_path`_ containing a preconfigured set of\nfiles and/or directories.\n\n**Note about maintenance:** This project is maintained and bug reports or pull\nrequests will be addressed. There is little activity because it simply works and\nno changes are required.\n\nFeatures\n--------\n\nThis plugin allows you to specify one or several files/directories that are\ncopied to a temporary directory (`tmp_path`_) before the execution of the test.\nThis means the original files are not modified and every test runs on its own\nversion of the same files.\n\nFiles/directories can be specified either as *strings* or as *pathlib.Path* objects.\n\nTo take advantage of the *datafiles* fixture in a test function, add\n*datafiles* as one of the test function parameters (per usual with `pytest`_\nfixtures) and decorate the test function with *@pytest.mark.datafiles(file1,\nfile2, dir1, dir2, ...)*. See the examples below.\n\nThe *datafiles* variable in your test function is a pathlib.Path object\n(`tmp_path`_) where the copied files are located. Under Linux systems this\nwill most likely be some subdirectory of */tmp/*.\n\n\nOptions\n-------\n\nThe following options can be specified as keyword arguments (kwargs) to the\n*@pytest.mark.datafiles* decorator function:\n\n- **keep_top_dir:** For all parameters that represent directories, keep that\n directory instead of only (recursively) copying its content. Possible values\n are *True* or *False*. *False* is the default value.\n- **on_duplicate:** Specify the action to take when duplicate files/directories\n are found. Possible values are: *exception*, *ignore* and *replace*. The\n default value is *exception*.\n\n - *exception:* An exception is raised instead of copying the duplicate\n file/directory.\n - *ignore:* The second (or subsequent) files/directories with the same name\n as the first one are simply ignored (i.e., the first file/directory with the\n duplicate name is kept).\n - *replace:* The second (or subsequent) files/directories with the same name\n replace the previous ones (i.e., the last file/directory with the duplicate\n name is kept).\n\nSee below for some *examples*.\n\n\nInstallation\n------------\n\n.. code-block:: bash\n\n pip install pytest-datafiles\n\n\nUpgrade to 3.0\n--------------\n\nVersion 3 now uses `tmp_path`_, resulting in `pathlib.Path` objects\ninstead of `py.path`.\n\nYour tests may need to be adjusted. In `examples/example_upgradev3.py` you see some possible\nvariations.\n\n\nUsage\n-----\n\nThe full code with more details for the examples can be found in `examples/`.\n\nExample 1\n~~~~~~~~~\n\nOne possible use case is when you are running tests on very big files that are\nnot included or packaged with your tests. For example, your test files are\nlarge video files stored under */opt/big_files/* . You don't want your tests modifying\nthe original files, but the files are required by the tests. You can reference these\ndata files in your test method as follows:\n\n.. code-block:: python\n\n # more details in `examples/example_1.py`\n\n @pytest.mark.datafiles('/opt/big_files/film1.mp4')\n def test_fast_forward(datafiles):\n # ...\n\n\nExample 2\n~~~~~~~~~\n\nNow for another use case: let's say in the directory where your tests are located, you\nplace a directory named *test_files*. Here you have a lot of images you want to run tests\non. By using this plugin, you make sure the original files under *test_files* are not\nmodified by every test.\n\n.. code-block:: python\n\n # more details in `examples/example_2.py`\n\n @pytest.mark.datafiles(\n FIXTURE_DIR / 'img1.jpg',\n FIXTURE_DIR / 'img2.jpg',\n FIXTURE_DIR / 'img3.jpg',\n )\n def test_find_borders(datafiles):\n # ...\n\n\nExample 3\n~~~~~~~~~\n\nIf all (or many) of your tests rely on the same files it can be easier to\ndefine one decorator beforehand and apply it to every test like this example:\n\n.. code-block:: python\n\n # more details in `examples/example_3.py`\n\n ALL_IMGS = pytest.mark.datafiles(\n FIXTURE_DIR / 'img1.jpg',\n FIXTURE_DIR / 'img2.jpg',\n FIXTURE_DIR / 'img3.jpg',\n )\n\n @ALL_IMGS\n def test_something1(datafiles):\n # ...\n\n\nExample 4\n~~~~~~~~~\n\nImagine you have 3 directories (*dir1*, *dir2*, *dir3*) each containing the files\n(*fileA* and *fileB*).\n\nThis example clarifies the options **on_duplicate** and **keep_top_dir**.\n\n\nExample 5\n~~~~~~~~~\n\nYou can also use a str paths.\n\n.. code-block:: python\n\n # more details in `examples/example_5.py`\n\n @pytest.mark.datafiles(\n os.path.join(FIXTURE_DIR, 'img1.jpg'),\n os.path.join(FIXTURE_DIR, 'img2.jpg'),\n os.path.join(FIXTURE_DIR, 'img3.jpg'),\n )\n def test_str(datafiles):\n # ...\n\n\nContributing\n------------\n\nContributions are very welcome. Tests can be run with `tox`_. Please\nensure the coverage stays at least the same before you submit a pull\nrequest.\n\nTo create and upload a new package first update the version number and then:\n\n.. code-block:: bash\n\n pip3 install --user -U twine\n make clean\n make dist\n twine upload --repository-url https://test.pypi.org/legacy/ dist/*\n # Verify the package is usable\n virtualenv -p python3 test-venv\n test-venv/bin/pip install pytest\n test-venv/bin/pip install --index-url https://test.pypi.org/simple/ pytest-datafiles\n # Create some test_example.py (e.g. with one of the examples above)\n test-venv/bin/pytest test_example.py\n # Set the git tag for final release\n git tag -a 3.0\n git push --tags\n # Upload the package for final release\n twine upload dist/*\n\nFinally create a release on GitHub and add the packages from dist/* to it.\n\nOf course this will only work if you have the necessary PyPI credentials for\nthis package.\n\n\nLicense\n-------\n\nDistributed under the terms of the `MIT license`_, \"pytest-datafiles\" is\nfree and open source software.\n\n\nIssues\n------\n\nIf you encounter any problems, please `file an issue`_ along with a\ndetailed description.\n\n\nAcknowledgements\n----------------\n\nThanks to `@flub`_ for the idea to use `pytest`_ marks to solve the\nproblem this plugin is trying to solve.\n\nSome ideas to improve this project were taken from the `Cookiecutter`_\ntemplates `cookiecutter-pypackage`_ and `cookiecutter-pytest-plugin`_.\n\n\n.. _`pytest`: https://docs.pytest.org/en/latest/contents.html\n.. _`tmp_path`: https://docs.pytest.org/en/latest/tmp_path.html\n.. _`tox`: https://tox.readthedocs.org/en/latest/\n.. _`MIT License`: http://opensource.org/licenses/MIT\n.. _`file an issue`: https://github.com/omarkohl/pytest-datafiles/issues\n.. _`@flub`: https://github.com/flub\n.. _`Cookiecutter`: https://github.com/audreyr/cookiecutter\n.. _`cookiecutter-pypackage`: https://github.com/audreyr/cookiecutter-pypackage\n.. _`cookiecutter-pytest-plugin`: https://github.com/pytest-dev/cookiecutter-pytest-plugin\n\n\n.. :changelog:\n\nChange Log\n----------\n\nAll notable changes to this project will be documented in this file.\nThis project adheres to `Semantic Versioning`_. The change log is\nformatted as suggested by `Keep a CHANGELOG`_.\n\n`Unreleased`_\n~~~~~~~~~~~~~\n\nAdded\nChanged\nDeprecated\nRemoved\nFixed\nSecurity\n\n`3.0`_\n~~~~~~\n\nChanged\n\n* BREAKING CHANGE: Using `pathlib.Path` instead of `py.path` (`#7`_)\n* BREAKING CHANGE: Removed support for Python 2.7 and Python 3 <= 3.6\n\n`2.0.1`_\n~~~~~~~~\n\nFixed\n\n* Register custom marker 'datafiles' to avoid PytestUnknownMarkWarning\n (`#18`_)\n\n`2.0`_\n~~~~~~\n\nAdded\n\n* Explicit support for Python 3.6 (no changes were necessary)\n\nRemoved\n\n* BREAKING CHANGE: Python 2.6 is no longer supported (because we rely on pytest\n >= 3.6)\n\nFixed\n\n* Use the new pytest mark API to fix MarkInfo warnings (`#2`_)\n* BREAKING CHANGE: Symlinks are now copied as links instead of copying the\n target they point to (`#1`_)\n\n`1.0`_\n~~~~~~\n\nChanged\n\n* Bump version to 1.0 to signal that the plugin is stable\n* Minor refactorization without repercussions for users\n* Only use regular 'paths' (str) instead of py.path objects in documentation\n examples because they were confusing to some people (unfamiliar with py.path)\n\n`0.2`_\n~~~~~~\n\nAdded\n\n* Support for directories\n* Option 'keep_top_dir' to keep the top level directory (instead of only\n copying its content). Possible values are: True, False (default)\n* Option 'on_duplicate' to specify what to do when duplicate files or\n directories are encountered. Possible values are: 'exception' (default),\n 'ignore', 'overwrite'\n\n`0.1`_\n~~~~~~\n\nAdded\n\n* Specify one or multiple files to be copied by decorating the test\n function\n\n\n.. _`Unreleased`: https://github.com/omarkohl/pytest-datafiles/compare/3.0...master\n.. _`3.0`: https://github.com/omarkohl/pytest-datafiles/compare/2.0.1...3.0\n.. _`2.0.1`: https://github.com/omarkohl/pytest-datafiles/compare/2.0...2.0.1\n.. _`2.0`: https://github.com/omarkohl/pytest-datafiles/compare/1.0...2.0\n.. _`1.0`: https://github.com/omarkohl/pytest-datafiles/compare/0.2...1.0\n.. _`0.2`: https://github.com/omarkohl/pytest-datafiles/compare/0.1...0.2\n.. _`0.1`: https://github.com/omarkohl/pytest-datafiles/compare/3c31b2c...0.1\n\n\n.. _`#1`: https://github.com/omarkohl/pytest-datafiles/issues/1\n.. _`#2`: https://github.com/omarkohl/pytest-datafiles/issues/2\n.. _`#7`: https://github.com/omarkohl/pytest-datafiles/issues/7\n.. _`#18`: https://github.com/omarkohl/pytest-datafiles/issues/18\n\n\n.. _`Semantic Versioning`: http://semver.org/\n.. _`Keep a CHANGELOG`: http://keepachangelog.com/\n\n\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "py.test plugin to create a 'tmp_path' containing predefined files/directories.",
"version": "3.0.0",
"project_urls": {
"Homepage": "https://github.com/omarkohl/pytest-datafiles"
},
"split_keywords": [
"pytest",
"datafiles",
"tmp_path"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "0bd7a29d8b79a8cf3125a4ed9af80cd93ef0374a8e8f6ea40268ed5cc2a6ce1d",
"md5": "166e3b3928216108c2bf622e345b8955",
"sha256": "2176e10d3f6e76f358925a897e21e2bcc5a0170b92fac4e66ed055eaa2ca6a22"
},
"downloads": -1,
"filename": "pytest_datafiles-3.0.0-py2.py3-none-any.whl",
"has_sig": false,
"md5_digest": "166e3b3928216108c2bf622e345b8955",
"packagetype": "bdist_wheel",
"python_version": "py2.py3",
"requires_python": null,
"size": 7416,
"upload_time": "2023-02-24T10:23:38",
"upload_time_iso_8601": "2023-02-24T10:23:38.104659Z",
"url": "https://files.pythonhosted.org/packages/0b/d7/a29d8b79a8cf3125a4ed9af80cd93ef0374a8e8f6ea40268ed5cc2a6ce1d/pytest_datafiles-3.0.0-py2.py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "e71d723fa4be3dec5384eb332888c1a22b4eeff848f9121efdded6859420902a",
"md5": "8f5f202a9f9c4e0f55b107292d2d7fc0",
"sha256": "a70c4c66a36d1cdcfc095607f04eee66eaef3fa64cbb62d60c47ce169901d1d4"
},
"downloads": -1,
"filename": "pytest-datafiles-3.0.0.tar.gz",
"has_sig": false,
"md5_digest": "8f5f202a9f9c4e0f55b107292d2d7fc0",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 8357,
"upload_time": "2023-02-24T10:23:39",
"upload_time_iso_8601": "2023-02-24T10:23:39.855516Z",
"url": "https://files.pythonhosted.org/packages/e7/1d/723fa4be3dec5384eb332888c1a22b4eeff848f9121efdded6859420902a/pytest-datafiles-3.0.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-02-24 10:23:39",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "omarkohl",
"github_project": "pytest-datafiles",
"travis_ci": true,
"coveralls": true,
"github_actions": false,
"tox": true,
"lcname": "pytest-datafiles"
}
JSON
