Django Cleanup
**************
|Version| |Status| |License|
Features
========
The django-cleanup app automatically deletes files for :code:`FileField`, :code:`ImageField` and
subclasses. When a :code:`FileField`'s value is changed and the model is saved, the old file is
deleted. When a model that has a :code:`FileField` is deleted, the file is also deleted. A file that
is set as the :code:`FileField`'s default value will not be deleted.
Compatibility
-------------
- Django 3.2, 4.1, 4.2, 5.0 (`See Django Supported Versions <https://www.djangoproject.com/download/#supported-versions>`_)
- Python 3.6+
- Compatible with `sorl-thumbnail <https://github.com/jazzband/sorl-thumbnail>`_
- Compatible with `easy-thumbnail <https://github.com/SmileyChris/easy-thumbnails>`_
How does it work?
=================
In order to track changes of a :code:`FileField` and facilitate file deletions, django-cleanup
connects :code:`post_init`, :code:`pre_save`, :code:`post_save` and :code:`post_delete` signals to
signal handlers for each :code:`INSTALLED_APPS` model that has a :code:`FileField`. In order to tell
whether or not a :code:`FileField`'s value has changed a local cache of original values is kept on
the model instance. If a condition is detected that should result in a file deletion, a function to
delete the file is setup and inserted into the commit phase of the current transaction.
**Warning! Please be aware of the known limitations documented below!**
Installation
============
::
pip install django-cleanup
Configuration
=============
Add ``django_cleanup`` to the bottom of ``INSTALLED_APPS`` in ``settings.py``
.. code-block:: py
INSTALLED_APPS = (
...,
'django_cleanup.apps.CleanupConfig',
)
That is all, no other configuration is necessary.
Note: Order of ``INSTALLED_APPS`` is important. To ensure that exceptions inside other apps' signal
handlers do not affect the integrity of file deletions within transactions, ``django_cleanup``
should be placed last in ``INSTALLED_APPS``.
Troubleshooting
===============
If you notice that ``django-cleanup`` is not removing files when expected, check that your models
are being properly
`loaded <https://docs.djangoproject.com/en/stable/ref/applications/#how-applications-are-loaded>`_:
You must define or import all models in your application's models.py or models/__init__.py.
Otherwise, the application registry may not be fully populated at this point, which could cause
the ORM to malfunction.
If your models are not loaded, ``django-cleanup`` will not be able to discover their
``FileField``'s.
You can check if your ``Model`` is loaded by using
.. code-block:: py
from django.apps import apps
apps.get_models()
Known limitations
=================
Database should support transactions
------------------------------------
If you are using a database that does not support transactions you may lose files if a
transaction will rollback at the right instance. This outcome is mitigated by our use of
post_save and post_delete signals, and by following the recommended configuration in this README.
This outcome will still occur if there are signals registered after app initialization and there are
exceptions when those signals are handled. In this case, the old file will be lost and the new file
will not be referenced in a model, though the new file will likely still exist on disk. If you are
concerned about this behavior you will need another solution for old file deletion in your project.
File referenced by multiple model instances
-------------------------------------------
This app is designed with the assumption that each file is referenced only once. If you are sharing
a file over two or more model instances you will not have the desired functionality. Be cautious of
copying model instances, as this will cause a file to be shared by more than one instance. If you
want to reference a file from multiple models add a level of indirection. That is, use a separate
file model that is referenced from other models through a foreign key. There are many file
management apps already available in the django ecosystem that fulfill this behavior.
Advanced
========
This section contains additional functionality that can be used to interact with django-cleanup for
special cases.
Signals
-------
To facilitate interactions with other django apps django-cleanup sends the following signals which
can be imported from :code:`django_cleanup.signals`:
- :code:`cleanup_pre_delete`: just before a file is deleted. Passes a :code:`file` keyword argument.
- :code:`cleanup_post_delete`: just after a file is deleted. Passes a :code:`file` keyword argument.
Signals example for sorl.thumbnail:
.. code-block:: py
from django_cleanup.signals import cleanup_pre_delete
from sorl.thumbnail import delete
def sorl_delete(**kwargs):
delete(kwargs['file'])
cleanup_pre_delete.connect(sorl_delete)
Refresh the cache
-----------------
There have been rare cases where the cache would need to be refreshed. To do so the
:code:`django_cleanup.cleanup.refresh` method can be used:
.. code-block:: py
from django_cleanup import cleanup
cleanup.refresh(model_instance)
Ignore cleanup for a specific model
-----------------------------------
To ignore a model and not have cleanup performed when the model is deleted or its files change, use
the :code:`ignore` decorator to mark that model:
.. code-block:: py
from django_cleanup import cleanup
@cleanup.ignore
class MyModel(models.Model):
image = models.FileField()
Only cleanup selected models
----------------------------
If you have many models to ignore, or if you prefer to be explicit about what models are selected,
you can change the mode of django-cleanup to "select mode" by using the select mode app config. In
your ``INSTALLED_APPS`` setting you will replace ':code:`django_cleanup.apps.CleanupConfig`'
with ':code:`django_cleanup.apps.CleanupSelectedConfig`'. Then use the :code:`select` decorator to
mark a model for cleanup:
.. code-block:: py
from django_cleanup import cleanup
@cleanup.select
class MyModel(models.Model):
image = models.FileField()
How to run tests
================
Install, setup and use pyenv_ to install all the required versions of cPython
(see the `tox.ini <https://github.com/un1t/django-cleanup/blob/master/tox.ini>`_).
Setup pyenv_ to have all versions of python activated within your local django-cleanup repository.
Ensuring that the python 3.12 that was installed is first priority.
Install tox_ on python 3.12 and run the :code:`tox` command from your local django-cleanup
repository.
How to write tests
==================
This app requires the use of django.test.TransactionTestCase_ when writing tests.
For details on why this is required see `here
<https://docs.djangoproject.com/en/stable/topics/db/transactions/#use-in-tests>`_:
Django's :code:`TestCase` class wraps each test in a transaction and rolls back that transaction
after each test, in order to provide test isolation. This means that no transaction is ever
actually committed, thus your :code:`on_commit()` callbacks will never be run. If you need to
test the results of an :code:`on_commit()` callback, use a :code:`TransactionTestCase` instead.
License
=======
django-cleanup is free software under terms of the:
MIT License
Copyright (C) 2012 by Ilya Shalyapin, ishalyapin@gmail.com
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
.. _django.test.TransactionTestCase: https://docs.djangoproject.com/en/stable/topics/testing/tools/#django.test.TransactionTestCase
.. _pyenv: https://github.com/pyenv/pyenv
.. _tox: https://tox.readthedocs.io/en/latest/
.. |Version| image:: https://img.shields.io/pypi/v/django-cleanup.svg
:target: https://pypi.python.org/pypi/django-cleanup/
:alt: PyPI Package
.. |Status| image:: https://github.com/un1t/django-cleanup/actions/workflows/main.yml/badge.svg
:target: https://github.com/un1t/django-cleanup/actions/workflows/main.yml
:alt: Build Status
.. |License| image:: https://img.shields.io/badge/license-MIT-maroon
:target: https://github.com/un1t/django-cleanup/blob/master/LICENSE
:alt: MIT License
Raw data
{
"_id": null,
"home_page": "https://github.com/un1t/django-cleanup",
"name": "django-cleanup",
"maintainer": "",
"docs_url": null,
"requires_python": "",
"maintainer_email": "",
"keywords": "django",
"author": "Ilya Shalyapin",
"author_email": "ishalyapin@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/00/1a/dfaf5473de62f879d11fb5009f9e89e6f9dfbd5a3cc7a2fe5959d7d21d2b/django-cleanup-8.1.0.tar.gz",
"platform": null,
"description": "Django Cleanup\n**************\n|Version| |Status| |License|\n\nFeatures\n========\nThe django-cleanup app automatically deletes files for :code:`FileField`, :code:`ImageField` and\nsubclasses. When a :code:`FileField`'s value is changed and the model is saved, the old file is\ndeleted. When a model that has a :code:`FileField` is deleted, the file is also deleted. A file that\nis set as the :code:`FileField`'s default value will not be deleted.\n\nCompatibility\n-------------\n- Django 3.2, 4.1, 4.2, 5.0 (`See Django Supported Versions <https://www.djangoproject.com/download/#supported-versions>`_)\n- Python 3.6+\n- Compatible with `sorl-thumbnail <https://github.com/jazzband/sorl-thumbnail>`_\n- Compatible with `easy-thumbnail <https://github.com/SmileyChris/easy-thumbnails>`_\n\nHow does it work?\n=================\nIn order to track changes of a :code:`FileField` and facilitate file deletions, django-cleanup\nconnects :code:`post_init`, :code:`pre_save`, :code:`post_save` and :code:`post_delete` signals to\nsignal handlers for each :code:`INSTALLED_APPS` model that has a :code:`FileField`. In order to tell\nwhether or not a :code:`FileField`'s value has changed a local cache of original values is kept on\nthe model instance. If a condition is detected that should result in a file deletion, a function to\ndelete the file is setup and inserted into the commit phase of the current transaction.\n\n**Warning! Please be aware of the known limitations documented below!**\n\nInstallation\n============\n::\n\n pip install django-cleanup\n\n\nConfiguration\n=============\nAdd ``django_cleanup`` to the bottom of ``INSTALLED_APPS`` in ``settings.py``\n\n.. code-block:: py\n\n INSTALLED_APPS = (\n ...,\n 'django_cleanup.apps.CleanupConfig',\n )\n\nThat is all, no other configuration is necessary.\n\nNote: Order of ``INSTALLED_APPS`` is important. To ensure that exceptions inside other apps' signal\nhandlers do not affect the integrity of file deletions within transactions, ``django_cleanup``\nshould be placed last in ``INSTALLED_APPS``.\n\nTroubleshooting\n===============\nIf you notice that ``django-cleanup`` is not removing files when expected, check that your models\nare being properly\n`loaded <https://docs.djangoproject.com/en/stable/ref/applications/#how-applications-are-loaded>`_:\n\n You must define or import all models in your application's models.py or models/__init__.py.\n Otherwise, the application registry may not be fully populated at this point, which could cause\n the ORM to malfunction.\n\nIf your models are not loaded, ``django-cleanup`` will not be able to discover their\n``FileField``'s.\n\nYou can check if your ``Model`` is loaded by using\n\n.. code-block:: py\n\n from django.apps import apps\n apps.get_models()\n\nKnown limitations\n=================\n\nDatabase should support transactions\n------------------------------------\nIf you are using a database that does not support transactions you may lose files if a\ntransaction will rollback at the right instance. This outcome is mitigated by our use of\npost_save and post_delete signals, and by following the recommended configuration in this README.\nThis outcome will still occur if there are signals registered after app initialization and there are\nexceptions when those signals are handled. In this case, the old file will be lost and the new file\nwill not be referenced in a model, though the new file will likely still exist on disk. If you are\nconcerned about this behavior you will need another solution for old file deletion in your project.\n\nFile referenced by multiple model instances\n-------------------------------------------\nThis app is designed with the assumption that each file is referenced only once. If you are sharing\na file over two or more model instances you will not have the desired functionality. Be cautious of\ncopying model instances, as this will cause a file to be shared by more than one instance. If you\nwant to reference a file from multiple models add a level of indirection. That is, use a separate\nfile model that is referenced from other models through a foreign key. There are many file\nmanagement apps already available in the django ecosystem that fulfill this behavior.\n\nAdvanced\n========\nThis section contains additional functionality that can be used to interact with django-cleanup for\nspecial cases.\n\nSignals\n-------\nTo facilitate interactions with other django apps django-cleanup sends the following signals which\ncan be imported from :code:`django_cleanup.signals`:\n\n- :code:`cleanup_pre_delete`: just before a file is deleted. Passes a :code:`file` keyword argument.\n- :code:`cleanup_post_delete`: just after a file is deleted. Passes a :code:`file` keyword argument.\n\nSignals example for sorl.thumbnail:\n\n.. code-block:: py\n\n from django_cleanup.signals import cleanup_pre_delete\n from sorl.thumbnail import delete\n\n def sorl_delete(**kwargs):\n delete(kwargs['file'])\n\n cleanup_pre_delete.connect(sorl_delete)\n\nRefresh the cache\n-----------------\nThere have been rare cases where the cache would need to be refreshed. To do so the\n:code:`django_cleanup.cleanup.refresh` method can be used:\n\n.. code-block:: py\n\n from django_cleanup import cleanup\n\n cleanup.refresh(model_instance)\n\nIgnore cleanup for a specific model\n-----------------------------------\nTo ignore a model and not have cleanup performed when the model is deleted or its files change, use\nthe :code:`ignore` decorator to mark that model:\n\n.. code-block:: py\n\n from django_cleanup import cleanup\n\n @cleanup.ignore\n class MyModel(models.Model):\n image = models.FileField()\n\nOnly cleanup selected models\n----------------------------\nIf you have many models to ignore, or if you prefer to be explicit about what models are selected,\nyou can change the mode of django-cleanup to \"select mode\" by using the select mode app config. In\nyour ``INSTALLED_APPS`` setting you will replace ':code:`django_cleanup.apps.CleanupConfig`'\nwith ':code:`django_cleanup.apps.CleanupSelectedConfig`'. Then use the :code:`select` decorator to\nmark a model for cleanup:\n\n.. code-block:: py\n\n from django_cleanup import cleanup\n\n @cleanup.select\n class MyModel(models.Model):\n image = models.FileField()\n\nHow to run tests\n================\nInstall, setup and use pyenv_ to install all the required versions of cPython\n(see the `tox.ini <https://github.com/un1t/django-cleanup/blob/master/tox.ini>`_).\n\nSetup pyenv_ to have all versions of python activated within your local django-cleanup repository.\nEnsuring that the python 3.12 that was installed is first priority.\n\nInstall tox_ on python 3.12 and run the :code:`tox` command from your local django-cleanup\nrepository.\n\nHow to write tests\n==================\nThis app requires the use of django.test.TransactionTestCase_ when writing tests.\n\nFor details on why this is required see `here\n<https://docs.djangoproject.com/en/stable/topics/db/transactions/#use-in-tests>`_:\n\n Django's :code:`TestCase` class wraps each test in a transaction and rolls back that transaction\n after each test, in order to provide test isolation. This means that no transaction is ever\n actually committed, thus your :code:`on_commit()` callbacks will never be run. If you need to\n test the results of an :code:`on_commit()` callback, use a :code:`TransactionTestCase` instead.\n\nLicense\n=======\ndjango-cleanup is free software under terms of the:\n\nMIT License\n\nCopyright (C) 2012 by Ilya Shalyapin, ishalyapin@gmail.com\n\nPermission is hereby granted, free of charge, to any person obtaining a copy\nof this software and associated documentation files (the \"Software\"), to deal\nin the Software without restriction, including without limitation the rights\nto use, copy, modify, merge, publish, distribute, sublicense, and/or sell\ncopies of the Software, and to permit persons to whom the Software is\nfurnished to do so, subject to the following conditions:\n\nThe above copyright notice and this permission notice shall be included in all\ncopies or substantial portions of the Software.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\nIMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\nFITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\nAUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\nLIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,\nOUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE\nSOFTWARE.\n\n\n.. _django.test.TransactionTestCase: https://docs.djangoproject.com/en/stable/topics/testing/tools/#django.test.TransactionTestCase\n.. _pyenv: https://github.com/pyenv/pyenv\n.. _tox: https://tox.readthedocs.io/en/latest/\n\n.. |Version| image:: https://img.shields.io/pypi/v/django-cleanup.svg\n :target: https://pypi.python.org/pypi/django-cleanup/\n :alt: PyPI Package\n.. |Status| image:: https://github.com/un1t/django-cleanup/actions/workflows/main.yml/badge.svg\n :target: https://github.com/un1t/django-cleanup/actions/workflows/main.yml\n :alt: Build Status\n.. |License| image:: https://img.shields.io/badge/license-MIT-maroon\n :target: https://github.com/un1t/django-cleanup/blob/master/LICENSE\n :alt: MIT License\n",
"bugtrack_url": null,
"license": "MIT License",
"summary": "Deletes old files.",
"version": "8.1.0",
"project_urls": {
"Download": "https://github.com/un1t/django-cleanup/tarball/master",
"Homepage": "https://github.com/un1t/django-cleanup"
},
"split_keywords": [
"django"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "860d5f3632cb8228d1a1af54db4aae49a43fa8c8de0952d1e821f95e96b3164d",
"md5": "7b49e620ff176eb94e2b1f27f295ef18",
"sha256": "7903873ea73b3f7e61e055340d27dba49b70634f60c87a573ad748e172836458"
},
"downloads": -1,
"filename": "django_cleanup-8.1.0-py2.py3-none-any.whl",
"has_sig": false,
"md5_digest": "7b49e620ff176eb94e2b1f27f295ef18",
"packagetype": "bdist_wheel",
"python_version": "py2.py3",
"requires_python": null,
"size": 10658,
"upload_time": "2024-01-29T00:06:40",
"upload_time_iso_8601": "2024-01-29T00:06:40.107065Z",
"url": "https://files.pythonhosted.org/packages/86/0d/5f3632cb8228d1a1af54db4aae49a43fa8c8de0952d1e821f95e96b3164d/django_cleanup-8.1.0-py2.py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "001adfaf5473de62f879d11fb5009f9e89e6f9dfbd5a3cc7a2fe5959d7d21d2b",
"md5": "795307eff6b380cb0e109a84827d72e8",
"sha256": "70df905076a44e7a111b31198199af633dee08876e199e6dce36ca8dd6b8b10f"
},
"downloads": -1,
"filename": "django-cleanup-8.1.0.tar.gz",
"has_sig": false,
"md5_digest": "795307eff6b380cb0e109a84827d72e8",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 17351,
"upload_time": "2024-01-29T00:06:41",
"upload_time_iso_8601": "2024-01-29T00:06:41.512777Z",
"url": "https://files.pythonhosted.org/packages/00/1a/dfaf5473de62f879d11fb5009f9e89e6f9dfbd5a3cc7a2fe5959d7d21d2b/django-cleanup-8.1.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-01-29 00:06:41",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "un1t",
"github_project": "django-cleanup",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"tox": true,
"lcname": "django-cleanup"
}
JSON
