# Automated SpectroPhotometric Image REDuction (ASPIRED) -- A Python-based spectral data reduction toolkit
[](https://coveralls.io/github/cylammarco/ASPIRED?branch=main)
[](https://aspired.readthedocs.io/en/latest/)
[](https://arxiv.org/abs/2111.02127)
[](https://badge.fury.io/py/aspired)
[](https://doi.org/10.5281/zenodo.4127294)
[](https://doi.org/10.3847/1538-3881/acd75c)
[](https://pepy.tech/project/aspired)
[](https://github.com/psf/black)
We aim to provide a suite of publicly available spectral data reduction software to facilitate rapid scientific outcomes from time-domain observations. For time resolved observations, an automated pipeline frees astronomers from performance of the routine data analysis tasks to concentrate on interpretation, planning future observations and communication with international collaborators. Part of the OPTICON project coordinates the operation of a network of largely self-funded European robotic and conventional telescopes, coordinating common science goals and providing the tools to deliver science-ready photometric and spectroscopic data. As part of this activity is [SPRAT](https://ui.adsabs.harvard.edu/abs/2014SPIE.9147E..8HP/abstract), a compact, reliable, low-cost and high-throughput spectrograph and appropriate for deployment on a wide range of 1-4m class telescopes. Installed on the Liverpool Telescope since 2014, the deployable slit and grating mechanism and optical fibre based calibration system make the instrument self-contained.
ASPIRED is written for use with python 3.7, 3.8, 3.9, 3.10 and 3.11, and is intentionally developed as a self-consistent reduction pipeline with its own diagnostics and error handling. The pipeline should be able to reduce 2D spectral data from raw image to wavelength and flux calibrated 1D spectrum automatically without any user input (quicklook quality). However, the real goal is to provide a set of easily configurable routines to build pipelines for long slit spectrographs on different telescopes (science quality). We use SPRAT as a test case for this development, but our aim is to support a much wider range of instruments. By delivering near real-time data reduction we will facilitate automated or interactive decision making, allowing "on-the-fly" modification of observing strategies and rapid triggering of other facilities.
Further information can be referred to this [AJ article](https://iopscience.iop.org/article/10.3847/1538-3881/acd75c).
Early stage development efforts can be referred to this [ASPC article](https://ui.adsabs.harvard.edu/abs/2020ASPC..527..655L/abstract) and this [arXiv article](https://ui.adsabs.harvard.edu/abs/2020arXiv201203505L/abstract). This is in concurrent development with the automated wavelength calibration software [RASCAL](https://github.com/jveitchmichaelis/rascal), further information can be referred to this [ASPC article](https://ui.adsabs.harvard.edu/abs/2020ASPC..527..627V/abstract) and it will appear in the same volume of ASPCS.
Example notebooks and scripts can be found at [aspired-example](https://github.com/cylammarco/ASPIRED-example). More examples can be found at the github repository of the journal article [here](https://github.com/cylammarco/ASPIRED-apj-article), e.g.:
## Use cases
We are to cover as many use cases as possible. If you would like to apply some reduction techniques that we have overseen, please use the [issue tracker](https://github.com/cylammarco/ASPIRED/issues) to request new features. The following is the list of scenarios that we can handle:
### Spectrum - full reduction
1. [x] Dataset with science and standard field-flattened images and the respective arc image.
### Spectrum - ADU spectrum extraction only (No flux calibration)
2. [x] Dataset with science field-flattened image and the arc image only.
### Spectrum - wavelength calibration only (Pre wavelength-calibrated)
3. [x] Dataset with science and standard field-flattened images only.
### Spectrum - other cases for full or partial reduction
4. [x] User supplied trace(s) for light spectrum extraction (only to extract ADU/s of the spectra).
5. [x] User supplied trace(s) for arc extraction (only to get wavelength calibration polynomial).
6. [x] User supplied wavelength calibration polynomial coefficients.
7. [x] User supplied line list.
8. [x] User supplied pixel-to-wavelength mapping (not fitted).
9. [x] User supplied sensitivity curve.
10. [x] Flux calibration for user supplied wavelength calibrated science and standard 1D spectra.
11. [x] Apply atmospheric extinction correction.
12. [x] Apply basic telluric absorption correction.
### Output
13. [x] Save diagnostic plots in [these formats](https://plotly.com/python/renderers/#setting-the-default-renderer).
14. [x] Save data in FITS (with header information) or ascii (csv).
See the examples of these use cases at [aspired-example](https://github.com/cylammarco/ASPIRED-example/).
## Dependencies
* python >= 3.8 (It should work on 3.6 and 3.7 if you can sort out the astropy (>=5.0) requirement of >=3.8)
* [numpy](https://numpy.org/doc/stable/index.html) >= 1.21
* [scipy](https://scipy.org/) >= 1.7
* [astropy](https://github.com/astropy/astropy) >= 4.3
* [astroscrappy](https://github.com/astropy/astroscrappy) >= 1.1
* [ccdproc](https://github.com/astropy/ccdproc)
* [plotly](https://github.com/plotly/plotly.py) >= 5.0
* [rascal](https://github.com/jveitchmichaelis/rascal) >= 0.3.10, < 4.0
* [spectresc](https://github.com/cylammarco/SpectResC) >= 1.0.2
* [statsmodels](https://www.statsmodels.org/stable/index.html) >= 0.13
## Installation
Instructions can be found [here](https://aspired.readthedocs.io/en/latest/installation/pip.html).
## Reporting issues/feature requests
Please use the [issue tracker](https://github.com/cylammarco/ASPIRED/issues) to report any issues or support questions.
## Getting started
The [quickstart guide](https://aspired.readthedocs.io/en/latest/tutorials/quickstart.html) will show you how to reduce the example dataset.
## Contributing Code/Documentation
If you are interested in contributing code to the project, thank you! For those unfamiliar with the process of contributing to an open-source project, you may want to read through Github’s own short informational section on how to submit a [contribution](https://opensource.guide/how-to-contribute/#how-to-submit-a-contribution) or send me a message.
Style -- black. See the .pre-commit-config.yaml for the other requirements.
## Funding bodies
1. European Union’s Horizon 2020 research and innovation programme (grant agreement No. 730890)
(January 2019 - March 2020)
2. Polish NCN grant Daina No. 2017/27/L/ST9/03221
(May - June 2020)
3. European Research Council Starting Grant (grant agreement No. 852097)
(Sept 2020 - Current)
## Citation
If you make use of the ASPIRED toolkit, we would appreciate if you can refernce the two articles and two pieces of software listed below:
1. [ASPIRED AJ article](https://ui.adsabs.harvard.edu/abs/10.3847/1538-3881/acd75c/abstract)
2. [ASPIRED Zenodo](https://doi.org/10.5281/zenodo.4127294)
3. [RASCAL arXiv article](https://ui.adsabs.harvard.edu/abs/2020ASPC..527..627V/abstract)
4. [RASCAL Zenodo](https://doi.org/10.5281/zenodo.4117516)
Raw data
{
"_id": null,
"home_page": "https://aspired.readthedocs.io/en/latest/?badge=latest",
"name": "aspired",
"maintainer": "Marco C Lam",
"docs_url": null,
"requires_python": ">=3.6",
"maintainer_email": "lam@mail.tau.ac.il",
"keywords": "",
"author": "Marco C Lam, Robert J Smith",
"author_email": "lam@mail.tau.ac.il, r.j.smith@ljmu.ac.uk",
"download_url": "https://files.pythonhosted.org/packages/e3/b5/aa17f58d1eeac914e06cb38303aae2046cccbb68d111b119bf5698381483/aspired-0.5.1.tar.gz",
"platform": null,
"description": "# Automated SpectroPhotometric Image REDuction (ASPIRED) -- A Python-based spectral data reduction toolkit\n\n[](https://coveralls.io/github/cylammarco/ASPIRED?branch=main)\n[](https://aspired.readthedocs.io/en/latest/)\n[](https://arxiv.org/abs/2111.02127)\n[](https://badge.fury.io/py/aspired)\n[](https://doi.org/10.5281/zenodo.4127294)\n[](https://doi.org/10.3847/1538-3881/acd75c)\n[](https://pepy.tech/project/aspired)\n[](https://github.com/psf/black)\n\nWe aim to provide a suite of publicly available spectral data reduction software to facilitate rapid scientific outcomes from time-domain observations. For time resolved observations, an automated pipeline frees astronomers from performance of the routine data analysis tasks to concentrate on interpretation, planning future observations and communication with international collaborators. Part of the OPTICON project coordinates the operation of a network of largely self-funded European robotic and conventional telescopes, coordinating common science goals and providing the tools to deliver science-ready photometric and spectroscopic data. As part of this activity is [SPRAT](https://ui.adsabs.harvard.edu/abs/2014SPIE.9147E..8HP/abstract), a compact, reliable, low-cost and high-throughput spectrograph and appropriate for deployment on a wide range of 1-4m class telescopes. Installed on the Liverpool Telescope since 2014, the deployable slit and grating mechanism and optical fibre based calibration system make the instrument self-contained.\n\nASPIRED is written for use with python 3.7, 3.8, 3.9, 3.10 and 3.11, and is intentionally developed as a self-consistent reduction pipeline with its own diagnostics and error handling. The pipeline should be able to reduce 2D spectral data from raw image to wavelength and flux calibrated 1D spectrum automatically without any user input (quicklook quality). However, the real goal is to provide a set of easily configurable routines to build pipelines for long slit spectrographs on different telescopes (science quality). We use SPRAT as a test case for this development, but our aim is to support a much wider range of instruments. By delivering near real-time data reduction we will facilitate automated or interactive decision making, allowing \"on-the-fly\" modification of observing strategies and rapid triggering of other facilities.\n\nFurther information can be referred to this [AJ article](https://iopscience.iop.org/article/10.3847/1538-3881/acd75c).\n\nEarly stage development efforts can be referred to this [ASPC article](https://ui.adsabs.harvard.edu/abs/2020ASPC..527..655L/abstract) and this [arXiv article](https://ui.adsabs.harvard.edu/abs/2020arXiv201203505L/abstract). This is in concurrent development with the automated wavelength calibration software [RASCAL](https://github.com/jveitchmichaelis/rascal), further information can be referred to this [ASPC article](https://ui.adsabs.harvard.edu/abs/2020ASPC..527..627V/abstract) and it will appear in the same volume of ASPCS.\n\nExample notebooks and scripts can be found at [aspired-example](https://github.com/cylammarco/ASPIRED-example). More examples can be found at the github repository of the journal article [here](https://github.com/cylammarco/ASPIRED-apj-article), e.g.:\n\n\n\n## Use cases\nWe are to cover as many use cases as possible. If you would like to apply some reduction techniques that we have overseen, please use the [issue tracker](https://github.com/cylammarco/ASPIRED/issues) to request new features. The following is the list of scenarios that we can handle:\n\n### Spectrum - full reduction\n1. [x] Dataset with science and standard field-flattened images and the respective arc image.\n\n### Spectrum - ADU spectrum extraction only (No flux calibration)\n2. [x] Dataset with science field-flattened image and the arc image only.\n\n### Spectrum - wavelength calibration only (Pre wavelength-calibrated)\n3. [x] Dataset with science and standard field-flattened images only.\n\n### Spectrum - other cases for full or partial reduction\n4. [x] User supplied trace(s) for light spectrum extraction (only to extract ADU/s of the spectra).\n5. [x] User supplied trace(s) for arc extraction (only to get wavelength calibration polynomial).\n6. [x] User supplied wavelength calibration polynomial coefficients.\n7. [x] User supplied line list.\n8. [x] User supplied pixel-to-wavelength mapping (not fitted).\n9. [x] User supplied sensitivity curve.\n10. [x] Flux calibration for user supplied wavelength calibrated science and standard 1D spectra.\n11. [x] Apply atmospheric extinction correction.\n12. [x] Apply basic telluric absorption correction.\n\n### Output\n13. [x] Save diagnostic plots in [these formats](https://plotly.com/python/renderers/#setting-the-default-renderer).\n14. [x] Save data in FITS (with header information) or ascii (csv).\n\nSee the examples of these use cases at [aspired-example](https://github.com/cylammarco/ASPIRED-example/).\n\n## Dependencies\n* python >= 3.8 (It should work on 3.6 and 3.7 if you can sort out the astropy (>=5.0) requirement of >=3.8)\n* [numpy](https://numpy.org/doc/stable/index.html) >= 1.21\n* [scipy](https://scipy.org/) >= 1.7\n* [astropy](https://github.com/astropy/astropy) >= 4.3\n* [astroscrappy](https://github.com/astropy/astroscrappy) >= 1.1\n* [ccdproc](https://github.com/astropy/ccdproc)\n* [plotly](https://github.com/plotly/plotly.py) >= 5.0\n* [rascal](https://github.com/jveitchmichaelis/rascal) >= 0.3.10, < 4.0\n* [spectresc](https://github.com/cylammarco/SpectResC) >= 1.0.2\n* [statsmodels](https://www.statsmodels.org/stable/index.html) >= 0.13\n\n## Installation\nInstructions can be found [here](https://aspired.readthedocs.io/en/latest/installation/pip.html).\n\n## Reporting issues/feature requests\nPlease use the [issue tracker](https://github.com/cylammarco/ASPIRED/issues) to report any issues or support questions.\n\n## Getting started\nThe [quickstart guide](https://aspired.readthedocs.io/en/latest/tutorials/quickstart.html) will show you how to reduce the example dataset.\n\n## Contributing Code/Documentation\nIf you are interested in contributing code to the project, thank you! For those unfamiliar with the process of contributing to an open-source project, you may want to read through Github\u2019s own short informational section on how to submit a [contribution](https://opensource.guide/how-to-contribute/#how-to-submit-a-contribution) or send me a message.\n\nStyle -- black. See the .pre-commit-config.yaml for the other requirements.\n\n## Funding bodies\n1. European Union\u2019s Horizon 2020 research and innovation programme (grant agreement No. 730890)\n(January 2019 - March 2020)\n2. Polish NCN grant Daina No. 2017/27/L/ST9/03221\n(May - June 2020)\n3. European Research Council Starting Grant (grant agreement No. 852097)\n(Sept 2020 - Current)\n\n## Citation\nIf you make use of the ASPIRED toolkit, we would appreciate if you can refernce the two articles and two pieces of software listed below:\n\n1. [ASPIRED AJ article](https://ui.adsabs.harvard.edu/abs/10.3847/1538-3881/acd75c/abstract)\n2. [ASPIRED Zenodo](https://doi.org/10.5281/zenodo.4127294)\n3. [RASCAL arXiv article](https://ui.adsabs.harvard.edu/abs/2020ASPC..527..627V/abstract)\n4. [RASCAL Zenodo](https://doi.org/10.5281/zenodo.4117516)\n\n\n",
"bugtrack_url": null,
"license": "BSD-3-Clause",
"summary": "The iraf-free spectral data reduction toolkit.",
"version": "0.5.1",
"project_urls": {
"Download": "https://github.com/cylammarco/aspired",
"Homepage": "https://aspired.readthedocs.io/en/latest/?badge=latest"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "53f8d3c646b6c3765655b319a2e765bae6f302f9a785d2845e92966610f1b9c5",
"md5": "5536e1e4b944b7a5b47f3e9c21b5e341",
"sha256": "36502da058a3702ee44bd077e8c472cb33b13705e4c43fe6fe264b32797d9557"
},
"downloads": -1,
"filename": "aspired-0.5.1-py3-none-any.whl",
"has_sig": false,
"md5_digest": "5536e1e4b944b7a5b47f3e9c21b5e341",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.6",
"size": 12736444,
"upload_time": "2023-07-24T15:48:16",
"upload_time_iso_8601": "2023-07-24T15:48:16.552097Z",
"url": "https://files.pythonhosted.org/packages/53/f8/d3c646b6c3765655b319a2e765bae6f302f9a785d2845e92966610f1b9c5/aspired-0.5.1-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "e3b5aa17f58d1eeac914e06cb38303aae2046cccbb68d111b119bf5698381483",
"md5": "b388387a68a33c1b44a5e18a6623bf72",
"sha256": "9c014097bc871cbf6d06b75ddf28bc03012654be46a7fb404230f751c4c8397c"
},
"downloads": -1,
"filename": "aspired-0.5.1.tar.gz",
"has_sig": false,
"md5_digest": "b388387a68a33c1b44a5e18a6623bf72",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.6",
"size": 12474414,
"upload_time": "2023-07-24T15:48:19",
"upload_time_iso_8601": "2023-07-24T15:48:19.990497Z",
"url": "https://files.pythonhosted.org/packages/e3/b5/aa17f58d1eeac914e06cb38303aae2046cccbb68d111b119bf5698381483/aspired-0.5.1.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-07-24 15:48:19",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "cylammarco",
"github_project": "aspired",
"travis_ci": false,
"coveralls": true,
"github_actions": true,
"requirements": [],
"lcname": "aspired"
}
JSON
