ioavstatsdb


Nameioavstatsdb JSON
Version 1.5.0a99 PyPI version JSON
download
home_page
SummaryAviation Event Statistics - Database Software
upload_time2023-08-05 14:19:43
maintainer
docs_urlNone
author
requires_python>=3.10
license
keywords accidents aviation ntsb statistics
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # IO-AVSTATS-DB - Aviation Event Statistics Database Software

The National Transportation Safety Board ([NTSB](https://www.ntsb.gov/Pages/home.aspx)) investigates all aviation accidents in the U.S. and makes the investigation results available on their [website](https://data.ntsb.gov/avdata) in Microsoft Access database files for public use. 
The NTSB provides data from 1982 through 2007 in the file **`Pre2008.zip`**. 
Data since 2008 are available first in the overall **`avail.zip`** file, which is updated monthly, and second with a "weekly" amendment file each month on the 1st, 8th, 15th, and 22nd, e.g. **`up22JUN.zip`**.

**IO-AVSTATS-DB** allows you to migrate Microsoft Access files to a PostgreSQL database.
After the data is uploaded based on the two files **`Pre2008.zip`** and **`avail.zip`**, the PostgreSQL can be kept up to date with the "weekly" amendment files.

To validate and supplement the NTSB data in certain aspects, the following data collections are additionally used: 

- [**AVIATION OCCURRENCE CATEGORIES**](https://www.ntsb.gov/safety/data/Documents/datafiles/OccurrenceCategoryDefinitions.pdf)
- [**FAA Airports**](https://adds-faa.opendata.arcgis.com/datasets/faa::airports-1/explore?location=0.158824%2C-1.633886%2C2.00)
- [**FAA Runways**](https://adds-faa.opendata.arcgis.com/datasets/faa::runways/explore?location=0.059024%2C-1.628764%2C2.00)
- [**geodatos**](https://www.geodatos.net/en)
- [**National Plan of Integrated Airport Systems (NPIAS)**](https://www.faa.gov/airports/planning_capacity/npias/current)
- [**opendatasoft**](https://www.opendatasoft.com/?hsLang=en)
- [**simplemaps**](https://simplemaps.com/)
- [**United States Zip Codes.org**](https://www.unitedstateszipcodes.org/)

The functionality includes the following tasks:

| Task                                                   | Code        | 
|--------------------------------------------------------|-------------|
| Cleansing PostgreSQL data                              | **`c_p_d`** |
| Complete processing of a modifying MS Access file      | **`u_p_d`** |
| Correct decimal US latitudes and longitudes            | **`c_l_l`** |
| Create the PostgreSQL database schema                  | **`c_d_s`** |
| Find the nearest airports                              | **`f_n_a`** |
| Load NTSB MS Access database data into PostgreSQL      | **`l_n_a`** |
| Load ZIP Code Database data into PostgreSQL            | **`l_z_d`** |
| Load airport data into PostgreSQL                      | **`l_a_p`** |
| Load aviation occurrence categories into PostgreSQL    | **`a_o_c`** |
| Load country and state data into PostgreSQL            | **`l_c_s`** |
| Load data from a correction file into PostgreSQL       | **`l_c_d`** |
| Load sequence of events data into PostgreSQL           | **`l_s_e`** |
| Load simplemaps data into PostgreSQL                   | **`l_s_d`** |
| Refresh the PostgreSQL database schema                 | **`r_d_s`** |
| Update the PostgreSQL database schema                  | **`u_d_s`** |
| Verify selected NTSB data                              | **`v_n_d`** |

All processing tasks can be performed using the **`run_io_avstats`** shell script.

## Documentation

Since this is a private repository, the complete documentaion is only available in a local version of the repository in the file directory **`site`**. 
You just have to open the file **`site/index.html`** with a web browser.

## Directory and File Structure of this Repository

### 1. Directories

| Directory         | Content                                                    |
|-------------------|------------------------------------------------------------|
| .github/workflows | **[GitHub Action](https://github.com/actions)** workflows. |
| data              | Application data related files.                            |
| dist              | Installable versions of the **IO-AVSTATS-DB** software.    |
| docs              | Documentation files.                                       |
| resources         | Selected manuals and software.                             |
| scripts           | Scripts supporting Ubuntu and Windows.                     |
| site              | Documentation as static HTML pages.                        |
| src               | Python script files.                                       |
| tests             | Scripts and data for **pytest**.                           |

### 2. Files

| File                      | Functionality                                                 |
|---------------------------|---------------------------------------------------------------|
| .gitignore                | Configuration of files and folders to be ignored.             |
| .pylintrc                 | **pylint** configuration file.                                |
| .settings.io_avstats.toml | Configuration data - secrets.                                 |
| LICENSE.md                | Text of the licence terms.                                    |
| logging_cfg.yaml          | Configuration of the Logger functionality.                    |
| Makefile                  | Tasks to be executed with the **`make`** command.             |
| mkdocs.yml                | Configuration file for **MkDocs**.                            |
| Pipfile                   | Definition of the Python package requirements.                |
| Pipfile.lock              | Definition of the specific versions of the Python packages.   |
| pyproject.toml            | Optional configuration data for the software quality tools.   |
| README.md                 | This file.                                                    |
| run_io_avstats            | Main script for using the functionality of **IO-AVSTATS-DB**. |
| settings.io_avstats.toml  | Configuration data.                                           |
| setup.cfg                 | Optional configuration data for **flake8**.                   |

            

Raw data

            {
    "_id": null,
    "home_page": "",
    "name": "ioavstatsdb",
    "maintainer": "",
    "docs_url": null,
    "requires_python": ">=3.10",
    "maintainer_email": "Team IO-Aero <info@io-aero.ch>",
    "keywords": "Accidents,Aviation,NTSB,Statistics",
    "author": "",
    "author_email": "Team IO-Aero <info@io-aero.com>",
    "download_url": "https://files.pythonhosted.org/packages/af/54/7acd5a2c6d5b80b1e58d7592fb9415d659b1868220a762a1ab38e269aedb/ioavstatsdb-1.5.0a99.tar.gz",
    "platform": null,
    "description": "# IO-AVSTATS-DB - Aviation Event Statistics Database Software\r\n\r\nThe National Transportation Safety Board ([NTSB](https://www.ntsb.gov/Pages/home.aspx)) investigates all aviation accidents in the U.S. and makes the investigation results available on their [website](https://data.ntsb.gov/avdata) in Microsoft Access database files for public use. \r\nThe NTSB provides data from 1982 through 2007 in the file **`Pre2008.zip`**. \r\nData since 2008 are available first in the overall **`avail.zip`** file, which is updated monthly, and second with a \"weekly\" amendment file each month on the 1st, 8th, 15th, and 22nd, e.g. **`up22JUN.zip`**.\r\n\r\n**IO-AVSTATS-DB** allows you to migrate Microsoft Access files to a PostgreSQL database.\r\nAfter the data is uploaded based on the two files **`Pre2008.zip`** and **`avail.zip`**, the PostgreSQL can be kept up to date with the \"weekly\" amendment files.\r\n\r\nTo validate and supplement the NTSB data in certain aspects, the following data collections are additionally used: \r\n\r\n- [**AVIATION OCCURRENCE CATEGORIES**](https://www.ntsb.gov/safety/data/Documents/datafiles/OccurrenceCategoryDefinitions.pdf)\r\n- [**FAA Airports**](https://adds-faa.opendata.arcgis.com/datasets/faa::airports-1/explore?location=0.158824%2C-1.633886%2C2.00)\r\n- [**FAA Runways**](https://adds-faa.opendata.arcgis.com/datasets/faa::runways/explore?location=0.059024%2C-1.628764%2C2.00)\r\n- [**geodatos**](https://www.geodatos.net/en)\r\n- [**National Plan of Integrated Airport Systems (NPIAS)**](https://www.faa.gov/airports/planning_capacity/npias/current)\r\n- [**opendatasoft**](https://www.opendatasoft.com/?hsLang=en)\r\n- [**simplemaps**](https://simplemaps.com/)\r\n- [**United States Zip Codes.org**](https://www.unitedstateszipcodes.org/)\r\n\r\nThe functionality includes the following tasks:\r\n\r\n| Task                                                   | Code        | \r\n|--------------------------------------------------------|-------------|\r\n| Cleansing PostgreSQL data                              | **`c_p_d`** |\r\n| Complete processing of a modifying MS Access file      | **`u_p_d`** |\r\n| Correct decimal US latitudes and longitudes            | **`c_l_l`** |\r\n| Create the PostgreSQL database schema                  | **`c_d_s`** |\r\n| Find the nearest airports                              | **`f_n_a`** |\r\n| Load NTSB MS Access database data into PostgreSQL      | **`l_n_a`** |\r\n| Load ZIP Code Database data into PostgreSQL            | **`l_z_d`** |\r\n| Load airport data into PostgreSQL                      | **`l_a_p`** |\r\n| Load aviation occurrence categories into PostgreSQL    | **`a_o_c`** |\r\n| Load country and state data into PostgreSQL            | **`l_c_s`** |\r\n| Load data from a correction file into PostgreSQL       | **`l_c_d`** |\r\n| Load sequence of events data into PostgreSQL           | **`l_s_e`** |\r\n| Load simplemaps data into PostgreSQL                   | **`l_s_d`** |\r\n| Refresh the PostgreSQL database schema                 | **`r_d_s`** |\r\n| Update the PostgreSQL database schema                  | **`u_d_s`** |\r\n| Verify selected NTSB data                              | **`v_n_d`** |\r\n\r\nAll processing tasks can be performed using the **`run_io_avstats`** shell script.\r\n\r\n## Documentation\r\n\r\nSince this is a private repository, the complete documentaion is only available in a local version of the repository in the file directory **`site`**. \r\nYou just have to open the file **`site/index.html`** with a web browser.\r\n\r\n## Directory and File Structure of this Repository\r\n\r\n### 1. Directories\r\n\r\n| Directory         | Content                                                    |\r\n|-------------------|------------------------------------------------------------|\r\n| .github/workflows | **[GitHub Action](https://github.com/actions)** workflows. |\r\n| data              | Application data related files.                            |\r\n| dist              | Installable versions of the **IO-AVSTATS-DB** software.    |\r\n| docs              | Documentation files.                                       |\r\n| resources         | Selected manuals and software.                             |\r\n| scripts           | Scripts supporting Ubuntu and Windows.                     |\r\n| site              | Documentation as static HTML pages.                        |\r\n| src               | Python script files.                                       |\r\n| tests             | Scripts and data for **pytest**.                           |\r\n\r\n### 2. Files\r\n\r\n| File                      | Functionality                                                 |\r\n|---------------------------|---------------------------------------------------------------|\r\n| .gitignore                | Configuration of files and folders to be ignored.             |\r\n| .pylintrc                 | **pylint** configuration file.                                |\r\n| .settings.io_avstats.toml | Configuration data - secrets.                                 |\r\n| LICENSE.md                | Text of the licence terms.                                    |\r\n| logging_cfg.yaml          | Configuration of the Logger functionality.                    |\r\n| Makefile                  | Tasks to be executed with the **`make`** command.             |\r\n| mkdocs.yml                | Configuration file for **MkDocs**.                            |\r\n| Pipfile                   | Definition of the Python package requirements.                |\r\n| Pipfile.lock              | Definition of the specific versions of the Python packages.   |\r\n| pyproject.toml            | Optional configuration data for the software quality tools.   |\r\n| README.md                 | This file.                                                    |\r\n| run_io_avstats            | Main script for using the functionality of **IO-AVSTATS-DB**. |\r\n| settings.io_avstats.toml  | Configuration data.                                           |\r\n| setup.cfg                 | Optional configuration data for **flake8**.                   |\r\n",
    "bugtrack_url": null,
    "license": "",
    "summary": "Aviation Event Statistics - Database Software",
    "version": "1.5.0a99",
    "project_urls": {
        "Bug Tracker": "https://github.com/io-aero/io-avstats-db/issues",
        "Documentation": "https://io-aero.github.io/io-avstats-db/",
        "Homepage": "https://github.com/io-aero/io-avstats-db",
        "Release History": "https://io-aero.github.io/io-avstats-db/release_history/",
        "Release Notes": "https://io-aero.github.io/io-avstats-db/release_notes/",
        "Source": "https://github.com/io-aero/io-avstats-db/ioavstatsdb/"
    },
    "split_keywords": [
        "accidents",
        "aviation",
        "ntsb",
        "statistics"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "438b90306770fbe1a339d9f2690a9438afb4eeca41138b8b99ee6106e144bd34",
                "md5": "6769d746ec4b7f9eb2696b181602cd80",
                "sha256": "40d22a07e74fa165165e0ab04132b41119393397f3f376293c4c8c2bce5b24aa"
            },
            "downloads": -1,
            "filename": "ioavstatsdb-1.5.0a99-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "6769d746ec4b7f9eb2696b181602cd80",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.10",
            "size": 66123,
            "upload_time": "2023-08-05T14:19:41",
            "upload_time_iso_8601": "2023-08-05T14:19:41.163249Z",
            "url": "https://files.pythonhosted.org/packages/43/8b/90306770fbe1a339d9f2690a9438afb4eeca41138b8b99ee6106e144bd34/ioavstatsdb-1.5.0a99-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "af547acd5a2c6d5b80b1e58d7592fb9415d659b1868220a762a1ab38e269aedb",
                "md5": "597e48674960bb42e3aea1e9811d21a8",
                "sha256": "ec0dfbec559ce95b3b70a8073bcad473cc850c55cf05a1a4dbedc310864dbd93"
            },
            "downloads": -1,
            "filename": "ioavstatsdb-1.5.0a99.tar.gz",
            "has_sig": false,
            "md5_digest": "597e48674960bb42e3aea1e9811d21a8",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.10",
            "size": 63283,
            "upload_time": "2023-08-05T14:19:43",
            "upload_time_iso_8601": "2023-08-05T14:19:43.016463Z",
            "url": "https://files.pythonhosted.org/packages/af/54/7acd5a2c6d5b80b1e58d7592fb9415d659b1868220a762a1ab38e269aedb/ioavstatsdb-1.5.0a99.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-08-05 14:19:43",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "io-aero",
    "github_project": "io-avstats-db",
    "github_not_found": true,
    "lcname": "ioavstatsdb"
}
        
Elapsed time: 0.19488s