glider-ingest


Nameglider-ingest JSON
Version 1.1.21 PyPI version JSON
download
home_pageNone
SummaryPackage for GERG to ingest raw glider data into NetCDF files
upload_time2025-02-11 22:09:05
maintainerAlec
docs_urlNone
authorAlec
requires_python<3.14,>=3.12
licenseNone
keywords gerg tamu glider ingest netcdf python data
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            <a id="readme-top"></a>

<!-- PROJECT LOGO -->
<br />
<div align="center">
  <a href="https://github.com/alecmkrueger/glider-ingest">
    <img src="https://github.com/alecmkrueger/glider_ingest/blob/f0d38149d6a8ee24902c2debbd7acf795263703c/.github/TAMU-GERG-Glider.jpg" alt="Logo" width="500" height="272">
  </a>

<h3 align="center">GERG Glider Ingest</h3>

  <p align="center">
    Convert raw data from GERG gliders into netcdf using python
    <br />
    <a href="https://glider-ingest.readthedocs.io/en/latest/"><strong>Explore the docs »</strong></a>
    <br />
    <br />
    <a href="https://github.com/alecmkrueger/glider-ingest/issues/new?labels=bug&template=bug-report---.md">Report Bug</a>
    ·
    <a href="https://github.com/alecmkrueger/glider-ingest/issues/new?labels=enhancement&template=feature-request---.md">Request Feature</a>
  </p>
</div>



<!-- TABLE OF CONTENTS -->
<details>
  <summary>Table of Contents</summary>
  <ol>
    <li>
      <a href="#about-the-project">About The Project</a>
      <ul>
        <li><a href="#built-with">Built With</a></li>
      </ul>
    </li>
    <li>
      <a href="#getting-started">Getting Started</a>
      <ul>
        <li><a href="#dependencies">Dependencies</a></li>
        <li><a href="#installation">Installation</a></li>
      </ul>
    </li>
    <li><a href="#usage">Usage</a></li>
    <li><a href="#contributing">Contributing</a></li>
    <li><a href="#license">License</a></li>
    <li><a href="#contact">Contact</a></li>
    <li><a href="#acknowledgments">Acknowledgments</a></li>
  </ol>
</details>



<!-- ABOUT THE PROJECT -->
## About The Project

This project was created to streamline the process of converting the raw data from the gliders after missions into NetCDF files, 
as well as ensuring the code can be easily maintained, understood, and used by others.



### Built With

[![Python][Python]][Python-url]



<!-- GETTING STARTED -->
## Getting Started

There are three ways to get started
1. Create a fresh virtual environment using your favorite method and install the dependencies
2. Use an already established virtual environment and install the dependencies



### Dependencies
I have provided some commands to install the dependencies using conda but you can use any package manager

1. #### Creating your own virtual environment then installing dependencies
    You can change "glider_ingest" to your desired environment name 

    ```sh
    conda create -n glider_ingest python=3.12
    ```
    
    ```sh
    conda activate glider_ingest
    ```

    ```sh
    pip install numpy pandas xarray gsw attrs
    ```

2. #### Using an already established virtual environment

    ```sh
    conda activate your_env
    ```

    ```sh
    pip install numpy pandas xarray gsw attrs
    ```

### Installation

1. Activate your virtual environment
1. Verify/Install Dependencies
1. Clone the repo
   ```sh
   git clone https://github.com/alecmkrueger/glider-ingest.git
   ```





<!-- USAGE EXAMPLES -->
## Usage

Process raw data from gliders using python. 

Function inputs:
* raw_data_source (Path|str): Raw data source, from the glider SD card
* working_directory (Path|str): Where you want the raw copy and processed data to be
* glider_number (str): The number of the glider, for NetCDF metadata
* mission_title (str): The mission title, for NetCDF metadata
* extensions (list): The extensions you wish to process
* output_nc_filename (str): The name of the output NetCDF file
* return_ds (bool): If you would like the output dataset to be returned. Default = False

Example:

```sh
from pathlib import Path

from glider_ingest import MissionData, MissionProcessor

memory_card_copy_loc = Path('path/to/memory/card/copy')
# Where you want the netcdf to be saved to
working_dir = Path('path/to/working/dir').resolve()
mission_num = '46'

# Initalize the mission_data container
mission_data = MissionData(memory_card_copy_loc=memory_card_copy_loc,
                         working_dir=working_dir,
                         mission_num=mission_num)
# Pass the mission_data container to the MissionProcessor class
# call save_mission_dataset to generate and save the mission dataset
MissionProcessor(mission_data=mission_data).save_mission_dataset()
```




<!-- CONTRIBUTING -->
## Contributing

Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are **greatly appreciated**.

If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement".

1. Fork the Project
2. Create your Feature Branch (`git checkout -b feature/AmazingFeature`)
3. Commit your Changes (`git commit -m 'Add some AmazingFeature'`)
4. Push to the Branch (`git push origin feature/AmazingFeature`)
5. Open a Pull Request





<!-- LICENSE -->
## License

Distributed under the MIT License. See `LICENSE` for more information.



<!-- CONTACT -->
## Contact

Alec Krueger - alecmkrueger@tamu.edu

Project Link: [https://github.com/alecmkrueger/glider-ingest](https://github.com/alecmkrueger/glider-ingest)



<!-- ACKNOWLEDGMENTS -->
## Acknowledgments

* Sakib Mahmud, Texas A&M University, Geochemical and Environmental Research Group, sakib@tamu.edu
* Xiao Ge, Texas A&M University, Geochemical and Environmental Research Group, gexiao@tamu.edu
* Alec Krueger, Texas A&M University, Geochemical and Environmental Research Group, alecmkrueger@tamu.edu

<p align="right">(<a href="#readme-top">back to top</a>)</p>



<!-- MARKDOWN LINKS & IMAGES -->
<!-- https://www.markdownguide.org/basic-syntax/#reference-style-links -->
[contributors-shield]: https://img.shields.io/github/contributors/alecmkrueger/glider-ingest.svg?style=for-the-badge
[contributors-url]: https://github.com/alecmkrueger/glider-ingest/graphs/contributors
[forks-shield]: https://img.shields.io/github/forks/alecmkrueger/glider-ingest.svg?style=for-the-badge
[forks-url]: https://github.com/alecmkrueger/glider-ingest/network/members
[stars-shield]: https://img.shields.io/github/stars/alecmkrueger/glider-ingest.svg?style=for-the-badge
[stars-url]: https://github.com/alecmkrueger/glider-ingest/stargazers
[issues-shield]: https://img.shields.io/github/issues/alecmkrueger/glider-ingest.svg?style=for-the-badge
[issues-url]: https://github.com/alecmkrueger/glider-ingest/issues
[license-shield]: https://img.shields.io/github/license/alecmkrueger/glider-ingest.svg?style=for-the-badge
[license-url]: https://github.com/alecmkrueger/glider-ingest/LICENSE
[linkedin-shield]: https://img.shields.io/badge/-LinkedIn-black.svg?style=for-the-badge&logo=linkedin&colorB=555
[linkedin-url]: https://linkedin.com/in/aleckrueger
[product-screenshot]: images/screenshot.png
[Python]: https://img.shields.io/badge/python-000000?&logo=python
[Python-url]: https://www.python.org/

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "glider-ingest",
    "maintainer": "Alec",
    "docs_url": null,
    "requires_python": "<3.14,>=3.12",
    "maintainer_email": "alecmkrueger@tamu.edu",
    "keywords": "GERG, TAMU, glider, ingest, netcdf, python, data",
    "author": "Alec",
    "author_email": "alecmkrueger@tamu.edu",
    "download_url": "https://files.pythonhosted.org/packages/96/99/1cd3071bbcd61e2258ecac6c744f11125bdc466d64e9bd7f2d87f0c145e5/glider_ingest-1.1.21.tar.gz",
    "platform": null,
    "description": "<a id=\"readme-top\"></a>\n\n<!-- PROJECT LOGO -->\n<br />\n<div align=\"center\">\n  <a href=\"https://github.com/alecmkrueger/glider-ingest\">\n    <img src=\"https://github.com/alecmkrueger/glider_ingest/blob/f0d38149d6a8ee24902c2debbd7acf795263703c/.github/TAMU-GERG-Glider.jpg\" alt=\"Logo\" width=\"500\" height=\"272\">\n  </a>\n\n<h3 align=\"center\">GERG Glider Ingest</h3>\n\n  <p align=\"center\">\n    Convert raw data from GERG gliders into netcdf using python\n    <br />\n    <a href=\"https://glider-ingest.readthedocs.io/en/latest/\"><strong>Explore the docs \u00bb</strong></a>\n    <br />\n    <br />\n    <a href=\"https://github.com/alecmkrueger/glider-ingest/issues/new?labels=bug&template=bug-report---.md\">Report Bug</a>\n    \u00b7\n    <a href=\"https://github.com/alecmkrueger/glider-ingest/issues/new?labels=enhancement&template=feature-request---.md\">Request Feature</a>\n  </p>\n</div>\n\n\n\n<!-- TABLE OF CONTENTS -->\n<details>\n  <summary>Table of Contents</summary>\n  <ol>\n    <li>\n      <a href=\"#about-the-project\">About The Project</a>\n      <ul>\n        <li><a href=\"#built-with\">Built With</a></li>\n      </ul>\n    </li>\n    <li>\n      <a href=\"#getting-started\">Getting Started</a>\n      <ul>\n        <li><a href=\"#dependencies\">Dependencies</a></li>\n        <li><a href=\"#installation\">Installation</a></li>\n      </ul>\n    </li>\n    <li><a href=\"#usage\">Usage</a></li>\n    <li><a href=\"#contributing\">Contributing</a></li>\n    <li><a href=\"#license\">License</a></li>\n    <li><a href=\"#contact\">Contact</a></li>\n    <li><a href=\"#acknowledgments\">Acknowledgments</a></li>\n  </ol>\n</details>\n\n\n\n<!-- ABOUT THE PROJECT -->\n## About The Project\n\nThis project was created to streamline the process of converting the raw data from the gliders after missions into NetCDF files, \nas well as ensuring the code can be easily maintained, understood, and used by others.\n\n\n\n### Built With\n\n[![Python][Python]][Python-url]\n\n\n\n<!-- GETTING STARTED -->\n## Getting Started\n\nThere are three ways to get started\n1. Create a fresh virtual environment using your favorite method and install the dependencies\n2. Use an already established virtual environment and install the dependencies\n\n\n\n### Dependencies\nI have provided some commands to install the dependencies using conda but you can use any package manager\n\n1. #### Creating your own virtual environment then installing dependencies\n    You can change \"glider_ingest\" to your desired environment name \n\n    ```sh\n    conda create -n glider_ingest python=3.12\n    ```\n    \n    ```sh\n    conda activate glider_ingest\n    ```\n\n    ```sh\n    pip install numpy pandas xarray gsw attrs\n    ```\n\n2. #### Using an already established virtual environment\n\n    ```sh\n    conda activate your_env\n    ```\n\n    ```sh\n    pip install numpy pandas xarray gsw attrs\n    ```\n\n### Installation\n\n1. Activate your virtual environment\n1. Verify/Install Dependencies\n1. Clone the repo\n   ```sh\n   git clone https://github.com/alecmkrueger/glider-ingest.git\n   ```\n\n\n\n\n\n<!-- USAGE EXAMPLES -->\n## Usage\n\nProcess raw data from gliders using python. \n\nFunction inputs:\n* raw_data_source (Path|str): Raw data source, from the glider SD card\n* working_directory (Path|str): Where you want the raw copy and processed data to be\n* glider_number (str): The number of the glider, for NetCDF metadata\n* mission_title (str): The mission title, for NetCDF metadata\n* extensions (list): The extensions you wish to process\n* output_nc_filename (str): The name of the output NetCDF file\n* return_ds (bool): If you would like the output dataset to be returned. Default = False\n\nExample:\n\n```sh\nfrom pathlib import Path\n\nfrom glider_ingest import MissionData, MissionProcessor\n\nmemory_card_copy_loc = Path('path/to/memory/card/copy')\n# Where you want the netcdf to be saved to\nworking_dir = Path('path/to/working/dir').resolve()\nmission_num = '46'\n\n# Initalize the mission_data container\nmission_data = MissionData(memory_card_copy_loc=memory_card_copy_loc,\n                         working_dir=working_dir,\n                         mission_num=mission_num)\n# Pass the mission_data container to the MissionProcessor class\n# call save_mission_dataset to generate and save the mission dataset\nMissionProcessor(mission_data=mission_data).save_mission_dataset()\n```\n\n\n\n\n<!-- CONTRIBUTING -->\n## Contributing\n\nContributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are **greatly appreciated**.\n\nIf you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag \"enhancement\".\n\n1. Fork the Project\n2. Create your Feature Branch (`git checkout -b feature/AmazingFeature`)\n3. Commit your Changes (`git commit -m 'Add some AmazingFeature'`)\n4. Push to the Branch (`git push origin feature/AmazingFeature`)\n5. Open a Pull Request\n\n\n\n\n\n<!-- LICENSE -->\n## License\n\nDistributed under the MIT License. See `LICENSE` for more information.\n\n\n\n<!-- CONTACT -->\n## Contact\n\nAlec Krueger - alecmkrueger@tamu.edu\n\nProject Link: [https://github.com/alecmkrueger/glider-ingest](https://github.com/alecmkrueger/glider-ingest)\n\n\n\n<!-- ACKNOWLEDGMENTS -->\n## Acknowledgments\n\n* Sakib Mahmud, Texas A&M University, Geochemical and Environmental Research Group, sakib@tamu.edu\n* Xiao Ge, Texas A&M University, Geochemical and Environmental Research Group, gexiao@tamu.edu\n* Alec Krueger, Texas A&M University, Geochemical and Environmental Research Group, alecmkrueger@tamu.edu\n\n<p align=\"right\">(<a href=\"#readme-top\">back to top</a>)</p>\n\n\n\n<!-- MARKDOWN LINKS & IMAGES -->\n<!-- https://www.markdownguide.org/basic-syntax/#reference-style-links -->\n[contributors-shield]: https://img.shields.io/github/contributors/alecmkrueger/glider-ingest.svg?style=for-the-badge\n[contributors-url]: https://github.com/alecmkrueger/glider-ingest/graphs/contributors\n[forks-shield]: https://img.shields.io/github/forks/alecmkrueger/glider-ingest.svg?style=for-the-badge\n[forks-url]: https://github.com/alecmkrueger/glider-ingest/network/members\n[stars-shield]: https://img.shields.io/github/stars/alecmkrueger/glider-ingest.svg?style=for-the-badge\n[stars-url]: https://github.com/alecmkrueger/glider-ingest/stargazers\n[issues-shield]: https://img.shields.io/github/issues/alecmkrueger/glider-ingest.svg?style=for-the-badge\n[issues-url]: https://github.com/alecmkrueger/glider-ingest/issues\n[license-shield]: https://img.shields.io/github/license/alecmkrueger/glider-ingest.svg?style=for-the-badge\n[license-url]: https://github.com/alecmkrueger/glider-ingest/LICENSE\n[linkedin-shield]: https://img.shields.io/badge/-LinkedIn-black.svg?style=for-the-badge&logo=linkedin&colorB=555\n[linkedin-url]: https://linkedin.com/in/aleckrueger\n[product-screenshot]: images/screenshot.png\n[Python]: https://img.shields.io/badge/python-000000?&logo=python\n[Python-url]: https://www.python.org/\n",
    "bugtrack_url": null,
    "license": null,
    "summary": "Package for GERG to ingest raw glider data into NetCDF files",
    "version": "1.1.21",
    "project_urls": null,
    "split_keywords": [
        "gerg",
        " tamu",
        " glider",
        " ingest",
        " netcdf",
        " python",
        " data"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "d354354c50bb735f0dadf7fdbcba44c564c286b34ca7a9dd21ad5fc460f7bce2",
                "md5": "cd5b3cdf33145fef573675feb316a25e",
                "sha256": "521b9edc588aef9caaed8d015048b8da6c7f4698146f26ddf62968c616d5cdd5"
            },
            "downloads": -1,
            "filename": "glider_ingest-1.1.21-cp312-cp312-win_amd64.whl",
            "has_sig": false,
            "md5_digest": "cd5b3cdf33145fef573675feb316a25e",
            "packagetype": "bdist_wheel",
            "python_version": "cp312",
            "requires_python": "<3.14,>=3.12",
            "size": 22214,
            "upload_time": "2025-02-11T22:09:03",
            "upload_time_iso_8601": "2025-02-11T22:09:03.675400Z",
            "url": "https://files.pythonhosted.org/packages/d3/54/354c50bb735f0dadf7fdbcba44c564c286b34ca7a9dd21ad5fc460f7bce2/glider_ingest-1.1.21-cp312-cp312-win_amd64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "96991cd3071bbcd61e2258ecac6c744f11125bdc466d64e9bd7f2d87f0c145e5",
                "md5": "6ca68020fa6055f3d13babd7f6459098",
                "sha256": "ed30ae243d7d7d3fb43a882acce5f9c3296fc97faf65cd12337a8d0e532d67c9"
            },
            "downloads": -1,
            "filename": "glider_ingest-1.1.21.tar.gz",
            "has_sig": false,
            "md5_digest": "6ca68020fa6055f3d13babd7f6459098",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": "<3.14,>=3.12",
            "size": 21556,
            "upload_time": "2025-02-11T22:09:05",
            "upload_time_iso_8601": "2025-02-11T22:09:05.157418Z",
            "url": "https://files.pythonhosted.org/packages/96/99/1cd3071bbcd61e2258ecac6c744f11125bdc466d64e9bd7f2d87f0c145e5/glider_ingest-1.1.21.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2025-02-11 22:09:05",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "lcname": "glider-ingest"
}
        
Elapsed time: 0.80902s