# DiscoEPG (Discovery EPG) - A library for EPG signal analysis of pierce-sucking insects
## Overview
Electrical penetration graph (EPG) is a technique used to study the feeding behavior of sucking insects such as aphids. Specifically, the experimental insect and host plant are made part of an electrical circuit, which is closed when aphid mouthparts penetrate plant tissue. When the aphid stylet is inserted intercellularly, the voltage is positive and when inserted intracellularly, the voltage is negative. Waveforms in EPG have been correlated to specific aphid feeding behaviors by stylectomy followed by microscopy of the plant tissue to determine the approximate location of the stylet as well as observing aphid head movement, posture, and muscle dynamics. EPG is well established and has been widely used to study the mechanisms of plant virus transmission by aphids, the effect of resistant and susceptible lines on aphid feeding behaviors, and to better our understanding of the mechanisms that aphids use to continuously drink from the phloem.
DiscoEPG (abbreviated for Discovery-EPG) package is an open-source Python package, designed to be compatible with the popular Stylet+ EPG System by W. F. Tjallingii [1]. DiscoEPG provides many utilities including data visualization, accurate automatic segmentation, and calculations of various EPG parameters, which facilitate the data analysis stage in the study of EPG signals. The package was used as a helpful support tool for our study in characterizing aphid's behavior based on this data.
The novelty of DiscoEPG lies in the automatic segmentation procedure, which follows a sliding-window technique where the entire signal is broken into non-overlapping segments, then the each of them is labeled independently before concatenating the predictions to form a unified segmentation. Despite being simple, we observe great performance in terms of 1) the segment classification results and 2) the overlap rate between the prediction and the ground-truth aggregated segmentation.
## Usage
For DiscoEPG to run properly, you only need to prepare a dataset folder which contains all the dataset containing recordings with the ASCII format obtained from [Stylet+ application](https://www.DiscoEPGystems.eu/). Corresponding to each dataset `<dataset_name>`, there should be one subfolder called `<dataset_name>` containing the recording data (with `.A0x` extension) and another one called `<dataset_name>_ANA` containing the waveform position (with `.ANA` extension). Each complete recording comprises of multiple recording files. In case the prefix of these data files are different, DiscoEPG will automatically rename them from `<file_name>.A0x` into `<folder_name>_<file_name>.A0x`, as well as the analysis file.
## Functions
For training a model, predicting segmenation or making visualization, please refer to the example notebooks.
### Train ML models for characterizing EPG waveforms
DiscoEPG provides two trainer objects for training Deep Learning (CNN1D, ResNet and CNN2D) and Traditional Machine Learning (XGB, Random Forest, Logistic Regression) for characterizing EPG waveforms. After a model is trained, it can be used for EPG waveform segmentation. The trainer objects also provide post-prediction utilities such as saving checkpoints (for DL models) and plot the segmentation result/ metrics. The syntaxes are closely resemble that of the implementation of ML algorithms by `scikit-learn`.
### Visualization
DiscoEPG allows users to create color plots, in both _static_ and _interactive_ states of EPG recordings. The data visualization functions are based on well-known visualization libraries such as matplotlib and plotly. To help with visualizing a huge numbers of data points, `plotly-resampler` [2] was incorporated into our package.
### EPG parameters calculation
DiscoEPG can calculate various EPG parameters proposed for aphids, adopted from [4].
## Acknowledgement
We hugely thanks the authors of the cited work for providing us with necessary tools which were the building blocks for DiscoEPG.
## Please cite our paper with
```bibtex
@article {Dinh2024.06.10.598170,
author = {Dinh, Quang-Dung and Kunk, Daniel and Hy, Truong Son and Nalam, Vamsi J and Dao, Phuong},
title = {Machine learning for characterizing plant-insect interactions through electrical penetration graphic signal},
elocation-id = {2024.06.10.598170},
year = {2024},
doi = {10.1101/2024.06.10.598170},
publisher = {Cold Spring Harbor Laboratory},
abstract = {The electrical penetration graph (EPG) is a well-known technique that provides insights into the feeding behavior of insects with piercing-sucking mouthparts, mostly hemipterans. Since its inception in the 1960s, EPG has become indispensable in studying plant-insect interactions, revealing critical information about host plant selection, plant resistance, virus transmission, and responses to environmental factors. By integrating the plant and insect into an electrical circuit, EPG allows researchers to identify specific feeding behaviors based on distinct waveform patterns associated with activities within plant tissues. However, the traditional manual analysis of EPG waveform data is time-consuming and labor-intensive, limiting research throughput. This study presents a novel machine-learning approach to automate the segmentation and classification of EPG signals. We rigorously evaluated six diverse machine learning models, including neural networks, tree-based models, and logistic regressions, using an extensive dataset from aphid feeding experiments. Our results demonstrate that a Residual Network (ResNet) architecture achieved the highest overall waveform classification accuracy of 96.8\% and highest segmentation overlap rate of 84.4\%, highlighting the potential of machine learning for accurate and efficient EPG analysis. This automated approach promises to accelerate research in this field significantly and has the potential to be generalized to other insect species and experimental settings. Our findings underscore the value of applying advanced computational techniques to complex biological datasets, paving the way for a more comprehensive understanding of insect-plant interactions and their broader ecological implications. The source code for all experiments conducted within this study is publicly available at https://github.com/HySonLab/ML4InsectsCompeting Interest StatementThe authors have declared no competing interest.},
URL = {https://www.biorxiv.org/content/early/2024/06/11/2024.06.10.598170},
eprint = {https://www.biorxiv.org/content/early/2024/06/11/2024.06.10.598170.full.pdf},
journal = {bioRxiv}
}
```
## Contributors
* Quang-Dung DINH, Institut Galilée, Universite Sorbonne Paris Nord, Villetaneuse 93430, Paris, France
* Truong Son HY (PI), Department of Mathematics and Computer Science, Indiana State University, Terre Haute, IN 47809, United States
* Phuong DAO (PI), Department of Agricultural Biology, Colorado State University, Fort Collins, CO 80523, United States
## References
[1.](https://onlinelibrary.wiley.com/doi/10.1111/j.1570-7458.1978.tb02836.x) Tjallingii WF. Electronic Recording of Penetration Behaviour by Aphids Entomologia Experimentalis et Applicata. 1978; 24(3): 721–730.
[2.](https://ieeexplore.ieee.org/document/9973221) J. Van Der Donckt, J. Van der Donckt, E. Deprost and S. Van Hoecke, "Plotly-Resampler: Effective Visual Analytics for Large Time Series," 2022 IEEE Visualization and Visual Analytics (VIS), Oklahoma City, OK, USA, 2022, pp. 21-25. [GitHub](https://github.com/predict-idlab/plotly-resampler)
[3.](https://link.springer.com/article/10.1007/s11263-019-01194-0) Runia, T.F.H., Snoek, C.G.M. & Smeulders, A.W.M. Repetition Estimation. Int J Comput Vis 127, 1361–1383 (2019). [GitHub](https://github.com/tomrunia/PyTorchWavelets)
[4.](https://academic.oup.com/jinsectscience/article/24/3/28/7701043) Elisa Garzo, Antonio Jesús Álvarez, Aránzazu Moreno, Gregory P Walker, W Fred Tjallingii, Alberto Fereres, Novel program for automatic calculation of EPG variables, Journal of Insect Science, Volume 24, Issue 3, May 2024, 28.
Raw data
{
"_id": null,
"home_page": "https://github.com/HySonLab/ML4Insects",
"name": "DiscoEPG",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.10",
"maintainer_email": null,
"keywords": null,
"author": "DINHQuangDung1999",
"author_email": "dqdung999@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/df/02/8f44b5395e4c9395b78e16b59a0fac41f01758b5e76914a19b528fc8ed20/DiscoEPG-0.0.22.tar.gz",
"platform": null,
"description": "# DiscoEPG (Discovery EPG) - A library for EPG signal analysis of pierce-sucking insects\r\n\r\n## Overview\r\nElectrical penetration graph (EPG) is a technique used to study the feeding behavior of sucking insects such as aphids. Specifically, the experimental insect and host plant are made part of an electrical circuit, which is closed when aphid mouthparts penetrate plant tissue. When the aphid stylet is inserted intercellularly, the voltage is positive and when inserted intracellularly, the voltage is negative. Waveforms in EPG have been correlated to specific aphid feeding behaviors by stylectomy followed by microscopy of the plant tissue to determine the approximate location of the stylet as well as observing aphid head movement, posture, and muscle dynamics. EPG is well established and has been widely used to study the mechanisms of plant virus transmission by aphids, the effect of resistant and susceptible lines on aphid feeding behaviors, and to better our understanding of the mechanisms that aphids use to continuously drink from the phloem. \r\n\r\nDiscoEPG (abbreviated for Discovery-EPG) package is an open-source Python package, designed to be compatible with the popular Stylet+ EPG System by W. F. Tjallingii [1]. DiscoEPG provides many utilities including data visualization, accurate automatic segmentation, and calculations of various EPG parameters, which facilitate the data analysis stage in the study of EPG signals. The package was used as a helpful support tool for our study in characterizing aphid's behavior based on this data. \r\n\r\nThe novelty of DiscoEPG lies in the automatic segmentation procedure, which follows a sliding-window technique where the entire signal is broken into non-overlapping segments, then the each of them is labeled independently before concatenating the predictions to form a unified segmentation. Despite being simple, we observe great performance in terms of 1) the segment classification results and 2) the overlap rate between the prediction and the ground-truth aggregated segmentation. \r\n\r\n## Usage \r\nFor DiscoEPG to run properly, you only need to prepare a dataset folder which contains all the dataset containing recordings with the ASCII format obtained from [Stylet+ application](https://www.DiscoEPGystems.eu/). Corresponding to each dataset `<dataset_name>`, there should be one subfolder called `<dataset_name>` containing the recording data (with `.A0x` extension) and another one called `<dataset_name>_ANA` containing the waveform position (with `.ANA` extension). Each complete recording comprises of multiple recording files. In case the prefix of these data files are different, DiscoEPG will automatically rename them from `<file_name>.A0x` into `<folder_name>_<file_name>.A0x`, as well as the analysis file.\r\n\r\n## Functions\r\nFor training a model, predicting segmenation or making visualization, please refer to the example notebooks. \r\n\r\n### Train ML models for characterizing EPG waveforms\r\nDiscoEPG provides two trainer objects for training Deep Learning (CNN1D, ResNet and CNN2D) and Traditional Machine Learning (XGB, Random Forest, Logistic Regression) for characterizing EPG waveforms. After a model is trained, it can be used for EPG waveform segmentation. The trainer objects also provide post-prediction utilities such as saving checkpoints (for DL models) and plot the segmentation result/ metrics. The syntaxes are closely resemble that of the implementation of ML algorithms by `scikit-learn`.\r\n\r\n### Visualization\r\nDiscoEPG allows users to create color plots, in both _static_ and _interactive_ states of EPG recordings. The data visualization functions are based on well-known visualization libraries such as matplotlib and plotly. To help with visualizing a huge numbers of data points, `plotly-resampler` [2] was incorporated into our package. \r\n\r\n### EPG parameters calculation \r\nDiscoEPG can calculate various EPG parameters proposed for aphids, adopted from [4].\r\n\r\n## Acknowledgement\r\nWe hugely thanks the authors of the cited work for providing us with necessary tools which were the building blocks for DiscoEPG. \r\n\r\n## Please cite our paper with\r\n\r\n```bibtex\r\n@article {Dinh2024.06.10.598170,\r\n\tauthor = {Dinh, Quang-Dung and Kunk, Daniel and Hy, Truong Son and Nalam, Vamsi J and Dao, Phuong},\r\n\ttitle = {Machine learning for characterizing plant-insect interactions through electrical penetration graphic signal},\r\n\telocation-id = {2024.06.10.598170},\r\n\tyear = {2024},\r\n\tdoi = {10.1101/2024.06.10.598170},\r\n\tpublisher = {Cold Spring Harbor Laboratory},\r\n\tabstract = {The electrical penetration graph (EPG) is a well-known technique that provides insights into the feeding behavior of insects with piercing-sucking mouthparts, mostly hemipterans. Since its inception in the 1960s, EPG has become indispensable in studying plant-insect interactions, revealing critical information about host plant selection, plant resistance, virus transmission, and responses to environmental factors. By integrating the plant and insect into an electrical circuit, EPG allows researchers to identify specific feeding behaviors based on distinct waveform patterns associated with activities within plant tissues. However, the traditional manual analysis of EPG waveform data is time-consuming and labor-intensive, limiting research throughput. This study presents a novel machine-learning approach to automate the segmentation and classification of EPG signals. We rigorously evaluated six diverse machine learning models, including neural networks, tree-based models, and logistic regressions, using an extensive dataset from aphid feeding experiments. Our results demonstrate that a Residual Network (ResNet) architecture achieved the highest overall waveform classification accuracy of 96.8\\% and highest segmentation overlap rate of 84.4\\%, highlighting the potential of machine learning for accurate and efficient EPG analysis. This automated approach promises to accelerate research in this field significantly and has the potential to be generalized to other insect species and experimental settings. Our findings underscore the value of applying advanced computational techniques to complex biological datasets, paving the way for a more comprehensive understanding of insect-plant interactions and their broader ecological implications. The source code for all experiments conducted within this study is publicly available at https://github.com/HySonLab/ML4InsectsCompeting Interest StatementThe authors have declared no competing interest.},\r\n\tURL = {https://www.biorxiv.org/content/early/2024/06/11/2024.06.10.598170},\r\n\teprint = {https://www.biorxiv.org/content/early/2024/06/11/2024.06.10.598170.full.pdf},\r\n\tjournal = {bioRxiv}\r\n}\r\n```\r\n\r\n## Contributors\r\n* Quang-Dung DINH, Institut Galil\u00e9e, Universite Sorbonne Paris Nord, Villetaneuse 93430, Paris, France\r\n* Truong Son HY (PI), Department of Mathematics and Computer Science, Indiana State University, Terre Haute, IN 47809, United States\r\n* Phuong DAO (PI), Department of Agricultural Biology, Colorado State University, Fort Collins, CO 80523, United States\r\n\r\n## References\r\n[1.](https://onlinelibrary.wiley.com/doi/10.1111/j.1570-7458.1978.tb02836.x) Tjallingii WF. Electronic Recording of Penetration Behaviour by Aphids Entomologia Experimentalis et Applicata. 1978; 24(3): 721\u2013730.\r\n\r\n[2.](https://ieeexplore.ieee.org/document/9973221) J. Van Der Donckt, J. Van der Donckt, E. Deprost and S. Van Hoecke, \"Plotly-Resampler: Effective Visual Analytics for Large Time Series,\" 2022 IEEE Visualization and Visual Analytics (VIS), Oklahoma City, OK, USA, 2022, pp. 21-25. [GitHub](https://github.com/predict-idlab/plotly-resampler) \r\n\r\n[3.](https://link.springer.com/article/10.1007/s11263-019-01194-0) Runia, T.F.H., Snoek, C.G.M. & Smeulders, A.W.M. Repetition Estimation. Int J Comput Vis 127, 1361\u20131383 (2019). [GitHub](https://github.com/tomrunia/PyTorchWavelets) \r\n\r\n[4.](https://academic.oup.com/jinsectscience/article/24/3/28/7701043) Elisa Garzo, Antonio Jes\u00fas \u00c1lvarez, Ar\u00e1nzazu Moreno, Gregory P Walker, W Fred Tjallingii, Alberto Fereres, Novel program for automatic calculation of EPG variables, Journal of Insect Science, Volume 24, Issue 3, May 2024, 28.\r\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "Open-source package for insects EPG data analysis",
"version": "0.0.22",
"project_urls": {
"Homepage": "https://github.com/HySonLab/ML4Insects"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "6e4dd16ab9fa359a421b0f3fa83c09d6ee4ba620b21b64632057cb6575c4f0f7",
"md5": "a61c1f4a1a39c5d3e1ef0157101b4bc3",
"sha256": "286e9bac6809c09b3eee784fd1d36dc2ebd71c34f5cbcaed6f105a3aad17310b"
},
"downloads": -1,
"filename": "DiscoEPG-0.0.22-py3-none-any.whl",
"has_sig": false,
"md5_digest": "a61c1f4a1a39c5d3e1ef0157101b4bc3",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.10",
"size": 70859,
"upload_time": "2024-12-11T21:20:28",
"upload_time_iso_8601": "2024-12-11T21:20:28.211117Z",
"url": "https://files.pythonhosted.org/packages/6e/4d/d16ab9fa359a421b0f3fa83c09d6ee4ba620b21b64632057cb6575c4f0f7/DiscoEPG-0.0.22-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "df028f44b5395e4c9395b78e16b59a0fac41f01758b5e76914a19b528fc8ed20",
"md5": "c0af7ead0e0b0ad359a3f53a72964577",
"sha256": "d9314a170ec19bfe9400dc0ae2667757f5f80f9e8a6d34aa346c81c38b98a6fe"
},
"downloads": -1,
"filename": "DiscoEPG-0.0.22.tar.gz",
"has_sig": false,
"md5_digest": "c0af7ead0e0b0ad359a3f53a72964577",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.10",
"size": 61935,
"upload_time": "2024-12-11T21:20:29",
"upload_time_iso_8601": "2024-12-11T21:20:29.524922Z",
"url": "https://files.pythonhosted.org/packages/df/02/8f44b5395e4c9395b78e16b59a0fac41f01758b5e76914a19b528fc8ed20/DiscoEPG-0.0.22.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-12-11 21:20:29",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "HySonLab",
"github_project": "ML4Insects",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"requirements": [
{
"name": "numpy",
"specs": [
[
"==",
"1.26.4"
]
]
},
{
"name": "pandas",
"specs": [
[
"==",
"2.2.2"
]
]
},
{
"name": "matplotlib",
"specs": [
[
"==",
"3.9.1"
]
]
},
{
"name": "seaborn",
"specs": [
[
"==",
"0.13.2"
]
]
},
{
"name": "librosa",
"specs": [
[
"==",
"0.10.2.post1"
]
]
},
{
"name": "torch",
"specs": [
[
"==",
"2.3.1"
]
]
},
{
"name": "easydict",
"specs": []
},
{
"name": "scikit-learn",
"specs": [
[
"==",
"1.5.1"
]
]
},
{
"name": "xgboost",
"specs": [
[
"==",
"2.1.0"
]
]
},
{
"name": "scipy",
"specs": [
[
"==",
"1.14.0"
]
]
},
{
"name": "plotly",
"specs": [
[
"==",
"5.22.0"
]
]
},
{
"name": "plotly-resampler",
"specs": []
},
{
"name": "ipywidgets",
"specs": [
[
"==",
"8.1.3"
]
]
},
{
"name": "nbformat",
"specs": [
[
"==",
"5.10.4"
]
]
},
{
"name": "pyts",
"specs": [
[
"==",
"0.13.0"
]
]
},
{
"name": "opencv-python",
"specs": []
},
{
"name": "PyWavelets",
"specs": []
},
{
"name": "tqdm",
"specs": []
},
{
"name": "xlsxwriter",
"specs": []
}
],
"lcname": "discoepg"
}
JSON
