# intedact: Interactive EDA
[](https://pypi.org/project/intedact/)
[](https://github.com/mattboggess/intedact/blob/master/LICENSE)
Interactive EDA for pandas DataFrames directly in your Jupyter notebook. intedact makes
common, standardized EDA visual summaries available in an interactive manner with one function call. Using ipywidgets, you can quickly
cycle through different variables or combinations of variables and produce useful visual summaries when exploring the dataset. Each summary will have additional
plot parameters you can tweak to adjust the visualizations to work for your dataset.
Full documentation at [intedact.readthedocs.io](https://intedact.readthedocs.io/en/latest/index.html)
# Getting Started
## Installation
Install via pip:
pip install intedact
Download the following nltk resources for the ngram text summaries.
import nltk
nltk.download('punkt')
nltk.download('stopwords')
## Univariate EDA
Univariate EDA refers to the process of visualizing and summarizing a single variable.
For interactive univariate EDA simply import the `univariate_eda_interact` function in a jupyter notebook and pass in a pandas dataframe:
from intedact import univariate_eda_interact
univarate_eda_interact(
data, notes_file="optional_file_to_save_notes_to.json"
)
<img src="https://github.com/mattboggess/intedact/raw/main/demo/univariate_eda.gif"/>
At the top level, one selects the column and the summary type for that column to display. To explore the full dataset,
just toggle through each of the column names. Current supported summary types:
- categorical: Summarize a categorical or low cardinality numerical column
- numeric: Summarize a high cardinality numerical column
- datetime: Summarize a datetime column
- text: Summarize a free form text column
- collection: Summarize a column with collections of values (i.e. lists, tuples, sets, etc.)
- url: Summarize a column containing urls
For each column, one can then adjust parameters for the given summary type to fit your particular dataset. These summaries
try to automatically set good default parameters, but sometimes you need to make adjustments to get the full picture.
See the documentation for [examples](https://intedact.readthedocs.io/en/latest/auto_examples/index.html) of how to statically call the individual univariate summary functions.
## Bivariate EDA
Bivariate EDA refers to the process of visualizing and summarizing a pair of variables.
Like with univariate EDA, simply import the `bivariate_eda_interact` function in a jupyter notebook and pass in a dataframe:
from intedact import bivariate_eda_interact
bivarate_eda_interact(
data, notes_file="optional_file_to_save_notes_to.json"
)
<img src="https://github.com/mattboggess/intedact/raw/main/demo/bivariate_eda.gif"/>
At the top level, one selects a pair of columns to display (one as the independent and the second as the dependent).
Current supported summary types:
- categorical-categorical: Summarize a pair of categorical columns
- numeric-categorical: Summarize an independent numeric variable against a dependent categorical variable
- categorical-numeric: Summarize an independent categorical variable against a dependent numeric variable
- numeric-numeric: Summarize a pair of numeric columns
# Design Philosophy
The motivation for intedact comes from the following observations:
1. There is a standard set of visualizations that should be always applied to different individual and combinations of variables depending on their type when performing EDA. For example, it is always good
to visualize the distribution of a numerical variable using a histogram. intedact's goal is to save you from having to constantly copy-paste this code across columns, projects, etc.
2. These visualizations often need some degree of adjustment to get the information you need. For example, really skewed variables with outliers might need some outlier filtering and/or a log transform
to actually be able to visualize the histogram properly. intedact's goal is to give you additional control over the visualization with interactive widgets that you can repeatedly adjust until
you get the visualization you need.
Given the above, intedact tries to produce visualizations that give you the visual understanding you are seeking for 95% of cases when you pass in the defaults. For the other 5%,
we give you additional parameters you can tweak via the widgets so you can still get the insights you need without having to leave the interface.
intedact is not a single click EDA summary generation tool. Many of those exist and we recommend pairing them with intedact (pandas-profiling is a great one for example).
Where these fall short, is they don't focus on the visualizations and give you the power to adjust them to your dataset when the defaults don't suffice. Use intedact
when you want to dig deeper and really visually understand a variable or the relationship between variable(s).
Raw data
{
"_id": null,
"home_page": "https://intedact.readthedocs.io/en/latest/index.html",
"name": "intedact",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.6",
"maintainer_email": "",
"keywords": "eda,data visualization,data science,pandas,data analysis,python",
"author": "Matthew Boggess",
"author_email": "mattboggess7@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/44/cc/9016e44708e9c147bf76d0d4e93dcbb4111da4eeaf3c1c41cd78b5942709/intedact-0.1.0.tar.gz",
"platform": null,
"description": "# intedact: Interactive EDA\n\n[](https://pypi.org/project/intedact/)\n[](https://github.com/mattboggess/intedact/blob/master/LICENSE)\n\nInteractive EDA for pandas DataFrames directly in your Jupyter notebook. intedact makes\ncommon, standardized EDA visual summaries available in an interactive manner with one function call. Using ipywidgets, you can quickly\ncycle through different variables or combinations of variables and produce useful visual summaries when exploring the dataset. Each summary will have additional\nplot parameters you can tweak to adjust the visualizations to work for your dataset.\n\nFull documentation at [intedact.readthedocs.io](https://intedact.readthedocs.io/en/latest/index.html)\n\n# Getting Started\n\n## Installation\n\nInstall via pip:\n\n pip install intedact\n\nDownload the following nltk resources for the ngram text summaries.\n\n import nltk\n nltk.download('punkt')\n nltk.download('stopwords')\n\n## Univariate EDA\n\nUnivariate EDA refers to the process of visualizing and summarizing a single variable.\n\nFor interactive univariate EDA simply import the `univariate_eda_interact` function in a jupyter notebook and pass in a pandas dataframe:\n\n from intedact import univariate_eda_interact\n univarate_eda_interact(\n data, notes_file=\"optional_file_to_save_notes_to.json\"\n )\n\n<img src=\"https://github.com/mattboggess/intedact/raw/main/demo/univariate_eda.gif\"/>\n\nAt the top level, one selects the column and the summary type for that column to display. To explore the full dataset,\njust toggle through each of the column names. Current supported summary types:\n\n- categorical: Summarize a categorical or low cardinality numerical column\n- numeric: Summarize a high cardinality numerical column\n- datetime: Summarize a datetime column\n- text: Summarize a free form text column\n- collection: Summarize a column with collections of values (i.e. lists, tuples, sets, etc.)\n- url: Summarize a column containing urls\n\nFor each column, one can then adjust parameters for the given summary type to fit your particular dataset. These summaries\ntry to automatically set good default parameters, but sometimes you need to make adjustments to get the full picture.\n\nSee the documentation for [examples](https://intedact.readthedocs.io/en/latest/auto_examples/index.html) of how to statically call the individual univariate summary functions.\n\n## Bivariate EDA\n\nBivariate EDA refers to the process of visualizing and summarizing a pair of variables.\n\nLike with univariate EDA, simply import the `bivariate_eda_interact` function in a jupyter notebook and pass in a dataframe:\n\n from intedact import bivariate_eda_interact\n bivarate_eda_interact(\n data, notes_file=\"optional_file_to_save_notes_to.json\"\n )\n\n<img src=\"https://github.com/mattboggess/intedact/raw/main/demo/bivariate_eda.gif\"/>\n\nAt the top level, one selects a pair of columns to display (one as the independent and the second as the dependent).\nCurrent supported summary types:\n\n- categorical-categorical: Summarize a pair of categorical columns\n- numeric-categorical: Summarize an independent numeric variable against a dependent categorical variable\n- categorical-numeric: Summarize an independent categorical variable against a dependent numeric variable\n- numeric-numeric: Summarize a pair of numeric columns\n\n\n# Design Philosophy\n\nThe motivation for intedact comes from the following observations:\n\n1. There is a standard set of visualizations that should be always applied to different individual and combinations of variables depending on their type when performing EDA. For example, it is always good\n to visualize the distribution of a numerical variable using a histogram. intedact's goal is to save you from having to constantly copy-paste this code across columns, projects, etc.\n2. These visualizations often need some degree of adjustment to get the information you need. For example, really skewed variables with outliers might need some outlier filtering and/or a log transform\n to actually be able to visualize the histogram properly. intedact's goal is to give you additional control over the visualization with interactive widgets that you can repeatedly adjust until\n you get the visualization you need.\n\nGiven the above, intedact tries to produce visualizations that give you the visual understanding you are seeking for 95% of cases when you pass in the defaults. For the other 5%,\nwe give you additional parameters you can tweak via the widgets so you can still get the insights you need without having to leave the interface.\n\nintedact is not a single click EDA summary generation tool. Many of those exist and we recommend pairing them with intedact (pandas-profiling is a great one for example).\nWhere these fall short, is they don't focus on the visualizations and give you the power to adjust them to your dataset when the defaults don't suffice. Use intedact\nwhen you want to dig deeper and really visually understand a variable or the relationship between variable(s).\n",
"bugtrack_url": null,
"license": "",
"summary": "Interactive EDA visualizations in your jupyter notebook",
"version": "0.1.0",
"split_keywords": [
"eda",
"data visualization",
"data science",
"pandas",
"data analysis",
"python"
],
"urls": [
{
"comment_text": "",
"digests": {
"md5": "3df7ef432086dc6c7dc58c268f2ab2d5",
"sha256": "bbf21333c8c223e9286202021ae6ab96e96ff07ee0d94289ab554fb609550841"
},
"downloads": -1,
"filename": "intedact-0.1.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "3df7ef432086dc6c7dc58c268f2ab2d5",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.6",
"size": 24991,
"upload_time": "2022-12-25T21:20:32",
"upload_time_iso_8601": "2022-12-25T21:20:32.223114Z",
"url": "https://files.pythonhosted.org/packages/a1/3d/726175ec618bebab339394bd405d9ef71e6100070253c77290e1444cd132/intedact-0.1.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"md5": "48e8104c7e4c08b02bdc16a657a2d2d8",
"sha256": "0e4673ec901662dcf77898934d8d2c67a41a282a03cf7b33b26b5a9ebec9cf63"
},
"downloads": -1,
"filename": "intedact-0.1.0.tar.gz",
"has_sig": false,
"md5_digest": "48e8104c7e4c08b02bdc16a657a2d2d8",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.6",
"size": 22518,
"upload_time": "2022-12-25T21:20:33",
"upload_time_iso_8601": "2022-12-25T21:20:33.417299Z",
"url": "https://files.pythonhosted.org/packages/44/cc/9016e44708e9c147bf76d0d4e93dcbb4111da4eeaf3c1c41cd78b5942709/intedact-0.1.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2022-12-25 21:20:33",
"github": false,
"gitlab": false,
"bitbucket": false,
"lcname": "intedact"
}
JSON