# Chatify
[](https://zenodo.org/badge/latestdoi/627651845)
<img src="https://raw.githubusercontent.com/ContextLab/chatify/main/docs/images/greeting.png" alt="greeting" width="400"/>
Chatify is a python package that enables ipython magic commands to Jupyter notebooks that provide LLM-driven enhancements to markdown and code cells. This package is currently in the *alpha* stage: expect broken things, crashes, bad (wrong, misleading) answers, and other serious issues. That said, we think Chatify is pretty neat even in this early form, and we're excited about its future!
# Background
This tool was originally created to supplement the [Neuromatch Academy](https://compneuro.neuromatch.io/tutorials/intro.html) materials. A "Chatify-enhanced" version of the Neuromatch computational neuroscience course may be found [here](https://contextlab.github.io/course-content/tutorials/intro.html), and an enhanced version of the deep learning course may be found [here](https://contextlab.github.io/course-content-dl/tutorials/intro.html).
## Installing and enabling Chatify
To install and enable chatify in any Jupyter (iPython) notebook, add the following two cells to the top of your notebook (and run them):
```python
%pip install davos
import davos
davos.config.suppress_stdout = True
```
```python
smuggle chatify
%load_ext chatify
```
No further setup is required. To interact with Chatify about any code in the notebook, simply insert the `%%explain` magic command at the top of the code cell and then run it (shift + enter) to access the Chatify interface. To disable Chatify and run the code block as usual, just delete the `%%explain` command and re-run the cell (e.g., by pressing shift + enter again).
### Why those two cells?
The first cell installs and enables the [Davos](https://github.com/ContextLab/davos) library, which is used to safely manage Python dependencies in Jupyter notebooks. Importing Davos provides access to the `smuggle` keyword. The `smuggle` keyword is like a safer and more robust version of `import`; if the requested package isn't available in the current environment, it will be automatically installed and imported. Importantly, any newly installed packages are automatically isolated in a virtual environment. This prevents Chatify or its dependencies from interfering with other packages that might be installed on your system.
The `smuggle` statement in the second cell is what actually installs, configures, and imports Chatify, and the `%load_ext` line loads and enables the Chatify extension (accessed by adding the `%%explain` magic command to the top of any code cell in the notebook).
If you don't care about protecting your runtime environment from potential side effects of installing Chatify (note: this is **not recommended** and may **break other aspects of your setup**!), you can replace those two cells above with the following:
```python
!pip install -qqq chatify
import chatify
%load_ext chatify
```
Note: the quiet (`-qqq`) flags are optional, but including them will avoid cluttering up your notebook with installation-related messages. It's probably fine to use this "direct/unsafe install" method if you're running Chatify in a Colab notebook, inside of a container, or in a dedicated virtual environment, but you shouldn't install the unsafe version of Chatify locally. GPU-friendly libraries are notoriously finicky, and since Chatify will mess with some of those libraries it's reasonably likely that your other GPU libraries will stop working correctly if you don't isolate Chatify's effects on your system.
### I like to live on the wild side-- give me the bleeding edge version!
Psst...if you really want to see our lack of quality control on full display, we can tell you the secret password 🤫. Step this way...that's right. Don't mind those animals, pay no attention...🐯🦁🦎...🦌🐘🐬🦕...to install Chatify directly from GitHub (**even though this is not recommended!!**), with no safety checks or guarantees whatsoever, you can add and run this cell to the top of your notebook:
```python
!pip install -qqq chatify git+https://github.com/ContextLab/chatify.git
import chatify
%load_ext chatify
```
You should really only do this in a fully protected (containerized, virtual)
environment or on Colab, since it could break other stuff on your system. Don't
say we didn't warn you!
## Customizing Chatify
Chatify is designed to work by default in the free tiers of [Colaboratory](https://colab.research.google.com/) and [Kaggle](https://www.kaggle.com/code) notebooks, and to operate without requiring any additional costs or setup beyond installing and enabling Chatify itself. There's some server magic that happens behind the scenes to make that happen. In addition to Colaboratory and Kaggle notebooks, Chatify also supports a variety of other systems and setups, including running locally or on other cloud-based systems (e.g., if you don't want our servers to see what you're doing 🕵️). For setups with additional resources, it is possible to switch to better-performing or lower-cost models. Chatify works in CPU-only environments, but it is GPU-friendly (for both CUDA-enabled and Metal-enabled systems). We support any text-generation model on [Hugging Face](https://huggingface.co/models?pipeline_tag=text-generation&sort=trending), Meta's [Llama 2](https://ai.meta.com/resources/models-and-libraries/llama-downloads/) models, and OpenAI's [ChatGPT](https://chat.openai.com/) models (e.g., ChatGPT-3.5 and ChatGPT-4). Models that run on Hugging Face or OpenAI's servers require either a [Hugging Face API key](https://huggingface.co/docs/api-inference/quicktour#get-your-api-token) or an [OpenAI API key](https://platform.openai.com/signup), respectively.
Once you have your API key(s), if needed, create a `config.yaml` file in the directory where you launch your notebook. For the OpenAI configuration, replace `<OPANAI API KEY>` with your actual OpenAI API key (with no quotes) and then create a `config.yaml` file with the following contents:
### OpenAI configuration
If you have an OpenAI API key, adding this config.yaml file to your local directory (after adding your API key) will substantially improve your experience by generating higher quality responses:
```yaml
cache_config:
cache: False
caching_strategy: exact # alternative: similarity
cache_db_version: 0.1
url: <URL> # ignore this
feedback: False
model_config:
open_ai_key: <OPENAI API KEY>
model: open_ai_model
model_name: gpt-4
max_tokens: 2500
chain_config:
chain_type: default
prompts_config:
prompts_to_use: [tutor, tester, inventer, experimenter]
```
### Llama 2 configuration
If you're running your notebook on a well-resourced machine, you can use this config file to get good performance for free, and without using our servers! The 7B and 13B variants of llama 2 both run on the free tier of Google Colaboratory and Kaggle, but the 13B is substantially slower (therefore we recommend the 7B variant if you're using Colaboratory or Kaggle notebooks). Note that using this configuration requires installing the "HuggingFace" dependencies (`pip install chatify[hf]`).
```yaml
cache_config:
cache: False
caching_strategy: exact # alternative: similarity
cache_db_version: 0.1
url: <URL> # ignore this
feedback: False
model_config:
model: llama_model
model_name: TheBloke/Llama-2-70B-Chat-GGML # can also replace "70B" with either "7B" or "13B" on this line and the next
weights_fname: llama-2-70b-chat.ggmlv3.q5_1.bin
max_tokens: 2500
n_gpu_layers: 40
n_batch: 512
chain_config:
chain_type: default
prompts_config:
prompts_to_use: [tutor, tester, inventer, experimenter]
```
### Hugging Face configuration (local)
If you're running your notebook on a well-resourced machine, you can use this config file to get good performance for free, and without using our servers! For most models this will require lots of RAM. It's a nice way to explore a wide variety of models. Note that using this configuration requires installing the "HuggingFace" dependencies (`pip install chatify[hf]`).
```yaml
cache_config:
cache: False
caching_strategy: exact # alternative: similarity
cache_db_version: 0.1
url: <URL> # ignore this
feedback: False
model_config:
model: huggingface_model
model_name: TheBloke/Llama-2-70B-Chat-GGML # replace with any text-generation model on Hugging Face!
max_tokens: 2500
n_gpu_layers: 40
n_batch: 512
chain_config:
chain_type: default
prompts_config:
prompts_to_use: [tutor, tester, inventer, experimenter]
```
After saving your `config.yaml` file, follow the "[**Installing and enabling Chatify**](README.md#installing-and-enabling-chatify)" instructions.
# What do I do if I have questions or problems?
We'd love to hear from you 🤩! If you're using Chatify as part of one of the NMA courses, please consider filling out our [feedback survey](https://forms.gle/V9ZGssyukjmFR9bk7) to help us improve and/or better understand the experience. For more general problems, please submit an [issue](https://github.com/ContextLab/chatify/issues). And for other questions, comments, concerns, etc., just send us an [email](contextualdynamics@gmail.com).
# I want to help!
Yay-- welcome 🎉! This is a *very* new project (in the "alpha" phase) and we're looking for all the help we can get! If you're new around here and want to explore/contribute, here's how:
1. [Fork](https://github.com/ContextLab/chatify/fork) this repository so that you can work with your own "copy" of the code base
2. Take a look at our [Project Board](https://github.com/orgs/ContextLab/projects/3) and/or the list of open [issues](https://github.com/ContextLab/chatify/issues) to get a sense of the current project status, todo list, etc.
3. Feel free to add your own issues/tasks, comment on existing issues, etc.
## Current priorities and suggested tasks to start with
In general, we've broken down tasks into ["coding" tasks](https://github.com/ContextLab/chatify/labels/coding%20required) (which require some amount of coding, likely in Python) and ["non-coding" tasks](https://github.com/ContextLab/chatify/labels/non-coding) (which do *not* require coding).
If you have questions, ideas, etc., also please check out the [discussion board](https://github.com/ContextLab/chatify/discussions)!
=======
History
=======
0.2.1 (August, 2023)
------------------
* Preparing for a release on pip
0.2.0 (July, 2023)
------------------
* Lots of GUI improvements
* Default model is now run on a proxy server (still does not require and setup or API key)
0.1.1 (July, 2023)
------------------
* More models are now supported!
* Everything now runs locally (no need for an OpenAI API key)
0.1.0 (July, 2023)
------------------
* Initial package version.
Raw data
{
"_id": null,
"home_page": "https://github.com/ContextLab/chatify",
"name": "chatify",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.6",
"maintainer_email": "",
"keywords": "chatify",
"author": "Contextual Dynamics Lab",
"author_email": "contextualdynamics@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/1e/63/681ba3c606c5750ea800f4a8e8a5daadb64354fb0831b938e61a284cb62d/chatify-0.2.1.tar.gz",
"platform": null,
"description": "# Chatify\n[](https://zenodo.org/badge/latestdoi/627651845)\n\n<img src=\"https://raw.githubusercontent.com/ContextLab/chatify/main/docs/images/greeting.png\" alt=\"greeting\" width=\"400\"/>\n\nChatify is a python package that enables ipython magic commands to Jupyter notebooks that provide LLM-driven enhancements to markdown and code cells. This package is currently in the *alpha* stage: expect broken things, crashes, bad (wrong, misleading) answers, and other serious issues. That said, we think Chatify is pretty neat even in this early form, and we're excited about its future!\n\n# Background\n\nThis tool was originally created to supplement the [Neuromatch Academy](https://compneuro.neuromatch.io/tutorials/intro.html) materials. A \"Chatify-enhanced\" version of the Neuromatch computational neuroscience course may be found [here](https://contextlab.github.io/course-content/tutorials/intro.html), and an enhanced version of the deep learning course may be found [here](https://contextlab.github.io/course-content-dl/tutorials/intro.html).\n\n## Installing and enabling Chatify\n\nTo install and enable chatify in any Jupyter (iPython) notebook, add the following two cells to the top of your notebook (and run them):\n\n```python\n%pip install davos\nimport davos\ndavos.config.suppress_stdout = True\n```\n\n```python\nsmuggle chatify\n%load_ext chatify\n```\n\nNo further setup is required. To interact with Chatify about any code in the notebook, simply insert the `%%explain` magic command at the top of the code cell and then run it (shift + enter) to access the Chatify interface. To disable Chatify and run the code block as usual, just delete the `%%explain` command and re-run the cell (e.g., by pressing shift + enter again).\n\n### Why those two cells?\n\nThe first cell installs and enables the [Davos](https://github.com/ContextLab/davos) library, which is used to safely manage Python dependencies in Jupyter notebooks. Importing Davos provides access to the `smuggle` keyword. The `smuggle` keyword is like a safer and more robust version of `import`; if the requested package isn't available in the current environment, it will be automatically installed and imported. Importantly, any newly installed packages are automatically isolated in a virtual environment. This prevents Chatify or its dependencies from interfering with other packages that might be installed on your system.\n\nThe `smuggle` statement in the second cell is what actually installs, configures, and imports Chatify, and the `%load_ext` line loads and enables the Chatify extension (accessed by adding the `%%explain` magic command to the top of any code cell in the notebook).\n\nIf you don't care about protecting your runtime environment from potential side effects of installing Chatify (note: this is **not recommended** and may **break other aspects of your setup**!), you can replace those two cells above with the following:\n\n```python\n!pip install -qqq chatify\nimport chatify\n%load_ext chatify\n```\n\nNote: the quiet (`-qqq`) flags are optional, but including them will avoid cluttering up your notebook with installation-related messages. It's probably fine to use this \"direct/unsafe install\" method if you're running Chatify in a Colab notebook, inside of a container, or in a dedicated virtual environment, but you shouldn't install the unsafe version of Chatify locally. GPU-friendly libraries are notoriously finicky, and since Chatify will mess with some of those libraries it's reasonably likely that your other GPU libraries will stop working correctly if you don't isolate Chatify's effects on your system.\n\n### I like to live on the wild side-- give me the bleeding edge version! \n\nPsst...if you really want to see our lack of quality control on full display, we can tell you the secret password \ud83e\udd2b. Step this way...that's right. Don't mind those animals, pay no attention...\ud83d\udc2f\ud83e\udd81\ud83e\udd8e...\ud83e\udd8c\ud83d\udc18\ud83d\udc2c\ud83e\udd95...to install Chatify directly from GitHub (**even though this is not recommended!!**), with no safety checks or guarantees whatsoever, you can add and run this cell to the top of your notebook:\n\n```python\n!pip install -qqq chatify git+https://github.com/ContextLab/chatify.git\nimport chatify\n%load_ext chatify\n```\n\nYou should really only do this in a fully protected (containerized, virtual)\nenvironment or on Colab, since it could break other stuff on your system. Don't\nsay we didn't warn you!\n\n## Customizing Chatify\n\nChatify is designed to work by default in the free tiers of [Colaboratory](https://colab.research.google.com/) and [Kaggle](https://www.kaggle.com/code) notebooks, and to operate without requiring any additional costs or setup beyond installing and enabling Chatify itself. There's some server magic that happens behind the scenes to make that happen. In addition to Colaboratory and Kaggle notebooks, Chatify also supports a variety of other systems and setups, including running locally or on other cloud-based systems (e.g., if you don't want our servers to see what you're doing \ud83d\udd75\ufe0f). For setups with additional resources, it is possible to switch to better-performing or lower-cost models. Chatify works in CPU-only environments, but it is GPU-friendly (for both CUDA-enabled and Metal-enabled systems). We support any text-generation model on [Hugging Face](https://huggingface.co/models?pipeline_tag=text-generation&sort=trending), Meta's [Llama 2](https://ai.meta.com/resources/models-and-libraries/llama-downloads/) models, and OpenAI's [ChatGPT](https://chat.openai.com/) models (e.g., ChatGPT-3.5 and ChatGPT-4). Models that run on Hugging Face or OpenAI's servers require either a [Hugging Face API key](https://huggingface.co/docs/api-inference/quicktour#get-your-api-token) or an [OpenAI API key](https://platform.openai.com/signup), respectively.\n\nOnce you have your API key(s), if needed, create a `config.yaml` file in the directory where you launch your notebook. For the OpenAI configuration, replace `<OPANAI API KEY>` with your actual OpenAI API key (with no quotes) and then create a `config.yaml` file with the following contents:\n\n### OpenAI configuration\n\nIf you have an OpenAI API key, adding this config.yaml file to your local directory (after adding your API key) will substantially improve your experience by generating higher quality responses:\n\n```yaml\ncache_config:\n cache: False\n caching_strategy: exact # alternative: similarity\n cache_db_version: 0.1\n url: <URL> # ignore this\n\nfeedback: False\n\nmodel_config:\n open_ai_key: <OPENAI API KEY>\n model: open_ai_model\n model_name: gpt-4\n max_tokens: 2500\n\nchain_config:\n chain_type: default\n\nprompts_config:\n prompts_to_use: [tutor, tester, inventer, experimenter]\n```\n\n### Llama 2 configuration\n\nIf you're running your notebook on a well-resourced machine, you can use this config file to get good performance for free, and without using our servers! The 7B and 13B variants of llama 2 both run on the free tier of Google Colaboratory and Kaggle, but the 13B is substantially slower (therefore we recommend the 7B variant if you're using Colaboratory or Kaggle notebooks). Note that using this configuration requires installing the \"HuggingFace\" dependencies (`pip install chatify[hf]`).\n\n```yaml\ncache_config:\n cache: False\n caching_strategy: exact # alternative: similarity\n cache_db_version: 0.1\n url: <URL> # ignore this\n\nfeedback: False\n\nmodel_config:\n model: llama_model\n model_name: TheBloke/Llama-2-70B-Chat-GGML # can also replace \"70B\" with either \"7B\" or \"13B\" on this line and the next\n weights_fname: llama-2-70b-chat.ggmlv3.q5_1.bin\n max_tokens: 2500\n n_gpu_layers: 40\n n_batch: 512\n\nchain_config:\n chain_type: default\n\nprompts_config:\n prompts_to_use: [tutor, tester, inventer, experimenter]\n```\n\n### Hugging Face configuration (local)\n\nIf you're running your notebook on a well-resourced machine, you can use this config file to get good performance for free, and without using our servers! For most models this will require lots of RAM. It's a nice way to explore a wide variety of models. Note that using this configuration requires installing the \"HuggingFace\" dependencies (`pip install chatify[hf]`).\n\n```yaml\ncache_config:\n cache: False\n caching_strategy: exact # alternative: similarity\n cache_db_version: 0.1\n url: <URL> # ignore this\n\nfeedback: False\n\nmodel_config:\n model: huggingface_model\n model_name: TheBloke/Llama-2-70B-Chat-GGML # replace with any text-generation model on Hugging Face!\n max_tokens: 2500\n n_gpu_layers: 40\n n_batch: 512\n\nchain_config:\n chain_type: default\n\nprompts_config:\n prompts_to_use: [tutor, tester, inventer, experimenter]\n```\n\nAfter saving your `config.yaml` file, follow the \"[**Installing and enabling Chatify**](README.md#installing-and-enabling-chatify)\" instructions.\n\n\n# What do I do if I have questions or problems?\n\nWe'd love to hear from you \ud83e\udd29! If you're using Chatify as part of one of the NMA courses, please consider filling out our [feedback survey](https://forms.gle/V9ZGssyukjmFR9bk7) to help us improve and/or better understand the experience. For more general problems, please submit an [issue](https://github.com/ContextLab/chatify/issues). And for other questions, comments, concerns, etc., just send us an [email](contextualdynamics@gmail.com).\n\n\n# I want to help!\n\nYay-- welcome \ud83c\udf89! This is a *very* new project (in the \"alpha\" phase) and we're looking for all the help we can get! If you're new around here and want to explore/contribute, here's how:\n\n1. [Fork](https://github.com/ContextLab/chatify/fork) this repository so that you can work with your own \"copy\" of the code base\n2. Take a look at our [Project Board](https://github.com/orgs/ContextLab/projects/3) and/or the list of open [issues](https://github.com/ContextLab/chatify/issues) to get a sense of the current project status, todo list, etc.\n3. Feel free to add your own issues/tasks, comment on existing issues, etc.\n\n## Current priorities and suggested tasks to start with\n\nIn general, we've broken down tasks into [\"coding\" tasks](https://github.com/ContextLab/chatify/labels/coding%20required) (which require some amount of coding, likely in Python) and [\"non-coding\" tasks](https://github.com/ContextLab/chatify/labels/non-coding) (which do *not* require coding).\n\nIf you have questions, ideas, etc., also please check out the [discussion board](https://github.com/ContextLab/chatify/discussions)!\n\n\n=======\nHistory\n=======\n\n0.2.1 (August, 2023)\n------------------\n\n* Preparing for a release on pip\n\n0.2.0 (July, 2023)\n------------------\n\n* Lots of GUI improvements\n* Default model is now run on a proxy server (still does not require and setup or API key)\n\n0.1.1 (July, 2023)\n------------------\n\n* More models are now supported!\n* Everything now runs locally (no need for an OpenAI API key)\n\n0.1.0 (July, 2023)\n------------------\n\n* Initial package version.\n",
"bugtrack_url": null,
"license": "MIT license",
"summary": "A python package that adds a magic command to Jupyter notebooks to enable LLM interactions with code cells.",
"version": "0.2.1",
"project_urls": {
"Homepage": "https://github.com/ContextLab/chatify"
},
"split_keywords": [
"chatify"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "1e63681ba3c606c5750ea800f4a8e8a5daadb64354fb0831b938e61a284cb62d",
"md5": "8262022bb61c06e76a3dfe1ca6b8fd28",
"sha256": "3148aae5da95033b27b7d0deae7e8de87530a9cfea24c0693cf557905e0c427b"
},
"downloads": -1,
"filename": "chatify-0.2.1.tar.gz",
"has_sig": false,
"md5_digest": "8262022bb61c06e76a3dfe1ca6b8fd28",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.6",
"size": 6942958,
"upload_time": "2023-08-22T16:20:00",
"upload_time_iso_8601": "2023-08-22T16:20:00.050173Z",
"url": "https://files.pythonhosted.org/packages/1e/63/681ba3c606c5750ea800f4a8e8a5daadb64354fb0831b938e61a284cb62d/chatify-0.2.1.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-08-22 16:20:00",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "ContextLab",
"github_project": "chatify",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"tox": true,
"lcname": "chatify"
}
JSON
