# DiffLLM
Extending the next token prediction setting into "diff prediction".
## Setup
Create virtual environment:
```
conda create -n diff-llm python=3.9
conda activate diff-llm
pip install -r requirements.txt
```
Export secrets:
```
export $(grep -v '^#' secrets.txt | xargs)
```
Export env vars:
```
export PYTHONPATH=.
```
## Usage
### Create dataset
```
python src/create_dataset.py \
--output-dir ./dataset \
--page-names '["Deep learning", "Ancient Greece", "Ted Chiang"]' \
--n-revisions 10
```
Raw data
{
"_id": null,
"home_page": "https://github.com/hai-labs/diff-llm",
"name": "diff-llm",
"maintainer": "",
"docs_url": null,
"requires_python": ">3.7",
"maintainer_email": "",
"keywords": "machine-learning,artificial-intelligence",
"author": "Niels Bantilan",
"author_email": "niels.bantilan@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/bb/85/04dcd9a8525790886c335a2252c848220be291673c0cbf64359d7b9f1e55/diff-llm-0.0.0a0.tar.gz",
"platform": "any",
"description": "# DiffLLM\n\nExtending the next token prediction setting into \"diff prediction\".\n\n## Setup\n\nCreate virtual environment:\n\n```\nconda create -n diff-llm python=3.9\nconda activate diff-llm\npip install -r requirements.txt\n```\n\nExport secrets:\n\n```\nexport $(grep -v '^#' secrets.txt | xargs)\n```\n\nExport env vars:\n\n```\nexport PYTHONPATH=.\n```\n\n## Usage\n\n### Create dataset\n\n```\npython src/create_dataset.py \\\n --output-dir ./dataset \\\n --page-names '[\"Deep learning\", \"Ancient Greece\", \"Ted Chiang\"]' \\\n --n-revisions 10\n```\n",
"bugtrack_url": null,
"license": "Apache",
"summary": "LLM that predicts text diffs.",
"version": "0.0.0a0",
"project_urls": {
"Homepage": "https://github.com/hai-labs/diff-llm",
"Issue Tracker": "https://github.com/hai-labs/diff-llm/issues",
"Source Code": "https://github.com/hai-labs/diff-llm"
},
"split_keywords": [
"machine-learning",
"artificial-intelligence"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "683d3249a4b82dac47cf314164643361d9dcf9188bebfbb81452904db55773e0",
"md5": "a0d67b5466384bce384ce39bb44e5733",
"sha256": "fbe8a8d60173b2a7bf53973c2d9d82c54dda5a91a41ff39b62a9233da719ac20"
},
"downloads": -1,
"filename": "diff_llm-0.0.0a0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "a0d67b5466384bce384ce39bb44e5733",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">3.7",
"size": 7623,
"upload_time": "2023-08-03T03:35:06",
"upload_time_iso_8601": "2023-08-03T03:35:06.877868Z",
"url": "https://files.pythonhosted.org/packages/68/3d/3249a4b82dac47cf314164643361d9dcf9188bebfbb81452904db55773e0/diff_llm-0.0.0a0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "bb8504dcd9a8525790886c335a2252c848220be291673c0cbf64359d7b9f1e55",
"md5": "ac652627646afaa0cb0cce8bfb5d4947",
"sha256": "21891dc39bc0d390ecc9aa2c50d4d4fc9b32320f5e22ece35d8c5d1400578089"
},
"downloads": -1,
"filename": "diff-llm-0.0.0a0.tar.gz",
"has_sig": false,
"md5_digest": "ac652627646afaa0cb0cce8bfb5d4947",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">3.7",
"size": 6283,
"upload_time": "2023-08-03T03:35:07",
"upload_time_iso_8601": "2023-08-03T03:35:07.972605Z",
"url": "https://files.pythonhosted.org/packages/bb/85/04dcd9a8525790886c335a2252c848220be291673c0cbf64359d7b9f1e55/diff-llm-0.0.0a0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-08-03 03:35:07",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "hai-labs",
"github_project": "diff-llm",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"requirements": [],
"lcname": "diff-llm"
}