[![Multi-Modality](agorabanner.png)](https://discord.gg/qUtxnK2NMf)
# Lumiere
Implementation of the text to video model LUMIERE from the paper: "A Space-Time Diffusion Model for Video Generation" by Google Research. I will mostly be implementing the modules from the diagram a and b in figure 4
## Install
`pip install lumiere`
## Usage
```python
import torch
from lumiere.model import AttentionBasedInflationBlock
# B, T, H, W, D
x = torch.randn(1, 4, 224, 224, 512)
# Model
model = AttentionBasedInflationBlock(dim=512, heads=4, dropout=0.1)
# Forward pass
out = model(x)
# print
print(out.shape) # Expected shape: [1, 4, 224, 224, 3]
```
# License
MIT
Raw data
{
"_id": null,
"home_page": "https://github.com/kyegomez/LUMIERE",
"name": "lumiere",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.6,<4.0",
"maintainer_email": "",
"keywords": "artificial intelligence,deep learning,optimizers,Prompt Engineering",
"author": "Kye Gomez",
"author_email": "kye@apac.ai",
"download_url": "https://files.pythonhosted.org/packages/cb/ce/5d56fea708bf4e1b42bf79613684d3db2ef53f06820d87c41828d16c1b9e/lumiere-0.0.4.tar.gz",
"platform": null,
"description": "[![Multi-Modality](agorabanner.png)](https://discord.gg/qUtxnK2NMf)\n\n# Lumiere \nImplementation of the text to video model LUMIERE from the paper: \"A Space-Time Diffusion Model for Video Generation\" by Google Research. I will mostly be implementing the modules from the diagram a and b in figure 4\n\n## Install\n`pip install lumiere`\n\n\n## Usage\n```python\nimport torch\nfrom lumiere.model import AttentionBasedInflationBlock\n\n# B, T, H, W, D\nx = torch.randn(1, 4, 224, 224, 512)\n\n# Model\nmodel = AttentionBasedInflationBlock(dim=512, heads=4, dropout=0.1)\n\n# Forward pass\nout = model(x)\n\n# print\nprint(out.shape) # Expected shape: [1, 4, 224, 224, 3]\n\n```\n\n\n# License\nMIT\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "Paper - Pytorch",
"version": "0.0.4",
"project_urls": {
"Documentation": "https://github.com/kyegomez/LUMIERE",
"Homepage": "https://github.com/kyegomez/LUMIERE",
"Repository": "https://github.com/kyegomez/LUMIERE"
},
"split_keywords": [
"artificial intelligence",
"deep learning",
"optimizers",
"prompt engineering"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "1d5bb098ba8806007b5e923a5910209bf3466da76dc5990b461bd47a67dbe0c4",
"md5": "fa83c256bd6bfca39232cf1cb400795e",
"sha256": "a59a84a9f5d0bffe8c226de5266e2ab8ee49df03fe7f46e1e405519aaf3c5403"
},
"downloads": -1,
"filename": "lumiere-0.0.4-py3-none-any.whl",
"has_sig": false,
"md5_digest": "fa83c256bd6bfca39232cf1cb400795e",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.6,<4.0",
"size": 4488,
"upload_time": "2024-02-06T03:23:18",
"upload_time_iso_8601": "2024-02-06T03:23:18.868505Z",
"url": "https://files.pythonhosted.org/packages/1d/5b/b098ba8806007b5e923a5910209bf3466da76dc5990b461bd47a67dbe0c4/lumiere-0.0.4-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "cbce5d56fea708bf4e1b42bf79613684d3db2ef53f06820d87c41828d16c1b9e",
"md5": "b6571f0ce570912cf2cfa904e661eced",
"sha256": "06ab58c915a2ebe3326f83d88ad4abf09be0580f884d0766ca6596ca508ccd77"
},
"downloads": -1,
"filename": "lumiere-0.0.4.tar.gz",
"has_sig": false,
"md5_digest": "b6571f0ce570912cf2cfa904e661eced",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.6,<4.0",
"size": 4520,
"upload_time": "2024-02-06T03:23:20",
"upload_time_iso_8601": "2024-02-06T03:23:20.458619Z",
"url": "https://files.pythonhosted.org/packages/cb/ce/5d56fea708bf4e1b42bf79613684d3db2ef53f06820d87c41828d16c1b9e/lumiere-0.0.4.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-02-06 03:23:20",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "kyegomez",
"github_project": "LUMIERE",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"requirements": [
{
"name": "torch",
"specs": []
},
{
"name": "zetascale",
"specs": []
},
{
"name": "swarms",
"specs": []
}
],
"lcname": "lumiere"
}