Name | text2video JSON |
Version |
0.0.4
JSON |
| download |
home_page | None |
Summary | Utils for text2video generation models |
upload_time | 2024-10-16 06:16:21 |
maintainer | None |
docs_url | None |
author | None |
requires_python | >=3.4 |
license | None |
keywords |
text
video
generation
|
VCS |
 |
bugtrack_url |
|
requirements |
No requirements were recorded.
|
Travis-CI |
No Travis.
|
coveralls test coverage |
No coveralls.
|
# Official text2video package
This is the official github repo of pypi package text2video (https://pypi.org/project/text2video/). This repo is intended to provide common interface
to help develop text2video related Vision-Language Models and related deployed APIs. There are also many brilliant AI apps released such as Runway AI, Pika AI, Kling AI, etc.
Right now it has just started from scratch and you are very welcome to contact us if you would like to commit to this repo and facilitate the community.
## Install
```
pip install text2video
```
An example of Calling arxiv.org to Fetch Latest "Text To Video" Related Papers
## Usage
```
import text2video as t2v
input_dict = {"text": "Text to Video"}
res = t2v.api(input_dict, model=None, api_name="ArxivPaperAPI", start=0, max_results = 3)
paper_list = json.loads(res["text"])
print ("###### Text to Image Recent Paper List:")
for (i, paper_json) in enumerate(paper_list):
print ("### PAPER %d" % (i+1))
print (paper_json)
```
### Common Interface of Text to Video Application
```
class YourText2VideoAPI(BaseAPI):
"""docstring for ClassName"""
def __init__(self, configs):
super(YourText2VideoAPI, self).__init__(configs)
self.name = "xxxxx"
def api(self, input_dict, model, kwargs):
"""
Args:
input_dict: dict, multi-modal input text, image, audio and video
model: huggingface model of tf or pytoch
kwargs: key-value args
Return:
res_dict: dict, multi-modal text text, image, audio and video
"""
res_dict={}
try:
input_text = input_dict["text"] # str
input_image = input_dict["image"] # image path
input_audio = input_dict["audio"] # audio path
input_video = input_dict["video"] # video path
res_dict["text"] = None
res_dict["image"] = None
res_dict["audio"] = None
res_dict["video"] = None
except Exception as e:
print (e)
return res_dict
```
### Awesome Text to Video Papers and Projects
#### 2024 Text to Video Paper
| PAPER | URL |
| ---- | ---- |
| HARIVO: Harnessing Text-to-Image Models for Video Generation | https://arxiv.org/pdf/2410.07763 |
| MMHead: Towards Fine-grained Multi-modal 3D Facial Animation | https://arxiv.org/abs/2410.07757 |
| T2V-Turbo-v2: Enhancing Video Generation Model Post-Training through Data, Reward, and Conditional Guidance Design | https://arxiv.org/abs/2410.05677 |
| MotionAura: Generating High-Quality and Motion Consistent Videos using Discrete Diffusion | https://arxiv.org/abs/2410.07659 |
### AI Services Reviews and Ratings <br>
##### Chatbot
[OpenAI o1 Reviews](http://www.deepnlp.org/store/pub/pub-openai-o1) <br>
[ChatGPT User Reviews](http://www.deepnlp.org/store/pub/pub-chatgpt-openai) <br>
[Gemini User Reviews](http://www.deepnlp.org/store/pub/pub-gemini-google) <br>
[Perplexity User Reviews](http://www.deepnlp.org/store/pub/pub-perplexity) <br>
[Claude User Reviews](http://www.deepnlp.org/store/pub/pub-claude-anthropic) <br>
[Qwen AI Reviews](http://www.deepnlp.org/store/pub/pub-qwen-alibaba) <br>
[Doubao Reviews](http://www.deepnlp.org/store/pub/pub-doubao-douyin) <br>
[ChatGPT Strawberry](http://www.deepnlp.org/store/pub/pub-chatgpt-strawberry) <br>
[Zhipu AI Reviews](http://www.deepnlp.org/store/pub/pub-zhipu-ai) <br>
##### AI Image Generation
[Midjourney User Reviews](http://www.deepnlp.org/store/pub/pub-midjourney) <br>
[Stable Diffusion User Reviews](http://www.deepnlp.org/store/pub/pub-stable-diffusion) <br>
[Runway User Reviews](http://www.deepnlp.org/store/pub/pub-runway) <br>
[GPT-5 Forecast](http://www.deepnlp.org/store/pub/pub-gpt-5) <br>
[Flux AI Reviews](http://www.deepnlp.org/store/pub/pub-flux-1-black-forest-lab) <br>
[Canva User Reviews](http://www.deepnlp.org/store/pub/pub-canva) <br>
##### AI Video Generation
[Luma AI](http://www.deepnlp.org/store/pub/pub-luma-ai) <br>
[Pika AI Reviews](http://www.deepnlp.org/store/pub/pub-pika) <br>
[Runway AI Reviews](http://www.deepnlp.org/store/pub/pub-runway) <br>
[Kling AI Reviews](http://www.deepnlp.org/store/pub/pub-kling-kwai) <br>
[Dreamina AI Reviews](http://www.deepnlp.org/store/pub/pub-dreamina-douyin) <br>
##### AI Education
[Coursera Reviews](http://www.deepnlp.org/store/pub/pub-coursera) <br>
[Udacity Reviews](http://www.deepnlp.org/store/pub/pub-udacity) <br>
[Grammarly Reviews](http://www.deepnlp.org/store/pub/pub-grammarly) <br>
##### Robotics
[Tesla Cybercab Robotaxi](http://www.deepnlp.org/store/pub/pub-tesla-cybercab) <br>
[Tesla Optimus](http://www.deepnlp.org/store/pub/pub-tesla-optimus) <br>
[Figure AI](http://www.deepnlp.org/store/pub/pub-figure-ai) <br>
[Unitree Robotics Reviews](http://www.deepnlp.org/store/pub/pub-unitree-robotics) <br>
[Waymo User Reviews](http://www.deepnlp.org/store/pub/pub-waymo-google) <br>
[ANYbotics Reviews](http://www.deepnlp.org/store/pub/pub-anybotics) <br>
[Boston Dynamics](http://www.deepnlp.org/store/pub/pub-boston-dynamic) <br>
##### AI Tools
[DeepNLP AI Tools](http://www.deepnlp.org/store/pub/pub-deepnlp-ai) <br>
##### AI Widgets
[Apple Glasses](http://www.deepnlp.org/store/pub/pub-apple-glasses) <br>
[Meta Glasses](http://www.deepnlp.org/store/pub/pub-meta-glasses) <br>
[Apple AR VR Headset](http://www.deepnlp.org/store/pub/pub-apple-ar-vr-headset) <br>
[Google Glass](http://www.deepnlp.org/store/pub/pub-google-glass) <br>
[Meta VR Headset](http://www.deepnlp.org/store/pub/pub-meta-vr-headset) <br>
[Google AR VR Headsets](http://www.deepnlp.org/store/pub/pub-google-ar-vr-headset) <br>
##### Social
[Character AI](http://www.deepnlp.org/store/pub/pub-character-ai) <br>
##### Self-Driving
[BYD Seal](http://www.deepnlp.org/store/pub/pub-byd-seal) <br>
[Tesla Model 3](http://www.deepnlp.org/store/pub/pub-tesla-model-3) <br>
[BMW i4](http://www.deepnlp.org/store/pub/pub-bmw-i4) <br>
[Baidu Apollo Reviews](http://www.deepnlp.org/store/pub/pub-baidu-apollo) <br>
[Hyundai IONIQ 6](http://www.deepnlp.org/store/pub/pub-hyundai-ioniq-6) <br>
### Related Blogs <br>
1. [Introduction to multimodal generative models](http://www.deepnlp.org/blog/introduction-to-multimodal-generative-models) <br>
2. [Generative AI Search Engine Optimization](http://www.deepnlp.org/blog/generative-ai-search-engine-optimization-how-to-improve-your-content) <br>
3. [AI Image Generator User Reviews](http://www.deepnlp.org/store/image-generator) <br>
4. [AI Video Generator User Reviews](http://www.deepnlp.org/store/video-generator) <br>
5. [AI Chatbot & Assistant Reviews](http://www.deepnlp.org/store/chatbot-assistant) <br>
6. [Best AI Tools User Reviews](http://www.deepnlp.org/store/pub/) <br>
Raw data
{
"_id": null,
"home_page": null,
"name": "text2video",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.4",
"maintainer_email": null,
"keywords": "text, video, generation",
"author": null,
"author_email": "dingo0927@126.com",
"download_url": null,
"platform": null,
"description": "# Official text2video package\n\nThis is the official github repo of pypi package text2video (https://pypi.org/project/text2video/). This repo is intended to provide common interface\nto help develop text2video related Vision-Language Models and related deployed APIs. There are also many brilliant AI apps released such as Runway AI, Pika AI, Kling AI, etc.\nRight now it has just started from scratch and you are very welcome to contact us if you would like to commit to this repo and facilitate the community. \n\n\n\n## Install\n```\npip install text2video\n```\n\n\nAn example of Calling arxiv.org to Fetch Latest \"Text To Video\" Related Papers\n\n## Usage\n```\nimport text2video as t2v\n\ninput_dict = {\"text\": \"Text to Video\"}\n\nres = t2v.api(input_dict, model=None, api_name=\"ArxivPaperAPI\", start=0, max_results = 3)\npaper_list = json.loads(res[\"text\"])\nprint (\"###### Text to Image Recent Paper List:\")\nfor (i, paper_json) in enumerate(paper_list):\n print (\"### PAPER %d\" % (i+1))\n print (paper_json)\n\n```\n\n\n### Common Interface of Text to Video Application\n\n```\n\nclass YourText2VideoAPI(BaseAPI):\n \"\"\"docstring for ClassName\"\"\"\n def __init__(self, configs):\n super(YourText2VideoAPI, self).__init__(configs)\n self.name = \"xxxxx\"\n\n def api(self, input_dict, model, kwargs):\n \"\"\"\n Args:\n input_dict: dict, multi-modal input text, image, audio and video\n model: huggingface model of tf or pytoch\n kwargs: key-value args\n Return:\n res_dict: dict, multi-modal text text, image, audio and video\n \"\"\"\n res_dict={}\n try:\n input_text = input_dict[\"text\"] # str\n input_image = input_dict[\"image\"] # image path\n input_audio = input_dict[\"audio\"] # audio path\n input_video = input_dict[\"video\"] # video path\n\n res_dict[\"text\"] = None\n res_dict[\"image\"] = None\n res_dict[\"audio\"] = None\n res_dict[\"video\"] = None\n except Exception as e:\n print (e)\n return res_dict\n\n\n```\n\n\n\n### Awesome Text to Video Papers and Projects\n\n#### 2024 Text to Video Paper\n\n| PAPER | URL |\n| ---- | ---- |\n| HARIVO: Harnessing Text-to-Image Models for Video Generation | https://arxiv.org/pdf/2410.07763 |\n| MMHead: Towards Fine-grained Multi-modal 3D Facial Animation | https://arxiv.org/abs/2410.07757 |\n| T2V-Turbo-v2: Enhancing Video Generation Model Post-Training through Data, Reward, and Conditional Guidance Design | https://arxiv.org/abs/2410.05677 |\n| MotionAura: Generating High-Quality and Motion Consistent Videos using Discrete Diffusion | https://arxiv.org/abs/2410.07659 |\n\n\n\n### AI Services Reviews and Ratings <br>\n##### Chatbot\n[OpenAI o1 Reviews](http://www.deepnlp.org/store/pub/pub-openai-o1) <br>\n[ChatGPT User Reviews](http://www.deepnlp.org/store/pub/pub-chatgpt-openai) <br>\n[Gemini User Reviews](http://www.deepnlp.org/store/pub/pub-gemini-google) <br>\n[Perplexity User Reviews](http://www.deepnlp.org/store/pub/pub-perplexity) <br>\n[Claude User Reviews](http://www.deepnlp.org/store/pub/pub-claude-anthropic) <br>\n[Qwen AI Reviews](http://www.deepnlp.org/store/pub/pub-qwen-alibaba) <br>\n[Doubao Reviews](http://www.deepnlp.org/store/pub/pub-doubao-douyin) <br>\n[ChatGPT Strawberry](http://www.deepnlp.org/store/pub/pub-chatgpt-strawberry) <br>\n[Zhipu AI Reviews](http://www.deepnlp.org/store/pub/pub-zhipu-ai) <br>\n##### AI Image Generation\n[Midjourney User Reviews](http://www.deepnlp.org/store/pub/pub-midjourney) <br>\n[Stable Diffusion User Reviews](http://www.deepnlp.org/store/pub/pub-stable-diffusion) <br>\n[Runway User Reviews](http://www.deepnlp.org/store/pub/pub-runway) <br>\n[GPT-5 Forecast](http://www.deepnlp.org/store/pub/pub-gpt-5) <br>\n[Flux AI Reviews](http://www.deepnlp.org/store/pub/pub-flux-1-black-forest-lab) <br>\n[Canva User Reviews](http://www.deepnlp.org/store/pub/pub-canva) <br>\n##### AI Video Generation\n[Luma AI](http://www.deepnlp.org/store/pub/pub-luma-ai) <br>\n[Pika AI Reviews](http://www.deepnlp.org/store/pub/pub-pika) <br>\n[Runway AI Reviews](http://www.deepnlp.org/store/pub/pub-runway) <br>\n[Kling AI Reviews](http://www.deepnlp.org/store/pub/pub-kling-kwai) <br>\n[Dreamina AI Reviews](http://www.deepnlp.org/store/pub/pub-dreamina-douyin) <br>\n##### AI Education\n[Coursera Reviews](http://www.deepnlp.org/store/pub/pub-coursera) <br>\n[Udacity Reviews](http://www.deepnlp.org/store/pub/pub-udacity) <br>\n[Grammarly Reviews](http://www.deepnlp.org/store/pub/pub-grammarly) <br>\n##### Robotics\n[Tesla Cybercab Robotaxi](http://www.deepnlp.org/store/pub/pub-tesla-cybercab) <br>\n[Tesla Optimus](http://www.deepnlp.org/store/pub/pub-tesla-optimus) <br>\n[Figure AI](http://www.deepnlp.org/store/pub/pub-figure-ai) <br>\n[Unitree Robotics Reviews](http://www.deepnlp.org/store/pub/pub-unitree-robotics) <br>\n[Waymo User Reviews](http://www.deepnlp.org/store/pub/pub-waymo-google) <br>\n[ANYbotics Reviews](http://www.deepnlp.org/store/pub/pub-anybotics) <br>\n[Boston Dynamics](http://www.deepnlp.org/store/pub/pub-boston-dynamic) <br>\n##### AI Tools\n[DeepNLP AI Tools](http://www.deepnlp.org/store/pub/pub-deepnlp-ai) <br>\n##### AI Widgets\n[Apple Glasses](http://www.deepnlp.org/store/pub/pub-apple-glasses) <br>\n[Meta Glasses](http://www.deepnlp.org/store/pub/pub-meta-glasses) <br>\n[Apple AR VR Headset](http://www.deepnlp.org/store/pub/pub-apple-ar-vr-headset) <br>\n[Google Glass](http://www.deepnlp.org/store/pub/pub-google-glass) <br>\n[Meta VR Headset](http://www.deepnlp.org/store/pub/pub-meta-vr-headset) <br>\n[Google AR VR Headsets](http://www.deepnlp.org/store/pub/pub-google-ar-vr-headset) <br>\n##### Social\n[Character AI](http://www.deepnlp.org/store/pub/pub-character-ai) <br>\n##### Self-Driving\n[BYD Seal](http://www.deepnlp.org/store/pub/pub-byd-seal) <br>\n[Tesla Model 3](http://www.deepnlp.org/store/pub/pub-tesla-model-3) <br>\n[BMW i4](http://www.deepnlp.org/store/pub/pub-bmw-i4) <br>\n[Baidu Apollo Reviews](http://www.deepnlp.org/store/pub/pub-baidu-apollo) <br>\n[Hyundai IONIQ 6](http://www.deepnlp.org/store/pub/pub-hyundai-ioniq-6) <br>\n\n\n### Related Blogs <br>\n1. [Introduction to multimodal generative models](http://www.deepnlp.org/blog/introduction-to-multimodal-generative-models) <br>\n2. [Generative AI Search Engine Optimization](http://www.deepnlp.org/blog/generative-ai-search-engine-optimization-how-to-improve-your-content) <br>\n3. [AI Image Generator User Reviews](http://www.deepnlp.org/store/image-generator) <br>\n4. [AI Video Generator User Reviews](http://www.deepnlp.org/store/video-generator) <br>\n5. [AI Chatbot & Assistant Reviews](http://www.deepnlp.org/store/chatbot-assistant) <br>\n6. [Best AI Tools User Reviews](http://www.deepnlp.org/store/pub/) <br>\n\n",
"bugtrack_url": null,
"license": null,
"summary": "Utils for text2video generation models",
"version": "0.0.4",
"project_urls": {
"homepage": "http://www.deepnlp.org",
"repository": "https://github.com/rockingdingo/text2video"
},
"split_keywords": [
"text",
" video",
" generation"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "fcd42b5c8b2656f61c920b107bf558723aeb54135bc647e70ffe65039182834b",
"md5": "de4bd40709aab8a71d6754b8f4cff57f",
"sha256": "f95b955e73a559bdffe8544b55bb6d70cd2880ecfd1267aa7ec07bc08340e26c"
},
"downloads": -1,
"filename": "text2video-0.0.4-py3-none-any.whl",
"has_sig": false,
"md5_digest": "de4bd40709aab8a71d6754b8f4cff57f",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.4",
"size": 5489,
"upload_time": "2024-10-16T06:16:21",
"upload_time_iso_8601": "2024-10-16T06:16:21.222782Z",
"url": "https://files.pythonhosted.org/packages/fc/d4/2b5c8b2656f61c920b107bf558723aeb54135bc647e70ffe65039182834b/text2video-0.0.4-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-10-16 06:16:21",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "rockingdingo",
"github_project": "text2video",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "text2video"
}