# Megaladon
Sail the Seas of Data and Dive into the Depths of Computation!
## _Megaladon: The Orca is no match._
Welcome aboard, shipmates! Let Megaladon be your steadfast vessel on the uncharted ocean of Big Data and Machine Learning. With our rich datasets and detailed mathematical models, there's no computational storm we can't weather together!
> "We didn't name it 'Megaladon' for nothing. It's big, it's powerful, and it's got a heck of a bite when it comes to data crunching!" - Captain Codebeard
## Navigation Chart
```python
Dataset Sample (Row by Row) [Input] --(Feeds into)--> [Model] --(Outputs)--> Dataset Sample (Row by Row)
```
# Deck Logs (Changelog)
- **v2.0.0 - The Leviathan Update** - We've surfaced some serious computational power in this one! Modular integration of HuggingFace and OpenAI models.
- **v1.5.0 - The Kraken Patch** - Tightened up the tentacles of the code. Fewer bugs will be slipping through!
- **v1.0.0 - Maiden Voyage** - Initial launch! The Megaladon sets sail!
# Shipwright's Guide (Installation)
Batten down the hatches and ready your terminal, it's time to summon the Megaladon:
```bash
git clone https://github.com/Megaladon-ds/Megaladon.git
cd Megaladon
pip install -r requirements.txt
```
# Navigational Tools (Usage)
1. **Start your voyage with a good map.** (Load your dataset)
```python
from Megaladon import Megaladon
# Using OpenAI model
Megaladon = Megaladon(model_id="gpt-3", api_key="your-api-key", dataset="flax-sentence-embeddings/stackexchange_math_jsonl")
# Using Hugging Face model
Megaladon = Megaladon(model_id="gpt2", dataset="flax-sentence-embeddings/stackexchange_math_jsonl")
```
2. **Set sail!** (Generate explanations)
```python
explanations = Megaladon.run()
```
3. **Return to port.** (Save your results)
```python
Megaladon.save_to_huggingface(explanations, 'hf_output_dir')
```
Please replace `"your-api-key"` with your actual OpenAI API key, and `'hf_output_dir'` with your desired output directory for the Hugging Face datasets.
# Lifeboats (Support)
If you find yourself overboard in a sea of confusion, don't panic! Shoot a flare to our issue tracker on Github, and our dedicated crew will row to your rescue.
[Create New Issue](https://github.com/Megaladon-ds/Megaladon/issues/new)
# Crow's Nest (Future Plans)
1. **New Species Detection** - We're constantly exploring unknown waters to find and integrate new algorithms and data models into Megaladon.
2. **Crew Training** - Comprehensive documentation and examples are on the horizon to help you get the most out of your voyage with Megaladon.
Thank you for choosing to sail with Megaladon. May fair winds and calm seas guide your data journey!
Happy Sailing!
The Megaladon Team
# Todo:
* Better prompt
* More seamless model handling, plug and play with any model from OpenAI or HuggingFace.
* Save to HuggingFace after each iteration is labeled
* Potentially use Parquet for optimized storage
* Add in polymorphic or shape shifting preprocessing logic
Raw data
{
"_id": null,
"home_page": "https://github.com/Agora-X/Megaladon",
"name": "megaladon",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.6,<4.0",
"maintainer_email": "",
"keywords": "artificial intelligence,attention mechanism,transformers",
"author": "Kye Gomez",
"author_email": "kye@apac.ai",
"download_url": "https://files.pythonhosted.org/packages/64/4e/07bccc4109b667a70d5780f6d0e521855c48ce0e486cc18034b0e4681ad6/megaladon-0.0.2.tar.gz",
"platform": null,
"description": "# Megaladon\nSail the Seas of Data and Dive into the Depths of Computation! \n\n\n## _Megaladon: The Orca is no match._\n\nWelcome aboard, shipmates! Let Megaladon be your steadfast vessel on the uncharted ocean of Big Data and Machine Learning. With our rich datasets and detailed mathematical models, there's no computational storm we can't weather together! \n\n> \"We didn't name it 'Megaladon' for nothing. It's big, it's powerful, and it's got a heck of a bite when it comes to data crunching!\" - Captain Codebeard\n\n## Navigation Chart\n\n```python\nDataset Sample (Row by Row) [Input] --(Feeds into)--> [Model] --(Outputs)--> Dataset Sample (Row by Row)\n```\n\n# Deck Logs (Changelog)\n\n- **v2.0.0 - The Leviathan Update** - We've surfaced some serious computational power in this one! Modular integration of HuggingFace and OpenAI models.\n- **v1.5.0 - The Kraken Patch** - Tightened up the tentacles of the code. Fewer bugs will be slipping through!\n- **v1.0.0 - Maiden Voyage** - Initial launch! The Megaladon sets sail!\n\n# Shipwright's Guide (Installation)\n\nBatten down the hatches and ready your terminal, it's time to summon the Megaladon:\n\n```bash\ngit clone https://github.com/Megaladon-ds/Megaladon.git\ncd Megaladon\npip install -r requirements.txt\n```\n\n# Navigational Tools (Usage)\n\n1. **Start your voyage with a good map.** (Load your dataset)\n\n```python\nfrom Megaladon import Megaladon\n\n# Using OpenAI model\nMegaladon = Megaladon(model_id=\"gpt-3\", api_key=\"your-api-key\", dataset=\"flax-sentence-embeddings/stackexchange_math_jsonl\")\n\n# Using Hugging Face model\nMegaladon = Megaladon(model_id=\"gpt2\", dataset=\"flax-sentence-embeddings/stackexchange_math_jsonl\")\n```\n\n2. **Set sail!** (Generate explanations)\n\n```python\nexplanations = Megaladon.run()\n```\n\n3. **Return to port.** (Save your results)\n\n```python\nMegaladon.save_to_huggingface(explanations, 'hf_output_dir')\n```\n\nPlease replace `\"your-api-key\"` with your actual OpenAI API key, and `'hf_output_dir'` with your desired output directory for the Hugging Face datasets.\n\n# Lifeboats (Support)\n\nIf you find yourself overboard in a sea of confusion, don't panic! Shoot a flare to our issue tracker on Github, and our dedicated crew will row to your rescue. \n\n[Create New Issue](https://github.com/Megaladon-ds/Megaladon/issues/new)\n\n# Crow's Nest (Future Plans)\n\n1. **New Species Detection** - We're constantly exploring unknown waters to find and integrate new algorithms and data models into Megaladon. \n2. **Crew Training** - Comprehensive documentation and examples are on the horizon to help you get the most out of your voyage with Megaladon.\n\nThank you for choosing to sail with Megaladon. May fair winds and calm seas guide your data journey!\n\nHappy Sailing!\n\nThe Megaladon Team\n\n\n\n# Todo:\n\n* Better prompt\n* More seamless model handling, plug and play with any model from OpenAI or HuggingFace.\n* Save to HuggingFace after each iteration is labeled\n* Potentially use Parquet for optimized storage\n* Add in polymorphic or shape shifting preprocessing logic\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "Megaladon - Pytorch",
"version": "0.0.2",
"project_urls": {
"Homepage": "https://github.com/Agora-X/Megaladon"
},
"split_keywords": [
"artificial intelligence",
"attention mechanism",
"transformers"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "f2959fbd98a9afdae68dcabf26af6fd1a171e2bc6bfc5f10008d87406a84e12c",
"md5": "f388c439ac282fc6815f1a77745121ae",
"sha256": "91d9ee8bbc60e2859a3b35726cbd18df07fa6cad34cfc2ba1c5e0a7d1dfd6d1c"
},
"downloads": -1,
"filename": "megaladon-0.0.2-py3-none-any.whl",
"has_sig": false,
"md5_digest": "f388c439ac282fc6815f1a77745121ae",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.6,<4.0",
"size": 9728,
"upload_time": "2023-07-24T21:05:08",
"upload_time_iso_8601": "2023-07-24T21:05:08.017807Z",
"url": "https://files.pythonhosted.org/packages/f2/95/9fbd98a9afdae68dcabf26af6fd1a171e2bc6bfc5f10008d87406a84e12c/megaladon-0.0.2-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "644e07bccc4109b667a70d5780f6d0e521855c48ce0e486cc18034b0e4681ad6",
"md5": "18c7d98fa923eeb58484c2ad385e4675",
"sha256": "aa0938cf0498aa9f63cc2ab5e51ef29946a6e295ca10850428508ef55aca4999"
},
"downloads": -1,
"filename": "megaladon-0.0.2.tar.gz",
"has_sig": false,
"md5_digest": "18c7d98fa923eeb58484c2ad385e4675",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.6,<4.0",
"size": 6246,
"upload_time": "2023-07-24T21:05:09",
"upload_time_iso_8601": "2023-07-24T21:05:09.419369Z",
"url": "https://files.pythonhosted.org/packages/64/4e/07bccc4109b667a70d5780f6d0e521855c48ce0e486cc18034b0e4681ad6/megaladon-0.0.2.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-07-24 21:05:09",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "Agora-X",
"github_project": "Megaladon",
"github_not_found": true,
"lcname": "megaladon"
}
JSON
