# MyPythonDB
Python is at the heart of most data analysis but to share analysis's most users have been uploading data to SQL databases, until now.
MyPythonDB turns your python instance into an SQL database. Existing tools can query data directly at faster than database speeds.
- PythonDB provides a MySQL interface that allows every BI tool to just work.
- With DuckDB and Polars-SQL you can directly query in-memory dataframes, S3 or on-disk parquet files using SQL.
- Via the simple SQL editor web interface, you can share links to results with colleagues.
Modern tools and libraries are arriving and providing capabilities and performance only previously available accessible by paying for
huge enterprise licenses $$$. Given these changes, We believe data analysts will increasingly be performed using these tools in future.
## Uses
1. Import package to expose your python instance as a MySQL Database.
2. pythondb.exe mydb.duckdb - Load a duckdb database and make it remotely accessible.
3. pythondb --language duckdb - A new in-memory duckdb instance
4. pythondb code.py --language polars - A polars instance
### Python as MySQL
```
import mypythondb
mypythondb.start(port=3145, webport=9090, language='POLARS')
```
## Command Line Options
```
Options:
-l, --language LANG Language to interpret code as. [default: PYTHON]
-c, --command COMMAND Run COMMAND
-P, --port SQLPORT Port for MySQL compatible server to listen on
-w, --webport WEBPORT Port for webserver to listen on
-q, --quiet Quiet, don't show banner
-v, --verbose Display debugging information
--version Show the version and exit.
--help Show this message and exit.
```
# Development Info
### Facts
- **Python** is the language for data analysis.
- **Polars** / **DuckDB** provides extremely fast DataFrame operations previously only accessible at great cost.
- Many libraries and databases are converging on common data formats
- Apache **Arrow** in memory
- Apache **Parquet** on disk
# Commands
```
poetry install --sync
poetry lock
poetry run pythondb
poetry run pytest
poetry run pyinstaller --onefile launcher.py
```
## Optional TODO
- Ability to set duckdb conn to one of users choosing.
- Ability to set polars context to one of users choosing.
- QWEB
- autocomplete for duckdb / polars / python?
- Sharing link to show correct chart type fix.
- Server Tree Working
- MySQL
- Test with tableau / dbeaver / ?
- Server Tree Working
- Security - Allow setting authentication function
- Tutorials/Website
- Using QDB to enable DuckDB IPC
- Using QDB to query python direct from tableau / every popular combo......
- Using QDB to enable polars SQL IPC
- Deploy
- Provide mac built package
- Provide linux built package
- Get into linux package managers
- Get into mac package managers
- KDB
- Subscribe to streaming data
- KDB Server ability to allow users to send data in from a kdb+ process?
- Q Language?
- Misc
- K Language?
- Other languages?
Raw data
{
"_id": null,
"home_page": "https://github.com/ryanhamilton/pythondb",
"name": "mypythondb",
"maintainer": null,
"docs_url": null,
"requires_python": "<4.0,>=3.9",
"maintainer_email": null,
"keywords": "hypermodern",
"author": "Ryan Hamilton",
"author_email": null,
"download_url": "https://files.pythonhosted.org/packages/90/dc/8f506228d4c0388e9749040a70789136bb223bfffc98012d800cb29b8f5e/mypythondb-0.2.4.tar.gz",
"platform": null,
"description": "# MyPythonDB\n\nPython is at the heart of most data analysis but to share analysis's most users have been uploading data to SQL databases, until now.\nMyPythonDB turns your python instance into an SQL database. Existing tools can query data directly at faster than database speeds.\n\n- PythonDB provides a MySQL interface that allows every BI tool to just work.\n- With DuckDB and Polars-SQL you can directly query in-memory dataframes, S3 or on-disk parquet files using SQL.\n- Via the simple SQL editor web interface, you can share links to results with colleagues.\n\nModern tools and libraries are arriving and providing capabilities and performance only previously available accessible by paying for \nhuge enterprise licenses $$$. Given these changes, We believe data analysts will increasingly be performed using these tools in future.\n\n## Uses\n\n1. Import package to expose your python instance as a MySQL Database.\n2. pythondb.exe mydb.duckdb - Load a duckdb database and make it remotely accessible.\n3. pythondb --language duckdb - A new in-memory duckdb instance\n4. pythondb code.py --language polars - A polars instance\n\n### Python as MySQL\n\n```\nimport mypythondb\n\nmypythondb.start(port=3145, webport=9090, language='POLARS')\n```\n\n## Command Line Options\n\n```\nOptions:\n -l, --language LANG Language to interpret code as. [default: PYTHON]\n -c, --command COMMAND Run COMMAND\n -P, --port SQLPORT Port for MySQL compatible server to listen on\n -w, --webport WEBPORT Port for webserver to listen on\n -q, --quiet Quiet, don't show banner\n -v, --verbose Display debugging information\n --version Show the version and exit.\n --help Show this message and exit.\n```\n\n# Development Info\n\n### Facts\n\n- **Python** is the language for data analysis.\n- **Polars** / **DuckDB** provides extremely fast DataFrame operations previously only accessible at great cost.\n- Many libraries and databases are converging on common data formats\n - Apache **Arrow** in memory\n - Apache **Parquet** on disk\n\n\n# Commands\n```\npoetry install --sync\npoetry lock\npoetry run pythondb\npoetry run pytest\npoetry run pyinstaller --onefile launcher.py\n```\n## Optional TODO\n\n- Ability to set duckdb conn to one of users choosing.\n- Ability to set polars context to one of users choosing.\n\n- QWEB\n\t- autocomplete for duckdb / polars / python?\n\t- Sharing link to show correct chart type fix.\n\t- Server Tree Working\n- MySQL\n\t- Test with tableau / dbeaver / ?\n\t- Server Tree Working\n\t- Security - Allow setting authentication function\n- Tutorials/Website\n\t- Using QDB to enable DuckDB IPC\n\t- Using QDB to query python direct from tableau / every popular combo......\n\t- Using QDB to enable polars SQL IPC\n- Deploy\n\t- Provide mac built package\n\t- Provide linux built package\n\t- Get into linux package managers\n\t- Get into mac package managers \n- KDB\n\t- Subscribe to streaming data\n\t- KDB Server ability to allow users to send data in from a kdb+ process?\n\t- Q Language?\n- Misc\n - K Language?\n - Other languages?",
"bugtrack_url": null,
"license": "MIT",
"summary": "The MyPythonDB project",
"version": "0.2.4",
"project_urls": {
"Documentation": "https://github.com/ryanhamilton/pythondb",
"Homepage": "https://github.com/ryanhamilton/pythondb",
"Repository": "https://github.com/ryanhamilton/pythondb"
},
"split_keywords": [
"hypermodern"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "3910a09271065e31b95e6312785d59594f463be24bb8c71fe476127df2db0ae4",
"md5": "32aa8bca31e55cb6e7f0cab26b596377",
"sha256": "4bf583f8c7b9542d72aa8749a487e23ed9f27ccfb7ef67f41d9cd6ed95bf1d89"
},
"downloads": -1,
"filename": "mypythondb-0.2.4-py3-none-any.whl",
"has_sig": false,
"md5_digest": "32aa8bca31e55cb6e7f0cab26b596377",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": "<4.0,>=3.9",
"size": 15635,
"upload_time": "2024-07-25T12:52:53",
"upload_time_iso_8601": "2024-07-25T12:52:53.798386Z",
"url": "https://files.pythonhosted.org/packages/39/10/a09271065e31b95e6312785d59594f463be24bb8c71fe476127df2db0ae4/mypythondb-0.2.4-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "90dc8f506228d4c0388e9749040a70789136bb223bfffc98012d800cb29b8f5e",
"md5": "20bffb9f4f10b7402ca04c9c3fd13bac",
"sha256": "25a2218a3c29689ad0e3f871f862a068bfcaecd6d88eaaacdeff4e1e4309e4b7"
},
"downloads": -1,
"filename": "mypythondb-0.2.4.tar.gz",
"has_sig": false,
"md5_digest": "20bffb9f4f10b7402ca04c9c3fd13bac",
"packagetype": "sdist",
"python_version": "source",
"requires_python": "<4.0,>=3.9",
"size": 14978,
"upload_time": "2024-07-25T12:52:55",
"upload_time_iso_8601": "2024-07-25T12:52:55.129373Z",
"url": "https://files.pythonhosted.org/packages/90/dc/8f506228d4c0388e9749040a70789136bb223bfffc98012d800cb29b8f5e/mypythondb-0.2.4.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-07-25 12:52:55",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "ryanhamilton",
"github_project": "pythondb",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "mypythondb"
}
JSON
