| Name | shipyard-snowflake JSON |
| Version |
0.2.8
JSON |
| download |
| home_page | None |
| Summary | A local client for conecting and working with Snowflake |
| upload_time | 2024-07-01 15:38:59 |
| maintainer | None |
| docs_url | None |
| author | wrp801 |
| requires_python | <3.11,>=3.9 |
| license | Apache 2.0 |
| keywords |
|
| VCS |
|
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
# shipyard-snowflake
The `shipyard-snowflake` Python Package is a set of utility classes designed to streamline interactions with Snowflake, a cloud-based data warehousing platform. This package offers two main client classes, `SnowflakeClient` and `SnowparkClient`, each catering to different use cases and functionalities within the Snowflake ecosystem.
## Table of Contents
- [Installation](#installation)
- [Usage](#usage)
- [SnowflakeClient](#snowflakeclient)
- [SnowparkClient](#snowparkclient)
## Installation
You can install `shipyard-snowflake` using `pip`:
```bash
python3 -m pip install shipyard-snowflake
```
## Usage
### SnowflakeClient
The SnowflakeClient class provides methods to interact with Snowflake using the Snowflake Python Connector. It supports functionalities such as authentication, data uploading, executing queries, and fetching results. Here's an example of how to use it:
```python
import pandas as pd
from shipyard_snowflake import SnowflakeClient
from shipyard_snowflake.utils import utils
# Initialize the SnowflakeClient with credentials
client = SnowflakeClient(
username="your_username",
pwd="your_password",
account="your_account_id",
warehouse="your_warehouse",
database="your_database",
schema="your_schema",
rsa_key="your_rsa_key", # Optional, use either rsa_key or pwd
role="your_role"
)
# Connect to Snowflake
client.connect()
```
### Upload a file to Create or Replace a Table
```python
# Upload a csv to Snowflake to replace a table
# create the table first
data_types = utils.infer_schema(file_name = "<file_path>")
sql = client._create_table_sql(table_name = "<table_name>", columns = data_types)
client.create_table(sql)
# load the file to the table
client.upload(file_path = "<file_path>", table_name = "<table_name>", insert_method = "replace")
```
### Upload a file to append to an existing table
```python
client.upload(file_path = "<file_path>", table_name = "<table_name>", insert_method = "append")
### Fetch the results of a query as a pandas dataframe
```python
query = "SELECT * FROM your_table_name"
result_df = client.execute_query(query=query)
```
### Execute a Query
```python
query = "DROP TABLE IF EXISTS SALES"
result_df = client.fetch(query = query)
```
### Close the connection
```python
# Close the connection
client.conn.close()
```
### SnowparkClient
The SnowparkClient class allows interaction with Snowflake using Snowpark, a modern data processing and scripting framework. It enables data upload and some query execution capabilities. Here's an example of how to use it:
```python
from shipyard_snowflake import SnowparkClient
# Initialize the SnowparkClient with credentials
client = SnowparkClient(
username="your_username",
pwd="your_password",
account="your_account_url",
warehouse="your_warehouse", # optional
database="your_database", # optional
schema="your_schema", # optional
role="your_role" # optional
)
# Connect to Snowflake using Snowpark
session = client.connect()
# Upload a DataFrame to Snowflake
import pandas as pd
df = pd.DataFrame(...) # Your DataFrame
client.upload(
session=session,
df=df,
table_name="your_table_name",
overwrite=True # False for append
)
# Close the session
session.close()
```
Raw data
{
"_id": null,
"home_page": null,
"name": "shipyard-snowflake",
"maintainer": null,
"docs_url": null,
"requires_python": "<3.11,>=3.9",
"maintainer_email": null,
"keywords": null,
"author": "wrp801",
"author_email": "wespoulsen@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/ad/5a/2daa10f34758318dda52127acf73d7cb2e7ada12942debfc28ebd60c1ad6/shipyard_snowflake-0.2.8.tar.gz",
"platform": null,
"description": "# shipyard-snowflake\n\nThe `shipyard-snowflake` Python Package is a set of utility classes designed to streamline interactions with Snowflake, a cloud-based data warehousing platform. This package offers two main client classes, `SnowflakeClient` and `SnowparkClient`, each catering to different use cases and functionalities within the Snowflake ecosystem.\n\n## Table of Contents\n\n- [Installation](#installation)\n- [Usage](#usage)\n - [SnowflakeClient](#snowflakeclient)\n - [SnowparkClient](#snowparkclient)\n## Installation\n\nYou can install `shipyard-snowflake` using `pip`:\n\n```bash\npython3 -m pip install shipyard-snowflake\n```\n\n## Usage\n\n### SnowflakeClient\n\nThe SnowflakeClient class provides methods to interact with Snowflake using the Snowflake Python Connector. It supports functionalities such as authentication, data uploading, executing queries, and fetching results. Here's an example of how to use it:\n\n```python\nimport pandas as pd\nfrom shipyard_snowflake import SnowflakeClient\nfrom shipyard_snowflake.utils import utils\n# Initialize the SnowflakeClient with credentials\nclient = SnowflakeClient(\n username=\"your_username\",\n pwd=\"your_password\",\n account=\"your_account_id\",\n warehouse=\"your_warehouse\",\n database=\"your_database\",\n schema=\"your_schema\",\n rsa_key=\"your_rsa_key\", # Optional, use either rsa_key or pwd\n role=\"your_role\"\n)\n\n# Connect to Snowflake\nclient.connect()\n```\n\n\n### Upload a file to Create or Replace a Table \n```python \n\n# Upload a csv to Snowflake to replace a table\n# create the table first\ndata_types = utils.infer_schema(file_name = \"<file_path>\")\nsql = client._create_table_sql(table_name = \"<table_name>\", columns = data_types)\nclient.create_table(sql)\n# load the file to the table\nclient.upload(file_path = \"<file_path>\", table_name = \"<table_name>\", insert_method = \"replace\")\n\n``` \n### Upload a file to append to an existing table \n```python\nclient.upload(file_path = \"<file_path>\", table_name = \"<table_name>\", insert_method = \"append\")\n\n### Fetch the results of a query as a pandas dataframe\n```python\nquery = \"SELECT * FROM your_table_name\"\nresult_df = client.execute_query(query=query)\n```\n\n### Execute a Query\n```python\nquery = \"DROP TABLE IF EXISTS SALES\"\nresult_df = client.fetch(query = query)\n```\n\n### Close the connection \n```python\n# Close the connection\nclient.conn.close()\n```\n\n### SnowparkClient\n\nThe SnowparkClient class allows interaction with Snowflake using Snowpark, a modern data processing and scripting framework. It enables data upload and some query execution capabilities. Here's an example of how to use it:\n```python\nfrom shipyard_snowflake import SnowparkClient\n\n# Initialize the SnowparkClient with credentials\nclient = SnowparkClient(\n username=\"your_username\",\n pwd=\"your_password\",\n account=\"your_account_url\",\n warehouse=\"your_warehouse\", # optional\n database=\"your_database\", # optional\n schema=\"your_schema\", # optional\n role=\"your_role\" # optional\n)\n\n# Connect to Snowflake using Snowpark\nsession = client.connect()\n\n# Upload a DataFrame to Snowflake\nimport pandas as pd\ndf = pd.DataFrame(...) # Your DataFrame\nclient.upload(\n session=session,\n df=df,\n table_name=\"your_table_name\",\n overwrite=True # False for append\n)\n# Close the session\nsession.close()\n```\n\n",
"bugtrack_url": null,
"license": "Apache 2.0",
"summary": "A local client for conecting and working with Snowflake",
"version": "0.2.8",
"project_urls": null,
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "4cac040aaa45f7da54bea2d0be6776554828de5b2af249b4a90da767ceaeeb1d",
"md5": "fcf2a69a6edd687f66f6c54d578e7dae",
"sha256": "4ab6b5eccc6643a0fbf92a4b9d018953aa9ee58daf25cc1e2fbad36bc7ad5714"
},
"downloads": -1,
"filename": "shipyard_snowflake-0.2.8-py3-none-any.whl",
"has_sig": false,
"md5_digest": "fcf2a69a6edd687f66f6c54d578e7dae",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": "<3.11,>=3.9",
"size": 18947,
"upload_time": "2024-07-01T15:38:58",
"upload_time_iso_8601": "2024-07-01T15:38:58.078424Z",
"url": "https://files.pythonhosted.org/packages/4c/ac/040aaa45f7da54bea2d0be6776554828de5b2af249b4a90da767ceaeeb1d/shipyard_snowflake-0.2.8-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "ad5a2daa10f34758318dda52127acf73d7cb2e7ada12942debfc28ebd60c1ad6",
"md5": "1cca5dbd41b74257292bbbb4c0b179ec",
"sha256": "21ab66c715605995c8c9e563e7c7c09ada115e23ce5c2702edfcb760f6b5e8d4"
},
"downloads": -1,
"filename": "shipyard_snowflake-0.2.8.tar.gz",
"has_sig": false,
"md5_digest": "1cca5dbd41b74257292bbbb4c0b179ec",
"packagetype": "sdist",
"python_version": "source",
"requires_python": "<3.11,>=3.9",
"size": 13972,
"upload_time": "2024-07-01T15:38:59",
"upload_time_iso_8601": "2024-07-01T15:38:59.792011Z",
"url": "https://files.pythonhosted.org/packages/ad/5a/2daa10f34758318dda52127acf73d7cb2e7ada12942debfc28ebd60c1ad6/shipyard_snowflake-0.2.8.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-07-01 15:38:59",
"github": false,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"lcname": "shipyard-snowflake"
}
