connectorx


Nameconnectorx JSON
Version 0.4.0 PyPI version JSON
download
home_pageNone
SummaryNone
upload_time2024-11-04 20:30:09
maintainerNone
docs_urlNone
authorWeiyuan Wu <youngw@sfu.ca>
requires_python>=3.10
licenseMIT
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # ConnectorX [![status][ci_badge]][ci_page] [![discussions][discussion_badge]][discussion_page] [![Downloads][download_badge]][download_page]

[ci_badge]: https://github.com/sfu-db/connector-x/workflows/ci/badge.svg
[ci_page]: https://github.com/sfu-db/connector-x/actions
[discussion_badge]: https://img.shields.io/badge/Forum-Github%20Discussions-blue
[discussion_page]: https://github.com/sfu-db/connector-x/discussions
[download_badge]: https://pepy.tech/badge/connectorx
[download_page]: https://pepy.tech/project/connectorx

Load data from <img src="https://raw.githubusercontent.com/sfu-db/connector-x/main/assets/sources.gif" width="6.5%" style="margin-bottom: -2px"/> to <img src="https://raw.githubusercontent.com/sfu-db/connector-x/main/assets/destinations.gif" width="7%" style="margin-bottom: -2px"/>, the fastest way.

ConnectorX enables you to load data from databases into Python in the fastest and most memory efficient way.

What you need is one line of code:

```python
import connectorx as cx

cx.read_sql("postgresql://username:password@server:port/database", "SELECT * FROM lineitem")
```

Optionally, you can accelerate the data loading using parallelism by specifying a partition column.

```python
import connectorx as cx

cx.read_sql("postgresql://username:password@server:port/database", "SELECT * FROM lineitem", partition_on="l_orderkey", partition_num=10)
```

The function will partition the query by **evenly** splitting the specified column to the amount of partitions.
ConnectorX will assign one thread for each partition to load and write data in parallel.
Currently, we support partitioning on **numerical** columns (**cannot contain NULL**) for **SPJA** queries. 

**Experimental: We are now providing federated query support, you can write a single query to join tables from two or more databases!**
```python
import connectorx as cx
db1 = "postgresql://username1:password1@server1:port1/database1"
db2 = "postgresql://username2:password2@server2:port2/database2"
cx.read_sql({"db1": db1, "db2": db2}, "SELECT * FROM db1.nation n, db2.region r where n.n_regionkey = r.r_regionkey")
```
By default, we pushdown all joins from the same data source. More details for setup and configuration can be found [here](https://github.com/sfu-db/connector-x/blob/main/Federation.md).

Check out more detailed usage and examples [here](https://sfu-db.github.io/connector-x/api.html). A general introduction of the project can be found in this [blog post](https://towardsdatascience.com/connectorx-the-fastest-way-to-load-data-from-databases-a65d4d4062d5).

# Installation

```bash
pip install connectorx
```

Check out [here](https://sfu-db.github.io/connector-x/install.html#build-from-source-code) to see how to build python wheel from source.

# Performance

We compared different solutions in Python that provides the `read_sql` function, by loading a 10x TPC-H lineitem table (8.6GB) from Postgres into a DataFrame, with 4 cores parallelism.

## Time chart, lower is better.

<p align="center"><img alt="time chart" src="https://raw.githubusercontent.com/sfu-db/connector-x/main/assets/pg-time.png"/></p>

## Memory consumption chart, lower is better.

<p align="center"><img alt="memory chart" src="https://raw.githubusercontent.com/sfu-db/connector-x/main/assets/pg-mem.png"/></p>

In conclusion, ConnectorX uses up to **3x** less memory and **21x** less time (**3x** less memory and **13x** less time compared with Pandas.). More on [here](https://github.com/sfu-db/connector-x/blob/main/Benchmark.md#benchmark-result-on-aws-r54xlarge).

## How does ConnectorX achieve a lightning speed while keeping the memory footprint low?

We observe that existing solutions more or less do data copy multiple times when downloading the data.
Additionally, implementing a data intensive application in Python brings additional cost.

ConnectorX is written in Rust and follows "zero-copy" principle.
This allows it to make full use of the CPU by becoming cache and branch predictor friendly. Moreover, the architecture of ConnectorX ensures the data will be copied exactly once, directly from the source to the destination.

## How does ConnectorX download the data?

Upon receiving the query, e.g. `SELECT * FROM lineitem`, ConnectorX will first issue a `LIMIT 1` query `SELECT * FROM lineitem LIMIT 1` to get the schema of the result set.

Then, if `partition_on` is specified, ConnectorX will issue `SELECT MIN($partition_on), MAX($partition_on) FROM (SELECT * FROM lineitem)` to know the range of the partition column.
After that, the original query is split into partitions based on the min/max information, e.g. `SELECT * FROM (SELECT * FROM lineitem) WHERE $partition_on > 0 AND $partition_on < 10000`.
ConnectorX will then run a count query to get the partition size (e.g. `SELECT COUNT(*) FROM (SELECT * FROM lineitem) WHERE $partition_on > 0 AND $partition_on < 10000`). If the partition
is not specified, the count query will be `SELECT COUNT(*) FROM (SELECT * FROM lineitem)`.

Finally, ConnectorX will use the schema info as well as the count info to allocate memory and download data by executing the queries normally.

Once the downloading begins, there will be one thread for each partition so that the data are downloaded in parallel at the partition level. The thread will issue the query of the corresponding
partition to the database and then write the returned data to the destination row-wise or column-wise (depends on the database) in a streaming fashion. 


# Supported Sources & Destinations

Example connection string, supported protocols and data types for each data source can be found [here](https://sfu-db.github.io/connector-x/databases.html).

For more planned data sources, please check out our [discussion](https://github.com/sfu-db/connector-x/discussions/61).

## Sources
- [x] Postgres
- [x] Mysql
- [x] Mariadb (through mysql protocol)
- [x] Sqlite
- [x] Redshift (through postgres protocol)
- [x] Clickhouse (through mysql protocol)
- [x] SQL Server
- [x] Azure SQL Database (through mssql protocol)
- [x] Oracle
- [x] Big Query
- [x] Trino
- [ ] ODBC (WIP)
- [ ] ...

## Destinations
- [x] Pandas
- [x] PyArrow
- [x] Modin (through Pandas)
- [x] Dask (through Pandas)
- [x] Polars (through PyArrow)

# Documentation

Doc: https://sfu-db.github.io/connector-x/intro.html
Rust docs: [stable](https://docs.rs/connectorx) [nightly](https://sfu-db.github.io/connector-x/connectorx/)

# Next Plan

Checkout our [discussion][discussion_page] to participate in deciding our next plan!

# Historical Benchmark Results

https://sfu-db.github.io/connector-x/dev/bench/

# Developer's Guide
Please see [Developer's Guide](https://github.com/sfu-db/connector-x/blob/main/CONTRIBUTING.md) for information about developing ConnectorX.

# Supports

You are always welcomed to:
1. Ask questions & propose new ideas in our github [discussion][discussion_page].
2. Ask questions in stackoverflow. Make sure to have #connectorx attached.

# Organizations and Projects using ConnectorX

[<img src="https://raw.githubusercontent.com/pola-rs/polars-static/master/logos/polars-logo-dark.svg" height="60" style="margin-bottom: -2px"/>](https://github.com/pola-rs/polars)
[<img src="https://raw.githubusercontent.com/sfu-db/dataprep/develop/assets/logo.png" height="60" style="margin-bottom: -2px"/>](https://dataprep.ai/)
[<img src="https://github.com/modin-project/modin/blob/3d6368edf311995ad231ec5342a51cd9e4e3dc20/docs/img/MODIN_ver2_hrz.png?raw=true" height="60" style="margin-bottom: -2px"/>](https://modin.readthedocs.io)

To add your project/organization here, reply our post [here](https://github.com/sfu-db/connector-x/discussions/146)

# Citing ConnectorX

If you use ConnectorX, please consider citing the following paper:

Xiaoying Wang, Weiyuan Wu, Jinze Wu, Yizhou Chen, Nick Zrymiak, Changbo Qu, Lampros Flokas, George Chow, Jiannan Wang, Tianzheng Wang, Eugene Wu, Qingqing Zhou. [ConnectorX: Accelerating Data Loading From Databases to Dataframes.](https://www.vldb.org/pvldb/vol15/p2994-wang.pdf) _VLDB 2022_.

BibTeX entry:

```bibtex
@article{connectorx2022,
  author    = {Xiaoying Wang and Weiyuan Wu and Jinze Wu and Yizhou Chen and Nick Zrymiak and Changbo Qu and Lampros Flokas and George Chow and Jiannan Wang and Tianzheng Wang and Eugene Wu and Qingqing Zhou},
  title     = {ConnectorX: Accelerating Data Loading From Databases to Dataframes},
  journal   = {Proc. {VLDB} Endow.},
  volume    = {15},
  number    = {11},
  pages     = {2994--3003},
  year      = {2022},
  url       = {https://www.vldb.org/pvldb/vol15/p2994-wang.pdf},
}
```

# Contributors

<!-- readme: contributors -start -->
<table>
	<tbody>
		<tr>
            <td align="center">
                <a href="https://github.com/wangxiaoying">
                    <img src="https://avatars.githubusercontent.com/u/5569610?v=4" width="66;" alt="wangxiaoying"/>
                    <br />
                    <sub><b>Xiaoying Wang</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/dovahcrow">
                    <img src="https://avatars.githubusercontent.com/u/998606?v=4" width="66;" alt="dovahcrow"/>
                    <br />
                    <sub><b>Weiyuan Wu</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/Wukkkinz-0725">
                    <img src="https://avatars.githubusercontent.com/u/60677420?v=4" width="66;" alt="Wukkkinz-0725"/>
                    <br />
                    <sub><b>Null</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/Yizhou150">
                    <img src="https://avatars.githubusercontent.com/u/62522644?v=4" width="66;" alt="Yizhou150"/>
                    <br />
                    <sub><b>Yizhou</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/zen-xu">
                    <img src="https://avatars.githubusercontent.com/u/38552291?v=4" width="66;" alt="zen-xu"/>
                    <br />
                    <sub><b>ZhengYu, Xu</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/wseaton">
                    <img src="https://avatars.githubusercontent.com/u/16678729?v=4" width="66;" alt="wseaton"/>
                    <br />
                    <sub><b>Will Eaton</b></sub>
                </a>
            </td>
		</tr>
		<tr>
            <td align="center">
                <a href="https://github.com/AnatolyBuga">
                    <img src="https://avatars.githubusercontent.com/u/60788447?v=4" width="66;" alt="AnatolyBuga"/>
                    <br />
                    <sub><b>Anatoly Bugakov</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/Jordan-M-Young">
                    <img src="https://avatars.githubusercontent.com/u/54070169?v=4" width="66;" alt="Jordan-M-Young"/>
                    <br />
                    <sub><b>Jordan M. Young</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/domnikl">
                    <img src="https://avatars.githubusercontent.com/u/603116?v=4" width="66;" alt="domnikl"/>
                    <br />
                    <sub><b>Dominik Liebler</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/auyer">
                    <img src="https://avatars.githubusercontent.com/u/12375421?v=4" width="66;" alt="auyer"/>
                    <br />
                    <sub><b>Rafael Passos</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/pangjunrong">
                    <img src="https://avatars.githubusercontent.com/u/61274749?v=4" width="66;" alt="pangjunrong"/>
                    <br />
                    <sub><b>Pang Jun Rong (Jayden)</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/gruuya">
                    <img src="https://avatars.githubusercontent.com/u/45558892?v=4" width="66;" alt="gruuya"/>
                    <br />
                    <sub><b>Marko Grujic</b></sub>
                </a>
            </td>
		</tr>
		<tr>
            <td align="center">
                <a href="https://github.com/jinzew">
                    <img src="https://avatars.githubusercontent.com/u/55274369?v=4" width="66;" alt="jinzew"/>
                    <br />
                    <sub><b>Null</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/alswang18">
                    <img src="https://avatars.githubusercontent.com/u/44207558?v=4" width="66;" alt="alswang18"/>
                    <br />
                    <sub><b>Alec Wang</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/lBilali">
                    <img src="https://avatars.githubusercontent.com/u/5528169?v=4" width="66;" alt="lBilali"/>
                    <br />
                    <sub><b>Lulzim Bilali</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/ritchie46">
                    <img src="https://avatars.githubusercontent.com/u/3023000?v=4" width="66;" alt="ritchie46"/>
                    <br />
                    <sub><b>Ritchie Vink</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/houqp">
                    <img src="https://avatars.githubusercontent.com/u/670302?v=4" width="66;" alt="houqp"/>
                    <br />
                    <sub><b>QP Hou</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/wKollendorf">
                    <img src="https://avatars.githubusercontent.com/u/83725977?v=4" width="66;" alt="wKollendorf"/>
                    <br />
                    <sub><b>Null</b></sub>
                </a>
            </td>
		</tr>
		<tr>
            <td align="center">
                <a href="https://github.com/CBQu">
                    <img src="https://avatars.githubusercontent.com/u/16992497?v=4" width="66;" alt="CBQu"/>
                    <br />
                    <sub><b>CbQu</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/quambene">
                    <img src="https://avatars.githubusercontent.com/u/33333672?v=4" width="66;" alt="quambene"/>
                    <br />
                    <sub><b>Null</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/jorgecarleitao">
                    <img src="https://avatars.githubusercontent.com/u/2772607?v=4" width="66;" alt="jorgecarleitao"/>
                    <br />
                    <sub><b>Jorge Leitao</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/glennpierce">
                    <img src="https://avatars.githubusercontent.com/u/691783?v=4" width="66;" alt="glennpierce"/>
                    <br />
                    <sub><b>Glenn Pierce</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/alexander-beedie">
                    <img src="https://avatars.githubusercontent.com/u/2613171?v=4" width="66;" alt="alexander-beedie"/>
                    <br />
                    <sub><b>Alexander Beedie</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/FerriLuli">
                    <img src="https://avatars.githubusercontent.com/u/110925223?v=4" width="66;" alt="FerriLuli"/>
                    <br />
                    <sub><b>FerriLuli</b></sub>
                </a>
            </td>
		</tr>
		<tr>
            <td align="center">
                <a href="https://github.com/therealhieu">
                    <img src="https://avatars.githubusercontent.com/u/38937534?v=4" width="66;" alt="therealhieu"/>
                    <br />
                    <sub><b>Hieu Minh Nguyen</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/maxb2">
                    <img src="https://avatars.githubusercontent.com/u/9096667?v=4" width="66;" alt="maxb2"/>
                    <br />
                    <sub><b>Matthew Anderson</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/tschm">
                    <img src="https://avatars.githubusercontent.com/u/2046079?v=4" width="66;" alt="tschm"/>
                    <br />
                    <sub><b>Thomas Schmelzer</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/MatsMoll">
                    <img src="https://avatars.githubusercontent.com/u/4439131?v=4" width="66;" alt="MatsMoll"/>
                    <br />
                    <sub><b>Mats Eikeland Mollestad</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/rursprung">
                    <img src="https://avatars.githubusercontent.com/u/39383228?v=4" width="66;" alt="rursprung"/>
                    <br />
                    <sub><b>Ralph Ursprung</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/albcunha">
                    <img src="https://avatars.githubusercontent.com/u/13671325?v=4" width="66;" alt="albcunha"/>
                    <br />
                    <sub><b>Null</b></sub>
                </a>
            </td>
		</tr>
		<tr>
            <td align="center">
                <a href="https://github.com/kotval">
                    <img src="https://avatars.githubusercontent.com/u/11917243?v=4" width="66;" alt="kotval"/>
                    <br />
                    <sub><b>Kotval</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/messense">
                    <img src="https://avatars.githubusercontent.com/u/1556054?v=4" width="66;" alt="messense"/>
                    <br />
                    <sub><b>Messense</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/phanindra-ramesh">
                    <img src="https://avatars.githubusercontent.com/u/16794420?v=4" width="66;" alt="phanindra-ramesh"/>
                    <br />
                    <sub><b>Null</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/surister">
                    <img src="https://avatars.githubusercontent.com/u/37985796?v=4" width="66;" alt="surister"/>
                    <br />
                    <sub><b>Ivan</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/venkashank">
                    <img src="https://avatars.githubusercontent.com/u/27744439?v=4" width="66;" alt="venkashank"/>
                    <br />
                    <sub><b>Null</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/zemelLeong">
                    <img src="https://avatars.githubusercontent.com/u/26835087?v=4" width="66;" alt="zemelLeong"/>
                    <br />
                    <sub><b>zemel leong</b></sub>
                </a>
            </td>
		</tr>
		<tr>
            <td align="center">
                <a href="https://github.com/zzzdong">
                    <img src="https://avatars.githubusercontent.com/u/5125482?v=4" width="66;" alt="zzzdong"/>
                    <br />
                    <sub><b>Null</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/marianoguerra">
                    <img src="https://avatars.githubusercontent.com/u/68463?v=4" width="66;" alt="marianoguerra"/>
                    <br />
                    <sub><b>Mariano Guerra</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/kevinheavey">
                    <img src="https://avatars.githubusercontent.com/u/24635973?v=4" width="66;" alt="kevinheavey"/>
                    <br />
                    <sub><b>Kevin Heavey</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/kayhoogland">
                    <img src="https://avatars.githubusercontent.com/u/22837350?v=4" width="66;" alt="kayhoogland"/>
                    <br />
                    <sub><b>Kay Hoogland</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/deepsourcebot">
                    <img src="https://avatars.githubusercontent.com/u/60907429?v=4" width="66;" alt="deepsourcebot"/>
                    <br />
                    <sub><b>DeepSource Bot</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/AndrewJackson2020">
                    <img src="https://avatars.githubusercontent.com/u/46945903?v=4" width="66;" alt="AndrewJackson2020"/>
                    <br />
                    <sub><b>Andrew Jackson</b></sub>
                </a>
            </td>
		</tr>
		<tr>
            <td align="center">
                <a href="https://github.com/Cabbagec">
                    <img src="https://avatars.githubusercontent.com/u/14164987?v=4" width="66;" alt="Cabbagec"/>
                    <br />
                    <sub><b>Brandon</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/Amar1729">
                    <img src="https://avatars.githubusercontent.com/u/15623522?v=4" width="66;" alt="Amar1729"/>
                    <br />
                    <sub><b>Amar Paul</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/aljazerzen">
                    <img src="https://avatars.githubusercontent.com/u/11072061?v=4" width="66;" alt="aljazerzen"/>
                    <br />
                    <sub><b>Aljaž Mur Eržen</b></sub>
                </a>
            </td>
            <td align="center">
                <a href="https://github.com/aimtsou">
                    <img src="https://avatars.githubusercontent.com/u/2598924?v=4" width="66;" alt="aimtsou"/>
                    <br />
                    <sub><b>Aimilios Tsouvelekakis</b></sub>
                </a>
            </td>
		</tr>
	<tbody>
</table>
<!-- readme: contributors -end -->


            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "connectorx",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.10",
    "maintainer_email": null,
    "keywords": null,
    "author": "Weiyuan Wu <youngw@sfu.ca>",
    "author_email": "Weiyuan Wu <youngw@sfu.ca>",
    "download_url": null,
    "platform": null,
    "description": "# ConnectorX [![status][ci_badge]][ci_page] [![discussions][discussion_badge]][discussion_page] [![Downloads][download_badge]][download_page]\n\n[ci_badge]: https://github.com/sfu-db/connector-x/workflows/ci/badge.svg\n[ci_page]: https://github.com/sfu-db/connector-x/actions\n[discussion_badge]: https://img.shields.io/badge/Forum-Github%20Discussions-blue\n[discussion_page]: https://github.com/sfu-db/connector-x/discussions\n[download_badge]: https://pepy.tech/badge/connectorx\n[download_page]: https://pepy.tech/project/connectorx\n\nLoad data from <img src=\"https://raw.githubusercontent.com/sfu-db/connector-x/main/assets/sources.gif\" width=\"6.5%\" style=\"margin-bottom: -2px\"/> to <img src=\"https://raw.githubusercontent.com/sfu-db/connector-x/main/assets/destinations.gif\" width=\"7%\" style=\"margin-bottom: -2px\"/>, the fastest way.\n\nConnectorX enables you to load data from databases into Python in the fastest and most memory efficient way.\n\nWhat you need is one line of code:\n\n```python\nimport connectorx as cx\n\ncx.read_sql(\"postgresql://username:password@server:port/database\", \"SELECT * FROM lineitem\")\n```\n\nOptionally, you can accelerate the data loading using parallelism by specifying a partition column.\n\n```python\nimport connectorx as cx\n\ncx.read_sql(\"postgresql://username:password@server:port/database\", \"SELECT * FROM lineitem\", partition_on=\"l_orderkey\", partition_num=10)\n```\n\nThe function will partition the query by **evenly** splitting the specified column to the amount of partitions.\nConnectorX will assign one thread for each partition to load and write data in parallel.\nCurrently, we support partitioning on **numerical** columns (**cannot contain NULL**) for **SPJA** queries. \n\n**Experimental: We are now providing federated query support, you can write a single query to join tables from two or more databases!**\n```python\nimport connectorx as cx\ndb1 = \"postgresql://username1:password1@server1:port1/database1\"\ndb2 = \"postgresql://username2:password2@server2:port2/database2\"\ncx.read_sql({\"db1\": db1, \"db2\": db2}, \"SELECT * FROM db1.nation n, db2.region r where n.n_regionkey = r.r_regionkey\")\n```\nBy default, we pushdown all joins from the same data source. More details for setup and configuration can be found [here](https://github.com/sfu-db/connector-x/blob/main/Federation.md).\n\nCheck out more detailed usage and examples [here](https://sfu-db.github.io/connector-x/api.html). A general introduction of the project can be found in this [blog post](https://towardsdatascience.com/connectorx-the-fastest-way-to-load-data-from-databases-a65d4d4062d5).\n\n# Installation\n\n```bash\npip install connectorx\n```\n\nCheck out [here](https://sfu-db.github.io/connector-x/install.html#build-from-source-code) to see how to build python wheel from source.\n\n# Performance\n\nWe compared different solutions in Python that provides the `read_sql` function, by loading a 10x TPC-H lineitem table (8.6GB) from Postgres into a DataFrame, with 4 cores parallelism.\n\n## Time chart, lower is better.\n\n<p align=\"center\"><img alt=\"time chart\" src=\"https://raw.githubusercontent.com/sfu-db/connector-x/main/assets/pg-time.png\"/></p>\n\n## Memory consumption chart, lower is better.\n\n<p align=\"center\"><img alt=\"memory chart\" src=\"https://raw.githubusercontent.com/sfu-db/connector-x/main/assets/pg-mem.png\"/></p>\n\nIn conclusion, ConnectorX uses up to **3x** less memory and **21x** less time (**3x** less memory and **13x** less time compared with Pandas.). More on [here](https://github.com/sfu-db/connector-x/blob/main/Benchmark.md#benchmark-result-on-aws-r54xlarge).\n\n## How does ConnectorX achieve a lightning speed while keeping the memory footprint low?\n\nWe observe that existing solutions more or less do data copy multiple times when downloading the data.\nAdditionally, implementing a data intensive application in Python brings additional cost.\n\nConnectorX is written in Rust and follows \"zero-copy\" principle.\nThis allows it to make full use of the CPU by becoming cache and branch predictor friendly. Moreover, the architecture of ConnectorX ensures the data will be copied exactly once, directly from the source to the destination.\n\n## How does ConnectorX download the data?\n\nUpon receiving the query, e.g. `SELECT * FROM lineitem`, ConnectorX will first issue a `LIMIT 1` query `SELECT * FROM lineitem LIMIT 1` to get the schema of the result set.\n\nThen, if `partition_on` is specified, ConnectorX will issue `SELECT MIN($partition_on), MAX($partition_on) FROM (SELECT * FROM lineitem)` to know the range of the partition column.\nAfter that, the original query is split into partitions based on the min/max information, e.g. `SELECT * FROM (SELECT * FROM lineitem) WHERE $partition_on > 0 AND $partition_on < 10000`.\nConnectorX will then run a count query to get the partition size (e.g. `SELECT COUNT(*) FROM (SELECT * FROM lineitem) WHERE $partition_on > 0 AND $partition_on < 10000`). If the partition\nis not specified, the count query will be `SELECT COUNT(*) FROM (SELECT * FROM lineitem)`.\n\nFinally, ConnectorX will use the schema info as well as the count info to allocate memory and download data by executing the queries normally.\n\nOnce the downloading begins, there will be one thread for each partition so that the data are downloaded in parallel at the partition level. The thread will issue the query of the corresponding\npartition to the database and then write the returned data to the destination row-wise or column-wise (depends on the database) in a streaming fashion. \n\n\n# Supported Sources & Destinations\n\nExample connection string, supported protocols and data types for each data source can be found [here](https://sfu-db.github.io/connector-x/databases.html).\n\nFor more planned data sources, please check out our [discussion](https://github.com/sfu-db/connector-x/discussions/61).\n\n## Sources\n- [x] Postgres\n- [x] Mysql\n- [x] Mariadb (through mysql protocol)\n- [x] Sqlite\n- [x] Redshift (through postgres protocol)\n- [x] Clickhouse (through mysql protocol)\n- [x] SQL Server\n- [x] Azure SQL Database (through mssql protocol)\n- [x] Oracle\n- [x] Big Query\n- [x] Trino\n- [ ] ODBC (WIP)\n- [ ] ...\n\n## Destinations\n- [x] Pandas\n- [x] PyArrow\n- [x] Modin (through Pandas)\n- [x] Dask (through Pandas)\n- [x] Polars (through PyArrow)\n\n# Documentation\n\nDoc: https://sfu-db.github.io/connector-x/intro.html\nRust docs: [stable](https://docs.rs/connectorx) [nightly](https://sfu-db.github.io/connector-x/connectorx/)\n\n# Next Plan\n\nCheckout our [discussion][discussion_page] to participate in deciding our next plan!\n\n# Historical Benchmark Results\n\nhttps://sfu-db.github.io/connector-x/dev/bench/\n\n# Developer's Guide\nPlease see [Developer's Guide](https://github.com/sfu-db/connector-x/blob/main/CONTRIBUTING.md) for information about developing ConnectorX.\n\n# Supports\n\nYou are always welcomed to:\n1. Ask questions & propose new ideas in our github [discussion][discussion_page].\n2. Ask questions in stackoverflow. Make sure to have #connectorx attached.\n\n# Organizations and Projects using ConnectorX\n\n[<img src=\"https://raw.githubusercontent.com/pola-rs/polars-static/master/logos/polars-logo-dark.svg\" height=\"60\" style=\"margin-bottom: -2px\"/>](https://github.com/pola-rs/polars)\n[<img src=\"https://raw.githubusercontent.com/sfu-db/dataprep/develop/assets/logo.png\" height=\"60\" style=\"margin-bottom: -2px\"/>](https://dataprep.ai/)\n[<img src=\"https://github.com/modin-project/modin/blob/3d6368edf311995ad231ec5342a51cd9e4e3dc20/docs/img/MODIN_ver2_hrz.png?raw=true\" height=\"60\" style=\"margin-bottom: -2px\"/>](https://modin.readthedocs.io)\n\nTo add your project/organization here, reply our post [here](https://github.com/sfu-db/connector-x/discussions/146)\n\n# Citing ConnectorX\n\nIf you use ConnectorX, please consider citing the following paper:\n\nXiaoying Wang, Weiyuan Wu, Jinze Wu, Yizhou Chen, Nick Zrymiak, Changbo Qu, Lampros Flokas, George Chow, Jiannan Wang, Tianzheng Wang, Eugene Wu, Qingqing Zhou. [ConnectorX: Accelerating Data Loading From Databases to Dataframes.](https://www.vldb.org/pvldb/vol15/p2994-wang.pdf) _VLDB 2022_.\n\nBibTeX entry:\n\n```bibtex\n@article{connectorx2022,\n  author    = {Xiaoying Wang and Weiyuan Wu and Jinze Wu and Yizhou Chen and Nick Zrymiak and Changbo Qu and Lampros Flokas and George Chow and Jiannan Wang and Tianzheng Wang and Eugene Wu and Qingqing Zhou},\n  title     = {ConnectorX: Accelerating Data Loading From Databases to Dataframes},\n  journal   = {Proc. {VLDB} Endow.},\n  volume    = {15},\n  number    = {11},\n  pages     = {2994--3003},\n  year      = {2022},\n  url       = {https://www.vldb.org/pvldb/vol15/p2994-wang.pdf},\n}\n```\n\n# Contributors\n\n<!-- readme: contributors -start -->\n<table>\n\t<tbody>\n\t\t<tr>\n            <td align=\"center\">\n                <a href=\"https://github.com/wangxiaoying\">\n                    <img src=\"https://avatars.githubusercontent.com/u/5569610?v=4\" width=\"66;\" alt=\"wangxiaoying\"/>\n                    <br />\n                    <sub><b>Xiaoying Wang</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/dovahcrow\">\n                    <img src=\"https://avatars.githubusercontent.com/u/998606?v=4\" width=\"66;\" alt=\"dovahcrow\"/>\n                    <br />\n                    <sub><b>Weiyuan Wu</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/Wukkkinz-0725\">\n                    <img src=\"https://avatars.githubusercontent.com/u/60677420?v=4\" width=\"66;\" alt=\"Wukkkinz-0725\"/>\n                    <br />\n                    <sub><b>Null</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/Yizhou150\">\n                    <img src=\"https://avatars.githubusercontent.com/u/62522644?v=4\" width=\"66;\" alt=\"Yizhou150\"/>\n                    <br />\n                    <sub><b>Yizhou</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/zen-xu\">\n                    <img src=\"https://avatars.githubusercontent.com/u/38552291?v=4\" width=\"66;\" alt=\"zen-xu\"/>\n                    <br />\n                    <sub><b>ZhengYu, Xu</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/wseaton\">\n                    <img src=\"https://avatars.githubusercontent.com/u/16678729?v=4\" width=\"66;\" alt=\"wseaton\"/>\n                    <br />\n                    <sub><b>Will Eaton</b></sub>\n                </a>\n            </td>\n\t\t</tr>\n\t\t<tr>\n            <td align=\"center\">\n                <a href=\"https://github.com/AnatolyBuga\">\n                    <img src=\"https://avatars.githubusercontent.com/u/60788447?v=4\" width=\"66;\" alt=\"AnatolyBuga\"/>\n                    <br />\n                    <sub><b>Anatoly Bugakov</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/Jordan-M-Young\">\n                    <img src=\"https://avatars.githubusercontent.com/u/54070169?v=4\" width=\"66;\" alt=\"Jordan-M-Young\"/>\n                    <br />\n                    <sub><b>Jordan M. Young</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/domnikl\">\n                    <img src=\"https://avatars.githubusercontent.com/u/603116?v=4\" width=\"66;\" alt=\"domnikl\"/>\n                    <br />\n                    <sub><b>Dominik Liebler</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/auyer\">\n                    <img src=\"https://avatars.githubusercontent.com/u/12375421?v=4\" width=\"66;\" alt=\"auyer\"/>\n                    <br />\n                    <sub><b>Rafael Passos</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/pangjunrong\">\n                    <img src=\"https://avatars.githubusercontent.com/u/61274749?v=4\" width=\"66;\" alt=\"pangjunrong\"/>\n                    <br />\n                    <sub><b>Pang Jun Rong (Jayden)</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/gruuya\">\n                    <img src=\"https://avatars.githubusercontent.com/u/45558892?v=4\" width=\"66;\" alt=\"gruuya\"/>\n                    <br />\n                    <sub><b>Marko Grujic</b></sub>\n                </a>\n            </td>\n\t\t</tr>\n\t\t<tr>\n            <td align=\"center\">\n                <a href=\"https://github.com/jinzew\">\n                    <img src=\"https://avatars.githubusercontent.com/u/55274369?v=4\" width=\"66;\" alt=\"jinzew\"/>\n                    <br />\n                    <sub><b>Null</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/alswang18\">\n                    <img src=\"https://avatars.githubusercontent.com/u/44207558?v=4\" width=\"66;\" alt=\"alswang18\"/>\n                    <br />\n                    <sub><b>Alec Wang</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/lBilali\">\n                    <img src=\"https://avatars.githubusercontent.com/u/5528169?v=4\" width=\"66;\" alt=\"lBilali\"/>\n                    <br />\n                    <sub><b>Lulzim Bilali</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/ritchie46\">\n                    <img src=\"https://avatars.githubusercontent.com/u/3023000?v=4\" width=\"66;\" alt=\"ritchie46\"/>\n                    <br />\n                    <sub><b>Ritchie Vink</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/houqp\">\n                    <img src=\"https://avatars.githubusercontent.com/u/670302?v=4\" width=\"66;\" alt=\"houqp\"/>\n                    <br />\n                    <sub><b>QP Hou</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/wKollendorf\">\n                    <img src=\"https://avatars.githubusercontent.com/u/83725977?v=4\" width=\"66;\" alt=\"wKollendorf\"/>\n                    <br />\n                    <sub><b>Null</b></sub>\n                </a>\n            </td>\n\t\t</tr>\n\t\t<tr>\n            <td align=\"center\">\n                <a href=\"https://github.com/CBQu\">\n                    <img src=\"https://avatars.githubusercontent.com/u/16992497?v=4\" width=\"66;\" alt=\"CBQu\"/>\n                    <br />\n                    <sub><b>CbQu</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/quambene\">\n                    <img src=\"https://avatars.githubusercontent.com/u/33333672?v=4\" width=\"66;\" alt=\"quambene\"/>\n                    <br />\n                    <sub><b>Null</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/jorgecarleitao\">\n                    <img src=\"https://avatars.githubusercontent.com/u/2772607?v=4\" width=\"66;\" alt=\"jorgecarleitao\"/>\n                    <br />\n                    <sub><b>Jorge Leitao</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/glennpierce\">\n                    <img src=\"https://avatars.githubusercontent.com/u/691783?v=4\" width=\"66;\" alt=\"glennpierce\"/>\n                    <br />\n                    <sub><b>Glenn Pierce</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/alexander-beedie\">\n                    <img src=\"https://avatars.githubusercontent.com/u/2613171?v=4\" width=\"66;\" alt=\"alexander-beedie\"/>\n                    <br />\n                    <sub><b>Alexander Beedie</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/FerriLuli\">\n                    <img src=\"https://avatars.githubusercontent.com/u/110925223?v=4\" width=\"66;\" alt=\"FerriLuli\"/>\n                    <br />\n                    <sub><b>FerriLuli</b></sub>\n                </a>\n            </td>\n\t\t</tr>\n\t\t<tr>\n            <td align=\"center\">\n                <a href=\"https://github.com/therealhieu\">\n                    <img src=\"https://avatars.githubusercontent.com/u/38937534?v=4\" width=\"66;\" alt=\"therealhieu\"/>\n                    <br />\n                    <sub><b>Hieu Minh Nguyen</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/maxb2\">\n                    <img src=\"https://avatars.githubusercontent.com/u/9096667?v=4\" width=\"66;\" alt=\"maxb2\"/>\n                    <br />\n                    <sub><b>Matthew Anderson</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/tschm\">\n                    <img src=\"https://avatars.githubusercontent.com/u/2046079?v=4\" width=\"66;\" alt=\"tschm\"/>\n                    <br />\n                    <sub><b>Thomas Schmelzer</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/MatsMoll\">\n                    <img src=\"https://avatars.githubusercontent.com/u/4439131?v=4\" width=\"66;\" alt=\"MatsMoll\"/>\n                    <br />\n                    <sub><b>Mats Eikeland Mollestad</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/rursprung\">\n                    <img src=\"https://avatars.githubusercontent.com/u/39383228?v=4\" width=\"66;\" alt=\"rursprung\"/>\n                    <br />\n                    <sub><b>Ralph Ursprung</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/albcunha\">\n                    <img src=\"https://avatars.githubusercontent.com/u/13671325?v=4\" width=\"66;\" alt=\"albcunha\"/>\n                    <br />\n                    <sub><b>Null</b></sub>\n                </a>\n            </td>\n\t\t</tr>\n\t\t<tr>\n            <td align=\"center\">\n                <a href=\"https://github.com/kotval\">\n                    <img src=\"https://avatars.githubusercontent.com/u/11917243?v=4\" width=\"66;\" alt=\"kotval\"/>\n                    <br />\n                    <sub><b>Kotval</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/messense\">\n                    <img src=\"https://avatars.githubusercontent.com/u/1556054?v=4\" width=\"66;\" alt=\"messense\"/>\n                    <br />\n                    <sub><b>Messense</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/phanindra-ramesh\">\n                    <img src=\"https://avatars.githubusercontent.com/u/16794420?v=4\" width=\"66;\" alt=\"phanindra-ramesh\"/>\n                    <br />\n                    <sub><b>Null</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/surister\">\n                    <img src=\"https://avatars.githubusercontent.com/u/37985796?v=4\" width=\"66;\" alt=\"surister\"/>\n                    <br />\n                    <sub><b>Ivan</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/venkashank\">\n                    <img src=\"https://avatars.githubusercontent.com/u/27744439?v=4\" width=\"66;\" alt=\"venkashank\"/>\n                    <br />\n                    <sub><b>Null</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/zemelLeong\">\n                    <img src=\"https://avatars.githubusercontent.com/u/26835087?v=4\" width=\"66;\" alt=\"zemelLeong\"/>\n                    <br />\n                    <sub><b>zemel leong</b></sub>\n                </a>\n            </td>\n\t\t</tr>\n\t\t<tr>\n            <td align=\"center\">\n                <a href=\"https://github.com/zzzdong\">\n                    <img src=\"https://avatars.githubusercontent.com/u/5125482?v=4\" width=\"66;\" alt=\"zzzdong\"/>\n                    <br />\n                    <sub><b>Null</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/marianoguerra\">\n                    <img src=\"https://avatars.githubusercontent.com/u/68463?v=4\" width=\"66;\" alt=\"marianoguerra\"/>\n                    <br />\n                    <sub><b>Mariano Guerra</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/kevinheavey\">\n                    <img src=\"https://avatars.githubusercontent.com/u/24635973?v=4\" width=\"66;\" alt=\"kevinheavey\"/>\n                    <br />\n                    <sub><b>Kevin Heavey</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/kayhoogland\">\n                    <img src=\"https://avatars.githubusercontent.com/u/22837350?v=4\" width=\"66;\" alt=\"kayhoogland\"/>\n                    <br />\n                    <sub><b>Kay Hoogland</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/deepsourcebot\">\n                    <img src=\"https://avatars.githubusercontent.com/u/60907429?v=4\" width=\"66;\" alt=\"deepsourcebot\"/>\n                    <br />\n                    <sub><b>DeepSource Bot</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/AndrewJackson2020\">\n                    <img src=\"https://avatars.githubusercontent.com/u/46945903?v=4\" width=\"66;\" alt=\"AndrewJackson2020\"/>\n                    <br />\n                    <sub><b>Andrew Jackson</b></sub>\n                </a>\n            </td>\n\t\t</tr>\n\t\t<tr>\n            <td align=\"center\">\n                <a href=\"https://github.com/Cabbagec\">\n                    <img src=\"https://avatars.githubusercontent.com/u/14164987?v=4\" width=\"66;\" alt=\"Cabbagec\"/>\n                    <br />\n                    <sub><b>Brandon</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/Amar1729\">\n                    <img src=\"https://avatars.githubusercontent.com/u/15623522?v=4\" width=\"66;\" alt=\"Amar1729\"/>\n                    <br />\n                    <sub><b>Amar Paul</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/aljazerzen\">\n                    <img src=\"https://avatars.githubusercontent.com/u/11072061?v=4\" width=\"66;\" alt=\"aljazerzen\"/>\n                    <br />\n                    <sub><b>Alja\u017e Mur Er\u017een</b></sub>\n                </a>\n            </td>\n            <td align=\"center\">\n                <a href=\"https://github.com/aimtsou\">\n                    <img src=\"https://avatars.githubusercontent.com/u/2598924?v=4\" width=\"66;\" alt=\"aimtsou\"/>\n                    <br />\n                    <sub><b>Aimilios Tsouvelekakis</b></sub>\n                </a>\n            </td>\n\t\t</tr>\n\t<tbody>\n</table>\n<!-- readme: contributors -end -->\n\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": null,
    "version": "0.4.0",
    "project_urls": null,
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "627fdcde38b550ea37350afc9126fd1bc3fda4c8c1a97388d4039151ae2e3bae",
                "md5": "8daaf2a465826c3b2445b357ae8f878a",
                "sha256": "447bd065feb69b63e51a8a056b1de3ccb98a48108b52987dba1b67555f01a8d8"
            },
            "downloads": -1,
            "filename": "connectorx-0.4.0-cp310-cp310-macosx_10_12_x86_64.whl",
            "has_sig": false,
            "md5_digest": "8daaf2a465826c3b2445b357ae8f878a",
            "packagetype": "bdist_wheel",
            "python_version": "cp310",
            "requires_python": ">=3.10",
            "size": 27010628,
            "upload_time": "2024-11-04T20:30:09",
            "upload_time_iso_8601": "2024-11-04T20:30:09.267754Z",
            "url": "https://files.pythonhosted.org/packages/62/7f/dcde38b550ea37350afc9126fd1bc3fda4c8c1a97388d4039151ae2e3bae/connectorx-0.4.0-cp310-cp310-macosx_10_12_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "fdf60a0a30ba8aff51bd9159d705b1d089b6df9b3677bb29389b21feada4c10f",
                "md5": "449fc1f2611da491a89f1b8a464fe558",
                "sha256": "342d233ca0008ec7cfef2ab91da566f15a1326ac2f51c87c6dd9f77dc9a6549e"
            },
            "downloads": -1,
            "filename": "connectorx-0.4.0-cp310-cp310-macosx_11_0_arm64.whl",
            "has_sig": false,
            "md5_digest": "449fc1f2611da491a89f1b8a464fe558",
            "packagetype": "bdist_wheel",
            "python_version": "cp310",
            "requires_python": ">=3.10",
            "size": 25926714,
            "upload_time": "2024-11-04T20:30:22",
            "upload_time_iso_8601": "2024-11-04T20:30:22.405442Z",
            "url": "https://files.pythonhosted.org/packages/fd/f6/0a0a30ba8aff51bd9159d705b1d089b6df9b3677bb29389b21feada4c10f/connectorx-0.4.0-cp310-cp310-macosx_11_0_arm64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "37326a9c0c5adcf9ccb9d580895e4c28ced7530a72e389618c4e419c2ed63969",
                "md5": "68865087c18b1797b96cb128cbc722b3",
                "sha256": "72103766090f81ed7f8aeba9183d7eb2f24b65de9678d74a61c16f85f89e8b81"
            },
            "downloads": -1,
            "filename": "connectorx-0.4.0-cp310-cp310-manylinux_2_28_x86_64.whl",
            "has_sig": false,
            "md5_digest": "68865087c18b1797b96cb128cbc722b3",
            "packagetype": "bdist_wheel",
            "python_version": "cp310",
            "requires_python": ">=3.10",
            "size": 32012212,
            "upload_time": "2024-11-04T20:30:34",
            "upload_time_iso_8601": "2024-11-04T20:30:34.648029Z",
            "url": "https://files.pythonhosted.org/packages/37/32/6a9c0c5adcf9ccb9d580895e4c28ced7530a72e389618c4e419c2ed63969/connectorx-0.4.0-cp310-cp310-manylinux_2_28_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "2d05764957b79ac61045cd696abf41e4b9b754fc4bb088ec417117244f960127",
                "md5": "37e381ff6d81b0ec6f33e90d7f3b29bc",
                "sha256": "63a5a4961ed43e5f33eebaa9ee0ea0bb4e3f7d0f710d48e2b51ede3bd1e2af44"
            },
            "downloads": -1,
            "filename": "connectorx-0.4.0-cp310-none-win_amd64.whl",
            "has_sig": false,
            "md5_digest": "37e381ff6d81b0ec6f33e90d7f3b29bc",
            "packagetype": "bdist_wheel",
            "python_version": "cp310",
            "requires_python": ">=3.10",
            "size": 25349244,
            "upload_time": "2024-11-04T20:30:47",
            "upload_time_iso_8601": "2024-11-04T20:30:47.276990Z",
            "url": "https://files.pythonhosted.org/packages/2d/05/764957b79ac61045cd696abf41e4b9b754fc4bb088ec417117244f960127/connectorx-0.4.0-cp310-none-win_amd64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "256cf2c4d77b5231a7fae0454b03e8c0273c3d847311d6c062ec30fab025ff70",
                "md5": "1fbe54ce62c0be28271529ba3ff3d995",
                "sha256": "fb3653c4ff1de8ada871c2ab883ed04dc2b7bb84704fcf08e6a23cf67deb931f"
            },
            "downloads": -1,
            "filename": "connectorx-0.4.0-cp311-cp311-macosx_10_12_x86_64.whl",
            "has_sig": false,
            "md5_digest": "1fbe54ce62c0be28271529ba3ff3d995",
            "packagetype": "bdist_wheel",
            "python_version": "cp311",
            "requires_python": ">=3.10",
            "size": 27011262,
            "upload_time": "2024-11-04T20:30:12",
            "upload_time_iso_8601": "2024-11-04T20:30:12.604287Z",
            "url": "https://files.pythonhosted.org/packages/25/6c/f2c4d77b5231a7fae0454b03e8c0273c3d847311d6c062ec30fab025ff70/connectorx-0.4.0-cp311-cp311-macosx_10_12_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "f06df1cfcac61302761f094814c8276513644e7fa7a8cfa03d0a30bc807d3c89",
                "md5": "95a9e8c47dc9fa327dfe5cb976367af0",
                "sha256": "224da692923f3e2f6ae5677dfd0f00ac0374e3989832ee4de029112b09da2281"
            },
            "downloads": -1,
            "filename": "connectorx-0.4.0-cp311-cp311-macosx_11_0_arm64.whl",
            "has_sig": false,
            "md5_digest": "95a9e8c47dc9fa327dfe5cb976367af0",
            "packagetype": "bdist_wheel",
            "python_version": "cp311",
            "requires_python": ">=3.10",
            "size": 25930131,
            "upload_time": "2024-11-04T20:30:25",
            "upload_time_iso_8601": "2024-11-04T20:30:25.596781Z",
            "url": "https://files.pythonhosted.org/packages/f0/6d/f1cfcac61302761f094814c8276513644e7fa7a8cfa03d0a30bc807d3c89/connectorx-0.4.0-cp311-cp311-macosx_11_0_arm64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "5f8663cbb519775f006879ef602839e3c82524f64280d502204086ef3c3f666c",
                "md5": "295cdee63de335329abbba28d0b5d25d",
                "sha256": "d9b6d1832c071201cacb810b06c7311cb605f99dead0ee47935d38086f1c9d4b"
            },
            "downloads": -1,
            "filename": "connectorx-0.4.0-cp311-cp311-manylinux_2_28_x86_64.whl",
            "has_sig": false,
            "md5_digest": "295cdee63de335329abbba28d0b5d25d",
            "packagetype": "bdist_wheel",
            "python_version": "cp311",
            "requires_python": ">=3.10",
            "size": 32012214,
            "upload_time": "2024-11-04T20:30:37",
            "upload_time_iso_8601": "2024-11-04T20:30:37.827606Z",
            "url": "https://files.pythonhosted.org/packages/5f/86/63cbb519775f006879ef602839e3c82524f64280d502204086ef3c3f666c/connectorx-0.4.0-cp311-cp311-manylinux_2_28_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "db5b137d7bbdca9e6addfa0746c7332ed71ea186f9559d2ae06618dd34416034",
                "md5": "1f1868cce7fe4847808d80b097e28bb7",
                "sha256": "31b2c02f56360c6c4034d23c107772df98c8ab6102f71242bcb9a8a0fec06512"
            },
            "downloads": -1,
            "filename": "connectorx-0.4.0-cp311-none-win_amd64.whl",
            "has_sig": false,
            "md5_digest": "1f1868cce7fe4847808d80b097e28bb7",
            "packagetype": "bdist_wheel",
            "python_version": "cp311",
            "requires_python": ">=3.10",
            "size": 25343743,
            "upload_time": "2024-11-04T20:30:50",
            "upload_time_iso_8601": "2024-11-04T20:30:50.826580Z",
            "url": "https://files.pythonhosted.org/packages/db/5b/137d7bbdca9e6addfa0746c7332ed71ea186f9559d2ae06618dd34416034/connectorx-0.4.0-cp311-none-win_amd64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "3c5b19bfbb374ba4ec8bdc9f74951352a9aab9d26ecc9459e519a57fcf940fdc",
                "md5": "4bf1af48f43f9760d22173e620dc2234",
                "sha256": "5c6bb6cc468ff77b18b71ee44b5ea7e3c72de3a08a4740040fed3361a6086659"
            },
            "downloads": -1,
            "filename": "connectorx-0.4.0-cp312-cp312-macosx_10_12_x86_64.whl",
            "has_sig": false,
            "md5_digest": "4bf1af48f43f9760d22173e620dc2234",
            "packagetype": "bdist_wheel",
            "python_version": "cp312",
            "requires_python": ">=3.10",
            "size": 27001506,
            "upload_time": "2024-11-04T20:30:15",
            "upload_time_iso_8601": "2024-11-04T20:30:15.472437Z",
            "url": "https://files.pythonhosted.org/packages/3c/5b/19bfbb374ba4ec8bdc9f74951352a9aab9d26ecc9459e519a57fcf940fdc/connectorx-0.4.0-cp312-cp312-macosx_10_12_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "0d216486b86315af8da9d510ff0d8195fc178b9aba5d2b0c0572b68288e54cef",
                "md5": "7983df63a409437a75f42282d6d701f5",
                "sha256": "42d9ae283541aca860f7082186ecb0525ff933b714e676dfe0e517e7943a9799"
            },
            "downloads": -1,
            "filename": "connectorx-0.4.0-cp312-cp312-macosx_11_0_arm64.whl",
            "has_sig": false,
            "md5_digest": "7983df63a409437a75f42282d6d701f5",
            "packagetype": "bdist_wheel",
            "python_version": "cp312",
            "requires_python": ">=3.10",
            "size": 25923458,
            "upload_time": "2024-11-04T20:30:28",
            "upload_time_iso_8601": "2024-11-04T20:30:28.587526Z",
            "url": "https://files.pythonhosted.org/packages/0d/21/6486b86315af8da9d510ff0d8195fc178b9aba5d2b0c0572b68288e54cef/connectorx-0.4.0-cp312-cp312-macosx_11_0_arm64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "d0cb93261244ab037d686b00006445dee8feb56811d63fd61a5edac8463ab4be",
                "md5": "f67d88a6d853a05078b5a572b79638ce",
                "sha256": "c3ebe1e95e4c82d69804d0165be4d4f80ff4bb1beac04d6946aa73ed04819440"
            },
            "downloads": -1,
            "filename": "connectorx-0.4.0-cp312-cp312-manylinux_2_28_x86_64.whl",
            "has_sig": false,
            "md5_digest": "f67d88a6d853a05078b5a572b79638ce",
            "packagetype": "bdist_wheel",
            "python_version": "cp312",
            "requires_python": ">=3.10",
            "size": 32018249,
            "upload_time": "2024-11-04T20:30:41",
            "upload_time_iso_8601": "2024-11-04T20:30:41.064502Z",
            "url": "https://files.pythonhosted.org/packages/d0/cb/93261244ab037d686b00006445dee8feb56811d63fd61a5edac8463ab4be/connectorx-0.4.0-cp312-cp312-manylinux_2_28_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "6cf84febd915b31343798824f2e4961b54bc354a70a7944e4c51b6925f84e6bd",
                "md5": "d4f85acf3ab3e90087ad26a507a612f6",
                "sha256": "d4c156df650860002f61155e2eff23d9c822c2e9f14e16d04e21dd1033b09cdc"
            },
            "downloads": -1,
            "filename": "connectorx-0.4.0-cp312-none-win_amd64.whl",
            "has_sig": false,
            "md5_digest": "d4f85acf3ab3e90087ad26a507a612f6",
            "packagetype": "bdist_wheel",
            "python_version": "cp312",
            "requires_python": ">=3.10",
            "size": 25350236,
            "upload_time": "2024-11-04T20:30:53",
            "upload_time_iso_8601": "2024-11-04T20:30:53.608494Z",
            "url": "https://files.pythonhosted.org/packages/6c/f8/4febd915b31343798824f2e4961b54bc354a70a7944e4c51b6925f84e6bd/connectorx-0.4.0-cp312-none-win_amd64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "370d43527ac16b096ef19ae7ffa2c4104f7d1315e965aa4f3059f28ec5fff450",
                "md5": "a9d7d646562d081306e7f6372c3c838f",
                "sha256": "b74266abb86c7d570579004d909d8b4ce5d18dab29e07c63015ea75ed0178adb"
            },
            "downloads": -1,
            "filename": "connectorx-0.4.0-cp313-cp313-macosx_10_12_x86_64.whl",
            "has_sig": false,
            "md5_digest": "a9d7d646562d081306e7f6372c3c838f",
            "packagetype": "bdist_wheel",
            "python_version": "cp313",
            "requires_python": ">=3.10",
            "size": 27002153,
            "upload_time": "2024-11-04T20:30:19",
            "upload_time_iso_8601": "2024-11-04T20:30:19.182270Z",
            "url": "https://files.pythonhosted.org/packages/37/0d/43527ac16b096ef19ae7ffa2c4104f7d1315e965aa4f3059f28ec5fff450/connectorx-0.4.0-cp313-cp313-macosx_10_12_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "8244cd4a606b5ab89592d8310bb4ad94960ad516186f455274342e3784946b74",
                "md5": "3a5201ed5405f439f52e8ef7fb4d55f8",
                "sha256": "dd80488823a174d0c73e4575b10f0c0eb86bc82cbd72e28fd2b611733308699d"
            },
            "downloads": -1,
            "filename": "connectorx-0.4.0-cp313-cp313-macosx_11_0_arm64.whl",
            "has_sig": false,
            "md5_digest": "3a5201ed5405f439f52e8ef7fb4d55f8",
            "packagetype": "bdist_wheel",
            "python_version": "cp313",
            "requires_python": ">=3.10",
            "size": 25922650,
            "upload_time": "2024-11-04T20:30:31",
            "upload_time_iso_8601": "2024-11-04T20:30:31.695217Z",
            "url": "https://files.pythonhosted.org/packages/82/44/cd4a606b5ab89592d8310bb4ad94960ad516186f455274342e3784946b74/connectorx-0.4.0-cp313-cp313-macosx_11_0_arm64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "49cfec8aeb7c69b1f8e57fddb9ea5c3f1c653402a62794b0b9be7349768d3b51",
                "md5": "8f96ed021a8eb6871898dfcb63826127",
                "sha256": "33a64fdd0b3efd32f54cce664f1022d448db5878e919e7a2f186f2af19eaa572"
            },
            "downloads": -1,
            "filename": "connectorx-0.4.0-cp313-cp313-manylinux_2_28_x86_64.whl",
            "has_sig": false,
            "md5_digest": "8f96ed021a8eb6871898dfcb63826127",
            "packagetype": "bdist_wheel",
            "python_version": "cp313",
            "requires_python": ">=3.10",
            "size": 32018346,
            "upload_time": "2024-11-04T20:30:44",
            "upload_time_iso_8601": "2024-11-04T20:30:44.099707Z",
            "url": "https://files.pythonhosted.org/packages/49/cf/ec8aeb7c69b1f8e57fddb9ea5c3f1c653402a62794b0b9be7349768d3b51/connectorx-0.4.0-cp313-cp313-manylinux_2_28_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "fde48fb9ca60a8895e873fb465ed8a893c6ee459e043f4ba12f6ba9f056f86bf",
                "md5": "195443e2d2122be71da2bd773765d3e7",
                "sha256": "635727407b0a14ff30cd02519e631766b2df55c94da2d57c7599e5a9a4ce2f4f"
            },
            "downloads": -1,
            "filename": "connectorx-0.4.0-cp313-none-win_amd64.whl",
            "has_sig": false,
            "md5_digest": "195443e2d2122be71da2bd773765d3e7",
            "packagetype": "bdist_wheel",
            "python_version": "cp313",
            "requires_python": ">=3.10",
            "size": 25349352,
            "upload_time": "2024-11-04T20:30:56",
            "upload_time_iso_8601": "2024-11-04T20:30:56.433967Z",
            "url": "https://files.pythonhosted.org/packages/fd/e4/8fb9ca60a8895e873fb465ed8a893c6ee459e043f4ba12f6ba9f056f86bf/connectorx-0.4.0-cp313-none-win_amd64.whl",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-11-04 20:30:09",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "lcname": "connectorx"
}
        
Elapsed time: 0.36165s