BigQuery DataFrames (BigFrames)
===============================
|GA| |pypi| |versions|
BigQuery DataFrames (also known as BigFrames) provides a Pythonic DataFrame
and machine learning (ML) API powered by the BigQuery engine.
* `bigframes.pandas` provides a pandas API for analytics. Many workloads can be
migrated from pandas to bigframes by just changing a few imports.
* ``bigframes.ml`` provides a scikit-learn-like API for ML.
BigQuery DataFrames is an open-source package.
**Version 2.0 introduces breaking changes for improved security and performance. See below for details.**
Getting started with BigQuery DataFrames
----------------------------------------
The easiest way to get started is to try the
`BigFrames quickstart <https://cloud.google.com/bigquery/docs/dataframes-quickstart>`_
in a `notebook in BigQuery Studio <https://cloud.google.com/bigquery/docs/notebooks-introduction>`_.
To use BigFrames in your local development environment,
1. Run ``pip install --upgrade bigframes`` to install the latest version.
2. Setup `Application default credentials <https://cloud.google.com/docs/authentication/set-up-adc-local-dev-environment>`_
for your local development environment enviroment.
3. Create a `GCP project with the BigQuery API enabled <https://cloud.google.com/bigquery/docs/sandbox>`_.
4. Use the ``bigframes`` package to query data.
.. code-block:: python
import bigframes.pandas as bpd
bpd.options.bigquery.project = your_gcp_project_id
df = bpd.read_gbq("bigquery-public-data.usa_names.usa_1910_2013")
print(
df.groupby("name")
.agg({"number": "sum"})
.sort_values("number", ascending=False)
.head(10)
.to_pandas()
)
Documentation
-------------
To learn more about BigQuery DataFrames, visit these pages
* `Introduction to BigQuery DataFrames (BigFrames) <https://cloud.google.com/bigquery/docs/bigquery-dataframes-introduction>`_
* `Sample notebooks <https://github.com/googleapis/python-bigquery-dataframes/tree/main/notebooks>`_
* `API reference <https://cloud.google.com/python/docs/reference/bigframes/latest/summary_overview>`_
* `Source code (GitHub) <https://github.com/googleapis/python-bigquery-dataframes>`_
⚠️ Warning: Breaking Changes in BigQuery DataFrames v2.0
--------------------------------------------------------
Version 2.0 introduces breaking changes for improved security and performance. Key default behaviors have changed, including
* **Large Results (>10GB):** The default value for ``allow_large_results`` has changed to ``False``.
Methods like ``to_pandas()`` will now fail if the query result's compressed data size exceeds 10GB,
unless large results are explicitly permitted.
* **Remote Function Security:** The library no longer automatically lets the Compute Engine default service
account become the identity of the Cloud Run functions. If that is desired, it has to be indicated by passing
``cloud_function_service_account="default"``. And network ingress now defaults to ``"internal-only"``.
* **@remote_function Argument Passing:** Arguments other than ``input_types``, ``output_type``, and ``dataset``
to ``remote_function`` must now be passed using keyword syntax, as positional arguments are no longer supported.
* **@udf Argument Passing:** Arguments ``dataset`` and ``name`` to ``udf`` are now mandatory.
* **Endpoint Connections:** Automatic fallback to locational endpoints in certain regions is removed.
* **LLM Updates (Gemini Integration):** Integrations now default to the ``gemini-2.0-flash-001`` model.
PaLM2 support has been removed; please migrate any existing PaLM2 usage to Gemini. **Note:** The current default
model will be removed in Version 3.0.
**Important:** If you are not ready to adapt to these changes, please pin your dependency to a version less than 2.0
(e.g., ``bigframes==1.42.0``) to avoid disruption.
To learn about these changes and how to migrate to version 2.0, see the
`updated introduction guide <https://cloud.google.com/bigquery/docs/bigquery-dataframes-introduction>`_.
.. |GA| image:: https://img.shields.io/badge/support-GA-gold.svg
:target: https://github.com/googleapis/google-cloud-python/blob/main/README.rst#general-availability
.. |pypi| image:: https://img.shields.io/pypi/v/bigframes.svg
:target: https://pypi.org/project/bigframes/
.. |versions| image:: https://img.shields.io/pypi/pyversions/bigframes.svg
:target: https://pypi.org/project/bigframes/
License
-------
BigQuery DataFrames is distributed with the `Apache-2.0 license
<https://github.com/googleapis/python-bigquery-dataframes/blob/main/LICENSE>`_.
It also contains code derived from the following third-party packages:
* `Ibis <https://ibis-project.org/>`_
* `pandas <https://pandas.pydata.org/>`_
* `Python <https://www.python.org/>`_
* `scikit-learn <https://scikit-learn.org/>`_
* `XGBoost <https://xgboost.readthedocs.io/en/stable/>`_
For details, see the `third_party
<https://github.com/googleapis/python-bigquery-dataframes/tree/main/third_party/bigframes_vendored>`_
directory.
Contact Us
----------
For further help and provide feedback, you can email us at `bigframes-feedback@google.com <https://mail.google.com/mail/?view=cm&fs=1&tf=1&to=bigframes-feedback@google.com>`_.
Raw data
{
"_id": null,
"home_page": "https://github.com/googleapis/python-bigquery-dataframes",
"name": "bigframes",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.9",
"maintainer_email": null,
"keywords": null,
"author": "Google LLC",
"author_email": "bigframes-feedback@google.com",
"download_url": "https://files.pythonhosted.org/packages/6e/88/f1588cd38ae366df234067703d8b98622d224949696f0e1e92ed8ca36c22/bigframes-2.13.0.tar.gz",
"platform": "Posix; MacOS X; Windows",
"description": "BigQuery DataFrames (BigFrames)\n===============================\n\n|GA| |pypi| |versions|\n\nBigQuery DataFrames (also known as BigFrames) provides a Pythonic DataFrame\nand machine learning (ML) API powered by the BigQuery engine.\n\n* `bigframes.pandas` provides a pandas API for analytics. Many workloads can be\n migrated from pandas to bigframes by just changing a few imports.\n* ``bigframes.ml`` provides a scikit-learn-like API for ML.\n\nBigQuery DataFrames is an open-source package.\n\n**Version 2.0 introduces breaking changes for improved security and performance. See below for details.**\n\nGetting started with BigQuery DataFrames\n----------------------------------------\n\nThe easiest way to get started is to try the\n`BigFrames quickstart <https://cloud.google.com/bigquery/docs/dataframes-quickstart>`_\nin a `notebook in BigQuery Studio <https://cloud.google.com/bigquery/docs/notebooks-introduction>`_.\n\nTo use BigFrames in your local development environment,\n\n1. Run ``pip install --upgrade bigframes`` to install the latest version.\n\n2. Setup `Application default credentials <https://cloud.google.com/docs/authentication/set-up-adc-local-dev-environment>`_\n for your local development environment enviroment.\n\n3. Create a `GCP project with the BigQuery API enabled <https://cloud.google.com/bigquery/docs/sandbox>`_.\n\n4. Use the ``bigframes`` package to query data.\n\n.. code-block:: python\n\n import bigframes.pandas as bpd\n\n bpd.options.bigquery.project = your_gcp_project_id\n df = bpd.read_gbq(\"bigquery-public-data.usa_names.usa_1910_2013\")\n print(\n df.groupby(\"name\")\n .agg({\"number\": \"sum\"})\n .sort_values(\"number\", ascending=False)\n .head(10)\n .to_pandas()\n )\n\n\nDocumentation\n-------------\n\nTo learn more about BigQuery DataFrames, visit these pages\n\n* `Introduction to BigQuery DataFrames (BigFrames) <https://cloud.google.com/bigquery/docs/bigquery-dataframes-introduction>`_\n* `Sample notebooks <https://github.com/googleapis/python-bigquery-dataframes/tree/main/notebooks>`_\n* `API reference <https://cloud.google.com/python/docs/reference/bigframes/latest/summary_overview>`_\n* `Source code (GitHub) <https://github.com/googleapis/python-bigquery-dataframes>`_\n\n\u26a0\ufe0f Warning: Breaking Changes in BigQuery DataFrames v2.0\n--------------------------------------------------------\n\nVersion 2.0 introduces breaking changes for improved security and performance. Key default behaviors have changed, including\n\n* **Large Results (>10GB):** The default value for ``allow_large_results`` has changed to ``False``.\n Methods like ``to_pandas()`` will now fail if the query result's compressed data size exceeds 10GB,\n unless large results are explicitly permitted.\n* **Remote Function Security:** The library no longer automatically lets the Compute Engine default service\n account become the identity of the Cloud Run functions. If that is desired, it has to be indicated by passing\n ``cloud_function_service_account=\"default\"``. And network ingress now defaults to ``\"internal-only\"``.\n* **@remote_function Argument Passing:** Arguments other than ``input_types``, ``output_type``, and ``dataset``\n to ``remote_function`` must now be passed using keyword syntax, as positional arguments are no longer supported.\n* **@udf Argument Passing:** Arguments ``dataset`` and ``name`` to ``udf`` are now mandatory.\n* **Endpoint Connections:** Automatic fallback to locational endpoints in certain regions is removed.\n* **LLM Updates (Gemini Integration):** Integrations now default to the ``gemini-2.0-flash-001`` model.\n PaLM2 support has been removed; please migrate any existing PaLM2 usage to Gemini. **Note:** The current default\n model will be removed in Version 3.0.\n\n**Important:** If you are not ready to adapt to these changes, please pin your dependency to a version less than 2.0\n(e.g., ``bigframes==1.42.0``) to avoid disruption.\n\nTo learn about these changes and how to migrate to version 2.0, see the\n`updated introduction guide <https://cloud.google.com/bigquery/docs/bigquery-dataframes-introduction>`_.\n\n.. |GA| image:: https://img.shields.io/badge/support-GA-gold.svg\n :target: https://github.com/googleapis/google-cloud-python/blob/main/README.rst#general-availability\n.. |pypi| image:: https://img.shields.io/pypi/v/bigframes.svg\n :target: https://pypi.org/project/bigframes/\n.. |versions| image:: https://img.shields.io/pypi/pyversions/bigframes.svg\n :target: https://pypi.org/project/bigframes/\n\nLicense\n-------\n\nBigQuery DataFrames is distributed with the `Apache-2.0 license\n<https://github.com/googleapis/python-bigquery-dataframes/blob/main/LICENSE>`_.\n\nIt also contains code derived from the following third-party packages:\n\n* `Ibis <https://ibis-project.org/>`_\n* `pandas <https://pandas.pydata.org/>`_\n* `Python <https://www.python.org/>`_\n* `scikit-learn <https://scikit-learn.org/>`_\n* `XGBoost <https://xgboost.readthedocs.io/en/stable/>`_\n\nFor details, see the `third_party\n<https://github.com/googleapis/python-bigquery-dataframes/tree/main/third_party/bigframes_vendored>`_\ndirectory.\n\n\nContact Us\n----------\n\nFor further help and provide feedback, you can email us at `bigframes-feedback@google.com <https://mail.google.com/mail/?view=cm&fs=1&tf=1&to=bigframes-feedback@google.com>`_.\n",
"bugtrack_url": null,
"license": "Apache 2.0",
"summary": "BigQuery DataFrames -- scalable analytics and machine learning with BigQuery",
"version": "2.13.0",
"project_urls": {
"Homepage": "https://github.com/googleapis/python-bigquery-dataframes"
},
"split_keywords": [],
"urls": [
{
"comment_text": null,
"digests": {
"blake2b_256": "aa17a2fb31419811ef001058933bddba20f7601213aa320339d4bdcb4b4ecb15",
"md5": "0e92f78aa6b8ee1cd58a931707b249f0",
"sha256": "91f9f5131e0d7c71acb7c8fae679edb09ad12ac01b0b3d61c1df6d2cc11c1f98"
},
"downloads": -1,
"filename": "bigframes-2.13.0-py2.py3-none-any.whl",
"has_sig": false,
"md5_digest": "0e92f78aa6b8ee1cd58a931707b249f0",
"packagetype": "bdist_wheel",
"python_version": "py2.py3",
"requires_python": ">=3.9",
"size": 1345227,
"upload_time": "2025-07-28T21:40:15",
"upload_time_iso_8601": "2025-07-28T21:40:15.177773Z",
"url": "https://files.pythonhosted.org/packages/aa/17/a2fb31419811ef001058933bddba20f7601213aa320339d4bdcb4b4ecb15/bigframes-2.13.0-py2.py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "6e88f1588cd38ae366df234067703d8b98622d224949696f0e1e92ed8ca36c22",
"md5": "02abb9a1e18543c7a1207b3a871225d7",
"sha256": "1c216b85931fe6b5f6b41d9ecda4facaca193d5d851d3b1353e6459a9ef92e2f"
},
"downloads": -1,
"filename": "bigframes-2.13.0.tar.gz",
"has_sig": false,
"md5_digest": "02abb9a1e18543c7a1207b3a871225d7",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.9",
"size": 2319032,
"upload_time": "2025-07-28T21:40:17",
"upload_time_iso_8601": "2025-07-28T21:40:17.551969Z",
"url": "https://files.pythonhosted.org/packages/6e/88/f1588cd38ae366df234067703d8b98622d224949696f0e1e92ed8ca36c22/bigframes-2.13.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2025-07-28 21:40:17",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "googleapis",
"github_project": "python-bigquery-dataframes",
"travis_ci": false,
"coveralls": true,
"github_actions": true,
"lcname": "bigframes"
}
JSON
