apache-airflow-providers-huawei


Nameapache-airflow-providers-huawei JSON
Version 1.7.0 PyPI version JSON
download
home_pagehttps://airflow.apache.org/
SummaryProvider for Apache Airflow. Implements apache-airflow-providers-huawei package
upload_time2024-03-07 12:16:31
maintainer
docs_urlNone
authorApache Software Foundation
requires_python~=3.7
licenseApache License 2.0
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            
.. Licensed to the Apache Software Foundation (ASF) under one
   or more contributor license agreements.  See the NOTICE file
   distributed with this work for additional information
   regarding copyright ownership.  The ASF licenses this file
   to you under the Apache License, Version 2.0 (the
   "License"); you may not use this file except in compliance
   with the License.  You may obtain a copy of the License at

..   http://www.apache.org/licenses/LICENSE-2.0

.. Unless required by applicable law or agreed to in writing,
   software distributed under the License is distributed on an
   "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
   KIND, either express or implied.  See the License for the
   specific language governing permissions and limitations
   under the License.


Package ``apache-airflow-providers-huawei``

Release: ``1.7.0``


Huawei Cloud integration (including `Huawei Cloud <https://www.huaweicloud.com/intl/en-us/>`__).


Provider package
----------------

This is a provider package for ``huawei`` provider. All classes for this provider package
are in ``airflow.providers.huawei`` python package.

You can find package information and changelog for the provider
in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-huawei/1.7.0/>`_.


Installation
------------

You can install this package on top of an existing Airflow 2 installation (see ``Requirements`` below
for the minimum Airflow version supported) via
``pip install apache-airflow-providers-huawei``

The package supports the following python versions: 3.7,3.8,3.9,3.10

Requirements
------------

======================  ==================
PIP package             Version required
======================  ==================
``apache-airflow``      ``>=2.5.0``
``psycopg2``            ``>=2.9.4``
``huaweicloudsdkcore``  ``>=3.1.78``
``esdk-obs-python``     ``>=3.22.2``
``huaweicloudsdkdws``   ``>=3.1.21``
``huaweicloudsdksmn``   ``>=3.1.19``
``huaweicloudsdkdli``   ``==3.1.67``
``huaweicloudsdkcdm``   ``>=3.1.78``
``huaweicloudsdkdlf``   ``>=3.1.19``
``huaweicloudsdkiam``   ``>=3.1.19``
``huaweicloudsdkmrs``   ``>=3.1.58``
======================  ==================

Cross provider package dependencies
-----------------------------------

Those are dependencies that might be needed in order to use all the features of the package.
You need to install the specified provider packages in order to use them.

You can install such cross-provider dependencies when installing from PyPI. For example:

.. code-block:: bash

    pip install apache-airflow-providers-huawei[common.sql]


============================================================================================================  ==============
Dependent package                                                                                             Extra
============================================================================================================  ==============
`apache-airflow-providers-common-sql <https://airflow.apache.org/docs/apache-airflow-providers-common-sql>`_  ``common.sql``
============================================================================================================  ==============

 .. Licensed to the Apache Software Foundation (ASF) under one
    or more contributor license agreements.  See the NOTICE file
    distributed with this work for additional information
    regarding copyright ownership.  The ASF licenses this file
    to you under the Apache License, Version 2.0 (the
    "License"); you may not use this file except in compliance
    with the License.  You may obtain a copy of the License at

 ..   http://www.apache.org/licenses/LICENSE-2.0

 .. Unless required by applicable law or agreed to in writing,
    software distributed under the License is distributed on an
    "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
    KIND, either express or implied.  See the License for the
    specific language governing permissions and limitations
    under the License.


.. NOTE TO CONTRIBUTORS:
   Please, only add notes to the Changelog just below the "Changelog" header when there are some breaking changes
   and you want to add an explanation to the users on how they are supposed to deal with them.
   The changelog is updated and maintained semi-automatically by release manager.

Changelog
---------
1.7.0
.....

Features
~~~~~~~~~
* ``Adjust utils directory structure(!63)``
* ``Add ModerArts Integration(!61)``

1.6.0
.....

Features
~~~~~~~~~
* ``Add Huawei Cloud DWS test cases and example dags and document(!57)``
* ``Fix return type of get_conn of DWSSqlHook(!56)``
* ``Add DWSExecuteQueryOperator and fix DWSSqlHook and DWSClusterSensor(!55)``
* ``Add Huawei Cloud DLI example dags and documents(!54)``
* ``Add test cases for new features in DLI(!53)``
* ``Add new operators, sensors and methods for hooks about DLI(!52)``

1.5.1
.....

Features
~~~~~~~~~
* ``Add template field "variables" for CDMStartJobOperator(!50)``

1.5.0
.....

Features
~~~~~~~~~
* ``Fix docs(!47)``
* ``Add example code for CDMStartJobOperator and supplementary document(!45)``
* ``Add parameter "variables" for CDMStartJobOperator(!44)``

1.4.0
.....

Features
~~~~~~~~~

* ``Add DLIShowElasticResourcePoolStatusSensor (!42)``
* ``Add Huawei Cloud DLI document for new operators (!38)``
* ``Add Huawei Cloud DLI example dags (!37)``
* ``Add test cases for new features in DLI (!36)``
* ``Add new operators, trigger and methods for hooks about DLI (!35)``

1.3.0
.....

Features
~~~~~~~~~

* ``Add deferred mode for MRSCreateClusterOperator (!33)``
* ``Fix stop_job function of MRSHook !(32)``
* ``Add and fix document for MRS and DLI (!30)``
* ``Add test system sample code for MRS (!29)``
* ``Add MRSCreateExecuteJobOperator with deferrable mode and add MRSShowJobResultSensor (!27)``
* ``Add test cases for MRS (!28)``

1.2.0
.....

Features
~~~~~~~~~

* ``Fix docstring (!25)``
* ``Add warning according to the DLI product Bulletin (!25)``
* ``Add deferrable mode to DLISparkCreateBatchJobOperator and DLIRunSqlJobOperator (!25)``
* ``The python sdk version of dli is changed from 3.1.66 to 3.1.67 (!25)``

1.1.0
.....

Features
~~~~~~~~~

* ``Add Huawei Cloud MRS hook,operators, and sensors (!19)``
* ``Add Huawei Cloud MRS test and example dags (!19)``
* ``Add "tags" to template_fields for SMNPublishMessageTemplateOperator (!19)``
* ``Fix the method docstring for create_cluster method of DWSHook (!19)``
* ``Fix example mrs dags (!19)``
* ``Add MRS docs and modify other docs (!19)``
* ``Add MRS dependencies (!19)``

1.0.3
.....

Bug Fixes
~~~~~~~~~

* ``Fix the DLISparkCreateBatchJobOperator parameter (!17)``

1.0.2
.....

Bug Fixes
~~~~~~~~~

* ``Fix the Connections extra param obs-bucket (!15)``

1.0.1
.....

Bug Fixes
~~~~~~~~~

* ``Fix mistakenly added install_requires for provider (!12)``

1.0.0
.....

Initial version of the provider.

            

Raw data

            {
    "_id": null,
    "home_page": "https://airflow.apache.org/",
    "name": "apache-airflow-providers-huawei",
    "maintainer": "",
    "docs_url": null,
    "requires_python": "~=3.7",
    "maintainer_email": "",
    "keywords": "",
    "author": "Apache Software Foundation",
    "author_email": "dev@airflow.apache.org",
    "download_url": "https://files.pythonhosted.org/packages/d0/aa/43b515afe0bd7cbb60377a07fa3a89f676fd13fc2d0d7af90cfcb06b48d4/apache-airflow-providers-huawei-1.7.0.tar.gz",
    "platform": null,
    "description": "\n.. Licensed to the Apache Software Foundation (ASF) under one\n   or more contributor license agreements.  See the NOTICE file\n   distributed with this work for additional information\n   regarding copyright ownership.  The ASF licenses this file\n   to you under the Apache License, Version 2.0 (the\n   \"License\"); you may not use this file except in compliance\n   with the License.  You may obtain a copy of the License at\n\n..   http://www.apache.org/licenses/LICENSE-2.0\n\n.. Unless required by applicable law or agreed to in writing,\n   software distributed under the License is distributed on an\n   \"AS IS\" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY\n   KIND, either express or implied.  See the License for the\n   specific language governing permissions and limitations\n   under the License.\n\n\nPackage ``apache-airflow-providers-huawei``\n\nRelease: ``1.7.0``\n\n\nHuawei Cloud integration (including `Huawei Cloud <https://www.huaweicloud.com/intl/en-us/>`__).\n\n\nProvider package\n----------------\n\nThis is a provider package for ``huawei`` provider. All classes for this provider package\nare in ``airflow.providers.huawei`` python package.\n\nYou can find package information and changelog for the provider\nin the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-huawei/1.7.0/>`_.\n\n\nInstallation\n------------\n\nYou can install this package on top of an existing Airflow 2 installation (see ``Requirements`` below\nfor the minimum Airflow version supported) via\n``pip install apache-airflow-providers-huawei``\n\nThe package supports the following python versions: 3.7,3.8,3.9,3.10\n\nRequirements\n------------\n\n======================  ==================\nPIP package             Version required\n======================  ==================\n``apache-airflow``      ``>=2.5.0``\n``psycopg2``            ``>=2.9.4``\n``huaweicloudsdkcore``  ``>=3.1.78``\n``esdk-obs-python``     ``>=3.22.2``\n``huaweicloudsdkdws``   ``>=3.1.21``\n``huaweicloudsdksmn``   ``>=3.1.19``\n``huaweicloudsdkdli``   ``==3.1.67``\n``huaweicloudsdkcdm``   ``>=3.1.78``\n``huaweicloudsdkdlf``   ``>=3.1.19``\n``huaweicloudsdkiam``   ``>=3.1.19``\n``huaweicloudsdkmrs``   ``>=3.1.58``\n======================  ==================\n\nCross provider package dependencies\n-----------------------------------\n\nThose are dependencies that might be needed in order to use all the features of the package.\nYou need to install the specified provider packages in order to use them.\n\nYou can install such cross-provider dependencies when installing from PyPI. For example:\n\n.. code-block:: bash\n\n    pip install apache-airflow-providers-huawei[common.sql]\n\n\n============================================================================================================  ==============\nDependent package                                                                                             Extra\n============================================================================================================  ==============\n`apache-airflow-providers-common-sql <https://airflow.apache.org/docs/apache-airflow-providers-common-sql>`_  ``common.sql``\n============================================================================================================  ==============\n\n .. Licensed to the Apache Software Foundation (ASF) under one\n    or more contributor license agreements.  See the NOTICE file\n    distributed with this work for additional information\n    regarding copyright ownership.  The ASF licenses this file\n    to you under the Apache License, Version 2.0 (the\n    \"License\"); you may not use this file except in compliance\n    with the License.  You may obtain a copy of the License at\n\n ..   http://www.apache.org/licenses/LICENSE-2.0\n\n .. Unless required by applicable law or agreed to in writing,\n    software distributed under the License is distributed on an\n    \"AS IS\" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY\n    KIND, either express or implied.  See the License for the\n    specific language governing permissions and limitations\n    under the License.\n\n\n.. NOTE TO CONTRIBUTORS:\n   Please, only add notes to the Changelog just below the \"Changelog\" header when there are some breaking changes\n   and you want to add an explanation to the users on how they are supposed to deal with them.\n   The changelog is updated and maintained semi-automatically by release manager.\n\nChangelog\n---------\n1.7.0\n.....\n\nFeatures\n~~~~~~~~~\n* ``Adjust utils directory structure(!63)``\n* ``Add ModerArts Integration(!61)``\n\n1.6.0\n.....\n\nFeatures\n~~~~~~~~~\n* ``Add Huawei Cloud DWS test cases and example dags and document(!57)``\n* ``Fix return type of get_conn of DWSSqlHook(!56)``\n* ``Add DWSExecuteQueryOperator and fix DWSSqlHook and DWSClusterSensor(!55)``\n* ``Add Huawei Cloud DLI example dags and documents(!54)``\n* ``Add test cases for new features in DLI(!53)``\n* ``Add new operators, sensors and methods for hooks about DLI(!52)``\n\n1.5.1\n.....\n\nFeatures\n~~~~~~~~~\n* ``Add template field \"variables\" for CDMStartJobOperator(!50)``\n\n1.5.0\n.....\n\nFeatures\n~~~~~~~~~\n* ``Fix docs(!47)``\n* ``Add example code for CDMStartJobOperator and supplementary document(!45)``\n* ``Add parameter \"variables\" for CDMStartJobOperator(!44)``\n\n1.4.0\n.....\n\nFeatures\n~~~~~~~~~\n\n* ``Add DLIShowElasticResourcePoolStatusSensor (!42)``\n* ``Add Huawei Cloud DLI document for new operators (!38)``\n* ``Add Huawei Cloud DLI example dags (!37)``\n* ``Add test cases for new features in DLI (!36)``\n* ``Add new operators, trigger and methods for hooks about DLI (!35)``\n\n1.3.0\n.....\n\nFeatures\n~~~~~~~~~\n\n* ``Add deferred mode for MRSCreateClusterOperator (!33)``\n* ``Fix stop_job function of MRSHook !(32)``\n* ``Add and fix document for MRS and DLI (!30)``\n* ``Add test system sample code for MRS (!29)``\n* ``Add MRSCreateExecuteJobOperator with deferrable mode and add MRSShowJobResultSensor (!27)``\n* ``Add test cases for MRS (!28)``\n\n1.2.0\n.....\n\nFeatures\n~~~~~~~~~\n\n* ``Fix docstring (!25)``\n* ``Add warning according to the DLI product Bulletin (!25)``\n* ``Add deferrable mode to DLISparkCreateBatchJobOperator and DLIRunSqlJobOperator (!25)``\n* ``The python sdk version of dli is changed from 3.1.66 to 3.1.67 (!25)``\n\n1.1.0\n.....\n\nFeatures\n~~~~~~~~~\n\n* ``Add Huawei Cloud MRS hook,operators, and sensors (!19)``\n* ``Add Huawei Cloud MRS test and example dags (!19)``\n* ``Add \"tags\" to template_fields for SMNPublishMessageTemplateOperator (!19)``\n* ``Fix the method docstring for create_cluster method of DWSHook (!19)``\n* ``Fix example mrs dags (!19)``\n* ``Add MRS docs and modify other docs (!19)``\n* ``Add MRS dependencies (!19)``\n\n1.0.3\n.....\n\nBug Fixes\n~~~~~~~~~\n\n* ``Fix the DLISparkCreateBatchJobOperator parameter (!17)``\n\n1.0.2\n.....\n\nBug Fixes\n~~~~~~~~~\n\n* ``Fix the Connections extra param obs-bucket (!15)``\n\n1.0.1\n.....\n\nBug Fixes\n~~~~~~~~~\n\n* ``Fix mistakenly added install_requires for provider (!12)``\n\n1.0.0\n.....\n\nInitial version of the provider.\n",
    "bugtrack_url": null,
    "license": "Apache License 2.0",
    "summary": "Provider for Apache Airflow. Implements apache-airflow-providers-huawei package",
    "version": "1.7.0",
    "project_urls": {
        "Bug Tracker": "https://github.com/apache/airflow/issues",
        "Documentation": "https://airflow.apache.org/docs/apache-airflow-providers-huawei/1.7.0/",
        "Download": "https://archive.apache.org/dist/airflow/providers",
        "Homepage": "https://airflow.apache.org/",
        "Slack Chat": "https://s.apache.org/airflow-slack",
        "Source Code": "https://github.com/apache/airflow",
        "Twitter": "https://twitter.com/ApacheAirflow",
        "YouTube": "https://www.youtube.com/channel/UCSXwxpWZQ7XZ1WL3wqevChA/"
    },
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "a9545ecb2860a1dfdde2b0d19094bca74077cb2c702214587d4aa14cb215d0e9",
                "md5": "07b7c8abcc4d3fadf9fbd860a486be1a",
                "sha256": "26ce40f46f166c9c31d4a8ae3fff732bec2ac3abd6bb79eca6792f37d85d076b"
            },
            "downloads": -1,
            "filename": "apache_airflow_providers_huawei-1.7.0-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "07b7c8abcc4d3fadf9fbd860a486be1a",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": "~=3.7",
            "size": 101067,
            "upload_time": "2024-03-07T12:16:28",
            "upload_time_iso_8601": "2024-03-07T12:16:28.318044Z",
            "url": "https://files.pythonhosted.org/packages/a9/54/5ecb2860a1dfdde2b0d19094bca74077cb2c702214587d4aa14cb215d0e9/apache_airflow_providers_huawei-1.7.0-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "d0aa43b515afe0bd7cbb60377a07fa3a89f676fd13fc2d0d7af90cfcb06b48d4",
                "md5": "cc904aa52c92e356b3921b37bbe01ab7",
                "sha256": "484d2d5cd618c2fff1091315f58d3843b2dc39f4e86d327c384674c9d5d85a59"
            },
            "downloads": -1,
            "filename": "apache-airflow-providers-huawei-1.7.0.tar.gz",
            "has_sig": false,
            "md5_digest": "cc904aa52c92e356b3921b37bbe01ab7",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": "~=3.7",
            "size": 75682,
            "upload_time": "2024-03-07T12:16:31",
            "upload_time_iso_8601": "2024-03-07T12:16:31.442058Z",
            "url": "https://files.pythonhosted.org/packages/d0/aa/43b515afe0bd7cbb60377a07fa3a89f676fd13fc2d0d7af90cfcb06b48d4/apache-airflow-providers-huawei-1.7.0.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-03-07 12:16:31",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "apache",
    "github_project": "airflow",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "apache-airflow-providers-huawei"
}
        
Elapsed time: 0.23388s