taskcluster-taskgraph


Nametaskcluster-taskgraph JSON
Version 14.0.0 PyPI version JSON
download
home_pageNone
SummaryBuild taskcluster taskgraphs
upload_time2025-02-19 15:38:28
maintainerNone
docs_urlNone
authorNone
requires_python>=3.8
licenseNone
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            
.. image:: https://firefox-ci-tc.services.mozilla.com/api/github/v1/repository/taskcluster/taskgraph/main/badge.svg
   :target: https://firefox-ci-tc.services.mozilla.com/api/github/v1/repository/taskcluster/taskgraph/main/latest
   :alt: Task Status

.. image:: https://results.pre-commit.ci/badge/github/taskcluster/taskgraph/main.svg
   :target: https://results.pre-commit.ci/latest/github/taskcluster/taskgraph/main
   :alt: pre-commit.ci status

.. image:: https://codecov.io/gh/taskcluster/taskgraph/branch/main/graph/badge.svg?token=GJIV52ZQNP
   :target: https://codecov.io/gh/taskcluster/taskgraph
   :alt: Code Coverage

.. image:: https://badge.fury.io/py/taskcluster-taskgraph.svg
   :target: https://badge.fury.io/py/taskcluster-taskgraph
   :alt: Pypi Version

.. image:: https://readthedocs.org/projects/taskcluster-taskgraph/badge/?version=latest
   :target: https://taskcluster-taskgraph.readthedocs.io/en/latest/?badge=latest
   :alt: Documentation Status

.. image:: https://img.shields.io/badge/license-MPL%202.0-orange.svg
   :target: http://mozilla.org/MPL/2.0
   :alt: License

Taskgraph
=========

Taskgraph is a Python library to generate graphs of tasks for the `Taskcluster
CI`_ service. It is the recommended approach for configuring tasks once your
project outgrows a single `.taskcluster.yml`_ file and is what powers the over
30,000 tasks and counting that make up Firefox's CI.

For more information and usage instructions, `see the docs`_.

How It Works
------------

Taskgraph leverages the fact that Taskcluster is a generic task execution
platform. This means that tasks can be scheduled via its `comprehensive API`_,
and aren't limited to being triggered in response to supported events.

Taskgraph leverages this execution platform to allow CI systems to scale to any
size or complexity.

1. A *decision task* is created via Taskcluster's normal `.taskcluster.yml`_
   file. This task invokes ``taskgraph``.
2. Taskgraph evaluates a series of yaml based task definitions (similar to
   those other CI offerings provide).
3. Taskgraph applies transforms on top of these task definitions. Transforms
   are Python functions that can programmatically alter or even clone a task
   definition.
4. Taskgraph applies some optional optimization logic to remove unnecessary
   tasks.
5. Taskgraph submits the resulting *task graph* to Taskcluster via its API.

Taskgraph's combination of declarative task configuration combined with
programmatic alteration are what allow it to support CI systems of any scale.
Taskgraph is the library that powers the 30,000+ tasks making up `Firefox's
CI`_.

.. _Taskcluster CI: https://taskcluster.net/
.. _comprehensive API: https://docs.taskcluster.net/docs/reference/platform/queue/api
.. _.taskcluster.yml: https://docs.taskcluster.net/docs/reference/integrations/github/taskcluster-yml-v1
.. _Firefox's CI: https://treeherder.mozilla.org/jobs?repo=mozilla-central
.. _see the docs: https://taskcluster-taskgraph.readthedocs.io

Installation
------------

Taskgraph supports Python 3.8 and up, and can be installed from Pypi:

.. code-block::

  pip install taskcluster-taskgraph


Alternatively, the repo can be cloned and installed directly:

.. code-block::

  git clone https://github.com/taskcluster/taskgraph
  cd taskgraph
  python setup.py install

In both cases, it's recommended to use a Python `virtual environment`_.

.. _virtual environment: https://docs.python.org/3/tutorial/venv.html

Get Involved
------------

If you'd like to get involved, please see our `contributing docs`_!

.. _contributing docs: https://github.com/taskcluster/taskgraph/blob/main/CONTRIBUTING.rst

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "taskcluster-taskgraph",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.8",
    "maintainer_email": null,
    "keywords": null,
    "author": null,
    "author_email": "Mozilla Release Engineering <release+taskgraph@mozilla.com>",
    "download_url": "https://files.pythonhosted.org/packages/34/ca/5d2a926b96d1cc3b9e22973a0ec6be1f6e1fb44e35f2ed6d65a0643786d0/taskcluster_taskgraph-14.0.0.tar.gz",
    "platform": null,
    "description": "\n.. image:: https://firefox-ci-tc.services.mozilla.com/api/github/v1/repository/taskcluster/taskgraph/main/badge.svg\n   :target: https://firefox-ci-tc.services.mozilla.com/api/github/v1/repository/taskcluster/taskgraph/main/latest\n   :alt: Task Status\n\n.. image:: https://results.pre-commit.ci/badge/github/taskcluster/taskgraph/main.svg\n   :target: https://results.pre-commit.ci/latest/github/taskcluster/taskgraph/main\n   :alt: pre-commit.ci status\n\n.. image:: https://codecov.io/gh/taskcluster/taskgraph/branch/main/graph/badge.svg?token=GJIV52ZQNP\n   :target: https://codecov.io/gh/taskcluster/taskgraph\n   :alt: Code Coverage\n\n.. image:: https://badge.fury.io/py/taskcluster-taskgraph.svg\n   :target: https://badge.fury.io/py/taskcluster-taskgraph\n   :alt: Pypi Version\n\n.. image:: https://readthedocs.org/projects/taskcluster-taskgraph/badge/?version=latest\n   :target: https://taskcluster-taskgraph.readthedocs.io/en/latest/?badge=latest\n   :alt: Documentation Status\n\n.. image:: https://img.shields.io/badge/license-MPL%202.0-orange.svg\n   :target: http://mozilla.org/MPL/2.0\n   :alt: License\n\nTaskgraph\n=========\n\nTaskgraph is a Python library to generate graphs of tasks for the `Taskcluster\nCI`_ service. It is the recommended approach for configuring tasks once your\nproject outgrows a single `.taskcluster.yml`_ file and is what powers the over\n30,000 tasks and counting that make up Firefox's CI.\n\nFor more information and usage instructions, `see the docs`_.\n\nHow It Works\n------------\n\nTaskgraph leverages the fact that Taskcluster is a generic task execution\nplatform. This means that tasks can be scheduled via its `comprehensive API`_,\nand aren't limited to being triggered in response to supported events.\n\nTaskgraph leverages this execution platform to allow CI systems to scale to any\nsize or complexity.\n\n1. A *decision task* is created via Taskcluster's normal `.taskcluster.yml`_\n   file. This task invokes ``taskgraph``.\n2. Taskgraph evaluates a series of yaml based task definitions (similar to\n   those other CI offerings provide).\n3. Taskgraph applies transforms on top of these task definitions. Transforms\n   are Python functions that can programmatically alter or even clone a task\n   definition.\n4. Taskgraph applies some optional optimization logic to remove unnecessary\n   tasks.\n5. Taskgraph submits the resulting *task graph* to Taskcluster via its API.\n\nTaskgraph's combination of declarative task configuration combined with\nprogrammatic alteration are what allow it to support CI systems of any scale.\nTaskgraph is the library that powers the 30,000+ tasks making up `Firefox's\nCI`_.\n\n.. _Taskcluster CI: https://taskcluster.net/\n.. _comprehensive API: https://docs.taskcluster.net/docs/reference/platform/queue/api\n.. _.taskcluster.yml: https://docs.taskcluster.net/docs/reference/integrations/github/taskcluster-yml-v1\n.. _Firefox's CI: https://treeherder.mozilla.org/jobs?repo=mozilla-central\n.. _see the docs: https://taskcluster-taskgraph.readthedocs.io\n\nInstallation\n------------\n\nTaskgraph supports Python 3.8 and up, and can be installed from Pypi:\n\n.. code-block::\n\n  pip install taskcluster-taskgraph\n\n\nAlternatively, the repo can be cloned and installed directly:\n\n.. code-block::\n\n  git clone https://github.com/taskcluster/taskgraph\n  cd taskgraph\n  python setup.py install\n\nIn both cases, it's recommended to use a Python `virtual environment`_.\n\n.. _virtual environment: https://docs.python.org/3/tutorial/venv.html\n\nGet Involved\n------------\n\nIf you'd like to get involved, please see our `contributing docs`_!\n\n.. _contributing docs: https://github.com/taskcluster/taskgraph/blob/main/CONTRIBUTING.rst\n",
    "bugtrack_url": null,
    "license": null,
    "summary": "Build taskcluster taskgraphs",
    "version": "14.0.0",
    "project_urls": {
        "Issues": "https://github.com/taskcluster/taskgraph/issues",
        "Repository": "https://github.com/taskcluster/taskgraph"
    },
    "split_keywords": [],
    "urls": [
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "7f447ffe8ad7858e09c8217a8d6b68a8c78b1032e14d8eb391c3b3fee3ee2391",
                "md5": "54498e060ba411f7b26618e8a0f18fcb",
                "sha256": "512463517429c323c1834e3164606d44bc55837e6afab56dd8d97f3abad892d2"
            },
            "downloads": -1,
            "filename": "taskcluster_taskgraph-14.0.0-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "54498e060ba411f7b26618e8a0f18fcb",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.8",
            "size": 195116,
            "upload_time": "2025-02-19T15:38:25",
            "upload_time_iso_8601": "2025-02-19T15:38:25.628585Z",
            "url": "https://files.pythonhosted.org/packages/7f/44/7ffe8ad7858e09c8217a8d6b68a8c78b1032e14d8eb391c3b3fee3ee2391/taskcluster_taskgraph-14.0.0-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "34ca5d2a926b96d1cc3b9e22973a0ec6be1f6e1fb44e35f2ed6d65a0643786d0",
                "md5": "2d48e6527cb0eb7f6179cc9718b0330a",
                "sha256": "04be28c01ea244930d25a0d0474aa8109c2d9273b74c628ab447b4356858d60f"
            },
            "downloads": -1,
            "filename": "taskcluster_taskgraph-14.0.0.tar.gz",
            "has_sig": false,
            "md5_digest": "2d48e6527cb0eb7f6179cc9718b0330a",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.8",
            "size": 410924,
            "upload_time": "2025-02-19T15:38:28",
            "upload_time_iso_8601": "2025-02-19T15:38:28.557154Z",
            "url": "https://files.pythonhosted.org/packages/34/ca/5d2a926b96d1cc3b9e22973a0ec6be1f6e1fb44e35f2ed6d65a0643786d0/taskcluster_taskgraph-14.0.0.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2025-02-19 15:38:28",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "taskcluster",
    "github_project": "taskgraph",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "taskcluster-taskgraph"
}
        
Elapsed time: 1.39055s