| Name | t1cicd JSON |
| Version |
0.1.6
JSON |
| download |
| home_page | None |
| Summary | None |
| upload_time | 2024-12-01 04:34:34 |
| maintainer | None |
| docs_url | None |
| author | Your Name |
| requires_python | <4.0,>=3.11 |
| license | None |
| keywords |
|
| VCS |
|
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
# T1-CICD
## High-Level Design
## Sequence Diagram
### Pipeline Run
### Pipeline Cancel
### Pipeline Report
## Components
| Components | README |
| :-------: | :----: |
| CLI | [Design Doc](t1cicd/cicd/cli/README.md) |
| Rest API | [Design Doc](t1cicd/cicd/api/README.md) |
| Orchestrator | [Design Doc](t1cicd/cicd/orchestrator/README.md) |
| PostgreSQL | [Design Doc](t1cicd/cicd/db/README.md) |
| Docker Server | [Design Doc](t1cicd/cicd/docker/README.md) |
### CLI
CLI provides the interface to use our CICD system. It supports users to upload a custom pipeline yaml file, to run the pipeline, cancel the pipeline and get pipeline reports.
CLI runs on user's host. CLI only communicates with RestAPI. CLI send requests and receives responses through flask apis.
### Rest API
Rest API receives CLI's request and process the data for function calls to let the orchestrator run pipelines or get reports from the database.
RestAPI can run on user's host for local run, or run on a remote server. RestAPI communicates with CLI, Orchestrator and PostgreSQL.
- For communication with CLI, RestAPI receives requests and sends requests through flask apis.
- For communication with Orchestrator, for now we implement them in one host, so RestAPI will use function calls to execute functions in Orchestrator; While RestAPI and Orchestrator can also be in different hosts, and in this case they can communicate via a message queue, and RestAPI will push the processed request from CLI to the message queue, and Orchestrator will get the processed request from the queue.
- For communication with PostgreSQL, RestAPI will GET reports from the database. We have implemented apis to call DB functions.
### Orchestrator
Orchestrator is the main part for CICD RUN. It parses user's pipeline config files, stores all processed data to the database, controls the order of running pipelines, and creates Docker containers to run jobs. For now it supports running multiple pipelines in serial. In one pipeline, stages run in serial, and jobs without dependencies run in parallel.
Orchestrator can run on user's host for local run, or run on the same remote server as Rest API, or run on another server. Orchestrator communicates with PostgreSQL and Docker Server.
- For communication with PostgreSQL, the orchestrator POST parsed pipelines and update all status to the Database.
- For communication with Docker Server, the orchestrator use Docker APIs to create and run containers.
### PostgreSQL
We use PostgreSQL for data storage.
PostgreSQL Server can run on user's host for local run, or run on a remote server.
### Docker Server
We use Docker to run containers.
Docker Server can run on user's host for local run, or run on a remote server. Docker communicates with Orchestrator that returns logs and run responses back to Orchestrator.
## Getting Started
If you want to use our CICD system, follow this [User Guide](dev-docs/client_guide.md).
<!-- (For now, all the components are deployed locally. In t1cicd package, only the CLI part can be directly used without any configuration. Users needs to setup the config of Database and run server using poetry manually. In future improvement with running on cloud, we expect users only have CLI on their end, and the server and DB will be pre-deployed on the other host.) -->
If you want to build and develop on our CICD system, follow this [Developer Guide](dev-docs/developer_guide.md).
Raw data
{
"_id": null,
"home_page": null,
"name": "t1cicd",
"maintainer": null,
"docs_url": null,
"requires_python": "<4.0,>=3.11",
"maintainer_email": null,
"keywords": null,
"author": "Your Name",
"author_email": "you@example.com",
"download_url": "https://files.pythonhosted.org/packages/43/40/73e30ec3cbdc539d5fc50275d9f3d895f6034b7432c71fc8c0da63b8f525/t1cicd-0.1.6.tar.gz",
"platform": null,
"description": "# T1-CICD\n\n## High-Level Design\n\n\n\n## Sequence Diagram\n\n### Pipeline Run\n\n\n\n### Pipeline Cancel\n\n\n\n### Pipeline Report\n\n\n\n## Components\n\n| Components | README |\n| :-------: | :----: | \n| CLI | [Design Doc](t1cicd/cicd/cli/README.md) |\n| Rest API | [Design Doc](t1cicd/cicd/api/README.md) |\n| Orchestrator | [Design Doc](t1cicd/cicd/orchestrator/README.md) | \n| PostgreSQL | [Design Doc](t1cicd/cicd/db/README.md) | \n| Docker Server | [Design Doc](t1cicd/cicd/docker/README.md) | \n\n\n### CLI\nCLI provides the interface to use our CICD system. It supports users to upload a custom pipeline yaml file, to run the pipeline, cancel the pipeline and get pipeline reports.\n\nCLI runs on user's host. CLI only communicates with RestAPI. CLI send requests and receives responses through flask apis.\n\n### Rest API\nRest API receives CLI's request and process the data for function calls to let the orchestrator run pipelines or get reports from the database.\n\nRestAPI can run on user's host for local run, or run on a remote server. RestAPI communicates with CLI, Orchestrator and PostgreSQL. \n- For communication with CLI, RestAPI receives requests and sends requests through flask apis. \n- For communication with Orchestrator, for now we implement them in one host, so RestAPI will use function calls to execute functions in Orchestrator; While RestAPI and Orchestrator can also be in different hosts, and in this case they can communicate via a message queue, and RestAPI will push the processed request from CLI to the message queue, and Orchestrator will get the processed request from the queue. \n- For communication with PostgreSQL, RestAPI will GET reports from the database. We have implemented apis to call DB functions.\n\n### Orchestrator\nOrchestrator is the main part for CICD RUN. It parses user's pipeline config files, stores all processed data to the database, controls the order of running pipelines, and creates Docker containers to run jobs. For now it supports running multiple pipelines in serial. In one pipeline, stages run in serial, and jobs without dependencies run in parallel.\n\nOrchestrator can run on user's host for local run, or run on the same remote server as Rest API, or run on another server. Orchestrator communicates with PostgreSQL and Docker Server.\n- For communication with PostgreSQL, the orchestrator POST parsed pipelines and update all status to the Database.\n- For communication with Docker Server, the orchestrator use Docker APIs to create and run containers.\n\n### PostgreSQL\nWe use PostgreSQL for data storage.\n\nPostgreSQL Server can run on user's host for local run, or run on a remote server.\n\n### Docker Server\nWe use Docker to run containers.\n\nDocker Server can run on user's host for local run, or run on a remote server. Docker communicates with Orchestrator that returns logs and run responses back to Orchestrator.\n\n## Getting Started\n\nIf you want to use our CICD system, follow this [User Guide](dev-docs/client_guide.md). \n<!-- (For now, all the components are deployed locally. In t1cicd package, only the CLI part can be directly used without any configuration. Users needs to setup the config of Database and run server using poetry manually. In future improvement with running on cloud, we expect users only have CLI on their end, and the server and DB will be pre-deployed on the other host.) -->\n\nIf you want to build and develop on our CICD system, follow this [Developer Guide](dev-docs/developer_guide.md).\n",
"bugtrack_url": null,
"license": null,
"summary": null,
"version": "0.1.6",
"project_urls": null,
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "e6357972663b4f6b7a1abd094dd5a8f1dd6394f4387b8c54b4301d4a7df3d330",
"md5": "d450e66d113d3c56b3444a7a812277c1",
"sha256": "13a47a1b5c391c54dc241ea47c591819e2cefd46d5e6a8a2d381a0f9847672d0"
},
"downloads": -1,
"filename": "t1cicd-0.1.6-py3-none-any.whl",
"has_sig": false,
"md5_digest": "d450e66d113d3c56b3444a7a812277c1",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": "<4.0,>=3.11",
"size": 66814,
"upload_time": "2024-12-01T04:34:30",
"upload_time_iso_8601": "2024-12-01T04:34:30.421966Z",
"url": "https://files.pythonhosted.org/packages/e6/35/7972663b4f6b7a1abd094dd5a8f1dd6394f4387b8c54b4301d4a7df3d330/t1cicd-0.1.6-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "434073e30ec3cbdc539d5fc50275d9f3d895f6034b7432c71fc8c0da63b8f525",
"md5": "94fe17cd5c2fe59fa6f6c46536f1b549",
"sha256": "33dda060bd18a177d7ebcc2f41929b546e0325ad0e59ee0a4f1f59be7a469383"
},
"downloads": -1,
"filename": "t1cicd-0.1.6.tar.gz",
"has_sig": false,
"md5_digest": "94fe17cd5c2fe59fa6f6c46536f1b549",
"packagetype": "sdist",
"python_version": "source",
"requires_python": "<4.0,>=3.11",
"size": 46632,
"upload_time": "2024-12-01T04:34:34",
"upload_time_iso_8601": "2024-12-01T04:34:34.886676Z",
"url": "https://files.pythonhosted.org/packages/43/40/73e30ec3cbdc539d5fc50275d9f3d895f6034b7432c71fc8c0da63b8f525/t1cicd-0.1.6.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-12-01 04:34:34",
"github": false,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"lcname": "t1cicd"
}
