aws-prototyping-sdk.pipeline


Nameaws-prototyping-sdk.pipeline JSON
Version 0.19.68 PyPI version JSON
download
home_pagehttps://github.com/aws/aws-prototyping-sdk
Summary@aws-prototyping-sdk/pipeline
upload_time2023-08-24 23:17:21
maintainer
docs_urlNone
authorAWS APJ COPE<apj-cope@amazon.com>
requires_python~=3.7
licenseApache-2.0
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            > **BREAKING CHANGES** (pre-release)
>
> * `> v0.16.1`: Refactored PDKPipeline to now be a construct so accessing CodePipeline methods now requires accessing a public codePipeline property i.e: `pdkPipeline.codePipeline.XXX`

The pipeline module vends an extension to CDK's CodePipeline construct, named PDKPipeline. It additionally creates a CodeCommit repository and by default is configured to build the project assumming nx-monorepo is being used (although this can be changed). A Sonarqube Scanner can also be configured to trigger a scan whenever the synth build job completes successfully. This Scanner is non-blocking and as such is not instrumented as part of the pipeline.

The architecture for the PDKPipeline is as follows:

```
CodeCommit repository -> CodePipeline
                             |-> EventBridge Rule (On Build Succeded) -> CodeBuild (Sonar Scan)
                             |-> Secret (sonarqube token)
```

This module additionally vends multiple Projen Projects, one for each of the supported languages. These projects aim to bootstrap your project by providing sample code which uses the PDKPipeline construct.

For example, in .projenrc.ts:

```python
new PDKPipelineTsProject({
  cdkVersion: "2.1.0",
  defaultReleaseBranch: "mainline",
  devDeps: ["aws-prototyping-sdk"],
  name: "my-pipeline",
});
```

This will generate a package in typescript containing CDK boilerplate for a pipeline stack (which instantiates PDKPipeline), sets up a Dev stage with an Application Stage containing an empty ApplicationStack (to be implemented). Once this package is synthesized, you can run `npx projen` and projen will synthesize your cloudformation.

Alternatively, you can initialize a project using the cli (in an empty directory) for each of the supported languages as follows:

```bash
# Typescript
npx projen new --from @aws-prototyping-sdk/pdk-pipeline-ts
```

```bash
# Python
npx projen new --from @aws-prototyping-sdk/pdk-pipeline-py
```

```bash
# Java
npx projen new --from @aws-prototyping-sdk/pdk-pipeline-java
```

### CDK Nag

In order to keep CDK Nag happy, make sure you build the pipeline before synth as per https://github.com/aws/aws-cdk/issues/18440.

## Multi-branch pipeline management

If your team follows [GitHub flow](https://docs.github.com/en/get-started/quickstart/github-flow), the pipelines module can optionally help you create independent environments to test and validate changes before merging. When you create a new branch, it will automatically create a new pipeline stack and any stages you configure. Once you have finished testing and delete the branch, it will automatically clean up the stacks created in the branch's environment.

The feature is enabled and configured by setting the `branchNamePrefixes` property of the `PDKPipeline` construct. Any branches created matching this list of prefixes will create a new pipeline and stack.

When your PDKPipeline is run, the current branch will be available in the `BRANCH` environment variable. You can use this to give unique names to the stacks and stages created by that branch. You can also enable and disable stages based on the branch name. For example, you may want the PipelineStack and Dev stage to get created for any branch and only create the Prod stage in the default branch.

### PDKPipeline configuration

#### Example: All Branches

pipeline-stack.ts

```python
this.pipeline = new PDKPipeline(this, "ApplicationPipeline", {
  primarySynthDirectory: "packages/backend/cdk.out",
  repositoryName: this.node.tryGetContext("repositoryName") || "monorepo",
  branchNamePrefixes: PDKPipeline.ALL_BRANCHES,
});
```

#### Example: Branches starting with "feature/" or "fix/"

pipeline-stack.ts

```python
this.pipeline = new PDKPipeline(this, "ApplicationPipeline", {
  primarySynthDirectory: "packages/backend/cdk.out",
  repositoryName: this.node.tryGetContext("repositoryName") || "monorepo",
  branchNamePrefixes: ["feature/", "fix/"],
});
```

### Pipeline Definition

When you define your pipeline, you define which stages get created for a given branch and how to name your stacks uniquely. `PipelineStack` must be included.

pipeline.ts

```python
const branchPrefix = PDKPipeline.getBranchPrefix({ node: app.node });

const pipelineStack = new PipelineStack(app, branchPrefix + "PipelineStack", {
  env: {
    account: process.env.CDK_DEFAULT_ACCOUNT!,
    region: process.env.CDK_DEFAULT_REGION!,
  },
});

const devStage = new ApplicationStage(app, branchPrefix + "Dev", {
  env: {
    account: process.env.CDK_DEFAULT_ACCOUNT!, // Replace with Dev account
    region: process.env.CDK_DEFAULT_REGION!, // Replace with Dev region
  },
});

pipelineStack.pipeline.addStage(devStage);

// Only create the Prod stage in the default branch
if (PDKPipeline.isDefaultBranch({ node: app.node })) {
  const prodStage = new ApplicationStage(app, "Prod", {
    env: {
      account: process.env.CDK_DEFAULT_ACCOUNT!, // Replace with Prod account
      region: process.env.CDK_DEFAULT_REGION!, // Replace with Prod region
    },
  });

  pipelineStack.pipeline.addStage(prodStage);
}
```



            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/aws/aws-prototyping-sdk",
    "name": "aws-prototyping-sdk.pipeline",
    "maintainer": "",
    "docs_url": null,
    "requires_python": "~=3.7",
    "maintainer_email": "",
    "keywords": "",
    "author": "AWS APJ COPE<apj-cope@amazon.com>",
    "author_email": "",
    "download_url": "https://files.pythonhosted.org/packages/8f/e9/153dd11bb442273809f5f7f9b3ca3e9c329dd3f9f9c74cbe850f4abc6a6d/aws_prototyping_sdk.pipeline-0.19.68.tar.gz",
    "platform": null,
    "description": "> **BREAKING CHANGES** (pre-release)\n>\n> * `> v0.16.1`: Refactored PDKPipeline to now be a construct so accessing CodePipeline methods now requires accessing a public codePipeline property i.e: `pdkPipeline.codePipeline.XXX`\n\nThe pipeline module vends an extension to CDK's CodePipeline construct, named PDKPipeline. It additionally creates a CodeCommit repository and by default is configured to build the project assumming nx-monorepo is being used (although this can be changed). A Sonarqube Scanner can also be configured to trigger a scan whenever the synth build job completes successfully. This Scanner is non-blocking and as such is not instrumented as part of the pipeline.\n\nThe architecture for the PDKPipeline is as follows:\n\n```\nCodeCommit repository -> CodePipeline\n                             |-> EventBridge Rule (On Build Succeded) -> CodeBuild (Sonar Scan)\n                             |-> Secret (sonarqube token)\n```\n\nThis module additionally vends multiple Projen Projects, one for each of the supported languages. These projects aim to bootstrap your project by providing sample code which uses the PDKPipeline construct.\n\nFor example, in .projenrc.ts:\n\n```python\nnew PDKPipelineTsProject({\n  cdkVersion: \"2.1.0\",\n  defaultReleaseBranch: \"mainline\",\n  devDeps: [\"aws-prototyping-sdk\"],\n  name: \"my-pipeline\",\n});\n```\n\nThis will generate a package in typescript containing CDK boilerplate for a pipeline stack (which instantiates PDKPipeline), sets up a Dev stage with an Application Stage containing an empty ApplicationStack (to be implemented). Once this package is synthesized, you can run `npx projen` and projen will synthesize your cloudformation.\n\nAlternatively, you can initialize a project using the cli (in an empty directory) for each of the supported languages as follows:\n\n```bash\n# Typescript\nnpx projen new --from @aws-prototyping-sdk/pdk-pipeline-ts\n```\n\n```bash\n# Python\nnpx projen new --from @aws-prototyping-sdk/pdk-pipeline-py\n```\n\n```bash\n# Java\nnpx projen new --from @aws-prototyping-sdk/pdk-pipeline-java\n```\n\n### CDK Nag\n\nIn order to keep CDK Nag happy, make sure you build the pipeline before synth as per https://github.com/aws/aws-cdk/issues/18440.\n\n## Multi-branch pipeline management\n\nIf your team follows [GitHub flow](https://docs.github.com/en/get-started/quickstart/github-flow), the pipelines module can optionally help you create independent environments to test and validate changes before merging. When you create a new branch, it will automatically create a new pipeline stack and any stages you configure. Once you have finished testing and delete the branch, it will automatically clean up the stacks created in the branch's environment.\n\nThe feature is enabled and configured by setting the `branchNamePrefixes` property of the `PDKPipeline` construct. Any branches created matching this list of prefixes will create a new pipeline and stack.\n\nWhen your PDKPipeline is run, the current branch will be available in the `BRANCH` environment variable. You can use this to give unique names to the stacks and stages created by that branch. You can also enable and disable stages based on the branch name. For example, you may want the PipelineStack and Dev stage to get created for any branch and only create the Prod stage in the default branch.\n\n### PDKPipeline configuration\n\n#### Example: All Branches\n\npipeline-stack.ts\n\n```python\nthis.pipeline = new PDKPipeline(this, \"ApplicationPipeline\", {\n  primarySynthDirectory: \"packages/backend/cdk.out\",\n  repositoryName: this.node.tryGetContext(\"repositoryName\") || \"monorepo\",\n  branchNamePrefixes: PDKPipeline.ALL_BRANCHES,\n});\n```\n\n#### Example: Branches starting with \"feature/\" or \"fix/\"\n\npipeline-stack.ts\n\n```python\nthis.pipeline = new PDKPipeline(this, \"ApplicationPipeline\", {\n  primarySynthDirectory: \"packages/backend/cdk.out\",\n  repositoryName: this.node.tryGetContext(\"repositoryName\") || \"monorepo\",\n  branchNamePrefixes: [\"feature/\", \"fix/\"],\n});\n```\n\n### Pipeline Definition\n\nWhen you define your pipeline, you define which stages get created for a given branch and how to name your stacks uniquely. `PipelineStack` must be included.\n\npipeline.ts\n\n```python\nconst branchPrefix = PDKPipeline.getBranchPrefix({ node: app.node });\n\nconst pipelineStack = new PipelineStack(app, branchPrefix + \"PipelineStack\", {\n  env: {\n    account: process.env.CDK_DEFAULT_ACCOUNT!,\n    region: process.env.CDK_DEFAULT_REGION!,\n  },\n});\n\nconst devStage = new ApplicationStage(app, branchPrefix + \"Dev\", {\n  env: {\n    account: process.env.CDK_DEFAULT_ACCOUNT!, // Replace with Dev account\n    region: process.env.CDK_DEFAULT_REGION!, // Replace with Dev region\n  },\n});\n\npipelineStack.pipeline.addStage(devStage);\n\n// Only create the Prod stage in the default branch\nif (PDKPipeline.isDefaultBranch({ node: app.node })) {\n  const prodStage = new ApplicationStage(app, \"Prod\", {\n    env: {\n      account: process.env.CDK_DEFAULT_ACCOUNT!, // Replace with Prod account\n      region: process.env.CDK_DEFAULT_REGION!, // Replace with Prod region\n    },\n  });\n\n  pipelineStack.pipeline.addStage(prodStage);\n}\n```\n\n\n",
    "bugtrack_url": null,
    "license": "Apache-2.0",
    "summary": "@aws-prototyping-sdk/pipeline",
    "version": "0.19.68",
    "project_urls": {
        "Homepage": "https://github.com/aws/aws-prototyping-sdk",
        "Source": "https://github.com/aws/aws-prototyping-sdk"
    },
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "27b182e487151776508e971cf5287d4f63a5d859ccda21824a904502b5bd8d09",
                "md5": "4db19ea552112ac55623c83f6296ac98",
                "sha256": "f7b9de8400135d723433cf6ba17cb8c1639e2728f4bc7202f36dee2a13137546"
            },
            "downloads": -1,
            "filename": "aws_prototyping_sdk.pipeline-0.19.68-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "4db19ea552112ac55623c83f6296ac98",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": "~=3.7",
            "size": 380648,
            "upload_time": "2023-08-24T23:17:20",
            "upload_time_iso_8601": "2023-08-24T23:17:20.178440Z",
            "url": "https://files.pythonhosted.org/packages/27/b1/82e487151776508e971cf5287d4f63a5d859ccda21824a904502b5bd8d09/aws_prototyping_sdk.pipeline-0.19.68-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "8fe9153dd11bb442273809f5f7f9b3ca3e9c329dd3f9f9c74cbe850f4abc6a6d",
                "md5": "5eaecbf6d0220588bd994ede6d7126ea",
                "sha256": "20172bc3e8416723cea965aab0a755eacf9e315ff81e1878146ccd8043fa0901"
            },
            "downloads": -1,
            "filename": "aws_prototyping_sdk.pipeline-0.19.68.tar.gz",
            "has_sig": false,
            "md5_digest": "5eaecbf6d0220588bd994ede6d7126ea",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": "~=3.7",
            "size": 382591,
            "upload_time": "2023-08-24T23:17:21",
            "upload_time_iso_8601": "2023-08-24T23:17:21.602314Z",
            "url": "https://files.pythonhosted.org/packages/8f/e9/153dd11bb442273809f5f7f9b3ca3e9c329dd3f9f9c74cbe850f4abc6a6d/aws_prototyping_sdk.pipeline-0.19.68.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-08-24 23:17:21",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "aws",
    "github_project": "aws-prototyping-sdk",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "aws-prototyping-sdk.pipeline"
}
        
Elapsed time: 0.22594s