Search Results for ""

Pipelines

This document describes how to enable the pipelines engine if you need to trigger workflows from the CircleCI API or auto-cancel workflows.

Getting Started

Enable pipelines at the bottom of the Advanced section of Settings page for your project in the CircleCI app.

The new pipelines feature enables use of the new API endpoint to trigger builds with workflows and the following use cases:

  • New API endpoint to trigger builds, including running all workflows in the build.
  • Jobs named build will be wrapped in a workflows stanza by the processor.
  • Projects for which auto-cancel is enabled in the Advanced Settings will have workflows on non-default branches cancelled when a newer build is triggered on that same branch.
  • Use of configuration version 2.1 or higher requires pipelines to be turned on.

Notes: It is important to carefully consider the impact of enabling the auto-cancel feature, for example, if you have configured automated deployment jobs on non-default branches.

Troubleshooting

Pipeline errors will appear on the Jobs page or the Workflows page. When migrating an existing project to pipelines, you may safely go back by disabling the radio button for the pipelines feature on your Advanced Settings for your project if jobs or workflows fail the new pipelines service.

Limitations

CircleCI is committed to achieving backwards compatibility in almost all cases, and most projects that enable pipelines will have no effect on existing builds. Let us know if you experience breaking builds that worked before you turned on pipelines, but broke after you turned it on.

  • Anchors will be processed and resolved instead of appearing in the app config.
  • If you use << in your shell commands (most commonly found in use of heredocs) you will need to escape them using backslash \ as in \<< in order to use version 2.1 or higher of configuration.
  • Pipelines are not fully backwards-compatible with the 1.1 API endpoint to trigger arbitrary jobs - you may experience unexpected or inconsistent results if you use this endpoint after turning on Pipelines. Alternatively, you can use the build-triggering endpoint in the 1.1 API introduced in September 2018. Please keep in mind that this build triggering API endpoint does not accept parameters or workflow or job filters. If you make heavy use of those API features and want to use Pipelines, please contact your CircleCI account team.

Giving Feedback

  1. Tweet @circleci with thoughts
  2. Vote or add to our Ideas board

See Also

Refer to the Skipping and Cancelling Builds document for more details.