Skip to content

Latest commit

 

History

History
85 lines (65 loc) · 3.7 KB

RELEASE.md

File metadata and controls

85 lines (65 loc) · 3.7 KB
Raw

Release Management

Overview

Release are created from the main repository branch using the version numbers, including an intermediate version suffix, defined in .make.versions. The following points are important:

  1. In general, common a version number is used for all published pypi wheels and docker images.
  2. .make.versions contains the version to be used when publishing the next release.
  3. Whenever .make.versions is changed, make set-versions should be run from the top of the repo.
    1. Corollary: make set-versions should ONLY be used from the top of the repo when .make.versions changes.
  4. The main branch always has the version suffix set to .dev<N>, which allows intermediate publishing from the main branch using version X.Y.Z.dev<N>.
  5. The scripts/release-branch.sh script automates creation of a new release branch and tag and version numbers in .make.versions
  6. Building and publishing is done manually, or soon via a git action, in the branch created by scripts/release-branch.sh.
    1. Wheels can only be published once to pypi for a given version.
    2. Transform and kfp images may be republished to the docker registry.

Cutting the release

Creating the release involves

  1. Creating a release branch and tag and updating the main branch versions.
  2. Building and publishing pypi library wheels and docker registry image.
  3. Creating a github release from the release branch and tag.

Each is discussed below.

Creating release branch and tag

The scripts/release-branch.sh is currently run manually to create the branch and tags as follows:

  1. Creates the release/vX.Y.Z and tag vX.Y.Z where X.Y.Z are defined in .make.versions
  2. In the new branch:
    1. Nulls out the version suffix in the new branch's .make.version file.
    2. Applies the unsuffixed versions to the artifacts published from the repo using make set-versions..
    3. Commits and pushes branch and tag
  3. In the main branch:
    1. Increments the minor version (i.e. Z+1) and resets the suffix in the main branch to dev0 in .make.versions..
    2. Commits and pushes branch

To double-check the version that will be published from the main branch,

git checkout <main branch>
make DPK_VERSION_SUFFIX= show-version

This will print for example, 1.2.3.

To run the script from the top of the repo:

scripts/release-branch.sh

Publishing wheels and images

After creating the release branch and tag using the scripts/release-branch.sh script:

  1. Switch to a release branch (e.g. releases/v1.2.3) created by the release-branch.sh script
  2. Be sure you're at the top of the repository (.../data-prep-kit)
  3. Optionally, make show-version to see the version that will be published
  4. Running the following, either manually or in a git action
    1. make build
    2. make publish (See credential requirements below)

For docker registry publishing, the following environment variables/credentials are needed:

  • DPK_DOCKER_REGISTRY_USER - user used with the registry defined in DOCKER_HOST in .make.defaults
  • DPK_DOCKER_REGISTRY_KEY - key/password for docker registry user.

To publish to pypi, the credentials in ~/.pypirc file (let us know if there is a way to do this with environment variables). See pypi for details.

Github release

After running the release-branch.sh script, to create tag vX.Y.Z and branch releases/vX.Y.Z

  1. Go to the releases page.
  2. Select Draft a new release
  3. Select Choose a tag -> vX.Y.Z
  4. Press Generate release notes
  5. Add a title (e.g., Release X.Y.Z)
  6. Add any additional relese notes.
  7. Press Publish release