Push mirroring (FREE ALL)

Introduced in GitLab 13.5: LFS support over HTTPS.

A push mirror is a downstream repository that mirrors the commits made to the upstream repository. Push mirrors passively receive copies of the commits made to the upstream repository. To prevent the mirror from diverging from the upstream repository, don't push commits directly to the downstream mirror. Push commits to the upstream repository instead.

While pull mirroring periodically retrieves updates from the upstream repository, push mirrors only receive changes when:

Commits are pushed to the upstream GitLab repository.
An administrator force-updates the mirror.

When you push a change to the upstream repository, the push mirror receives it:

Within five minutes.
Within one minute, if you enabled Only mirror protected branches.

When a branch is merged into the default branch and deleted in the source project, it is deleted from the remote mirror on the next push. Branches with unmerged changes are kept. If a branch diverges, the Mirroring repositories section displays an error.

GitLab Silent Mode disables pushing to, and pulling from, remote mirrors.

Configure push mirroring

To set up push mirroring for an existing project:

On the left sidebar, at the top, select Search GitLab ({search}) to find your project.
Select Settings > Repository.
Expand Mirroring repositories.
Enter a repository URL.
In the Mirror direction dropdown list, select Push.
Select an Authentication method. For more information, see Authentication methods for mirrors.
Select Only mirror protected branches, if necessary.
Select Keep divergent refs, if desired.
To save the configuration, select Mirror repository.

Configure push mirrors through the API

You can also create and modify project push mirrors through the remote mirrors API.

Keep divergent refs

Introduced in GitLab 13.0.

By default, if any ref (branch or tag) on the remote (downstream) mirror diverges from the local repository, the upstream repository overwrites any changes on the remote:

A repository mirrors main and develop branches to a remote.
A new commit is added to develop on the remote mirror.
The next push updates the remote mirror to match the upstream repository.
The new commit added to develop on the remote mirror is lost.

If Keep divergent refs is selected, the changes are handled differently:

Updates to the develop branch on the remote mirror are skipped.
The develop branch on the remote mirror preserves the commit that does not exist on the upstream repository. Any refs that exist in the remote mirror, but not the upstream, are left untouched.
The update is marked failed.

After you create a mirror, you can only modify the value of Keep divergent refs through the remote mirrors API.

Set up a push mirror from GitLab to GitHub

To configure a mirror from GitLab to GitHub:

Create a GitHub fine-grained personal access token with at least read and write permissions on the repository contents. If your repository contains a .github/workflows directory, you must also grant read and write access for the Workflows. For a more fine-grained access, you can configure your token to only apply to the specific repository.
Enter a Git repository URL with this format, changing the variables as needed:
```
https://USERNAME@github.com/GROUP/PROJECT.git
```
- USERNAME: The username of the owner of the personal access token.
- GROUP: The group on GitHub.
- PROJECT: The project on GitHub.
For Password, enter your GitHub personal access token.
Select Mirror repository.

The mirrored repository is listed. For example:

https://*****:*****@github.com/<your_github_group>/<your_github_project>.git

The repository pushes shortly thereafter. To force a push, select Update now ({retry}).

Set up a push mirror from GitLab to AWS CodeCommit

AWS CodeCommit push mirroring is the best way to connect GitLab repositories to AWS CodePipeline. GitLab is not yet supported as one of their Source Code Management (SCM) providers. Each new AWS CodePipeline needs significant AWS infrastructure setup. It also requires an individual pipeline per branch.

If AWS CodeDeploy is the final step of a CodePipeline, you can, instead combine these tools to create a deployment:

GitLab CI/CD pipelines.
The AWS CLI in the final job in .gitlab-ci.yml to deploy to CodeDeploy.

NOTE: GitLab-to-AWS-CodeCommit push mirroring cannot use SSH authentication until GitLab issue 34014 is resolved.

To set up a mirror from GitLab to AWS CodeCommit:

In the AWS IAM console, create an IAM user.

Add the following least privileges permissions for repository mirroring as an inline policy.

The Amazon Resource Names (ARNs) must explicitly include the region and account. This IAM policy grants privilege for mirroring access to two sample repositories. These permissions have been tested to be the minimum (least privileged) required for mirroring:

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Sid": "MinimumGitLabPushMirroringPermissions",
            "Effect": "Allow",
            "Action": [
                "codecommit:GitPull",
                "codecommit:GitPush"
            ],
            "Resource": [
              "arn:aws:codecommit:us-east-1:111111111111:MyDestinationRepo",
              "arn:aws:codecommit:us-east-1:111111111111:MyDemo*"
            ]
        }
    ]
}

After the user is created, select the AWS IAM user name.
Select the Security credentials tab.
Under HTTPS Git credentials for AWS CodeCommit, select Generate credentials.

NOTE: This Git user ID and password is specific to communicating with CodeCommit. Do not confuse it with the IAM user ID or AWS keys of this user.
Copy or download the special Git HTTPS user ID and password.
In the AWS CodeCommit console, create a new repository to mirror from your GitLab repository.
Open your new repository, and then select Clone URL > Clone HTTPS (not Clone HTTPS (GRC)).
In GitLab, open the repository to be push-mirrored.
Select Settings > Repository, and then expand Mirroring repositories.
Fill in the Git repository URL field using this format:
```
https://<your_aws_git_userid>@git-codecommit.<aws-region>.amazonaws.com/v1/repos/<your_codecommit_repo>
```
Replace <your_aws_git_userid> with the AWS special HTTPS Git user ID from the IAM Git credentials created earlier. Replace <your_codecommit_repo> with the name of your repository in CodeCommit.
For Mirror direction, select Push.
For Authentication method, select Password. Fill in the Password box with the special IAM Git clone user ID password created earlier in AWS.
Leave the option Only mirror protected branches for CodeCommit. It pushes more frequently (from every five minutes to every minute).

CodePipeline requires individual pipeline setups for named branches you want to have a AWS CI setup for. Because feature branches with dynamic names are unsupported, configuring Only mirror protected branches doesn't cause flexibility problems with CodePipeline integration. You must also protect all the named branches you want to build CodePipelines for.

Select Mirror repository. You should see the mirrored repository appear:

https://*****:*****@git-codecommit.<aws-region>.amazonaws.com/v1/repos/<your_codecommit_repo>

To test mirroring by forcing a push, select Update now (the half-circle arrows). If Last successful update shows a date, you have configured mirroring correctly. If it isn't working correctly, a red error tag appears, and shows the error message as hover text.

Set up a push mirror to another GitLab instance with 2FA activated

On the destination GitLab instance, create a personal access token with write_repository scope.
On the source GitLab instance:
1. Enter the Git repository URL using this format: https://oauth2@<destination host>/<your_gitlab_group_or_name>/<your_gitlab_project>.git.
2. Enter the Password. Use the GitLab personal access token created on the destination GitLab instance.
3. Select Mirror repository.