Getting Inference For Fullsend

The goal of this document is that you acquire a WIF provider URL to pass to the next step of the process (Configuring GitHub).

Fullsend supports GCP Vertex AI inference using Workload Identity Federation (WIF) on both GitHub and GitLab. WIF grants short-lived tokens to requesters that meet certain requirements. For GitHub, this requires an OIDC token signed by GitHub with its origin (org, repository and other details). For GitLab, the OIDC token is signed by GitLab's built-in id_tokens mechanism. If the WIF finds the request valid, it provides a short-lived token.

For GitLab repos, inference credentials are configured via repos install --inference-project rather than the steps below. See Operations for details.

You may need to create a new GCP project or reuse one. The output of this process is a WIF provider URL resembling:

projects/<number>/locations/global/workloadIdentityPools/<pool-name>/providers/<provider-name>

Where <number> is the number of the GCP project. This URL may be provided to you if there is someone handling GCP projects in your organization. Otherwise you may need to create a GCP project and configure it yourself.

Prerequisites

• Download the latest gcloud CLI and authenticate with it.
• Download the latest fullsend CLI.

Create a GCP project

Head over to GCloud and create a new project. Then enable the following APIs:

gcloud services enable \
  iam.googleapis.com \
  cloudresourcemanager.googleapis.com \
  aiplatform.googleapis.com \
  --project="$GCP_PROJECT"

Note: enable Anthropic's models Opus and Sonnet as well.

Then give yourself the roles roles/iam.workloadIdentityPoolAdmin and roles/resourcemanager.projectIamAdmin.

Configure inference in your GCP project

Run the command to configure provision for your GitHub repository:

fullsend inference provision <org>/<repo> --project <gcp-project>

Where <org>/<repo> refers to the GitHub organization and repository you want to enable inference for, and <gcp-project> is your GCP project name. The output resembles:

⚡ fullsend <version>
  Autonomous agentic development for Git-hosted organizations

→ Provisioning WIF for repo-scoped inference: <org>/<repo>

  • Provisioning WIF infrastructure
  ✓ WIF infrastructure ready

    WIF Provider: projects/<number>/locations/global/workloadIdentityPools/fullsend-inference/providers/gh-<org>-<repo>

    Pass this value to the GitHub setup command:
      fullsend github setup <org>/<repo> \
        --inference-project=<gcp-project> \
        --inference-wif-provider=projects/<number>/locations/global/workloadIdentityPools/fullsend-inference/providers/gh-<org>-<repo>

The important piece of information is the WIF Provider which you need to pass to the next step.

Next steps

Head over to Configuring GitHub to use your WIF provider URL.