Setup p0 on your on-prem server on Google Cloud Provider (GCP)

Welcome to the on-premise installation instructions for p0 on Google Cloud Provider (GCP). Follow this guide to get set up with your own version of p0.

Create service account with required permission
  1. Ensure that you have gcloud CLI (Google Cloud command line interface) installed, authenticated, and configured with the correct project ID.

  2. Create a service account using either:

    1. gCloud CLI (see command below)

    2. Google Cloud Web Console

    • Important notes

      • Ensure the service account has access to Vertex API to use Claude 3 Haiku model. Please refer to this guide for configuration details.

      • New Google Cloud accounts receive free credits, but a billing account is required to use the Claude 3 Haiku model.

    • To create a service account using gCloud CLI: (Replace p0-vertex-ai-sa with your preferred service account name, if needed.)

gcloud iam service-accounts create p0-vertex-ai-sa

gcloud iam service-accounts create p0-vertex-ai-sa

gcloud iam service-accounts create p0-vertex-ai-sa

  1. Assign required roles to the newly created service account by replacing <PROJECT_ID> in the following command:

gcloud projects add-iam-policy-binding <PROJECT_ID> \ --member="serviceAccount:p0-vertex-ai-sa@<PROJECT_ID>.iam.gserviceaccount.com" \ --role=roles/aiplatform.user

gcloud projects add-iam-policy-binding <PROJECT_ID> \ --member="serviceAccount:p0-vertex-ai-sa@<PROJECT_ID>.iam.gserviceaccount.com" \ --role=roles/aiplatform.user

gcloud projects add-iam-policy-binding <PROJECT_ID> \ --member="serviceAccount:p0-vertex-ai-sa@<PROJECT_ID>.iam.gserviceaccount.com" \ --role=roles/aiplatform.user

This grants roles/aiplatform.user, which is required for accessing your on-premise LLM from p0 instance.

Import p0 image
  1. On the Google Cloud Console, select the project where you want to set up the p0 application.

  2. In the left sidebar, select Migrate to Virtual Machines

  1. Navigate to the Targets tab and add your project for this API.

  2. Go to the Image Imports tab and click the Create Image button.

  1. Fill in the following details:

    • Image Name: imported-p0-dashboard

    • Source Cloud Storage File: public-p0/p0-dashboard.vmdk

    • Region: Select your preferred region

    • Target Project: Choose the project created in Step 1

    • Click Create

  2. Wait approximately 20 minutes for the image import to complete.

Create p0 instance
  1. Once the p0 image import is complete, go to Compute Engine > Storage > Images: https://console.cloud.google.com/compute/images?tab=images

  1. You should see the imported image. If not, search for the image name from the previous step: imported-p0-dashboard.

  2. Once you locate the image, click the three-dot Action menu next to it, then select Create Instance

  1. Instance Configuration Page will open. Put in the name of your choice for the machine.

  1. Under Machine Configuration, select your preferred region and zone.

  2. In the Machine Configuration section, choose:

    • E2 > Standard

    • e2-standard-4 (4 vCPUs, 2 cores, 16 GB memory)

  3. (Optional) Under OS and Storage, if you have a large number of repositories where 50GB won’t be enough, add a new disk or proceed with the default 50GB.

  4. In the Networking section, under Firewall, check Allow HTTP and HTTPS traffic.

  1. Under Security > Identity and API Access, select the service account created in the previous steps.

  1. (Optional) Under Security > Manage Access, enable Block project-wide SSH keys for a more controlled experience.

  2. In the Advanced section, under Provisioning Model, select Standard Instances (avoid Spot instances, as they can be terminated during runs).

  1. Click Create at the bottom of the page.

  2. In about 10 minutes, visit the external IP of the newly created instance to begin onboarding.

Contact us

If you are facing any trouble setting up your on-prem application, reach out to us at contact[at]p0[dot]inc

Contact us

If you are facing any trouble setting up your on-prem application, reach out to us at contact[at]p0[dot]inc

Contact us

If you are facing any trouble setting up your on-prem application, reach out to us at contact[at]p0[dot]inc

© 2024 p

0

. All rights reserved.

© 2024 p

0

. All rights reserved.

© 2024 p

0

. All rights reserved.