2,478 questions
0
votes
0
answers
60
views
Using Lifespan FastAPI in Vertex AI Endpoint got 503
I'm trying to serve my custom container model in Vertex AI Endpoint. Im using Fast API and I need to load 5 models in my lifespan before executing the request. When I try to request my Endpoint it got ...
1
vote
0
answers
55
views
How to expose a Vertex AI endpoint on Apigee with a `/predict`?
I deployed a model on a GCP Vertex AI endpoint. This endpoint is consumable at the URL https://${VERTEXAI_URL}:predict.
I need now to expose this API service on Apigee with the following URL syntax:
...
0
votes
1
answer
169
views
Get the monitoring activation status of my GCP Vertex AI endpoint with Python?
In a GCP project with Vertex AI endpoints already deployed, I want to know if the monitoring is enabled with the google-cloud-aiplatform library.
How can I do it ?
For more context, I ran following ...
0
votes
1
answer
73
views
Google Cloud Endpoints - Failed to load service
Something very strange has just started happening. Our API on Google Cloud Endpoints won't startup. This happened just after trying to deploy to a new test environment. Now we can't deploy to the ...
1
vote
2
answers
306
views
Calling Vertex AI Endpoint for Swift (IOS application)
I have created a tuned model in Vertex AI and deployed it into an endpoint. I would like to use the tuned model in my Swift IOS application, but I don't know how.
Are there any ways to call it using ...
0
votes
0
answers
95
views
GCP endpoint - authentication
I am trying to setup GCP endpoints which is internally target to K8s ingress service.
My openapi.yaml
swagger: "2.0"
info:
description: "A simple Google Cloud Endpoints API example.&...
0
votes
1
answer
84
views
Firestore DB read/write latency is same from public route and private service connect endpoint in GCP
I have firestore DB in GCP. I was accessing the firestore DB via public route and the latency was around 300ms (280-300).
I create a private service connect endpoint to reduce the latency and access ...
0
votes
0
answers
243
views
How To Run GCP Cloud Endpoints Locally?
So I am trying to figure out how to run GCP Cloud Endpoints locally. I have followed the instructions on the Github getting started with Cloud Endpoints located here:
https://github.com/...
0
votes
2
answers
2k
views
How to authenticate with a Vertex AI endpoint in Postman without manual action?
I created a endpoint on Google Cloud Platform Vertex AI and I managed to consume it with Postman with the following authentication process:
Connect to GCP
Open a gcloud console and run gcloud auth ...
5
votes
0
answers
2k
views
LLAMA 2 in Vertex AI
I deployed llama-2 13B and 70B in Vertex AI through Model Garden. Deployment was successful, but when I am hitting the endpoint through curl I keep on getting below error. Has anyone tried llama-2 in ...
1
vote
0
answers
134
views
Why is my Svelte web application using a previous version that I have deleted from App Engine?
The exact URLs/endpoints/etc below have been anonymized.
I have built a very simple web application with Svelte/Sveltekit as the frontend, and FastAPI as the backend. I am hosting each service on ...
0
votes
1
answer
130
views
How can I use my App Engine API to run an executable on Compute Engine?
My project structure is roughly as follows:
Frontend - built with Svelte, SvelteKit, and hosted on App Engine
API - built with FastAPI, also hosted on App Engine (*1)
Backend - proprietary code/...
1
vote
0
answers
160
views
Unsupported gRPC frame flag: 1 in response of Cloud Endpoints OpenAPI for Cloud Run with ESPv2
I have deployed a service in GCP cloud endpoint and in backend calling a GRPC service. In GRPC service I have taken a string type param in proto. When I get big string in response I receive error &...
0
votes
0
answers
372
views
VertexAI Endpoint - Unable to coerce value
I have a Custom Class that turns a Pandas Dataframe into a dataset consisting of a list of lists of 7-day periods with a batch size of 32.
Giving some context, this is the code:
def make_dataset(self, ...
0
votes
0
answers
415
views
Failed startup of context c.g.a.r.j.AppEngineWebAppContext due to FeatureNotEnabledException: app_identity_service.GetAccessToken
After adding Google Storage to a Google Endpoints app written in Java, the web instances seem not to be able to start up anymore, when deployed to GAE. However, all works fine when run locally (mvn ...