Fastapi server with vertex ai online prediction

[DanHerman212]

Greetings,

I was working with the following notebook:

https://github.com/GoogleCloudPlatform/vertex-ai-samples/blob/main/notebooks/official/custom/SDK_Custom_Container_Prediction.ipynb

The fastapi configuration doesn’t work. When you get to deployment it fails. The logs show many errors, where it appears the fastapi sever did not function properly.

I don’t have experience with fastapi, but I read it’s better than flask. So I would love to master it.

I’m currently researching a solution and will send it to you if I can resolve the issue. Otherwise, I would love to collaborate on a solution if I get stuck, if possible.

Cheers

[DanHerman212]

I went to review other solutions and my assumptions is that there are conflicts in the packages installed on the container. I was not able to successfully run the container locally.