🔥 Benchmarking a new optimization integrated by the Model Garden team for serving LLMs on Vertex AI.

Can't wait to share!

#VertexAI #LLMs #Benchmarking #Optimization #ModelGarden #LLMServing

Features of the week on #GoogleCloud

- #BigQuery: Reverse ETL to load into and external dataset to read from #Spanner are GA
- #GenAI: Judge model in preview
- #ModelGarden: #Mistral small 3.1
- #CodeAssist: streamed chat response
- #ContainerRegistry is shut down, use #ArtifactRegistry

#FotWGCP