Stay organized with collections
Save and categorize content based on your preferences.
You can run batch inference with Meta's Llama 3.2-1b LLM and vLLM on a Cloud Run job, then write the results directly to Cloud Storage using Cloud Run volume mounts.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-08-29 UTC."],[],[],null,["# Run batch inference using GPUs on Cloud Run jobs\n\n| **Preview\n| --- GPU support for Cloud Run jobs**\n|\n|\n| This feature is subject to the \"Pre-GA Offerings Terms\" in the General Service Terms section\n| of the [Service Specific Terms](/terms/service-terms#1).\n|\n| Pre-GA features are available \"as is\" and might have limited support.\n|\n| For more information, see the\n| [launch stage descriptions](/products#product-launch-stages).\n\nYou can run batch inference with [Meta's Llama 3.2-1b LLM](https://huggingface.co/meta-llama/Llama-3.2-1B) and [vLLM](https://github.com/vllm-project/vllm) on a Cloud Run job, then write the results directly to Cloud Storage using Cloud Run volume mounts.\n\nSee a step-by-step instructional codelab at [How to run batch inference on Cloud Run jobs](https://codelabs.developers.google.com/codelabs/cloud-run/how-to-batch-inference-cloud-run-jobs)."]]
