menu
techminis

A naukri.com initiative

google-web-stories
Home

>

Cloud News

>

[SOLVED] H...
source image

Medium

2M

read

326

img
dot

[SOLVED] How to fetch real-time google cloud run job logs?

  • To fetch real-time logs from a specific job running on Google Cloud Run, the current method of using Google Cloud Logging API with filters for periodic log retrieval has limitations in terms of API rate limits.
  • An alternative and more efficient approach is to set up a Log Sink to route logs to Pub/Sub. This allows relevant logs filtered by job name to be forwarded to a Pub/Sub topic, enabling real-time log processing by a Django backend without hitting API rate limits.
  • Another option is to use a Log Sink to send logs to BigQuery for structured storage and analysis, which can also help in eliminating API rate limits.
  • Implementing these approaches can ensure real-time log monitoring for long-running jobs and scalability for multiple users and pipelines on Google Cloud Run.

Read Full Article

like

19 Likes

For uninterrupted reading, download the app