Analytics Live Exporting via Google Pub/Sub
The Bitmovin Analytics Pub/Sub Export system enables real-time delivery of analytics data to customer-owned infrastructure using Google Cloud Pub/Sub. This setup allows customers to receive, store, and process analytics events in a scalable and decoupled manner.
All analytics data is pushed to a Google Cloud Pub/Sub topic defined and controlled by the customer. Message payload is encoded using Protocol Buffers (Protobuf) format for efficient and structured encoding.
Setup
As a customer, you must first create the necessary Pub/Sub components in your Google Cloud Platform (GCP) account:
- Pub/Sub Topic: A new or existing topic where Bitmovin will publish analytics data.
- Subscription: A subscription attached to the topic which enables you to pull and process messages.
Required IAM Permissions
You must grant Bitmovin Analytics Pub/Sub writer permissions to the topic. This is done by assigning the roles/pubsub.publisher
role to the Bitmovin service account:
Service Account: [email protected]
Role: roles/pubsub.publisher
This allows Bitmovin to publish messages to the topic without access to other resources in your GCP project.
Message receiving
To receive messages from Google Pub/Sub please follow the Google Pub/Sub tutorial: https://cloud.google.com/pubsub/docs/overview
Bitmovin Analytics uses Protocol buffers for the Pub/Sub message payload. This allows customers to generate deserialization logic in multiple languages (e.g., Java, Python, Go).
See this sample .proto file schema as a reference. For more information about protocol buffers please see:
https://protobuf.dev/overview/
Completion and activation
Once the necessary Pub/Sub components are created and the required IAM permissions are granted to the Bitmovin service account, please reach out to Bitmovin support. Upon notification, Bitmovin will configure the live-exporting process, and data will begin streaming into your Pub/Sub topic in real-time.
Updated 7 days ago