Open in app
Home
Notifications
Lists
Stories

Write
Olga Braginskaya
Olga Braginskaya

Home
About

Published in Towards Data Science

·Pinned

PubSub to BigQuery: How to Build a Data Pipeline Using Dataflow, Apache Beam, and Java

Learn how to create a data pipeline in GCP — I’ve recently worked on a project that required me to collect data from Google PubSub and load it into different BigQuery tables. I’ve faced many challenges during this process so I would like to share my experience building a complete data pipeline in Google Cloud Platform. Problem statement Let’s say we have…

Data Pipeline

12 min read

PubSub to BigQuery: How to Build a Data Pipeline Using Dataflow, Apache Beam, and Java
PubSub to BigQuery: How to Build a Data Pipeline Using Dataflow, Apache Beam, and Java
Olga Braginskaya

Olga Braginskaya

Data engineer. I believe in Python and cats. My blog datobra.com

Following
  • Daniel Bourke

    Daniel Bourke

  • Dafna Rosenblum

    Dafna Rosenblum

  • Sigal Shaharabani

    Sigal Shaharabani

  • Quick Code

    Quick Code

  • Nikita Schneider

    Nikita Schneider

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Knowable