ContextFlow

Real-time clickstream × market × weather × transit enrichment pipeline.

ContextFlow joins live web events (PostHog / Umami) with external context — Finnhub market data, Open-Meteo weather, GTFS-RT transit — on Apache Beam / Cloud Dataflow, landing enriched rows in BigQuery for Power BI.

Try it

Publish a synthetic clickstream event to the live GCP Pub/Sub topic clickstream-raw-topic. Watch it land in BigQuery contextflow.clickstream_events within ~10s.

Events per city — Looker Studio

Live report (Looker Studio → BigQuery view contextflow.v_events_per_city). Public link share, no Google sign-in required to view.

Stack

• Ingest: Google Pub/Sub
• Compute: Apache Beam on Cloud Dataflow (streaming)
• Warehouse: BigQuery (partitioned + clustered)
• BI: Power BI Service
• Edge / DNS: AWS CloudFront + Route 53

Links

• Source: github.com/nxv-can/cfa
• Author: vinhnx.ca