Posted on Aug 03, 2021

Extracted and integrated data from various platforms and transferred it the data to a cloud-based data warehouse

Challenges
  • Needed a solution to integrate data from various advertisement platforms like Google Adwords, Facebook Ads, Shopify Ads, etc.
  • They wanted to extract data from these platforms and transfer to it a cloud-based data warehouse.
  • They wanted to centralize the advertisement data to enable data science operations.
  • They wanted to create an analytical database to enable historical reporting and analysis.
Solutions
  • Integrated Adwords module using BigQuery data transfer services by synchronizing Adwords to BigQuery.
  • Configured a portal using an opensource framework (singer.io) to load integrated Facebook data to the cloud-based data warehouse (Amazon Redshift).
  • Designed a microservice for seamless transfer of data across data warehouses using Scala.
  • Automated end-to-end flow to provide real-time updates of customer enrollment.