Integration of Facebook Catalog with BigQuery

Connect Facebook (Meta) product catalogs to Google BigQuery with WitCloud and collect a daily snapshot of their products and product sets.

Updated

Introduction

This module integrates with the Facebook Catalog API (Meta Graph API), enabling you to collect the products and product sets of your Facebook (Meta) product catalogs and store them in Google Cloud BigQuery. Each run saves the current state of the catalog, so you can track your product feed over time and join it with your Facebook Ads data.

Configuration guide

Follow the steps below to connect Facebook Catalog with BigQuery. Once the setup is complete, your data will be automatically transferred to your BigQuery project.

WitCloud lists the catalogs of the Meta business portfolios your Facebook account belongs to — both catalogs the business owns and catalogs shared with it. Make sure the account you authorize has access to the business and catalogs you want to collect.

Module setup

Go to the Integrations section in the menu > Click Add integration.

Integrations list with the Add integration button

Select Facebook Catalog from the list of available integrations.

Integration catalog filtered to Facebook Catalog

Enter the Collect name, e.g. Facebook Catalog PL.

Collect name field filled in with the example name Facebook Catalog PL

Authorization

If you have already authorized Facebook Catalog in this project, simply pick the token from the Select Facebook authorization drop-down and skip this step.

Click Authorize.

Authorize button next to the Select Facebook authorization field

In the Facebook window:

  • Log in to Facebook and choose the account you want to use.
  • On the "Review WitCloud's access request" screen, confirm the permissions "Manage your product catalogues" and "Manage your business". WitCloud also reads your basic public profile.
  • Click Save.

Facebook Review WitCloud's access request screen

Catalog selection

Back in WitCloud, open Select catalogs and choose the catalogs you want to collect.

Select catalogs drop-down open with example Facebook catalogs

You can select multiple catalogs at once — WitCloud creates a separate data collect for each one, named after the collect name and the catalog (e.g. Facebook Catalog PL - Demo Catalog DE).

Select catalogs field with two example catalogs selected

Optionally, click Show advanced settings to set:

  • Data freshness (hours) — the minimum time between two collections of the catalog: a run that starts sooner after the last collection (for example, a manual re-run) is skipped. From 4 to 12 hours; default 4.
  • Tables to collect — both tables are selected by default; remove the one you don't need (at least one is required).

Advanced settings with Data freshness (hours) and Tables to collect

Click Create to complete the configuration.

Completed Facebook Catalog collect settings with the Create button

Done! Your Facebook Catalog data will now be synchronized with BigQuery.

Data synchronization

Facebook Catalog data is a current‑state snapshot of your product catalog, so there is no historical date‑range step: each run saves the catalog as it is at that moment and replaces that day's partition.

A data synchronization schedule is created automatically and collects the catalog once a day. More information on this topic can be found here.

Data schema

Expand the tables below to view the full data schema collected from Facebook Catalog.

Data schema for fb_catalog_products
Field NameModeType
dateNULLABLEDATE
catalog_idNULLABLESTRING
catalog_nameNULLABLESTRING
product_idNULLABLESTRING
retailer_idNULLABLESTRING
nameNULLABLESTRING
descriptionNULLABLESTRING
urlNULLABLESTRING
image_urlNULLABLESTRING
brandNULLABLESTRING
categoryNULLABLESTRING
product_typeNULLABLESTRING
availabilityNULLABLESTRING
conditionNULLABLESTRING
priceNULLABLESTRING
sale_priceNULLABLESTRING
currencyNULLABLESTRING
gtinNULLABLESTRING
mpnNULLABLESTRING
colorNULLABLESTRING
sizeNULLABLESTRING
custom_label_0NULLABLESTRING
custom_label_1NULLABLESTRING
custom_label_2NULLABLESTRING
custom_label_3NULLABLESTRING
custom_label_4NULLABLESTRING
Data schema for fb_catalog_product_sets
Field NameModeType
dateNULLABLEDATE
catalog_idNULLABLESTRING
catalog_nameNULLABLESTRING
product_set_idNULLABLESTRING
product_set_nameNULLABLESTRING
product_countNULLABLEINTEGER