Integration of Magento with BigQuery
Connect a Magento store to BigQuery with WitCloud - orders, products, product attributes, low stock, categories, tax rates, currencies and store settings, collected through the Magento REST API.
Updated
Introduction
This integration collects the data of your Magento store through its REST API and stores it in Google Cloud BigQuery. You get orders with their line items, payments and status history, the product catalog with product attributes and low-stock items, categories, tax rates, currencies and store settings, so you can analyze your sales and assortment together with your marketing data.
Configuration guide
Follow the steps below to connect Magento with BigQuery. Once the setup is complete, your store data is transferred to your BigQuery project automatically.
You need an access token from your Magento store. You create it in the Magento admin panel (Magento's own interface, not WitCloud) and it has to be allowed to read the data you want to collect: orders, products, categories, tax rates, currencies and stock. You also need the address of your shop, for example https://shop.example.com.
Module setup
Go to Integrations in the menu and click Add integration.

Select Magento from the list of available integrations.

Enter the Collect name, for example "Magento PL". A good name helps you recognize the data source later.

Enter the Shop URL. It has to be a full address starting with https:// or http://. Magento is collected per shop, so add a separate integration for each shop.

Authorization
If you have already added an access token for this shop, you can pick it from the Magento authorization drop-down and skip the rest of this step.
Click Authorize. The button stays disabled until the Shop URL is filled in with a valid address.

In the Authorize window paste the Access token from your Magento store and click Create. The token is hidden while you type; use the eye icon to check it. Only members with the Editor role or higher can add a token.

Select the token from the Magento authorization drop-down. Each token is listed under the shop address and the beginning of the token, so you can tell tokens of different shops apart.

Advanced settings
Click Show advanced settings to open them.
In Data freshness (products, stocks) set how often, in hours, the products and low-stock tables are refreshed. These tables hold the whole catalog, so they are not downloaded again on every run: a run skips them if they were updated less than this many hours ago. The value is between 4 and 12 hours; the default is 4.

If your shop is protected, for example by Cloudflare or a firewall, turn on Static IP. All requests are then sent from the same address, shown next to the switch (34.118.32.227), which you can add to the list of allowed addresses.

In Tables to collect choose which tables are collected. All eight tables are selected by default and at least one must stay selected. Collecting fewer tables makes a run faster.

Click Next.

Historical data and scheduling
In Historical Data enter the number of days of orders to collect backwards from today, up to 365.

Orders are collected day by day, by the date the order was created. The other tables (products, product attributes, low stock, categories, tax rates, currencies, store settings) are a snapshot of the current state of your shop, taken on every run.
A data synchronization schedule is created automatically. More information on this topic can be found here.
Click Create to complete the configuration.

Done! Your Magento data will now be synchronized with BigQuery on the schedule you got.
Data schema
The tables below are created in your BigQuery dataset, one set per Magento integration. The orders table contains the personal data that Magento returns with an order, such as the customer's e-mail address, name, phone number and billing and shipping addresses, so grant access to it with care.
Data schema for magento_orders
| Field Name | Mode | Type |
|---|---|---|
| applied_rule_ids | NULLABLE | STRING |
| base_currency_code | NULLABLE | STRING |
| base_discount_amount | NULLABLE | FLOAT |
| base_discount_invoiced | NULLABLE | FLOAT |
| base_grand_total | NULLABLE | FLOAT |
| base_discount_tax_compensation_amount | NULLABLE | FLOAT |
| base_discount_tax_compensation_invoiced | NULLABLE | FLOAT |
| base_shipping_amount | NULLABLE | FLOAT |
| base_shipping_discount_amount | NULLABLE | FLOAT |
| base_shipping_discount_tax_compensation_amnt | NULLABLE | FLOAT |
| base_shipping_incl_tax | NULLABLE | FLOAT |
| base_shipping_invoiced | NULLABLE | FLOAT |
| base_shipping_tax_amount | NULLABLE | FLOAT |
| base_subtotal | NULLABLE | FLOAT |
| base_subtotal_incl_tax | NULLABLE | FLOAT |
| base_subtotal_invoiced | NULLABLE | FLOAT |
| base_tax_amount | NULLABLE | FLOAT |
| base_tax_invoiced | NULLABLE | FLOAT |
| base_total_due | NULLABLE | FLOAT |
| base_total_invoiced | NULLABLE | FLOAT |
| base_total_invoiced_cost | NULLABLE | FLOAT |
| base_total_paid | NULLABLE | FLOAT |
| base_to_global_rate | NULLABLE | FLOAT |
| base_to_order_rate | NULLABLE | FLOAT |
| billing_address_id | NULLABLE | FLOAT |
| coupon_code | NULLABLE | STRING |
| created_at | NULLABLE | TIMESTAMP |
| customer_email | NULLABLE | STRING |
| customer_firstname | NULLABLE | STRING |
| customer_group_id | NULLABLE | INTEGER |
| customer_id | NULLABLE | INTEGER |
| customer_is_guest | NULLABLE | INTEGER |
| customer_lastname | NULLABLE | STRING |
| customer_note_notify | NULLABLE | INTEGER |
| discount_amount | NULLABLE | FLOAT |
| discount_description | NULLABLE | STRING |
| discount_invoiced | NULLABLE | FLOAT |
| email_sent | NULLABLE | INTEGER |
| entity_id | NULLABLE | INTEGER |
| global_currency_code | NULLABLE | STRING |
| grand_total | NULLABLE | FLOAT |
| discount_tax_compensation_amount | NULLABLE | FLOAT |
| discount_tax_compensation_invoiced | NULLABLE | FLOAT |
| increment_id | NULLABLE | STRING |
| is_virtual | NULLABLE | INTEGER |
| order_currency_code | NULLABLE | STRING |
| protect_code | NULLABLE | STRING |
| quote_id | NULLABLE | INTEGER |
| remote_ip | NULLABLE | STRING |
| shipping_amount | NULLABLE | FLOAT |
| shipping_description | NULLABLE | STRING |
| shipping_discount_amount | NULLABLE | FLOAT |
| shipping_discount_tax_compensation_amount | NULLABLE | FLOAT |
| shipping_incl_tax | NULLABLE | FLOAT |
| shipping_invoiced | NULLABLE | FLOAT |
| shipping_tax_amount | NULLABLE | FLOAT |
| state | NULLABLE | STRING |
| status | NULLABLE | STRING |
| store_currency_code | NULLABLE | STRING |
| store_id | NULLABLE | INTEGER |
| store_name | NULLABLE | STRING |
| store_to_base_rate | NULLABLE | FLOAT |
| store_to_order_rate | NULLABLE | FLOAT |
| subtotal | NULLABLE | FLOAT |
| subtotal_incl_tax | NULLABLE | FLOAT |
| subtotal_invoiced | NULLABLE | FLOAT |
| tax_amount | NULLABLE | FLOAT |
| tax_invoiced | NULLABLE | FLOAT |
| total_due | NULLABLE | FLOAT |
| total_invoiced | NULLABLE | FLOAT |
| total_item_count | NULLABLE | INTEGER |
| total_paid | NULLABLE | FLOAT |
| total_qty_ordered | NULLABLE | INTEGER |
| updated_at | NULLABLE | TIMESTAMP |
| weight | NULLABLE | FLOAT |
| x_forwarded_for | NULLABLE | STRING |
| items | REPEATED | RECORD |
| items.amount_refunded | NULLABLE | FLOAT |
| items.applied_rule_ids | NULLABLE | STRING |
| items.base_amount_refunded | NULLABLE | FLOAT |
| items.base_discount_amount | NULLABLE | FLOAT |
| items.base_discount_invoiced | NULLABLE | FLOAT |
| items.base_discount_tax_compensation_amount | NULLABLE | FLOAT |
| items.base_discount_tax_compensation_invoiced | NULLABLE | FLOAT |
| items.base_original_price | NULLABLE | FLOAT |
| items.base_price | NULLABLE | FLOAT |
| items.base_price_incl_tax | NULLABLE | FLOAT |
| items.base_row_invoiced | NULLABLE | FLOAT |
| items.base_row_total | NULLABLE | FLOAT |
| items.base_row_total_incl_tax | NULLABLE | FLOAT |
| items.base_tax_amount | NULLABLE | FLOAT |
| items.base_tax_invoiced | NULLABLE | FLOAT |
| items.created_at | NULLABLE | TIMESTAMP |
| items.discount_amount | NULLABLE | FLOAT |
| items.discount_invoiced | NULLABLE | FLOAT |
| items.discount_percent | NULLABLE | INTEGER |
| items.free_shipping | NULLABLE | INTEGER |
| items.discount_tax_compensation_amount | NULLABLE | FLOAT |
| items.discount_tax_compensation_invoiced | NULLABLE | FLOAT |
| items.is_qty_decimal | NULLABLE | INTEGER |
| items.is_virtual | NULLABLE | INTEGER |
| items.item_id | NULLABLE | INTEGER |
| items.name | NULLABLE | STRING |
| items.no_discount | NULLABLE | INTEGER |
| items.order_id | NULLABLE | INTEGER |
| items.original_price | NULLABLE | FLOAT |
| items.price | NULLABLE | FLOAT |
| items.price_incl_tax | NULLABLE | FLOAT |
| items.product_id | NULLABLE | INTEGER |
| items.product_type | NULLABLE | STRING |
| items.qty_canceled | NULLABLE | INTEGER |
| items.qty_invoiced | NULLABLE | INTEGER |
| items.qty_ordered | NULLABLE | INTEGER |
| items.qty_refunded | NULLABLE | INTEGER |
| items.qty_shipped | NULLABLE | INTEGER |
| items.quote_item_id | NULLABLE | INTEGER |
| items.row_invoiced | NULLABLE | FLOAT |
| items.row_total | NULLABLE | FLOAT |
| items.row_total_incl_tax | NULLABLE | FLOAT |
| items.row_weight | NULLABLE | FLOAT |
| items.sku | NULLABLE | STRING |
| items.store_id | NULLABLE | INTEGER |
| items.tax_amount | NULLABLE | FLOAT |
| items.tax_invoiced | NULLABLE | FLOAT |
| items.tax_percent | NULLABLE | INTEGER |
| items.updated_at | NULLABLE | TIMESTAMP |
| items.weee_tax_applied | NULLABLE | STRING |
| items.weight | NULLABLE | FLOAT |
| items.product_option | NULLABLE | RECORD |
| items.product_option.extension_attributes | NULLABLE | RECORD |
| items.product_option.extension_attributes.configurable_item_options | REPEATED | RECORD |
| items.product_option.extension_attributes.configurable_item_options.option_id | NULLABLE | STRING |
| items.product_option.extension_attributes.configurable_item_options.option_value | NULLABLE | INTEGER |
| billing_address | NULLABLE | RECORD |
| billing_address.address_type | NULLABLE | STRING |
| billing_address.city | NULLABLE | STRING |
| billing_address.country_id | NULLABLE | STRING |
| billing_address.email | NULLABLE | STRING |
| billing_address.entity_id | NULLABLE | INTEGER |
| billing_address.firstname | NULLABLE | STRING |
| billing_address.lastname | NULLABLE | STRING |
| billing_address.parent_id | NULLABLE | INTEGER |
| billing_address.postcode | NULLABLE | STRING |
| billing_address.street | REPEATED | STRING |
| billing_address.telephone | NULLABLE | STRING |
| payment | NULLABLE | RECORD |
| payment.account_status | NULLABLE | STRING |
| payment.amount_ordered | NULLABLE | FLOAT |
| payment.amount_paid | NULLABLE | FLOAT |
| payment.base_amount_ordered | NULLABLE | FLOAT |
| payment.base_amount_paid | NULLABLE | FLOAT |
| payment.base_amount_paid_online | NULLABLE | FLOAT |
| payment.base_shipping_amount | NULLABLE | FLOAT |
| payment.base_shipping_captured | NULLABLE | FLOAT |
| payment.cc_exp_year | NULLABLE | STRING |
| payment.cc_last4 | NULLABLE | STRING |
| payment.cc_ss_start_month | NULLABLE | STRING |
| payment.cc_ss_start_year | NULLABLE | STRING |
| payment.entity_id | NULLABLE | INTEGER |
| payment.last_trans_id | NULLABLE | STRING |
| payment.method | NULLABLE | STRING |
| payment.parent_id | NULLABLE | INTEGER |
| payment.shipping_amount | NULLABLE | FLOAT |
| payment.shipping_captured | NULLABLE | FLOAT |
| status_histories | REPEATED | RECORD |
| status_histories.comment | NULLABLE | STRING |
| status_histories.created_at | NULLABLE | TIMESTAMP |
| status_histories.entity_id | NULLABLE | INTEGER |
| status_histories.is_customer_notified | NULLABLE | INTEGER |
| status_histories.is_visible_on_front | NULLABLE | INTEGER |
| status_histories.parent_id | NULLABLE | INTEGER |
| status_histories.status | NULLABLE | STRING |
| extension_attributes | NULLABLE | RECORD |
| extension_attributes.shipping_assignments | REPEATED | RECORD |
| extension_attributes.shipping_assignments.shipping | NULLABLE | RECORD |
| extension_attributes.shipping_assignments.shipping.address | NULLABLE | RECORD |
| extension_attributes.shipping_assignments.shipping.address.address_type | NULLABLE | STRING |
| extension_attributes.shipping_assignments.shipping.address.city | NULLABLE | STRING |
| extension_attributes.shipping_assignments.shipping.address.country_id | NULLABLE | STRING |
| extension_attributes.shipping_assignments.shipping.address.email | NULLABLE | STRING |
| extension_attributes.shipping_assignments.shipping.address.entity_id | NULLABLE | INTEGER |
| extension_attributes.shipping_assignments.shipping.address.firstname | NULLABLE | STRING |
| extension_attributes.shipping_assignments.shipping.address.lastname | NULLABLE | STRING |
| extension_attributes.shipping_assignments.shipping.address.parent_id | NULLABLE | INTEGER |
| extension_attributes.shipping_assignments.shipping.address.postcode | NULLABLE | STRING |
| extension_attributes.shipping_assignments.shipping.address.street | REPEATED | STRING |
| extension_attributes.shipping_assignments.shipping.address.telephone | NULLABLE | STRING |
| extension_attributes.shipping_assignments.shipping.method | NULLABLE | STRING |
| extension_attributes.shipping_assignments.shipping.total | NULLABLE | RECORD |
| extension_attributes.shipping_assignments.shipping.total.base_shipping_amount | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.shipping.total.base_shipping_discount_amount | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.shipping.total.base_shipping_discount_tax_compensation_amnt | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.shipping.total.base_shipping_incl_tax | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.shipping.total.base_shipping_invoiced | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.shipping.total.base_shipping_tax_amount | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.shipping.total.shipping_amount | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.shipping.total.shipping_discount_amount | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.shipping.total.shipping_discount_tax_compensation_amount | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.shipping.total.shipping_incl_tax | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.shipping.total.shipping_invoiced | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.shipping.total.shipping_tax_amount | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items | REPEATED | RECORD |
| extension_attributes.shipping_assignments.items.amount_refunded | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.applied_rule_ids | NULLABLE | STRING |
| extension_attributes.shipping_assignments.items.base_amount_refunded | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.base_discount_amount | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.base_discount_invoiced | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.base_discount_tax_compensation_amount | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.base_discount_tax_compensation_invoiced | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.base_original_price | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.base_price | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.base_price_incl_tax | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.base_row_invoiced | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.base_row_total | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.base_row_total_incl_tax | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.base_tax_amount | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.base_tax_invoiced | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.created_at | NULLABLE | TIMESTAMP |
| extension_attributes.shipping_assignments.items.discount_amount | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.discount_invoiced | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.discount_percent | NULLABLE | INTEGER |
| extension_attributes.shipping_assignments.items.free_shipping | NULLABLE | INTEGER |
| extension_attributes.shipping_assignments.items.discount_tax_compensation_amount | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.discount_tax_compensation_invoiced | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.is_qty_decimal | NULLABLE | INTEGER |
| extension_attributes.shipping_assignments.items.is_virtual | NULLABLE | INTEGER |
| extension_attributes.shipping_assignments.items.item_id | NULLABLE | INTEGER |
| extension_attributes.shipping_assignments.items.name | NULLABLE | STRING |
| extension_attributes.shipping_assignments.items.no_discount | NULLABLE | INTEGER |
| extension_attributes.shipping_assignments.items.order_id | NULLABLE | INTEGER |
| extension_attributes.shipping_assignments.items.original_price | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.price | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.price_incl_tax | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.product_id | NULLABLE | INTEGER |
| extension_attributes.shipping_assignments.items.product_type | NULLABLE | STRING |
| extension_attributes.shipping_assignments.items.qty_canceled | NULLABLE | INTEGER |
| extension_attributes.shipping_assignments.items.qty_invoiced | NULLABLE | INTEGER |
| extension_attributes.shipping_assignments.items.qty_ordered | NULLABLE | INTEGER |
| extension_attributes.shipping_assignments.items.qty_refunded | NULLABLE | INTEGER |
| extension_attributes.shipping_assignments.items.qty_shipped | NULLABLE | INTEGER |
| extension_attributes.shipping_assignments.items.quote_item_id | NULLABLE | INTEGER |
| extension_attributes.shipping_assignments.items.row_invoiced | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.row_total | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.row_total_incl_tax | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.row_weight | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.sku | NULLABLE | STRING |
| extension_attributes.shipping_assignments.items.store_id | NULLABLE | INTEGER |
| extension_attributes.shipping_assignments.items.tax_amount | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.tax_invoiced | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.tax_percent | NULLABLE | INTEGER |
| extension_attributes.shipping_assignments.items.updated_at | NULLABLE | TIMESTAMP |
| extension_attributes.shipping_assignments.items.weee_tax_applied | NULLABLE | STRING |
| extension_attributes.shipping_assignments.items.weight | NULLABLE | FLOAT |
| extension_attributes.shipping_assignments.items.product_option | NULLABLE | RECORD |
| extension_attributes.shipping_assignments.items.product_option.extension_attributes | NULLABLE | RECORD |
| extension_attributes.shipping_assignments.items.product_option.extension_attributes.configurable_item_options | REPEATED | RECORD |
| extension_attributes.shipping_assignments.items.product_option.extension_attributes.configurable_item_options.option_id | NULLABLE | STRING |
| extension_attributes.shipping_assignments.items.product_option.extension_attributes.configurable_item_options.option_value | NULLABLE | INTEGER |
| extension_attributes.payment_additional_info | REPEATED | RECORD |
| extension_attributes.payment_additional_info.key | NULLABLE | STRING |
| extension_attributes.payment_additional_info.value | NULLABLE | STRING |
| extension_attributes.applied_taxes | REPEATED | RECORD |
| extension_attributes.applied_taxes.code | NULLABLE | STRING |
| extension_attributes.applied_taxes.title | NULLABLE | STRING |
| extension_attributes.applied_taxes.percent | NULLABLE | INTEGER |
| extension_attributes.applied_taxes.amount | NULLABLE | FLOAT |
| extension_attributes.applied_taxes.base_amount | NULLABLE | FLOAT |
| extension_attributes.item_applied_taxes | REPEATED | RECORD |
| extension_attributes.item_applied_taxes.type | NULLABLE | STRING |
| extension_attributes.item_applied_taxes.applied_taxes | REPEATED | RECORD |
| extension_attributes.item_applied_taxes.applied_taxes.code | NULLABLE | STRING |
| extension_attributes.item_applied_taxes.applied_taxes.title | NULLABLE | STRING |
| extension_attributes.item_applied_taxes.applied_taxes.percent | NULLABLE | FLOAT |
| extension_attributes.item_applied_taxes.applied_taxes.amount | NULLABLE | FLOAT |
| extension_attributes.item_applied_taxes.applied_taxes.base_amount | NULLABLE | FLOAT |
| extension_attributes.converting_from_quote | NULLABLE | BOOLEAN |
| extension_attributes.cash_on_delivery_fee | NULLABLE | INTEGER |
| extension_attributes.base_cash_on_delivery_fee | NULLABLE | INTEGER |
Data schema for magento_products
| Field Name | Mode | Type |
|---|---|---|
| id | NULLABLE | INTEGER |
| sku | NULLABLE | STRING |
| name | NULLABLE | STRING |
| attribute_set_id | NULLABLE | INTEGER |
| price | NULLABLE | FLOAT |
| status | NULLABLE | INTEGER |
| visibility | NULLABLE | INTEGER |
| type_id | NULLABLE | STRING |
| created_at | NULLABLE | STRING |
| updated_at | NULLABLE | STRING |
| weight | NULLABLE | FLOAT |
| extension_attributes | NULLABLE | RECORD |
| extension_attributes.website_ids | REPEATED | INTEGER |
| extension_attributes.category_links | REPEATED | RECORD |
| extension_attributes.category_links.position | NULLABLE | INTEGER |
| extension_attributes.category_links.category_id | NULLABLE | STRING |
| extension_attributes.bundle_product_options | REPEATED | RECORD |
| extension_attributes.bundle_product_options.option_id | NULLABLE | INTEGER |
| extension_attributes.bundle_product_options.title | NULLABLE | STRING |
| extension_attributes.bundle_product_options.required | NULLABLE | BOOLEAN |
| extension_attributes.bundle_product_options.type | NULLABLE | STRING |
| extension_attributes.bundle_product_options.position | NULLABLE | INTEGER |
| extension_attributes.bundle_product_options.sku | NULLABLE | STRING |
| extension_attributes.bundle_product_options.product_links | REPEATED | RECORD |
| extension_attributes.bundle_product_options.product_links.can_change_quantity | NULLABLE | INTEGER |
| extension_attributes.bundle_product_options.product_links.id | NULLABLE | STRING |
| extension_attributes.bundle_product_options.product_links.is_default | NULLABLE | BOOLEAN |
| extension_attributes.bundle_product_options.product_links.option_id | NULLABLE | INTEGER |
| extension_attributes.bundle_product_options.product_links.position | NULLABLE | INTEGER |
| extension_attributes.bundle_product_options.product_links.price | NULLABLE | FLOAT |
| extension_attributes.bundle_product_options.product_links.price_type | NULLABLE | INTEGER |
| extension_attributes.bundle_product_options.product_links.qty | NULLABLE | FLOAT |
| extension_attributes.bundle_product_options.product_links.sku | NULLABLE | STRING |
| extension_attributes.stock_item | NULLABLE | RECORD |
| extension_attributes.stock_item.item_id | NULLABLE | INTEGER |
| extension_attributes.stock_item.product_id | NULLABLE | INTEGER |
| extension_attributes.stock_item.stock_id | NULLABLE | INTEGER |
| extension_attributes.stock_item.qty | NULLABLE | INTEGER |
| extension_attributes.stock_item.is_in_stock | NULLABLE | BOOLEAN |
| extension_attributes.stock_item.is_qty_decimal | NULLABLE | BOOLEAN |
| extension_attributes.stock_item.show_default_notification_message | NULLABLE | BOOLEAN |
| extension_attributes.stock_item.use_config_min_qty | NULLABLE | BOOLEAN |
| extension_attributes.stock_item.min_qty | NULLABLE | INTEGER |
| extension_attributes.stock_item.use_config_min_sale_qty | NULLABLE | INTEGER |
| extension_attributes.stock_item.min_sale_qty | NULLABLE | INTEGER |
| extension_attributes.stock_item.use_config_max_sale_qty | NULLABLE | BOOLEAN |
| extension_attributes.stock_item.max_sale_qty | NULLABLE | INTEGER |
| extension_attributes.stock_item.use_config_backorders | NULLABLE | BOOLEAN |
| extension_attributes.stock_item.backorders | NULLABLE | INTEGER |
| extension_attributes.stock_item.use_config_notify_stock_qty | NULLABLE | BOOLEAN |
| extension_attributes.stock_item.notify_stock_qty | NULLABLE | INTEGER |
| extension_attributes.stock_item.use_config_qty_increments | NULLABLE | BOOLEAN |
| extension_attributes.stock_item.qty_increments | NULLABLE | INTEGER |
| extension_attributes.stock_item.use_config_enable_qty_inc | NULLABLE | BOOLEAN |
| extension_attributes.stock_item.enable_qty_increments | NULLABLE | BOOLEAN |
| extension_attributes.stock_item.use_config_manage_stock | NULLABLE | BOOLEAN |
| extension_attributes.stock_item.manage_stock | NULLABLE | BOOLEAN |
| extension_attributes.stock_item.low_stock_date | NULLABLE | STRING |
| extension_attributes.stock_item.is_decimal_divided | NULLABLE | BOOLEAN |
| extension_attributes.stock_item.stock_status_changed_auto | NULLABLE | INTEGER |
| extension_attributes.downloadable_product_links | REPEATED | RECORD |
| extension_attributes.downloadable_product_links.id | NULLABLE | INTEGER |
| extension_attributes.downloadable_product_links.title | NULLABLE | STRING |
| extension_attributes.downloadable_product_links.sort_order | NULLABLE | INTEGER |
| extension_attributes.downloadable_product_links.is_shareable | NULLABLE | INTEGER |
| extension_attributes.downloadable_product_links.price | NULLABLE | FLOAT |
| extension_attributes.downloadable_product_links.number_of_downloads | NULLABLE | INTEGER |
| extension_attributes.downloadable_product_links.link_type | NULLABLE | STRING |
| extension_attributes.downloadable_product_links.link_file | NULLABLE | STRING |
| extension_attributes.downloadable_product_links.link_file_content | NULLABLE | RECORD |
| extension_attributes.downloadable_product_links.link_file_content.file_data | NULLABLE | STRING |
| extension_attributes.downloadable_product_links.link_file_content.name | NULLABLE | STRING |
| extension_attributes.downloadable_product_links.link_url | NULLABLE | STRING |
| extension_attributes.downloadable_product_links.sample_type | NULLABLE | STRING |
| extension_attributes.downloadable_product_links.sample_file | NULLABLE | STRING |
| extension_attributes.downloadable_product_links.sample_file_content | NULLABLE | RECORD |
| extension_attributes.downloadable_product_links.sample_file_content.file_data | NULLABLE | STRING |
| extension_attributes.downloadable_product_links.sample_file_content.name | NULLABLE | STRING |
| extension_attributes.downloadable_product_links.sample_url | NULLABLE | STRING |
| extension_attributes.downloadable_product_samples | REPEATED | RECORD |
| extension_attributes.downloadable_product_samples.id | NULLABLE | INTEGER |
| extension_attributes.downloadable_product_samples.title | NULLABLE | STRING |
| extension_attributes.downloadable_product_samples.sort_order | NULLABLE | INTEGER |
| extension_attributes.downloadable_product_samples.sample_type | NULLABLE | STRING |
| extension_attributes.downloadable_product_samples.sample_file | NULLABLE | STRING |
| extension_attributes.downloadable_product_samples.sample_file_content | NULLABLE | RECORD |
| extension_attributes.downloadable_product_samples.sample_file_content.file_data | NULLABLE | STRING |
| extension_attributes.downloadable_product_samples.sample_file_content.name | NULLABLE | STRING |
| extension_attributes.downloadable_product_samples.sample_url | NULLABLE | STRING |
| extension_attributes.giftcard_amounts | REPEATED | RECORD |
| extension_attributes.giftcard_amounts.attribute_id | NULLABLE | INTEGER |
| extension_attributes.giftcard_amounts.website_id | NULLABLE | INTEGER |
| extension_attributes.giftcard_amounts.value | NULLABLE | INTEGER |
| extension_attributes.giftcard_amounts.website_value | NULLABLE | INTEGER |
| extension_attributes.configurable_product_options | REPEATED | RECORD |
| extension_attributes.configurable_product_options.id | NULLABLE | INTEGER |
| extension_attributes.configurable_product_options.attribute_id | NULLABLE | STRING |
| extension_attributes.configurable_product_options.label | NULLABLE | STRING |
| extension_attributes.configurable_product_options.position | NULLABLE | INTEGER |
| extension_attributes.configurable_product_options.is_use_default | NULLABLE | BOOLEAN |
| extension_attributes.configurable_product_options.values | REPEATED | RECORD |
| extension_attributes.configurable_product_options.values.value_index | NULLABLE | INTEGER |
| extension_attributes.configurable_product_options.product_id | NULLABLE | INTEGER |
| extension_attributes.configurable_product_links | REPEATED | INTEGER |
| extension_attributes.vertex_commodity_code | NULLABLE | RECORD |
| extension_attributes.vertex_commodity_code.code | NULLABLE | STRING |
| extension_attributes.vertex_commodity_code.type | NULLABLE | STRING |
| product_links | REPEATED | RECORD |
| product_links.sku | NULLABLE | STRING |
| product_links.link_type | NULLABLE | STRING |
| product_links.linked_product_sku | NULLABLE | STRING |
| product_links.linked_product_type | NULLABLE | STRING |
| product_links.position | NULLABLE | INTEGER |
| product_links.extension_attributes | NULLABLE | RECORD |
| product_links.extension_attributes.qty | NULLABLE | INTEGER |
| options | REPEATED | RECORD |
| options.product_sku | NULLABLE | STRING |
| options.option_id | NULLABLE | INTEGER |
| options.title | NULLABLE | STRING |
| options.type | NULLABLE | STRING |
| options.sort_order | NULLABLE | INTEGER |
| options.is_require | NULLABLE | BOOLEAN |
| options.price | NULLABLE | FLOAT |
| options.price_type | NULLABLE | STRING |
| options.sku | NULLABLE | STRING |
| options.file_extension | NULLABLE | STRING |
| options.max_characters | NULLABLE | INTEGER |
| options.image_size_x | NULLABLE | INTEGER |
| options.image_size_y | NULLABLE | INTEGER |
| options.values | REPEATED | RECORD |
| options.values.title | NULLABLE | STRING |
| options.values.sort_order | NULLABLE | INTEGER |
| options.values.price | NULLABLE | FLOAT |
| options.values.price_type | NULLABLE | STRING |
| options.values.sku | NULLABLE | STRING |
| options.values.option_type_id | NULLABLE | INTEGER |
| options.extension_attributes | NULLABLE | RECORD |
| options.extension_attributes.vertex_flex_field | NULLABLE | STRING |
| media_gallery_entries | REPEATED | RECORD |
| media_gallery_entries.id | NULLABLE | INTEGER |
| media_gallery_entries.media_type | NULLABLE | STRING |
| media_gallery_entries.label | NULLABLE | STRING |
| media_gallery_entries.position | NULLABLE | INTEGER |
| media_gallery_entries.disabled | NULLABLE | BOOLEAN |
| media_gallery_entries.types | REPEATED | STRING |
| media_gallery_entries.file | NULLABLE | STRING |
| media_gallery_entries.content | REPEATED | RECORD |
| media_gallery_entries.content.base64_encoded_data | NULLABLE | STRING |
| media_gallery_entries.content.type | NULLABLE | STRING |
| media_gallery_entries.content.name | NULLABLE | STRING |
| media_gallery_entries.extension_attributes | REPEATED | RECORD |
| media_gallery_entries.extension_attributes.video_content | REPEATED | RECORD |
| media_gallery_entries.extension_attributes.video_content.media_type | NULLABLE | STRING |
| media_gallery_entries.extension_attributes.video_content.video_provider | NULLABLE | STRING |
| media_gallery_entries.extension_attributes.video_content.video_url | NULLABLE | STRING |
| media_gallery_entries.extension_attributes.video_content.video_title | NULLABLE | STRING |
| media_gallery_entries.extension_attributes.video_content.video_description | NULLABLE | STRING |
| media_gallery_entries.extension_attributes.video_content.video_metadata | NULLABLE | STRING |
| tier_prices | REPEATED | RECORD |
| tier_prices.customer_group_id | NULLABLE | INTEGER |
| tier_prices.qty | NULLABLE | FLOAT |
| tier_prices.value | NULLABLE | FLOAT |
| tier_prices.extension_attributes | NULLABLE | RECORD |
| tier_prices.extension_attributes.percentage_value | NULLABLE | FLOAT |
| tier_prices.extension_attributes.website_id | NULLABLE | INTEGER |
| custom_attributes | REPEATED | RECORD |
| custom_attributes.attribute_code | NULLABLE | STRING |
| custom_attributes.value | NULLABLE | STRING |
Data schema for magento_product_attributes
| Field Name | Mode | Type |
|---|---|---|
| is_wysiwyg_enabled | NULLABLE | BOOLEAN |
| is_html_allowed_on_front | NULLABLE | BOOLEAN |
| used_for_sort_by | NULLABLE | BOOLEAN |
| is_filterable | NULLABLE | BOOLEAN |
| is_filterable_in_search | NULLABLE | BOOLEAN |
| is_used_in_grid | NULLABLE | BOOLEAN |
| is_visible_in_grid | NULLABLE | BOOLEAN |
| is_filterable_in_grid | NULLABLE | BOOLEAN |
| position | NULLABLE | INTEGER |
| is_searchable | NULLABLE | STRING |
| is_visible_in_advanced_search | NULLABLE | STRING |
| is_comparable | NULLABLE | STRING |
| is_used_for_promo_rules | NULLABLE | STRING |
| is_visible_on_front | NULLABLE | STRING |
| used_in_product_listing | NULLABLE | STRING |
| is_visible | NULLABLE | BOOLEAN |
| scope | NULLABLE | STRING |
| attribute_id | NULLABLE | INTEGER |
| attribute_code | NULLABLE | STRING |
| frontend_input | NULLABLE | STRING |
| entity_type_id | NULLABLE | STRING |
| is_required | NULLABLE | BOOLEAN |
| options | REPEATED | RECORD |
| options.label | NULLABLE | STRING |
| options.value | NULLABLE | STRING |
| is_user_defined | NULLABLE | BOOLEAN |
| default_frontend_label | NULLABLE | STRING |
| frontend_labels | REPEATED | RECORD |
| frontend_labels.store_id | NULLABLE | INTEGER |
| frontend_labels.label | NULLABLE | STRING |
| backend_type | NULLABLE | STRING |
| backend_model | NULLABLE | STRING |
| default_value | NULLABLE | STRING |
Data schema for magento_low_stocks
| Field Name | Mode | Type |
|---|---|---|
| item_id | NULLABLE | INTEGER |
| product_id | NULLABLE | INTEGER |
| stock_id | NULLABLE | INTEGER |
| qty | NULLABLE | INTEGER |
| is_in_stock | NULLABLE | BOOLEAN |
| is_qty_decimal | NULLABLE | BOOLEAN |
| show_default_notification_message | NULLABLE | BOOLEAN |
| use_config_min_qty | NULLABLE | BOOLEAN |
| min_qty | NULLABLE | INTEGER |
| use_config_min_sale_qty | NULLABLE | INTEGER |
| min_sale_qty | NULLABLE | INTEGER |
| use_config_max_sale_qty | NULLABLE | BOOLEAN |
| max_sale_qty | NULLABLE | INTEGER |
| use_config_backorders | NULLABLE | BOOLEAN |
| backorders | NULLABLE | INTEGER |
| use_config_notify_stock_qty | NULLABLE | BOOLEAN |
| notify_stock_qty | NULLABLE | INTEGER |
| use_config_qty_increments | NULLABLE | BOOLEAN |
| qty_increments | NULLABLE | INTEGER |
| use_config_enable_qty_inc | NULLABLE | BOOLEAN |
| enable_qty_increments | NULLABLE | BOOLEAN |
| use_config_manage_stock | NULLABLE | BOOLEAN |
| manage_stock | NULLABLE | BOOLEAN |
| low_stock_date | NULLABLE | TIMESTAMP |
| is_decimal_divided | NULLABLE | BOOLEAN |
| stock_status_changed_auto | NULLABLE | INTEGER |
Data schema for magento_categories
| Field Name | Mode | Type |
|---|---|---|
| id | NULLABLE | INTEGER |
| parent_id | NULLABLE | INTEGER |
| name | NULLABLE | STRING |
| is_active | NULLABLE | BOOLEAN |
| position | NULLABLE | INTEGER |
| level | NULLABLE | INTEGER |
| product_count | NULLABLE | INTEGER |
Data schema for magento_store_configs
| Field Name | Mode | Type |
|---|---|---|
| id | NULLABLE | INTEGER |
| code | NULLABLE | STRING |
| website_id | NULLABLE | INTEGER |
| locale | NULLABLE | STRING |
| base_currency_code | NULLABLE | STRING |
| default_display_currency_code | NULLABLE | STRING |
| timezone | NULLABLE | STRING |
| weight_unit | NULLABLE | STRING |
| base_url | NULLABLE | STRING |
| base_link_url | NULLABLE | STRING |
| base_static_url | NULLABLE | STRING |
| base_media_url | NULLABLE | STRING |
| secure_base_url | NULLABLE | STRING |
| secure_base_link_url | NULLABLE | STRING |
| secure_base_static_url | NULLABLE | STRING |
| secure_base_media_url | NULLABLE | STRING |
Data schema for magento_tax_rates
| Field Name | Mode | Type |
|---|---|---|
| id | NULLABLE | INTEGER |
| tax_country_id | NULLABLE | STRING |
| tax_region_id | NULLABLE | INTEGER |
| tax_postcode | NULLABLE | STRING |
| rate | NULLABLE | FLOAT |
| code | NULLABLE | STRING |
| titles | REPEATED | RECORD |
| titles.store_id | NULLABLE | STRING |
| titles.value | NULLABLE | STRING |
Data schema for magento_currency
| Field Name | Mode | Type |
|---|---|---|
| base_currency_code | NULLABLE | STRING |
| base_currency_symbol | NULLABLE | STRING |
| default_display_currency_code | NULLABLE | STRING |
| default_display_currency_symbol | NULLABLE | STRING |
| available_currency_codes | REPEATED | STRING |
| exchange_rates | REPEATED | RECORD |
| exchange_rates.currency_to | NULLABLE | STRING |
| exchange_rates.rate | NULLABLE | FLOAT |
