Data Sources

The real-world event that creates the data
How the CPG brand acquires it
What data you get
Consumer buys at store
Cashier scans UPC barcode
Retailer Portal / EDI Feed
Login to retailer portals like Luminate, Amazon Vendor Central, Kroger 84.51°. Download or connect via API. Daily/weekly refresh. Free with trading relationship.
POS Sales (units, $)
Store Inventory
On-Hand / OOS
Promo Flags
Retailer KPIs
Same Store Sale — Aggregated
NielsenIQ/Circana collects POS from 900K+ stores, projects to universe
Paid Subscription License
Annual contract ($500K–$5M+). Access via Discover/Unify portal or flat-file delivery. Covers all brands in subscribed categories. Weekly refresh.
Market Share
Distribution
Velocity
Pricing
Category Size
Promo Elasticity
Household Scans Receipt / Barcode
Panelist in Kantar/Nielsen sample records every purchase
Paid Subscription License
Annual contract ($300K–$2M+). Kantar Worldpanel or Nielsen Homescan. Continuous diary, projected to national. Quarterly deep-dives.
Penetration
Frequency
Demographics
Loyalty / Repeat
Switching
Basket
Your Own Operations
Factory produces, warehouse ships, finance invoices, sales team plans promos
ERP / System Extract (ETL/CDC)
SAP, Oracle, TPM, CRM, MES → Data warehouse via automated ETL pipelines or Change Data Capture.Real-time to daily. You own this data
P&L / Financials
Trade Spend
GTN Waterfall
Inventory
OTIF / Shipments
Demand Forecast
Product Master (MDM)
COGS
Consumer Posts / Searches Online
Social post, product review, Amazon search, ad impression
SaaS Platform API Integration
REST API connections to Phyllo (influencer), Brandwatch (social), Profitero (digital shelf), Bazaarvoice (reviews), Pathmatics (ads).SaaS subscription $20K–$500K/yr.
Influencer Metrics
Social Sentiment
Digital Shelf Rank
Ratings & Reviews
Competitor Ad Spend
RMN ROAS
Product Listed on E-Commerce
Your ASIN/UPC exists on Amazon, Walmart.com, Instacart
Automated Web Scraping + API
Profitero / Edge crawls marketplace pages daily.Captures rank, price, stock status, reviews, content completeness. Some via API, some via scraping.
Share of Search
Organic Rank
Buy Box %
Content Score
Price Monitoring
3P Seller Count
Competitor Launches New Product
New SKU hits shelves with new claims, ingredients, price
Product Database Subscription + Scraping
Mintel GNPD catalogues every global launch. SPINS tracks claims. Syndicated data shows competitor share. Scraping captures pricing. Multiple sources combined.
New Launch Tracker
Claims Analytics
Competitor Share
Ingredient Trends
Competitor Price
Brand Commissions Research
Surveys, focus groups, concept tests, U&A studies
Agency Delivery / Qualtrics Export
Research agency (Kantar, Ipsos) delivers data packs. Continuous tracking via Qualtrics. BASES delivers volume predictions. Project-based ($50K–$500K).
Brand Health
NPS / CSAT
U&A Data
Concept Test Scores
WTP / Conjoint
Field Rep Photographs Shelf
In-store photo captured by Trax camera or rep’s phone
Image Recognition AI (Computer Vision)
Trax / Snapp AI detects products on shelf from image.Identifies OOS, counts facings, checks planogram.Vendor subscription $100K–$500K/yr.
OOS Detection
Facing Count
Share of Shelf
Planogram Compliance
Display Present?
Field Rep Photographs Shelf
In-store photo captured by Trax camera or rep’s phone
Image Recognition AI (Computer Vision)
Trax / Snapp AI detects products on shelf from image.Identifies OOS, counts facings, checks planogram.Vendor subscription $100K–$500K/yr.
CPI / Inflation
Commodity Prices
Consumer Confidence
Weather
Demographics