Nearly six years ago Walmart sent 500 shelf-scanning robots home after concluding that workers picking online orders could see the
Conversations On Retail
July 20, 2026
There is a well-worn assumption embedded in most consumer goods companies: that understanding the shopper means understanding the purchase. Know the basket, the channel, the trip frequency. For decades that framing was sufficient. It no longer is.
The most consequential moments in a consumer’s relationship with a brand happen not at the shelf, not in the loyalty app, and not during a promotional event, but at home, in the unremarkable routines of daily life, where products are either used, stretched, quietly substituted, or eventually forgotten. What happens in those moments determines whether a product earns a standing place in a household or disappears from the repurchase cycle. Most CPG companies have almost no visibility into that stretch of the journey.
Point-of-sale data tells you what moved. Loyalty data tells you what was bought again. Survey research tells you what consumers remember, or believe, they do. None of these, individually or together, can tell you how a product is actually used once it crosses the threshold of someone’s home.
This gap has always existed, but for much of the past two decades it was manageable because consumer behavior moved slowly enough that traditional research could approximate it. That is no longer the case. NIQ’s Consumer Outlook for 2026 found that prolonged economic volatility has ingrained a lasting caution into consumer psychology, and its effects on product usage are fast-moving and difficult to detect through conventional means. Inflation-driven stretching of quantities, substitution of alternatives, and abandonment of routines are all occurring in ways that will not register clearly in scan data for months.
McKinsey’s State of the Consumer 2025, based on responses from more than 25,000 consumers in 18 markets, reached a conclusion that should give CPG leaders pause. The research found that consumer behavior has shifted so fundamentally since 2020 that, as McKinsey put it, “the old frameworks used to decipher” consumer choices “no longer apply.” What looked like temporary pandemic adaptations have become permanent. The measurement infrastructure most CPG companies depend on was designed for a consumer who no longer quite exists.
The distance between what consumers report doing and what they actually do is not a new observation. It has been documented across categories for decades and sits at the root of why survey-based research has always required a degree of professional skepticism. What is shifting is the scale of the divergence and the growing availability of methods capable of measuring it directly rather than inferring it.
The pattern shows up consistently at the category and product level. Consumers tend to overstate how often they use products, how reliably they stick to routines, and how intentional their choices are. A shopper may sincerely believe she uses a given skincare product every day; when usage is observed rather than recalled, the actual frequency is often two or three times a week. That discrepancy is not noise. It is the signal that tells you whether a product has genuinely worked its way into someone’s life or whether it is lingering on a bathroom shelf waiting for a routine that never quite materialized, and conventional research methods cannot see it.
NIQ’s tracking of consumer spending behavior has found persistent divergence between stated spending intentions and actual purchasing decisions across categories and markets. Bain’s consumer surveys from October 2024 found that roughly 80% of US and European respondents reported cutting their spending, even as category-level data presented a considerably more varied picture. The aggregate view flattens individual behavior. The individual truth is where the useful signal lives.
This issue extends well beyond the consumer insights function. The significant investment CPG companies have made in AI-powered personalization, demand forecasting, and retail optimization depends fundamentally on the quality of the behavioral data feeding those systems. Algorithms reflect and magnify whatever they are trained on. When training data rests on recalled rather than observed behavior, the models learn the wrong version of the consumer and produce outputs calibrated to someone who does not quite exist.
The execution gap is striking. Bain’s 2025 Consumer Products Report found that while 90% of CPG executives acknowledge AI’s importance to their business, only 37% rank it among their top five strategic priorities, and just 6% report having a clear and actionable plan for using it to create business value. That gap between stated importance and operational readiness is partly a talent and infrastructure problem. It is also a data problem. Companies that commit to AI investment before sorting out the quality of their behavioral inputs will find the returns difficult to explain.
PwC’s research into the future of consumer goods captured this plainly through one senior CPG leader’s description of the shift underway at their company: away from claimed behavior as a data source, toward measurement of what people actually do, because that is what gives predictive models real explanatory power. The observation reflects where the industry is heading. The gap between that destination and where most organizations currently sit is where the competitive work needs to happen.
Sales data has long been the primary instrument for detecting behavioral change. Its central limitation is how slowly it delivers a clear signal. By the time a shift in product usage frequency shows up unambiguously in POS data or retailer scan feeds, the underlying change in consumer behavior has typically been running for weeks, sometimes months. For a brand whose product is being quietly edged out of household routines, the gap between what is happening and what the data shows is the difference between getting ahead of the problem and managing the consequences after the fact.
The current consumer environment makes this more consequential, not less. NIQ’s Consumer Outlook for 2026 found that growing numbers of consumers plan to pull back on spending across fresh produce, health and wellness, meat, and dairy, reflecting a granular, category-specific reconfiguration of household budgets rather than a broad retreat from spending. These shifts do not arrive as clean events. They accumulate slowly, product by product, occasion by occasion, household by household, long before they produce a trend line that triggers internal review.
Behavioral intelligence can surface those shifts in frequency and context well before they show up at the register. The practical value is not that it produces more dramatic insights. It is that it reduces the delay between what is actually happening in people’s homes and a brand’s capacity to do something about it.
Continuous behavioral data has cross-functional implications that periodic research does not. Product development teams can build around actual usage occasions rather than assumed ones. Marketing can write claims grounded in what consumers demonstrably do rather than what they say they intend. Supply chain planners can build more accurate consumption models when they have access to actual use frequency rather than purchase frequency alone, and the two numbers are often far enough apart to matter for replenishment and inventory planning.
Most organizations’ data infrastructure was built to measure what was sold, to whom, through which channel, and at what margin. The systems that could track what happens after the sale are typically thin relative to the investment in pre-purchase measurement. The insight teams with the largest budgets are generally focused on the acquisition side of the consumer relationship. What comes after purchase, the product’s daily presence or absence in someone’s life, tends to get addressed through a qualitative study run once or twice a year.
PwC’s 2025 CPG Executive Survey found that nearly half of CPG leaders doubt their current business structures will hold up through the decade. The companies investing now in closing the post-purchase intelligence gap are not adopting a new methodology. They are building a capability that gets more valuable as behavioral data accumulates and models sharpen, and more difficult to replicate the longer competitors wait to start.
The stakes are sharpest in new product development. Mintel’s Global New Product Database found that only 35% of global CPG launches in the first five months of 2024 were genuinely new products, the lowest share Mintel has recorded since it began tracking new product activity in 1996. The pressure to get launches right has rarely been higher. And the place where most new products fail is not on the shelf during the trial window. It is in the weeks and months that follow, when a product either finds its place in a routine or quietly gets displaced by something more convenient, more familiar, or simply better positioned for the moment when the consumer actually reaches for it.
Behavioral intelligence changes the feedback loop. Conventional product development leans on sales performance to confirm or contradict assumptions, a process measured in quarters that conflates too many variables to be particularly instructive. When actual usage is observable, teams can see friction developing before it becomes abandonment, and can understand which specific moments in a routine the product is failing to serve.
For most of CPG’s history, the period between purchase and repurchase has been treated as a black box that eventually produces a sales number. The companies beginning to treat it as territory worth understanding, with its own signals, its own patterns, and its own early warning indicators, are not necessarily the largest or the best resourced. They are the ones that recognized earliest that what happens after the transaction is where the relationship with the consumer is actually decided.