Understanding Shopper Behaviour Better With Video Tracking

A shopper may well know what types of products he or she is planning to buy in a store, but what products the shopper will come out with is much less sure. Frequently there will be some additional unplanned products in the shopper’s basket. This observation is more often demonstrated in the case of grocery shopping in supermarkets, but it is likely to hold true also in other types of stores, especially large ones like department stores, fashion stores, and DIY or home improvement stores.

There can be a number of reasons or triggers for shoppers to consider additional products to purchase during the shopping trip itself — products forgotten and reminded of by cues that arise while shopping, attractiveness of visual appearance of product display (‘visual lift’), promotions posted on tags at the product display (‘point-of-purchase’) or in hand-out flyers, and more. The phenomenon of unplanned purchases is very familiar, and the study of it is not new. However, the behaviour of shoppers during their store visit that leads to this outcome, especially the consideration of product categories in an unplanned manner, is not understood well enough. The relatively new methodology of video tracking with a head-mounted small camera shows promise in gaining better understanding of shopper behaviour during the shopping trip; a research article by Hui, Huang, Suher and Inman (2013) is paving the way with a valuable contribution, particularly in shedding light on the relations between planned and unplanned considerations in a supermarket, and the factors that may drive conversion of the latter into purchases (1).

Shopper marketing is an evolving specialisation which gains increasing attention in  marketing and retailing. It concerns activities of consumers performed in a ‘shopper mode’ and is strongly connected with or contained within consumer marketing. Innovations in this sub-field by retailers and manufacturers span digital activities, multichannel marketing, store atmospherics and design, in-store merchandising, shopper marketing metrics and organisation. However, carrying out more effective and successful shopper marketing programmes requires closer collaboration between manufacturers and retailers — more openness to each party’s perspective and priorities (e.g., in interpretation of shopper insights), sharing information and coordination (2).

In-Store Video Tracking allows researchers to observe the shopping trip as it proceeds from the viewpoint of the shopper, literally. The strength of this methodology is in capturing the dynamics of shopping (e.g., with regard to in-store drivers of unplanned purchases). Unlike other approaches (e.g., RFID, product scanners), the video tracking method enables tracking acts of consideration, whether followed or not by purchase (i.e., putting a product item in the shopping cart).

For video tracking, a shopper is asked to wear, with the help of an experimenter, a headset belt that contains the portable video equipment, including a small video camera, a view/record unit, and a battery pack. It is worn like a Bluetooth headset. In addition, the equipment used by Hui et al. included an RFID transmitter that allows to trace the location of the shopper throughout his or her shopping path in a supermarket.

Like any research methodology, video tracking has its strengths and advantages versus its weaknesses and limitations. With the camera it is possible to capture the shopper’s field of vision during a shopping trip; the resulting video is stored in the view/record unit. However, without an eye-tracking (infrared) device, the camera may not point accurately to the positions of products considered (by eye fixation) in the field of vision. Yet, the video supports at least approximate inferences when a product is touched or moved, or the head-body posture and gesture suggest from which display a shopper considers products (i.e., the ‘frame’ closes-in on a section of the display). It is further noted that difficulties in calibrating an eye-tracking device in motion may impair the accuracy of locating fixations. The video camera seems sufficient and effective for identifying product categories as targets of consideration and purchase.

Furthermore, contrary to video filmed from cameras hanging from the ceiling in a store, the head-mounted camera records the scene at eye-level and not from high above, enabling to better notice what the shopper is doing (e.g., in aisles), and it follows the shopper all the way, not just in selected sections of the store. Additionally, using a head-mounted camera is more ethical than relying on surrounding cameras (often CCTV security cameras). On the other hand, head-mounted devices (e.g., camera, eye-tracking), which are not the most natural to wear whilst shopping, raise concerns of sampling bias (self-selection) and possibly causing change in the behaviour of the shopper; proponents argue that shoppers quickly forget of the device (devices are now made lighter) as they engage in shopping, but the issue is still in debate.

Video tracking is advantageous to RFID  and product scanners for the study of unplanned purchase behaviour by capturing acts of consideration: the RFID method alone (3) enables to trace the path of the shopper but not what one does in front of the shelf or stand display, and a scanner method allows to record what products are purchased but not which are considered. The advantage of the combined video + RFID approach according to Hui and his colleagues is in providing them “not only the shopping path but also the changes in the shoppers’ visual field as he or she walks around the store” (p. 449).

The complete research design included two interviews conducted with each shopper-participant — before the shopping trip, as a shopper enters the store, and after, on the way out. In the initial interview, shoppers were asked in which product categories they were planning to buy (aided by a list to choose from), as well as other shopping aspects (e.g., total budget, whether they brought their own shopping list). At the exit the shoppers were asked about personal characteristics, and the experimenters collected a copy of the receipt from the retailer’s transaction log. The information collected was essential for two aspects in particular: (a) distinguishing between planned and unplanned considerations; and (b) estimating the amount of money remaining for the shopper to make unplanned purchases out of the total budget (‘in-store slack’ metric).

237 participants were included in analyses. Overall, shoppers-participants planned to purchase from approximately 5.5 categories; they considered on average 13 categories in total, of which fewer than 5 were planned considerations (median 5.6). 37% of the participants carried a list prepared in advance.

Characteristics influencing unplanned consideration:  The researchers sought first to identify personal and product characteristics that significantly influence the probability of making an unplanned consideration in each given product category (a latent utility likelihood model was constructed). Consequently, they could infer which characteristics contribute to considering more categories in an unplanned manner. The model showed, for instance, that shoppers older in age and female shoppers are likely to engage in unplanned consideration in a greater number of product categories. Inversely, shoppers who are more familiar with a store (layout and location of products) and those carrying a shopping list tend to consider fewer product categories in an unplanned manner.

At a product level, a higher hedonic score for a product category is positively associated with greater incidence of unplanned consideration of it. Products that are promoted in the weekly flyer of the store at the time of a shopper’s visit are also more likely to receive an unplanned consideration from the shopper. Hui et al. further revealed effects of complementarity relations: products that were not planned beforehand for purchase (B) but are closer complementary of products in a ‘planned basket’ of shoppers (A) gain a greater likelihood of being considered in an unplanned manner (‘A –> B lift’).  [The researchers present a two-dimensional map detailing what products are more proximate and thus more likely to get paired together, not dependent yet on purchase of them].

Differences in behaviour between planned and unplanned considerations: Unplanned considerations tend to be made more haphazardly — while standing farther from display shelves and involving fewer product touches; conversely, planned considerations entail greater ‘depth’. Unplanned considerations tend to occur a little later in the shopping trip (the gap in timing is not very convincing). An unplanned consideration is less likely to entail reference to a shopping list — the list serves in “keeping the shopper on task”, being less prone to divert to unplanned consideration. Shoppers during an unplanned consideration are also less likely to refer to discount coupons or to in-store flyers/circulars. However, interestingly, some of the patterns found in this analysis change as an unplanned consideration turns into a purchase.

Importantly, in the outcome unplanned considerations are less likely to conclude with a purchase (63%) than planned considerations (83%). This raises the question, what can make an unplanned consideration result in purchase conversion?

Drivers of purchase conversion of unplanned considerations: Firstly, unplanned considerations that result in a purchase take longer (40 seconds on average) than those that do not (24 seconds). Secondly, shoppers get closer to the shelves and touch more product items before concluding with a purchase; the greater ‘depth’ of the process towards unplanned purchase is characterised by viewing fewer product displays (‘facings’) within the category — the shopper is concentrating on fewer alternatives yet examines those selected more carefully (e.g., by picking them up for a closer read). Another conspicuous finding is that shoppers are more likely to refer to a shopping list during an unplanned consideration that is going to result in a purchase — a plausible explanation is that the shopping list may help the shopper to seek whether an unplanned product complements a product on the list.

The researchers employed another (latent utility) model to investigate more systemically the drivers likely to lead unplanned considerations to result in a purchase. The model supported, for example, that purchase conversion is more likely in categories of  higher hedonic products. It corroborated the notions about ‘depth’ of consideration as a driver to purchase and the role of a shopping list in realising complementary unplanned products as supplements to the ‘planned basket’. It is also shown that interacting with a service staff for assistance increases the likelihood of concluding with a purchase.

  • Location in the store matters: An aisle is relatively a more likely place for an unplanned consideration to occur, and subsequently has a better chance when it happens to result in a purchase. The authors recommend assigning service staff to be present near aisles.

Complementarity relations were analysed once again, this time in the context of unplanned purchases. The analysis, as visualised in a new map, indicates that proximity between planned and unplanned categories enhances the likelihood of an unplanned purchase: if a shopper plans to purchase in category A, then the closer category B is to A, the more likely is the shopper to purchase in category B given it is considered. Hui et al. note that distances in the maps for considerations and for purchase conversion of unplanned considerations are not correlated, implying hence that the unplanned consideration and a purchase decision are two different dimensions in the decision process. This is a salient result because it distinguishes between engaging in consideration and the decision itself. The researchers caution, however, that in some cases the distinction between consideration and a choice decision may be false and inappropriate because they may happen rapidly in a single step.

  • The latent distances in the maps are also uncorrelated with physical distances between products in the supermarket (i.e., the complementarity relations are mental).

The research shows that while promotion (coupons or in-store flyers) for an unplanned product has a significant effect in increasing the probability of its consideration, it does not contribute to probability of its purchase. This evidence furthermore points to a separation between consideration and a decision. The authors suggest that a promotion may attract shoppers to consider a product, but they are mostly uninterested to buy and hence it has no further effect on their point-of-purchase behaviour. The researchers suggest that retailers can apply their model of complementarity to proactively invoke consideration by triggering a real-time promotion on a mobile shopping app for products associated with those on a digital list of the shopper “so a small coupon can nudge this consideration into a purchase”.

But there are some reservations to be made about the findings regarding promotions. An available promotion can increase the probability of a product to be considered in an unplanned manner, yet shoppers are less likely to look at their coupons or flyers at the relevant moment. Inversely, the existence of a promotion does not contribute to purchase conversion of an unplanned consideration but shoppers are more likely to refer to their coupons or flyers during unplanned considerations that result in a purchase.  A plausible explanation to resolve this apparent inconsistency is that reference to a promotional coupon or flyer is more concrete from a shopper viewpoint than the mere availability of a promotion; shoppers may not be aware of some of the promotions the researchers account for. In the article, the researchers do not address directly promotional information that appears on tags at the product display — such promotions may affect shoppers differently from flyers or distributed coupons (paper or digital via mobile app), because tags are more readily visible at the point-of-purchase.

One of the dynamic factors examined by Hui et al. is the ‘in-store slack’, the mental budget reserved for unplanned purchases. Reserving a larger slack increases the likelihood of unplanned considerations. Furthermore, at the moment of truth, the larger is the in-store slack that remains at the time of an unplanned consideration, the more likely is the shopper to take a product from the display to purchase. However, computations used in the analyses of dynamic changes in each shopper’s in-store slack appear to assume that shoppers estimate how much they already spent on planned products in various moments of the trip and are aware of their budget, an assumption not very realistic. The approach in the research is very clever, and yet consumers may not be so sophisticated: they may exceed their in-store slack, possibly because they are not very good in keeping their budget (e.g., exacerbated by use of credit cards) or in making arithmetic computations fluently.

Finally, shoppers could be subject to a dynamic trade-off between their self-control and the in-store slack. As the shopping trip progresses and the remaining in-store slack is expected to shrink, the shopper becomes less likely to allow an unplanned purchase, but he or she may become more likely to be tempted to consider and buy in an unplanned manner, because the strength of one’s self-control is depleted following active decision-making. In addition, a shopper who avoided making a purchase on the last occasion of unplanned consideration is more likely to purchase a product in the next unplanned occasion — this negative “momentum” effect means that following an initial effort at self-control, subsequent attempts are more likely to fail as a result of depletion of the strength of self-control.

The research of Hui, Huang, Suher and Inman offers multiple insights for retailers as well as manufacturers to take notice of, and much more material for thought and additional study and planning. The video tracking approach reveals patterns and drivers of shopper behaviour in unplanned considerations and how they relate to planned considerations.  The methodology is not without limitations; viewing and coding the video clips is notably time-consuming. Nevertheless, this research is bringing us a step forward towards better understanding and knowledge to act upon.

Ron Ventura, Ph.D. (Marketing)

Notes:

(1) Deconstructing the “First Moment of Truth”: Understanding Unplanned Consideration and Purchase Conversion Using In-Store Video Tracking; Sam K. Hui, Yanliu Huang, Jacob Suher, & J. Jeffrey Inman, 2013; Journal of Marketing Research, 50 (August), pp. 445-462.

(2) Innovations in Shopper Marketing: Current Insights and Future Research Issues; Venkatesh Shankar, J. Jeffrey Inman, Murali Mantrala, & Eileen Kelley, 2011; Journal of Retailing, 87S (1), pp. S29-S42.

(3) See other research on path data modelling and analysis in marketing and retailing by Hui with Peter Fader and Eric Bradlow (2009).

Leave a comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.