In-store Mockup Validator

Bridging retail’s “attitude-behavior gap” through expressive, data-driven IoT product mockups.

Tools & Methods

Figma, HTML, Arduino, Processing, Claude AI, Lovable

Duration

Solo, 5 months

My Role

Lead Creative Technologist

Project Overview

I redesigned the In-Store Mockup Validator ™ initiated by Bamboo Brands to be an interactive IoT system that replaces costly, waste-heavy product pilot runs, with playful shelf agents capable of capturing real-time behavioural data.

Bamboo Brands builds in-store validation tools to help companies test new products before they hit the market. The idea was promising, but early tests with a simple mechanical string made shoppers fee “fooled” and “scammed”.

I led the interaction strategy and research to a new system architecture with Artificial Intelligence system to process data and interpret customer’s behaviour. By detecting intent at ≤ 7cm, we turned retail frustration into curiosity while capturing real-time behavior data via Data Foundry.

Problem Space

The current method of validation process of Fast Market Consumer Goods Industry is crucial to understand consumer behavior and ensure commercial success in high speed market. However, current method can be undermined by the attutude behavior gap which is the misalignment between consumer’s stated intentions in traditional research settings and their actual purchasing behavior in real purchasing environment.

The ISMV embeds the IoT technology into interactive shelf mockups to shift product testing to a much earlier stage, before everything is mass-produced.

Solution

While the client initially focused on tracking physical “pickup” , my contextual research revealed that customer interest begins well before contact. I discovered that the interaction actually starts at approximately 7 cm away. Therefore, I reframed the mockup from a “fake product” to an expressive character that acknowledges the shopper’s approach. We could turn this initial frustration into a moment of “magical” curiosity.

30%

Increase in user experience than previous model.

2/3

Score in ease of use based on the user testing.

The ISMV in action! Taken during a university-wide demo day with mini supermarket stand

Requirements

  1. The mockup must visually integrate with the surrounding shelf products.

  2. The interaction should occur at the shelf, with the mockup remaining in place.

  3. The system must be durable and low maintenance for buys retail environment.

  4. Interaction must be unobtrusive to the customer's shopping experience.

  5. The system must capture and store customer engagement data for evaluation by Bamboo Brands.

Research & Discovery

I mixed field research, semi-structured interviews, workshops and rapid prototyping to explore interactions that would result in a delightful user experience in super market

Final Outcome

The final design was presented in the Summer Demo day 2025 in Eindhoven University of Technology. The client stated that they were content with the result, providing a more interactive and unique approach to gather data from the customer.

I delivered a working prototype that is able to:

  • Do a proximity-first interaction: I replaced string with an ultrasonic sensor to detect a hand approaching at approx. 7 cm, triggering the mockup to “turn” and greet the user before contact

  • Gestural storytelling: I programmed a servo-based “dance” that responded to a survey participation, creating a playful dialogue between user and the shelf agent.

  • Phygital Data Loop: I engineered an IoT architecture using Arduino Nano ESP32 and Data Foundry, through vibe coding, the system enabled Bamboo Brands to monitor footfall and dwell time in real-time.

This Graduation project was awarded with 8,5/10.

Read the full report here.

Key Learnings

  1. Business constraints aren’t barriers; they are design parameters.

By mapping the stakeholder value exchange, I discovered how to deliver the high-fidelity behavioral data Bamboo Brands required while protecting the user's emotional experience

  1. Co-creation to prevent tunnel vision and uncovering hidden emotional needs.

This helped me look past the technical brief to find out user's needs that ultimately defined the ISMV’s character

  1. Importance of continuous rapid prototyping

By failing fast and often, I was able to quickly eliminate these unpleasant interactions

Other projects

Copyright 2025 by Alisha Hidayat

Copyright 2025 by Alisha Hidayat

Copyright 2025 by Alisha Hidayat