Create new

Welhuis Dakwerken Chatbot agent image

Test Details

Overview

Test Overview

This report details the findings of a visual asset pre-test conducted by BrandPulse for Wellhuis Dakwerken. The primary objective was to identify the most effective image to represent their chatbot, optimising engagement and brand perception through data-backed insights. We leverage AI insights + human feedback to identify your top-performing asset with confidence, utilising audience signals, engagement points, and a Stopping Power Rating (SPR).

Type

Image Testing

Test period

5 days

Completion date

April 15, 2025

Location Targeting

  • Aalsmeer, Netherlands
  • Amstelveen, Netherlands
  • Amsterdam, Netherlands
  • Badhoevedorp, Netherlands
  • Haarlem, Netherlands
  • Hoofddorp, Netherlands
  • IJmuiden, Netherlands
  • Weesp, Netherlands
  • Zeist, Netherlands
  • South Holland, Netherlands

Languages

  • English
  • Dutch

Demographics

Gender

Male, Female

Age Groups
  • 18-24
  • 25-34
  • 35-44
  • 45-54
  • 55-64
  • 65+

Intent Signals

  • All Intent Signals

Passion Profiles

  • All Passion Profiles

Life Milestones

  • All Life Milestones

Package Details

Silver Package

Performance Overview

Best Performing Asset

Man - Realistic
Man - Realistic 79 SPR Scores

Human Audience Signals

34.753 Combined reach

VS 30.000 bought audience signals

Confidence Level

95% based on Chi-Square Analysis

VS 80% bought confidence level

Demographic Distribution

Gender Distribution

Total
100%

Age Distribution

Total
100.0%

Asset Performance

Winner: Man - Realistic

Asset

SPR Score

Audience Signals

Man - Realistic
Man - Realistic Realistic
79

6738

Robot - Cartoon
Robot - Cartoon Cartoon
52

6754

Woman – Cartoon
Woman – Cartoon Cartoon
42

7220

Man - Cartoon
Man - Cartoon Cartoon
41

7289

Woman - Realistic
Woman - Realistic Realistic
35

6752

Detailed Asset Analysis

Winner: Man - Realistic

In-Depth Visual Analysis

Each asset has been analyzed using our proprietary AI-powered Visual Heatmap Technology , which identifies areas of high visual engagement and attention. The heatmaps reveal how users interact with different elements of each image, highlighting focal points and areas that drive engagement. This data-driven approach allows us to understand why certain visuals perform better than others and provides actionable insights for optimizing your visual assets.

View all assets

Man - Realistic
Man - Realistic
Original AI Heatmap

Man - Realistic

Realistic

AI Insights

Powered by AI

The realistic male avatar shows strong engagement, with attention focused on the facial expression and company branding. The authentic appearance and professional attire create trust and relatability. High attention to the logo suggests strong brand recognition.

  • SPR Score 79
  • Probability to be Best 91.9%
  • Audience Signals 6738
Robot - Cartoon
Robot - Cartoon
Original AI Heatmap

Robot - Cartoon

Cartoon

AI Insights

Powered by AI

The robot avatar generates significant interest, particularly around the distinctive headset and expressive features. The modern design aligns well with the chatbot context, though it may feel less personal than human avatars.

  • SPR Score 52
  • Probability to be Best 6%
  • Audience Signals 6754
Woman – Cartoon
Woman – Cartoon
Original AI Heatmap

Woman – Cartoon

Cartoon

AI Insights

Powered by AI

The cartoon female avatar creates good engagement with its friendly expression. The thumbs-up gesture draws attention, creating a positive association with the brand.

  • SPR Score 42
  • Probability to be Best 0.9%
  • Audience Signals 7220
Man - Cartoon
Man - Cartoon
Original AI Heatmap

Man - Cartoon

Cartoon

AI Insights

Powered by AI

The cartoon male avatar receives moderate attention, with focus split between the facial features and branding. While approachable, it may not convey the same level of professionalism as the realistic version.

  • SPR Score 41
  • Probability to be Best 0.2%
  • Audience Signals 7289
Woman - Realistic
Woman - Realistic
Original AI Heatmap

Woman - Realistic

Realistic

AI Insights

Powered by AI

The realistic female avatar attracts attention to the facial region and company branding. The professional appearance resonates with audiences, though engagement metrics suggest room for optimization.

  • SPR Score 35
  • Probability to be Best 0.2%
  • Audience Signals 6752

Statistical Analysis

Explanation of Tests

1

Chi-Square Test

Tests whether the differences in click behavior across all assets are statistically significant.

Result: Significant at 95% confidence (p = 0.0361)

2

Z-Test

Compares the top two performing assets directly.

Result: Significant at 80–85% (p = 0.128)

3

Bayesian Test

Estimates the probability that each asset is truly the best.

Result: Man – Realistic has 91.9% probability

Statistical Significance Matrix

Image Asset

95% Confidence Level

Chi-Square Test

85% Confidence Level

Z-Test

Bayesian Best Probability

author
Man - Realistic

P= 0.0361

p = 0.128

91.9%
author
Robot - Cartoon

P= 0.0361

p = 0.128

6%
author
Woman – Cartoon

P= 0.0361

-

0.9%
author
Man - Cartoon

P= 0.0361

-

0.2%
author
Woman - Realistic

P= 0.0361

-

0.2%

Key Insight: The Power of Human Connection

Human-like visuals, especially with direct eye contact, consistently outperformed abstract or indirect designs, generating stronger engagement and more positive user response.

The results of this test underscore the importance of human connection in digital interactions. The realistic male image resonated strongly with users due to its authenticity and relatable expression, leading to higher engagement and trust.

The attention heatmaps further confirmed that eyes, facial symmetry, and contrast were key to visual engagement, highlighting the elements that make a visual asset truly compelling and effective in capturing attention.

Recommendations & Next Steps

Implement Winning Asset

Use “Man – Realistic” as chatbot visual across all digital touchpoints.

Realism Wins

Focus on authentic expressions and eye contact for higher engagement.

Follow-Up Test

  • Explore female versions with stronger gaze
  • Test color background variations
  • Add subtle animation to enhance interaction

Based on the data-driven insights from this test, we recommend implementing the “Man – Realistic” asset as your chatbot visual. Future testing could explore female versions with stronger gaze and further refine visual cues for optimal engagement.

95% Confidence Level

Results at this level indicate very strong statistical confidence in the findings.