AB Tasty and VWO have united, because half the loop was never enough.

Learn about the merger

Blog

How a City and a Sports Media Giant Work with Wingify to Test What Works: Their Passport to Success

4 Min Read
How a City and a Sports Media Giant Work with Wingify to Test What Works: Their Passport to Success

Back to Blog

When questions arise, a science museum is the perfect venue for a panel that opens with a deceptively simple question: what makes a good website? 

The honest answer is, it depends –  and is exactly the kind of thing you can only fully define through experimentation and testing. That was the thread running through the closing panel at Experience Next Amsterdam, where two guests from very different worlds sat down to compare and contrast their experience in the world of digital optimization. 

Two very different optimizers

Lukas, who studied AI and data science at the University of Amsterdam, now works on the website of the municipality of The Hague – optimizing it for the city’s residents. 

Johannes, on the other hand, oversees product analytics and experimentation as the lead of Digital Intelligence at Better Collective – which is a large sports media company whose brands span online sport media and eSports. 

Their businesses could hardly be more different. As a municipality, The Hague is non-commercial: it isn’t chasing revenue or maximum traffic, but has built its own model of what makes a good page — which is garnered toward the needs of visitors rather than increasing conversions alone. 

On the contrary, Better Collective juggles multiple revenue streams – such as affiliates, subscription paywalls, and ad revenue across several user journeys that shift with page type and content format.

The challenge: the same word, different metrics

Even a slight difference between two different metrics can completely change the shape of an experiment. 

For The Hague, KPIs are built page by page. Informational pages might be judged on whether people click a phone number – which is a sign that the page isn’t doing its job. 

CTA pages are measured on two metrics: CTA percentage (the higher, the better) and contact percentage (the lower, the better). But even that can be misleading: a passport application page might show a great CTA rate, yet if residents arrive at the municipality with badly filled forms – the page will fail. 

“We always try to look further than just the percentages,” Lukas, insert job title from slides here – make this quote 

Johannes faced a similar challenge: aligning many teams and brands on what to measure in the first place. In turn, both named the same overarching disruption – AI fundamentally changing the role of experimentation, A/B testing, and CRO. 

For Johannes, that means the daily work of many team members is continuously evolving, and it demands clean data. As he iterated in his presentation, if you dump garbage into AI â€“ you’ll get garbage out. 

That’s exactly why his team is building a new data architecture with a global naming convention and tracking logic, designed to feed MCP servers and unlock better experimentation. 

For Lukas, the challenge is more fundamental still: defining what a good municipal webpage even is.

How they overcame it: research first, then small changes

Both guests landed on the same principle: if you understand the user before you optimize for them. Johannes described combining product analytics with user research and surveys to find out what users actually care about instead of assuming what they wanted most.

The payoff wasn’t just better tests, but stronger hypotheses. 

“When we do research, the hypothesis is so much stronger.” – Quote Johannes here, cross check slides

Lukas’s approach is grounded in a similar concept. The Hague classifies every page by its goal and attaches a tailored set of KPIs, then strives to look beyond them.

The proof: two small changes, two big lessons

Lukas shared a series of tests that all pointed the same way. On the passport page, the menu and the title above the CTA read “applying for a passport.” But data and surveys showed people couldn’t find it, because they were looking for an appointment. 

Changing the wording from “apply for a passport” to “make an appointment” lifted conversion by a whopping 8%. A similar wording change on the homepage had a comparable, measurable effect. The lesson here is that people tend to scan for specific keywords, and if they don’t find them – they don’t find the button.

Johannes’s example came from review pages ranking “the best bookmaker.” By pairing analytics with user research, his team lifted CTA clicks and click-through rate by around 10%.

The takeaway

The panel’s message was that experimentation looks different in every organisation – a municipality optimising for clarity, a media group balancing four revenue streams — but the discipline is the same. 

\Define what “good” means for each page, ground your hypotheses in research, and let small, well-targeted changes do the heavy lifting. And as Lukas noted, The Hague is ahead of the curve: one of the few municipalities actually running A/B tests, and happy to use a platform like Wingify to do it.

Because whether you’re selling subscriptions or passport appointments, the question is the same – and the only way to answer it is to test.

Stephanie Safdie

Stephanie Safdie holds a bachelor's degree in English Language and Literature from the University of Maryland, specializing in multimedia studies. She has worked as a social media video creator, freelance copywriter, SEO copywriter at Greenly climate tech, and runs a travel blog Destination Dreamer Diaries.

You might also love to read these

From Experiments to Better Decisions: How DNZ and Studio Anneloes Are Redesigning Experimentation
5 Min Read

From Experiments to Better Decisions: How DNZ and Studio Anneloes Are Redesigning Experimentation

When New Ideas Take Flight: How PagerDuty Put Wingz to Work on Experimentation Reporting
5 Min Read

When New Ideas Take Flight: How PagerDuty Put Wingz to Work on Experimentation Reporting

Hitting the Ground Running: How ASICS Turned Testing Speed Into Experimentation Velocity
5 Min Read

Hitting the Ground Running: How ASICS Turned Testing Speed Into Experimentation Velocity

The better way to test,
learn and grow

Get a Demo Start Trial