A Worthless Headline: How Bing’s Idea Was Their Biggest Win
Picture this: You’re a program manager at Microsoft in 2012. Your inbox is flooded with hundreds of feature requests from engineers across the company. Most are complex, resource-intensive ideas that promise revolutionary changes to how Bing displays search results.
Then there’s that email—a simple suggestion about changing how ad headlines appear. A few days of coding work, maybe less. You glance at it, shrug, and mark it “low priority.” After all, how much impact could tweaking a headline format possibly have?
Six months later, that dismissed idea would generate over $100 million in annual revenue.
Here’s what actually happened: A Microsoft employee working on Bing proposed a seemingly minor change to how the search engine displayed ad headlines. The idea required minimal effort—just a few days of engineering time—but it was buried among hundreds of other proposals. Program managers deemed it insignificant and let it languish.
The breakthrough came when an engineer, recognizing the low development cost, decided to test the idea anyway. He launched a simple A/B experiment to measure its impact. Within hours, the modified headline format was generating revenue at such unusually high rates that it activated the system’s automated “too good to be true” warning.
The results were staggering: a 12% increase in revenue, translating to more than $100 million annually in the United States alone.
But here’s the twist that should keep every business leader awake at night: This became Bing’s most successful revenue-generating idea in company history, yet until the experiment........





















Toi Staff
Sabine Sterk
Gideon Levy
Penny S. Tee
Waka Ikeda
Daniel Orenstein
Grant Arthur Gochin