Research agencies have a specialization problem
Editor’s note: Jiten Madia is the founder of myMRPlace. With over two decades of experience across market research, consumer insights and ResTech, Madia pursues ideas, concepts and trends resting at the intersection of technology and qualitative research practice. He is an alumnus of Chicago Booth and holds an MBA in marketing from NMIMS, Mumbai. His background across the client and agency side equips him to take a unique, practitioner-focused view of technology and its applications to commercial market research. Find Madia on LinkedIn.
On paper, the insights industry is healthy. Esomar sizes the global insights industry at $153 billion, up from $142 billion the year before. But look inside the number and the sense of comfort disappears. Esomar's own breakdown shows that growth stems from research software-sector platforms. Within the market research sector, the traditional full-service model still accounts for roughly 65% of turnover and is the slowest-growing slice of the industry.
Forrester finds that 98% of B2C companies now have some form of in-house insights or research function. Industry analyses of CPG insights teams describe internal vs. external research spend shifting from the traditional 30/70 split toward 50/50 or even 60/40 in favor of internal. This is driven by in-house capabilities, technology platforms and AI-moderated research replacing agency-led projects.
All in all, agencies are being squeezed from two directions at once: software eating the execution layer from below, and in-house teams absorbing the work from above.
What clients are actually asking for
Ask any agency what clients demand and the answer comes back instantly: actionable insights. It is the most requested yet least defined deliverable in marketing research.
More importantly, this demand is real and measurable. In a McKinsey survey of over 700 businesses, 65% of respondents believed that customer insights should act as a thought partner to the entire organization. At the same time, only 36% considered the majority of their insights staff to be insights consultants who interpret data and partner with business units.
Similarly, Forrester reported that 57% of B2C marketing decision makers believe that their insights team takes too long to deliver usable insights. Today, this gap between what decision makers want and what they receive is not a data gap – data has never been more abundant.
Here's one way to decode the McKinsey and Forrester findings: Insights feel actionable when they are delivered right. An insight lands as actionable when a clear story emerges from the evidence, when the decision maker can see what the findings mean, why they hold and what to do next. The client asking for actionability is, underneath, asking for storytelling.
Building a story on thorough analysis, backed by evidence
This is where agencies routinely take a wrong turn. They hear storytelling and reach for the surface: better slide design, punchier headlines, a narrative-arc workshop for the team. But a lot of this might be "momentary slickness" – a story that looks and sounds good when narrated.
Sure, slick is helpful. Research on processing fluency shows that narratives are processed more easily than the same information delivered as disconnected facts. Narratives that are easier to process drive engagement and retention. However, in-the-moment fluency is a floor effect – a slick story that may collapse a week later when faced with hard questions from a stakeholder who knows their market. What survives that collision is a story built on thorough analysis, where every claim can be traced back to evidence, and where the researcher understands the category well enough to judge which findings aid decision-making and which are noise.
In other words, good storytelling is not a presentation skill. Instead, it is the visible output of two invisible inputs: analytical rigor and sectoral expertise.
Sectoral expertise is valuable and hard to find
Here's the industry's uncomfortable truth: The way agencies are structured makes that second input (sectoral expertise) nearly impossible to accumulate. Our industry has evolved so that everyone does everything. There are contexts where being a generalist is a legitimate strategy. I have written elsewhere about when it works and when it doesn't.
But consider what specialization actually looks like inside most agencies. Even in large firms, the client servicing team's specialization label reads financial services. Or worse, financial services and automotive. Anyone who has worked on the client side knows that category dynamics of banking differ from credit cards, and credit cards from insurance. A team servicing all three under a label of “finance” cannot possibly build the depth that storytelling requires ... not because the team lacks talent but because 'finance' is not one category. Context, consumer behavior and industry dynamics differ considerably between the three categories.
And a researcher without category depth cannot judge which findings to weave into the story and which to set aside. So, the honest output is the comprehensive one – an 80-slide deck that reports everything (and commits to nothing). A comprehensive summary of findings is possibly the most automatable artefact (research software can generate it). And an internal team with platform access can produce it themselves. Which means that the generalist agency's default deliverable is the one with the least defensible value.
The market already pays for the alternative
Consulting firms are paid multiples of what research agencies earn for work that often rests on either thinner primary evidence or on the data that is collected by research agencies. A large part of that premium is earned by storytelling supported by sector-specific domain knowledge. Consulting firms walk into briefs with a category context and walk out having delivered committed, challengeable narratives. Clients pay them more because a clear, testable story is worth much more when it comes to making business decisions.
The fee gap between consulting and marketing research is, in part, the market's way of pricing the difference between facts delivered vs. clarity delivered.
Storytelling requires expertise. Commit to a sector
If good storytelling requires sectoral expertise, and sectoral expertise cannot accumulate in an everyone-does-everything structure. A long-term path for an agency is one that commits to a sector and goes deep enough, for long enough, so that they earn the right to story tell in that sector. Multiple studies in the same category. Teams that stay and grow foster lasting client relationships. Knowledge that compounds.
This strategy is an antidote to competing with in-house teams. In-house teams have context, but they rarely have the bandwidth or the flexibility to absorb every wave of demand and an agency with sector expertise offers spend flexibility to clients: deep capability available on demand, without the fixed costs.
As the software sector grows faster, and as more capabilities are moved to in-house teams, the scope of generalist agencies does get thinner. Agencies that survive this crunch will be the ones that picked a sector, stayed and turned depth into the one deliverable the machines cannot make: Clarity.