Brian and Andrew sit down with Karine Pepin of The Research Heads and Andrew Gordon of Prolific to break down one of the most important data quality studies the industry has produced. They analyzed 5,200 respondents across 10 platforms and the findings will surprise you.

AI agents are not in your data. Outside of MTurk, detection rates were below 0.5% across every platform type. And the things getting flagged on MTurk? Old-school bots, not LLMs. When they ran actual AI agents through the same survey, those agents outperformed real human respondents on nearly every quality measure.

The actual crisis is your human respondents and the platform you are buying them from.

Key Takeaways:

• Agent infiltration is not the crisis the industry thinks it is

• What is actually getting flagged as bots on MTurk, and what it really means

• Why the human quality gap between direct panels & marketplace platforms is the story nobody is telling

• Why the cheapest sample per click is often the most expensive data you will ever buy

Link to the study "AI Agent Prevalence and Data Quality Across Multiple Online Sample Providers"

If you loved the episode, have comments, or want to appear on the show, connect with us down below!

Connect with us:

• LinkedIn

• YouTube

• ROI Rocket

Connect with Karine Pepin:

• LinkedIn

Connect with Andrew Gordon:

• LinkedIn
  

Brian and Andrew sit down with Angela Chavez, Insights Manager at Dig Insights and UGA MMR graduate, ahead of her first-ever conference presentation at the Future of Insights Summit in Athens this August.

Angela's talk is called "Learning Research in a Rapidly Changing World," and this episode is a preview of exactly that. She walks through what it has actually been like to enter the industry as AI was exploding, going from hesitant early adopter to someone who opens ChatGPT as a reflex, all while growing from analyst to manager.

The conversation also gets into Dig Insights' tech-forward approach and what Angela's early career experience reveals for senior leaders trying to figure out how to onboard, train, and develop the next generation of researchers right now.

Key Takeaways:

• What it is actually like to learn research and AI at the same time, in real time

• How Angela balances keeping up with new tools while still doing the work

• Where the gap between academic foundation and real-world practice still shows up

• Why early career researchers have a perspective that senior leaders should be paying attention to

If you loved the episode, have comments, or want to appear on the show, connect with us down below!

Connect with us:

• LinkedIn

• YouTube

• ROI Rocket

Connect with Angela Chavez:

• LinkedIn

• Dig Insights
  

Andrew is back from his honeymoon, and Brian is very glad to have him. This one is part reunion, part rant, and entirely worth listening to.

First, the honeymoon stories. American Airlines lost three out of four bags for six days. The Vatican Special Police detained Andrew and his wife in the Sistine Chapel after mistaking them for a couple who had made terrorist threats. The Secret Service showed up at the wedding because of a drone and a Vice President flying nearby. All of this is true.

Then it gets into industry territory. Brian recaps the Verisoul-sponsored Cincinnati Reds event that brought together 40 companies and became an impromptu who's who of the Cincinnati research community, with a surprise appearance from Insights Association CEO Anita Watkins. The conversation builds into a genuine debate about who actually has the microphone in market research right now, whether the loudest voices at conferences are the most credible ones, and what it means that the biggest booths increasingly belong to companies with outside capital rather than the most rigorous methodologies.

Brian and Andrew close with a quick AI check-in, a plug for the upcoming July 9th webinar on the trust deficit in sample, and a tease of future episodes where they plan to screen share and show what they are actually building.

Key Takeaways:

• Why the Vatican Special Police detained Andrew and Brooke on their honeymoon, and how it ended

• Why Verisol's Cincinnati Reds event was one of the best community-building moments the local research scene has seen

• Whether the people with the loudest voices at industry conferences are the right ones to have the microphone

• What traditional research firms can do to compete for visibility in a world where outside capital buys the biggest booths

• Why AI is now part of daily life, not just a work tool, and what Brian has been quietly building with it

If you loved the episode, have comments, or want to appear on the show, connect with us down below!

Connect with us:

• LinkedIn

• YouTube

• ROI Rocket

Brian sits down with Samuel Cohen, CEO of Fairgen, for a no-fluff conversation about what is actually happening in synthetic data and who is positioned to win as the space matures.

Samuel cuts through the vendor noise fast: most companies claiming to train models on millions of survey responses are not doing that. What is under the hood is usually far simpler, and the lack of transparency is quietly eroding trust in the whole category. Fairgen's answer is to model at the individual level and be open about how it works.

The conversation also covers how collapsing time to insight is changing research workflows, where digital twins fit alongside real respondents in the next few years, and Samuel's unfiltered take on which players are well-positioned and which ones need to rethink their model now.

Key Takeaways:

• Why the data behind the model matters far more than which LLM is powering it

• What most synthetic vendors are actually doing versus what they claim

• Who wins as synthetic data matures and who is in trouble

• What are the best use cases for Digital Twins & Synthetic Data

If you loved the episode, have comments, or want to appear on the show, connect with us down below!

Connect with us:

• LinkedIn

• YouTube

• ROI Rocket

Connect with the CEO of Fairgen, Samuel Cohen:

• LinkedIn

• Fairgen
  

Andrew is in Italy on his honeymoon, a guest backed out, and Brian decided to go solo for the first time in 10 years of podcasting. No co-host, no guardrails, no agenda. Just 30 years of experience and a list of questions he has been sitting on for a while.

None of them has clean answers. Thats kind of the point.

Brian works through six questions the market research industry is not asking loudly enough: whether stacking fraud tools without coordination is quietly introducing a new category of data quality bias, who actually owns the definition of quality when nobody agrees, whether synthetic data is a legitimate solution or a convenient way to avoid the harder problem, where the next generation of researchers is coming from and whether the industry even knows what skills it needs to fill that pipeline, why market research is one of the only professions that shapes billion-dollar decisions without any required accreditation, and whether the M&A wave is actually good for research quality or just good for returns.

These are not gotcha questions. Brian is not here to throw anyone under the bus. But he is willing to say some things out loud that tend to get avoided in favor of AI hype cycles and vendor showcases, and this episode is the result of that.

Key Takeaways:

• Why stacking uncoordinated fraud tools may be creating invisible bias, not solving fraud

• Why the quality definition problem may eventually be settled by procurement departments instead of researchers

• The legitimate use cases for synthetic data and the less legitimate reasons adoption is accelerating

• Why the researcher talent shortage is really two problems bundled into one

• Why market research informs billion-dollar decisions with zero required accreditation

• Why consolidation looks like efficiency at first, and what history tells us happens next

If you loved the episode, have comments, or want to appear on the show, connect with us down below!

Connect with us:

• LinkedIn

• YouTube

• ROI Rocket

In this episode, Brian and Andrew sit down with Dan Entrup, co-founder of AggKnowledge, to talk about one of the most overlooked drivers of the data quality crisis: the respondent experience nobody is actually fixing.

Dan tracked every research outreach he received over 15 months and turned it into a SampleCon presentation. The numbers were brutal. 137 times asked his age. 57 dental requests sent to someone who has never been a dentist. An inbox so flooded with irrelevant surveys that even a motivated expert panelist nearly quit. His point is sharp: bad targeting is not just inefficient, it is actively killing the panels we depend on.

The conversation gets into what AggKnowledge is building to solve it upstream, why free-text profiling and stale data are quietly sabotaging research operations at scale, and why identity verification and workplace verification are not the same thing. There is also a candid take on the M&A and funding landscape, who is well-positioned, where the yellow flags are, and why human knowledge only gets more valuable as AI takes over everything else.

Key Takeaways:

• Why bad targeting is a fraud accelerant, not just a waste of budget

• What 15 months of tracking his own respondent experience revealed about how broken outreach really is

• Why the gap between identity verification and workplace verification is where embellishment hides

• How upstream profiling data can reduce fraud before a screener is ever sent

• Why companies beating on revenue are still seeing their stock drop, and what that signals for the research industry M&A

If you loved the episode, have comments, or want to appear on the show, connect with us down below!

Connect with us:

• LinkedIn

• YouTube

• ROI Rocket

Connect with Dan Entrup:

• LinkedIn

• AggKnowledge

• It's Pronounced Data (Newsletter)

This episode is the bonus round to Brian and Andrew's four forces webinar. They ran out of time on the live session, so they saved the best part for here: where all four trends are actually pointing and what it means for how research gets done.

Andrew lays out the clearest version of the webinar's thesis: capital, AI, and the data quality crisis are not three separate things. They are converging forces pushing the industry toward methodologies that are more transparent, more respondent-friendly, and more operationally feasible than what came before.

From there, the conversation gets specific on async qual, AI-led conversational interviewing, and agentic research. Andrew makes a sharp argument that the next step change in automated research will not come from software companies selling AI tools. It will come from agencies building proprietary workflows trained on their own data and methodological history. The agencies that do that work now will have a moat that an off-the-shelf product cannot replicate.

The episode closes with Brian's take on four things the disruption narrative tends to get wrong, including why qual is not dying and why the trust crisis will not be solved by more technology.

Key Takeaways:

• Why the four trends are a single converging story, not four things happening in parallel

• What AI-led async qual does better than scheduled IDIs and why it matters for panel health

• Why agentic research workflows will be built by agencies from the inside, not sold to them as products

• Why qual is not dying and why AI quant cannibalises quant budgets, not qual budgets

• Why the trust crisis is a culture problem, not a technology problem

If you loved the episode, have comments, or want to appear on the show, connect with us down below!

Connect with us:

• LinkedIn

• YouTube

• ROI Rocket

In this special episode, Brian and Andrew bring their live webinar to the podcast feed. Drawing from recent conferences, client conversations, and industry reports, they break down four forces reshaping how research gets done: Capital Influx, the Data Quality Crisis, AI Disruption, and Methodology Reframe.

Brian's core argument is that these are not four separate trends. They are one larger story with feedback loops accelerating each other, and the industry does not get to choose whether the shift happens, only whether it leads or follows.

The episode also features a live Q&A, including a sharp exchange on whether there are research categories where AI should not be used yet, and a direct answer to how you sell quality to a client who thinks $12 CEOs are fine.

Key Takeaways:

• Why OpenAI and Anthropic’s launch of deployment consulting firms is a competitive threat the insights industry needs to take seriously

• What the latest GDQ benchmarks reveal, including a 59.6 percent post-survey removal rate in B2B

• Why the biggest fraud risk is not bots but humans using AI to fake qualifications and game incentives

• Why synthetic data still needs proof, and why every credible synthetic platform still anchors to a verified human sample

• Why the qual and quant divide has not just blurred, it has effectively disappeared

If you loved the episode, have comments, or want to appear on the show, connect with us down below!

Connect with us:

• LinkedIn

• YouTube

• ROI Rocket