Chapter 22 · Canonical English edition

22. Level 2: Qualitative Data and Cross-Cutting Observations

Functional Systems Facilitation · Dmitry Shamenkov

Section 30 of 53version 1.1 · July 2026Source: Book_OD
← Book contents

22. Level 2: Qualitative Data and Cross-Cutting Observations

The direct quantitative data of the first level give rigorous but narrow answers. The second lens is the large body of qualitative data accumulated over years of practice. I will describe three main sources.

The “Key to the Result” Intensive: 526,000 Characters of the Living Fabric of the Process

I have already drawn on this material in detail in Part III, chapter 16. Here I want to underscore its status as second-level empirical evidence.

“Key to the Result” (March 16–20, 2026) was an Intensive that we documented especially fully — we collected all 641 chat messages, all of the participants’ reflections, all the markers of engagement. The result was a body of 526,000 characters of coherent text written by 55 participants in the very midst of transformation.

This is a special kind of data. Not an after-the-fact review (“liked it,” “was useful”), not an interview a year later (“did it help”), but synchronous self-reflection by participants in the very process of change. Such bodies of material are extremely rare in practice, because usually there is no one to collect them and no one to process them. We have them — thanks to the architecture of the platform and a culture of written reflection.

What does this data show?

Engagement metrics (the main figures from chapter 16, repeated here):

  • 83% retention from the first day to the fifth (high relative to typical online-course completion, commonly 15–30%, though the populations and formats differ substantially);

  • 95% of participants actively wrote reflections (52 of 55);

  • 75% worked all 5 days out of 5 (41 of 55);

  • An average of 11 messages per participant over the Intensive.

Cross-cutting patterns of change, found in the analysis of all 55 reflections:

  • Shame as the fundamental currency of self-prohibition (40+ people);

  • The diagnostic as a turning point (30+ people, 55%);

  • Projection onto the group’s shared space as a mirror for one’s own work (50+ people);

  • The body as an indicator of authentic material (30+ people);

  • The integration of the ancestral theme (15+ people).

Concrete external results over 5 days — a job offer, a paid-off loan, a passed interview, the discovery of a root conflict, a new source of income, and so on.

These observations are not interpretations. They are direct evidence from the participants’ own texts, verifiable by anyone who cares to check.

75+ Recorded Case Discussions: An Archive of Transformation

Alongside the Intensives, I regularly conduct case discussions — a format in which a participant brings a concrete life request into the group space. By the time of this writing, the program’s archive has accumulated more than 75 recorded case discussions — across different requests, different groups, and different participants⁴.

This is a rare body of material for empirical analysis. With it, one can:

  • See which types of requests, at what frequency, lead to which changes;

  • Track how one and the same participant moves through several case discussions across different periods of life;

  • Notice which speech markers precede a breakthrough and which precede getting stuck;

  • Study how different facilitators work with the same types of requests.

For now this material serves as a training base for preparing facilitators and as raw material for further scientific analysis. Some of the conclusions drawn from it are already built into the architecture of the AI-based self-assessment tool discussed in chapter 16A.

The AI Self-Assessment Tool: 1,100+ Completions and 220,000 Reflections

The third block of qualitative data is the body of material accumulated through the self-assessment tool on the site money.shamenkov.com.

The numbers as of this writing: — 220,000 reflections from program participants over 15 years — the corpus the model was trained on; — More than 1,100 people have completed the self-assessment; — 35,000 characters on average in each participant’s personal report; — 52% of completed self-assessments show self-worth as the leading limiting pattern.

In chapter 16A, I described in detail the four mechanisms through which the tool works. Here I will add an observation about its precision: participants with many years of therapy experience (“15 years in therapy,” “a degree in psychology,” “I’ve taken every course I know of”) reproducibly report that the tool shows them what had previously remained hidden. This is not evidence that therapy did not work; it is evidence that AI analysis of the questionnaire operates in a different mode of seeing — structural, pattern-recognizing, impersonal — which sometimes proves more effective for a breakthrough than long therapy.

What the Second-Level Data Teaches

Qualitative data does not yield “percentages” in the strict sense. But it gives what the numbers cannot: a structural picture of what is happening. It shows that transformation is not a single event but a process with a predictable architecture: entry, encounter, deepening, integration, completion. It shows that in people of different ages, professions, countries, and histories, the same inner mechanisms are at work — shame, the isolation of a pattern, giving oneself permission to be. It shows that change is possible even for those who have already despaired (15 years of therapy — and they saw the root conflict for the first time).

This knowledge cannot be obtained from quantitative scales alone. This qualitative material carries its own evidential value — grounded in many independent, documented cases — though it is not a substitute for controlled quantitative data.