How far can an AI assistant get along a software demo path?
A correct account of the demo route did not always reach its destination. In the Agent Gap demo-path task on 6 October 2026, all 70 initial results were scored correct, while 44 reached the defined endpoint. The endpoint was a handoff, not proof of a booked meeting or a completed sale.
What we measured
Measured. The Agent Gap demo-path method used the ChatGPT Work browser interface for one initial task on each of 70 selected vendors. It recorded 70 found destinations, 70 correct results and 44 reached outcomes in this task. The 26-session difference is a calculation between these two recorded counts, not a count of lost buyers.
The study's Describe and Pricing page tasks are separate. Its 30 preselected repeat sessions are also separate from this 70-session demo base. The collection took place on 6 October 2026 using one assistant interface.
The data does not establish why every path stopped, whether a human would have continued or whether any meeting was booked.
Our answer-study method, v1.1.
What this means for you
Reasoned. Divide the route into the information the assistant found and the point it actually reached. A clear description of where to request a demo can be correct even when a later step falls outside the demonstrated path.
Keep the destination evidence beside the result. If the task ends at a handoff, describe that endpoint as a handoff. Do not write “demo completed” when the record contains no completed demonstration, scheduling confirmation or buyer attendance.
- If you publish the route: make the next step and any required human action visible before a visitor reaches it.
- If you assess an assistant: ask to see the final page or recorded endpoint, not only the narrative summary of the attempt.
- If you report performance: retain the 70 correct and 44 reached counts separately. They measure different conditions.
A failed endpoint is a reason to inspect the actual path, not proof that a form needs a redesign or that a buyer was lost. The dated record can identify the point to investigate; a proposed change still needs a source and a clear acceptance check.
Also asked as
How far can an AI assistant get along a software demo path?
Related
- Agent Gap demo-path study
- Does a handoff mean a purchase?
- Finding versus understanding
- Turn a finding into a work order
Next step
Use Free 10-question check (one engine) for a dated answer observation, keeping it separate from any test of a website's demo route. No email is needed; runs are limited per network and per day, and by the site's daily allowance.
If an inspected route points to one unsupported or unclear page explanation, Fix one answer, $490. State the public destination and the change you can verify.
Prepared by the Broadcastwell team.
Page owner: Vikram Patel, AI Architect. Corrections: hello@broadcastwell.com