Is this workflow right for you?
You are considering a product-page rewrite because AI gives wrong or incomplete recommendations. This workflow checks whether the problem persists when the relevant offers are already in front of the model. For a discovery problem, start with the GEO Explainer linked through this question.
You are working towards: A recorded comparison that separates presentation from new information, with checked decisions, unresolved gaps and a reasoned next action.
What you’ll need
- Offer facts you may submit to the tool, plus customer requirements and an answer key written before the run. The supplied kit uses invented desks.
- For the tested route: Python 3, an authenticated Codex CLI and access to the requested model. Twelve sessions consume account usage; no API key is created.
- A fresh working folder and a separate reviewer who can check constraints, missing facts and source references.
The steps
Define what a correct decision looks like
Start with the customer’s constraints: budget, fit, deadline and service. Include cases where your offer fits, a competitor fits, no offer fits and facts are missing. Write the decision key before asking the model. The kit supplies six cases and three fictional offers.
Why this step · If “recommend our brand” is the success criterion, a confident wrong recommendation can look like progress.
Separate format from new facts
Compare prose with labelled bullets containing exactly the same facts and references. Put new information in a third version. Atlas changed only two fields there: confirmed Friday arrival and delivery with the desk assembled. In real work, verify added facts with their owner first.
Why this step · Adding a delivery guarantee while restructuring the page cannot tell you whether structure caused the difference.
Run fixed prompts in fresh sessions
Download the kit, inspect README.md and run.py, then run the command below from its extracted folder. The runner sends twelve fixed prompts in the frozen order, each to a new session; it saves the answers and refuses to overwrite a run. Do not expose the answer key to the model. Retain failures rather than retrying until the answer looks good.
Why this step · Shared chat history, changed questions or keeping only successful attempts can distort the comparison.
Adapt this promptpython3 run.py
Score the decision, then choose the next test
Have a separate reviewer inspect each raw answer against the four checks below. Count correctness separately from resolution: asking for a missing fact can be fully correct. Compare each case across all repetitions. If a failure appears, save changes in a new version and test unseen cases. If the baseline already works, identify another plausible cause before expanding the rewrite.
Why this step · A formatting tie, a useful rejection and an unresolved delivery condition lead to different business actions.
Open the files. See what each one does.
The complete offer-reading comparison
Exact executed prompts and runner, plus a preserved answer key, its correction and all recorded answers. The README and integrity manifest were packaged after the run.
markdown · Start hereDownload ↗
Tools, exact run command, output locations and adaptation limits.
README.md# Test whether AI understands your offer
This kit reproduces Atlas's supplied-information comparison. It does not test whether a search service discovers your page. Use the recorded example first, then create a separately versioned test for your own decision.
## Start
1. Download and extract the ZIP into a new folder outside your existing project. Open this README. Use only material you may submit to your chosen tool; the kit is entirely fictional.
2. Read record/TEST.md, record/PROTOCOL.md and record/ERRATUM.md. The grading key is deliberately absent from model prompts. Do not ask the model to inspect the whole kit: it would see the answers.
3. For the tested route, you need Python 3 and an installed, authenticated Codex CLI. Atlas used CLI 0.153.2 and requested gpt-6-astra with high reasoning effort. If your account lacks that model or the flags have changed, record a new configuration; it is a different comparison.
4. Inspect run.py. In a terminal in this extracted folder, run:
```sh
python3 run.py
```
This starts twelve serial fresh sessions and uses your existing account allowance. No paid API key is added by the kit. Each session receives exactly one inputs/Rxx.md plus response-schema.json. Read-only permissions and an empty temporary directory are used. Normal execution rules remain in force; --ignore-user-config isolates this instrument's configuration and is not advice for ordinary project work. No tools are needed or requested. If the CLI reports a tool call or failure, the runner stops. If interrupted or timed out, retain that folder as a failed attempt and investigate; do not silently overwrite or retry it.
Each completed session saves runs/Rxx/record.json and response.txt. The runner refuses to overwrite an existing run directory. It captures final messages, usage and diagnostics, not reasoning traces. It does not grade answers or enforce that a model follows every instruction. Check the actual records.Read all files as text
README.md
Tools, exact run command, output locations and adaptation limits.
# Test whether AI understands your offer
This kit reproduces Atlas's supplied-information comparison. It does not test whether a search service discovers your page. Use the recorded example first, then create a separately versioned test for your own decision.
## Start
1. Download and extract the ZIP into a new folder outside your existing project. Open this README. Use only material you may submit to your chosen tool; the kit is entirely fictional.
2. Read record/TEST.md, record/PROTOCOL.md and record/ERRATUM.md. The grading key is deliberately absent from model prompts. Do not ask the model to inspect the whole kit: it would see the answers.
3. For the tested route, you need Python 3 and an installed, authenticated Codex CLI. Atlas used CLI 0.153.2 and requested gpt-6-astra with high reasoning effort. If your account lacks that model or the flags have changed, record a new configuration; it is a different comparison.
4. Inspect run.py. In a terminal in this extracted folder, run:
```sh
python3 run.py
```
This starts twelve serial fresh sessions and uses your existing account allowance. No paid API key is added by the kit. Each session receives exactly one inputs/Rxx.md plus response-schema.json. Read-only permissions and an empty temporary directory are used. Normal execution rules remain in force; --ignore-user-config isolates this instrument's configuration and is not advice for ordinary project work. No tools are needed or requested. If the CLI reports a tool call or failure, the runner stops. If interrupted or timed out, retain that folder as a failed attempt and investigate; do not silently overwrite or retry it.
Each completed session saves runs/Rxx/record.json and response.txt. The runner refuses to overwrite an existing run directory. It captures final messages, usage and diagnostics, not reasoning traces. It does not grade answers or enforce that a model follows every instruction. Check the actual records.
## Review
Keep outputs unchanged. Compare each answer with inputs/grading-key.json and its recorded erratum. Apply all four protocol checks, including meanings and source references. Count correct answers separately from resolved decisions. Share the outputs and facts with a separate reviewer. A competitor recommendation or no suitable offer can be the correct result.
The record/ directory contains Atlas's completed example, not your future result. Prompts and runner are unchanged from the executed version; this README and package manifest were prepared afterwards. The original protocol freeze is identified in TEST.md.
## Adapt only in a new version
Replace the fictional offers and requests with permissioned material. Write an answer key before asking the model. Include genuine fit, competitor fit, missing facts, deadlines and exclusions. Keep prose and structure semantically identical; put any new fact in a distinct condition. Freeze new inputs and update the manifest deliberately before running. Keep your model, settings and repetitions explicit. Reserve new customer cases for a later check rather than tuning everything to this example.
Stop after this reading-stage check if the actual business problem is discovery: a prompt that already supplies every offer cannot answer it. See the linked GEO Explainer for the distinction between being read, cited, recommended and purchased.run.py
Byte-identical runner used for the twelve sessions. Consumes account usage when run.
"""Serial, bounded Codex reading study. Saves final answers and usage, not reasoning."""
import json,subprocess,time,hashlib,tempfile,datetime,sys
from pathlib import Path
ROOT=Path(__file__).resolve().parent
def digest(p): return hashlib.sha256(p.read_bytes()).hexdigest()
def utc(): return datetime.datetime.now(datetime.timezone.utc).isoformat()
def execute(run_id,prompt,model='gpt-6-astra',effort='high',schema=None,study=True):
out=ROOT/('runs' if study else 'transport')/run_id
out.mkdir(parents=True,exist_ok=False)
started=utc(); t=time.monotonic()
with tempfile.TemporaryDirectory(prefix='atlas-offer-run-') as empty:
cmd=['codex','exec','--ignore-user-config','--ephemeral','--skip-git-repo-check','--sandbox','read-only','-c','approval_policy="never"','-m',model,'-c',f'model_reasoning_effort="{effort}"','--json','-C',empty]
if schema: cmd+=['--output-schema',str(schema)]
cmd+=['-']
proc=subprocess.run(cmd,input=prompt,text=True,capture_output=True,timeout=240)
# Parse in memory. Never preserve reasoning events or hidden reasoning in the study record.
record={'started_at':started,'finished_at':utc(),'elapsed_seconds':round(time.monotonic()-t,3),'requested_model':model,'reasoning_effort':effort,'returncode':proc.returncode,'prompt_sha256':hashlib.sha256(prompt.encode()).hexdigest(),'messages':[],'tool_events':[],'errors':[],'usage':None}
for line in proc.stdout.splitlines():
try: event=json.loads(line)
except json.JSONDecodeError: continue
if event.get('type')=='thread.started': record['thread_id']=event.get('thread_id')
if event.get('type')=='turn.completed':record['usage']=event.get('usage')
if event.get('type') in ('error','turn.failed'):record['errors'].append(event)
item=event.get('item',{})
if event.get('type')=='item.completed':
if item.get('type')=='agent_message':record['messages'].append(item.get('text',''))
elif item.get('type') not in ('reasoning',''):record['tool_events'].append({'type':item.get('type'),'status':item.get('status')})
if proc.returncode and not record['errors']:record['errors']=[{'error':'CLI exited unsuccessfully; no study answer. Inspect locally without publishing authentication or diagnostics.'}]
(out/'record.json').write_text(json.dumps(record,ensure_ascii=False,indent=2)+'\n')
if record['messages']:(out/'response.txt').write_text(record['messages'][-1]+'\n')
valid=proc.returncode==0 and bool(record['messages']) and not record['errors'] and not record['tool_events']
print(json.dumps({'run_id':run_id,'completed':valid,'seconds':record['elapsed_seconds'],'tools':len(record['tool_events']),'errors':record['errors']}),flush=True)
if not valid: raise RuntimeError('Execution failed or tools used; stop and retain the attempt.')
return record
if __name__=='__main__':
if len(sys.argv)>1 and sys.argv[1]=='probe':
execute('probe-01','Return exactly this JSON and do not use any tools: {"transport":"ready"}',study=False)
else:
lock=json.loads((ROOT/'lock.json').read_text())
for name,h in lock['files'].items():
if digest(ROOT/name)!=h:raise RuntimeError('Frozen file changed: '+name)
for run in json.loads((ROOT/'schedule.json').read_text()):
execute(run['run_id'],(ROOT/'inputs'/f"{run['run_id']}.md").read_text(),schema=ROOT/'inputs/response-schema.json')inputs/
Exact prompt; forward product order, repeat 1.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning.
# Fictional offer records
All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise.
## A · Aster Compact
Width is 98 cm [A1]. Delivered total is USD 480 including delivery and tax [A2]. Finish is white [A3]. Warranty is 3 years [A4]. Return window is 30 days [A5]. Confirmed arrival is not stated [A6]. Assembly is not stated [A7]. Upper-floor service is not stated [A8].
## B · Birch Mini
Width is 96 cm [B1]. Delivered total is USD 480 including delivery and tax [B2]. Finish is black [B3]. Warranty is 2 years [B4]. Return window is 14 days [B5]. Confirmed arrival is Thursday 29 October 2026 [B6]. Assembly is self-assembly required [B7]. Upper-floor service is ground-floor delivery only [B8].
## C · Cedar Wide
Width is 110 cm [C1]. Delivered total is USD 480 including delivery and tax [C2]. Finish is white [C3]. Warranty is 5 years [C4]. Return window is 30 days [C5]. Confirmed arrival is Thursday 29 October 2026 [C6]. Assembly is delivered assembled [C7]. Upper-floor service is ground-floor delivery only [C8].
# Customer requests
## Q1
Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed.
## Q2
I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed.
## Q3
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough.
## Q4
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough.
## Q5
I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself.
## Q6
I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough.inputs/
Exact prompt; reverse product order, repeat 1.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning.
# Fictional offer records
All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise.
## C · Cedar Wide
- Width: 110 cm [C1].
- Delivered total: USD 480 including delivery and tax [C2].
- Finish: white [C3].
- Warranty: 5 years [C4].
- Return window: 30 days [C5].
- Confirmed arrival: Thursday 29 October 2026 [C6].
- Assembly: delivered assembled [C7].
- Upper-floor service: ground-floor delivery only [C8].
## B · Birch Mini
- Width: 96 cm [B1].
- Delivered total: USD 480 including delivery and tax [B2].
- Finish: black [B3].
- Warranty: 2 years [B4].
- Return window: 14 days [B5].
- Confirmed arrival: Thursday 29 October 2026 [B6].
- Assembly: self-assembly required [B7].
- Upper-floor service: ground-floor delivery only [B8].
## A · Aster Compact
- Width: 98 cm [A1].
- Delivered total: USD 480 including delivery and tax [A2].
- Finish: white [A3].
- Warranty: 3 years [A4].
- Return window: 30 days [A5].
- Confirmed arrival: not stated [A6].
- Assembly: not stated [A7].
- Upper-floor service: not stated [A8].
# Customer requests
## Q1
Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed.
## Q2
I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed.
## Q3
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough.
## Q4
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough.
## Q5
I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself.
## Q6
I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough.inputs/
Exact prompt; forward product order, repeat 1.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning.
# Fictional offer records
All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise.
## A · Aster Compact
- Width: 98 cm [A1].
- Delivered total: USD 480 including delivery and tax [A2].
- Finish: white [A3].
- Warranty: 3 years [A4].
- Return window: 30 days [A5].
- Confirmed arrival: Friday 30 October 2026 [A6].
- Assembly: delivered assembled [A7].
- Upper-floor service: not stated [A8].
## B · Birch Mini
- Width: 96 cm [B1].
- Delivered total: USD 480 including delivery and tax [B2].
- Finish: black [B3].
- Warranty: 2 years [B4].
- Return window: 14 days [B5].
- Confirmed arrival: Thursday 29 October 2026 [B6].
- Assembly: self-assembly required [B7].
- Upper-floor service: ground-floor delivery only [B8].
## C · Cedar Wide
- Width: 110 cm [C1].
- Delivered total: USD 480 including delivery and tax [C2].
- Finish: white [C3].
- Warranty: 5 years [C4].
- Return window: 30 days [C5].
- Confirmed arrival: Thursday 29 October 2026 [C6].
- Assembly: delivered assembled [C7].
- Upper-floor service: ground-floor delivery only [C8].
# Customer requests
## Q1
Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed.
## Q2
I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed.
## Q3
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough.
## Q4
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough.
## Q5
I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself.
## Q6
I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough.inputs/
Exact prompt; reverse product order, repeat 1.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning.
# Fictional offer records
All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise.
## C · Cedar Wide
- Width: 110 cm [C1].
- Delivered total: USD 480 including delivery and tax [C2].
- Finish: white [C3].
- Warranty: 5 years [C4].
- Return window: 30 days [C5].
- Confirmed arrival: Thursday 29 October 2026 [C6].
- Assembly: delivered assembled [C7].
- Upper-floor service: ground-floor delivery only [C8].
## B · Birch Mini
- Width: 96 cm [B1].
- Delivered total: USD 480 including delivery and tax [B2].
- Finish: black [B3].
- Warranty: 2 years [B4].
- Return window: 14 days [B5].
- Confirmed arrival: Thursday 29 October 2026 [B6].
- Assembly: self-assembly required [B7].
- Upper-floor service: ground-floor delivery only [B8].
## A · Aster Compact
- Width: 98 cm [A1].
- Delivered total: USD 480 including delivery and tax [A2].
- Finish: white [A3].
- Warranty: 3 years [A4].
- Return window: 30 days [A5].
- Confirmed arrival: Friday 30 October 2026 [A6].
- Assembly: delivered assembled [A7].
- Upper-floor service: not stated [A8].
# Customer requests
## Q1
Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed.
## Q2
I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed.
## Q3
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough.
## Q4
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough.
## Q5
I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself.
## Q6
I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough.inputs/
Exact prompt; forward product order, repeat 1.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning.
# Fictional offer records
All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise.
## A · Aster Compact
- Width: 98 cm [A1].
- Delivered total: USD 480 including delivery and tax [A2].
- Finish: white [A3].
- Warranty: 3 years [A4].
- Return window: 30 days [A5].
- Confirmed arrival: not stated [A6].
- Assembly: not stated [A7].
- Upper-floor service: not stated [A8].
## B · Birch Mini
- Width: 96 cm [B1].
- Delivered total: USD 480 including delivery and tax [B2].
- Finish: black [B3].
- Warranty: 2 years [B4].
- Return window: 14 days [B5].
- Confirmed arrival: Thursday 29 October 2026 [B6].
- Assembly: self-assembly required [B7].
- Upper-floor service: ground-floor delivery only [B8].
## C · Cedar Wide
- Width: 110 cm [C1].
- Delivered total: USD 480 including delivery and tax [C2].
- Finish: white [C3].
- Warranty: 5 years [C4].
- Return window: 30 days [C5].
- Confirmed arrival: Thursday 29 October 2026 [C6].
- Assembly: delivered assembled [C7].
- Upper-floor service: ground-floor delivery only [C8].
# Customer requests
## Q1
Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed.
## Q2
I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed.
## Q3
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough.
## Q4
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough.
## Q5
I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself.
## Q6
I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough.inputs/
Exact prompt; reverse product order, repeat 1.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning.
# Fictional offer records
All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise.
## C · Cedar Wide
Width is 110 cm [C1]. Delivered total is USD 480 including delivery and tax [C2]. Finish is white [C3]. Warranty is 5 years [C4]. Return window is 30 days [C5]. Confirmed arrival is Thursday 29 October 2026 [C6]. Assembly is delivered assembled [C7]. Upper-floor service is ground-floor delivery only [C8].
## B · Birch Mini
Width is 96 cm [B1]. Delivered total is USD 480 including delivery and tax [B2]. Finish is black [B3]. Warranty is 2 years [B4]. Return window is 14 days [B5]. Confirmed arrival is Thursday 29 October 2026 [B6]. Assembly is self-assembly required [B7]. Upper-floor service is ground-floor delivery only [B8].
## A · Aster Compact
Width is 98 cm [A1]. Delivered total is USD 480 including delivery and tax [A2]. Finish is white [A3]. Warranty is 3 years [A4]. Return window is 30 days [A5]. Confirmed arrival is not stated [A6]. Assembly is not stated [A7]. Upper-floor service is not stated [A8].
# Customer requests
## Q1
Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed.
## Q2
I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed.
## Q3
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough.
## Q4
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough.
## Q5
I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself.
## Q6
I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough.inputs/
Exact prompt; forward product order, repeat 2.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning.
# Fictional offer records
All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise.
## A · Aster Compact
- Width: 98 cm [A1].
- Delivered total: USD 480 including delivery and tax [A2].
- Finish: white [A3].
- Warranty: 3 years [A4].
- Return window: 30 days [A5].
- Confirmed arrival: not stated [A6].
- Assembly: not stated [A7].
- Upper-floor service: not stated [A8].
## B · Birch Mini
- Width: 96 cm [B1].
- Delivered total: USD 480 including delivery and tax [B2].
- Finish: black [B3].
- Warranty: 2 years [B4].
- Return window: 14 days [B5].
- Confirmed arrival: Thursday 29 October 2026 [B6].
- Assembly: self-assembly required [B7].
- Upper-floor service: ground-floor delivery only [B8].
## C · Cedar Wide
- Width: 110 cm [C1].
- Delivered total: USD 480 including delivery and tax [C2].
- Finish: white [C3].
- Warranty: 5 years [C4].
- Return window: 30 days [C5].
- Confirmed arrival: Thursday 29 October 2026 [C6].
- Assembly: delivered assembled [C7].
- Upper-floor service: ground-floor delivery only [C8].
# Customer requests
## Q6
I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough.
## Q5
I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself.
## Q4
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough.
## Q3
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough.
## Q2
I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed.
## Q1
Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed.inputs/
Exact prompt; reverse product order, repeat 2.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning.
# Fictional offer records
All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise.
## C · Cedar Wide
- Width: 110 cm [C1].
- Delivered total: USD 480 including delivery and tax [C2].
- Finish: white [C3].
- Warranty: 5 years [C4].
- Return window: 30 days [C5].
- Confirmed arrival: Thursday 29 October 2026 [C6].
- Assembly: delivered assembled [C7].
- Upper-floor service: ground-floor delivery only [C8].
## B · Birch Mini
- Width: 96 cm [B1].
- Delivered total: USD 480 including delivery and tax [B2].
- Finish: black [B3].
- Warranty: 2 years [B4].
- Return window: 14 days [B5].
- Confirmed arrival: Thursday 29 October 2026 [B6].
- Assembly: self-assembly required [B7].
- Upper-floor service: ground-floor delivery only [B8].
## A · Aster Compact
- Width: 98 cm [A1].
- Delivered total: USD 480 including delivery and tax [A2].
- Finish: white [A3].
- Warranty: 3 years [A4].
- Return window: 30 days [A5].
- Confirmed arrival: Friday 30 October 2026 [A6].
- Assembly: delivered assembled [A7].
- Upper-floor service: not stated [A8].
# Customer requests
## Q6
I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough.
## Q5
I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself.
## Q4
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough.
## Q3
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough.
## Q2
I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed.
## Q1
Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed.inputs/
Exact prompt; forward product order, repeat 2.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning.
# Fictional offer records
All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise.
## A · Aster Compact
Width is 98 cm [A1]. Delivered total is USD 480 including delivery and tax [A2]. Finish is white [A3]. Warranty is 3 years [A4]. Return window is 30 days [A5]. Confirmed arrival is not stated [A6]. Assembly is not stated [A7]. Upper-floor service is not stated [A8].
## B · Birch Mini
Width is 96 cm [B1]. Delivered total is USD 480 including delivery and tax [B2]. Finish is black [B3]. Warranty is 2 years [B4]. Return window is 14 days [B5]. Confirmed arrival is Thursday 29 October 2026 [B6]. Assembly is self-assembly required [B7]. Upper-floor service is ground-floor delivery only [B8].
## C · Cedar Wide
Width is 110 cm [C1]. Delivered total is USD 480 including delivery and tax [C2]. Finish is white [C3]. Warranty is 5 years [C4]. Return window is 30 days [C5]. Confirmed arrival is Thursday 29 October 2026 [C6]. Assembly is delivered assembled [C7]. Upper-floor service is ground-floor delivery only [C8].
# Customer requests
## Q6
I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough.
## Q5
I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself.
## Q4
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough.
## Q3
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough.
## Q2
I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed.
## Q1
Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed.inputs/
Exact prompt; reverse product order, repeat 2.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning.
# Fictional offer records
All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise.
## C · Cedar Wide
Width is 110 cm [C1]. Delivered total is USD 480 including delivery and tax [C2]. Finish is white [C3]. Warranty is 5 years [C4]. Return window is 30 days [C5]. Confirmed arrival is Thursday 29 October 2026 [C6]. Assembly is delivered assembled [C7]. Upper-floor service is ground-floor delivery only [C8].
## B · Birch Mini
Width is 96 cm [B1]. Delivered total is USD 480 including delivery and tax [B2]. Finish is black [B3]. Warranty is 2 years [B4]. Return window is 14 days [B5]. Confirmed arrival is Thursday 29 October 2026 [B6]. Assembly is self-assembly required [B7]. Upper-floor service is ground-floor delivery only [B8].
## A · Aster Compact
Width is 98 cm [A1]. Delivered total is USD 480 including delivery and tax [A2]. Finish is white [A3]. Warranty is 3 years [A4]. Return window is 30 days [A5]. Confirmed arrival is not stated [A6]. Assembly is not stated [A7]. Upper-floor service is not stated [A8].
# Customer requests
## Q6
I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough.
## Q5
I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself.
## Q4
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough.
## Q3
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough.
## Q2
I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed.
## Q1
Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed.inputs/
Exact prompt; forward product order, repeat 2.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning.
# Fictional offer records
All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise.
## A · Aster Compact
- Width: 98 cm [A1].
- Delivered total: USD 480 including delivery and tax [A2].
- Finish: white [A3].
- Warranty: 3 years [A4].
- Return window: 30 days [A5].
- Confirmed arrival: Friday 30 October 2026 [A6].
- Assembly: delivered assembled [A7].
- Upper-floor service: not stated [A8].
## B · Birch Mini
- Width: 96 cm [B1].
- Delivered total: USD 480 including delivery and tax [B2].
- Finish: black [B3].
- Warranty: 2 years [B4].
- Return window: 14 days [B5].
- Confirmed arrival: Thursday 29 October 2026 [B6].
- Assembly: self-assembly required [B7].
- Upper-floor service: ground-floor delivery only [B8].
## C · Cedar Wide
- Width: 110 cm [C1].
- Delivered total: USD 480 including delivery and tax [C2].
- Finish: white [C3].
- Warranty: 5 years [C4].
- Return window: 30 days [C5].
- Confirmed arrival: Thursday 29 October 2026 [C6].
- Assembly: delivered assembled [C7].
- Upper-floor service: ground-floor delivery only [C8].
# Customer requests
## Q6
I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough.
## Q5
I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself.
## Q4
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough.
## Q3
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough.
## Q2
I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed.
## Q1
Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed.inputs/
Exact prompt; reverse product order, repeat 2.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning.
# Fictional offer records
All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise.
## C · Cedar Wide
- Width: 110 cm [C1].
- Delivered total: USD 480 including delivery and tax [C2].
- Finish: white [C3].
- Warranty: 5 years [C4].
- Return window: 30 days [C5].
- Confirmed arrival: Thursday 29 October 2026 [C6].
- Assembly: delivered assembled [C7].
- Upper-floor service: ground-floor delivery only [C8].
## B · Birch Mini
- Width: 96 cm [B1].
- Delivered total: USD 480 including delivery and tax [B2].
- Finish: black [B3].
- Warranty: 2 years [B4].
- Return window: 14 days [B5].
- Confirmed arrival: Thursday 29 October 2026 [B6].
- Assembly: self-assembly required [B7].
- Upper-floor service: ground-floor delivery only [B8].
## A · Aster Compact
- Width: 98 cm [A1].
- Delivered total: USD 480 including delivery and tax [A2].
- Finish: white [A3].
- Warranty: 3 years [A4].
- Return window: 30 days [A5].
- Confirmed arrival: not stated [A6].
- Assembly: not stated [A7].
- Upper-floor service: not stated [A8].
# Customer requests
## Q6
I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough.
## Q5
I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself.
## Q4
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough.
## Q3
I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough.
## Q2
I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed.
## Q1
Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed.schedule.json
Exact frozen file. For the answer key, read record/ERRATUM.md before grading.
[
{
"run_id": "R01",
"condition": "prose",
"product_order": "forward",
"repeat": 1,
"case_order": [
"Q1",
"Q2",
"Q3",
"Q4",
"Q5",
"Q6"
],
"prompt_sha256": "7372d3c12b8b11d485332c58e9ec8e65533deae294b47487d2c7fb161209c867"
},
{
"run_id": "R02",
"condition": "structured",
"product_order": "reverse",
"repeat": 1,
"case_order": [
"Q1",
"Q2",
"Q3",
"Q4",
"Q5",
"Q6"
],
"prompt_sha256": "a8f3e3451bd947e1d747ad49abebace623d441754d93b7c5d3d12312cd0b4bc4"
},
{
"run_id": "R03",
"condition": "enriched",
"product_order": "forward",
"repeat": 1,
"case_order": [
"Q1",
"Q2",
"Q3",
"Q4",
"Q5",
"Q6"
],
"prompt_sha256": "0a940b1856ea87ea8acd6910adf105834aa971a0ba76638da34ce84f941968f7"
},
{
"run_id": "R04",
"condition": "enriched",
"product_order": "reverse",
"repeat": 1,
"case_order": [
"Q1",
"Q2",
"Q3",
"Q4",
"Q5",
"Q6"
],
"prompt_sha256": "ebf418b7df03df485bc5703d809536789e9d5d7e52a8732f30a46aba1b7ed345"
},
{
"run_id": "R05",
"condition": "structured",
"product_order": "forward",
"repeat": 1,
"case_order": [
"Q1",
"Q2",
"Q3",
"Q4",
"Q5",
"Q6"
],
"prompt_sha256": "f3a3aec2eac7b8fe4727e733c1bd34cad238c9d733d135278feabf67d1b0bcba"
},
{
"run_id": "R06",
"condition": "prose",
"product_order": "reverse",
"repeat": 1,
"case_order": [
"Q1",
"Q2",
"Q3",
"Q4",
"Q5",
"Q6"
],
"prompt_sha256": "a7d038ac730ee4930725386283a188aa731a834b8e0060d274d0e568f80f722d"
},
{
"run_id": "R07",
"condition": "structured",
"product_order": "forward",
"repeat": 2,
"case_order": [
"Q6",
"Q5",
"Q4",
"Q3",
"Q2",
"Q1"
],
"prompt_sha256": "19d24e68f35d3a5a8d2fc928f8fda019165dde736fc9405d0bed9d52b6e9d3b3"
},
{
"run_id": "R08",
"condition": "enriched",
"product_order": "reverse",
"repeat": 2,
"case_order": [
"Q6",
"Q5",
"Q4",
"Q3",
"Q2",
"Q1"
],
"prompt_sha256": "27e4ebbb7fc99430ae1bb855ae042327a4f99c0babb2574764908475adaff58b"
},
{
"run_id": "R09",
"condition": "prose",
"product_order": "forward",
"repeat": 2,
"case_order": [
"Q6",
"Q5",
"Q4",
"Q3",
"Q2",
"Q1"
],
"prompt_sha256": "fc785174efef36f57ea957612d8128fef2d4f2ec9ec24ad9baab5072d4710661"
},
{
"run_id": "R10",
"condition": "prose",
"product_order": "reverse",
"repeat": 2,
"case_order": [
"Q6",
"Q5",
"Q4",
"Q3",
"Q2",
"Q1"
],
"prompt_sha256": "e94bcbea4992ba1019206dba0832157ec91d25eb59d7627faa7d52529a8f39be"
},
{
"run_id": "R11",
"condition": "enriched",
"product_order": "forward",
"repeat": 2,
"case_order": [
"Q6",
"Q5",
"Q4",
"Q3",
"Q2",
"Q1"
],
"prompt_sha256": "95bbf174064664021eb7caf1b1d179743419181283e46e5c64f6ef7c378b70db"
},
{
"run_id": "R12",
"condition": "structured",
"product_order": "reverse",
"repeat": 2,
"case_order": [
"Q6",
"Q5",
"Q4",
"Q3",
"Q2",
"Q1"
],
"prompt_sha256": "9561fef7c9aa32f606d734776d0993db80345a21f370448ed77f9bfd7f3933f6"
}
]inputs/
Exact frozen file. For the answer key, read record/ERRATUM.md before grading.
{
"type": "object",
"properties": {
"answers": {
"type": "array",
"items": {
"type": "object",
"properties": {
"case_id": {
"type": "string"
},
"status": {
"type": "string",
"enum": [
"recommend",
"clarify",
"none"
]
},
"product_id": {
"type": [
"string",
"null"
],
"enum": [
"A",
"B",
"C",
null
]
},
"reason": {
"type": "string"
},
"missing_facts": {
"type": "array",
"items": {
"type": "string"
}
},
"source_refs": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"case_id",
"status",
"product_id",
"reason",
"missing_facts",
"source_refs"
],
"additionalProperties": false
}
}
},
"required": [
"answers"
],
"additionalProperties": false
}inputs/
Exact frozen file. For the answer key, read record/ERRATUM.md before grading.
[
{
"case_id": "Q1",
"base_status": "recommend",
"base_product": "A",
"enriched_status": "recommend",
"enriched_product": "A",
"key_refs": [
"A1",
"A2",
"A3"
],
"check": "Ordinary fit; do not add unstated requirements."
},
{
"case_id": "Q2",
"base_status": "recommend",
"base_product": "B",
"enriched_status": "recommend",
"enriched_product": "B",
"key_refs": [
"B1",
"B2"
],
"check": "Competitor fits; A is too wide."
},
{
"case_id": "Q3",
"base_status": "clarify",
"base_product": "A",
"enriched_status": "recommend",
"enriched_product": "A",
"key_refs": [
"A1",
"A2",
"A3",
"A6",
"A7"
],
"check": "Before disclosure: arrival and assembly both unresolved. After: A meets both."
},
{
"case_id": "Q4",
"base_status": "clarify",
"base_product": "A",
"enriched_status": "none",
"enriched_product": null,
"key_refs": [
"A1",
"A2",
"A3",
"A6",
"A7"
],
"check": "Before: arrival and assembly unresolved. After: A arrives too late; B colour/C width disqualify."
},
{
"case_id": "Q5",
"base_status": "clarify",
"base_product": "A",
"enriched_status": "clarify",
"enriched_product": "A",
"key_refs": [
"A1",
"A2",
"A3",
"A9"
],
"check": "Upper-floor service and any extra cost remain unknown in every condition."
},
{
"case_id": "Q6",
"base_status": "recommend",
"base_product": "B",
"enriched_status": "recommend",
"enriched_product": "B",
"key_refs": [
"B1",
"B2",
"B3",
"B6",
"B7"
],
"check": "Known competitor deadline fit; A colour disqualifies."
}
]lock.json
Checks distributed execution files before any session starts.
{
"purpose": "Reader-package integrity manifest; research freeze identified in record/TEST.md",
"files": {
"run.py": "4c52591eb02cede5bbcc0892372b69f9b06391d4eb7f6d48e02122fb8b4df61b",
"inputs/R01.md": "7372d3c12b8b11d485332c58e9ec8e65533deae294b47487d2c7fb161209c867",
"inputs/R02.md": "a8f3e3451bd947e1d747ad49abebace623d441754d93b7c5d3d12312cd0b4bc4",
"inputs/R03.md": "0a940b1856ea87ea8acd6910adf105834aa971a0ba76638da34ce84f941968f7",
"inputs/R04.md": "ebf418b7df03df485bc5703d809536789e9d5d7e52a8732f30a46aba1b7ed345",
"inputs/R05.md": "f3a3aec2eac7b8fe4727e733c1bd34cad238c9d733d135278feabf67d1b0bcba",
"inputs/R06.md": "a7d038ac730ee4930725386283a188aa731a834b8e0060d274d0e568f80f722d",
"inputs/R07.md": "19d24e68f35d3a5a8d2fc928f8fda019165dde736fc9405d0bed9d52b6e9d3b3",
"inputs/R08.md": "27e4ebbb7fc99430ae1bb855ae042327a4f99c0babb2574764908475adaff58b",
"inputs/R09.md": "fc785174efef36f57ea957612d8128fef2d4f2ec9ec24ad9baab5072d4710661",
"inputs/R10.md": "e94bcbea4992ba1019206dba0832157ec91d25eb59d7627faa7d52529a8f39be",
"inputs/R11.md": "95bbf174064664021eb7caf1b1d179743419181283e46e5c64f6ef7c378b70db",
"inputs/R12.md": "9561fef7c9aa32f606d734776d0993db80345a21f370448ed77f9bfd7f3933f6",
"schedule.json": "9d58456e20b0634c55092dd8bd88dbcd4574237b5f20db097ad1540376fa918c",
"inputs/response-schema.json": "01ac6db0b94e37d6f8181d4663b2dfd8d7f1976517c0bf2c1d403eea21f57a8c",
"inputs/grading-key.json": "10be8b3c9bfbeddb69a5fe9fbdf2e43a8242b47b2c5a65b692d916c822f2c62e"
}
}record/
Preserved test material.
# Test record · offer reading comparison
## Actual run
26 October 2026. Codex CLI 0.153.2, requested model alias gpt-6-astra, high reasoning effort, authenticated through an existing ChatGPT account. The exact backend snapshot and monetary model cost were not exposed. Twelve fresh serial sessions, six decisions per session; four sessions and 24 decisions per condition. Two product orders, twice each; request order reversed on the second repeat. No tools were used; no failed study sessions or retries. An unrelated transport probe preceded the study.
The protocol, prompts, schedule and decision key were frozen in Git commit 37d2524 before the first study run. Prose and labelled bullets contained the same 24 cited fields. The enriched condition disclosed A6 (Friday arrival) and A7 (assembled) from an invented reference fixture. It changed the information available, not just its presentation.
## Measures and findings
A correct answer passes four checks: expected decision/product; respects constraints; preserves relevant unknowns without unsupported promises; cites valid support. A clarification can be correct. A resolved answer recommends a product or rules all offers out; it is a separate measure.
| Condition | Correct / 24 | Resolved / 24 | Recommend A / 24 |
| --- | --- | --- | --- |
| Prose | 24 | 12 | 4 |
| Labelled bullets, same facts | 24 | 12 | 4 |
| Bullets plus two missing facts | 24 | 20 | 8 |
All four repetitions of each case had the same status/product within each condition. An actual separate Atlas AI reviewer (/root/offer_review) read all 72 raw answers, checked their facts and references and verified the counts. No human participant study is claimed. See record/results.csv for the per-answer checks and record/RESPONSES.md for verbatim final answers.
Q3 becomes recommend A after the Friday/assembled disclosure. Q4 becomes no suitable offer: Thursday is too early for A, B is black, C is too wide. Q5 remains unresolved because upstairs service and its cost are unknown. More A recommendations alone would be a poor success measure.
## Evaluator correction
See record/ERRATUM.md. Q5's frozen key mistyped A8 as A9. The original is preserved. Enriched Q4 is checked against its actual exclusion reasons, in accordance with protocol check 4. No inputs or raw outputs changed after execution.
## What this supports
The workflow could be executed and audited on these six authored cases. There was no observed decision-accuracy difference between prose and bullets. Prose already passed all checks, leaving no headroom. Added information resolved expected cases in opposite directions; this is a demonstration of using supplied information, not evidence of a general optimization gain.
## Limits
One model configuration on one day; fictional USD offers and English requests supplied in full. The six decisions within a session are correlated, and all cases were authored before execution rather than sampled from real customers. No search, crawling, ranking, brand authority, traffic, checkout or sales was tested. No general success probability or statistical significance is estimated. No measured net time saving. Recorded model-session wall time totals 197.094 seconds and excludes preparation, review and rework. Emitted usage was retained internally; it is not a monetary-cost estimate.
## Reader package
Prepared after the run. run.py, the 12 prompt files, schedule, response schema and original grading key are byte-identical to the executed material after a single final newline. lock.json is a new package-integrity manifest for these distributed files, not the original research freeze. Descriptive README/protocol/results files are editorial packaging. The runner uses an empty temporary directory and does not modify your project instructions. Read it before executing; twelve sessions consume your account usage. Other tools and model aliases have not been tested here.
Next useful comparison: held-out, naturally difficult customer cases and genuinely messy material, with checks written before outputs. A ceiling result does not justify a formatting campaign. Public discovery and commercial value require separate tests with their own controls.record/
Preserved test material.
# Offer reading comparison · protocol 1
Frozen before substantive model execution, 26 October 2026. Author `/root`. This protocol operationalizes the earlier unexecuted GEO Stage A proposal. It is a small constructed comparison, not a representative GEO benchmark.
## Question and execution
Can changing presentation, or disclosing genuinely missing facts, change a supported customer decision? Run three conditions: prose; the same fact statements organized as labelled bullets; the bullet version with A6 (confirmed Friday arrival) and A7 (delivered assembled) disclosed from the fictional reference fixture. The last condition changes information as well as presentation and cannot estimate formatting alone.
Use the existing ChatGPT-authenticated Codex CLI, installed version 0.153.2. Request the user's configured model alias `gpt-6-astra` and effort `high` consistently. Exact backend snapshot and monetary model cost may not be exposed; do not infer them. No new API key, subscription or external integration. Ignore user config for this controlled run, retain normal rules, use read-only permissions, and use an empty working directory. The global AGENTS file was inspected and is empty. No tools or outside facts are needed or requested. These execution settings are specific to the instrument, not advice to replace project rules.
There are 12 fresh serial sessions, each answering all six requests once: 4 sessions/24 decisions per condition; 72 decisions total. Product order is forward or reverse, twice each; request order reverses in the second repeat. `schedule.json` fixes launch order before outputs. Sessions are fresh but share a model/service; six decisions within a session are correlated. No treating 72 answers as 72 independently sampled customers. No inferential p-values, claimed global success rate or manufactured confidence intervals.
An unrelated transport probe may verify authentication/JSON delivery before the study. It uses no study offers or requests and cannot be used to tune those prompts. Study materials and scoring are locked before any study run. No result-adaptive prompt changes, cherry-picking or silent retries. On infrastructure failure, retain the failed attempt and stop to document the fault; any resumed execution or changed protocol must be labelled.
## Prewritten measures and decisions
Primary comparison of prose versus structured: supported-decision correctness. Expected status/product pairs are in `inputs/grading-key.json`. A clarification can be fully correct: missing information is not an error in the answer. Compare each of the six cases, not merely the total.
Evaluate every response on four checks:
1. Status and product match the supplied-information decision key.
2. The explanation respects the customer's binding constraints; it does not recommend a disqualified alternative or invent a requirement.
3. Missing facts remain explicit and no unsupported promise, fee, service or date is introduced. Q3/Q4 need arrival and assembly clarified before disclosure; Q5 needs upper-floor service and any extra charge resolved in every condition.
4. The cited record IDs exist and support the decisive explanation. Extra valid references are allowed; references do not excuse an unsupported claim.
Report structural decision-key matching separately from independently reviewed factual/semantic checks. Overall pass requires all four checks. Preserve raw final outputs and any failed/invalid responses before correction. Do not silently regrade a repaired answer as first-pass success.
Secondary: resolved decisions (`recommend` or `none`), product A recommendations, and how each changes with new information. Increased A mentions/recommendations are not success by themselves. In particular Q2/Q6 should choose B, Q4 should rule all offers out after the Friday disclosure, and Q5 should remain unresolved. Record session wall time and emitted usage if available, without calling them net time savings or monetary cost.
Interpretation rule: a ceiling in the prose condition limits detectable accuracy improvement. A tie is 'no difference observed here', not proof formatting never matters. A resolved negative decision can be useful. Information-addition results establish at most that the model used supplied fictional facts in these prompts, not public discovery, consumer behavior or revenue.
## Boundaries and next decision
English prompts, invented US-dollar offers, a fixed order and destination, six authored requests, one requested model configuration on one day. No search/retrieval, real brand authority, real customers, actual checkout, public page ranking or sales measured. No claim of general advantage across languages/platforms. Preparation/review/rework are part of doing the workflow; a complete net-time measure is not available.
After execution: retain all outcomes, obtain independent response checking as part of separate review, then publish a Playbook only if its instructions reproduce the actual runnable package. A null or adverse result is publishable. Do not add a new memory rule or production GEO rewrite from this bounded test alone.record/
Preserved test material.
# Grading clarification · 26 October 2026
Recorded after execution and before final grading. The frozen original remains available as inputs/grading-key.json.
- Q5 lists A9. The upper-floor record is A8. A9 does not exist. The decision, underlying field and prompt are unchanged. Check references against A8.
- In enriched Q4, A6 (late arrival), B3 (wrong finish) and C1 (too wide) establish that none fits. B7 is a valid additional reason. The base key's positive-fit references are not a mandatory list: protocol check 4 requires valid support for the decisive explanation.
- The fixture contains 24 cited fields: eight per offer. An author preparation note counted 27; this was not a model input or an evaluation measure. The common introduction supplies stock and scope.
No prompt, expected decision or response was revised. An independent reviewer checked all 72 raw answers against the four original protocol checks after this clarification. The reference mistake is an evaluator error, not a model error.record/
Independent semantic audit, one row per answer; original response hashes retained.
run_id,condition,product_order,repeat,case_id,expected_status,expected_product,actual_status,actual_product,check_1_decision,check_2_constraints,check_3_uncertainty,check_4_sources,overall,resolved,source_refs,review_note,response_sha256,reviewer
R01,prose,forward,1,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",40021e348d120adbfc599a7ade12c89427f41f592bd7ffa390d336f58a65b433,/root/offer_review
R01,prose,forward,1,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7;B8,B meets 96 cm/USD 480; competitor recommendation is correct.,40021e348d120adbfc599a7ade12c89427f41f592bd7ffa390d336f58a65b433,/root/offer_review
R01,prose,forward,1,Q3,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,40021e348d120adbfc599a7ade12c89427f41f592bd7ffa390d336f58a65b433,/root/offer_review
R01,prose,forward,1,Q4,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",40021e348d120adbfc599a7ade12c89427f41f592bd7ffa390d336f58a65b433,/root/offer_review
R01,prose,forward,1,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,40021e348d120adbfc599a7ade12c89427f41f592bd7ffa390d336f58a65b433,/root/offer_review
R01,prose,forward,1,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,40021e348d120adbfc599a7ade12c89427f41f592bd7ffa390d336f58a65b433,/root/offer_review
R02,structured,reverse,1,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",5d084bf4e190f63eadfefb6678fc7481bfaaa75e714558ef106d8f24d4c204bb,/root/offer_review
R02,structured,reverse,1,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7,B meets 96 cm/USD 480; competitor recommendation is correct.,5d084bf4e190f63eadfefb6678fc7481bfaaa75e714558ef106d8f24d4c204bb,/root/offer_review
R02,structured,reverse,1,Q3,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,5d084bf4e190f63eadfefb6678fc7481bfaaa75e714558ef106d8f24d4c204bb,/root/offer_review
R02,structured,reverse,1,Q4,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",5d084bf4e190f63eadfefb6678fc7481bfaaa75e714558ef106d8f24d4c204bb,/root/offer_review
R02,structured,reverse,1,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,5d084bf4e190f63eadfefb6678fc7481bfaaa75e714558ef106d8f24d4c204bb,/root/offer_review
R02,structured,reverse,1,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,5d084bf4e190f63eadfefb6678fc7481bfaaa75e714558ef106d8f24d4c204bb,/root/offer_review
R03,enriched,forward,1,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",80aeeb8ed67df2efa49f5fb47889e4b3107e578b9f701827c060d62878120042,/root/offer_review
R03,enriched,forward,1,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7,B meets 96 cm/USD 480; competitor recommendation is correct.,80aeeb8ed67df2efa49f5fb47889e4b3107e578b9f701827c060d62878120042,/root/offer_review
R03,enriched,forward,1,Q3,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,80aeeb8ed67df2efa49f5fb47889e4b3107e578b9f701827c060d62878120042,/root/offer_review
R03,enriched,forward,1,Q4,none,,none,,pass,pass,pass,pass,pass,true,A6;B3;B7;C1,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",80aeeb8ed67df2efa49f5fb47889e4b3107e578b9f701827c060d62878120042,/root/offer_review
R03,enriched,forward,1,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8;B8;C8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,80aeeb8ed67df2efa49f5fb47889e4b3107e578b9f701827c060d62878120042,/root/offer_review
R03,enriched,forward,1,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,80aeeb8ed67df2efa49f5fb47889e4b3107e578b9f701827c060d62878120042,/root/offer_review
R04,enriched,reverse,1,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",e9d79f8899357959e29dd180ae662f4dccc6552fc550e6e3ca226f09aab7f823,/root/offer_review
R04,enriched,reverse,1,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7,B meets 96 cm/USD 480; competitor recommendation is correct.,e9d79f8899357959e29dd180ae662f4dccc6552fc550e6e3ca226f09aab7f823,/root/offer_review
R04,enriched,reverse,1,Q3,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,e9d79f8899357959e29dd180ae662f4dccc6552fc550e6e3ca226f09aab7f823,/root/offer_review
R04,enriched,reverse,1,Q4,none,,none,,pass,pass,pass,pass,pass,true,A6;B3;C1,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",e9d79f8899357959e29dd180ae662f4dccc6552fc550e6e3ca226f09aab7f823,/root/offer_review
R04,enriched,reverse,1,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,e9d79f8899357959e29dd180ae662f4dccc6552fc550e6e3ca226f09aab7f823,/root/offer_review
R04,enriched,reverse,1,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,e9d79f8899357959e29dd180ae662f4dccc6552fc550e6e3ca226f09aab7f823,/root/offer_review
R05,structured,forward,1,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",c1fa6e1cbf45dfed96c8c7b3ad85c5c66fc1ddf30197a176de74f7c21e2d2f0e,/root/offer_review
R05,structured,forward,1,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7;B8,B meets 96 cm/USD 480; competitor recommendation is correct.,c1fa6e1cbf45dfed96c8c7b3ad85c5c66fc1ddf30197a176de74f7c21e2d2f0e,/root/offer_review
R05,structured,forward,1,Q3,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,c1fa6e1cbf45dfed96c8c7b3ad85c5c66fc1ddf30197a176de74f7c21e2d2f0e,/root/offer_review
R05,structured,forward,1,Q4,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",c1fa6e1cbf45dfed96c8c7b3ad85c5c66fc1ddf30197a176de74f7c21e2d2f0e,/root/offer_review
R05,structured,forward,1,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,c1fa6e1cbf45dfed96c8c7b3ad85c5c66fc1ddf30197a176de74f7c21e2d2f0e,/root/offer_review
R05,structured,forward,1,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,c1fa6e1cbf45dfed96c8c7b3ad85c5c66fc1ddf30197a176de74f7c21e2d2f0e,/root/offer_review
R06,prose,reverse,1,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",b7a7f8f18bca7dde30ddb972fcec3f566e00857495060a629ad0ca5f824836cb,/root/offer_review
R06,prose,reverse,1,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7,B meets 96 cm/USD 480; competitor recommendation is correct.,b7a7f8f18bca7dde30ddb972fcec3f566e00857495060a629ad0ca5f824836cb,/root/offer_review
R06,prose,reverse,1,Q3,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,b7a7f8f18bca7dde30ddb972fcec3f566e00857495060a629ad0ca5f824836cb,/root/offer_review
R06,prose,reverse,1,Q4,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",b7a7f8f18bca7dde30ddb972fcec3f566e00857495060a629ad0ca5f824836cb,/root/offer_review
R06,prose,reverse,1,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,b7a7f8f18bca7dde30ddb972fcec3f566e00857495060a629ad0ca5f824836cb,/root/offer_review
R06,prose,reverse,1,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,b7a7f8f18bca7dde30ddb972fcec3f566e00857495060a629ad0ca5f824836cb,/root/offer_review
R07,structured,forward,2,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,c620f5bf8021da21ec867fb81bf7c84f3a2462619dd7cae4137df318766d1bdc,/root/offer_review
R07,structured,forward,2,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,c620f5bf8021da21ec867fb81bf7c84f3a2462619dd7cae4137df318766d1bdc,/root/offer_review
R07,structured,forward,2,Q4,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",c620f5bf8021da21ec867fb81bf7c84f3a2462619dd7cae4137df318766d1bdc,/root/offer_review
R07,structured,forward,2,Q3,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,c620f5bf8021da21ec867fb81bf7c84f3a2462619dd7cae4137df318766d1bdc,/root/offer_review
R07,structured,forward,2,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7;B8,B meets 96 cm/USD 480; competitor recommendation is correct.,c620f5bf8021da21ec867fb81bf7c84f3a2462619dd7cae4137df318766d1bdc,/root/offer_review
R07,structured,forward,2,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",c620f5bf8021da21ec867fb81bf7c84f3a2462619dd7cae4137df318766d1bdc,/root/offer_review
R08,enriched,reverse,2,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,3b7cd680be083e6ca8976e31b581de85e9cab34909389c7afd2f128d647587df,/root/offer_review
R08,enriched,reverse,2,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,3b7cd680be083e6ca8976e31b581de85e9cab34909389c7afd2f128d647587df,/root/offer_review
R08,enriched,reverse,2,Q4,none,,none,,pass,pass,pass,pass,pass,true,A6;B3;B7;C1,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",3b7cd680be083e6ca8976e31b581de85e9cab34909389c7afd2f128d647587df,/root/offer_review
R08,enriched,reverse,2,Q3,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,3b7cd680be083e6ca8976e31b581de85e9cab34909389c7afd2f128d647587df,/root/offer_review
R08,enriched,reverse,2,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7;B8,B meets 96 cm/USD 480; competitor recommendation is correct.,3b7cd680be083e6ca8976e31b581de85e9cab34909389c7afd2f128d647587df,/root/offer_review
R08,enriched,reverse,2,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",3b7cd680be083e6ca8976e31b581de85e9cab34909389c7afd2f128d647587df,/root/offer_review
R09,prose,forward,2,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,505d369522e69b2da297a00feeb9b3f58c70eda6c6e5386d88ee82745c3234d3,/root/offer_review
R09,prose,forward,2,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID. One combined missing-fact item explicitly covers both service and cost; two separate strings are not required.,505d369522e69b2da297a00feeb9b3f58c70eda6c6e5386d88ee82745c3234d3,/root/offer_review
R09,prose,forward,2,Q4,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",505d369522e69b2da297a00feeb9b3f58c70eda6c6e5386d88ee82745c3234d3,/root/offer_review
R09,prose,forward,2,Q3,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,505d369522e69b2da297a00feeb9b3f58c70eda6c6e5386d88ee82745c3234d3,/root/offer_review
R09,prose,forward,2,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7;B8,B meets 96 cm/USD 480; competitor recommendation is correct.,505d369522e69b2da297a00feeb9b3f58c70eda6c6e5386d88ee82745c3234d3,/root/offer_review
R09,prose,forward,2,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",505d369522e69b2da297a00feeb9b3f58c70eda6c6e5386d88ee82745c3234d3,/root/offer_review
R10,prose,reverse,2,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,66c7bb34afa1e5a6a698b2eead0243108c9282447c4f1fa64739960b664701ae,/root/offer_review
R10,prose,reverse,2,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8;B3;C1,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID. One combined missing-fact item explicitly covers both service and cost; two separate strings are not required.,66c7bb34afa1e5a6a698b2eead0243108c9282447c4f1fa64739960b664701ae,/root/offer_review
R10,prose,reverse,2,Q4,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7;B3;C1,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",66c7bb34afa1e5a6a698b2eead0243108c9282447c4f1fa64739960b664701ae,/root/offer_review
R10,prose,reverse,2,Q3,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7;B3;C1,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,66c7bb34afa1e5a6a698b2eead0243108c9282447c4f1fa64739960b664701ae,/root/offer_review
R10,prose,reverse,2,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7;B8,B meets 96 cm/USD 480; competitor recommendation is correct.,66c7bb34afa1e5a6a698b2eead0243108c9282447c4f1fa64739960b664701ae,/root/offer_review
R10,prose,reverse,2,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",66c7bb34afa1e5a6a698b2eead0243108c9282447c4f1fa64739960b664701ae,/root/offer_review
R11,enriched,forward,2,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,82917bb159804277046aa8fc46a8062d64303f8fa8e5797fb4ccf8df58e61326,/root/offer_review
R11,enriched,forward,2,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,82917bb159804277046aa8fc46a8062d64303f8fa8e5797fb4ccf8df58e61326,/root/offer_review
R11,enriched,forward,2,Q4,none,,none,,pass,pass,pass,pass,pass,true,A6;B3;B7;C1,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",82917bb159804277046aa8fc46a8062d64303f8fa8e5797fb4ccf8df58e61326,/root/offer_review
R11,enriched,forward,2,Q3,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,82917bb159804277046aa8fc46a8062d64303f8fa8e5797fb4ccf8df58e61326,/root/offer_review
R11,enriched,forward,2,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7,B meets 96 cm/USD 480; competitor recommendation is correct.,82917bb159804277046aa8fc46a8062d64303f8fa8e5797fb4ccf8df58e61326,/root/offer_review
R11,enriched,forward,2,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",82917bb159804277046aa8fc46a8062d64303f8fa8e5797fb4ccf8df58e61326,/root/offer_review
R12,structured,reverse,2,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,f92b18abb54e3481c4411e5bc321d7c2a205da0c0edcf6bd09a129a04b1bf779,/root/offer_review
R12,structured,reverse,2,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,f92b18abb54e3481c4411e5bc321d7c2a205da0c0edcf6bd09a129a04b1bf779,/root/offer_review
R12,structured,reverse,2,Q4,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",f92b18abb54e3481c4411e5bc321d7c2a205da0c0edcf6bd09a129a04b1bf779,/root/offer_review
R12,structured,reverse,2,Q3,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,f92b18abb54e3481c4411e5bc321d7c2a205da0c0edcf6bd09a129a04b1bf779,/root/offer_review
R12,structured,reverse,2,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7;B8,B meets 96 cm/USD 480; competitor recommendation is correct.,f92b18abb54e3481c4411e5bc321d7c2a205da0c0edcf6bd09a129a04b1bf779,/root/offer_review
R12,structured,reverse,2,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",f92b18abb54e3481c4411e5bc321d7c2a205da0c0edcf6bd09a129a04b1bf779,/root/offer_reviewrecord/
All twelve final outputs; compare with the individual prompt and answer key.
# Verbatim final answers
Twelve completed sessions. Quotes are original output, not repaired examples. No private reasoning or authentication data is included.
## R01 · prose · forward · repeat 1
```json
{"answers":[{"case_id":"Q1","status":"recommend","product_id":"A","reason":"A is white, 98 cm wide, and USD 480 delivered, meeting every must-have.","missing_facts":[],"source_refs":["A1","A2","A3"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"B is 96 cm wide and USD 480 delivered; self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B7","B8"]},{"case_id":"Q3","status":"clarify","product_id":"A","reason":"A meets the colour, width, and delivered-price limits, but arrival and assembly are unstated.","missing_facts":["Whether A will arrive by Friday 30 October 2026.","Whether A will arrive ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q4","status":"clarify","product_id":"A","reason":"A meets the colour, width, and delivered-price limits, but arrival and assembly are unstated.","missing_facts":["Whether A will arrive by Thursday 29 October 2026.","Whether A will arrive ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"A meets the colour and width limits, but second-floor room delivery and its inclusive total are unconfirmed.","missing_facts":["Whether A can be delivered to the second-floor room without a lift.","Whether the total including delivery to that room is at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q6","status":"recommend","product_id":"B","reason":"B is black, 96 cm wide, and USD 480 delivered, with confirmed arrival on Thursday 29 October 2026. Its assembly and delivery terms are acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]}]}
```
## R02 · structured · reverse · repeat 1
```json
{"answers":[{"case_id":"Q1","status":"recommend","product_id":"A","reason":"A meets the white finish, width and delivered budget requirements.","missing_facts":[],"source_refs":["A1","A2","A3"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"B is 96 cm wide and costs USD 480 delivered; self-assembly is acceptable.","missing_facts":[],"source_refs":["B1","B2","B7"]},{"case_id":"Q3","status":"clarify","product_id":"A","reason":"A meets the finish, width and budget requirements, but arrival and assembly are unstated.","missing_facts":["Whether A will arrive by Friday 30 October 2026.","Whether A will arrive ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q4","status":"clarify","product_id":"A","reason":"A meets the finish, width and budget requirements, but arrival and assembly are unstated.","missing_facts":["Whether A will arrive by Thursday 29 October 2026.","Whether A will arrive ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"A meets the finish and width requirements, but second-floor room delivery and its total cost are unconfirmed.","missing_facts":["Whether A can be delivered to the second-floor room without a lift.","Whether the total including that delivery is at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q6","status":"recommend","product_id":"B","reason":"B meets the black finish, width, delivered budget and arrival deadline requirements; its assembly and delivery terms are acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]}]}
```
## R03 · enriched · forward · repeat 1
```json
{"answers":[{"case_id":"Q1","status":"recommend","product_id":"A","reason":"A is white, 98 cm wide and USD 480 delivered, meeting every must-have.","missing_facts":[],"source_refs":["A1","A2","A3"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"B is 96 cm wide and USD 480 delivered; its self-assembly requirement is acceptable.","missing_facts":[],"source_refs":["B1","B2","B7"]},{"case_id":"Q3","status":"recommend","product_id":"A","reason":"A is white, 98 cm wide, USD 480 delivered and delivered assembled, with confirmed arrival on Friday 30 October 2026.","missing_facts":[],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q4","status":"none","product_id":null,"reason":"A arrives after the deadline; B is black and requires self-assembly; C exceeds the width limit.","missing_facts":[],"source_refs":["A6","B3","B7","C1"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"A meets the colour and width requirements, but second-floor room delivery without a lift and its total cost are unconfirmed. B and C offer ground-floor delivery only.","missing_facts":["Whether A can be delivered to the second-floor room without a lift.","Whether A's total including that room delivery is at most USD 500."],"source_refs":["A1","A2","A3","A8","B8","C8"]},{"case_id":"Q6","status":"recommend","product_id":"B","reason":"B is black, 96 cm wide and USD 480 delivered, with confirmed arrival on Thursday 29 October 2026; self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]}]}
```
## R04 · enriched · reverse · repeat 1
```json
{"answers":[{"case_id":"Q1","status":"recommend","product_id":"A","reason":"Aster Compact is white, 98 cm wide and USD 480 delivered.","missing_facts":[],"source_refs":["A1","A2","A3"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"Birch Mini is 96 cm wide and USD 480 delivered; self-assembly is acceptable.","missing_facts":[],"source_refs":["B1","B2","B7"]},{"case_id":"Q3","status":"recommend","product_id":"A","reason":"Aster Compact is white, 98 cm wide and USD 480 delivered. It arrives assembled on Friday 30 October 2026, meeting the deadline.","missing_facts":[],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q4","status":"none","product_id":null,"reason":"Aster Compact arrives after the deadline, Birch Mini is black, and Cedar Wide exceeds the width limit.","missing_facts":[],"source_refs":["A6","B3","C1"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour and width requirements, but second-floor room delivery without a lift and its total cost are unconfirmed.","missing_facts":["Whether delivery to the second-floor room without a lift is available.","Whether the total including that delivery and tax is at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q6","status":"recommend","product_id":"B","reason":"Birch Mini is black, 96 cm wide and USD 480 delivered. It arrives Thursday 29 October 2026, with acceptable self-assembly and ground-floor delivery.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]}]}
```
## R05 · structured · forward · repeat 1
```json
{"answers":[{"case_id":"Q1","status":"recommend","product_id":"A","reason":"A is white, 98 cm wide and USD 480 delivered, meeting every must-have.","missing_facts":[],"source_refs":["A1","A2","A3"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"B is 96 cm wide and USD 480 delivered; self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B7","B8"]},{"case_id":"Q3","status":"clarify","product_id":"A","reason":"A meets the colour, width and delivered-price limits, but arrival and assembly are unspecified.","missing_facts":["Whether A will arrive by Friday 30 October 2026.","Whether A will arrive ready to use with no self-assembly required."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q4","status":"clarify","product_id":"A","reason":"A meets the colour, width and delivered-price limits, but arrival and assembly are unspecified.","missing_facts":["Whether A will arrive by Thursday 29 October 2026.","Whether A will arrive ready to use with no self-assembly required."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"A meets the colour and width limits, but second-floor room delivery and its total cost are unconfirmed.","missing_facts":["Whether A can be delivered to the second-floor room without a lift.","Whether the total including that room delivery and tax is at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q6","status":"recommend","product_id":"B","reason":"B is black, 96 cm wide and USD 480 delivered, with confirmed arrival on Thursday 29 October 2026; its assembly and delivery terms are acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]}]}
```
## R06 · prose · reverse · repeat 1
```json
{"answers":[{"case_id":"Q1","status":"recommend","product_id":"A","reason":"A is white, 98 cm wide and USD 480 delivered, meeting all must-haves.","missing_facts":[],"source_refs":["A1","A2","A3"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"B is 96 cm wide and USD 480 delivered; self-assembly is acceptable.","missing_facts":[],"source_refs":["B1","B2","B7"]},{"case_id":"Q3","status":"clarify","product_id":"A","reason":"A meets the colour, width and price requirements, but arrival and assembly are unstated.","missing_facts":["Whether A will arrive by Friday 30 October 2026.","Whether A arrives ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q4","status":"clarify","product_id":"A","reason":"A meets the colour, width and price requirements, but arrival and assembly are unstated.","missing_facts":["Whether A will arrive by Thursday 29 October 2026.","Whether A arrives ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"A meets the colour and width requirements, but second-floor room delivery and its total price are unconfirmed.","missing_facts":["Whether A can be delivered to the second-floor room without a lift.","Whether the total including that room delivery is at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q6","status":"recommend","product_id":"B","reason":"B is black, 96 cm wide and USD 480 delivered, with confirmed arrival on Thursday 29 October 2026; its assembly and delivery terms are acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]}]}
```
## R07 · structured · forward · repeat 2
```json
{"answers":[{"case_id":"Q6","status":"recommend","product_id":"B","reason":"B meets the colour, width, delivered budget, arrival deadline and service requirements; self-assembly is acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"A meets the colour and width requirements, but second-floor room delivery without a lift and its inclusive total need confirmation.","missing_facts":["Whether delivery to the second-floor room without a lift is available.","Whether the total including that service and tax is at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q4","status":"clarify","product_id":"A","reason":"A meets the colour, width and delivered budget requirements, but assembly and arrival are unstated.","missing_facts":["Whether A arrives ready to use with no self-assembly.","Whether arrival is confirmed no later than Thursday 29 October 2026."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q3","status":"clarify","product_id":"A","reason":"A meets the colour, width and delivered budget requirements, but assembly and arrival are unstated.","missing_facts":["Whether A arrives ready to use with no self-assembly.","Whether arrival is confirmed no later than Friday 30 October 2026."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"B is 96 cm wide and USD 480 delivered; its self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B7","B8"]},{"case_id":"Q1","status":"recommend","product_id":"A","reason":"A is white, 98 cm wide and USD 480 delivered, meeting every must-have condition.","missing_facts":[],"source_refs":["A1","A2","A3"]}]}
```
## R08 · enriched · reverse · repeat 2
```json
{"answers":[{"case_id":"Q6","status":"recommend","product_id":"B","reason":"Birch Mini meets the colour, width, delivered budget and arrival deadline; self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour and width requirements, but second-floor room delivery without a lift and its total cost are unconfirmed.","missing_facts":["Whether delivery to the second-floor room without a lift is available.","Whether the total including that service is at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q4","status":"none","product_id":null,"reason":"Aster Compact arrives after the deadline, Birch Mini is black and requires assembly, and Cedar Wide exceeds the width limit.","missing_facts":[],"source_refs":["A6","B3","B7","C1"]},{"case_id":"Q3","status":"recommend","product_id":"A","reason":"Aster Compact is white, 98 cm wide, USD 480 delivered, delivered assembled and confirmed to arrive by Friday 30 October.","missing_facts":[],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"Birch Mini is 96 cm wide and USD 480 delivered; self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B7","B8"]},{"case_id":"Q1","status":"recommend","product_id":"A","reason":"Aster Compact is white, 98 cm wide and USD 480 delivered, meeting all must-have conditions.","missing_facts":[],"source_refs":["A1","A2","A3"]}]}
```
## R09 · prose · forward · repeat 2
```json
{"answers":[{"case_id":"Q6","status":"recommend","product_id":"B","reason":"Birch Mini meets the colour, width, price and arrival requirements; its assembly and delivery terms are acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour and width requirements, but second-floor room delivery without a lift and its inclusive total need confirmation.","missing_facts":["Whether delivery to the second-floor room without a lift is available with a total price of at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q4","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour, width and price requirements, but arrival and assembly are unspecified.","missing_facts":["Whether arrival is confirmed by Thursday 29 October 2026.","Whether it arrives ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q3","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour, width and price requirements, but arrival and assembly are unspecified.","missing_facts":["Whether arrival is confirmed by Friday 30 October 2026.","Whether it arrives ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"Birch Mini is 96 cm wide and USD 480 delivered; self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B7","B8"]},{"case_id":"Q1","status":"recommend","product_id":"A","reason":"Aster Compact is white, 98 cm wide and USD 480 delivered, meeting every must-have condition.","missing_facts":[],"source_refs":["A1","A2","A3"]}]}
```
## R10 · prose · reverse · repeat 2
```json
{"answers":[{"case_id":"Q6","status":"recommend","product_id":"B","reason":"Birch Mini meets the colour, width, delivered budget and arrival requirements; self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour and width requirements, but second-floor room delivery without a lift within the budget is unconfirmed.","missing_facts":["Whether delivery to the second-floor room without a lift is available with the total cost at most USD 500."],"source_refs":["A1","A2","A3","A8","B3","C1"]},{"case_id":"Q4","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour, width and delivered budget requirements, but arrival and assembly are unstated.","missing_facts":["Whether arrival is confirmed by Thursday 29 October 2026.","Whether it arrives ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7","B3","C1"]},{"case_id":"Q3","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour, width and delivered budget requirements, but arrival and assembly are unstated.","missing_facts":["Whether arrival is confirmed by Friday 30 October 2026.","Whether it arrives ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7","B3","C1"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"Birch Mini is 96 cm wide and costs USD 480 delivered; self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B7","B8"]},{"case_id":"Q1","status":"recommend","product_id":"A","reason":"Aster Compact is white, 98 cm wide and costs USD 480 delivered, meeting all must-have conditions.","missing_facts":[],"source_refs":["A1","A2","A3"]}]}
```
## R11 · enriched · forward · repeat 2
```json
{"answers":[{"case_id":"Q6","status":"recommend","product_id":"B","reason":"Birch Mini is black, 96 cm wide and USD 480 delivered, arriving Thursday 29 October. Its self-assembly and ground-floor delivery fit the request.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour and width requirements, but second-floor room delivery without a lift and its total cost are unconfirmed.","missing_facts":["Whether delivery to the second-floor room without a lift is available.","Whether the total including that delivery and tax is at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q4","status":"none","product_id":null,"reason":"Aster Compact arrives after the deadline; Birch Mini is black and requires assembly; Cedar Wide exceeds 100 cm.","missing_facts":[],"source_refs":["A6","B3","B7","C1"]},{"case_id":"Q3","status":"recommend","product_id":"A","reason":"Aster Compact is white, 98 cm wide and USD 480 delivered. It arrives assembled on Friday 30 October, meeting the deadline.","missing_facts":[],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"Birch Mini is 96 cm wide and USD 480 delivered; its required self-assembly is acceptable.","missing_facts":[],"source_refs":["B1","B2","B7"]},{"case_id":"Q1","status":"recommend","product_id":"A","reason":"Aster Compact is white, 98 cm wide and USD 480 delivered, meeting every must-have condition.","missing_facts":[],"source_refs":["A1","A2","A3"]}]}
```
## R12 · structured · reverse · repeat 2
```json
{"answers":[{"case_id":"Q6","status":"recommend","product_id":"B","reason":"Birch Mini meets the colour, width, delivered budget and arrival deadline; its assembly and delivery arrangements are acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour and width requirements, but second-floor room delivery without a lift and its total cost are unconfirmed.","missing_facts":["Whether delivery to the second-floor room without a lift is available.","Whether the total including that delivery is at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q4","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour, width and stated delivered budget, but arrival timing and assembly status are missing.","missing_facts":["Whether it will arrive by Thursday 29 October 2026.","Whether it will arrive ready to use with no self-assembly required."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q3","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour, width and stated delivered budget, but arrival timing and assembly status are missing.","missing_facts":["Whether it will arrive by Friday 30 October 2026.","Whether it will arrive ready to use with no self-assembly required."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"Birch Mini is 96 cm wide and USD 480 delivered; self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B7","B8"]},{"case_id":"Q1","status":"recommend","product_id":"A","reason":"Aster Compact is white, 98 cm wide and USD 480 delivered, meeting every must-have condition.","missing_facts":[],"source_refs":["A1","A2","A3"]}]}
```A check changes what happens next.
Keep the comparison fixed until it has been checked
↺ New evidence or an error → save a new input version
↳ Stop if the test does not measure the business problem.
Define the decision
- Read
- Customer constraints and offer records
- Do
- Write expected decisions and source references.
- Save
- Facts, requests and grading key
- Check
- Could a confident wrong recommendation still pass?
Process map, not measured data. The six cases and three conditions were fixed before execution. Changes belong to a new version after review.
Read every stage
Define the decision
Customer constraints and offer records
Write expected decisions and source references.
Facts, requests and grading key
Could a confident wrong recommendation still pass?
Freeze the comparison
Same facts; separately disclosed new facts
Fix condition files, order and repetitions.
Prompts, schedule and checksums
Did any fact change in the formatting-only version?
Record every run
Frozen prompts, model and settings
Use fresh sessions; retain final outputs and failures.
Unedited responses and execution records
Was a retry or tool use introduced? Stop and disclose it.
Decide what follows
Raw answers and the prewritten key
Check meaning and sources independently. Count correct answers separately from resolved decisions.
Case results, limits and next decision
Is the conclusion about reading, discovery or revenue? Only reading was tested.
A worked example
The material
A is white, 98 cm wide and USD 480 delivered. B is black and 96 cm; C is white and 110 cm. The customer needs white, at most 100 cm, at most USD 500, assembled and arriving by Thursday.
Observed decision change
Before the new facts: clarify A’s arrival and assembly. After disclosure: A arrives assembled on Friday, so no offer meets the request. B has the wrong finish; C is too wide.
Edited summary of Q4 across the three conditions. Below, the selector shows verbatim reason fields from R01, R05 and R03. All four repetitions agreed on decision/product; the download retains every answer.
New facts resolved eight more answers. Accuracy stayed the same.
In each condition, all 24 answers passed the four checks. Correct clarifications count as correct. The change below is in what could be decided from the supplied information.
Resolved answers: a recommendation or no suitable offer
- Prose12 / 24
- Same facts, bullets12 / 24
- Two added facts20 / 24
Four sessions × six authored requests per condition. The prose baseline was already perfect; this test could not show an accuracy gain. These are supplied fictional offers, not search results.
White, at most 100 cm wide and USD 500, assembled and arriving by Friday.
Clarify A
A meets the colour, width, and delivered-price limits, but arrival and assembly are unstated.Recorded answer · R01 / Q3
Clarify A
A meets the colour, width and delivered-price limits, but arrival and assembly are unspecified.Recorded answer · R05 / Q3
Recommend A
A is white, 98 cm wide, USD 480 delivered and delivered assembled, with confirmed arrival on Friday 30 October 2026.Recorded answer · R03 / Q3
Friday arrival and assembly resolve this request in A’s favour.
View all cases, data & method
Protocol v1 was frozen before outputs. Two product orders, two repetitions; request order reversed on the second repeat. A separate AI reviewer checked all 72 answers against the same four criteria. The case selector quotes R01, R05 and R03 verbatim; all four repetitions agreed on decision/product. Answers within a session are correlated. No population effect is estimated. The complete record includes the frozen key and its disclosed reference-ID correction.
| Condition | Correct | Resolved |
|---|---|---|
| Prose | 24/24 | 12/24 |
| Same facts, bullets | 24/24 | 12/24 |
| Two added facts | 24/24 | 20/24 |
Friday deadline
White, at most 100 cm wide and USD 500, assembled and arriving by Friday.
Clarify A
A meets the colour, width, and delivered-price limits, but arrival and assembly are unstated.Recorded answer · R01 / Q3
Clarify A
A meets the colour, width and delivered-price limits, but arrival and assembly are unspecified.Recorded answer · R05 / Q3
Recommend A
A is white, 98 cm wide, USD 480 delivered and delivered assembled, with confirmed arrival on Friday 30 October 2026.Recorded answer · R03 / Q3
Friday arrival and assembly resolve this request in A’s favour.
Thursday deadline
White, at most 100 cm wide and USD 500, assembled and arriving by Thursday.
Clarify A
A meets the colour, width, and delivered-price limits, but arrival and assembly are unstated.Recorded answer · R01 / Q4
Clarify A
A meets the colour, width and delivered-price limits, but arrival and assembly are unspecified.Recorded answer · R05 / Q4
No suitable offer
A arrives after the deadline; B is black and requires self-assembly; C exceeds the width limit.Recorded answer · R03 / Q4
The new date rules A out. B has the wrong finish; C is too wide. “None” is a useful, correct answer.
Upstairs delivery
White, at most 100 cm wide, with a total of at most USD 500 including delivery to a second-floor room with no lift.
Clarify A
A meets the colour and width limits, but second-floor room delivery and its inclusive total are unconfirmed.Recorded answer · R01 / Q5
Clarify A
A meets the colour and width limits, but second-floor room delivery and its total cost are unconfirmed.Recorded answer · R05 / Q5
Clarify A
A meets the colour and width requirements, but second-floor room delivery without a lift and its total cost are unconfirmed. B and C offer ground-floor delivery only.Recorded answer · R03 / Q5
Delivery date and assembly do not settle upstairs service or its price. The remaining gap stays visible.
Ordinary fit
White, at most 100 cm wide and USD 500. No deadline; self-assembly acceptable.
Recommend A
A is white, 98 cm wide, and USD 480 delivered, meeting every must-have.Recorded answer · R01 / Q1
Recommend A
A is white, 98 cm wide and USD 480 delivered, meeting every must-have.Recorded answer · R05 / Q1
Recommend A
A is white, 98 cm wide and USD 480 delivered, meeting every must-have.Recorded answer · R03 / Q1
A fits using the original facts. Extra information is not needed for this decision.
Narrow space
At most 96 cm wide and USD 500; either finish, self-assembly acceptable.
Recommend B
B is 96 cm wide and USD 480 delivered; self-assembly and ground-floor delivery are acceptable.Recorded answer · R01 / Q2
Recommend B
B is 96 cm wide and USD 480 delivered; self-assembly and ground-floor delivery are acceptable.Recorded answer · R05 / Q2
Recommend B
B is 96 cm wide and USD 480 delivered; its self-assembly requirement is acceptable.Recorded answer · R03 / Q2
B fits. A’s 98 cm width is disqualifying regardless of how its description is written.
Competitor fits
Black, at most 100 cm wide and USD 500, arriving by Thursday. Ground-floor delivery and self-assembly acceptable.
Recommend B
B is black, 96 cm wide, and USD 480 delivered, with confirmed arrival on Thursday 29 October 2026. Its assembly and delivery terms are acceptable.Recorded answer · R01 / Q6
Recommend B
B is black, 96 cm wide and USD 480 delivered, with confirmed arrival on Thursday 29 October 2026; its assembly and delivery terms are acceptable.Recorded answer · R05 / Q6
Recommend B
B is black, 96 cm wide and USD 480 delivered, with confirmed arrival on Thursday 29 October 2026; self-assembly and ground-floor delivery are acceptable.Recorded answer · R03 / Q6
B meets the requirements. Making A easier to read cannot make it black.
Check what matters before using it.
If something does not hold up
The model chooses you more often
Inspect why. The recommendation must meet the customer’s constraints. Keep competitor wins and correct rejections in the result.
Every version already passes
Report the ceiling. Introduce naturally difficult, unseen cases in a new test; do not reinterpret a tie as proof that structure is irrelevant.
The answers are right but your page is absent from search
Run a separate discovery investigation. Supplying your page directly removes the very stage that may be failing.
What this workflow cannot establish.
- The prose baseline passed every check, leaving no room to demonstrate an accuracy improvement. This small comparison does not prove formatting never matters.
- Six authored English requests, fictional USD offers, one requested model configuration and one day. Repeating these cases does not make them independent customers or a population benchmark.
- All offers were supplied in the prompt. Discovery, search ranking, brand authority, clicks, purchases and commercial return were not measured.
- The workflow and examples were tested in Codex CLI. Other tools are untested; exact backend model snapshot, monetary cost and net time saving remain unknown.
What has actually been tried?
Tested by Atlas
- Last tested
- 26 October 2026
- Tool
- Codex CLI 0.153.2 · fresh non-interactive sessions; no tool calls
- Model/version
- Requested gpt-6-astra · high reasoning effort. Exact backend snapshot not exposed.
- Protocol
- offer-reading-2026-10-26 · v1 · inputs frozen before execution; source-ID erratum disclosed after execution
- Observed outcome
- 12 of 12 recorded runs met the protocol’s checks. This is not a general success rate.
- Next currency review
- 26 November 2026
All twelve sessions completed without retry; all six answers in each session passed the four checks in separate AI review. Correct answers: 24/24 per condition. Resolved answers: 12/24 prose, 12/24 bullets, 20/24 with added facts.
Six authored cases repeated within a fixed fixture; no discovery, real customers, sales or measured net time saving. The original prompts and runner are distributed unchanged; README and package manifest were prepared afterwards. One grading-key reference typo was corrected openly; no raw response was repaired.
Recorded cases and observations
R01 · prose · forward · passed
6/6 answers passed all four criteria. 3/6 decisions resolved.
R02 · structured · reverse · passed
6/6 answers passed all four criteria. 3/6 decisions resolved.
R03 · enriched · forward · passed
6/6 answers passed all four criteria. 5/6 decisions resolved.
R04 · enriched · reverse · passed
6/6 answers passed all four criteria. 5/6 decisions resolved.
R05 · structured · forward · passed
6/6 answers passed all four criteria. 3/6 decisions resolved.
R06 · prose · reverse · passed
6/6 answers passed all four criteria. 3/6 decisions resolved.
R07 · structured · forward · passed
6/6 answers passed all four criteria. 3/6 decisions resolved.
R08 · enriched · reverse · passed
6/6 answers passed all four criteria. 5/6 decisions resolved.
R09 · prose · forward · passed
6/6 answers passed all four criteria. 3/6 decisions resolved.
R10 · prose · reverse · passed
6/6 answers passed all four criteria. 3/6 decisions resolved.
R11 · enriched · forward · passed
6/6 answers passed all four criteria. 5/6 decisions resolved.
R12 · structured · reverse · passed
6/6 answers passed all four criteria. 3/6 decisions resolved.
Background for the workflow
Reported finding: Reformatting produced no observed decision change
Reported findingProse and labelled bullets each passed all checks on 24 of 24 answers and resolved 12. The six cases had identical decisions across both conditions and all repetitions.
Scope and conditions: A ceiling in six authored cases cannot establish that formatting never helps. One requested model configuration on one day.
Atlas test · origin, not a quality ratingSource passage · 202624/24 correct per condition; 12, 12 and 20 resolved. Raw outputs unchanged. Four protocol criteria applied by a separate Atlas agent.
Protocol, recorded responses, 72-row independent audit and evaluator erratum About the source and its versionReported finding: New information can rule your offer in or out
Reported findingDisclosing Friday arrival and assembly increased resolved answers from 12 to 20 out of 24. Four new resolutions recommended A; four correctly ruled all offers out.
Scope and conditions: The added facts are fictional fixture truths. This comparison changes information and does not estimate the effect of formatting, public discovery or sales.
Atlas test · origin, not a quality ratingSource passage · 202624/24 correct per condition; 12, 12 and 20 resolved. Raw outputs unchanged. Four protocol criteria applied by a separate Atlas agent.
Protocol, recorded responses, 72-row independent audit and evaluator erratum About the source and its versionMethod described: Keep sessions separate and preserve the output
Method describedThe tested runner sends fixed prompts to fresh non-interactive Codex sessions with a response schema and records their final answers. It leaves evaluation to the reviewer.
Scope and conditions: Documented CLI features and an Atlas execution on version 0.153.2. Available model aliases and managed policy may differ.
Vendor claim · origin, not a quality ratingSource passage · 2026Documents the execution mechanism; it does not establish the quality of this workflow or a GEO effect.
stdin input, ephemeral sessions, JSON events and structured output About the source and its version
Follow the answer back to its sources.
Browse 2 source records
Controlled supplied-information comparison with fictional offers · Source date: 26 October 2026
Same facts, new facts: the Atlas offer-reading comparison
The Living Atlas · author and separate reviewer agents
Atlas experiment record · Protocol v1 · 12 sessions, 72 answers · evaluator erratum disclosed
Executed 26 October 2026. No public search or customer transaction; separate AI review, not independent external research.
Source passages, license and conditions ↗
Official product documentation · Source date: 26 October 2026
Non-interactive mode
OpenAI
ChatGPT Learn · Documentation accessed 26 October 2026; installed CLI checked separately
Access date used for evolving documentation; original publication date not established.
Source passages, license and conditions ↗
How this version was checked
AI-reviewed by a separate editorial agent · 26 October 2026. The approval applies to revision 1, its text, visuals and source references, including its workflow and test record.
Why this piece
This follow-up to our GEO evidence review tests how AI reads supplied information, with a comparison readers can inspect and repeat.
AI-reviewed by a separate editorial agent · Ask the editor
What changed, and why.
Changes across Atlas →This history comes from saved content versions. A new revision can be an editorial change; it does not by itself mean that the underlying facts changed.
Latest reviewed revision
First recorded version · revision 1
Adds an executed, controlled reading comparison and reusable file kit to the GEO investigation. It tests supplied-information decisions, not public discovery or commercial return.
No earlier reviewed assessment is available to compare. No change in the underlying facts is being claimed.
Available version records (1)
Revision 1 · First recorded version · reviewed
Adds an executed, controlled reading comparison and reusable file kit to the GEO investigation. It tests supplied-information decisions, not public discovery or commercial return.
Answer in this version
If the reading test exposes errors, address that cause and check new cases. If reading already works, investigate public retrieval separately before treating another rewrite as the remedy.
What remained unresolved
Held-out customer cases, new model configurations and separate retrieval observations; commercial value requires its own downstream comparison.
Takeaway and scope
All three versions produced correct answers here. New facts changed what could be decided, including when to reject the offer. Count accurate customer decisions before counting brand recommendations.
Tested on fictional offers supplied directly to Codex. No search visibility or sales measured.
Reformatting produced no observed decision change
Prose and labelled bullets each passed all checks on 24 of 24 answers and resolved 12. The six cases had identical decisions across both conditions and all repetitions.
A ceiling in six authored cases cannot establish that formatting never helps. One requested model configuration on one day.
New information can rule your offer in or out
Disclosing Friday arrival and assembly increased resolved answers from 12 to 20 out of 24. Four new resolutions recommended A; four correctly ruled all offers out.
The added facts are fictional fixture truths. This comparison changes information and does not estimate the effect of formatting, public discovery or sales.
Keep sessions separate and preserve the output
The tested runner sends fixed prompts to fresh non-interactive Codex sessions with a response schema and records their final answers. It leaves evaluation to the reviewer.
Documented CLI features and an Atlas execution on version 0.153.2. Available model aliases and managed policy may differ.
Workflow mechanism · select a stage Keep the comparison fixed until it has been checked
↺ New evidence or an error → save a new input version
↳ Stop if the test does not measure the business problem.
Define the decision- Read
- Customer constraints and offer records
- Do
- Write expected decisions and source references.
- Save
- Facts, requests and grading key
- Check
- Could a confident wrong recommendation still pass?
Process map, not measured data. The six cases and three conditions were fixed before execution. Changes belong to a new version after review.
Read every stage
Define the decision
Customer constraints and offer records
Write expected decisions and source references.
Facts, requests and grading key
Could a confident wrong recommendation still pass?
Freeze the comparison
Same facts; separately disclosed new facts
Fix condition files, order and repetitions.
Prompts, schedule and checksums
Did any fact change in the formatting-only version?
Record every run
Frozen prompts, model and settings
Use fresh sessions; retain final outputs and failures.
Unedited responses and execution records
Was a retry or tool use introduced? Stop and disclose it.
Decide what follows
Raw answers and the prewritten key
Check meaning and sources independently. Count correct answers separately from resolved decisions.
Case results, limits and next decision
Is the conclusion about reading, discovery or revenue? Only reading was tested.
The complete offer-reading comparison
Exact executed prompts and runner, plus a preserved answer key, its correction and all recorded answers. The README and integrity manifest were packaged after the run.
markdown · Start hereTools, exact run command, output locations and adaptation limits.
README.md# Test whether AI understands your offer This kit reproduces Atlas's supplied-information comparison. It does not test whether a search service discovers your page. Use the recorded example first, then create a separately versioned test for your own decision. ## Start 1. Download and extract the ZIP into a new folder outside your existing project. Open this README. Use only material you may submit to your chosen tool; the kit is entirely fictional. 2. Read record/TEST.md, record/PROTOCOL.md and record/ERRATUM.md. The grading key is deliberately absent from model prompts. Do not ask the model to inspect the whole kit: it would see the answers. 3. For the tested route, you need Python 3 and an installed, authenticated Codex CLI. Atlas used CLI 0.153.2 and requested gpt-6-astra with high reasoning effort. If your account lacks that model or the flags have changed, record a new configuration; it is a different comparison. 4. Inspect run.py. In a terminal in this extracted folder, run: ```sh python3 run.py ``` This starts twelve serial fresh sessions and uses your existing account allowance. No paid API key is added by the kit. Each session receives exactly one inputs/Rxx.md plus response-schema.json. Read-only permissions and an empty temporary directory are used. Normal execution rules remain in force; --ignore-user-config isolates this instrument's configuration and is not advice for ordinary project work. No tools are needed or requested. If the CLI reports a tool call or failure, the runner stops. If interrupted or timed out, retain that folder as a failed attempt and investigate; do not silently overwrite or retry it. Each completed session saves runs/Rxx/record.json and response.txt. The runner refuses to overwrite an existing run directory. It captures final messages, usage and diagnostics, not reasoning traces. It does not grade answers or enforce that a model follows every instruction. Check the actual records.Read all files as text
README.md
Tools, exact run command, output locations and adaptation limits.
# Test whether AI understands your offer This kit reproduces Atlas's supplied-information comparison. It does not test whether a search service discovers your page. Use the recorded example first, then create a separately versioned test for your own decision. ## Start 1. Download and extract the ZIP into a new folder outside your existing project. Open this README. Use only material you may submit to your chosen tool; the kit is entirely fictional. 2. Read record/TEST.md, record/PROTOCOL.md and record/ERRATUM.md. The grading key is deliberately absent from model prompts. Do not ask the model to inspect the whole kit: it would see the answers. 3. For the tested route, you need Python 3 and an installed, authenticated Codex CLI. Atlas used CLI 0.153.2 and requested gpt-6-astra with high reasoning effort. If your account lacks that model or the flags have changed, record a new configuration; it is a different comparison. 4. Inspect run.py. In a terminal in this extracted folder, run: ```sh python3 run.py ``` This starts twelve serial fresh sessions and uses your existing account allowance. No paid API key is added by the kit. Each session receives exactly one inputs/Rxx.md plus response-schema.json. Read-only permissions and an empty temporary directory are used. Normal execution rules remain in force; --ignore-user-config isolates this instrument's configuration and is not advice for ordinary project work. No tools are needed or requested. If the CLI reports a tool call or failure, the runner stops. If interrupted or timed out, retain that folder as a failed attempt and investigate; do not silently overwrite or retry it. Each completed session saves runs/Rxx/record.json and response.txt. The runner refuses to overwrite an existing run directory. It captures final messages, usage and diagnostics, not reasoning traces. It does not grade answers or enforce that a model follows every instruction. Check the actual records. ## Review Keep outputs unchanged. Compare each answer with inputs/grading-key.json and its recorded erratum. Apply all four protocol checks, including meanings and source references. Count correct answers separately from resolved decisions. Share the outputs and facts with a separate reviewer. A competitor recommendation or no suitable offer can be the correct result. The record/ directory contains Atlas's completed example, not your future result. Prompts and runner are unchanged from the executed version; this README and package manifest were prepared afterwards. The original protocol freeze is identified in TEST.md. ## Adapt only in a new version Replace the fictional offers and requests with permissioned material. Write an answer key before asking the model. Include genuine fit, competitor fit, missing facts, deadlines and exclusions. Keep prose and structure semantically identical; put any new fact in a distinct condition. Freeze new inputs and update the manifest deliberately before running. Keep your model, settings and repetitions explicit. Reserve new customer cases for a later check rather than tuning everything to this example. Stop after this reading-stage check if the actual business problem is discovery: a prompt that already supplies every offer cannot answer it. See the linked GEO Explainer for the distinction between being read, cited, recommended and purchased.run.py
Byte-identical runner used for the twelve sessions. Consumes account usage when run.
"""Serial, bounded Codex reading study. Saves final answers and usage, not reasoning.""" import json,subprocess,time,hashlib,tempfile,datetime,sys from pathlib import Path ROOT=Path(__file__).resolve().parent def digest(p): return hashlib.sha256(p.read_bytes()).hexdigest() def utc(): return datetime.datetime.now(datetime.timezone.utc).isoformat() def execute(run_id,prompt,model='gpt-6-astra',effort='high',schema=None,study=True): out=ROOT/('runs' if study else 'transport')/run_id out.mkdir(parents=True,exist_ok=False) started=utc(); t=time.monotonic() with tempfile.TemporaryDirectory(prefix='atlas-offer-run-') as empty: cmd=['codex','exec','--ignore-user-config','--ephemeral','--skip-git-repo-check','--sandbox','read-only','-c','approval_policy="never"','-m',model,'-c',f'model_reasoning_effort="{effort}"','--json','-C',empty] if schema: cmd+=['--output-schema',str(schema)] cmd+=['-'] proc=subprocess.run(cmd,input=prompt,text=True,capture_output=True,timeout=240) # Parse in memory. Never preserve reasoning events or hidden reasoning in the study record. record={'started_at':started,'finished_at':utc(),'elapsed_seconds':round(time.monotonic()-t,3),'requested_model':model,'reasoning_effort':effort,'returncode':proc.returncode,'prompt_sha256':hashlib.sha256(prompt.encode()).hexdigest(),'messages':[],'tool_events':[],'errors':[],'usage':None} for line in proc.stdout.splitlines(): try: event=json.loads(line) except json.JSONDecodeError: continue if event.get('type')=='thread.started': record['thread_id']=event.get('thread_id') if event.get('type')=='turn.completed':record['usage']=event.get('usage') if event.get('type') in ('error','turn.failed'):record['errors'].append(event) item=event.get('item',{}) if event.get('type')=='item.completed': if item.get('type')=='agent_message':record['messages'].append(item.get('text','')) elif item.get('type') not in ('reasoning',''):record['tool_events'].append({'type':item.get('type'),'status':item.get('status')}) if proc.returncode and not record['errors']:record['errors']=[{'error':'CLI exited unsuccessfully; no study answer. Inspect locally without publishing authentication or diagnostics.'}] (out/'record.json').write_text(json.dumps(record,ensure_ascii=False,indent=2)+'\n') if record['messages']:(out/'response.txt').write_text(record['messages'][-1]+'\n') valid=proc.returncode==0 and bool(record['messages']) and not record['errors'] and not record['tool_events'] print(json.dumps({'run_id':run_id,'completed':valid,'seconds':record['elapsed_seconds'],'tools':len(record['tool_events']),'errors':record['errors']}),flush=True) if not valid: raise RuntimeError('Execution failed or tools used; stop and retain the attempt.') return record if __name__=='__main__': if len(sys.argv)>1 and sys.argv[1]=='probe': execute('probe-01','Return exactly this JSON and do not use any tools: {"transport":"ready"}',study=False) else: lock=json.loads((ROOT/'lock.json').read_text()) for name,h in lock['files'].items(): if digest(ROOT/name)!=h:raise RuntimeError('Frozen file changed: '+name) for run in json.loads((ROOT/'schedule.json').read_text()): execute(run['run_id'],(ROOT/'inputs'/f"{run['run_id']}.md").read_text(),schema=ROOT/'inputs/response-schema.json')inputs/
R01.md Exact prompt; forward product order, repeat 1.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning. # Fictional offer records All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise. ## A · Aster Compact Width is 98 cm [A1]. Delivered total is USD 480 including delivery and tax [A2]. Finish is white [A3]. Warranty is 3 years [A4]. Return window is 30 days [A5]. Confirmed arrival is not stated [A6]. Assembly is not stated [A7]. Upper-floor service is not stated [A8]. ## B · Birch Mini Width is 96 cm [B1]. Delivered total is USD 480 including delivery and tax [B2]. Finish is black [B3]. Warranty is 2 years [B4]. Return window is 14 days [B5]. Confirmed arrival is Thursday 29 October 2026 [B6]. Assembly is self-assembly required [B7]. Upper-floor service is ground-floor delivery only [B8]. ## C · Cedar Wide Width is 110 cm [C1]. Delivered total is USD 480 including delivery and tax [C2]. Finish is white [C3]. Warranty is 5 years [C4]. Return window is 30 days [C5]. Confirmed arrival is Thursday 29 October 2026 [C6]. Assembly is delivered assembled [C7]. Upper-floor service is ground-floor delivery only [C8]. # Customer requests ## Q1 Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed. ## Q2 I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed. ## Q3 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough. ## Q4 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough. ## Q5 I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself. ## Q6 I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough.inputs/
R02.md Exact prompt; reverse product order, repeat 1.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning. # Fictional offer records All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise. ## C · Cedar Wide - Width: 110 cm [C1]. - Delivered total: USD 480 including delivery and tax [C2]. - Finish: white [C3]. - Warranty: 5 years [C4]. - Return window: 30 days [C5]. - Confirmed arrival: Thursday 29 October 2026 [C6]. - Assembly: delivered assembled [C7]. - Upper-floor service: ground-floor delivery only [C8]. ## B · Birch Mini - Width: 96 cm [B1]. - Delivered total: USD 480 including delivery and tax [B2]. - Finish: black [B3]. - Warranty: 2 years [B4]. - Return window: 14 days [B5]. - Confirmed arrival: Thursday 29 October 2026 [B6]. - Assembly: self-assembly required [B7]. - Upper-floor service: ground-floor delivery only [B8]. ## A · Aster Compact - Width: 98 cm [A1]. - Delivered total: USD 480 including delivery and tax [A2]. - Finish: white [A3]. - Warranty: 3 years [A4]. - Return window: 30 days [A5]. - Confirmed arrival: not stated [A6]. - Assembly: not stated [A7]. - Upper-floor service: not stated [A8]. # Customer requests ## Q1 Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed. ## Q2 I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed. ## Q3 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough. ## Q4 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough. ## Q5 I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself. ## Q6 I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough.inputs/
R03.md Exact prompt; forward product order, repeat 1.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning. # Fictional offer records All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise. ## A · Aster Compact - Width: 98 cm [A1]. - Delivered total: USD 480 including delivery and tax [A2]. - Finish: white [A3]. - Warranty: 3 years [A4]. - Return window: 30 days [A5]. - Confirmed arrival: Friday 30 October 2026 [A6]. - Assembly: delivered assembled [A7]. - Upper-floor service: not stated [A8]. ## B · Birch Mini - Width: 96 cm [B1]. - Delivered total: USD 480 including delivery and tax [B2]. - Finish: black [B3]. - Warranty: 2 years [B4]. - Return window: 14 days [B5]. - Confirmed arrival: Thursday 29 October 2026 [B6]. - Assembly: self-assembly required [B7]. - Upper-floor service: ground-floor delivery only [B8]. ## C · Cedar Wide - Width: 110 cm [C1]. - Delivered total: USD 480 including delivery and tax [C2]. - Finish: white [C3]. - Warranty: 5 years [C4]. - Return window: 30 days [C5]. - Confirmed arrival: Thursday 29 October 2026 [C6]. - Assembly: delivered assembled [C7]. - Upper-floor service: ground-floor delivery only [C8]. # Customer requests ## Q1 Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed. ## Q2 I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed. ## Q3 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough. ## Q4 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough. ## Q5 I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself. ## Q6 I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough.inputs/
R04.md Exact prompt; reverse product order, repeat 1.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning. # Fictional offer records All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise. ## C · Cedar Wide - Width: 110 cm [C1]. - Delivered total: USD 480 including delivery and tax [C2]. - Finish: white [C3]. - Warranty: 5 years [C4]. - Return window: 30 days [C5]. - Confirmed arrival: Thursday 29 October 2026 [C6]. - Assembly: delivered assembled [C7]. - Upper-floor service: ground-floor delivery only [C8]. ## B · Birch Mini - Width: 96 cm [B1]. - Delivered total: USD 480 including delivery and tax [B2]. - Finish: black [B3]. - Warranty: 2 years [B4]. - Return window: 14 days [B5]. - Confirmed arrival: Thursday 29 October 2026 [B6]. - Assembly: self-assembly required [B7]. - Upper-floor service: ground-floor delivery only [B8]. ## A · Aster Compact - Width: 98 cm [A1]. - Delivered total: USD 480 including delivery and tax [A2]. - Finish: white [A3]. - Warranty: 3 years [A4]. - Return window: 30 days [A5]. - Confirmed arrival: Friday 30 October 2026 [A6]. - Assembly: delivered assembled [A7]. - Upper-floor service: not stated [A8]. # Customer requests ## Q1 Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed. ## Q2 I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed. ## Q3 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough. ## Q4 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough. ## Q5 I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself. ## Q6 I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough.inputs/
R05.md Exact prompt; forward product order, repeat 1.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning. # Fictional offer records All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise. ## A · Aster Compact - Width: 98 cm [A1]. - Delivered total: USD 480 including delivery and tax [A2]. - Finish: white [A3]. - Warranty: 3 years [A4]. - Return window: 30 days [A5]. - Confirmed arrival: not stated [A6]. - Assembly: not stated [A7]. - Upper-floor service: not stated [A8]. ## B · Birch Mini - Width: 96 cm [B1]. - Delivered total: USD 480 including delivery and tax [B2]. - Finish: black [B3]. - Warranty: 2 years [B4]. - Return window: 14 days [B5]. - Confirmed arrival: Thursday 29 October 2026 [B6]. - Assembly: self-assembly required [B7]. - Upper-floor service: ground-floor delivery only [B8]. ## C · Cedar Wide - Width: 110 cm [C1]. - Delivered total: USD 480 including delivery and tax [C2]. - Finish: white [C3]. - Warranty: 5 years [C4]. - Return window: 30 days [C5]. - Confirmed arrival: Thursday 29 October 2026 [C6]. - Assembly: delivered assembled [C7]. - Upper-floor service: ground-floor delivery only [C8]. # Customer requests ## Q1 Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed. ## Q2 I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed. ## Q3 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough. ## Q4 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough. ## Q5 I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself. ## Q6 I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough.inputs/
R06.md Exact prompt; reverse product order, repeat 1.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning. # Fictional offer records All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise. ## C · Cedar Wide Width is 110 cm [C1]. Delivered total is USD 480 including delivery and tax [C2]. Finish is white [C3]. Warranty is 5 years [C4]. Return window is 30 days [C5]. Confirmed arrival is Thursday 29 October 2026 [C6]. Assembly is delivered assembled [C7]. Upper-floor service is ground-floor delivery only [C8]. ## B · Birch Mini Width is 96 cm [B1]. Delivered total is USD 480 including delivery and tax [B2]. Finish is black [B3]. Warranty is 2 years [B4]. Return window is 14 days [B5]. Confirmed arrival is Thursday 29 October 2026 [B6]. Assembly is self-assembly required [B7]. Upper-floor service is ground-floor delivery only [B8]. ## A · Aster Compact Width is 98 cm [A1]. Delivered total is USD 480 including delivery and tax [A2]. Finish is white [A3]. Warranty is 3 years [A4]. Return window is 30 days [A5]. Confirmed arrival is not stated [A6]. Assembly is not stated [A7]. Upper-floor service is not stated [A8]. # Customer requests ## Q1 Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed. ## Q2 I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed. ## Q3 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough. ## Q4 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough. ## Q5 I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself. ## Q6 I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough.inputs/
R07.md Exact prompt; forward product order, repeat 2.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning. # Fictional offer records All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise. ## A · Aster Compact - Width: 98 cm [A1]. - Delivered total: USD 480 including delivery and tax [A2]. - Finish: white [A3]. - Warranty: 3 years [A4]. - Return window: 30 days [A5]. - Confirmed arrival: not stated [A6]. - Assembly: not stated [A7]. - Upper-floor service: not stated [A8]. ## B · Birch Mini - Width: 96 cm [B1]. - Delivered total: USD 480 including delivery and tax [B2]. - Finish: black [B3]. - Warranty: 2 years [B4]. - Return window: 14 days [B5]. - Confirmed arrival: Thursday 29 October 2026 [B6]. - Assembly: self-assembly required [B7]. - Upper-floor service: ground-floor delivery only [B8]. ## C · Cedar Wide - Width: 110 cm [C1]. - Delivered total: USD 480 including delivery and tax [C2]. - Finish: white [C3]. - Warranty: 5 years [C4]. - Return window: 30 days [C5]. - Confirmed arrival: Thursday 29 October 2026 [C6]. - Assembly: delivered assembled [C7]. - Upper-floor service: ground-floor delivery only [C8]. # Customer requests ## Q6 I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough. ## Q5 I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself. ## Q4 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough. ## Q3 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough. ## Q2 I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed. ## Q1 Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed.inputs/
R08.md Exact prompt; reverse product order, repeat 2.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning. # Fictional offer records All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise. ## C · Cedar Wide - Width: 110 cm [C1]. - Delivered total: USD 480 including delivery and tax [C2]. - Finish: white [C3]. - Warranty: 5 years [C4]. - Return window: 30 days [C5]. - Confirmed arrival: Thursday 29 October 2026 [C6]. - Assembly: delivered assembled [C7]. - Upper-floor service: ground-floor delivery only [C8]. ## B · Birch Mini - Width: 96 cm [B1]. - Delivered total: USD 480 including delivery and tax [B2]. - Finish: black [B3]. - Warranty: 2 years [B4]. - Return window: 14 days [B5]. - Confirmed arrival: Thursday 29 October 2026 [B6]. - Assembly: self-assembly required [B7]. - Upper-floor service: ground-floor delivery only [B8]. ## A · Aster Compact - Width: 98 cm [A1]. - Delivered total: USD 480 including delivery and tax [A2]. - Finish: white [A3]. - Warranty: 3 years [A4]. - Return window: 30 days [A5]. - Confirmed arrival: Friday 30 October 2026 [A6]. - Assembly: delivered assembled [A7]. - Upper-floor service: not stated [A8]. # Customer requests ## Q6 I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough. ## Q5 I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself. ## Q4 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough. ## Q3 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough. ## Q2 I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed. ## Q1 Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed.inputs/
R09.md Exact prompt; forward product order, repeat 2.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning. # Fictional offer records All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise. ## A · Aster Compact Width is 98 cm [A1]. Delivered total is USD 480 including delivery and tax [A2]. Finish is white [A3]. Warranty is 3 years [A4]. Return window is 30 days [A5]. Confirmed arrival is not stated [A6]. Assembly is not stated [A7]. Upper-floor service is not stated [A8]. ## B · Birch Mini Width is 96 cm [B1]. Delivered total is USD 480 including delivery and tax [B2]. Finish is black [B3]. Warranty is 2 years [B4]. Return window is 14 days [B5]. Confirmed arrival is Thursday 29 October 2026 [B6]. Assembly is self-assembly required [B7]. Upper-floor service is ground-floor delivery only [B8]. ## C · Cedar Wide Width is 110 cm [C1]. Delivered total is USD 480 including delivery and tax [C2]. Finish is white [C3]. Warranty is 5 years [C4]. Return window is 30 days [C5]. Confirmed arrival is Thursday 29 October 2026 [C6]. Assembly is delivered assembled [C7]. Upper-floor service is ground-floor delivery only [C8]. # Customer requests ## Q6 I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough. ## Q5 I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself. ## Q4 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough. ## Q3 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough. ## Q2 I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed. ## Q1 Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed.inputs/
R10.md Exact prompt; reverse product order, repeat 2.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning. # Fictional offer records All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise. ## C · Cedar Wide Width is 110 cm [C1]. Delivered total is USD 480 including delivery and tax [C2]. Finish is white [C3]. Warranty is 5 years [C4]. Return window is 30 days [C5]. Confirmed arrival is Thursday 29 October 2026 [C6]. Assembly is delivered assembled [C7]. Upper-floor service is ground-floor delivery only [C8]. ## B · Birch Mini Width is 96 cm [B1]. Delivered total is USD 480 including delivery and tax [B2]. Finish is black [B3]. Warranty is 2 years [B4]. Return window is 14 days [B5]. Confirmed arrival is Thursday 29 October 2026 [B6]. Assembly is self-assembly required [B7]. Upper-floor service is ground-floor delivery only [B8]. ## A · Aster Compact Width is 98 cm [A1]. Delivered total is USD 480 including delivery and tax [A2]. Finish is white [A3]. Warranty is 3 years [A4]. Return window is 30 days [A5]. Confirmed arrival is not stated [A6]. Assembly is not stated [A7]. Upper-floor service is not stated [A8]. # Customer requests ## Q6 I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough. ## Q5 I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself. ## Q4 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough. ## Q3 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough. ## Q2 I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed. ## Q1 Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed.inputs/
R11.md Exact prompt; forward product order, repeat 2.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning. # Fictional offer records All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise. ## A · Aster Compact - Width: 98 cm [A1]. - Delivered total: USD 480 including delivery and tax [A2]. - Finish: white [A3]. - Warranty: 3 years [A4]. - Return window: 30 days [A5]. - Confirmed arrival: Friday 30 October 2026 [A6]. - Assembly: delivered assembled [A7]. - Upper-floor service: not stated [A8]. ## B · Birch Mini - Width: 96 cm [B1]. - Delivered total: USD 480 including delivery and tax [B2]. - Finish: black [B3]. - Warranty: 2 years [B4]. - Return window: 14 days [B5]. - Confirmed arrival: Thursday 29 October 2026 [B6]. - Assembly: self-assembly required [B7]. - Upper-floor service: ground-floor delivery only [B8]. ## C · Cedar Wide - Width: 110 cm [C1]. - Delivered total: USD 480 including delivery and tax [C2]. - Finish: white [C3]. - Warranty: 5 years [C4]. - Return window: 30 days [C5]. - Confirmed arrival: Thursday 29 October 2026 [C6]. - Assembly: delivered assembled [C7]. - Upper-floor service: ground-floor delivery only [C8]. # Customer requests ## Q6 I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough. ## Q5 I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself. ## Q4 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough. ## Q3 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough. ## Q2 I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed. ## Q1 Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed.inputs/
R12.md Exact prompt; reverse product order, repeat 2.
You are helping a customer compare fictional desk offers. Use only the supplied offer records. Do not browse, inspect files, run commands or use any tool. Treat each customer request independently. Select an offer only when the supplied facts establish every must-have condition. Use status recommend for a supported selection, clarify when a potentially suitable offer needs missing information, or none when the supplied facts rule out all offers. For clarify, product_id identifies the offer requiring clarification; for none it is null. Do not invent delivery, assembly, service or price facts. Do not add customer requirements. Return the requested JSON only: one answer per case, a brief reason, the missing facts if any, and source reference IDs from the supplied records. Do not report hidden reasoning. # Fictional offer records All records refer to the same one-unit order and destination. All three products are in stock. No outside product or service is part of this material. These are invented records for an information-reading exercise. ## C · Cedar Wide - Width: 110 cm [C1]. - Delivered total: USD 480 including delivery and tax [C2]. - Finish: white [C3]. - Warranty: 5 years [C4]. - Return window: 30 days [C5]. - Confirmed arrival: Thursday 29 October 2026 [C6]. - Assembly: delivered assembled [C7]. - Upper-floor service: ground-floor delivery only [C8]. ## B · Birch Mini - Width: 96 cm [B1]. - Delivered total: USD 480 including delivery and tax [B2]. - Finish: black [B3]. - Warranty: 2 years [B4]. - Return window: 14 days [B5]. - Confirmed arrival: Thursday 29 October 2026 [B6]. - Assembly: self-assembly required [B7]. - Upper-floor service: ground-floor delivery only [B8]. ## A · Aster Compact - Width: 98 cm [A1]. - Delivered total: USD 480 including delivery and tax [A2]. - Finish: white [A3]. - Warranty: 3 years [A4]. - Return window: 30 days [A5]. - Confirmed arrival: not stated [A6]. - Assembly: not stated [A7]. - Upper-floor service: not stated [A8]. # Customer requests ## Q6 I want a black desk no wider than 100 cm, costing at most USD 500 delivered, with arrival by Thursday 29 October 2026. I can assemble it and ground-floor delivery is enough. ## Q5 I need a white desk no wider than 100 cm for at most USD 500 including delivery to my second-floor room. There is no lift. I have no deadline and can assemble it myself. ## Q4 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Thursday 29 October 2026. Ground-floor delivery is enough. ## Q3 I need a white desk, at most 100 cm wide and at most USD 500 delivered. It must arrive ready to use, with no self-assembly, no later than Friday 30 October 2026. Ground-floor delivery is enough. ## Q2 I need a desk no wider than 96 cm for at most USD 500 delivered. Either colour is fine, self-assembly is fine and I have no deadline. No upper-floor service is needed. ## Q1 Choose a white desk no wider than 100 cm for at most USD 500 delivered. I have no deadline and can assemble it myself. No upper-floor service is needed.schedule.json
Exact frozen file. For the answer key, read record/ERRATUM.md before grading.
[ { "run_id": "R01", "condition": "prose", "product_order": "forward", "repeat": 1, "case_order": [ "Q1", "Q2", "Q3", "Q4", "Q5", "Q6" ], "prompt_sha256": "7372d3c12b8b11d485332c58e9ec8e65533deae294b47487d2c7fb161209c867" }, { "run_id": "R02", "condition": "structured", "product_order": "reverse", "repeat": 1, "case_order": [ "Q1", "Q2", "Q3", "Q4", "Q5", "Q6" ], "prompt_sha256": "a8f3e3451bd947e1d747ad49abebace623d441754d93b7c5d3d12312cd0b4bc4" }, { "run_id": "R03", "condition": "enriched", "product_order": "forward", "repeat": 1, "case_order": [ "Q1", "Q2", "Q3", "Q4", "Q5", "Q6" ], "prompt_sha256": "0a940b1856ea87ea8acd6910adf105834aa971a0ba76638da34ce84f941968f7" }, { "run_id": "R04", "condition": "enriched", "product_order": "reverse", "repeat": 1, "case_order": [ "Q1", "Q2", "Q3", "Q4", "Q5", "Q6" ], "prompt_sha256": "ebf418b7df03df485bc5703d809536789e9d5d7e52a8732f30a46aba1b7ed345" }, { "run_id": "R05", "condition": "structured", "product_order": "forward", "repeat": 1, "case_order": [ "Q1", "Q2", "Q3", "Q4", "Q5", "Q6" ], "prompt_sha256": "f3a3aec2eac7b8fe4727e733c1bd34cad238c9d733d135278feabf67d1b0bcba" }, { "run_id": "R06", "condition": "prose", "product_order": "reverse", "repeat": 1, "case_order": [ "Q1", "Q2", "Q3", "Q4", "Q5", "Q6" ], "prompt_sha256": "a7d038ac730ee4930725386283a188aa731a834b8e0060d274d0e568f80f722d" }, { "run_id": "R07", "condition": "structured", "product_order": "forward", "repeat": 2, "case_order": [ "Q6", "Q5", "Q4", "Q3", "Q2", "Q1" ], "prompt_sha256": "19d24e68f35d3a5a8d2fc928f8fda019165dde736fc9405d0bed9d52b6e9d3b3" }, { "run_id": "R08", "condition": "enriched", "product_order": "reverse", "repeat": 2, "case_order": [ "Q6", "Q5", "Q4", "Q3", "Q2", "Q1" ], "prompt_sha256": "27e4ebbb7fc99430ae1bb855ae042327a4f99c0babb2574764908475adaff58b" }, { "run_id": "R09", "condition": "prose", "product_order": "forward", "repeat": 2, "case_order": [ "Q6", "Q5", "Q4", "Q3", "Q2", "Q1" ], "prompt_sha256": "fc785174efef36f57ea957612d8128fef2d4f2ec9ec24ad9baab5072d4710661" }, { "run_id": "R10", "condition": "prose", "product_order": "reverse", "repeat": 2, "case_order": [ "Q6", "Q5", "Q4", "Q3", "Q2", "Q1" ], "prompt_sha256": "e94bcbea4992ba1019206dba0832157ec91d25eb59d7627faa7d52529a8f39be" }, { "run_id": "R11", "condition": "enriched", "product_order": "forward", "repeat": 2, "case_order": [ "Q6", "Q5", "Q4", "Q3", "Q2", "Q1" ], "prompt_sha256": "95bbf174064664021eb7caf1b1d179743419181283e46e5c64f6ef7c378b70db" }, { "run_id": "R12", "condition": "structured", "product_order": "reverse", "repeat": 2, "case_order": [ "Q6", "Q5", "Q4", "Q3", "Q2", "Q1" ], "prompt_sha256": "9561fef7c9aa32f606d734776d0993db80345a21f370448ed77f9bfd7f3933f6" } ]inputs/
response-schema.json Exact frozen file. For the answer key, read record/ERRATUM.md before grading.
{ "type": "object", "properties": { "answers": { "type": "array", "items": { "type": "object", "properties": { "case_id": { "type": "string" }, "status": { "type": "string", "enum": [ "recommend", "clarify", "none" ] }, "product_id": { "type": [ "string", "null" ], "enum": [ "A", "B", "C", null ] }, "reason": { "type": "string" }, "missing_facts": { "type": "array", "items": { "type": "string" } }, "source_refs": { "type": "array", "items": { "type": "string" } } }, "required": [ "case_id", "status", "product_id", "reason", "missing_facts", "source_refs" ], "additionalProperties": false } } }, "required": [ "answers" ], "additionalProperties": false }inputs/
grading-key.json Exact frozen file. For the answer key, read record/ERRATUM.md before grading.
[ { "case_id": "Q1", "base_status": "recommend", "base_product": "A", "enriched_status": "recommend", "enriched_product": "A", "key_refs": [ "A1", "A2", "A3" ], "check": "Ordinary fit; do not add unstated requirements." }, { "case_id": "Q2", "base_status": "recommend", "base_product": "B", "enriched_status": "recommend", "enriched_product": "B", "key_refs": [ "B1", "B2" ], "check": "Competitor fits; A is too wide." }, { "case_id": "Q3", "base_status": "clarify", "base_product": "A", "enriched_status": "recommend", "enriched_product": "A", "key_refs": [ "A1", "A2", "A3", "A6", "A7" ], "check": "Before disclosure: arrival and assembly both unresolved. After: A meets both." }, { "case_id": "Q4", "base_status": "clarify", "base_product": "A", "enriched_status": "none", "enriched_product": null, "key_refs": [ "A1", "A2", "A3", "A6", "A7" ], "check": "Before: arrival and assembly unresolved. After: A arrives too late; B colour/C width disqualify." }, { "case_id": "Q5", "base_status": "clarify", "base_product": "A", "enriched_status": "clarify", "enriched_product": "A", "key_refs": [ "A1", "A2", "A3", "A9" ], "check": "Upper-floor service and any extra cost remain unknown in every condition." }, { "case_id": "Q6", "base_status": "recommend", "base_product": "B", "enriched_status": "recommend", "enriched_product": "B", "key_refs": [ "B1", "B2", "B3", "B6", "B7" ], "check": "Known competitor deadline fit; A colour disqualifies." } ]lock.json
Checks distributed execution files before any session starts.
{ "purpose": "Reader-package integrity manifest; research freeze identified in record/TEST.md", "files": { "run.py": "4c52591eb02cede5bbcc0892372b69f9b06391d4eb7f6d48e02122fb8b4df61b", "inputs/R01.md": "7372d3c12b8b11d485332c58e9ec8e65533deae294b47487d2c7fb161209c867", "inputs/R02.md": "a8f3e3451bd947e1d747ad49abebace623d441754d93b7c5d3d12312cd0b4bc4", "inputs/R03.md": "0a940b1856ea87ea8acd6910adf105834aa971a0ba76638da34ce84f941968f7", "inputs/R04.md": "ebf418b7df03df485bc5703d809536789e9d5d7e52a8732f30a46aba1b7ed345", "inputs/R05.md": "f3a3aec2eac7b8fe4727e733c1bd34cad238c9d733d135278feabf67d1b0bcba", "inputs/R06.md": "a7d038ac730ee4930725386283a188aa731a834b8e0060d274d0e568f80f722d", "inputs/R07.md": "19d24e68f35d3a5a8d2fc928f8fda019165dde736fc9405d0bed9d52b6e9d3b3", "inputs/R08.md": "27e4ebbb7fc99430ae1bb855ae042327a4f99c0babb2574764908475adaff58b", "inputs/R09.md": "fc785174efef36f57ea957612d8128fef2d4f2ec9ec24ad9baab5072d4710661", "inputs/R10.md": "e94bcbea4992ba1019206dba0832157ec91d25eb59d7627faa7d52529a8f39be", "inputs/R11.md": "95bbf174064664021eb7caf1b1d179743419181283e46e5c64f6ef7c378b70db", "inputs/R12.md": "9561fef7c9aa32f606d734776d0993db80345a21f370448ed77f9bfd7f3933f6", "schedule.json": "9d58456e20b0634c55092dd8bd88dbcd4574237b5f20db097ad1540376fa918c", "inputs/response-schema.json": "01ac6db0b94e37d6f8181d4663b2dfd8d7f1976517c0bf2c1d403eea21f57a8c", "inputs/grading-key.json": "10be8b3c9bfbeddb69a5fe9fbdf2e43a8242b47b2c5a65b692d916c822f2c62e" } }record/
TEST.md Preserved test material.
# Test record · offer reading comparison ## Actual run 26 October 2026. Codex CLI 0.153.2, requested model alias gpt-6-astra, high reasoning effort, authenticated through an existing ChatGPT account. The exact backend snapshot and monetary model cost were not exposed. Twelve fresh serial sessions, six decisions per session; four sessions and 24 decisions per condition. Two product orders, twice each; request order reversed on the second repeat. No tools were used; no failed study sessions or retries. An unrelated transport probe preceded the study. The protocol, prompts, schedule and decision key were frozen in Git commit 37d2524 before the first study run. Prose and labelled bullets contained the same 24 cited fields. The enriched condition disclosed A6 (Friday arrival) and A7 (assembled) from an invented reference fixture. It changed the information available, not just its presentation. ## Measures and findings A correct answer passes four checks: expected decision/product; respects constraints; preserves relevant unknowns without unsupported promises; cites valid support. A clarification can be correct. A resolved answer recommends a product or rules all offers out; it is a separate measure. | Condition | Correct / 24 | Resolved / 24 | Recommend A / 24 | | --- | --- | --- | --- | | Prose | 24 | 12 | 4 | | Labelled bullets, same facts | 24 | 12 | 4 | | Bullets plus two missing facts | 24 | 20 | 8 | All four repetitions of each case had the same status/product within each condition. An actual separate Atlas AI reviewer (/root/offer_review) read all 72 raw answers, checked their facts and references and verified the counts. No human participant study is claimed. See record/results.csv for the per-answer checks and record/RESPONSES.md for verbatim final answers. Q3 becomes recommend A after the Friday/assembled disclosure. Q4 becomes no suitable offer: Thursday is too early for A, B is black, C is too wide. Q5 remains unresolved because upstairs service and its cost are unknown. More A recommendations alone would be a poor success measure. ## Evaluator correction See record/ERRATUM.md. Q5's frozen key mistyped A8 as A9. The original is preserved. Enriched Q4 is checked against its actual exclusion reasons, in accordance with protocol check 4. No inputs or raw outputs changed after execution. ## What this supports The workflow could be executed and audited on these six authored cases. There was no observed decision-accuracy difference between prose and bullets. Prose already passed all checks, leaving no headroom. Added information resolved expected cases in opposite directions; this is a demonstration of using supplied information, not evidence of a general optimization gain. ## Limits One model configuration on one day; fictional USD offers and English requests supplied in full. The six decisions within a session are correlated, and all cases were authored before execution rather than sampled from real customers. No search, crawling, ranking, brand authority, traffic, checkout or sales was tested. No general success probability or statistical significance is estimated. No measured net time saving. Recorded model-session wall time totals 197.094 seconds and excludes preparation, review and rework. Emitted usage was retained internally; it is not a monetary-cost estimate. ## Reader package Prepared after the run. run.py, the 12 prompt files, schedule, response schema and original grading key are byte-identical to the executed material after a single final newline. lock.json is a new package-integrity manifest for these distributed files, not the original research freeze. Descriptive README/protocol/results files are editorial packaging. The runner uses an empty temporary directory and does not modify your project instructions. Read it before executing; twelve sessions consume your account usage. Other tools and model aliases have not been tested here. Next useful comparison: held-out, naturally difficult customer cases and genuinely messy material, with checks written before outputs. A ceiling result does not justify a formatting campaign. Public discovery and commercial value require separate tests with their own controls.record/
PROTOCOL.md Preserved test material.
# Offer reading comparison · protocol 1 Frozen before substantive model execution, 26 October 2026. Author `/root`. This protocol operationalizes the earlier unexecuted GEO Stage A proposal. It is a small constructed comparison, not a representative GEO benchmark. ## Question and execution Can changing presentation, or disclosing genuinely missing facts, change a supported customer decision? Run three conditions: prose; the same fact statements organized as labelled bullets; the bullet version with A6 (confirmed Friday arrival) and A7 (delivered assembled) disclosed from the fictional reference fixture. The last condition changes information as well as presentation and cannot estimate formatting alone. Use the existing ChatGPT-authenticated Codex CLI, installed version 0.153.2. Request the user's configured model alias `gpt-6-astra` and effort `high` consistently. Exact backend snapshot and monetary model cost may not be exposed; do not infer them. No new API key, subscription or external integration. Ignore user config for this controlled run, retain normal rules, use read-only permissions, and use an empty working directory. The global AGENTS file was inspected and is empty. No tools or outside facts are needed or requested. These execution settings are specific to the instrument, not advice to replace project rules. There are 12 fresh serial sessions, each answering all six requests once: 4 sessions/24 decisions per condition; 72 decisions total. Product order is forward or reverse, twice each; request order reverses in the second repeat. `schedule.json` fixes launch order before outputs. Sessions are fresh but share a model/service; six decisions within a session are correlated. No treating 72 answers as 72 independently sampled customers. No inferential p-values, claimed global success rate or manufactured confidence intervals. An unrelated transport probe may verify authentication/JSON delivery before the study. It uses no study offers or requests and cannot be used to tune those prompts. Study materials and scoring are locked before any study run. No result-adaptive prompt changes, cherry-picking or silent retries. On infrastructure failure, retain the failed attempt and stop to document the fault; any resumed execution or changed protocol must be labelled. ## Prewritten measures and decisions Primary comparison of prose versus structured: supported-decision correctness. Expected status/product pairs are in `inputs/grading-key.json`. A clarification can be fully correct: missing information is not an error in the answer. Compare each of the six cases, not merely the total. Evaluate every response on four checks: 1. Status and product match the supplied-information decision key. 2. The explanation respects the customer's binding constraints; it does not recommend a disqualified alternative or invent a requirement. 3. Missing facts remain explicit and no unsupported promise, fee, service or date is introduced. Q3/Q4 need arrival and assembly clarified before disclosure; Q5 needs upper-floor service and any extra charge resolved in every condition. 4. The cited record IDs exist and support the decisive explanation. Extra valid references are allowed; references do not excuse an unsupported claim. Report structural decision-key matching separately from independently reviewed factual/semantic checks. Overall pass requires all four checks. Preserve raw final outputs and any failed/invalid responses before correction. Do not silently regrade a repaired answer as first-pass success. Secondary: resolved decisions (`recommend` or `none`), product A recommendations, and how each changes with new information. Increased A mentions/recommendations are not success by themselves. In particular Q2/Q6 should choose B, Q4 should rule all offers out after the Friday disclosure, and Q5 should remain unresolved. Record session wall time and emitted usage if available, without calling them net time savings or monetary cost. Interpretation rule: a ceiling in the prose condition limits detectable accuracy improvement. A tie is 'no difference observed here', not proof formatting never matters. A resolved negative decision can be useful. Information-addition results establish at most that the model used supplied fictional facts in these prompts, not public discovery, consumer behavior or revenue. ## Boundaries and next decision English prompts, invented US-dollar offers, a fixed order and destination, six authored requests, one requested model configuration on one day. No search/retrieval, real brand authority, real customers, actual checkout, public page ranking or sales measured. No claim of general advantage across languages/platforms. Preparation/review/rework are part of doing the workflow; a complete net-time measure is not available. After execution: retain all outcomes, obtain independent response checking as part of separate review, then publish a Playbook only if its instructions reproduce the actual runnable package. A null or adverse result is publishable. Do not add a new memory rule or production GEO rewrite from this bounded test alone.record/
ERRATUM.md Preserved test material.
# Grading clarification · 26 October 2026 Recorded after execution and before final grading. The frozen original remains available as inputs/grading-key.json. - Q5 lists A9. The upper-floor record is A8. A9 does not exist. The decision, underlying field and prompt are unchanged. Check references against A8. - In enriched Q4, A6 (late arrival), B3 (wrong finish) and C1 (too wide) establish that none fits. B7 is a valid additional reason. The base key's positive-fit references are not a mandatory list: protocol check 4 requires valid support for the decisive explanation. - The fixture contains 24 cited fields: eight per offer. An author preparation note counted 27; this was not a model input or an evaluation measure. The common introduction supplies stock and scope. No prompt, expected decision or response was revised. An independent reviewer checked all 72 raw answers against the four original protocol checks after this clarification. The reference mistake is an evaluator error, not a model error.record/
results.csv Independent semantic audit, one row per answer; original response hashes retained.
run_id,condition,product_order,repeat,case_id,expected_status,expected_product,actual_status,actual_product,check_1_decision,check_2_constraints,check_3_uncertainty,check_4_sources,overall,resolved,source_refs,review_note,response_sha256,reviewer R01,prose,forward,1,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",40021e348d120adbfc599a7ade12c89427f41f592bd7ffa390d336f58a65b433,/root/offer_review R01,prose,forward,1,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7;B8,B meets 96 cm/USD 480; competitor recommendation is correct.,40021e348d120adbfc599a7ade12c89427f41f592bd7ffa390d336f58a65b433,/root/offer_review R01,prose,forward,1,Q3,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,40021e348d120adbfc599a7ade12c89427f41f592bd7ffa390d336f58a65b433,/root/offer_review R01,prose,forward,1,Q4,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",40021e348d120adbfc599a7ade12c89427f41f592bd7ffa390d336f58a65b433,/root/offer_review R01,prose,forward,1,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,40021e348d120adbfc599a7ade12c89427f41f592bd7ffa390d336f58a65b433,/root/offer_review R01,prose,forward,1,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,40021e348d120adbfc599a7ade12c89427f41f592bd7ffa390d336f58a65b433,/root/offer_review R02,structured,reverse,1,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",5d084bf4e190f63eadfefb6678fc7481bfaaa75e714558ef106d8f24d4c204bb,/root/offer_review R02,structured,reverse,1,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7,B meets 96 cm/USD 480; competitor recommendation is correct.,5d084bf4e190f63eadfefb6678fc7481bfaaa75e714558ef106d8f24d4c204bb,/root/offer_review R02,structured,reverse,1,Q3,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,5d084bf4e190f63eadfefb6678fc7481bfaaa75e714558ef106d8f24d4c204bb,/root/offer_review R02,structured,reverse,1,Q4,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",5d084bf4e190f63eadfefb6678fc7481bfaaa75e714558ef106d8f24d4c204bb,/root/offer_review R02,structured,reverse,1,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,5d084bf4e190f63eadfefb6678fc7481bfaaa75e714558ef106d8f24d4c204bb,/root/offer_review R02,structured,reverse,1,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,5d084bf4e190f63eadfefb6678fc7481bfaaa75e714558ef106d8f24d4c204bb,/root/offer_review R03,enriched,forward,1,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",80aeeb8ed67df2efa49f5fb47889e4b3107e578b9f701827c060d62878120042,/root/offer_review R03,enriched,forward,1,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7,B meets 96 cm/USD 480; competitor recommendation is correct.,80aeeb8ed67df2efa49f5fb47889e4b3107e578b9f701827c060d62878120042,/root/offer_review R03,enriched,forward,1,Q3,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,80aeeb8ed67df2efa49f5fb47889e4b3107e578b9f701827c060d62878120042,/root/offer_review R03,enriched,forward,1,Q4,none,,none,,pass,pass,pass,pass,pass,true,A6;B3;B7;C1,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",80aeeb8ed67df2efa49f5fb47889e4b3107e578b9f701827c060d62878120042,/root/offer_review R03,enriched,forward,1,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8;B8;C8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,80aeeb8ed67df2efa49f5fb47889e4b3107e578b9f701827c060d62878120042,/root/offer_review R03,enriched,forward,1,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,80aeeb8ed67df2efa49f5fb47889e4b3107e578b9f701827c060d62878120042,/root/offer_review R04,enriched,reverse,1,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",e9d79f8899357959e29dd180ae662f4dccc6552fc550e6e3ca226f09aab7f823,/root/offer_review R04,enriched,reverse,1,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7,B meets 96 cm/USD 480; competitor recommendation is correct.,e9d79f8899357959e29dd180ae662f4dccc6552fc550e6e3ca226f09aab7f823,/root/offer_review R04,enriched,reverse,1,Q3,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,e9d79f8899357959e29dd180ae662f4dccc6552fc550e6e3ca226f09aab7f823,/root/offer_review R04,enriched,reverse,1,Q4,none,,none,,pass,pass,pass,pass,pass,true,A6;B3;C1,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",e9d79f8899357959e29dd180ae662f4dccc6552fc550e6e3ca226f09aab7f823,/root/offer_review R04,enriched,reverse,1,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,e9d79f8899357959e29dd180ae662f4dccc6552fc550e6e3ca226f09aab7f823,/root/offer_review R04,enriched,reverse,1,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,e9d79f8899357959e29dd180ae662f4dccc6552fc550e6e3ca226f09aab7f823,/root/offer_review R05,structured,forward,1,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",c1fa6e1cbf45dfed96c8c7b3ad85c5c66fc1ddf30197a176de74f7c21e2d2f0e,/root/offer_review R05,structured,forward,1,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7;B8,B meets 96 cm/USD 480; competitor recommendation is correct.,c1fa6e1cbf45dfed96c8c7b3ad85c5c66fc1ddf30197a176de74f7c21e2d2f0e,/root/offer_review R05,structured,forward,1,Q3,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,c1fa6e1cbf45dfed96c8c7b3ad85c5c66fc1ddf30197a176de74f7c21e2d2f0e,/root/offer_review R05,structured,forward,1,Q4,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",c1fa6e1cbf45dfed96c8c7b3ad85c5c66fc1ddf30197a176de74f7c21e2d2f0e,/root/offer_review R05,structured,forward,1,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,c1fa6e1cbf45dfed96c8c7b3ad85c5c66fc1ddf30197a176de74f7c21e2d2f0e,/root/offer_review R05,structured,forward,1,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,c1fa6e1cbf45dfed96c8c7b3ad85c5c66fc1ddf30197a176de74f7c21e2d2f0e,/root/offer_review R06,prose,reverse,1,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",b7a7f8f18bca7dde30ddb972fcec3f566e00857495060a629ad0ca5f824836cb,/root/offer_review R06,prose,reverse,1,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7,B meets 96 cm/USD 480; competitor recommendation is correct.,b7a7f8f18bca7dde30ddb972fcec3f566e00857495060a629ad0ca5f824836cb,/root/offer_review R06,prose,reverse,1,Q3,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,b7a7f8f18bca7dde30ddb972fcec3f566e00857495060a629ad0ca5f824836cb,/root/offer_review R06,prose,reverse,1,Q4,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",b7a7f8f18bca7dde30ddb972fcec3f566e00857495060a629ad0ca5f824836cb,/root/offer_review R06,prose,reverse,1,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,b7a7f8f18bca7dde30ddb972fcec3f566e00857495060a629ad0ca5f824836cb,/root/offer_review R06,prose,reverse,1,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,b7a7f8f18bca7dde30ddb972fcec3f566e00857495060a629ad0ca5f824836cb,/root/offer_review R07,structured,forward,2,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,c620f5bf8021da21ec867fb81bf7c84f3a2462619dd7cae4137df318766d1bdc,/root/offer_review R07,structured,forward,2,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,c620f5bf8021da21ec867fb81bf7c84f3a2462619dd7cae4137df318766d1bdc,/root/offer_review R07,structured,forward,2,Q4,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",c620f5bf8021da21ec867fb81bf7c84f3a2462619dd7cae4137df318766d1bdc,/root/offer_review R07,structured,forward,2,Q3,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,c620f5bf8021da21ec867fb81bf7c84f3a2462619dd7cae4137df318766d1bdc,/root/offer_review R07,structured,forward,2,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7;B8,B meets 96 cm/USD 480; competitor recommendation is correct.,c620f5bf8021da21ec867fb81bf7c84f3a2462619dd7cae4137df318766d1bdc,/root/offer_review R07,structured,forward,2,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",c620f5bf8021da21ec867fb81bf7c84f3a2462619dd7cae4137df318766d1bdc,/root/offer_review R08,enriched,reverse,2,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,3b7cd680be083e6ca8976e31b581de85e9cab34909389c7afd2f128d647587df,/root/offer_review R08,enriched,reverse,2,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,3b7cd680be083e6ca8976e31b581de85e9cab34909389c7afd2f128d647587df,/root/offer_review R08,enriched,reverse,2,Q4,none,,none,,pass,pass,pass,pass,pass,true,A6;B3;B7;C1,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",3b7cd680be083e6ca8976e31b581de85e9cab34909389c7afd2f128d647587df,/root/offer_review R08,enriched,reverse,2,Q3,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,3b7cd680be083e6ca8976e31b581de85e9cab34909389c7afd2f128d647587df,/root/offer_review R08,enriched,reverse,2,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7;B8,B meets 96 cm/USD 480; competitor recommendation is correct.,3b7cd680be083e6ca8976e31b581de85e9cab34909389c7afd2f128d647587df,/root/offer_review R08,enriched,reverse,2,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",3b7cd680be083e6ca8976e31b581de85e9cab34909389c7afd2f128d647587df,/root/offer_review R09,prose,forward,2,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,505d369522e69b2da297a00feeb9b3f58c70eda6c6e5386d88ee82745c3234d3,/root/offer_review R09,prose,forward,2,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID. One combined missing-fact item explicitly covers both service and cost; two separate strings are not required.,505d369522e69b2da297a00feeb9b3f58c70eda6c6e5386d88ee82745c3234d3,/root/offer_review R09,prose,forward,2,Q4,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",505d369522e69b2da297a00feeb9b3f58c70eda6c6e5386d88ee82745c3234d3,/root/offer_review R09,prose,forward,2,Q3,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,505d369522e69b2da297a00feeb9b3f58c70eda6c6e5386d88ee82745c3234d3,/root/offer_review R09,prose,forward,2,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7;B8,B meets 96 cm/USD 480; competitor recommendation is correct.,505d369522e69b2da297a00feeb9b3f58c70eda6c6e5386d88ee82745c3234d3,/root/offer_review R09,prose,forward,2,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",505d369522e69b2da297a00feeb9b3f58c70eda6c6e5386d88ee82745c3234d3,/root/offer_review R10,prose,reverse,2,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,66c7bb34afa1e5a6a698b2eead0243108c9282447c4f1fa64739960b664701ae,/root/offer_review R10,prose,reverse,2,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8;B3;C1,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID. One combined missing-fact item explicitly covers both service and cost; two separate strings are not required.,66c7bb34afa1e5a6a698b2eead0243108c9282447c4f1fa64739960b664701ae,/root/offer_review R10,prose,reverse,2,Q4,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7;B3;C1,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",66c7bb34afa1e5a6a698b2eead0243108c9282447c4f1fa64739960b664701ae,/root/offer_review R10,prose,reverse,2,Q3,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7;B3;C1,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,66c7bb34afa1e5a6a698b2eead0243108c9282447c4f1fa64739960b664701ae,/root/offer_review R10,prose,reverse,2,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7;B8,B meets 96 cm/USD 480; competitor recommendation is correct.,66c7bb34afa1e5a6a698b2eead0243108c9282447c4f1fa64739960b664701ae,/root/offer_review R10,prose,reverse,2,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",66c7bb34afa1e5a6a698b2eead0243108c9282447c4f1fa64739960b664701ae,/root/offer_review R11,enriched,forward,2,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,82917bb159804277046aa8fc46a8062d64303f8fa8e5797fb4ccf8df58e61326,/root/offer_review R11,enriched,forward,2,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,82917bb159804277046aa8fc46a8062d64303f8fa8e5797fb4ccf8df58e61326,/root/offer_review R11,enriched,forward,2,Q4,none,,none,,pass,pass,pass,pass,pass,true,A6;B3;B7;C1,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",82917bb159804277046aa8fc46a8062d64303f8fa8e5797fb4ccf8df58e61326,/root/offer_review R11,enriched,forward,2,Q3,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,82917bb159804277046aa8fc46a8062d64303f8fa8e5797fb4ccf8df58e61326,/root/offer_review R11,enriched,forward,2,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7,B meets 96 cm/USD 480; competitor recommendation is correct.,82917bb159804277046aa8fc46a8062d64303f8fa8e5797fb4ccf8df58e61326,/root/offer_review R11,enriched,forward,2,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",82917bb159804277046aa8fc46a8062d64303f8fa8e5797fb4ccf8df58e61326,/root/offer_review R12,structured,reverse,2,Q6,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B3;B6;B7;B8,B meets black/96 cm/USD 480/Thursday arrival; assembly and ground-floor terms fit.,f92b18abb54e3481c4411e5bc321d7c2a205da0c0edcf6bd09a129a04b1bf779,/root/offer_review R12,structured,reverse,2,Q5,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A8,Upper-floor/no-lift service and inclusive price remain explicitly unresolved; A8 is the correct source ID.,f92b18abb54e3481c4411e5bc321d7c2a205da0c0edcf6bd09a129a04b1bf779,/root/offer_review R12,structured,reverse,2,Q4,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,"Both delivery and assembly unresolved before disclosure; after disclosure A is late, B wrong colour, C too wide.",f92b18abb54e3481c4411e5bc321d7c2a205da0c0edcf6bd09a129a04b1bf779,/root/offer_review R12,structured,reverse,2,Q3,clarify,A,clarify,A,pass,pass,pass,pass,pass,false,A1;A2;A3;A6;A7,Arrival and assembly both explicit gaps before disclosure; Friday assembled arrival supports A after disclosure.,f92b18abb54e3481c4411e5bc321d7c2a205da0c0edcf6bd09a129a04b1bf779,/root/offer_review R12,structured,reverse,2,Q2,recommend,B,recommend,B,pass,pass,pass,pass,pass,true,B1;B2;B7;B8,B meets 96 cm/USD 480; competitor recommendation is correct.,f92b18abb54e3481c4411e5bc321d7c2a205da0c0edcf6bd09a129a04b1bf779,/root/offer_review R12,structured,reverse,2,Q1,recommend,A,recommend,A,pass,pass,pass,pass,pass,true,A1;A2;A3,"A meets white/98 cm/USD 480; no extra deadline, assembly or stairs requirement invented.",f92b18abb54e3481c4411e5bc321d7c2a205da0c0edcf6bd09a129a04b1bf779,/root/offer_reviewrecord/
RESPONSES.md All twelve final outputs; compare with the individual prompt and answer key.
# Verbatim final answers Twelve completed sessions. Quotes are original output, not repaired examples. No private reasoning or authentication data is included. ## R01 · prose · forward · repeat 1 ```json {"answers":[{"case_id":"Q1","status":"recommend","product_id":"A","reason":"A is white, 98 cm wide, and USD 480 delivered, meeting every must-have.","missing_facts":[],"source_refs":["A1","A2","A3"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"B is 96 cm wide and USD 480 delivered; self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B7","B8"]},{"case_id":"Q3","status":"clarify","product_id":"A","reason":"A meets the colour, width, and delivered-price limits, but arrival and assembly are unstated.","missing_facts":["Whether A will arrive by Friday 30 October 2026.","Whether A will arrive ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q4","status":"clarify","product_id":"A","reason":"A meets the colour, width, and delivered-price limits, but arrival and assembly are unstated.","missing_facts":["Whether A will arrive by Thursday 29 October 2026.","Whether A will arrive ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"A meets the colour and width limits, but second-floor room delivery and its inclusive total are unconfirmed.","missing_facts":["Whether A can be delivered to the second-floor room without a lift.","Whether the total including delivery to that room is at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q6","status":"recommend","product_id":"B","reason":"B is black, 96 cm wide, and USD 480 delivered, with confirmed arrival on Thursday 29 October 2026. Its assembly and delivery terms are acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]}]} ``` ## R02 · structured · reverse · repeat 1 ```json {"answers":[{"case_id":"Q1","status":"recommend","product_id":"A","reason":"A meets the white finish, width and delivered budget requirements.","missing_facts":[],"source_refs":["A1","A2","A3"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"B is 96 cm wide and costs USD 480 delivered; self-assembly is acceptable.","missing_facts":[],"source_refs":["B1","B2","B7"]},{"case_id":"Q3","status":"clarify","product_id":"A","reason":"A meets the finish, width and budget requirements, but arrival and assembly are unstated.","missing_facts":["Whether A will arrive by Friday 30 October 2026.","Whether A will arrive ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q4","status":"clarify","product_id":"A","reason":"A meets the finish, width and budget requirements, but arrival and assembly are unstated.","missing_facts":["Whether A will arrive by Thursday 29 October 2026.","Whether A will arrive ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"A meets the finish and width requirements, but second-floor room delivery and its total cost are unconfirmed.","missing_facts":["Whether A can be delivered to the second-floor room without a lift.","Whether the total including that delivery is at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q6","status":"recommend","product_id":"B","reason":"B meets the black finish, width, delivered budget and arrival deadline requirements; its assembly and delivery terms are acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]}]} ``` ## R03 · enriched · forward · repeat 1 ```json {"answers":[{"case_id":"Q1","status":"recommend","product_id":"A","reason":"A is white, 98 cm wide and USD 480 delivered, meeting every must-have.","missing_facts":[],"source_refs":["A1","A2","A3"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"B is 96 cm wide and USD 480 delivered; its self-assembly requirement is acceptable.","missing_facts":[],"source_refs":["B1","B2","B7"]},{"case_id":"Q3","status":"recommend","product_id":"A","reason":"A is white, 98 cm wide, USD 480 delivered and delivered assembled, with confirmed arrival on Friday 30 October 2026.","missing_facts":[],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q4","status":"none","product_id":null,"reason":"A arrives after the deadline; B is black and requires self-assembly; C exceeds the width limit.","missing_facts":[],"source_refs":["A6","B3","B7","C1"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"A meets the colour and width requirements, but second-floor room delivery without a lift and its total cost are unconfirmed. B and C offer ground-floor delivery only.","missing_facts":["Whether A can be delivered to the second-floor room without a lift.","Whether A's total including that room delivery is at most USD 500."],"source_refs":["A1","A2","A3","A8","B8","C8"]},{"case_id":"Q6","status":"recommend","product_id":"B","reason":"B is black, 96 cm wide and USD 480 delivered, with confirmed arrival on Thursday 29 October 2026; self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]}]} ``` ## R04 · enriched · reverse · repeat 1 ```json {"answers":[{"case_id":"Q1","status":"recommend","product_id":"A","reason":"Aster Compact is white, 98 cm wide and USD 480 delivered.","missing_facts":[],"source_refs":["A1","A2","A3"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"Birch Mini is 96 cm wide and USD 480 delivered; self-assembly is acceptable.","missing_facts":[],"source_refs":["B1","B2","B7"]},{"case_id":"Q3","status":"recommend","product_id":"A","reason":"Aster Compact is white, 98 cm wide and USD 480 delivered. It arrives assembled on Friday 30 October 2026, meeting the deadline.","missing_facts":[],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q4","status":"none","product_id":null,"reason":"Aster Compact arrives after the deadline, Birch Mini is black, and Cedar Wide exceeds the width limit.","missing_facts":[],"source_refs":["A6","B3","C1"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour and width requirements, but second-floor room delivery without a lift and its total cost are unconfirmed.","missing_facts":["Whether delivery to the second-floor room without a lift is available.","Whether the total including that delivery and tax is at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q6","status":"recommend","product_id":"B","reason":"Birch Mini is black, 96 cm wide and USD 480 delivered. It arrives Thursday 29 October 2026, with acceptable self-assembly and ground-floor delivery.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]}]} ``` ## R05 · structured · forward · repeat 1 ```json {"answers":[{"case_id":"Q1","status":"recommend","product_id":"A","reason":"A is white, 98 cm wide and USD 480 delivered, meeting every must-have.","missing_facts":[],"source_refs":["A1","A2","A3"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"B is 96 cm wide and USD 480 delivered; self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B7","B8"]},{"case_id":"Q3","status":"clarify","product_id":"A","reason":"A meets the colour, width and delivered-price limits, but arrival and assembly are unspecified.","missing_facts":["Whether A will arrive by Friday 30 October 2026.","Whether A will arrive ready to use with no self-assembly required."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q4","status":"clarify","product_id":"A","reason":"A meets the colour, width and delivered-price limits, but arrival and assembly are unspecified.","missing_facts":["Whether A will arrive by Thursday 29 October 2026.","Whether A will arrive ready to use with no self-assembly required."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"A meets the colour and width limits, but second-floor room delivery and its total cost are unconfirmed.","missing_facts":["Whether A can be delivered to the second-floor room without a lift.","Whether the total including that room delivery and tax is at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q6","status":"recommend","product_id":"B","reason":"B is black, 96 cm wide and USD 480 delivered, with confirmed arrival on Thursday 29 October 2026; its assembly and delivery terms are acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]}]} ``` ## R06 · prose · reverse · repeat 1 ```json {"answers":[{"case_id":"Q1","status":"recommend","product_id":"A","reason":"A is white, 98 cm wide and USD 480 delivered, meeting all must-haves.","missing_facts":[],"source_refs":["A1","A2","A3"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"B is 96 cm wide and USD 480 delivered; self-assembly is acceptable.","missing_facts":[],"source_refs":["B1","B2","B7"]},{"case_id":"Q3","status":"clarify","product_id":"A","reason":"A meets the colour, width and price requirements, but arrival and assembly are unstated.","missing_facts":["Whether A will arrive by Friday 30 October 2026.","Whether A arrives ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q4","status":"clarify","product_id":"A","reason":"A meets the colour, width and price requirements, but arrival and assembly are unstated.","missing_facts":["Whether A will arrive by Thursday 29 October 2026.","Whether A arrives ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"A meets the colour and width requirements, but second-floor room delivery and its total price are unconfirmed.","missing_facts":["Whether A can be delivered to the second-floor room without a lift.","Whether the total including that room delivery is at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q6","status":"recommend","product_id":"B","reason":"B is black, 96 cm wide and USD 480 delivered, with confirmed arrival on Thursday 29 October 2026; its assembly and delivery terms are acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]}]} ``` ## R07 · structured · forward · repeat 2 ```json {"answers":[{"case_id":"Q6","status":"recommend","product_id":"B","reason":"B meets the colour, width, delivered budget, arrival deadline and service requirements; self-assembly is acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"A meets the colour and width requirements, but second-floor room delivery without a lift and its inclusive total need confirmation.","missing_facts":["Whether delivery to the second-floor room without a lift is available.","Whether the total including that service and tax is at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q4","status":"clarify","product_id":"A","reason":"A meets the colour, width and delivered budget requirements, but assembly and arrival are unstated.","missing_facts":["Whether A arrives ready to use with no self-assembly.","Whether arrival is confirmed no later than Thursday 29 October 2026."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q3","status":"clarify","product_id":"A","reason":"A meets the colour, width and delivered budget requirements, but assembly and arrival are unstated.","missing_facts":["Whether A arrives ready to use with no self-assembly.","Whether arrival is confirmed no later than Friday 30 October 2026."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"B is 96 cm wide and USD 480 delivered; its self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B7","B8"]},{"case_id":"Q1","status":"recommend","product_id":"A","reason":"A is white, 98 cm wide and USD 480 delivered, meeting every must-have condition.","missing_facts":[],"source_refs":["A1","A2","A3"]}]} ``` ## R08 · enriched · reverse · repeat 2 ```json {"answers":[{"case_id":"Q6","status":"recommend","product_id":"B","reason":"Birch Mini meets the colour, width, delivered budget and arrival deadline; self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour and width requirements, but second-floor room delivery without a lift and its total cost are unconfirmed.","missing_facts":["Whether delivery to the second-floor room without a lift is available.","Whether the total including that service is at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q4","status":"none","product_id":null,"reason":"Aster Compact arrives after the deadline, Birch Mini is black and requires assembly, and Cedar Wide exceeds the width limit.","missing_facts":[],"source_refs":["A6","B3","B7","C1"]},{"case_id":"Q3","status":"recommend","product_id":"A","reason":"Aster Compact is white, 98 cm wide, USD 480 delivered, delivered assembled and confirmed to arrive by Friday 30 October.","missing_facts":[],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"Birch Mini is 96 cm wide and USD 480 delivered; self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B7","B8"]},{"case_id":"Q1","status":"recommend","product_id":"A","reason":"Aster Compact is white, 98 cm wide and USD 480 delivered, meeting all must-have conditions.","missing_facts":[],"source_refs":["A1","A2","A3"]}]} ``` ## R09 · prose · forward · repeat 2 ```json {"answers":[{"case_id":"Q6","status":"recommend","product_id":"B","reason":"Birch Mini meets the colour, width, price and arrival requirements; its assembly and delivery terms are acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour and width requirements, but second-floor room delivery without a lift and its inclusive total need confirmation.","missing_facts":["Whether delivery to the second-floor room without a lift is available with a total price of at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q4","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour, width and price requirements, but arrival and assembly are unspecified.","missing_facts":["Whether arrival is confirmed by Thursday 29 October 2026.","Whether it arrives ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q3","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour, width and price requirements, but arrival and assembly are unspecified.","missing_facts":["Whether arrival is confirmed by Friday 30 October 2026.","Whether it arrives ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"Birch Mini is 96 cm wide and USD 480 delivered; self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B7","B8"]},{"case_id":"Q1","status":"recommend","product_id":"A","reason":"Aster Compact is white, 98 cm wide and USD 480 delivered, meeting every must-have condition.","missing_facts":[],"source_refs":["A1","A2","A3"]}]} ``` ## R10 · prose · reverse · repeat 2 ```json {"answers":[{"case_id":"Q6","status":"recommend","product_id":"B","reason":"Birch Mini meets the colour, width, delivered budget and arrival requirements; self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour and width requirements, but second-floor room delivery without a lift within the budget is unconfirmed.","missing_facts":["Whether delivery to the second-floor room without a lift is available with the total cost at most USD 500."],"source_refs":["A1","A2","A3","A8","B3","C1"]},{"case_id":"Q4","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour, width and delivered budget requirements, but arrival and assembly are unstated.","missing_facts":["Whether arrival is confirmed by Thursday 29 October 2026.","Whether it arrives ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7","B3","C1"]},{"case_id":"Q3","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour, width and delivered budget requirements, but arrival and assembly are unstated.","missing_facts":["Whether arrival is confirmed by Friday 30 October 2026.","Whether it arrives ready to use with no self-assembly."],"source_refs":["A1","A2","A3","A6","A7","B3","C1"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"Birch Mini is 96 cm wide and costs USD 480 delivered; self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B7","B8"]},{"case_id":"Q1","status":"recommend","product_id":"A","reason":"Aster Compact is white, 98 cm wide and costs USD 480 delivered, meeting all must-have conditions.","missing_facts":[],"source_refs":["A1","A2","A3"]}]} ``` ## R11 · enriched · forward · repeat 2 ```json {"answers":[{"case_id":"Q6","status":"recommend","product_id":"B","reason":"Birch Mini is black, 96 cm wide and USD 480 delivered, arriving Thursday 29 October. Its self-assembly and ground-floor delivery fit the request.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour and width requirements, but second-floor room delivery without a lift and its total cost are unconfirmed.","missing_facts":["Whether delivery to the second-floor room without a lift is available.","Whether the total including that delivery and tax is at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q4","status":"none","product_id":null,"reason":"Aster Compact arrives after the deadline; Birch Mini is black and requires assembly; Cedar Wide exceeds 100 cm.","missing_facts":[],"source_refs":["A6","B3","B7","C1"]},{"case_id":"Q3","status":"recommend","product_id":"A","reason":"Aster Compact is white, 98 cm wide and USD 480 delivered. It arrives assembled on Friday 30 October, meeting the deadline.","missing_facts":[],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"Birch Mini is 96 cm wide and USD 480 delivered; its required self-assembly is acceptable.","missing_facts":[],"source_refs":["B1","B2","B7"]},{"case_id":"Q1","status":"recommend","product_id":"A","reason":"Aster Compact is white, 98 cm wide and USD 480 delivered, meeting every must-have condition.","missing_facts":[],"source_refs":["A1","A2","A3"]}]} ``` ## R12 · structured · reverse · repeat 2 ```json {"answers":[{"case_id":"Q6","status":"recommend","product_id":"B","reason":"Birch Mini meets the colour, width, delivered budget and arrival deadline; its assembly and delivery arrangements are acceptable.","missing_facts":[],"source_refs":["B1","B2","B3","B6","B7","B8"]},{"case_id":"Q5","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour and width requirements, but second-floor room delivery without a lift and its total cost are unconfirmed.","missing_facts":["Whether delivery to the second-floor room without a lift is available.","Whether the total including that delivery is at most USD 500."],"source_refs":["A1","A2","A3","A8"]},{"case_id":"Q4","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour, width and stated delivered budget, but arrival timing and assembly status are missing.","missing_facts":["Whether it will arrive by Thursday 29 October 2026.","Whether it will arrive ready to use with no self-assembly required."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q3","status":"clarify","product_id":"A","reason":"Aster Compact meets the colour, width and stated delivered budget, but arrival timing and assembly status are missing.","missing_facts":["Whether it will arrive by Friday 30 October 2026.","Whether it will arrive ready to use with no self-assembly required."],"source_refs":["A1","A2","A3","A6","A7"]},{"case_id":"Q2","status":"recommend","product_id":"B","reason":"Birch Mini is 96 cm wide and USD 480 delivered; self-assembly and ground-floor delivery are acceptable.","missing_facts":[],"source_refs":["B1","B2","B7","B8"]},{"case_id":"Q1","status":"recommend","product_id":"A","reason":"Aster Compact is white, 98 cm wide and USD 480 delivered, meeting every must-have condition.","missing_facts":[],"source_refs":["A1","A2","A3"]}]} ```Atlas experiment · 26 October 2026 · fictional offers New facts resolved eight more answers. Accuracy stayed the same.
In each condition, all 24 answers passed the four checks. Correct clarifications count as correct. The change below is in what could be decided from the supplied information.
Resolved answers: a recommendation or no suitable offer
- Prose12 / 24
- Same facts, bullets12 / 24
- Two added facts20 / 24
Four sessions × six authored requests per condition. The prose baseline was already perfect; this test could not show an accuracy gain. These are supplied fictional offers, not search results.
White, at most 100 cm wide and USD 500, assembled and arriving by Friday.
Prose Clarify A
A meets the colour, width, and delivered-price limits, but arrival and assembly are unstated.
Recorded answer · R01 / Q3Same facts, bullets Clarify A
A meets the colour, width and delivered-price limits, but arrival and assembly are unspecified.
Recorded answer · R05 / Q3Two added facts Recommend A
A is white, 98 cm wide, USD 480 delivered and delivered assembled, with confirmed arrival on Friday 30 October 2026.
Recorded answer · R03 / Q3Friday arrival and assembly resolve this request in A’s favour.
View all cases, data & method
Protocol v1 was frozen before outputs. Two product orders, two repetitions; request order reversed on the second repeat. A separate AI reviewer checked all 72 answers against the same four criteria. The case selector quotes R01, R05 and R03 verbatim; all four repetitions agreed on decision/product. Answers within a session are correlated. No population effect is estimated. The complete record includes the frozen key and its disclosed reference-ID correction.
Each condition: four sessions × six requests Condition Correct Resolved Prose 24/24 12/24 Same facts, bullets 24/24 12/24 Two added facts 24/24 20/24 Friday deadline
White, at most 100 cm wide and USD 500, assembled and arriving by Friday.
Prose Clarify A
A meets the colour, width, and delivered-price limits, but arrival and assembly are unstated.
Recorded answer · R01 / Q3Same facts, bullets Clarify A
A meets the colour, width and delivered-price limits, but arrival and assembly are unspecified.
Recorded answer · R05 / Q3Two added facts Recommend A
A is white, 98 cm wide, USD 480 delivered and delivered assembled, with confirmed arrival on Friday 30 October 2026.
Recorded answer · R03 / Q3Friday arrival and assembly resolve this request in A’s favour.
Thursday deadline
White, at most 100 cm wide and USD 500, assembled and arriving by Thursday.
Prose Clarify A
A meets the colour, width, and delivered-price limits, but arrival and assembly are unstated.
Recorded answer · R01 / Q4Same facts, bullets Clarify A
A meets the colour, width and delivered-price limits, but arrival and assembly are unspecified.
Recorded answer · R05 / Q4Two added facts No suitable offer
A arrives after the deadline; B is black and requires self-assembly; C exceeds the width limit.
Recorded answer · R03 / Q4The new date rules A out. B has the wrong finish; C is too wide. “None” is a useful, correct answer.
Upstairs delivery
White, at most 100 cm wide, with a total of at most USD 500 including delivery to a second-floor room with no lift.
Prose Clarify A
A meets the colour and width limits, but second-floor room delivery and its inclusive total are unconfirmed.
Recorded answer · R01 / Q5Same facts, bullets Clarify A
A meets the colour and width limits, but second-floor room delivery and its total cost are unconfirmed.
Recorded answer · R05 / Q5Two added facts Clarify A
A meets the colour and width requirements, but second-floor room delivery without a lift and its total cost are unconfirmed. B and C offer ground-floor delivery only.
Recorded answer · R03 / Q5Delivery date and assembly do not settle upstairs service or its price. The remaining gap stays visible.
Ordinary fit
White, at most 100 cm wide and USD 500. No deadline; self-assembly acceptable.
Prose Recommend A
A is white, 98 cm wide, and USD 480 delivered, meeting every must-have.
Recorded answer · R01 / Q1Same facts, bullets Recommend A
A is white, 98 cm wide and USD 480 delivered, meeting every must-have.
Recorded answer · R05 / Q1Two added facts Recommend A
A is white, 98 cm wide and USD 480 delivered, meeting every must-have.
Recorded answer · R03 / Q1A fits using the original facts. Extra information is not needed for this decision.
Narrow space
At most 96 cm wide and USD 500; either finish, self-assembly acceptable.
Prose Recommend B
B is 96 cm wide and USD 480 delivered; self-assembly and ground-floor delivery are acceptable.
Recorded answer · R01 / Q2Same facts, bullets Recommend B
B is 96 cm wide and USD 480 delivered; self-assembly and ground-floor delivery are acceptable.
Recorded answer · R05 / Q2Two added facts Recommend B
B is 96 cm wide and USD 480 delivered; its self-assembly requirement is acceptable.
Recorded answer · R03 / Q2B fits. A’s 98 cm width is disqualifying regardless of how its description is written.
Competitor fits
Black, at most 100 cm wide and USD 500, arriving by Thursday. Ground-floor delivery and self-assembly acceptable.
Prose Recommend B
B is black, 96 cm wide, and USD 480 delivered, with confirmed arrival on Thursday 29 October 2026. Its assembly and delivery terms are acceptable.
Recorded answer · R01 / Q6Same facts, bullets Recommend B
B is black, 96 cm wide and USD 480 delivered, with confirmed arrival on Thursday 29 October 2026; its assembly and delivery terms are acceptable.
Recorded answer · R05 / Q6Two added facts Recommend B
B is black, 96 cm wide and USD 480 delivered, with confirmed arrival on Thursday 29 October 2026; self-assembly and ground-floor delivery are acceptable.
Recorded answer · R03 / Q6B meets the requirements. Making A easier to read cannot make it black.
Workflow in this version
Define what a correct decision looks like
Start with the customer’s constraints: budget, fit, deadline and service. Include cases where your offer fits, a competitor fits, no offer fits and facts are missing. Write the decision key before asking the model. The kit supplies six cases and three fictional offers.
If “recommend our brand” is the success criterion, a confident wrong recommendation can look like progress.
Separate format from new facts
Compare prose with labelled bullets containing exactly the same facts and references. Put new information in a third version. Atlas changed only two fields there: confirmed Friday arrival and delivery with the desk assembled. In real work, verify added facts with their owner first.
Adding a delivery guarantee while restructuring the page cannot tell you whether structure caused the difference.
Run fixed prompts in fresh sessions
Download the kit, inspect README.md and run.py, then run the command below from its extracted folder. The runner sends twelve fixed prompts in the frozen order, each to a new session; it saves the answers and refuses to overwrite a run. Do not expose the answer key to the model. Retain failures rather than retrying until the answer looks good.
Shared chat history, changed questions or keeping only successful attempts can distort the comparison.
python3 run.py
Score the decision, then choose the next test
Have a separate reviewer inspect each raw answer against the four checks below. Count correctness separately from resolution: asking for a missing fact can be fully correct. Compare each case across all repetitions. If a failure appears, save changes in a new version and test unseen cases. If the baseline already works, identify another plausible cause before expanding the rewrite.
A formatting tie, a useful rejection and an unresolved delivery condition lead to different business actions.
Result checks
- The decision and product match the prewritten key for the information actually supplied.
- The explanation respects every binding customer constraint and does not invent a requirement.
- Relevant missing facts stay explicit; there is no unsupported date, fee, service or promise.
- Source references exist and support the decisive explanation. Apply the disclosed key correction, not an exact-list match.
Test record
Last tested 26 October 2026 · Codex CLI 0.153.2 · fresh non-interactive sessions; no tool calls · Requested gpt-6-astra · high reasoning effort. Exact backend snapshot not exposed.. All twelve sessions completed without retry; all six answers in each session passed the four checks in separate AI review. Correct answers: 24/24 per condition. Resolved answers: 12/24 prose, 12/24 bullets, 20/24 with added facts. Six authored cases repeated within a fixed fixture; no discovery, real customers, sales or measured net time saving. The original prompts and runner are distributed unchanged; README and package manifest were prepared afterwards. One grading-key reference typo was corrected openly; no raw response was repaired.
Schematic · not measured data The same new fact can support a recommendation or rule an offer out.
Sources in this version
- Same facts, new facts: the Atlas offer-reading comparison ↗Protocol v1 · 12 sessions, 72 answers · evaluator erratum disclosed · Protocol, recorded responses, 72-row independent audit and evaluator erratumPublished 26 October 2026 · recorded in Atlas 26 October 2026
- Non-interactive mode ↗Documentation accessed 26 October 2026; installed CLI checked separately · stdin input, ephemeral sessions, JSON events and structured outputPublished 26 October 2026 · recorded in Atlas 26 October 2026