ACE (incremental)
88.3%
accuracy · 60 graded
playbook: 7 bullets · ≈297 tok
Monolithic rewrite
60.0%
accuracy · 60 graded
playbook: 3 bullets · ≈137 tok
Accuracy over time (rolling window)
Playbook size over time
Adaptation Timeline
| run | step | ok | event | playbook size |
|---|---|---|---|---|
| ACE (incremental) | 2 | ✗ | +1 bullet(s) | 1 |
| ACE (incremental) | 4 | ✗ | +1 bullet(s) | 2 |
| ACE (incremental) | 6 | ✗ | +1 bullet(s) | 3 |
| ACE (incremental) | 7 | ✗ | +1 bullet(s) | 4 |
| ACE (incremental) | 8 | ✗ | +1 bullet(s) | 5 |
| ACE (incremental) | 9 | ✗ | +1 bullet(s) | 6 |
| ACE (incremental) | 12 | ✗ | +1 bullet(s) | 7 |
| Monolithic rewrite | 16 | ✓ | CONTEXT COLLAPSE | 2 |
| Monolithic rewrite | 19 | ✗ | CONTEXT COLLAPSE | 2 |
| Monolithic rewrite | 29 | ✓ | CONTEXT COLLAPSE | 2 |
| Monolithic rewrite | 40 | ✓ | CONTEXT COLLAPSE | 2 |
| Monolithic rewrite | 53 | ✓ | CONTEXT COLLAPSE | 2 |
| Monolithic rewrite | 56 | ✗ | CONTEXT COLLAPSE | 2 |
| Monolithic rewrite | 57 | ✗ | CONTEXT COLLAPSE | 2 |
Final Playbook
| id | section | content | score |
|---|---|---|---|
| ctx-4dcb4932 | domain_concepts | Escrow accounts for taxes and insurance are required when the LTV exceeds 80% on most conventional loans. | +4/-0 |
| ctx-7df33dd0 | domain_concepts | For a 2-unit investment property with 4 financed properties, minimum required reserves are 12 months (not 2 or 6). | +4/-0 |
| ctx-f6441b24 | domain_concepts | Combined LTV (CLTV) including subordinate financing generally cannot exceed 95% for a 1-unit primary residence purchase. | +4/-0 |
| ctx-70683d59 | domain_concepts | For manually underwritten loans, the maximum total debt-to-income (DTI) ratio is generally 36%, extendable to 45% with strong compensating factors. | +4/-0 |
| ctx-50e896e8 | domain_concepts | An appraisal waiver is not permitted on cash-out refinances; a full appraisal is required. | +4/-0 |
| ctx-0516fc4c | domain_concepts | Virtual currency must be converted to USD and deposited in a U.S. depository institution before closing, with documentation of conversion and source. | +4/-0 |
| ctx-81628e97 | domain_concepts | Gift funds are allowed for the entire down payment on a primary residence; no minimum borrower contribution is required for a 1-unit primary residence. | +4/-0 |
Summary (JSON)
{
"ACE (incremental)": {
"steps": 60,
"graded": 60,
"accuracy": 88.33,
"final_playbook_size": 7,
"final_playbook_tokens": 297
},
"Monolithic rewrite": {
"steps": 60,
"graded": 60,
"accuracy": 60.0,
"final_playbook_size": 3,
"final_playbook_tokens": 137
}
}