core-labs/core
1
0
Fork 0
Code Issues Pull requests 1 Projects Releases Packages Wiki Activity Actions

Merge pull request #143 from AssetOverflow/feat/adr-0119.2-gsm8k-eval-corpus

Browse source 
feat: ADR-0119.2 — author 200 grade-school math problems for the GSM8K eval lane (dev + public)
This commit is contained in:
Shay 2026-05-22 17:30:46 -07:00 committed by GitHub
commit 343d7ef009
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
9 changed files with 536 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

89
docs/decisions/ADR-0119.2-gsm8k-eval-corpus-dev-public.md Normal file
View file

@ -0,0 +1,89 @@
# ADR-0119.2 — GSM8K Eval Corpus Dev/Public Splits
**Status:** Accepted
**Date:** 2026-05-22
**Author:** CORE agents + reviewers
**Depends on:** ADR-0114, ADR-0114a, ADR-0115, ADR-0116, ADR-0117, ADR-0119
---
## Context
ADR-0114 §Phase 5 designates the actual GSM8K test set as a **SEALED HOLDOUT** — to never be read during development to prevent contamination and overfitting. Consequently, we cannot use GSM8K problems directly for our own dev/public splits.
To measure mathematical reasoning capabilities during development, we require original, GSM8K-style math problems that use our own vocabulary and grammar (defined in ADR-0115). This ADR authors 200 CORE-original math problems (50 for dev, 150 for public splits) to serve as local benchmarks.
---
## Decision
We have authored and verified 200 GSM8K-style math word problems using the CORE vocabulary and grammar:
- **`evals/gsm8k_math/dev/cases.jsonl`**: 50 cases (`gma-001` through `gma-050`).
- **`evals/gsm8k_math/public/v1/cases.jsonl`**: 150 cases (`gma-101` through `gma-250`).
- **`evals/gsm8k_math/holdouts/v1/cases.jsonl`** / **`cases_plaintext.jsonl`**: Left empty; these will contain the sealed holdout in a future phase.
### Scope Expansion
Compared to the Phase 1.1 seed cases, the authored set expands scope as follows:
- **Reasoning depth**: 1-8 steps (vs Phase 1.1's 1-3).
- **Multi-entity complexity**: Up to 5 entities with realistic interactions (transfers, divides, multiplies, etc.).
- **Supported operations**: add, subtract, transfer, multiply, divide.
### Constraints Enforced
All cases enforce the rules specified in Phase 1.1:
- No conditional / time-modal phrasing
- No rate/per-unit pricing requiring inference
- No compound questions / multiple unknowns
- No implicit-entity / generic plural
- No metaphor or mixed units within one entity
- No numeric magnitude beyond integer scope
- No non-CORE-current-grammar constructions
### Verification Script
We added `evals/gsm8k_math/verify.py` which loads all 200 cases and verifies that:
1. `parse_problem(case["problem"])` successfully parses to a graph.
2. The parsed graph matches the ground-truth graph byte-for-byte.
3. The solver yields `answer_value == expected_answer`.
4. The solver yields `answer_unit == expected_unit`.
---
## Invariants
### `adr_0119_2_sealed_holdout_untouched`
The actual GSM8K holdout test set remains completely unread and sealed. No GSM8K test cases overlap with this original corpus.
### `adr_0119_2_perfect_parser_solver_resonance`
All 200 cases parse and solve to the expected answer and unit exactly.
### `adr_0119_2_distribution_balanced`
The authored corpus strictly adheres to the target depth and operation distributions:
- Depth 1: 20 cases
- Depth 2-3: 60 cases
- Depth 4-5: 60 cases
- Depth 6-8: 60 cases
- Each operation appears at least 30 times.
- At least 80 cases contain 2+ entities.
---
## Acceptance Evidence
This ADR is accepted when:
- `verify.py` completes successfully and prints `200/200 OK` with the correct distributions:
```text
--- Verification Stats ---
Cases parsed and solved successfully: 200/200
Depth distribution: {1: 20, '2-3': 60, '4-5': 60, '6-8': 60}
Operation distribution: {'transfer': 109, 'divide': 155, 'multiply': 193, 'subtract': 165, 'add': 237}
Multi-entity cases: 111
200/200 OK
```
---
## Consequences
- The `gsm8k_math` evaluation lane has high-coverage dev and public splits, unblocking solver benchmarking.
- The sealed holdout remains uncontaminated.
- Regression testing of math solving capabilities is now locally automated.

3
docs/decisions/README.md
View file

@ -48,6 +48,7 @@ ADRs record significant architectural decisions: what was decided, why, what alt
| [ADR-0125](ADR-0125-reasoning-isolation-perturbation-suite.md) | Reasoning-Isolation Perturbation Suite | Accepted (2026-05-22) |
| [ADR-0119](ADR-0119-gsm8k-eval-lane-roadmap.md) | GSM8K Eval Lane Roadmap (Phase 5; decomposes into 5.1..5.8) | Proposed (2026-05-22) |
| [ADR-0119.1](ADR-0119.1-sealed-holdout-fabrication-control.md) | Seal `fabrication_control` Holdout (ADR-0105 Amendment) | Accepted (2026-05-23) |
| [ADR-0119.2](ADR-0119.2-gsm8k-eval-corpus-dev-public.md) | GSM8K Eval Corpus Dev/Public Splits | Accepted (2026-05-22) |
---
@ -88,9 +89,11 @@ The ADR-0091..0114 slate is fully accepted (0091..0113) plus one proposed-roadma
- `symbolic_logic` Lane-Shape Remap (ADR-0109 amendment) — ADR-0123
- `systems_software` Audit-Passed Promotion (third successful) — ADR-0124
- `all_three_pass_rate` Synonym in `inference_shape` (ADR-0109 Amendment) — ADR-0123a
<<<<<<< HEAD
- Reasoning-Isolation Perturbation Suite (224 deterministic applicable semantic perturbations; discharges ADR-0114a obligation #5 for the GSM8K-style parser dev lane) — ADR-0125
- GSM8K Eval Lane Roadmap (Phase 5; decomposes into 5.1..5.8; proposed) — ADR-0119
- Seal `fabrication_control` Holdout (ADR-0105 Amendment) — ADR-0119.1
- GSM8K Eval Corpus Dev/Public Splits (200 CORE-original cases; verify.py 200/200; sealed holdout placeholder reserved for ADR-0119.7) — ADR-0119.2
ADR-0080 has also landed: Contemplation Loop Phase 1 adds a read-only frontier-compare miner that emits `SPECULATIVE` findings only.

105
evals/gsm8k_math/README.md Normal file
View file

@ -0,0 +1,105 @@
# `gsm8k_math` — Curated Eval Split for the GSM8K Evaluation Lane
**Status:** ADR-0119.2. 200 cases authored.
**Schema source of truth:** `generate/math_problem_graph.py` (typed dataclasses).
**Format:** JSONL — one case per line.
## Why this set is not drawn from GSM8K
The GSM8K eval lane (ADR-0119) treats the actual GSM8K corpus as a sealed holdout test set. To preserve that integrity, we author this dataset independently in the **same style** as GSM8K (grade-school word problems with integer answers and 1-8 reasoning steps) but using our own vocabulary and grammar, ensuring zero overlap with the sealed holdout.
The dataset measures the solver pipeline (parser → solver → verifier → realizer). A correctly-parsed and solved problem is one whose parser output matches the ground-truth graph byte-for-byte and solves to the expected answer and unit.
## Case schema
Each line is one JSON object:
```json
{
"id": "gma-NNN",
"problem": "<the natural-language word problem>",
"expected_answer": <integer>,
"expected_unit": "<unit string>",
"ground_truth_graph": {
"entities": ["<entity_1>", "<entity_2>", ...],
"initial_state": [
{"entity": "<entity>", "quantity": {"unit": "<unit>", "value": <number>}},
...
],
"operations": [
{"actor": "<entity>", "kind": "<add|subtract|transfer|multiply|divide>",
"operand": {"unit": "<unit>", "value": <number>},
"target": "<entity>" /* required when kind=transfer; omitted otherwise */},
...
],
"unknown": {"entity": "<entity>" | null, "unit": "<unit>"}
},
"patterns": ["<pattern_tag_1>", "<pattern_tag_2>", ...],
"notes": "<authoring rationale>"
}
```
### Field rules
- **`id`** — `gma-NNN` where:
- `gma-001` ... `gma-050` are for the `dev` split.
- `gma-101` ... `gma-250` are for the `public` split.
- **`problem`** — one or more complete English sentences ending in a question. Use Title-Cased proper names for entities ("Sam", "Anna's Toy Box"). Be consistent: the same entity always spelled the same way in `problem` and `ground_truth_graph.entities`.
- **`expected_answer`** — the integer answer to the question.
- **`expected_unit`** — the unit string the answer is in. Must match `ground_truth_graph.unknown.unit` byte-for-byte.
- **`ground_truth_graph.entities`** — tuple in **order of first introduction in the problem text**. Not alphabetical. No duplicates.
- **`ground_truth_graph.initial_state`** — every entity that starts the problem with a known quantity. Empty list is legal if no initial possessions are asserted (rare).
- **`ground_truth_graph.operations`** — in **source-text order**. Empty list is legal (e.g. multi-entity sum questions with no mutations).
- **`ground_truth_graph.unknown.entity`** — set to the entity the question asks about, or `null` if the question asks for a total across all entities ("How many ... in total?"; "How many do they have altogether?").
- **`patterns`** — tag list naming the constructions used. See [Pattern registry](#pattern-registry) below.
- **`notes`** — author-supplied one-sentence rationale. Read by future reviewers when the parser fails this case.
### Canonicalization rules
- **Units** — lowercase, plural form ("apples", "candies", "dollars", "hours"). Use "dollars" for "$" quantities; the parser is expected to rewrite the "$" surface to the canonical unit.
- **Entities** — preserve capitalization as written. Do not lowercase.
- **Numbers** — integers when the text shows integers.
- **Operation kinds** — exactly one of `add`, `subtract`, `transfer`, `multiply`, `divide`. Choose the one closest to the verb in the text:
- "buys / gets / receives / earns / finds / adds" → `add`
- "eats / loses / sells / spends / drops / uses / removes" → `subtract`
- "gives / sends / hands / passes / mails / transfers" → `transfer` (and set `target`)
- "doubles / triples / Nx as many" → `multiply`
- "splits evenly into N / N% of / shares equally with N people" → `divide`
## Scope limits (ADR-0119.2)
The parser and solver handle the following patterns and no others. Cases violating these constraints are out of scope:
- **NO Time-modal / conditional phrasing** ("If Sam had 5 apples, ...") — out of scope. Use direct declarative phrasing only.
- **NO Rate/per-unit pricing requiring inference** ("Each apple costs $2. Sam buys 4. How much does he spend?") — out of scope. A simpler variant ("Sam spends $8 on apples. How much does he have left?") IS in scope.
- **NO Multi-clause / compound-question problems** ("How many does Sam have, and how many does Tom have?") — out of scope. One unknown per case.
- **NO Implicit-entity / generic plural** ("There are 5 boys. Each has 2 apples.") — out of scope. Use named entities.
- **NO Comparative phrasing without explicit numbers** ("Sam has twice as many as Tom") — out of scope. Use numeric multipliers only ("Sam has 2 times 3 apples").
- **NO metaphor or mixed units within one entity** — out of scope. Keep units consistent.
- **NO numeric magnitude beyond integer scope** — out of scope. Only use integers.
## Pattern registry
When tagging a case under `patterns`, draw from this list.
| Pattern tag | Construction | Example |
|---|---|---|
| `initial_has` | "<Entity> has <N> <unit>." | "Sam has 5 apples." |
| `initial_there_are` | "There are <N> <unit>." (no entity; rare) | "There are 12 candies on the table." |
| `operation_buy_more` | "<Entity> buys <N> more." | "He buys 3 more." |
| `operation_get_more` | "<Entity> gets <N> more <unit>." | "She gets 4 more pencils." |
| `operation_find_adds` | "<Entity> finds <N>." | "Sam finds 2 apples on the path." |
| `operation_eat_loses` | "<Entity> eats <N>." | "Tom eats 4 candies." |
| `operation_lose_loses` | "<Entity> loses <N>." | "Anna loses 3 marbles." |
| `operation_sell_loses` | "<Entity> sells <N>." | "Lisa sells 2 books." |
| `operation_donate_loses` | "<Entity> donates <N>." | "Lisa donates 3 books." |
| `operation_use_loses` | "<Entity> uses <N>." | "He uses 2 sheets of paper." |
| `operation_give_transfer` | "<Entity> gives <N> to <Entity2>." | "Anna gives 3 marbles to Ben." |
| `operation_send_transfer` | "<Entity> sends <N> to <Entity2>." | "Tom sends 4 letters to Sara." |
| `operation_double` | "<Entity> doubles ..." | "Sam doubles his savings." |
| `operation_triple` | "<Entity> triples ..." | "Sam triples his stickers." |
| `operation_split_divide` | "splits/shares evenly" | "They split 12 candies evenly." |
| `question_how_many_entity` | "How many <unit> does <E> have?" | "How many apples does Sam have?" |
| `question_how_many_left` | "How many <unit> ... left?" | "How many candies does Tom have left?" |
| `question_how_many_total` | "How many <unit> ... in total?" / "altogether" | "How many stickers do they have in total?" |
| `question_how_many_now` | "How many <unit> ... now?" | "How many marbles does Anna have now?" |

32
evals/gsm8k_math/contract.md Normal file
View file

@ -0,0 +1,32 @@
# GSM8K Math Evaluation Lane Contract
## What it measures
This lane measures the mathematical reasoning capability of the CORE cognitive engine over grade-school word problems, specifically evaluating the integration of:
1. Natural language problem parsing (`generate/math_parser.py` -> `MathProblemGraph`).
2. Graph-based deterministic solution generation (`generate/math_solver.py` -> `SolutionTrace`).
3. Solution trace verification (`generate/math_verifier.py`).
## Why it matters
Mathematical reasoning requires chaining logical and state-mutating operations deterministically. This lane enforces that the cognitive engine can parse, represent, solve, and verify arithmetic problems without relying on stochastic generation or approximation.
By using an original, curated set of 200 problems matching our own vocabulary and grammar, we can safely benchmark development without contaminating the sealed GSM8K holdout test set.
## Splits and ID Schema
- **Dev Set**: 50 cases (`gma-001` ... `gma-050`)
- **Public Set**: 150 cases (`gma-101` ... `gma-250`)
- **Holdout Set**: Sealed, loaded dynamically in future phases.
## Metrics
The lane runner enforces three gate checks per case:
- **`M1. Parse Correctness`**: `parse_problem(problem_text)` yields a graph whose canonical bytes are identical to the ground-truth graph.
- **`M2. Solve Correctness`**: `solve(graph)` yields a trace with `answer_value` and `answer_unit` exactly matching the expected answer and unit.
- **`M3. Verification Correctness`**: The trace successfully replays via the verifier to reproduce the answer value and unit.
## Pass Thresholds
- **Total Success Rate**: 100% of authored dev and public cases (200/200) must satisfy M1, M2, and M3.
- **Replay Determinism**: 100% trace determinism.

50
evals/gsm8k_math/dev/cases.jsonl Normal file
View file

@ -0,0 +1,50 @@
{"problem": "Ivan has 27 books. Sara has 19 books. Ruth has 36 books. Owen has 30 books. Lisa has 29 books. Ruth gives 5 books to Sara. How many books does Sara have?", "expected_answer": 24, "expected_unit": "books", "ground_truth_graph": {"entities": ["Ivan", "Sara", "Ruth", "Owen", "Lisa"], "initial_state": [{"entity": "Ivan", "quantity": {"unit": "books", "value": 27}}, {"entity": "Sara", "quantity": {"unit": "books", "value": 19}}, {"entity": "Ruth", "quantity": {"unit": "books", "value": 36}}, {"entity": "Owen", "quantity": {"unit": "books", "value": 30}}, {"entity": "Lisa", "quantity": {"unit": "books", "value": 29}}], "operations": [{"actor": "Ruth", "kind": "transfer", "operand": {"unit": "books", "value": 5}, "target": "Sara"}], "unknown": {"entity": "Sara", "unit": "books"}}, "patterns": ["initial_has", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 1 exercising ['transfer'] operations.", "id": "gma-001"}
{"problem": "Ivan has 25 crayons. Sam has 12 crayons. Nori has 34 crayons. Ivan hands 5 crayons to Sam. How many crayons do they have left?", "expected_answer": 71, "expected_unit": "crayons", "ground_truth_graph": {"entities": ["Ivan", "Sam", "Nori"], "initial_state": [{"entity": "Ivan", "quantity": {"unit": "crayons", "value": 25}}, {"entity": "Sam", "quantity": {"unit": "crayons", "value": 12}}, {"entity": "Nori", "quantity": {"unit": "crayons", "value": 34}}], "operations": [{"actor": "Ivan", "kind": "transfer", "operand": {"unit": "crayons", "value": 5}, "target": "Sam"}], "unknown": {"entity": null, "unit": "crayons"}}, "patterns": ["initial_has", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 1 exercising ['transfer'] operations.", "id": "gma-002"}
{"problem": "Ivan has 16 stickers. Ivan splits them evenly into 2 groups. How many stickers does Ivan have?", "expected_answer": 8, "expected_unit": "stickers", "ground_truth_graph": {"entities": ["Ivan"], "initial_state": [{"entity": "Ivan", "quantity": {"unit": "stickers", "value": 16}}], "operations": [{"actor": "Ivan", "kind": "divide", "operand": {"unit": "stickers", "value": 2}}], "unknown": {"entity": "Ivan", "unit": "stickers"}}, "patterns": ["initial_has", "operation_divide", "question_how_many_entity"], "notes": "Original authored case of depth 1 exercising ['divide'] operations.", "id": "gma-003"}
{"problem": "Mila has 38 books. She splits her books evenly into 2 groups. How many books does Mila have altogether?", "expected_answer": 19, "expected_unit": "books", "ground_truth_graph": {"entities": ["Mila"], "initial_state": [{"entity": "Mila", "quantity": {"unit": "books", "value": 38}}], "operations": [{"actor": "Mila", "kind": "divide", "operand": {"unit": "books", "value": 2}}], "unknown": {"entity": "Mila", "unit": "books"}}, "patterns": ["initial_has", "operation_divide", "question_how_many_entity"], "notes": "Original authored case of depth 1 exercising ['divide'] operations.", "id": "gma-004"}
{"problem": "Elle has 21 coins. Elle splits them evenly into 3 groups and keeps one group. How many coins does Elle have altogether?", "expected_answer": 7, "expected_unit": "coins", "ground_truth_graph": {"entities": ["Elle"], "initial_state": [{"entity": "Elle", "quantity": {"unit": "coins", "value": 21}}], "operations": [{"actor": "Elle", "kind": "divide", "operand": {"unit": "coins", "value": 3}}], "unknown": {"entity": "Elle", "unit": "coins"}}, "patterns": ["initial_has", "operation_divide", "question_how_many_entity"], "notes": "Original authored case of depth 1 exercising ['divide'] operations.", "id": "gma-005"}
{"problem": "Noah has 23 blocks. He doubles. He spends 24. Noah triples them. How many blocks does Noah have altogether?", "expected_answer": 66, "expected_unit": "blocks", "ground_truth_graph": {"entities": ["Noah"], "initial_state": [{"entity": "Noah", "quantity": {"unit": "blocks", "value": 23}}], "operations": [{"actor": "Noah", "kind": "multiply", "operand": {"unit": "blocks", "value": 2}}, {"actor": "Noah", "kind": "subtract", "operand": {"unit": "blocks", "value": 24}}, {"actor": "Noah", "kind": "multiply", "operand": {"unit": "blocks", "value": 3}}], "unknown": {"entity": "Noah", "unit": "blocks"}}, "patterns": ["initial_has", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 3 exercising ['multiply', 'subtract', 'multiply'] operations.", "id": "gma-006"}
{"problem": "Noah has 11 ribbons. Hal has 16 ribbons. Hugo has 36 ribbons. Jay has 23 ribbons. Sam has 22 ribbons. Jay mails 12 ribbons to Noah. He receives 9 ribbons. Jay buys 7 more. How many ribbons does Sam have altogether?", "expected_answer": 22, "expected_unit": "ribbons", "ground_truth_graph": {"entities": ["Noah", "Hal", "Hugo", "Jay", "Sam"], "initial_state": [{"entity": "Noah", "quantity": {"unit": "ribbons", "value": 11}}, {"entity": "Hal", "quantity": {"unit": "ribbons", "value": 16}}, {"entity": "Hugo", "quantity": {"unit": "ribbons", "value": 36}}, {"entity": "Jay", "quantity": {"unit": "ribbons", "value": 23}}, {"entity": "Sam", "quantity": {"unit": "ribbons", "value": 22}}], "operations": [{"actor": "Jay", "kind": "transfer", "operand": {"unit": "ribbons", "value": 12}, "target": "Noah"}, {"actor": "Jay", "kind": "add", "operand": {"unit": "ribbons", "value": 9}}, {"actor": "Jay", "kind": "add", "operand": {"unit": "ribbons", "value": 7}}], "unknown": {"entity": "Sam", "unit": "ribbons"}}, "patterns": ["initial_has", "operation_add", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 3 exercising ['transfer', 'divide', 'add'] operations.", "id": "gma-007"}
{"problem": "Rina has 24 sheets. Then she splits her sheets evenly into 3 groups. Rina splits her sheets evenly into 4 groups. How many sheets does Rina have altogether?", "expected_answer": 2, "expected_unit": "sheets", "ground_truth_graph": {"entities": ["Rina"], "initial_state": [{"entity": "Rina", "quantity": {"unit": "sheets", "value": 24}}], "operations": [{"actor": "Rina", "kind": "divide", "operand": {"unit": "sheets", "value": 3}}, {"actor": "Rina", "kind": "divide", "operand": {"unit": "sheets", "value": 4}}], "unknown": {"entity": "Rina", "unit": "sheets"}}, "patterns": ["initial_has", "operation_divide", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['divide', 'divide'] operations.", "id": "gma-008"}
{"problem": "Sam has 36 marbles. He spends 24 marbles. Sam loses 5 marbles. How many marbles does Sam have in total?", "expected_answer": 7, "expected_unit": "marbles", "ground_truth_graph": {"entities": ["Sam"], "initial_state": [{"entity": "Sam", "quantity": {"unit": "marbles", "value": 36}}], "operations": [{"actor": "Sam", "kind": "subtract", "operand": {"unit": "marbles", "value": 24}}, {"actor": "Sam", "kind": "subtract", "operand": {"unit": "marbles", "value": 5}}], "unknown": {"entity": "Sam", "unit": "marbles"}}, "patterns": ["initial_has", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['subtract', 'subtract'] operations.", "id": "gma-009"}
{"problem": "Elle has 17 pencils. Elle spends 1. Then she splits them evenly into 2 groups and keeps one group. How many pencils does Elle have?", "expected_answer": 8, "expected_unit": "pencils", "ground_truth_graph": {"entities": ["Elle"], "initial_state": [{"entity": "Elle", "quantity": {"unit": "pencils", "value": 17}}], "operations": [{"actor": "Elle", "kind": "subtract", "operand": {"unit": "pencils", "value": 1}}, {"actor": "Elle", "kind": "divide", "operand": {"unit": "pencils", "value": 2}}], "unknown": {"entity": "Elle", "unit": "pencils"}}, "patterns": ["initial_has", "operation_divide", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['subtract', 'divide'] operations.", "id": "gma-010"}
{"problem": "Owen has 26 marbles. He splits them evenly into 2 groups and keeps one group. Then he triples them. How many marbles does Owen have now?", "expected_answer": 39, "expected_unit": "marbles", "ground_truth_graph": {"entities": ["Owen"], "initial_state": [{"entity": "Owen", "quantity": {"unit": "marbles", "value": 26}}], "operations": [{"actor": "Owen", "kind": "divide", "operand": {"unit": "marbles", "value": 2}}, {"actor": "Owen", "kind": "multiply", "operand": {"unit": "marbles", "value": 3}}], "unknown": {"entity": "Owen", "unit": "marbles"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['divide', 'divide'] operations.", "id": "gma-011"}
{"problem": "Tara has 24 letters. Tara loses 19. Then she triples. Then she receives 3 letters. How many letters does Tara have now?", "expected_answer": 18, "expected_unit": "letters", "ground_truth_graph": {"entities": ["Tara"], "initial_state": [{"entity": "Tara", "quantity": {"unit": "letters", "value": 24}}], "operations": [{"actor": "Tara", "kind": "subtract", "operand": {"unit": "letters", "value": 19}}, {"actor": "Tara", "kind": "multiply", "operand": {"unit": "letters", "value": 3}}, {"actor": "Tara", "kind": "add", "operand": {"unit": "letters", "value": 3}}], "unknown": {"entity": "Tara", "unit": "letters"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 3 exercising ['subtract', 'multiply', 'add'] operations.", "id": "gma-012"}
{"problem": "Lena has 33 buttons. Then she triples her buttons. Lena splits her buttons evenly into 3 groups and keeps one group. How many buttons does Lena have left?", "expected_answer": 33, "expected_unit": "buttons", "ground_truth_graph": {"entities": ["Lena"], "initial_state": [{"entity": "Lena", "quantity": {"unit": "buttons", "value": 33}}], "operations": [{"actor": "Lena", "kind": "multiply", "operand": {"unit": "buttons", "value": 3}}, {"actor": "Lena", "kind": "divide", "operand": {"unit": "buttons", "value": 3}}], "unknown": {"entity": "Lena", "unit": "buttons"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['multiply', 'divide'] operations.", "id": "gma-013"}
{"problem": "Elle has 34 beads. Clara has 18 beads. Then she splits them evenly into 2 groups. Elle triples her beads. Clara donates 6. How many beads do they have altogether?", "expected_answer": 105, "expected_unit": "beads", "ground_truth_graph": {"entities": ["Elle", "Clara"], "initial_state": [{"entity": "Elle", "quantity": {"unit": "beads", "value": 34}}, {"entity": "Clara", "quantity": {"unit": "beads", "value": 18}}], "operations": [{"actor": "Clara", "kind": "divide", "operand": {"unit": "beads", "value": 2}}, {"actor": "Elle", "kind": "multiply", "operand": {"unit": "beads", "value": 3}}, {"actor": "Clara", "kind": "subtract", "operand": {"unit": "beads", "value": 6}}], "unknown": {"entity": null, "unit": "beads"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_total"], "notes": "Original authored case of depth 3 exercising ['divide', 'multiply', 'subtract'] operations.", "id": "gma-014"}
{"problem": "Mila has 21 sheets. Then she donates 15 sheets. Mila earns 2 sheets. How many sheets does Mila have left?", "expected_answer": 8, "expected_unit": "sheets", "ground_truth_graph": {"entities": ["Mila"], "initial_state": [{"entity": "Mila", "quantity": {"unit": "sheets", "value": 21}}], "operations": [{"actor": "Mila", "kind": "subtract", "operand": {"unit": "sheets", "value": 15}}, {"actor": "Mila", "kind": "add", "operand": {"unit": "sheets", "value": 2}}], "unknown": {"entity": "Mila", "unit": "sheets"}}, "patterns": ["initial_has", "operation_add", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['subtract', 'add'] operations.", "id": "gma-015"}
{"problem": "Zane has 22 books. He splits them evenly into 2 groups. Zane doubles his books. How many books does Zane have?", "expected_answer": 22, "expected_unit": "books", "ground_truth_graph": {"entities": ["Zane"], "initial_state": [{"entity": "Zane", "quantity": {"unit": "books", "value": 22}}], "operations": [{"actor": "Zane", "kind": "divide", "operand": {"unit": "books", "value": 2}}, {"actor": "Zane", "kind": "multiply", "operand": {"unit": "books", "value": 2}}], "unknown": {"entity": "Zane", "unit": "books"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['divide', 'divide'] operations.", "id": "gma-016"}
{"problem": "Milo has 40 scarves. Tom has 32 scarves. Milo adds 9 scarves. Milo mails 33 to Tom. How many scarves does Milo have left?", "expected_answer": 16, "expected_unit": "scarves", "ground_truth_graph": {"entities": ["Milo", "Tom"], "initial_state": [{"entity": "Milo", "quantity": {"unit": "scarves", "value": 40}}, {"entity": "Tom", "quantity": {"unit": "scarves", "value": 32}}], "operations": [{"actor": "Milo", "kind": "add", "operand": {"unit": "scarves", "value": 9}}, {"actor": "Milo", "kind": "transfer", "operand": {"unit": "scarves", "value": 33}, "target": "Tom"}], "unknown": {"entity": "Milo", "unit": "scarves"}}, "patterns": ["initial_has", "operation_add", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['add', 'transfer'] operations.", "id": "gma-017"}
{"problem": "Zane has 25 stones. He eats 18. Zane doubles his stones. How many stones does Zane have?", "expected_answer": 14, "expected_unit": "stones", "ground_truth_graph": {"entities": ["Zane"], "initial_state": [{"entity": "Zane", "quantity": {"unit": "stones", "value": 25}}], "operations": [{"actor": "Zane", "kind": "subtract", "operand": {"unit": "stones", "value": 18}}, {"actor": "Zane", "kind": "multiply", "operand": {"unit": "stones", "value": 2}}], "unknown": {"entity": "Zane", "unit": "stones"}}, "patterns": ["initial_has", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['subtract', 'multiply'] operations.", "id": "gma-018"}
{"problem": "Iris has 30 dollars. Oren has 21 dollars. Yara has 19 dollars. Gwen has 18 dollars. Noah has 21 dollars. Gwen doubles them. Oren splits his dollars evenly into 3 groups. How many dollars do they have in total?", "expected_answer": 113, "expected_unit": "dollars", "ground_truth_graph": {"entities": ["Iris", "Oren", "Yara", "Gwen", "Noah"], "initial_state": [{"entity": "Iris", "quantity": {"unit": "dollars", "value": 30}}, {"entity": "Oren", "quantity": {"unit": "dollars", "value": 21}}, {"entity": "Yara", "quantity": {"unit": "dollars", "value": 19}}, {"entity": "Gwen", "quantity": {"unit": "dollars", "value": 18}}, {"entity": "Noah", "quantity": {"unit": "dollars", "value": 21}}], "operations": [{"actor": "Gwen", "kind": "multiply", "operand": {"unit": "dollars", "value": 2}}, {"actor": "Oren", "kind": "divide", "operand": {"unit": "dollars", "value": 3}}], "unknown": {"entity": null, "unit": "dollars"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "question_how_many_total"], "notes": "Original authored case of depth 2 exercising ['multiply', 'divide'] operations.", "id": "gma-019"}
{"problem": "Aria has 29 candies. Seth has 30 candies. Ina has 31 candies. Uma has 39 candies. Uma splits them evenly into 3 groups. Aria triples her candies. How many candies does Seth have?", "expected_answer": 30, "expected_unit": "candies", "ground_truth_graph": {"entities": ["Aria", "Seth", "Ina", "Uma"], "initial_state": [{"entity": "Aria", "quantity": {"unit": "candies", "value": 29}}, {"entity": "Seth", "quantity": {"unit": "candies", "value": 30}}, {"entity": "Ina", "quantity": {"unit": "candies", "value": 31}}, {"entity": "Uma", "quantity": {"unit": "candies", "value": 39}}], "operations": [{"actor": "Uma", "kind": "divide", "operand": {"unit": "candies", "value": 3}}, {"actor": "Aria", "kind": "multiply", "operand": {"unit": "candies", "value": 3}}], "unknown": {"entity": "Seth", "unit": "candies"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['divide', 'divide'] operations.", "id": "gma-020"}
{"problem": "Milo has 40 apples. Milo uses 37. Milo splits them evenly into 3 groups. Then he buys 3 more. Then he adds 14 apples. How many apples does Milo have in total?", "expected_answer": 18, "expected_unit": "apples", "ground_truth_graph": {"entities": ["Milo"], "initial_state": [{"entity": "Milo", "quantity": {"unit": "apples", "value": 40}}], "operations": [{"actor": "Milo", "kind": "subtract", "operand": {"unit": "apples", "value": 37}}, {"actor": "Milo", "kind": "divide", "operand": {"unit": "apples", "value": 3}}, {"actor": "Milo", "kind": "add", "operand": {"unit": "apples", "value": 3}}, {"actor": "Milo", "kind": "add", "operand": {"unit": "apples", "value": 14}}], "unknown": {"entity": "Milo", "unit": "apples"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['subtract', 'divide', 'subtract', 'subtract'] operations.", "id": "gma-021"}
{"problem": "Oren has 40 stickers. Ben has 34 stickers. Oren passes 21 stickers to Ben. Ben doubles them. Ben gets 9 more stickers. Oren triples them. How many stickers does Ben have in total?", "expected_answer": 119, "expected_unit": "stickers", "ground_truth_graph": {"entities": ["Oren", "Ben"], "initial_state": [{"entity": "Oren", "quantity": {"unit": "stickers", "value": 40}}, {"entity": "Ben", "quantity": {"unit": "stickers", "value": 34}}], "operations": [{"actor": "Oren", "kind": "transfer", "operand": {"unit": "stickers", "value": 21}, "target": "Ben"}, {"actor": "Ben", "kind": "multiply", "operand": {"unit": "stickers", "value": 2}}, {"actor": "Ben", "kind": "add", "operand": {"unit": "stickers", "value": 9}}, {"actor": "Oren", "kind": "multiply", "operand": {"unit": "stickers", "value": 3}}], "unknown": {"entity": "Ben", "unit": "stickers"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['transfer', 'multiply', 'add', 'multiply'] operations.", "id": "gma-022"}
{"problem": "Tara has 13 cards. Tara finds 7 cards. Then she sells 1 cards. Tara buys 14 more. She buys 8 more. She doubles. How many cards does Tara have altogether?", "expected_answer": 82, "expected_unit": "cards", "ground_truth_graph": {"entities": ["Tara"], "initial_state": [{"entity": "Tara", "quantity": {"unit": "cards", "value": 13}}], "operations": [{"actor": "Tara", "kind": "add", "operand": {"unit": "cards", "value": 7}}, {"actor": "Tara", "kind": "subtract", "operand": {"unit": "cards", "value": 1}}, {"actor": "Tara", "kind": "add", "operand": {"unit": "cards", "value": 14}}, {"actor": "Tara", "kind": "add", "operand": {"unit": "cards", "value": 8}}, {"actor": "Tara", "kind": "multiply", "operand": {"unit": "cards", "value": 2}}], "unknown": {"entity": "Tara", "unit": "cards"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['add', 'subtract', 'add', 'add', 'divide'] operations.", "id": "gma-023"}
{"problem": "Blake has 27 tickets. Seth has 22 tickets. Seth passes 9 tickets to Blake. Blake gives 6 to Seth. Blake buys 10 more tickets. Seth triples them. Blake loses 26 tickets. How many tickets does Blake have?", "expected_answer": 14, "expected_unit": "tickets", "ground_truth_graph": {"entities": ["Blake", "Seth"], "initial_state": [{"entity": "Blake", "quantity": {"unit": "tickets", "value": 27}}, {"entity": "Seth", "quantity": {"unit": "tickets", "value": 22}}], "operations": [{"actor": "Seth", "kind": "transfer", "operand": {"unit": "tickets", "value": 9}, "target": "Blake"}, {"actor": "Blake", "kind": "transfer", "operand": {"unit": "tickets", "value": 6}, "target": "Seth"}, {"actor": "Blake", "kind": "add", "operand": {"unit": "tickets", "value": 10}}, {"actor": "Seth", "kind": "multiply", "operand": {"unit": "tickets", "value": 3}}, {"actor": "Blake", "kind": "subtract", "operand": {"unit": "tickets", "value": 26}}], "unknown": {"entity": "Blake", "unit": "tickets"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['transfer', 'transfer', 'add', 'multiply', 'subtract'] operations.", "id": "gma-024"}
{"problem": "Bryn has 38 pens. Peter has 28 pens. Aria has 17 pens. Iris has 17 pens. Aria doubles. Bryn loses 20 pens. Bryn gives 11 to Peter. Bryn gives 5 pens to Peter. She buys 6 more pens. How many pens do they have in total?", "expected_answer": 103, "expected_unit": "pens", "ground_truth_graph": {"entities": ["Bryn", "Peter", "Aria", "Iris"], "initial_state": [{"entity": "Bryn", "quantity": {"unit": "pens", "value": 38}}, {"entity": "Peter", "quantity": {"unit": "pens", "value": 28}}, {"entity": "Aria", "quantity": {"unit": "pens", "value": 17}}, {"entity": "Iris", "quantity": {"unit": "pens", "value": 17}}], "operations": [{"actor": "Aria", "kind": "multiply", "operand": {"unit": "pens", "value": 2}}, {"actor": "Bryn", "kind": "subtract", "operand": {"unit": "pens", "value": 20}}, {"actor": "Bryn", "kind": "transfer", "operand": {"unit": "pens", "value": 11}, "target": "Peter"}, {"actor": "Bryn", "kind": "transfer", "operand": {"unit": "pens", "value": 5}, "target": "Peter"}, {"actor": "Bryn", "kind": "add", "operand": {"unit": "pens", "value": 6}}], "unknown": {"entity": null, "unit": "pens"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 5 exercising ['divide', 'subtract', 'transfer', 'transfer', 'add'] operations.", "id": "gma-025"}
{"problem": "Ruth has 16 sheets. Finn has 39 sheets. Ruth triples. Finn splits them evenly into 3 groups. Ruth buys 5 more sheets. Ruth doubles. How many sheets does Ruth have now?", "expected_answer": 106, "expected_unit": "sheets", "ground_truth_graph": {"entities": ["Ruth", "Finn"], "initial_state": [{"entity": "Ruth", "quantity": {"unit": "sheets", "value": 16}}, {"entity": "Finn", "quantity": {"unit": "sheets", "value": 39}}], "operations": [{"actor": "Ruth", "kind": "multiply", "operand": {"unit": "sheets", "value": 3}}, {"actor": "Finn", "kind": "divide", "operand": {"unit": "sheets", "value": 3}}, {"actor": "Ruth", "kind": "add", "operand": {"unit": "sheets", "value": 5}}, {"actor": "Ruth", "kind": "multiply", "operand": {"unit": "sheets", "value": 2}}], "unknown": {"entity": "Ruth", "unit": "sheets"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['multiply', 'divide', 'add', 'multiply'] operations.", "id": "gma-026"}
{"problem": "Elle has 10 stickers. Elle splits her stickers evenly into 5 groups and keeps one group. Then she gets 10 more. Elle buys 11 more stickers. Elle earns 13 stickers. Elle loses 3 stickers. How many stickers does Elle have altogether?", "expected_answer": 33, "expected_unit": "stickers", "ground_truth_graph": {"entities": ["Elle"], "initial_state": [{"entity": "Elle", "quantity": {"unit": "stickers", "value": 10}}], "operations": [{"actor": "Elle", "kind": "divide", "operand": {"unit": "stickers", "value": 5}}, {"actor": "Elle", "kind": "add", "operand": {"unit": "stickers", "value": 10}}, {"actor": "Elle", "kind": "add", "operand": {"unit": "stickers", "value": 11}}, {"actor": "Elle", "kind": "add", "operand": {"unit": "stickers", "value": 13}}, {"actor": "Elle", "kind": "subtract", "operand": {"unit": "stickers", "value": 3}}], "unknown": {"entity": "Elle", "unit": "stickers"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['divide', 'add', 'add', 'add', 'subtract'] operations.", "id": "gma-027"}
{"problem": "Hugo has 33 scarves. Hugo splits his scarves evenly into 3 groups. Hugo triples. He receives 10 scarves. Then he adds 3 scarves. Hugo doubles. How many scarves does Hugo have in total?", "expected_answer": 92, "expected_unit": "scarves", "ground_truth_graph": {"entities": ["Hugo"], "initial_state": [{"entity": "Hugo", "quantity": {"unit": "scarves", "value": 33}}], "operations": [{"actor": "Hugo", "kind": "divide", "operand": {"unit": "scarves", "value": 3}}, {"actor": "Hugo", "kind": "multiply", "operand": {"unit": "scarves", "value": 3}}, {"actor": "Hugo", "kind": "add", "operand": {"unit": "scarves", "value": 10}}, {"actor": "Hugo", "kind": "add", "operand": {"unit": "scarves", "value": 3}}, {"actor": "Hugo", "kind": "multiply", "operand": {"unit": "scarves", "value": 2}}], "unknown": {"entity": "Hugo", "unit": "scarves"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['divide', 'divide', 'add', 'add', 'multiply'] operations.", "id": "gma-028"}
{"problem": "Bryn has 28 stones. She finds 13 stones. Bryn drops 7. Bryn donates 7 stones. Bryn drops 3 stones. Bryn gets 7 more stones. How many stones does Bryn have now?", "expected_answer": 31, "expected_unit": "stones", "ground_truth_graph": {"entities": ["Bryn"], "initial_state": [{"entity": "Bryn", "quantity": {"unit": "stones", "value": 28}}], "operations": [{"actor": "Bryn", "kind": "add", "operand": {"unit": "stones", "value": 13}}, {"actor": "Bryn", "kind": "subtract", "operand": {"unit": "stones", "value": 7}}, {"actor": "Bryn", "kind": "subtract", "operand": {"unit": "stones", "value": 7}}, {"actor": "Bryn", "kind": "subtract", "operand": {"unit": "stones", "value": 3}}, {"actor": "Bryn", "kind": "add", "operand": {"unit": "stones", "value": 7}}], "unknown": {"entity": "Bryn", "unit": "stones"}}, "patterns": ["initial_has", "operation_add", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['add', 'subtract', 'subtract', 'subtract', 'add'] operations.", "id": "gma-029"}
{"problem": "Wren has 15 blocks. Wren doubles her blocks. Wren splits them evenly into 5 groups and keeps one group. She splits them evenly into 3 groups. She finds 9 blocks. How many blocks does Wren have now?", "expected_answer": 11, "expected_unit": "blocks", "ground_truth_graph": {"entities": ["Wren"], "initial_state": [{"entity": "Wren", "quantity": {"unit": "blocks", "value": 15}}], "operations": [{"actor": "Wren", "kind": "multiply", "operand": {"unit": "blocks", "value": 2}}, {"actor": "Wren", "kind": "divide", "operand": {"unit": "blocks", "value": 5}}, {"actor": "Wren", "kind": "divide", "operand": {"unit": "blocks", "value": 3}}, {"actor": "Wren", "kind": "add", "operand": {"unit": "blocks", "value": 9}}], "unknown": {"entity": "Wren", "unit": "blocks"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['multiply', 'divide', 'divide', 'add'] operations.", "id": "gma-030"}
{"problem": "Ruth has 24 pencils. Jade has 27 pencils. Zane has 15 pencils. Ivan has 34 pencils. Ivan gives 17 to Ruth. Ivan buys 6 more pencils. Ruth triples. Ivan finds 4 pencils. Jade doubles her pencils. How many pencils do they have?", "expected_answer": 219, "expected_unit": "pencils", "ground_truth_graph": {"entities": ["Ruth", "Jade", "Zane", "Ivan"], "initial_state": [{"entity": "Ruth", "quantity": {"unit": "pencils", "value": 24}}, {"entity": "Jade", "quantity": {"unit": "pencils", "value": 27}}, {"entity": "Zane", "quantity": {"unit": "pencils", "value": 15}}, {"entity": "Ivan", "quantity": {"unit": "pencils", "value": 34}}], "operations": [{"actor": "Ivan", "kind": "transfer", "operand": {"unit": "pencils", "value": 17}, "target": "Ruth"}, {"actor": "Ivan", "kind": "add", "operand": {"unit": "pencils", "value": 6}}, {"actor": "Ruth", "kind": "multiply", "operand": {"unit": "pencils", "value": 3}}, {"actor": "Ivan", "kind": "add", "operand": {"unit": "pencils", "value": 4}}, {"actor": "Jade", "kind": "multiply", "operand": {"unit": "pencils", "value": 2}}], "unknown": {"entity": null, "unit": "pencils"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 5 exercising ['transfer', 'add', 'multiply', 'divide', 'multiply'] operations.", "id": "gma-031"}
{"problem": "Paz has 33 buttons. She splits her buttons evenly into 3 groups. Then she receives 12 buttons. Then she triples. Then she uses 55 buttons. Paz earns 2 buttons. How many buttons does Paz have in total?", "expected_answer": 16, "expected_unit": "buttons", "ground_truth_graph": {"entities": ["Paz"], "initial_state": [{"entity": "Paz", "quantity": {"unit": "buttons", "value": 33}}], "operations": [{"actor": "Paz", "kind": "divide", "operand": {"unit": "buttons", "value": 3}}, {"actor": "Paz", "kind": "add", "operand": {"unit": "buttons", "value": 12}}, {"actor": "Paz", "kind": "multiply", "operand": {"unit": "buttons", "value": 3}}, {"actor": "Paz", "kind": "subtract", "operand": {"unit": "buttons", "value": 55}}, {"actor": "Paz", "kind": "add", "operand": {"unit": "buttons", "value": 2}}], "unknown": {"entity": "Paz", "unit": "buttons"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['divide', 'divide', 'multiply', 'subtract', 'add'] operations.", "id": "gma-032"}
{"problem": "Jade has 38 pens. Leo has 34 pens. Ruth has 24 pens. Sam has 33 pens. Ruth drops 11 pens. She eats 10 pens. Sam gets 8 more. Jade gives 24 pens to Sam. How many pens does Ruth have altogether?", "expected_answer": 3, "expected_unit": "pens", "ground_truth_graph": {"entities": ["Jade", "Leo", "Ruth", "Sam"], "initial_state": [{"entity": "Jade", "quantity": {"unit": "pens", "value": 38}}, {"entity": "Leo", "quantity": {"unit": "pens", "value": 34}}, {"entity": "Ruth", "quantity": {"unit": "pens", "value": 24}}, {"entity": "Sam", "quantity": {"unit": "pens", "value": 33}}], "operations": [{"actor": "Ruth", "kind": "subtract", "operand": {"unit": "pens", "value": 11}}, {"actor": "Ruth", "kind": "subtract", "operand": {"unit": "pens", "value": 10}}, {"actor": "Sam", "kind": "add", "operand": {"unit": "pens", "value": 8}}, {"actor": "Jade", "kind": "transfer", "operand": {"unit": "pens", "value": 24}, "target": "Sam"}], "unknown": {"entity": "Ruth", "unit": "pens"}}, "patterns": ["initial_has", "operation_add", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['subtract', 'subtract', 'add', 'transfer'] operations.", "id": "gma-033"}
{"problem": "Tom has 14 buttons. Elle has 18 buttons. Peter has 22 buttons. Nia has 17 buttons. Ben has 11 buttons. Elle doubles them. Elle sends 10 buttons to Tom. Nia finds 8 buttons. Elle buys 10 more buttons. She splits them evenly into 2 groups and keeps one group. How many buttons do they have in total?", "expected_answer": 100, "expected_unit": "buttons", "ground_truth_graph": {"entities": ["Tom", "Elle", "Peter", "Nia", "Ben"], "initial_state": [{"entity": "Tom", "quantity": {"unit": "buttons", "value": 14}}, {"entity": "Elle", "quantity": {"unit": "buttons", "value": 18}}, {"entity": "Peter", "quantity": {"unit": "buttons", "value": 22}}, {"entity": "Nia", "quantity": {"unit": "buttons", "value": 17}}, {"entity": "Ben", "quantity": {"unit": "buttons", "value": 11}}], "operations": [{"actor": "Elle", "kind": "multiply", "operand": {"unit": "buttons", "value": 2}}, {"actor": "Elle", "kind": "transfer", "operand": {"unit": "buttons", "value": 10}, "target": "Tom"}, {"actor": "Nia", "kind": "add", "operand": {"unit": "buttons", "value": 8}}, {"actor": "Elle", "kind": "add", "operand": {"unit": "buttons", "value": 10}}, {"actor": "Elle", "kind": "divide", "operand": {"unit": "buttons", "value": 2}}], "unknown": {"entity": null, "unit": "buttons"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 5 exercising ['multiply', 'transfer', 'divide', 'add', 'divide'] operations.", "id": "gma-034"}
{"problem": "Ina has 29 letters. Ina gets 7 more. She receives 2 letters. Ina adds 8 letters. Then she triples her letters. How many letters does Ina have altogether?", "expected_answer": 138, "expected_unit": "letters", "ground_truth_graph": {"entities": ["Ina"], "initial_state": [{"entity": "Ina", "quantity": {"unit": "letters", "value": 29}}], "operations": [{"actor": "Ina", "kind": "add", "operand": {"unit": "letters", "value": 7}}, {"actor": "Ina", "kind": "add", "operand": {"unit": "letters", "value": 2}}, {"actor": "Ina", "kind": "add", "operand": {"unit": "letters", "value": 8}}, {"actor": "Ina", "kind": "multiply", "operand": {"unit": "letters", "value": 3}}], "unknown": {"entity": "Ina", "unit": "letters"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['add', 'add', 'add', 'multiply'] operations.", "id": "gma-035"}
{"problem": "Oren has 20 letters. He eats 15 letters. Oren adds 14 letters. He donates 1. Oren eats 2 letters. Then he splits them evenly into 2 groups. Then he splits his letters evenly into 2 groups and keeps one group. Oren splits his letters evenly into 2 groups and keeps one group. How many letters does Oren have in total?", "expected_answer": 2, "expected_unit": "letters", "ground_truth_graph": {"entities": ["Oren"], "initial_state": [{"entity": "Oren", "quantity": {"unit": "letters", "value": 20}}], "operations": [{"actor": "Oren", "kind": "subtract", "operand": {"unit": "letters", "value": 15}}, {"actor": "Oren", "kind": "add", "operand": {"unit": "letters", "value": 14}}, {"actor": "Oren", "kind": "subtract", "operand": {"unit": "letters", "value": 1}}, {"actor": "Oren", "kind": "subtract", "operand": {"unit": "letters", "value": 2}}, {"actor": "Oren", "kind": "divide", "operand": {"unit": "letters", "value": 2}}, {"actor": "Oren", "kind": "divide", "operand": {"unit": "letters", "value": 2}}, {"actor": "Oren", "kind": "divide", "operand": {"unit": "letters", "value": 2}}], "unknown": {"entity": "Oren", "unit": "letters"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['subtract', 'add', 'subtract', 'subtract', 'divide', 'divide', 'divide'] operations.", "id": "gma-036"}
{"problem": "Zane has 29 cups. Zane eats 23 cups. Zane donates 4 cups. He finds 15 cups. Then he eats 14. Zane triples them. He donates 5 cups. How many cups does Zane have altogether?", "expected_answer": 4, "expected_unit": "cups", "ground_truth_graph": {"entities": ["Zane"], "initial_state": [{"entity": "Zane", "quantity": {"unit": "cups", "value": 29}}], "operations": [{"actor": "Zane", "kind": "subtract", "operand": {"unit": "cups", "value": 23}}, {"actor": "Zane", "kind": "subtract", "operand": {"unit": "cups", "value": 4}}, {"actor": "Zane", "kind": "add", "operand": {"unit": "cups", "value": 15}}, {"actor": "Zane", "kind": "subtract", "operand": {"unit": "cups", "value": 14}}, {"actor": "Zane", "kind": "multiply", "operand": {"unit": "cups", "value": 3}}, {"actor": "Zane", "kind": "subtract", "operand": {"unit": "cups", "value": 5}}], "unknown": {"entity": "Zane", "unit": "cups"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 6 exercising ['subtract', 'subtract', 'add', 'subtract', 'multiply', 'subtract'] operations.", "id": "gma-037"}
{"problem": "Ivan has 24 stickers. Drew has 25 stickers. Ivan splits his stickers evenly into 3 groups and keeps one group. Drew removes 2 stickers. He gives 7 stickers to Ivan. Ivan hands 7 to Drew. Then he finds 10 stickers. Drew gets 15 more. Ivan splits his stickers evenly into 2 groups and keeps one group. Drew doubles them. How many stickers does Ivan have in total?", "expected_answer": 9, "expected_unit": "stickers", "ground_truth_graph": {"entities": ["Ivan", "Drew"], "initial_state": [{"entity": "Ivan", "quantity": {"unit": "stickers", "value": 24}}, {"entity": "Drew", "quantity": {"unit": "stickers", "value": 25}}], "operations": [{"actor": "Ivan", "kind": "divide", "operand": {"unit": "stickers", "value": 3}}, {"actor": "Drew", "kind": "subtract", "operand": {"unit": "stickers", "value": 2}}, {"actor": "Drew", "kind": "transfer", "operand": {"unit": "stickers", "value": 7}, "target": "Ivan"}, {"actor": "Ivan", "kind": "transfer", "operand": {"unit": "stickers", "value": 7}, "target": "Drew"}, {"actor": "Ivan", "kind": "add", "operand": {"unit": "stickers", "value": 10}}, {"actor": "Drew", "kind": "add", "operand": {"unit": "stickers", "value": 15}}, {"actor": "Ivan", "kind": "divide", "operand": {"unit": "stickers", "value": 2}}, {"actor": "Drew", "kind": "multiply", "operand": {"unit": "stickers", "value": 2}}], "unknown": {"entity": "Ivan", "unit": "stickers"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 8 exercising ['divide', 'subtract', 'transfer', 'transfer', 'add', 'add', 'divide', 'multiply'] operations.", "id": "gma-038"}
{"problem": "Iris has 12 stones. She spends 5. Iris doubles. Iris splits her stones evenly into 2 groups and keeps one group. Iris doubles her stones. Then she triples her stones. Iris doubles. She splits her stones evenly into 2 groups. How many stones does Iris have in total?", "expected_answer": 42, "expected_unit": "stones", "ground_truth_graph": {"entities": ["Iris"], "initial_state": [{"entity": "Iris", "quantity": {"unit": "stones", "value": 12}}], "operations": [{"actor": "Iris", "kind": "subtract", "operand": {"unit": "stones", "value": 5}}, {"actor": "Iris", "kind": "multiply", "operand": {"unit": "stones", "value": 2}}, {"actor": "Iris", "kind": "divide", "operand": {"unit": "stones", "value": 2}}, {"actor": "Iris", "kind": "multiply", "operand": {"unit": "stones", "value": 2}}, {"actor": "Iris", "kind": "multiply", "operand": {"unit": "stones", "value": 3}}, {"actor": "Iris", "kind": "multiply", "operand": {"unit": "stones", "value": 2}}, {"actor": "Iris", "kind": "divide", "operand": {"unit": "stones", "value": 2}}], "unknown": {"entity": "Iris", "unit": "stones"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['subtract', 'divide', 'divide', 'multiply', 'multiply', 'multiply', 'divide'] operations.", "id": "gma-039"}
{"problem": "Quinn has 38 stamps. Oren has 12 stamps. He gives 9 to Quinn. Then he finds 15 stamps. He triples his stamps. Quinn receives 13 stamps. Quinn splits them evenly into 4 groups. Oren triples. He triples his stamps. How many stamps does Quinn have altogether?", "expected_answer": 15, "expected_unit": "stamps", "ground_truth_graph": {"entities": ["Quinn", "Oren"], "initial_state": [{"entity": "Quinn", "quantity": {"unit": "stamps", "value": 38}}, {"entity": "Oren", "quantity": {"unit": "stamps", "value": 12}}], "operations": [{"actor": "Oren", "kind": "transfer", "operand": {"unit": "stamps", "value": 9}, "target": "Quinn"}, {"actor": "Oren", "kind": "add", "operand": {"unit": "stamps", "value": 15}}, {"actor": "Oren", "kind": "multiply", "operand": {"unit": "stamps", "value": 3}}, {"actor": "Quinn", "kind": "add", "operand": {"unit": "stamps", "value": 13}}, {"actor": "Quinn", "kind": "divide", "operand": {"unit": "stamps", "value": 4}}, {"actor": "Oren", "kind": "multiply", "operand": {"unit": "stamps", "value": 3}}, {"actor": "Oren", "kind": "multiply", "operand": {"unit": "stamps", "value": 3}}], "unknown": {"entity": "Quinn", "unit": "stamps"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['transfer', 'transfer', 'multiply', 'add', 'divide', 'multiply', 'multiply'] operations.", "id": "gma-040"}
{"problem": "Ben has 19 books. Sam has 35 books. Sam adds 13 books. Ben spends 13 books. Ben splits his books evenly into 2 groups. Ben earns 13 books. Sam gets 4 more books. Then he triples them. He loses 131. Ben mails 6 to Sam. How many books does Ben have in total?", "expected_answer": 10, "expected_unit": "books", "ground_truth_graph": {"entities": ["Ben", "Sam"], "initial_state": [{"entity": "Ben", "quantity": {"unit": "books", "value": 19}}, {"entity": "Sam", "quantity": {"unit": "books", "value": 35}}], "operations": [{"actor": "Sam", "kind": "add", "operand": {"unit": "books", "value": 13}}, {"actor": "Ben", "kind": "subtract", "operand": {"unit": "books", "value": 13}}, {"actor": "Ben", "kind": "divide", "operand": {"unit": "books", "value": 2}}, {"actor": "Ben", "kind": "add", "operand": {"unit": "books", "value": 13}}, {"actor": "Sam", "kind": "add", "operand": {"unit": "books", "value": 4}}, {"actor": "Sam", "kind": "multiply", "operand": {"unit": "books", "value": 3}}, {"actor": "Sam", "kind": "subtract", "operand": {"unit": "books", "value": 131}}, {"actor": "Ben", "kind": "transfer", "operand": {"unit": "books", "value": 6}, "target": "Sam"}], "unknown": {"entity": "Ben", "unit": "books"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 8 exercising ['add', 'subtract', 'divide', 'transfer', 'add', 'multiply', 'subtract', 'transfer'] operations.", "id": "gma-041"}
{"problem": "Dina has 15 letters. Nori has 26 letters. Gwen has 15 letters. Finn has 33 letters. Lux has 32 letters. Finn gets 5 more. Dina passes 8 letters to Lux. Nori buys 15 more. Lux triples them. Gwen splits them evenly into 5 groups. Gwen splits her letters evenly into 3 groups. Nori triples her letters. Dina gets 2 more. How many letters does Nori have in total?", "expected_answer": 123, "expected_unit": "letters", "ground_truth_graph": {"entities": ["Dina", "Nori", "Gwen", "Finn", "Lux"], "initial_state": [{"entity": "Dina", "quantity": {"unit": "letters", "value": 15}}, {"entity": "Nori", "quantity": {"unit": "letters", "value": 26}}, {"entity": "Gwen", "quantity": {"unit": "letters", "value": 15}}, {"entity": "Finn", "quantity": {"unit": "letters", "value": 33}}, {"entity": "Lux", "quantity": {"unit": "letters", "value": 32}}], "operations": [{"actor": "Finn", "kind": "add", "operand": {"unit": "letters", "value": 5}}, {"actor": "Dina", "kind": "transfer", "operand": {"unit": "letters", "value": 8}, "target": "Lux"}, {"actor": "Nori", "kind": "add", "operand": {"unit": "letters", "value": 15}}, {"actor": "Lux", "kind": "multiply", "operand": {"unit": "letters", "value": 3}}, {"actor": "Gwen", "kind": "divide", "operand": {"unit": "letters", "value": 5}}, {"actor": "Gwen", "kind": "divide", "operand": {"unit": "letters", "value": 3}}, {"actor": "Nori", "kind": "multiply", "operand": {"unit": "letters", "value": 3}}, {"actor": "Dina", "kind": "add", "operand": {"unit": "letters", "value": 2}}], "unknown": {"entity": "Nori", "unit": "letters"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 8 exercising ['add', 'transfer', 'add', 'multiply', 'divide', 'divide', 'multiply', 'divide'] operations.", "id": "gma-042"}
{"problem": "Mila has 28 oranges. Iris has 11 oranges. Lena has 19 oranges. Then she uses 15 oranges. Lena gets 11 more. Mila doubles her oranges. Iris eats 9 oranges. Iris splits her oranges evenly into 2 groups. Lena splits her oranges evenly into 3 groups. Mila gives 27 to Lena. How many oranges does Lena have left?", "expected_answer": 32, "expected_unit": "oranges", "ground_truth_graph": {"entities": ["Mila", "Iris", "Lena"], "initial_state": [{"entity": "Mila", "quantity": {"unit": "oranges", "value": 28}}, {"entity": "Iris", "quantity": {"unit": "oranges", "value": 11}}, {"entity": "Lena", "quantity": {"unit": "oranges", "value": 19}}], "operations": [{"actor": "Lena", "kind": "subtract", "operand": {"unit": "oranges", "value": 15}}, {"actor": "Lena", "kind": "add", "operand": {"unit": "oranges", "value": 11}}, {"actor": "Mila", "kind": "multiply", "operand": {"unit": "oranges", "value": 2}}, {"actor": "Iris", "kind": "subtract", "operand": {"unit": "oranges", "value": 9}}, {"actor": "Iris", "kind": "divide", "operand": {"unit": "oranges", "value": 2}}, {"actor": "Lena", "kind": "divide", "operand": {"unit": "oranges", "value": 3}}, {"actor": "Mila", "kind": "transfer", "operand": {"unit": "oranges", "value": 27}, "target": "Lena"}], "unknown": {"entity": "Lena", "unit": "oranges"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['subtract', 'transfer', 'multiply', 'subtract', 'divide', 'divide', 'transfer'] operations.", "id": "gma-043"}
{"problem": "Drew has 22 pens. Gwen has 29 pens. Gwen passes 18 to Drew. Drew buys 12 more. He splits his pens evenly into 2 groups and keeps one group. He uses 7. Gwen doubles them. Gwen passes 9 pens to Drew. Drew spends 7 pens. How many pens does Gwen have in total?", "expected_answer": 13, "expected_unit": "pens", "ground_truth_graph": {"entities": ["Drew", "Gwen"], "initial_state": [{"entity": "Drew", "quantity": {"unit": "pens", "value": 22}}, {"entity": "Gwen", "quantity": {"unit": "pens", "value": 29}}], "operations": [{"actor": "Gwen", "kind": "transfer", "operand": {"unit": "pens", "value": 18}, "target": "Drew"}, {"actor": "Drew", "kind": "add", "operand": {"unit": "pens", "value": 12}}, {"actor": "Drew", "kind": "divide", "operand": {"unit": "pens", "value": 2}}, {"actor": "Drew", "kind": "subtract", "operand": {"unit": "pens", "value": 7}}, {"actor": "Gwen", "kind": "multiply", "operand": {"unit": "pens", "value": 2}}, {"actor": "Gwen", "kind": "transfer", "operand": {"unit": "pens", "value": 9}, "target": "Drew"}, {"actor": "Drew", "kind": "subtract", "operand": {"unit": "pens", "value": 7}}], "unknown": {"entity": "Gwen", "unit": "pens"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['transfer', 'add', 'divide', 'subtract', 'multiply', 'transfer', 'subtract'] operations.", "id": "gma-044"}
{"problem": "Sam has 16 apples. Sam removes 3 apples. Sam gets 10 more apples. He buys 2 more. He donates 13. Then he donates 2 apples. Sam eats 1 apples. How many apples does Sam have altogether?", "expected_answer": 9, "expected_unit": "apples", "ground_truth_graph": {"entities": ["Sam"], "initial_state": [{"entity": "Sam", "quantity": {"unit": "apples", "value": 16}}], "operations": [{"actor": "Sam", "kind": "subtract", "operand": {"unit": "apples", "value": 3}}, {"actor": "Sam", "kind": "add", "operand": {"unit": "apples", "value": 10}}, {"actor": "Sam", "kind": "add", "operand": {"unit": "apples", "value": 2}}, {"actor": "Sam", "kind": "subtract", "operand": {"unit": "apples", "value": 13}}, {"actor": "Sam", "kind": "subtract", "operand": {"unit": "apples", "value": 2}}, {"actor": "Sam", "kind": "subtract", "operand": {"unit": "apples", "value": 1}}], "unknown": {"entity": "Sam", "unit": "apples"}}, "patterns": ["initial_has", "operation_add", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 6 exercising ['subtract', 'add', 'add', 'subtract', 'subtract', 'subtract'] operations.", "id": "gma-045"}
{"problem": "Anna has 31 sheets. Then she eats 27 sheets. Then she doubles her sheets. Anna splits her sheets evenly into 4 groups. She splits her sheets evenly into 2 groups. Then she triples her sheets. Anna doubles them. Anna triples her sheets. She drops 10. How many sheets does Anna have altogether?", "expected_answer": 8, "expected_unit": "sheets", "ground_truth_graph": {"entities": ["Anna"], "initial_state": [{"entity": "Anna", "quantity": {"unit": "sheets", "value": 31}}], "operations": [{"actor": "Anna", "kind": "subtract", "operand": {"unit": "sheets", "value": 27}}, {"actor": "Anna", "kind": "multiply", "operand": {"unit": "sheets", "value": 2}}, {"actor": "Anna", "kind": "divide", "operand": {"unit": "sheets", "value": 4}}, {"actor": "Anna", "kind": "divide", "operand": {"unit": "sheets", "value": 2}}, {"actor": "Anna", "kind": "multiply", "operand": {"unit": "sheets", "value": 3}}, {"actor": "Anna", "kind": "multiply", "operand": {"unit": "sheets", "value": 2}}, {"actor": "Anna", "kind": "multiply", "operand": {"unit": "sheets", "value": 3}}, {"actor": "Anna", "kind": "subtract", "operand": {"unit": "sheets", "value": 10}}], "unknown": {"entity": "Anna", "unit": "sheets"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 8 exercising ['subtract', 'multiply', 'divide', 'divide', 'multiply', 'multiply', 'multiply', 'subtract'] operations.", "id": "gma-046"}
{"problem": "Owen has 20 coins. Seth has 39 coins. Ben has 15 coins. Ben removes 12 coins. Seth sends 18 to Owen. Ben splits them evenly into 3 groups and keeps one group. Owen gives 13 to Ben. Owen passes 23 to Seth. Ben sells 6 coins. How many coins does Seth have left?", "expected_answer": 44, "expected_unit": "coins", "ground_truth_graph": {"entities": ["Owen", "Seth", "Ben"], "initial_state": [{"entity": "Owen", "quantity": {"unit": "coins", "value": 20}}, {"entity": "Seth", "quantity": {"unit": "coins", "value": 39}}, {"entity": "Ben", "quantity": {"unit": "coins", "value": 15}}], "operations": [{"actor": "Ben", "kind": "subtract", "operand": {"unit": "coins", "value": 12}}, {"actor": "Seth", "kind": "transfer", "operand": {"unit": "coins", "value": 18}, "target": "Owen"}, {"actor": "Ben", "kind": "divide", "operand": {"unit": "coins", "value": 3}}, {"actor": "Owen", "kind": "transfer", "operand": {"unit": "coins", "value": 13}, "target": "Ben"}, {"actor": "Owen", "kind": "transfer", "operand": {"unit": "coins", "value": 23}, "target": "Seth"}, {"actor": "Ben", "kind": "subtract", "operand": {"unit": "coins", "value": 6}}], "unknown": {"entity": "Seth", "unit": "coins"}}, "patterns": ["initial_has", "operation_divide", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 6 exercising ['subtract', 'transfer', 'divide', 'transfer', 'transfer', 'subtract'] operations.", "id": "gma-047"}
{"problem": "Iris has 16 sheets. Ivan has 28 sheets. Pia has 14 sheets. Jay has 30 sheets. Owen has 10 sheets. Then he hands 5 to Ivan. Pia splits her sheets evenly into 2 groups and keeps one group. Ivan mails 19 to Iris. Then he donates 2 sheets. Owen doubles them. He buys 14 more sheets. How many sheets does Pia have altogether?", "expected_answer": 7, "expected_unit": "sheets", "ground_truth_graph": {"entities": ["Iris", "Ivan", "Pia", "Jay", "Owen"], "initial_state": [{"entity": "Iris", "quantity": {"unit": "sheets", "value": 16}}, {"entity": "Ivan", "quantity": {"unit": "sheets", "value": 28}}, {"entity": "Pia", "quantity": {"unit": "sheets", "value": 14}}, {"entity": "Jay", "quantity": {"unit": "sheets", "value": 30}}, {"entity": "Owen", "quantity": {"unit": "sheets", "value": 10}}], "operations": [{"actor": "Owen", "kind": "transfer", "operand": {"unit": "sheets", "value": 5}, "target": "Ivan"}, {"actor": "Pia", "kind": "divide", "operand": {"unit": "sheets", "value": 2}}, {"actor": "Ivan", "kind": "transfer", "operand": {"unit": "sheets", "value": 19}, "target": "Iris"}, {"actor": "Ivan", "kind": "subtract", "operand": {"unit": "sheets", "value": 2}}, {"actor": "Owen", "kind": "multiply", "operand": {"unit": "sheets", "value": 2}}, {"actor": "Owen", "kind": "add", "operand": {"unit": "sheets", "value": 14}}], "unknown": {"entity": "Pia", "unit": "sheets"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 6 exercising ['transfer', 'divide', 'transfer', 'subtract', 'multiply', 'add'] operations.", "id": "gma-048"}
{"problem": "Gwen has 14 pencils. Aria has 15 pencils. Aria doubles. She eats 9. Gwen triples. Gwen buys 13 more pencils. Then she doubles. Gwen gives 14 pencils to Aria. Gwen gets 7 more. How many pencils does Gwen have left?", "expected_answer": 103, "expected_unit": "pencils", "ground_truth_graph": {"entities": ["Gwen", "Aria"], "initial_state": [{"entity": "Gwen", "quantity": {"unit": "pencils", "value": 14}}, {"entity": "Aria", "quantity": {"unit": "pencils", "value": 15}}], "operations": [{"actor": "Aria", "kind": "multiply", "operand": {"unit": "pencils", "value": 2}}, {"actor": "Aria", "kind": "subtract", "operand": {"unit": "pencils", "value": 9}}, {"actor": "Gwen", "kind": "multiply", "operand": {"unit": "pencils", "value": 3}}, {"actor": "Gwen", "kind": "add", "operand": {"unit": "pencils", "value": 13}}, {"actor": "Gwen", "kind": "multiply", "operand": {"unit": "pencils", "value": 2}}, {"actor": "Gwen", "kind": "transfer", "operand": {"unit": "pencils", "value": 14}, "target": "Aria"}, {"actor": "Gwen", "kind": "add", "operand": {"unit": "pencils", "value": 7}}], "unknown": {"entity": "Gwen", "unit": "pencils"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['multiply', 'subtract', 'multiply', 'add', 'multiply', 'transfer', 'add'] operations.", "id": "gma-049"}
{"problem": "Leo has 30 cards. Zane has 40 cards. Gwen has 37 cards. Leo triples. Zane splits them evenly into 2 groups. Gwen triples them. She doubles them. Gwen sends 100 to Leo. Gwen hands 70 to Leo. She uses 26. How many cards does Gwen have in total?", "expected_answer": 26, "expected_unit": "cards", "ground_truth_graph": {"entities": ["Leo", "Zane", "Gwen"], "initial_state": [{"entity": "Leo", "quantity": {"unit": "cards", "value": 30}}, {"entity": "Zane", "quantity": {"unit": "cards", "value": 40}}, {"entity": "Gwen", "quantity": {"unit": "cards", "value": 37}}], "operations": [{"actor": "Leo", "kind": "multiply", "operand": {"unit": "cards", "value": 3}}, {"actor": "Zane", "kind": "divide", "operand": {"unit": "cards", "value": 2}}, {"actor": "Gwen", "kind": "multiply", "operand": {"unit": "cards", "value": 3}}, {"actor": "Gwen", "kind": "multiply", "operand": {"unit": "cards", "value": 2}}, {"actor": "Gwen", "kind": "transfer", "operand": {"unit": "cards", "value": 100}, "target": "Leo"}, {"actor": "Gwen", "kind": "transfer", "operand": {"unit": "cards", "value": 70}, "target": "Leo"}, {"actor": "Gwen", "kind": "subtract", "operand": {"unit": "cards", "value": 26}}], "unknown": {"entity": "Gwen", "unit": "cards"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['multiply', 'divide', 'divide', 'multiply', 'transfer', 'transfer', 'subtract'] operations.", "id": "gma-050"}

0
evals/gsm8k_math/holdouts/v1/cases.jsonl Normal file
View file

0
evals/gsm8k_math/holdouts/v1/cases_plaintext.jsonl Normal file
View file

150
evals/gsm8k_math/public/v1/cases.jsonl Normal file
View file

@ -0,0 +1,150 @@
{"problem": "Kai has 15 crayons. Lux has 21 crayons. He sends 14 to Kai. How many crayons does Kai have left?", "expected_answer": 29, "expected_unit": "crayons", "ground_truth_graph": {"entities": ["Kai", "Lux"], "initial_state": [{"entity": "Kai", "quantity": {"unit": "crayons", "value": 15}}, {"entity": "Lux", "quantity": {"unit": "crayons", "value": 21}}], "operations": [{"actor": "Lux", "kind": "transfer", "operand": {"unit": "crayons", "value": 14}, "target": "Kai"}], "unknown": {"entity": "Kai", "unit": "crayons"}}, "patterns": ["initial_has", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 1 exercising ['transfer'] operations.", "id": "gma-101"}
{"problem": "Blake has 24 pencils. Anna has 16 pencils. Zane has 36 pencils. Noah has 20 pencils. Zane gives 30 pencils to Blake. How many pencils do they have in total?", "expected_answer": 96, "expected_unit": "pencils", "ground_truth_graph": {"entities": ["Blake", "Anna", "Zane", "Noah"], "initial_state": [{"entity": "Blake", "quantity": {"unit": "pencils", "value": 24}}, {"entity": "Anna", "quantity": {"unit": "pencils", "value": 16}}, {"entity": "Zane", "quantity": {"unit": "pencils", "value": 36}}, {"entity": "Noah", "quantity": {"unit": "pencils", "value": 20}}], "operations": [{"actor": "Zane", "kind": "transfer", "operand": {"unit": "pencils", "value": 30}, "target": "Blake"}], "unknown": {"entity": null, "unit": "pencils"}}, "patterns": ["initial_has", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 1 exercising ['transfer'] operations.", "id": "gma-102"}
{"problem": "Tom has 25 buttons. Hal has 14 buttons. Zane has 11 buttons. Uma has 40 buttons. Hal mails 2 buttons to Uma. How many buttons does Zane have left?", "expected_answer": 11, "expected_unit": "buttons", "ground_truth_graph": {"entities": ["Tom", "Hal", "Zane", "Uma"], "initial_state": [{"entity": "Tom", "quantity": {"unit": "buttons", "value": 25}}, {"entity": "Hal", "quantity": {"unit": "buttons", "value": 14}}, {"entity": "Zane", "quantity": {"unit": "buttons", "value": 11}}, {"entity": "Uma", "quantity": {"unit": "buttons", "value": 40}}], "operations": [{"actor": "Hal", "kind": "transfer", "operand": {"unit": "buttons", "value": 2}, "target": "Uma"}], "unknown": {"entity": "Zane", "unit": "buttons"}}, "patterns": ["initial_has", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 1 exercising ['transfer'] operations.", "id": "gma-103"}
{"problem": "Lena has 35 blocks. Anna has 11 blocks. Wren has 20 blocks. Milo has 16 blocks. Yara has 40 blocks. Yara sends 22 blocks to Milo. How many blocks does Wren have left?", "expected_answer": 20, "expected_unit": "blocks", "ground_truth_graph": {"entities": ["Lena", "Anna", "Wren", "Milo", "Yara"], "initial_state": [{"entity": "Lena", "quantity": {"unit": "blocks", "value": 35}}, {"entity": "Anna", "quantity": {"unit": "blocks", "value": 11}}, {"entity": "Wren", "quantity": {"unit": "blocks", "value": 20}}, {"entity": "Milo", "quantity": {"unit": "blocks", "value": 16}}, {"entity": "Yara", "quantity": {"unit": "blocks", "value": 40}}], "operations": [{"actor": "Yara", "kind": "transfer", "operand": {"unit": "blocks", "value": 22}, "target": "Milo"}], "unknown": {"entity": "Wren", "unit": "blocks"}}, "patterns": ["initial_has", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 1 exercising ['transfer'] operations.", "id": "gma-104"}
{"problem": "Finn has 29 stickers. Aria has 14 stickers. Finn hands 9 stickers to Aria. How many stickers does Finn have now?", "expected_answer": 20, "expected_unit": "stickers", "ground_truth_graph": {"entities": ["Finn", "Aria"], "initial_state": [{"entity": "Finn", "quantity": {"unit": "stickers", "value": 29}}, {"entity": "Aria", "quantity": {"unit": "stickers", "value": 14}}], "operations": [{"actor": "Finn", "kind": "transfer", "operand": {"unit": "stickers", "value": 9}, "target": "Aria"}], "unknown": {"entity": "Finn", "unit": "stickers"}}, "patterns": ["initial_has", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 1 exercising ['transfer'] operations.", "id": "gma-105"}
{"problem": "Elle has 18 oranges. Nori has 15 oranges. Drew has 14 oranges. Elle sends 4 oranges to Nori. How many oranges does Nori have now?", "expected_answer": 19, "expected_unit": "oranges", "ground_truth_graph": {"entities": ["Elle", "Nori", "Drew"], "initial_state": [{"entity": "Elle", "quantity": {"unit": "oranges", "value": 18}}, {"entity": "Nori", "quantity": {"unit": "oranges", "value": 15}}, {"entity": "Drew", "quantity": {"unit": "oranges", "value": 14}}], "operations": [{"actor": "Elle", "kind": "transfer", "operand": {"unit": "oranges", "value": 4}, "target": "Nori"}], "unknown": {"entity": "Nori", "unit": "oranges"}}, "patterns": ["initial_has", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 1 exercising ['transfer'] operations.", "id": "gma-106"}
{"problem": "Finn has 15 marbles. Hal has 12 marbles. Hal passes 7 marbles to Finn. How many marbles do they have?", "expected_answer": 27, "expected_unit": "marbles", "ground_truth_graph": {"entities": ["Finn", "Hal"], "initial_state": [{"entity": "Finn", "quantity": {"unit": "marbles", "value": 15}}, {"entity": "Hal", "quantity": {"unit": "marbles", "value": 12}}], "operations": [{"actor": "Hal", "kind": "transfer", "operand": {"unit": "marbles", "value": 7}, "target": "Finn"}], "unknown": {"entity": null, "unit": "marbles"}}, "patterns": ["initial_has", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 1 exercising ['transfer'] operations.", "id": "gma-107"}
{"problem": "Uma has 35 candies. Jay has 30 candies. Ina has 32 candies. Paz has 15 candies. Sara has 25 candies. Sara eats 5. How many candies does Uma have now?", "expected_answer": 35, "expected_unit": "candies", "ground_truth_graph": {"entities": ["Uma", "Jay", "Ina", "Paz", "Sara"], "initial_state": [{"entity": "Uma", "quantity": {"unit": "candies", "value": 35}}, {"entity": "Jay", "quantity": {"unit": "candies", "value": 30}}, {"entity": "Ina", "quantity": {"unit": "candies", "value": 32}}, {"entity": "Paz", "quantity": {"unit": "candies", "value": 15}}, {"entity": "Sara", "quantity": {"unit": "candies", "value": 25}}], "operations": [{"actor": "Sara", "kind": "subtract", "operand": {"unit": "candies", "value": 5}}], "unknown": {"entity": "Uma", "unit": "candies"}}, "patterns": ["initial_has", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 1 exercising ['subtract'] operations.", "id": "gma-108"}
{"problem": "Nori has 38 cards. Mila has 22 cards. Zane has 32 cards. Nia has 10 cards. Ina has 40 cards. Mila mails 7 to Nori. How many cards do they have altogether?", "expected_answer": 142, "expected_unit": "cards", "ground_truth_graph": {"entities": ["Nori", "Mila", "Zane", "Nia", "Ina"], "initial_state": [{"entity": "Nori", "quantity": {"unit": "cards", "value": 38}}, {"entity": "Mila", "quantity": {"unit": "cards", "value": 22}}, {"entity": "Zane", "quantity": {"unit": "cards", "value": 32}}, {"entity": "Nia", "quantity": {"unit": "cards", "value": 10}}, {"entity": "Ina", "quantity": {"unit": "cards", "value": 40}}], "operations": [{"actor": "Mila", "kind": "transfer", "operand": {"unit": "cards", "value": 7}, "target": "Nori"}], "unknown": {"entity": null, "unit": "cards"}}, "patterns": ["initial_has", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 1 exercising ['transfer'] operations.", "id": "gma-109"}
{"problem": "Dina has 10 oranges. Sara has 22 oranges. Clara has 21 oranges. She sells 18 oranges. How many oranges does Sara have left?", "expected_answer": 22, "expected_unit": "oranges", "ground_truth_graph": {"entities": ["Dina", "Sara", "Clara"], "initial_state": [{"entity": "Dina", "quantity": {"unit": "oranges", "value": 10}}, {"entity": "Sara", "quantity": {"unit": "oranges", "value": 22}}, {"entity": "Clara", "quantity": {"unit": "oranges", "value": 21}}], "operations": [{"actor": "Clara", "kind": "subtract", "operand": {"unit": "oranges", "value": 18}}], "unknown": {"entity": "Sara", "unit": "oranges"}}, "patterns": ["initial_has", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 1 exercising ['subtract'] operations.", "id": "gma-110"}
{"problem": "Iris has 14 tickets. Lux has 23 tickets. Sam has 40 tickets. Ben has 40 tickets. Sam triples. How many tickets do they have altogether?", "expected_answer": 197, "expected_unit": "tickets", "ground_truth_graph": {"entities": ["Iris", "Lux", "Sam", "Ben"], "initial_state": [{"entity": "Iris", "quantity": {"unit": "tickets", "value": 14}}, {"entity": "Lux", "quantity": {"unit": "tickets", "value": 23}}, {"entity": "Sam", "quantity": {"unit": "tickets", "value": 40}}, {"entity": "Ben", "quantity": {"unit": "tickets", "value": 40}}], "operations": [{"actor": "Sam", "kind": "multiply", "operand": {"unit": "tickets", "value": 3}}], "unknown": {"entity": null, "unit": "tickets"}}, "patterns": ["initial_has", "operation_multiply", "question_how_many_total"], "notes": "Original authored case of depth 1 exercising ['multiply'] operations.", "id": "gma-111"}
{"problem": "Ruth has 23 blocks. Bryn has 29 blocks. Seth has 40 blocks. Finn has 23 blocks. Clara has 39 blocks. Bryn triples them. How many blocks do they have in total?", "expected_answer": 212, "expected_unit": "blocks", "ground_truth_graph": {"entities": ["Ruth", "Bryn", "Seth", "Finn", "Clara"], "initial_state": [{"entity": "Ruth", "quantity": {"unit": "blocks", "value": 23}}, {"entity": "Bryn", "quantity": {"unit": "blocks", "value": 29}}, {"entity": "Seth", "quantity": {"unit": "blocks", "value": 40}}, {"entity": "Finn", "quantity": {"unit": "blocks", "value": 23}}, {"entity": "Clara", "quantity": {"unit": "blocks", "value": 39}}], "operations": [{"actor": "Bryn", "kind": "multiply", "operand": {"unit": "blocks", "value": 3}}], "unknown": {"entity": null, "unit": "blocks"}}, "patterns": ["initial_has", "operation_multiply", "question_how_many_total"], "notes": "Original authored case of depth 1 exercising ['multiply'] operations.", "id": "gma-112"}
{"problem": "Pia has 18 apples. Hugo has 36 apples. Zane has 33 apples. Milo has 23 apples. Jay has 23 apples. Milo gets 12 more apples. How many apples do they have?", "expected_answer": 145, "expected_unit": "apples", "ground_truth_graph": {"entities": ["Pia", "Hugo", "Zane", "Milo", "Jay"], "initial_state": [{"entity": "Pia", "quantity": {"unit": "apples", "value": 18}}, {"entity": "Hugo", "quantity": {"unit": "apples", "value": 36}}, {"entity": "Zane", "quantity": {"unit": "apples", "value": 33}}, {"entity": "Milo", "quantity": {"unit": "apples", "value": 23}}, {"entity": "Jay", "quantity": {"unit": "apples", "value": 23}}], "operations": [{"actor": "Milo", "kind": "add", "operand": {"unit": "apples", "value": 12}}], "unknown": {"entity": null, "unit": "apples"}}, "patterns": ["initial_has", "operation_add", "question_how_many_total"], "notes": "Original authored case of depth 1 exercising ['divide'] operations.", "id": "gma-113"}
{"problem": "Dina has 16 dollars. Seth has 38 dollars. Ina has 19 dollars. Quinn has 26 dollars. Aria has 27 dollars. Ina buys 8 more dollars. How many dollars does Ina have in total?", "expected_answer": 27, "expected_unit": "dollars", "ground_truth_graph": {"entities": ["Dina", "Seth", "Ina", "Quinn", "Aria"], "initial_state": [{"entity": "Dina", "quantity": {"unit": "dollars", "value": 16}}, {"entity": "Seth", "quantity": {"unit": "dollars", "value": 38}}, {"entity": "Ina", "quantity": {"unit": "dollars", "value": 19}}, {"entity": "Quinn", "quantity": {"unit": "dollars", "value": 26}}, {"entity": "Aria", "quantity": {"unit": "dollars", "value": 27}}], "operations": [{"actor": "Ina", "kind": "add", "operand": {"unit": "dollars", "value": 8}}], "unknown": {"entity": "Ina", "unit": "dollars"}}, "patterns": ["initial_has", "operation_add", "question_how_many_entity"], "notes": "Original authored case of depth 1 exercising ['add'] operations.", "id": "gma-114"}
{"problem": "Jade has 20 cups. Peter has 31 cups. Jade receives 11 cups. How many cups does Jade have altogether?", "expected_answer": 31, "expected_unit": "cups", "ground_truth_graph": {"entities": ["Jade", "Peter"], "initial_state": [{"entity": "Jade", "quantity": {"unit": "cups", "value": 20}}, {"entity": "Peter", "quantity": {"unit": "cups", "value": 31}}], "operations": [{"actor": "Jade", "kind": "add", "operand": {"unit": "cups", "value": 11}}], "unknown": {"entity": "Jade", "unit": "cups"}}, "patterns": ["initial_has", "operation_add", "question_how_many_entity"], "notes": "Original authored case of depth 1 exercising ['add'] operations.", "id": "gma-115"}
{"problem": "Oren has 23 blocks. Jade has 19 blocks. Lux has 15 blocks. Anna has 32 blocks. Quinn has 24 blocks. He triples his blocks. He gets 11 more blocks. How many blocks does Oren have left?", "expected_answer": 23, "expected_unit": "blocks", "ground_truth_graph": {"entities": ["Oren", "Jade", "Lux", "Anna", "Quinn"], "initial_state": [{"entity": "Oren", "quantity": {"unit": "blocks", "value": 23}}, {"entity": "Jade", "quantity": {"unit": "blocks", "value": 19}}, {"entity": "Lux", "quantity": {"unit": "blocks", "value": 15}}, {"entity": "Anna", "quantity": {"unit": "blocks", "value": 32}}, {"entity": "Quinn", "quantity": {"unit": "blocks", "value": 24}}], "operations": [{"actor": "Quinn", "kind": "multiply", "operand": {"unit": "blocks", "value": 3}}, {"actor": "Quinn", "kind": "add", "operand": {"unit": "blocks", "value": 11}}], "unknown": {"entity": "Oren", "unit": "blocks"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['multiply', 'add'] operations.", "id": "gma-116"}
{"problem": "Ruth has 32 cards. Ruth earns 9 cards. She finds 7 cards. How many cards does Ruth have?", "expected_answer": 48, "expected_unit": "cards", "ground_truth_graph": {"entities": ["Ruth"], "initial_state": [{"entity": "Ruth", "quantity": {"unit": "cards", "value": 32}}], "operations": [{"actor": "Ruth", "kind": "add", "operand": {"unit": "cards", "value": 9}}, {"actor": "Ruth", "kind": "add", "operand": {"unit": "cards", "value": 7}}], "unknown": {"entity": "Ruth", "unit": "cards"}}, "patterns": ["initial_has", "operation_add", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['add', 'divide'] operations.", "id": "gma-117"}
{"problem": "Cora has 36 letters. Oren has 25 letters. Pia has 25 letters. Ina has 35 letters. Finn has 15 letters. Finn passes 2 to Ina. Oren gets 9 more letters. How many letters does Ina have now?", "expected_answer": 37, "expected_unit": "letters", "ground_truth_graph": {"entities": ["Cora", "Oren", "Pia", "Ina", "Finn"], "initial_state": [{"entity": "Cora", "quantity": {"unit": "letters", "value": 36}}, {"entity": "Oren", "quantity": {"unit": "letters", "value": 25}}, {"entity": "Pia", "quantity": {"unit": "letters", "value": 25}}, {"entity": "Ina", "quantity": {"unit": "letters", "value": 35}}, {"entity": "Finn", "quantity": {"unit": "letters", "value": 15}}], "operations": [{"actor": "Finn", "kind": "transfer", "operand": {"unit": "letters", "value": 2}, "target": "Ina"}, {"actor": "Oren", "kind": "add", "operand": {"unit": "letters", "value": 9}}], "unknown": {"entity": "Ina", "unit": "letters"}}, "patterns": ["initial_has", "operation_add", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['transfer', 'add'] operations.", "id": "gma-118"}
{"problem": "Lena has 19 marbles. Ruth has 13 marbles. Milo has 27 marbles. Pia has 35 marbles. Milo splits his marbles evenly into 3 groups. Pia mails 24 marbles to Milo. Milo mails 24 to Ruth. How many marbles do they have left?", "expected_answer": 76, "expected_unit": "marbles", "ground_truth_graph": {"entities": ["Lena", "Ruth", "Milo", "Pia"], "initial_state": [{"entity": "Lena", "quantity": {"unit": "marbles", "value": 19}}, {"entity": "Ruth", "quantity": {"unit": "marbles", "value": 13}}, {"entity": "Milo", "quantity": {"unit": "marbles", "value": 27}}, {"entity": "Pia", "quantity": {"unit": "marbles", "value": 35}}], "operations": [{"actor": "Milo", "kind": "divide", "operand": {"unit": "marbles", "value": 3}}, {"actor": "Pia", "kind": "transfer", "operand": {"unit": "marbles", "value": 24}, "target": "Milo"}, {"actor": "Milo", "kind": "transfer", "operand": {"unit": "marbles", "value": 24}, "target": "Ruth"}], "unknown": {"entity": null, "unit": "marbles"}}, "patterns": ["initial_has", "operation_divide", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 3 exercising ['divide', 'transfer', 'transfer'] operations.", "id": "gma-119"}
{"problem": "Blake has 16 scarves. Elle has 17 scarves. Uma has 34 scarves. Kai has 25 scarves. Lux has 20 scarves. Blake splits his scarves evenly into 4 groups. Blake triples his scarves. How many scarves do they have altogether?", "expected_answer": 108, "expected_unit": "scarves", "ground_truth_graph": {"entities": ["Blake", "Elle", "Uma", "Kai", "Lux"], "initial_state": [{"entity": "Blake", "quantity": {"unit": "scarves", "value": 16}}, {"entity": "Elle", "quantity": {"unit": "scarves", "value": 17}}, {"entity": "Uma", "quantity": {"unit": "scarves", "value": 34}}, {"entity": "Kai", "quantity": {"unit": "scarves", "value": 25}}, {"entity": "Lux", "quantity": {"unit": "scarves", "value": 20}}], "operations": [{"actor": "Blake", "kind": "divide", "operand": {"unit": "scarves", "value": 4}}, {"actor": "Blake", "kind": "multiply", "operand": {"unit": "scarves", "value": 3}}], "unknown": {"entity": null, "unit": "scarves"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "question_how_many_total"], "notes": "Original authored case of depth 2 exercising ['divide', 'multiply'] operations.", "id": "gma-120"}
{"problem": "Wren has 31 marbles. Wren buys 5 more marbles. Wren donates 34 marbles. How many marbles does Wren have?", "expected_answer": 2, "expected_unit": "marbles", "ground_truth_graph": {"entities": ["Wren"], "initial_state": [{"entity": "Wren", "quantity": {"unit": "marbles", "value": 31}}], "operations": [{"actor": "Wren", "kind": "add", "operand": {"unit": "marbles", "value": 5}}, {"actor": "Wren", "kind": "subtract", "operand": {"unit": "marbles", "value": 34}}], "unknown": {"entity": "Wren", "unit": "marbles"}}, "patterns": ["initial_has", "operation_add", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['add', 'subtract'] operations.", "id": "gma-121"}
{"problem": "Blake has 18 cards. Blake drops 3. Blake donates 1. He triples. How many cards does Blake have left?", "expected_answer": 42, "expected_unit": "cards", "ground_truth_graph": {"entities": ["Blake"], "initial_state": [{"entity": "Blake", "quantity": {"unit": "cards", "value": 18}}], "operations": [{"actor": "Blake", "kind": "subtract", "operand": {"unit": "cards", "value": 3}}, {"actor": "Blake", "kind": "subtract", "operand": {"unit": "cards", "value": 1}}, {"actor": "Blake", "kind": "multiply", "operand": {"unit": "cards", "value": 3}}], "unknown": {"entity": "Blake", "unit": "cards"}}, "patterns": ["initial_has", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 3 exercising ['subtract', 'subtract', 'multiply'] operations.", "id": "gma-122"}
{"problem": "Anna has 22 cups. Dina has 21 cups. Iris has 12 cups. Clara has 23 cups. Then she adds 13 cups. Anna spends 17. Clara doubles them. How many cups do they have?", "expected_answer": 110, "expected_unit": "cups", "ground_truth_graph": {"entities": ["Anna", "Dina", "Iris", "Clara"], "initial_state": [{"entity": "Anna", "quantity": {"unit": "cups", "value": 22}}, {"entity": "Dina", "quantity": {"unit": "cups", "value": 21}}, {"entity": "Iris", "quantity": {"unit": "cups", "value": 12}}, {"entity": "Clara", "quantity": {"unit": "cups", "value": 23}}], "operations": [{"actor": "Clara", "kind": "add", "operand": {"unit": "cups", "value": 13}}, {"actor": "Anna", "kind": "subtract", "operand": {"unit": "cups", "value": 17}}, {"actor": "Clara", "kind": "multiply", "operand": {"unit": "cups", "value": 2}}], "unknown": {"entity": null, "unit": "cups"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "question_how_many_total"], "notes": "Original authored case of depth 3 exercising ['divide', 'subtract', 'multiply'] operations.", "id": "gma-123"}
{"problem": "Aria has 39 pencils. Then she triples her pencils. Aria gets 12 more pencils. How many pencils does Aria have in total?", "expected_answer": 129, "expected_unit": "pencils", "ground_truth_graph": {"entities": ["Aria"], "initial_state": [{"entity": "Aria", "quantity": {"unit": "pencils", "value": 39}}], "operations": [{"actor": "Aria", "kind": "multiply", "operand": {"unit": "pencils", "value": 3}}, {"actor": "Aria", "kind": "add", "operand": {"unit": "pencils", "value": 12}}], "unknown": {"entity": "Aria", "unit": "pencils"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['multiply', 'add'] operations.", "id": "gma-124"}
{"problem": "Dina has 14 books. Then she eats 4 books. Dina finds 12 books. How many books does Dina have altogether?", "expected_answer": 22, "expected_unit": "books", "ground_truth_graph": {"entities": ["Dina"], "initial_state": [{"entity": "Dina", "quantity": {"unit": "books", "value": 14}}], "operations": [{"actor": "Dina", "kind": "subtract", "operand": {"unit": "books", "value": 4}}, {"actor": "Dina", "kind": "add", "operand": {"unit": "books", "value": 12}}], "unknown": {"entity": "Dina", "unit": "books"}}, "patterns": ["initial_has", "operation_add", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['subtract', 'add'] operations.", "id": "gma-125"}
{"problem": "Gina has 31 kites. Then she receives 3 kites. Then she buys 7 more kites. Gina triples. How many kites does Gina have?", "expected_answer": 123, "expected_unit": "kites", "ground_truth_graph": {"entities": ["Gina"], "initial_state": [{"entity": "Gina", "quantity": {"unit": "kites", "value": 31}}], "operations": [{"actor": "Gina", "kind": "add", "operand": {"unit": "kites", "value": 3}}, {"actor": "Gina", "kind": "add", "operand": {"unit": "kites", "value": 7}}, {"actor": "Gina", "kind": "multiply", "operand": {"unit": "kites", "value": 3}}], "unknown": {"entity": "Gina", "unit": "kites"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 3 exercising ['add', 'add', 'multiply'] operations.", "id": "gma-126"}
{"problem": "Hugo has 15 stickers. Peter has 36 stickers. Mila has 26 stickers. Yara has 17 stickers. She loses 14. Yara splits them evenly into 3 groups. How many stickers do they have altogether?", "expected_answer": 78, "expected_unit": "stickers", "ground_truth_graph": {"entities": ["Hugo", "Peter", "Mila", "Yara"], "initial_state": [{"entity": "Hugo", "quantity": {"unit": "stickers", "value": 15}}, {"entity": "Peter", "quantity": {"unit": "stickers", "value": 36}}, {"entity": "Mila", "quantity": {"unit": "stickers", "value": 26}}, {"entity": "Yara", "quantity": {"unit": "stickers", "value": 17}}], "operations": [{"actor": "Yara", "kind": "subtract", "operand": {"unit": "stickers", "value": 14}}, {"actor": "Yara", "kind": "divide", "operand": {"unit": "stickers", "value": 3}}], "unknown": {"entity": null, "unit": "stickers"}}, "patterns": ["initial_has", "operation_divide", "operation_subtract", "question_how_many_total"], "notes": "Original authored case of depth 2 exercising ['subtract', 'divide'] operations.", "id": "gma-127"}
{"problem": "Tom has 36 buttons. Then he donates 6. Tom donates 22. How many buttons does Tom have altogether?", "expected_answer": 8, "expected_unit": "buttons", "ground_truth_graph": {"entities": ["Tom"], "initial_state": [{"entity": "Tom", "quantity": {"unit": "buttons", "value": 36}}], "operations": [{"actor": "Tom", "kind": "subtract", "operand": {"unit": "buttons", "value": 6}}, {"actor": "Tom", "kind": "subtract", "operand": {"unit": "buttons", "value": 22}}], "unknown": {"entity": "Tom", "unit": "buttons"}}, "patterns": ["initial_has", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['subtract', 'subtract'] operations.", "id": "gma-128"}
{"problem": "Hal has 28 kites. He splits his kites evenly into 2 groups. He sells 9. Hal earns 9 kites. How many kites does Hal have in total?", "expected_answer": 14, "expected_unit": "kites", "ground_truth_graph": {"entities": ["Hal"], "initial_state": [{"entity": "Hal", "quantity": {"unit": "kites", "value": 28}}], "operations": [{"actor": "Hal", "kind": "divide", "operand": {"unit": "kites", "value": 2}}, {"actor": "Hal", "kind": "subtract", "operand": {"unit": "kites", "value": 9}}, {"actor": "Hal", "kind": "add", "operand": {"unit": "kites", "value": 9}}], "unknown": {"entity": "Hal", "unit": "kites"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 3 exercising ['divide', 'subtract', 'subtract'] operations.", "id": "gma-129"}
{"problem": "Uma has 40 apples. Rina has 27 apples. Finn has 36 apples. Finn splits them evenly into 3 groups and keeps one group. Uma triples her apples. How many apples do they have left?", "expected_answer": 159, "expected_unit": "apples", "ground_truth_graph": {"entities": ["Uma", "Rina", "Finn"], "initial_state": [{"entity": "Uma", "quantity": {"unit": "apples", "value": 40}}, {"entity": "Rina", "quantity": {"unit": "apples", "value": 27}}, {"entity": "Finn", "quantity": {"unit": "apples", "value": 36}}], "operations": [{"actor": "Finn", "kind": "divide", "operand": {"unit": "apples", "value": 3}}, {"actor": "Uma", "kind": "multiply", "operand": {"unit": "apples", "value": 3}}], "unknown": {"entity": null, "unit": "apples"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "question_how_many_total"], "notes": "Original authored case of depth 2 exercising ['divide', 'multiply'] operations.", "id": "gma-130"}
{"problem": "Rina has 33 crayons. Owen has 27 crayons. Nori has 33 crayons. Lisa has 17 crayons. Tara has 28 crayons. Nori receives 14 crayons. She drops 34. How many crayons does Nori have in total?", "expected_answer": 13, "expected_unit": "crayons", "ground_truth_graph": {"entities": ["Rina", "Owen", "Nori", "Lisa", "Tara"], "initial_state": [{"entity": "Rina", "quantity": {"unit": "crayons", "value": 33}}, {"entity": "Owen", "quantity": {"unit": "crayons", "value": 27}}, {"entity": "Nori", "quantity": {"unit": "crayons", "value": 33}}, {"entity": "Lisa", "quantity": {"unit": "crayons", "value": 17}}, {"entity": "Tara", "quantity": {"unit": "crayons", "value": 28}}], "operations": [{"actor": "Nori", "kind": "add", "operand": {"unit": "crayons", "value": 14}}, {"actor": "Nori", "kind": "subtract", "operand": {"unit": "crayons", "value": 34}}], "unknown": {"entity": "Nori", "unit": "crayons"}}, "patterns": ["initial_has", "operation_add", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['add', 'subtract'] operations.", "id": "gma-131"}
{"problem": "Tara has 13 pencils. Tara triples them. Then she receives 13 pencils. Tara eats 4 pencils. How many pencils does Tara have altogether?", "expected_answer": 48, "expected_unit": "pencils", "ground_truth_graph": {"entities": ["Tara"], "initial_state": [{"entity": "Tara", "quantity": {"unit": "pencils", "value": 13}}], "operations": [{"actor": "Tara", "kind": "multiply", "operand": {"unit": "pencils", "value": 3}}, {"actor": "Tara", "kind": "add", "operand": {"unit": "pencils", "value": 13}}, {"actor": "Tara", "kind": "subtract", "operand": {"unit": "pencils", "value": 4}}], "unknown": {"entity": "Tara", "unit": "pencils"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 3 exercising ['multiply', 'add', 'subtract'] operations.", "id": "gma-132"}
{"problem": "Anna has 30 pens. Anna doubles. She triples them. How many pens does Anna have altogether?", "expected_answer": 180, "expected_unit": "pens", "ground_truth_graph": {"entities": ["Anna"], "initial_state": [{"entity": "Anna", "quantity": {"unit": "pens", "value": 30}}], "operations": [{"actor": "Anna", "kind": "multiply", "operand": {"unit": "pens", "value": 2}}, {"actor": "Anna", "kind": "multiply", "operand": {"unit": "pens", "value": 3}}], "unknown": {"entity": "Anna", "unit": "pens"}}, "patterns": ["initial_has", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['multiply', 'multiply'] operations.", "id": "gma-133"}
{"problem": "Wren has 19 tickets. Dina has 11 tickets. Jade has 37 tickets. Gina has 39 tickets. Dina adds 6 tickets. Dina sends 8 to Gina. How many tickets does Jade have left?", "expected_answer": 37, "expected_unit": "tickets", "ground_truth_graph": {"entities": ["Wren", "Dina", "Jade", "Gina"], "initial_state": [{"entity": "Wren", "quantity": {"unit": "tickets", "value": 19}}, {"entity": "Dina", "quantity": {"unit": "tickets", "value": 11}}, {"entity": "Jade", "quantity": {"unit": "tickets", "value": 37}}, {"entity": "Gina", "quantity": {"unit": "tickets", "value": 39}}], "operations": [{"actor": "Dina", "kind": "add", "operand": {"unit": "tickets", "value": 6}}, {"actor": "Dina", "kind": "transfer", "operand": {"unit": "tickets", "value": 8}, "target": "Gina"}], "unknown": {"entity": "Jade", "unit": "tickets"}}, "patterns": ["initial_has", "operation_add", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['divide', 'transfer'] operations.", "id": "gma-134"}
{"problem": "Elle has 12 kites. Clara has 11 kites. Ivan has 37 kites. Elle buys 5 more kites. Ivan triples his kites. Ivan adds 3 kites. How many kites does Elle have in total?", "expected_answer": 17, "expected_unit": "kites", "ground_truth_graph": {"entities": ["Elle", "Clara", "Ivan"], "initial_state": [{"entity": "Elle", "quantity": {"unit": "kites", "value": 12}}, {"entity": "Clara", "quantity": {"unit": "kites", "value": 11}}, {"entity": "Ivan", "quantity": {"unit": "kites", "value": 37}}], "operations": [{"actor": "Elle", "kind": "add", "operand": {"unit": "kites", "value": 5}}, {"actor": "Ivan", "kind": "multiply", "operand": {"unit": "kites", "value": 3}}, {"actor": "Ivan", "kind": "add", "operand": {"unit": "kites", "value": 3}}], "unknown": {"entity": "Elle", "unit": "kites"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 3 exercising ['add', 'multiply', 'add'] operations.", "id": "gma-135"}
{"problem": "Paz has 38 shells. She drops 6 shells. Then she splits her shells evenly into 2 groups and keeps one group. Paz removes 2 shells. How many shells does Paz have altogether?", "expected_answer": 14, "expected_unit": "shells", "ground_truth_graph": {"entities": ["Paz"], "initial_state": [{"entity": "Paz", "quantity": {"unit": "shells", "value": 38}}], "operations": [{"actor": "Paz", "kind": "subtract", "operand": {"unit": "shells", "value": 6}}, {"actor": "Paz", "kind": "divide", "operand": {"unit": "shells", "value": 2}}, {"actor": "Paz", "kind": "subtract", "operand": {"unit": "shells", "value": 2}}], "unknown": {"entity": "Paz", "unit": "shells"}}, "patterns": ["initial_has", "operation_divide", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 3 exercising ['subtract', 'divide', 'subtract'] operations.", "id": "gma-136"}
{"problem": "Wren has 26 pens. Lena has 26 pens. Wren mails 14 pens to Lena. Wren buys 3 more pens. Lena splits them evenly into 4 groups. How many pens does Wren have altogether?", "expected_answer": 15, "expected_unit": "pens", "ground_truth_graph": {"entities": ["Wren", "Lena"], "initial_state": [{"entity": "Wren", "quantity": {"unit": "pens", "value": 26}}, {"entity": "Lena", "quantity": {"unit": "pens", "value": 26}}], "operations": [{"actor": "Wren", "kind": "transfer", "operand": {"unit": "pens", "value": 14}, "target": "Lena"}, {"actor": "Wren", "kind": "add", "operand": {"unit": "pens", "value": 3}}, {"actor": "Lena", "kind": "divide", "operand": {"unit": "pens", "value": 4}}], "unknown": {"entity": "Wren", "unit": "pens"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 3 exercising ['transfer', 'add', 'divide'] operations.", "id": "gma-137"}
{"problem": "Kai has 39 shells. Ina has 32 shells. Kai triples them. Kai drops 60 shells. He doubles his shells. How many shells does Kai have left?", "expected_answer": 114, "expected_unit": "shells", "ground_truth_graph": {"entities": ["Kai", "Ina"], "initial_state": [{"entity": "Kai", "quantity": {"unit": "shells", "value": 39}}, {"entity": "Ina", "quantity": {"unit": "shells", "value": 32}}], "operations": [{"actor": "Kai", "kind": "multiply", "operand": {"unit": "shells", "value": 3}}, {"actor": "Kai", "kind": "subtract", "operand": {"unit": "shells", "value": 60}}, {"actor": "Kai", "kind": "multiply", "operand": {"unit": "shells", "value": 2}}], "unknown": {"entity": "Kai", "unit": "shells"}}, "patterns": ["initial_has", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 3 exercising ['multiply', 'subtract', 'multiply'] operations.", "id": "gma-138"}
{"problem": "Clara has 24 dollars. Ruth has 34 dollars. Lux has 21 dollars. Gina has 25 dollars. Sam has 18 dollars. Sam spends 16. Lux gets 6 more. How many dollars does Clara have left?", "expected_answer": 24, "expected_unit": "dollars", "ground_truth_graph": {"entities": ["Clara", "Ruth", "Lux", "Gina", "Sam"], "initial_state": [{"entity": "Clara", "quantity": {"unit": "dollars", "value": 24}}, {"entity": "Ruth", "quantity": {"unit": "dollars", "value": 34}}, {"entity": "Lux", "quantity": {"unit": "dollars", "value": 21}}, {"entity": "Gina", "quantity": {"unit": "dollars", "value": 25}}, {"entity": "Sam", "quantity": {"unit": "dollars", "value": 18}}], "operations": [{"actor": "Sam", "kind": "subtract", "operand": {"unit": "dollars", "value": 16}}, {"actor": "Lux", "kind": "add", "operand": {"unit": "dollars", "value": 6}}], "unknown": {"entity": "Clara", "unit": "dollars"}}, "patterns": ["initial_has", "operation_add", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['subtract', 'add'] operations.", "id": "gma-139"}
{"problem": "Owen has 36 crayons. Lisa has 31 crayons. Leo has 39 crayons. Anna has 25 crayons. Lux has 16 crayons. Lisa sends 16 to Lux. Lisa gets 15 more. How many crayons does Anna have in total?", "expected_answer": 25, "expected_unit": "crayons", "ground_truth_graph": {"entities": ["Owen", "Lisa", "Leo", "Anna", "Lux"], "initial_state": [{"entity": "Owen", "quantity": {"unit": "crayons", "value": 36}}, {"entity": "Lisa", "quantity": {"unit": "crayons", "value": 31}}, {"entity": "Leo", "quantity": {"unit": "crayons", "value": 39}}, {"entity": "Anna", "quantity": {"unit": "crayons", "value": 25}}, {"entity": "Lux", "quantity": {"unit": "crayons", "value": 16}}], "operations": [{"actor": "Lisa", "kind": "transfer", "operand": {"unit": "crayons", "value": 16}, "target": "Lux"}, {"actor": "Lisa", "kind": "add", "operand": {"unit": "crayons", "value": 15}}], "unknown": {"entity": "Anna", "unit": "crayons"}}, "patterns": ["initial_has", "operation_add", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['transfer', 'add'] operations.", "id": "gma-140"}
{"problem": "Sara has 32 dollars. Sara earns 15 dollars. She uses 21 dollars. How many dollars does Sara have left?", "expected_answer": 26, "expected_unit": "dollars", "ground_truth_graph": {"entities": ["Sara"], "initial_state": [{"entity": "Sara", "quantity": {"unit": "dollars", "value": 32}}], "operations": [{"actor": "Sara", "kind": "add", "operand": {"unit": "dollars", "value": 15}}, {"actor": "Sara", "kind": "subtract", "operand": {"unit": "dollars", "value": 21}}], "unknown": {"entity": "Sara", "unit": "dollars"}}, "patterns": ["initial_has", "operation_add", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['add', 'subtract'] operations.", "id": "gma-141"}
{"problem": "Bryn has 35 cups. Lisa has 14 cups. She splits them evenly into 2 groups. Bryn doubles. Then she triples them. How many cups do they have?", "expected_answer": 217, "expected_unit": "cups", "ground_truth_graph": {"entities": ["Bryn", "Lisa"], "initial_state": [{"entity": "Bryn", "quantity": {"unit": "cups", "value": 35}}, {"entity": "Lisa", "quantity": {"unit": "cups", "value": 14}}], "operations": [{"actor": "Lisa", "kind": "divide", "operand": {"unit": "cups", "value": 2}}, {"actor": "Bryn", "kind": "multiply", "operand": {"unit": "cups", "value": 2}}, {"actor": "Bryn", "kind": "multiply", "operand": {"unit": "cups", "value": 3}}], "unknown": {"entity": null, "unit": "cups"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "question_how_many_total"], "notes": "Original authored case of depth 3 exercising ['divide', 'multiply', 'multiply'] operations.", "id": "gma-142"}
{"problem": "Uma has 14 crayons. Aria has 30 crayons. Anna has 21 crayons. Elle has 14 crayons. Blake has 36 crayons. Elle drops 5 crayons. Blake adds 11 crayons. Anna splits them evenly into 3 groups and keeps one group. How many crayons do they have left?", "expected_answer": 107, "expected_unit": "crayons", "ground_truth_graph": {"entities": ["Uma", "Aria", "Anna", "Elle", "Blake"], "initial_state": [{"entity": "Uma", "quantity": {"unit": "crayons", "value": 14}}, {"entity": "Aria", "quantity": {"unit": "crayons", "value": 30}}, {"entity": "Anna", "quantity": {"unit": "crayons", "value": 21}}, {"entity": "Elle", "quantity": {"unit": "crayons", "value": 14}}, {"entity": "Blake", "quantity": {"unit": "crayons", "value": 36}}], "operations": [{"actor": "Elle", "kind": "subtract", "operand": {"unit": "crayons", "value": 5}}, {"actor": "Blake", "kind": "add", "operand": {"unit": "crayons", "value": 11}}, {"actor": "Anna", "kind": "divide", "operand": {"unit": "crayons", "value": 3}}], "unknown": {"entity": null, "unit": "crayons"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_subtract", "question_how_many_total"], "notes": "Original authored case of depth 3 exercising ['subtract', 'add', 'divide'] operations.", "id": "gma-143"}
{"problem": "Seth has 22 books. Seth splits them evenly into 2 groups. Seth eats 5 books. Seth splits them evenly into 3 groups. How many books does Seth have left?", "expected_answer": 2, "expected_unit": "books", "ground_truth_graph": {"entities": ["Seth"], "initial_state": [{"entity": "Seth", "quantity": {"unit": "books", "value": 22}}], "operations": [{"actor": "Seth", "kind": "divide", "operand": {"unit": "books", "value": 2}}, {"actor": "Seth", "kind": "subtract", "operand": {"unit": "books", "value": 5}}, {"actor": "Seth", "kind": "divide", "operand": {"unit": "books", "value": 3}}], "unknown": {"entity": "Seth", "unit": "books"}}, "patterns": ["initial_has", "operation_divide", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 3 exercising ['divide', 'subtract', 'divide'] operations.", "id": "gma-144"}
{"problem": "Cora has 22 balls. Jay has 32 balls. Peter has 32 balls. Peter splits his balls evenly into 2 groups and keeps one group. Cora doubles her balls. How many balls does Jay have in total?", "expected_answer": 32, "expected_unit": "balls", "ground_truth_graph": {"entities": ["Cora", "Jay", "Peter"], "initial_state": [{"entity": "Cora", "quantity": {"unit": "balls", "value": 22}}, {"entity": "Jay", "quantity": {"unit": "balls", "value": 32}}, {"entity": "Peter", "quantity": {"unit": "balls", "value": 32}}], "operations": [{"actor": "Peter", "kind": "divide", "operand": {"unit": "balls", "value": 2}}, {"actor": "Cora", "kind": "multiply", "operand": {"unit": "balls", "value": 2}}], "unknown": {"entity": "Jay", "unit": "balls"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['divide', 'multiply'] operations.", "id": "gma-145"}
{"problem": "Quinn has 35 stickers. Gwen has 38 stickers. Blake has 11 stickers. He passes 9 to Gwen. Gwen uses 9. Gwen splits them evenly into 2 groups and keeps one group. How many stickers do they have left?", "expected_answer": 56, "expected_unit": "stickers", "ground_truth_graph": {"entities": ["Quinn", "Gwen", "Blake"], "initial_state": [{"entity": "Quinn", "quantity": {"unit": "stickers", "value": 35}}, {"entity": "Gwen", "quantity": {"unit": "stickers", "value": 38}}, {"entity": "Blake", "quantity": {"unit": "stickers", "value": 11}}], "operations": [{"actor": "Blake", "kind": "transfer", "operand": {"unit": "stickers", "value": 9}, "target": "Gwen"}, {"actor": "Gwen", "kind": "subtract", "operand": {"unit": "stickers", "value": 9}}, {"actor": "Gwen", "kind": "divide", "operand": {"unit": "stickers", "value": 2}}], "unknown": {"entity": null, "unit": "stickers"}}, "patterns": ["initial_has", "operation_divide", "operation_subtract", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 3 exercising ['transfer', 'subtract', 'divide'] operations.", "id": "gma-146"}
{"problem": "Seth has 15 pencils. Tom has 13 pencils. Jade has 22 pencils. Blake has 17 pencils. Rina has 40 pencils. Seth receives 11 pencils. Blake doubles his pencils. How many pencils do they have altogether?", "expected_answer": 135, "expected_unit": "pencils", "ground_truth_graph": {"entities": ["Seth", "Tom", "Jade", "Blake", "Rina"], "initial_state": [{"entity": "Seth", "quantity": {"unit": "pencils", "value": 15}}, {"entity": "Tom", "quantity": {"unit": "pencils", "value": 13}}, {"entity": "Jade", "quantity": {"unit": "pencils", "value": 22}}, {"entity": "Blake", "quantity": {"unit": "pencils", "value": 17}}, {"entity": "Rina", "quantity": {"unit": "pencils", "value": 40}}], "operations": [{"actor": "Seth", "kind": "add", "operand": {"unit": "pencils", "value": 11}}, {"actor": "Blake", "kind": "multiply", "operand": {"unit": "pencils", "value": 2}}], "unknown": {"entity": null, "unit": "pencils"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "question_how_many_total"], "notes": "Original authored case of depth 2 exercising ['add', 'multiply'] operations.", "id": "gma-147"}
{"problem": "Quinn has 32 tickets. Hal has 29 tickets. Ina has 18 tickets. Then she donates 1. Hal sends 2 to Quinn. Ina removes 9. How many tickets do they have in total?", "expected_answer": 69, "expected_unit": "tickets", "ground_truth_graph": {"entities": ["Quinn", "Hal", "Ina"], "initial_state": [{"entity": "Quinn", "quantity": {"unit": "tickets", "value": 32}}, {"entity": "Hal", "quantity": {"unit": "tickets", "value": 29}}, {"entity": "Ina", "quantity": {"unit": "tickets", "value": 18}}], "operations": [{"actor": "Ina", "kind": "subtract", "operand": {"unit": "tickets", "value": 1}}, {"actor": "Hal", "kind": "transfer", "operand": {"unit": "tickets", "value": 2}, "target": "Quinn"}, {"actor": "Ina", "kind": "subtract", "operand": {"unit": "tickets", "value": 9}}], "unknown": {"entity": null, "unit": "tickets"}}, "patterns": ["initial_has", "operation_subtract", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 3 exercising ['subtract', 'transfer', 'subtract'] operations.", "id": "gma-148"}
{"problem": "Tom has 36 pencils. He splits his pencils evenly into 3 groups and keeps one group. Tom gets 12 more. Tom removes 7. How many pencils does Tom have now?", "expected_answer": 17, "expected_unit": "pencils", "ground_truth_graph": {"entities": ["Tom"], "initial_state": [{"entity": "Tom", "quantity": {"unit": "pencils", "value": 36}}], "operations": [{"actor": "Tom", "kind": "divide", "operand": {"unit": "pencils", "value": 3}}, {"actor": "Tom", "kind": "add", "operand": {"unit": "pencils", "value": 12}}, {"actor": "Tom", "kind": "subtract", "operand": {"unit": "pencils", "value": 7}}], "unknown": {"entity": "Tom", "unit": "pencils"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 3 exercising ['divide', 'add', 'subtract'] operations.", "id": "gma-149"}
{"problem": "Zane has 27 candies. Pia has 15 candies. She splits them evenly into 3 groups and keeps one group. Pia adds 9 candies. How many candies does Zane have left?", "expected_answer": 27, "expected_unit": "candies", "ground_truth_graph": {"entities": ["Zane", "Pia"], "initial_state": [{"entity": "Zane", "quantity": {"unit": "candies", "value": 27}}, {"entity": "Pia", "quantity": {"unit": "candies", "value": 15}}], "operations": [{"actor": "Pia", "kind": "divide", "operand": {"unit": "candies", "value": 3}}, {"actor": "Pia", "kind": "add", "operand": {"unit": "candies", "value": 9}}], "unknown": {"entity": "Zane", "unit": "candies"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['divide', 'subtract'] operations.", "id": "gma-150"}
{"problem": "Lisa has 40 blocks. Ina has 24 blocks. Mila has 31 blocks. Then she receives 12 blocks. Lisa sends 19 to Ina. Lisa sends 3 blocks to Mila. How many blocks does Mila have left?", "expected_answer": 46, "expected_unit": "blocks", "ground_truth_graph": {"entities": ["Lisa", "Ina", "Mila"], "initial_state": [{"entity": "Lisa", "quantity": {"unit": "blocks", "value": 40}}, {"entity": "Ina", "quantity": {"unit": "blocks", "value": 24}}, {"entity": "Mila", "quantity": {"unit": "blocks", "value": 31}}], "operations": [{"actor": "Mila", "kind": "add", "operand": {"unit": "blocks", "value": 12}}, {"actor": "Lisa", "kind": "transfer", "operand": {"unit": "blocks", "value": 19}, "target": "Ina"}, {"actor": "Lisa", "kind": "transfer", "operand": {"unit": "blocks", "value": 3}, "target": "Mila"}], "unknown": {"entity": "Mila", "unit": "blocks"}}, "patterns": ["initial_has", "operation_add", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 3 exercising ['add', 'transfer', 'transfer'] operations.", "id": "gma-151"}
{"problem": "Sara has 21 apples. Ivan has 17 apples. Tara has 21 apples. Sara splits them evenly into 3 groups. Ivan removes 7 apples. Ivan doubles. How many apples does Ivan have now?", "expected_answer": 20, "expected_unit": "apples", "ground_truth_graph": {"entities": ["Sara", "Ivan", "Tara"], "initial_state": [{"entity": "Sara", "quantity": {"unit": "apples", "value": 21}}, {"entity": "Ivan", "quantity": {"unit": "apples", "value": 17}}, {"entity": "Tara", "quantity": {"unit": "apples", "value": 21}}], "operations": [{"actor": "Sara", "kind": "divide", "operand": {"unit": "apples", "value": 3}}, {"actor": "Ivan", "kind": "subtract", "operand": {"unit": "apples", "value": 7}}, {"actor": "Ivan", "kind": "multiply", "operand": {"unit": "apples", "value": 2}}], "unknown": {"entity": "Ivan", "unit": "apples"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 3 exercising ['divide', 'subtract', 'multiply'] operations.", "id": "gma-152"}
{"problem": "Pia has 13 ribbons. Quinn has 21 ribbons. Finn has 31 ribbons. Oren has 25 ribbons. Finn donates 22. Quinn triples. How many ribbons does Quinn have in total?", "expected_answer": 63, "expected_unit": "ribbons", "ground_truth_graph": {"entities": ["Pia", "Quinn", "Finn", "Oren"], "initial_state": [{"entity": "Pia", "quantity": {"unit": "ribbons", "value": 13}}, {"entity": "Quinn", "quantity": {"unit": "ribbons", "value": 21}}, {"entity": "Finn", "quantity": {"unit": "ribbons", "value": 31}}, {"entity": "Oren", "quantity": {"unit": "ribbons", "value": 25}}], "operations": [{"actor": "Finn", "kind": "subtract", "operand": {"unit": "ribbons", "value": 22}}, {"actor": "Quinn", "kind": "multiply", "operand": {"unit": "ribbons", "value": 3}}], "unknown": {"entity": "Quinn", "unit": "ribbons"}}, "patterns": ["initial_has", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['subtract', 'multiply'] operations.", "id": "gma-153"}
{"problem": "Gina has 14 sheets. She eats 10 sheets. Gina earns 6 sheets. How many sheets does Gina have now?", "expected_answer": 10, "expected_unit": "sheets", "ground_truth_graph": {"entities": ["Gina"], "initial_state": [{"entity": "Gina", "quantity": {"unit": "sheets", "value": 14}}], "operations": [{"actor": "Gina", "kind": "subtract", "operand": {"unit": "sheets", "value": 10}}, {"actor": "Gina", "kind": "add", "operand": {"unit": "sheets", "value": 6}}], "unknown": {"entity": "Gina", "unit": "sheets"}}, "patterns": ["initial_has", "operation_add", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['subtract', 'subtract'] operations.", "id": "gma-154"}
{"problem": "Sam has 28 shells. Yara has 33 shells. Gwen has 24 shells. Ben has 39 shells. Yara gets 6 more shells. Ben receives 5 shells. He splits his shells evenly into 4 groups and keeps one group. How many shells does Yara have left?", "expected_answer": 39, "expected_unit": "shells", "ground_truth_graph": {"entities": ["Sam", "Yara", "Gwen", "Ben"], "initial_state": [{"entity": "Sam", "quantity": {"unit": "shells", "value": 28}}, {"entity": "Yara", "quantity": {"unit": "shells", "value": 33}}, {"entity": "Gwen", "quantity": {"unit": "shells", "value": 24}}, {"entity": "Ben", "quantity": {"unit": "shells", "value": 39}}], "operations": [{"actor": "Yara", "kind": "add", "operand": {"unit": "shells", "value": 6}}, {"actor": "Ben", "kind": "add", "operand": {"unit": "shells", "value": 5}}, {"actor": "Ben", "kind": "divide", "operand": {"unit": "shells", "value": 4}}], "unknown": {"entity": "Yara", "unit": "shells"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "question_how_many_entity"], "notes": "Original authored case of depth 3 exercising ['add', 'add', 'divide'] operations.", "id": "gma-155"}
{"problem": "Finn has 21 letters. He doubles. Finn loses 4 letters. Then he doubles. How many letters does Finn have now?", "expected_answer": 76, "expected_unit": "letters", "ground_truth_graph": {"entities": ["Finn"], "initial_state": [{"entity": "Finn", "quantity": {"unit": "letters", "value": 21}}], "operations": [{"actor": "Finn", "kind": "multiply", "operand": {"unit": "letters", "value": 2}}, {"actor": "Finn", "kind": "subtract", "operand": {"unit": "letters", "value": 4}}, {"actor": "Finn", "kind": "multiply", "operand": {"unit": "letters", "value": 2}}], "unknown": {"entity": "Finn", "unit": "letters"}}, "patterns": ["initial_has", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 3 exercising ['multiply', 'subtract', 'multiply'] operations.", "id": "gma-156"}
{"problem": "Finn has 40 scarves. He finds 7 scarves. He eats 1 scarves. Finn finds 9 scarves. How many scarves does Finn have?", "expected_answer": 55, "expected_unit": "scarves", "ground_truth_graph": {"entities": ["Finn"], "initial_state": [{"entity": "Finn", "quantity": {"unit": "scarves", "value": 40}}], "operations": [{"actor": "Finn", "kind": "add", "operand": {"unit": "scarves", "value": 7}}, {"actor": "Finn", "kind": "subtract", "operand": {"unit": "scarves", "value": 1}}, {"actor": "Finn", "kind": "add", "operand": {"unit": "scarves", "value": 9}}], "unknown": {"entity": "Finn", "unit": "scarves"}}, "patterns": ["initial_has", "operation_add", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 3 exercising ['add', 'subtract', 'add'] operations.", "id": "gma-157"}
{"problem": "Aria has 13 stamps. Mila has 10 stamps. Owen has 20 stamps. Ivan has 40 stamps. Ruth has 29 stamps. Ivan gives 17 stamps to Aria. Ruth gets 9 more stamps. How many stamps do they have in total?", "expected_answer": 121, "expected_unit": "stamps", "ground_truth_graph": {"entities": ["Aria", "Mila", "Owen", "Ivan", "Ruth"], "initial_state": [{"entity": "Aria", "quantity": {"unit": "stamps", "value": 13}}, {"entity": "Mila", "quantity": {"unit": "stamps", "value": 10}}, {"entity": "Owen", "quantity": {"unit": "stamps", "value": 20}}, {"entity": "Ivan", "quantity": {"unit": "stamps", "value": 40}}, {"entity": "Ruth", "quantity": {"unit": "stamps", "value": 29}}], "operations": [{"actor": "Ivan", "kind": "transfer", "operand": {"unit": "stamps", "value": 17}, "target": "Aria"}, {"actor": "Ruth", "kind": "add", "operand": {"unit": "stamps", "value": 9}}], "unknown": {"entity": null, "unit": "stamps"}}, "patterns": ["initial_has", "operation_add", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 2 exercising ['transfer', 'add'] operations.", "id": "gma-158"}
{"problem": "Gwen has 30 dollars. She drops 7. Then she loses 15 dollars. How many dollars does Gwen have?", "expected_answer": 8, "expected_unit": "dollars", "ground_truth_graph": {"entities": ["Gwen"], "initial_state": [{"entity": "Gwen", "quantity": {"unit": "dollars", "value": 30}}], "operations": [{"actor": "Gwen", "kind": "subtract", "operand": {"unit": "dollars", "value": 7}}, {"actor": "Gwen", "kind": "subtract", "operand": {"unit": "dollars", "value": 15}}], "unknown": {"entity": "Gwen", "unit": "dollars"}}, "patterns": ["initial_has", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['subtract', 'subtract'] operations.", "id": "gma-159"}
{"problem": "Jay has 10 tickets. Then he splits them evenly into 2 groups. He buys 12 more tickets. How many tickets does Jay have?", "expected_answer": 17, "expected_unit": "tickets", "ground_truth_graph": {"entities": ["Jay"], "initial_state": [{"entity": "Jay", "quantity": {"unit": "tickets", "value": 10}}], "operations": [{"actor": "Jay", "kind": "divide", "operand": {"unit": "tickets", "value": 2}}, {"actor": "Jay", "kind": "add", "operand": {"unit": "tickets", "value": 12}}], "unknown": {"entity": "Jay", "unit": "tickets"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "question_how_many_entity"], "notes": "Original authored case of depth 2 exercising ['divide', 'add'] operations.", "id": "gma-160"}
{"problem": "Paz has 25 marbles. Then she buys 10 more marbles. She doubles her marbles. Paz buys 14 more marbles. Then she doubles. Paz splits her marbles evenly into 2 groups and keeps one group. How many marbles does Paz have in total?", "expected_answer": 84, "expected_unit": "marbles", "ground_truth_graph": {"entities": ["Paz"], "initial_state": [{"entity": "Paz", "quantity": {"unit": "marbles", "value": 25}}], "operations": [{"actor": "Paz", "kind": "add", "operand": {"unit": "marbles", "value": 10}}, {"actor": "Paz", "kind": "multiply", "operand": {"unit": "marbles", "value": 2}}, {"actor": "Paz", "kind": "add", "operand": {"unit": "marbles", "value": 14}}, {"actor": "Paz", "kind": "multiply", "operand": {"unit": "marbles", "value": 2}}, {"actor": "Paz", "kind": "divide", "operand": {"unit": "marbles", "value": 2}}], "unknown": {"entity": "Paz", "unit": "marbles"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['add', 'multiply', 'add', 'multiply', 'divide'] operations.", "id": "gma-161"}
{"problem": "Nia has 24 stones. She sells 15 stones. She splits her stones evenly into 3 groups. Nia splits them evenly into 3 groups and keeps one group. Then she triples her stones. Nia earns 8 stones. How many stones does Nia have?", "expected_answer": 11, "expected_unit": "stones", "ground_truth_graph": {"entities": ["Nia"], "initial_state": [{"entity": "Nia", "quantity": {"unit": "stones", "value": 24}}], "operations": [{"actor": "Nia", "kind": "subtract", "operand": {"unit": "stones", "value": 15}}, {"actor": "Nia", "kind": "divide", "operand": {"unit": "stones", "value": 3}}, {"actor": "Nia", "kind": "divide", "operand": {"unit": "stones", "value": 3}}, {"actor": "Nia", "kind": "multiply", "operand": {"unit": "stones", "value": 3}}, {"actor": "Nia", "kind": "add", "operand": {"unit": "stones", "value": 8}}], "unknown": {"entity": "Nia", "unit": "stones"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['subtract', 'divide', 'divide', 'divide', 'subtract'] operations.", "id": "gma-162"}
{"problem": "Ruth has 24 balls. Ruth buys 8 more balls. She triples her balls. She buys 5 more balls. She adds 11 balls. How many balls does Ruth have altogether?", "expected_answer": 112, "expected_unit": "balls", "ground_truth_graph": {"entities": ["Ruth"], "initial_state": [{"entity": "Ruth", "quantity": {"unit": "balls", "value": 24}}], "operations": [{"actor": "Ruth", "kind": "add", "operand": {"unit": "balls", "value": 8}}, {"actor": "Ruth", "kind": "multiply", "operand": {"unit": "balls", "value": 3}}, {"actor": "Ruth", "kind": "add", "operand": {"unit": "balls", "value": 5}}, {"actor": "Ruth", "kind": "add", "operand": {"unit": "balls", "value": 11}}], "unknown": {"entity": "Ruth", "unit": "balls"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['add', 'multiply', 'add', 'add'] operations.", "id": "gma-163"}
{"problem": "Drew has 10 kites. Seth has 29 kites. Ruth has 19 kites. Seth eats 1 kites. Ruth finds 11 kites. Drew mails 5 to Ruth. Ruth triples her kites. How many kites does Ruth have in total?", "expected_answer": 105, "expected_unit": "kites", "ground_truth_graph": {"entities": ["Drew", "Seth", "Ruth"], "initial_state": [{"entity": "Drew", "quantity": {"unit": "kites", "value": 10}}, {"entity": "Seth", "quantity": {"unit": "kites", "value": 29}}, {"entity": "Ruth", "quantity": {"unit": "kites", "value": 19}}], "operations": [{"actor": "Seth", "kind": "subtract", "operand": {"unit": "kites", "value": 1}}, {"actor": "Ruth", "kind": "add", "operand": {"unit": "kites", "value": 11}}, {"actor": "Drew", "kind": "transfer", "operand": {"unit": "kites", "value": 5}, "target": "Ruth"}, {"actor": "Ruth", "kind": "multiply", "operand": {"unit": "kites", "value": 3}}], "unknown": {"entity": "Ruth", "unit": "kites"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['subtract', 'add', 'transfer', 'multiply'] operations.", "id": "gma-164"}
{"problem": "Lena has 27 dollars. Gina has 34 dollars. Rina has 16 dollars. Nori has 26 dollars. Hal has 34 dollars. Nori splits them evenly into 2 groups and keeps one group. Rina splits her dollars evenly into 2 groups and keeps one group. Rina gets 13 more dollars. Nori mails 7 dollars to Gina. Hal doubles them. How many dollars does Nori have in total?", "expected_answer": 6, "expected_unit": "dollars", "ground_truth_graph": {"entities": ["Lena", "Gina", "Rina", "Nori", "Hal"], "initial_state": [{"entity": "Lena", "quantity": {"unit": "dollars", "value": 27}}, {"entity": "Gina", "quantity": {"unit": "dollars", "value": 34}}, {"entity": "Rina", "quantity": {"unit": "dollars", "value": 16}}, {"entity": "Nori", "quantity": {"unit": "dollars", "value": 26}}, {"entity": "Hal", "quantity": {"unit": "dollars", "value": 34}}], "operations": [{"actor": "Nori", "kind": "divide", "operand": {"unit": "dollars", "value": 2}}, {"actor": "Rina", "kind": "divide", "operand": {"unit": "dollars", "value": 2}}, {"actor": "Rina", "kind": "add", "operand": {"unit": "dollars", "value": 13}}, {"actor": "Nori", "kind": "transfer", "operand": {"unit": "dollars", "value": 7}, "target": "Gina"}, {"actor": "Hal", "kind": "multiply", "operand": {"unit": "dollars", "value": 2}}], "unknown": {"entity": "Nori", "unit": "dollars"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['divide', 'divide', 'add', 'transfer', 'multiply'] operations.", "id": "gma-165"}
{"problem": "Owen has 24 pencils. Noah has 30 pencils. Jay has 38 pencils. Owen triples his pencils. Jay mails 35 pencils to Noah. Noah adds 14 pencils. He mails 36 pencils to Owen. He hands 23 pencils to Owen. How many pencils does Noah have altogether?", "expected_answer": 20, "expected_unit": "pencils", "ground_truth_graph": {"entities": ["Owen", "Noah", "Jay"], "initial_state": [{"entity": "Owen", "quantity": {"unit": "pencils", "value": 24}}, {"entity": "Noah", "quantity": {"unit": "pencils", "value": 30}}, {"entity": "Jay", "quantity": {"unit": "pencils", "value": 38}}], "operations": [{"actor": "Owen", "kind": "multiply", "operand": {"unit": "pencils", "value": 3}}, {"actor": "Jay", "kind": "transfer", "operand": {"unit": "pencils", "value": 35}, "target": "Noah"}, {"actor": "Noah", "kind": "add", "operand": {"unit": "pencils", "value": 14}}, {"actor": "Noah", "kind": "transfer", "operand": {"unit": "pencils", "value": 36}, "target": "Owen"}, {"actor": "Noah", "kind": "transfer", "operand": {"unit": "pencils", "value": 23}, "target": "Owen"}], "unknown": {"entity": "Noah", "unit": "pencils"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['multiply', 'transfer', 'add', 'transfer', 'transfer'] operations.", "id": "gma-166"}
{"problem": "Pia has 26 tickets. Owen has 23 tickets. Pia splits her tickets evenly into 2 groups and keeps one group. Owen passes 6 to Pia. Pia doubles them. Owen gets 5 more. He doubles his tickets. How many tickets does Pia have?", "expected_answer": 38, "expected_unit": "tickets", "ground_truth_graph": {"entities": ["Pia", "Owen"], "initial_state": [{"entity": "Pia", "quantity": {"unit": "tickets", "value": 26}}, {"entity": "Owen", "quantity": {"unit": "tickets", "value": 23}}], "operations": [{"actor": "Pia", "kind": "divide", "operand": {"unit": "tickets", "value": 2}}, {"actor": "Owen", "kind": "transfer", "operand": {"unit": "tickets", "value": 6}, "target": "Pia"}, {"actor": "Pia", "kind": "multiply", "operand": {"unit": "tickets", "value": 2}}, {"actor": "Owen", "kind": "add", "operand": {"unit": "tickets", "value": 5}}, {"actor": "Owen", "kind": "multiply", "operand": {"unit": "tickets", "value": 2}}], "unknown": {"entity": "Pia", "unit": "tickets"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['divide', 'transfer', 'multiply', 'add', 'multiply'] operations.", "id": "gma-167"}
{"problem": "Tom has 21 scarves. He earns 6 scarves. Tom sells 12 scarves. Tom doubles. Then he loses 25. He adds 8 scarves. How many scarves does Tom have altogether?", "expected_answer": 13, "expected_unit": "scarves", "ground_truth_graph": {"entities": ["Tom"], "initial_state": [{"entity": "Tom", "quantity": {"unit": "scarves", "value": 21}}], "operations": [{"actor": "Tom", "kind": "add", "operand": {"unit": "scarves", "value": 6}}, {"actor": "Tom", "kind": "subtract", "operand": {"unit": "scarves", "value": 12}}, {"actor": "Tom", "kind": "multiply", "operand": {"unit": "scarves", "value": 2}}, {"actor": "Tom", "kind": "subtract", "operand": {"unit": "scarves", "value": 25}}, {"actor": "Tom", "kind": "add", "operand": {"unit": "scarves", "value": 8}}], "unknown": {"entity": "Tom", "unit": "scarves"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['add', 'subtract', 'multiply', 'subtract', 'subtract'] operations.", "id": "gma-168"}
{"problem": "Ivan has 39 shells. He splits his shells evenly into 3 groups and keeps one group. Ivan loses 10 shells. Ivan splits them evenly into 3 groups. Then he buys 14 more shells. How many shells does Ivan have altogether?", "expected_answer": 15, "expected_unit": "shells", "ground_truth_graph": {"entities": ["Ivan"], "initial_state": [{"entity": "Ivan", "quantity": {"unit": "shells", "value": 39}}], "operations": [{"actor": "Ivan", "kind": "divide", "operand": {"unit": "shells", "value": 3}}, {"actor": "Ivan", "kind": "subtract", "operand": {"unit": "shells", "value": 10}}, {"actor": "Ivan", "kind": "divide", "operand": {"unit": "shells", "value": 3}}, {"actor": "Ivan", "kind": "add", "operand": {"unit": "shells", "value": 14}}], "unknown": {"entity": "Ivan", "unit": "shells"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['divide', 'subtract', 'divide', 'divide'] operations.", "id": "gma-169"}
{"problem": "Bryn has 25 blocks. Finn has 35 blocks. Lena has 15 blocks. Gina has 25 blocks. Blake has 20 blocks. Lena mails 10 to Gina. Gina splits her blocks evenly into 5 groups and keeps one group. Finn gets 12 more blocks. Blake gives 12 to Lena. Bryn hands 17 to Gina. How many blocks does Finn have altogether?", "expected_answer": 47, "expected_unit": "blocks", "ground_truth_graph": {"entities": ["Bryn", "Finn", "Lena", "Gina", "Blake"], "initial_state": [{"entity": "Bryn", "quantity": {"unit": "blocks", "value": 25}}, {"entity": "Finn", "quantity": {"unit": "blocks", "value": 35}}, {"entity": "Lena", "quantity": {"unit": "blocks", "value": 15}}, {"entity": "Gina", "quantity": {"unit": "blocks", "value": 25}}, {"entity": "Blake", "quantity": {"unit": "blocks", "value": 20}}], "operations": [{"actor": "Lena", "kind": "transfer", "operand": {"unit": "blocks", "value": 10}, "target": "Gina"}, {"actor": "Gina", "kind": "divide", "operand": {"unit": "blocks", "value": 5}}, {"actor": "Finn", "kind": "add", "operand": {"unit": "blocks", "value": 12}}, {"actor": "Blake", "kind": "transfer", "operand": {"unit": "blocks", "value": 12}, "target": "Lena"}, {"actor": "Bryn", "kind": "transfer", "operand": {"unit": "blocks", "value": 17}, "target": "Gina"}], "unknown": {"entity": "Finn", "unit": "blocks"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['transfer', 'divide', 'add', 'transfer', 'transfer'] operations.", "id": "gma-170"}
{"problem": "Yara has 38 coins. Jay has 27 coins. Lena has 14 coins. Yara doubles her coins. Then she mails 30 to Lena. Yara gets 14 more. Jay removes 12. How many coins does Lena have now?", "expected_answer": 44, "expected_unit": "coins", "ground_truth_graph": {"entities": ["Yara", "Jay", "Lena"], "initial_state": [{"entity": "Yara", "quantity": {"unit": "coins", "value": 38}}, {"entity": "Jay", "quantity": {"unit": "coins", "value": 27}}, {"entity": "Lena", "quantity": {"unit": "coins", "value": 14}}], "operations": [{"actor": "Yara", "kind": "multiply", "operand": {"unit": "coins", "value": 2}}, {"actor": "Yara", "kind": "transfer", "operand": {"unit": "coins", "value": 30}, "target": "Lena"}, {"actor": "Yara", "kind": "add", "operand": {"unit": "coins", "value": 14}}, {"actor": "Jay", "kind": "subtract", "operand": {"unit": "coins", "value": 12}}], "unknown": {"entity": "Lena", "unit": "coins"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['multiply', 'transfer', 'add', 'subtract'] operations.", "id": "gma-171"}
{"problem": "Nori has 29 shells. She eats 14. She removes 11 shells. Nori splits them evenly into 4 groups and keeps one group. Nori finds 14 shells. She spends 2. How many shells does Nori have now?", "expected_answer": 13, "expected_unit": "shells", "ground_truth_graph": {"entities": ["Nori"], "initial_state": [{"entity": "Nori", "quantity": {"unit": "shells", "value": 29}}], "operations": [{"actor": "Nori", "kind": "subtract", "operand": {"unit": "shells", "value": 14}}, {"actor": "Nori", "kind": "subtract", "operand": {"unit": "shells", "value": 11}}, {"actor": "Nori", "kind": "divide", "operand": {"unit": "shells", "value": 4}}, {"actor": "Nori", "kind": "add", "operand": {"unit": "shells", "value": 14}}, {"actor": "Nori", "kind": "subtract", "operand": {"unit": "shells", "value": 2}}], "unknown": {"entity": "Nori", "unit": "shells"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['subtract', 'subtract', 'divide', 'add', 'subtract'] operations.", "id": "gma-172"}
{"problem": "Yara has 16 ribbons. Seth has 17 ribbons. Yara triples. Yara finds 9 ribbons. Yara doubles. Then she splits them evenly into 2 groups and keeps one group. How many ribbons do they have in total?", "expected_answer": 74, "expected_unit": "ribbons", "ground_truth_graph": {"entities": ["Yara", "Seth"], "initial_state": [{"entity": "Yara", "quantity": {"unit": "ribbons", "value": 16}}, {"entity": "Seth", "quantity": {"unit": "ribbons", "value": 17}}], "operations": [{"actor": "Yara", "kind": "multiply", "operand": {"unit": "ribbons", "value": 3}}, {"actor": "Yara", "kind": "add", "operand": {"unit": "ribbons", "value": 9}}, {"actor": "Yara", "kind": "multiply", "operand": {"unit": "ribbons", "value": 2}}, {"actor": "Yara", "kind": "divide", "operand": {"unit": "ribbons", "value": 2}}], "unknown": {"entity": null, "unit": "ribbons"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "question_how_many_total"], "notes": "Original authored case of depth 4 exercising ['multiply', 'add', 'multiply', 'divide'] operations.", "id": "gma-173"}
{"problem": "Blake has 14 stamps. Blake splits them evenly into 2 groups. Blake receives 13 stamps. Blake splits his stamps evenly into 2 groups. Blake triples. How many stamps does Blake have?", "expected_answer": 30, "expected_unit": "stamps", "ground_truth_graph": {"entities": ["Blake"], "initial_state": [{"entity": "Blake", "quantity": {"unit": "stamps", "value": 14}}], "operations": [{"actor": "Blake", "kind": "divide", "operand": {"unit": "stamps", "value": 2}}, {"actor": "Blake", "kind": "add", "operand": {"unit": "stamps", "value": 13}}, {"actor": "Blake", "kind": "divide", "operand": {"unit": "stamps", "value": 2}}, {"actor": "Blake", "kind": "multiply", "operand": {"unit": "stamps", "value": 3}}], "unknown": {"entity": "Blake", "unit": "stamps"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['divide', 'add', 'divide', 'multiply'] operations.", "id": "gma-174"}
{"problem": "Finn has 19 letters. Hal has 26 letters. Then he gets 10 more. He splits his letters evenly into 3 groups and keeps one group. Finn receives 6 letters. Hal gives 6 letters to Finn. Finn receives 2 letters. How many letters do they have altogether?", "expected_answer": 39, "expected_unit": "letters", "ground_truth_graph": {"entities": ["Finn", "Hal"], "initial_state": [{"entity": "Finn", "quantity": {"unit": "letters", "value": 19}}, {"entity": "Hal", "quantity": {"unit": "letters", "value": 26}}], "operations": [{"actor": "Hal", "kind": "add", "operand": {"unit": "letters", "value": 10}}, {"actor": "Hal", "kind": "divide", "operand": {"unit": "letters", "value": 3}}, {"actor": "Finn", "kind": "add", "operand": {"unit": "letters", "value": 6}}, {"actor": "Hal", "kind": "transfer", "operand": {"unit": "letters", "value": 6}, "target": "Finn"}, {"actor": "Finn", "kind": "add", "operand": {"unit": "letters", "value": 2}}], "unknown": {"entity": null, "unit": "letters"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 5 exercising ['add', 'divide', 'divide', 'transfer', 'add'] operations.", "id": "gma-175"}
{"problem": "Lux has 23 stamps. Iris has 15 stamps. Lux buys 4 more. Lux loses 23 stamps. Lux triples. Lux sends 4 stamps to Iris. Lux doubles. How many stamps does Iris have?", "expected_answer": 19, "expected_unit": "stamps", "ground_truth_graph": {"entities": ["Lux", "Iris"], "initial_state": [{"entity": "Lux", "quantity": {"unit": "stamps", "value": 23}}, {"entity": "Iris", "quantity": {"unit": "stamps", "value": 15}}], "operations": [{"actor": "Lux", "kind": "add", "operand": {"unit": "stamps", "value": 4}}, {"actor": "Lux", "kind": "subtract", "operand": {"unit": "stamps", "value": 23}}, {"actor": "Lux", "kind": "multiply", "operand": {"unit": "stamps", "value": 3}}, {"actor": "Lux", "kind": "transfer", "operand": {"unit": "stamps", "value": 4}, "target": "Iris"}, {"actor": "Lux", "kind": "multiply", "operand": {"unit": "stamps", "value": 2}}], "unknown": {"entity": "Iris", "unit": "stamps"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['divide', 'subtract', 'multiply', 'transfer', 'multiply'] operations.", "id": "gma-176"}
{"problem": "Gwen has 27 marbles. Gina has 30 marbles. Hal has 22 marbles. Pia has 12 marbles. Nia has 33 marbles. Gina triples them. Pia loses 8. Nia mails 30 to Hal. Pia finds 12 marbles. How many marbles do they have?", "expected_answer": 188, "expected_unit": "marbles", "ground_truth_graph": {"entities": ["Gwen", "Gina", "Hal", "Pia", "Nia"], "initial_state": [{"entity": "Gwen", "quantity": {"unit": "marbles", "value": 27}}, {"entity": "Gina", "quantity": {"unit": "marbles", "value": 30}}, {"entity": "Hal", "quantity": {"unit": "marbles", "value": 22}}, {"entity": "Pia", "quantity": {"unit": "marbles", "value": 12}}, {"entity": "Nia", "quantity": {"unit": "marbles", "value": 33}}], "operations": [{"actor": "Gina", "kind": "multiply", "operand": {"unit": "marbles", "value": 3}}, {"actor": "Pia", "kind": "subtract", "operand": {"unit": "marbles", "value": 8}}, {"actor": "Nia", "kind": "transfer", "operand": {"unit": "marbles", "value": 30}, "target": "Hal"}, {"actor": "Pia", "kind": "add", "operand": {"unit": "marbles", "value": 12}}], "unknown": {"entity": null, "unit": "marbles"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 4 exercising ['multiply', 'subtract', 'transfer', 'add'] operations.", "id": "gma-177"}
{"problem": "Nori has 11 marbles. Nori receives 13 marbles. Nori drops 15 marbles. Then she doubles them. Then she finds 4 marbles. Nori splits her marbles evenly into 2 groups. How many marbles does Nori have?", "expected_answer": 11, "expected_unit": "marbles", "ground_truth_graph": {"entities": ["Nori"], "initial_state": [{"entity": "Nori", "quantity": {"unit": "marbles", "value": 11}}], "operations": [{"actor": "Nori", "kind": "add", "operand": {"unit": "marbles", "value": 13}}, {"actor": "Nori", "kind": "subtract", "operand": {"unit": "marbles", "value": 15}}, {"actor": "Nori", "kind": "multiply", "operand": {"unit": "marbles", "value": 2}}, {"actor": "Nori", "kind": "add", "operand": {"unit": "marbles", "value": 4}}, {"actor": "Nori", "kind": "divide", "operand": {"unit": "marbles", "value": 2}}], "unknown": {"entity": "Nori", "unit": "marbles"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['add', 'subtract', 'multiply', 'add', 'divide'] operations.", "id": "gma-178"}
{"problem": "Hal has 26 oranges. Then he sells 7. Hal doubles them. Hal gets 14 more. Then he buys 4 more. Then he doubles them. How many oranges does Hal have in total?", "expected_answer": 112, "expected_unit": "oranges", "ground_truth_graph": {"entities": ["Hal"], "initial_state": [{"entity": "Hal", "quantity": {"unit": "oranges", "value": 26}}], "operations": [{"actor": "Hal", "kind": "subtract", "operand": {"unit": "oranges", "value": 7}}, {"actor": "Hal", "kind": "multiply", "operand": {"unit": "oranges", "value": 2}}, {"actor": "Hal", "kind": "add", "operand": {"unit": "oranges", "value": 14}}, {"actor": "Hal", "kind": "add", "operand": {"unit": "oranges", "value": 4}}, {"actor": "Hal", "kind": "multiply", "operand": {"unit": "oranges", "value": 2}}], "unknown": {"entity": "Hal", "unit": "oranges"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['subtract', 'multiply', 'add', 'add', 'multiply'] operations.", "id": "gma-179"}
{"problem": "Tara has 21 dollars. Nia has 13 dollars. Sara has 22 dollars. Tara adds 6 dollars. Tara doubles. Then she splits them evenly into 3 groups and keeps one group. Nia eats 10. Then she receives 14 dollars. How many dollars does Nia have?", "expected_answer": 17, "expected_unit": "dollars", "ground_truth_graph": {"entities": ["Tara", "Nia", "Sara"], "initial_state": [{"entity": "Tara", "quantity": {"unit": "dollars", "value": 21}}, {"entity": "Nia", "quantity": {"unit": "dollars", "value": 13}}, {"entity": "Sara", "quantity": {"unit": "dollars", "value": 22}}], "operations": [{"actor": "Tara", "kind": "add", "operand": {"unit": "dollars", "value": 6}}, {"actor": "Tara", "kind": "multiply", "operand": {"unit": "dollars", "value": 2}}, {"actor": "Tara", "kind": "divide", "operand": {"unit": "dollars", "value": 3}}, {"actor": "Nia", "kind": "subtract", "operand": {"unit": "dollars", "value": 10}}, {"actor": "Nia", "kind": "add", "operand": {"unit": "dollars", "value": 14}}], "unknown": {"entity": "Nia", "unit": "dollars"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['add', 'multiply', 'divide', 'subtract', 'transfer'] operations.", "id": "gma-180"}
{"problem": "Aria has 27 stones. Aria splits her stones evenly into 3 groups. Aria triples. Aria sells 14. Aria doubles her stones. How many stones does Aria have left?", "expected_answer": 26, "expected_unit": "stones", "ground_truth_graph": {"entities": ["Aria"], "initial_state": [{"entity": "Aria", "quantity": {"unit": "stones", "value": 27}}], "operations": [{"actor": "Aria", "kind": "divide", "operand": {"unit": "stones", "value": 3}}, {"actor": "Aria", "kind": "multiply", "operand": {"unit": "stones", "value": 3}}, {"actor": "Aria", "kind": "subtract", "operand": {"unit": "stones", "value": 14}}, {"actor": "Aria", "kind": "multiply", "operand": {"unit": "stones", "value": 2}}], "unknown": {"entity": "Aria", "unit": "stones"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['divide', 'multiply', 'subtract', 'divide'] operations.", "id": "gma-181"}
{"problem": "Iris has 17 letters. Iris adds 15 letters. Iris buys 8 more letters. Then she doubles her letters. Iris buys 11 more. How many letters does Iris have altogether?", "expected_answer": 91, "expected_unit": "letters", "ground_truth_graph": {"entities": ["Iris"], "initial_state": [{"entity": "Iris", "quantity": {"unit": "letters", "value": 17}}], "operations": [{"actor": "Iris", "kind": "add", "operand": {"unit": "letters", "value": 15}}, {"actor": "Iris", "kind": "add", "operand": {"unit": "letters", "value": 8}}, {"actor": "Iris", "kind": "multiply", "operand": {"unit": "letters", "value": 2}}, {"actor": "Iris", "kind": "add", "operand": {"unit": "letters", "value": 11}}], "unknown": {"entity": "Iris", "unit": "letters"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['add', 'add', 'multiply', 'add'] operations.", "id": "gma-182"}
{"problem": "Hugo has 14 crayons. Hugo spends 1. Hugo adds 4 crayons. He buys 6 more. He triples his crayons. Then he doubles his crayons. How many crayons does Hugo have?", "expected_answer": 138, "expected_unit": "crayons", "ground_truth_graph": {"entities": ["Hugo"], "initial_state": [{"entity": "Hugo", "quantity": {"unit": "crayons", "value": 14}}], "operations": [{"actor": "Hugo", "kind": "subtract", "operand": {"unit": "crayons", "value": 1}}, {"actor": "Hugo", "kind": "add", "operand": {"unit": "crayons", "value": 4}}, {"actor": "Hugo", "kind": "add", "operand": {"unit": "crayons", "value": 6}}, {"actor": "Hugo", "kind": "multiply", "operand": {"unit": "crayons", "value": 3}}, {"actor": "Hugo", "kind": "multiply", "operand": {"unit": "crayons", "value": 2}}], "unknown": {"entity": "Hugo", "unit": "crayons"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['subtract', 'add', 'add', 'divide', 'multiply'] operations.", "id": "gma-183"}
{"problem": "Wren has 12 balls. Lena has 19 balls. Ben has 19 balls. Lena buys 10 more balls. Ben doubles. Wren splits her balls evenly into 2 groups and keeps one group. Lena gets 11 more balls. How many balls does Ben have?", "expected_answer": 38, "expected_unit": "balls", "ground_truth_graph": {"entities": ["Wren", "Lena", "Ben"], "initial_state": [{"entity": "Wren", "quantity": {"unit": "balls", "value": 12}}, {"entity": "Lena", "quantity": {"unit": "balls", "value": 19}}, {"entity": "Ben", "quantity": {"unit": "balls", "value": 19}}], "operations": [{"actor": "Lena", "kind": "add", "operand": {"unit": "balls", "value": 10}}, {"actor": "Ben", "kind": "multiply", "operand": {"unit": "balls", "value": 2}}, {"actor": "Wren", "kind": "divide", "operand": {"unit": "balls", "value": 2}}, {"actor": "Lena", "kind": "add", "operand": {"unit": "balls", "value": 11}}], "unknown": {"entity": "Ben", "unit": "balls"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['add', 'divide', 'divide', 'add'] operations.", "id": "gma-184"}
{"problem": "Sam has 38 beads. Clara has 26 beads. Hal has 18 beads. Then he eats 2 beads. Hal drops 1 beads. Clara sells 22 beads. She receives 5 beads. How many beads do they have left?", "expected_answer": 62, "expected_unit": "beads", "ground_truth_graph": {"entities": ["Sam", "Clara", "Hal"], "initial_state": [{"entity": "Sam", "quantity": {"unit": "beads", "value": 38}}, {"entity": "Clara", "quantity": {"unit": "beads", "value": 26}}, {"entity": "Hal", "quantity": {"unit": "beads", "value": 18}}], "operations": [{"actor": "Hal", "kind": "subtract", "operand": {"unit": "beads", "value": 2}}, {"actor": "Hal", "kind": "subtract", "operand": {"unit": "beads", "value": 1}}, {"actor": "Clara", "kind": "subtract", "operand": {"unit": "beads", "value": 22}}, {"actor": "Clara", "kind": "add", "operand": {"unit": "beads", "value": 5}}], "unknown": {"entity": null, "unit": "beads"}}, "patterns": ["initial_has", "operation_add", "operation_subtract", "question_how_many_total"], "notes": "Original authored case of depth 4 exercising ['subtract', 'subtract', 'subtract', 'subtract'] operations.", "id": "gma-185"}
{"problem": "Cora has 19 apples. Then she adds 14 apples. She finds 9 apples. She eats 27. Cora eats 3. How many apples does Cora have in total?", "expected_answer": 12, "expected_unit": "apples", "ground_truth_graph": {"entities": ["Cora"], "initial_state": [{"entity": "Cora", "quantity": {"unit": "apples", "value": 19}}], "operations": [{"actor": "Cora", "kind": "add", "operand": {"unit": "apples", "value": 14}}, {"actor": "Cora", "kind": "add", "operand": {"unit": "apples", "value": 9}}, {"actor": "Cora", "kind": "subtract", "operand": {"unit": "apples", "value": 27}}, {"actor": "Cora", "kind": "subtract", "operand": {"unit": "apples", "value": 3}}], "unknown": {"entity": "Cora", "unit": "apples"}}, "patterns": ["initial_has", "operation_add", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['add', 'add', 'subtract', 'subtract'] operations.", "id": "gma-186"}
{"problem": "Pia has 22 apples. She splits her apples evenly into 2 groups and keeps one group. Pia gets 10 more. Pia splits her apples evenly into 3 groups. Pia receives 15 apples. She spends 12 apples. How many apples does Pia have in total?", "expected_answer": 10, "expected_unit": "apples", "ground_truth_graph": {"entities": ["Pia"], "initial_state": [{"entity": "Pia", "quantity": {"unit": "apples", "value": 22}}], "operations": [{"actor": "Pia", "kind": "divide", "operand": {"unit": "apples", "value": 2}}, {"actor": "Pia", "kind": "add", "operand": {"unit": "apples", "value": 10}}, {"actor": "Pia", "kind": "divide", "operand": {"unit": "apples", "value": 3}}, {"actor": "Pia", "kind": "add", "operand": {"unit": "apples", "value": 15}}, {"actor": "Pia", "kind": "subtract", "operand": {"unit": "apples", "value": 12}}], "unknown": {"entity": "Pia", "unit": "apples"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['divide', 'add', 'divide', 'add', 'subtract'] operations.", "id": "gma-187"}
{"problem": "Sam has 28 candies. Dina has 34 candies. Sam sells 9 candies. Sam gives 4 to Dina. Sam sends 3 to Dina. Then he sends 8 candies to Dina. Dina finds 11 candies. How many candies do they have?", "expected_answer": 64, "expected_unit": "candies", "ground_truth_graph": {"entities": ["Sam", "Dina"], "initial_state": [{"entity": "Sam", "quantity": {"unit": "candies", "value": 28}}, {"entity": "Dina", "quantity": {"unit": "candies", "value": 34}}], "operations": [{"actor": "Sam", "kind": "subtract", "operand": {"unit": "candies", "value": 9}}, {"actor": "Sam", "kind": "transfer", "operand": {"unit": "candies", "value": 4}, "target": "Dina"}, {"actor": "Sam", "kind": "transfer", "operand": {"unit": "candies", "value": 3}, "target": "Dina"}, {"actor": "Sam", "kind": "transfer", "operand": {"unit": "candies", "value": 8}, "target": "Dina"}, {"actor": "Dina", "kind": "add", "operand": {"unit": "candies", "value": 11}}], "unknown": {"entity": null, "unit": "candies"}}, "patterns": ["initial_has", "operation_add", "operation_subtract", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 5 exercising ['subtract', 'transfer', 'transfer', 'transfer', 'divide'] operations.", "id": "gma-188"}
{"problem": "Jade has 17 kites. Then she triples them. Then she uses 14 kites. She uses 14 kites. She sells 13. Jade splits them evenly into 5 groups. How many kites does Jade have?", "expected_answer": 2, "expected_unit": "kites", "ground_truth_graph": {"entities": ["Jade"], "initial_state": [{"entity": "Jade", "quantity": {"unit": "kites", "value": 17}}], "operations": [{"actor": "Jade", "kind": "multiply", "operand": {"unit": "kites", "value": 3}}, {"actor": "Jade", "kind": "subtract", "operand": {"unit": "kites", "value": 14}}, {"actor": "Jade", "kind": "subtract", "operand": {"unit": "kites", "value": 14}}, {"actor": "Jade", "kind": "subtract", "operand": {"unit": "kites", "value": 13}}, {"actor": "Jade", "kind": "divide", "operand": {"unit": "kites", "value": 5}}], "unknown": {"entity": "Jade", "unit": "kites"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['multiply', 'subtract', 'subtract', 'subtract', 'divide'] operations.", "id": "gma-189"}
{"problem": "Tom has 22 beads. Tom triples them. Tom splits his beads evenly into 3 groups and keeps one group. He splits them evenly into 2 groups. Then he gets 7 more. Then he doubles his beads. How many beads does Tom have now?", "expected_answer": 36, "expected_unit": "beads", "ground_truth_graph": {"entities": ["Tom"], "initial_state": [{"entity": "Tom", "quantity": {"unit": "beads", "value": 22}}], "operations": [{"actor": "Tom", "kind": "multiply", "operand": {"unit": "beads", "value": 3}}, {"actor": "Tom", "kind": "divide", "operand": {"unit": "beads", "value": 3}}, {"actor": "Tom", "kind": "divide", "operand": {"unit": "beads", "value": 2}}, {"actor": "Tom", "kind": "add", "operand": {"unit": "beads", "value": 7}}, {"actor": "Tom", "kind": "multiply", "operand": {"unit": "beads", "value": 2}}], "unknown": {"entity": "Tom", "unit": "beads"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['multiply', 'divide', 'divide', 'add', 'multiply'] operations.", "id": "gma-190"}
{"problem": "Hugo has 12 tickets. Ben has 35 tickets. Pia has 27 tickets. Ina has 18 tickets. Ben loses 17. Then he splits them evenly into 3 groups and keeps one group. Pia gets 4 more. Ben eats 2 tickets. How many tickets do they have in total?", "expected_answer": 65, "expected_unit": "tickets", "ground_truth_graph": {"entities": ["Hugo", "Ben", "Pia", "Ina"], "initial_state": [{"entity": "Hugo", "quantity": {"unit": "tickets", "value": 12}}, {"entity": "Ben", "quantity": {"unit": "tickets", "value": 35}}, {"entity": "Pia", "quantity": {"unit": "tickets", "value": 27}}, {"entity": "Ina", "quantity": {"unit": "tickets", "value": 18}}], "operations": [{"actor": "Ben", "kind": "subtract", "operand": {"unit": "tickets", "value": 17}}, {"actor": "Ben", "kind": "divide", "operand": {"unit": "tickets", "value": 3}}, {"actor": "Pia", "kind": "add", "operand": {"unit": "tickets", "value": 4}}, {"actor": "Ben", "kind": "subtract", "operand": {"unit": "tickets", "value": 2}}], "unknown": {"entity": null, "unit": "tickets"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_subtract", "question_how_many_total"], "notes": "Original authored case of depth 4 exercising ['subtract', 'divide', 'add', 'subtract'] operations.", "id": "gma-191"}
{"problem": "Tom has 24 balls. Ina has 13 balls. Tom drops 3 balls. Then he passes 5 to Ina. He passes 4 to Ina. He splits them evenly into 4 groups and keeps one group. How many balls does Tom have?", "expected_answer": 3, "expected_unit": "balls", "ground_truth_graph": {"entities": ["Tom", "Ina"], "initial_state": [{"entity": "Tom", "quantity": {"unit": "balls", "value": 24}}, {"entity": "Ina", "quantity": {"unit": "balls", "value": 13}}], "operations": [{"actor": "Tom", "kind": "subtract", "operand": {"unit": "balls", "value": 3}}, {"actor": "Tom", "kind": "transfer", "operand": {"unit": "balls", "value": 5}, "target": "Ina"}, {"actor": "Tom", "kind": "transfer", "operand": {"unit": "balls", "value": 4}, "target": "Ina"}, {"actor": "Tom", "kind": "divide", "operand": {"unit": "balls", "value": 4}}], "unknown": {"entity": "Tom", "unit": "balls"}}, "patterns": ["initial_has", "operation_divide", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['subtract', 'transfer', 'transfer', 'divide'] operations.", "id": "gma-192"}
{"problem": "Ruth has 25 oranges. Ivan has 39 oranges. Kai has 14 oranges. Ruth gets 10 more oranges. Kai loses 3. Ivan splits his oranges evenly into 3 groups. He buys 15 more. Kai mails 5 to Ivan. How many oranges does Ivan have?", "expected_answer": 33, "expected_unit": "oranges", "ground_truth_graph": {"entities": ["Ruth", "Ivan", "Kai"], "initial_state": [{"entity": "Ruth", "quantity": {"unit": "oranges", "value": 25}}, {"entity": "Ivan", "quantity": {"unit": "oranges", "value": 39}}, {"entity": "Kai", "quantity": {"unit": "oranges", "value": 14}}], "operations": [{"actor": "Ruth", "kind": "add", "operand": {"unit": "oranges", "value": 10}}, {"actor": "Kai", "kind": "subtract", "operand": {"unit": "oranges", "value": 3}}, {"actor": "Ivan", "kind": "divide", "operand": {"unit": "oranges", "value": 3}}, {"actor": "Ivan", "kind": "add", "operand": {"unit": "oranges", "value": 15}}, {"actor": "Kai", "kind": "transfer", "operand": {"unit": "oranges", "value": 5}, "target": "Ivan"}], "unknown": {"entity": "Ivan", "unit": "oranges"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['add', 'subtract', 'divide', 'divide', 'transfer'] operations.", "id": "gma-193"}
{"problem": "Lisa has 39 apples. Drew has 30 apples. Jade has 26 apples. Drew drops 27. Drew earns 13 apples. Drew splits them evenly into 2 groups. Then he hands 2 to Jade. How many apples do they have?", "expected_answer": 73, "expected_unit": "apples", "ground_truth_graph": {"entities": ["Lisa", "Drew", "Jade"], "initial_state": [{"entity": "Lisa", "quantity": {"unit": "apples", "value": 39}}, {"entity": "Drew", "quantity": {"unit": "apples", "value": 30}}, {"entity": "Jade", "quantity": {"unit": "apples", "value": 26}}], "operations": [{"actor": "Drew", "kind": "subtract", "operand": {"unit": "apples", "value": 27}}, {"actor": "Drew", "kind": "add", "operand": {"unit": "apples", "value": 13}}, {"actor": "Drew", "kind": "divide", "operand": {"unit": "apples", "value": 2}}, {"actor": "Drew", "kind": "transfer", "operand": {"unit": "apples", "value": 2}, "target": "Jade"}], "unknown": {"entity": null, "unit": "apples"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_subtract", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 4 exercising ['subtract', 'add', 'divide', 'transfer'] operations.", "id": "gma-194"}
{"problem": "Ben has 26 buttons. Then he triples them. Ben receives 6 buttons. Ben doubles. Ben eats 75 buttons. He doubles his buttons. How many buttons does Ben have altogether?", "expected_answer": 186, "expected_unit": "buttons", "ground_truth_graph": {"entities": ["Ben"], "initial_state": [{"entity": "Ben", "quantity": {"unit": "buttons", "value": 26}}], "operations": [{"actor": "Ben", "kind": "multiply", "operand": {"unit": "buttons", "value": 3}}, {"actor": "Ben", "kind": "add", "operand": {"unit": "buttons", "value": 6}}, {"actor": "Ben", "kind": "multiply", "operand": {"unit": "buttons", "value": 2}}, {"actor": "Ben", "kind": "subtract", "operand": {"unit": "buttons", "value": 75}}, {"actor": "Ben", "kind": "multiply", "operand": {"unit": "buttons", "value": 2}}], "unknown": {"entity": "Ben", "unit": "buttons"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['multiply', 'add', 'multiply', 'subtract', 'multiply'] operations.", "id": "gma-195"}
{"problem": "Dina has 18 letters. Dina uses 16 letters. Then she splits her letters evenly into 2 groups. Then she gets 8 more letters. Dina triples. How many letters does Dina have?", "expected_answer": 27, "expected_unit": "letters", "ground_truth_graph": {"entities": ["Dina"], "initial_state": [{"entity": "Dina", "quantity": {"unit": "letters", "value": 18}}], "operations": [{"actor": "Dina", "kind": "subtract", "operand": {"unit": "letters", "value": 16}}, {"actor": "Dina", "kind": "divide", "operand": {"unit": "letters", "value": 2}}, {"actor": "Dina", "kind": "add", "operand": {"unit": "letters", "value": 8}}, {"actor": "Dina", "kind": "multiply", "operand": {"unit": "letters", "value": 3}}], "unknown": {"entity": "Dina", "unit": "letters"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['subtract', 'divide', 'add', 'multiply'] operations.", "id": "gma-196"}
{"problem": "Ben has 30 letters. Ben splits his letters evenly into 5 groups and keeps one group. Ben gets 4 more. Ben splits his letters evenly into 5 groups. Ben adds 9 letters. Then he earns 9 letters. How many letters does Ben have now?", "expected_answer": 20, "expected_unit": "letters", "ground_truth_graph": {"entities": ["Ben"], "initial_state": [{"entity": "Ben", "quantity": {"unit": "letters", "value": 30}}], "operations": [{"actor": "Ben", "kind": "divide", "operand": {"unit": "letters", "value": 5}}, {"actor": "Ben", "kind": "add", "operand": {"unit": "letters", "value": 4}}, {"actor": "Ben", "kind": "divide", "operand": {"unit": "letters", "value": 5}}, {"actor": "Ben", "kind": "add", "operand": {"unit": "letters", "value": 9}}, {"actor": "Ben", "kind": "add", "operand": {"unit": "letters", "value": 9}}], "unknown": {"entity": "Ben", "unit": "letters"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['divide', 'add', 'divide', 'add', 'divide'] operations.", "id": "gma-197"}
{"problem": "Gina has 38 dollars. Gina gets 10 more dollars. Gina doubles her dollars. Gina sells 47 dollars. Gina buys 8 more. How many dollars does Gina have in total?", "expected_answer": 57, "expected_unit": "dollars", "ground_truth_graph": {"entities": ["Gina"], "initial_state": [{"entity": "Gina", "quantity": {"unit": "dollars", "value": 38}}], "operations": [{"actor": "Gina", "kind": "add", "operand": {"unit": "dollars", "value": 10}}, {"actor": "Gina", "kind": "multiply", "operand": {"unit": "dollars", "value": 2}}, {"actor": "Gina", "kind": "subtract", "operand": {"unit": "dollars", "value": 47}}, {"actor": "Gina", "kind": "add", "operand": {"unit": "dollars", "value": 8}}], "unknown": {"entity": "Gina", "unit": "dollars"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['add', 'multiply', 'subtract', 'add'] operations.", "id": "gma-198"}
{"problem": "Wren has 30 balls. Then she splits them evenly into 2 groups and keeps one group. Wren triples her balls. Wren triples them. Wren doubles her balls. How many balls does Wren have now?", "expected_answer": 270, "expected_unit": "balls", "ground_truth_graph": {"entities": ["Wren"], "initial_state": [{"entity": "Wren", "quantity": {"unit": "balls", "value": 30}}], "operations": [{"actor": "Wren", "kind": "divide", "operand": {"unit": "balls", "value": 2}}, {"actor": "Wren", "kind": "multiply", "operand": {"unit": "balls", "value": 3}}, {"actor": "Wren", "kind": "multiply", "operand": {"unit": "balls", "value": 3}}, {"actor": "Wren", "kind": "multiply", "operand": {"unit": "balls", "value": 2}}], "unknown": {"entity": "Wren", "unit": "balls"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['divide', 'multiply', 'multiply', 'multiply'] operations.", "id": "gma-199"}
{"problem": "Wren has 14 cards. Wren doubles. She triples. Wren donates 69. Then she earns 4 cards. She doubles. How many cards does Wren have now?", "expected_answer": 38, "expected_unit": "cards", "ground_truth_graph": {"entities": ["Wren"], "initial_state": [{"entity": "Wren", "quantity": {"unit": "cards", "value": 14}}], "operations": [{"actor": "Wren", "kind": "multiply", "operand": {"unit": "cards", "value": 2}}, {"actor": "Wren", "kind": "multiply", "operand": {"unit": "cards", "value": 3}}, {"actor": "Wren", "kind": "subtract", "operand": {"unit": "cards", "value": 69}}, {"actor": "Wren", "kind": "add", "operand": {"unit": "cards", "value": 4}}, {"actor": "Wren", "kind": "multiply", "operand": {"unit": "cards", "value": 2}}], "unknown": {"entity": "Wren", "unit": "cards"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['multiply', 'multiply', 'subtract', 'add', 'divide'] operations.", "id": "gma-200"}
{"problem": "Wren has 28 stickers. Ivan has 18 stickers. Clara has 32 stickers. Ivan doubles. Wren receives 2 stickers. Then she gets 14 more stickers. She adds 9 stickers. She hands 9 stickers to Ivan. How many stickers does Wren have?", "expected_answer": 44, "expected_unit": "stickers", "ground_truth_graph": {"entities": ["Wren", "Ivan", "Clara"], "initial_state": [{"entity": "Wren", "quantity": {"unit": "stickers", "value": 28}}, {"entity": "Ivan", "quantity": {"unit": "stickers", "value": 18}}, {"entity": "Clara", "quantity": {"unit": "stickers", "value": 32}}], "operations": [{"actor": "Ivan", "kind": "multiply", "operand": {"unit": "stickers", "value": 2}}, {"actor": "Wren", "kind": "add", "operand": {"unit": "stickers", "value": 2}}, {"actor": "Wren", "kind": "add", "operand": {"unit": "stickers", "value": 14}}, {"actor": "Wren", "kind": "add", "operand": {"unit": "stickers", "value": 9}}, {"actor": "Wren", "kind": "transfer", "operand": {"unit": "stickers", "value": 9}, "target": "Ivan"}], "unknown": {"entity": "Wren", "unit": "stickers"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['multiply', 'add', 'add', 'add', 'transfer'] operations.", "id": "gma-201"}
{"problem": "Jade has 19 coins. Lisa has 25 coins. Jay has 19 coins. Then he gets 8 more. He passes 17 to Lisa. He triples. Lisa splits them evenly into 2 groups and keeps one group. Jay splits them evenly into 5 groups and keeps one group. How many coins does Jade have in total?", "expected_answer": 19, "expected_unit": "coins", "ground_truth_graph": {"entities": ["Jade", "Lisa", "Jay"], "initial_state": [{"entity": "Jade", "quantity": {"unit": "coins", "value": 19}}, {"entity": "Lisa", "quantity": {"unit": "coins", "value": 25}}, {"entity": "Jay", "quantity": {"unit": "coins", "value": 19}}], "operations": [{"actor": "Jay", "kind": "add", "operand": {"unit": "coins", "value": 8}}, {"actor": "Jay", "kind": "transfer", "operand": {"unit": "coins", "value": 17}, "target": "Lisa"}, {"actor": "Jay", "kind": "multiply", "operand": {"unit": "coins", "value": 3}}, {"actor": "Lisa", "kind": "divide", "operand": {"unit": "coins", "value": 2}}, {"actor": "Jay", "kind": "divide", "operand": {"unit": "coins", "value": 5}}], "unknown": {"entity": "Jade", "unit": "coins"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['divide', 'transfer', 'multiply', 'divide', 'divide'] operations.", "id": "gma-202"}
{"problem": "Lena has 28 balls. Cora has 32 balls. Cora triples. Cora splits her balls evenly into 3 groups. Cora doubles. Lena buys 13 more balls. How many balls does Cora have now?", "expected_answer": 64, "expected_unit": "balls", "ground_truth_graph": {"entities": ["Lena", "Cora"], "initial_state": [{"entity": "Lena", "quantity": {"unit": "balls", "value": 28}}, {"entity": "Cora", "quantity": {"unit": "balls", "value": 32}}], "operations": [{"actor": "Cora", "kind": "multiply", "operand": {"unit": "balls", "value": 3}}, {"actor": "Cora", "kind": "divide", "operand": {"unit": "balls", "value": 3}}, {"actor": "Cora", "kind": "multiply", "operand": {"unit": "balls", "value": 2}}, {"actor": "Lena", "kind": "add", "operand": {"unit": "balls", "value": 13}}], "unknown": {"entity": "Cora", "unit": "balls"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['multiply', 'divide', 'multiply', 'add'] operations.", "id": "gma-203"}
{"problem": "Uma has 29 kites. Tom has 13 kites. Uma passes 10 to Tom. Uma gives 1 kites to Tom. Tom triples them. Uma buys 14 more kites. How many kites does Tom have in total?", "expected_answer": 72, "expected_unit": "kites", "ground_truth_graph": {"entities": ["Uma", "Tom"], "initial_state": [{"entity": "Uma", "quantity": {"unit": "kites", "value": 29}}, {"entity": "Tom", "quantity": {"unit": "kites", "value": 13}}], "operations": [{"actor": "Uma", "kind": "transfer", "operand": {"unit": "kites", "value": 10}, "target": "Tom"}, {"actor": "Uma", "kind": "transfer", "operand": {"unit": "kites", "value": 1}, "target": "Tom"}, {"actor": "Tom", "kind": "multiply", "operand": {"unit": "kites", "value": 3}}, {"actor": "Uma", "kind": "add", "operand": {"unit": "kites", "value": 14}}], "unknown": {"entity": "Tom", "unit": "kites"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 4 exercising ['transfer', 'transfer', 'multiply', 'add'] operations.", "id": "gma-204"}
{"problem": "Gina has 40 buttons. Ben has 18 buttons. Ben gets 15 more buttons. He sends 5 buttons to Gina. He removes 24. Ben splits them evenly into 4 groups. Ben gets 3 more buttons. How many buttons does Gina have now?", "expected_answer": 45, "expected_unit": "buttons", "ground_truth_graph": {"entities": ["Gina", "Ben"], "initial_state": [{"entity": "Gina", "quantity": {"unit": "buttons", "value": 40}}, {"entity": "Ben", "quantity": {"unit": "buttons", "value": 18}}], "operations": [{"actor": "Ben", "kind": "add", "operand": {"unit": "buttons", "value": 15}}, {"actor": "Ben", "kind": "transfer", "operand": {"unit": "buttons", "value": 5}, "target": "Gina"}, {"actor": "Ben", "kind": "subtract", "operand": {"unit": "buttons", "value": 24}}, {"actor": "Ben", "kind": "divide", "operand": {"unit": "buttons", "value": 4}}, {"actor": "Ben", "kind": "add", "operand": {"unit": "buttons", "value": 3}}], "unknown": {"entity": "Gina", "unit": "buttons"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 5 exercising ['add', 'transfer', 'subtract', 'divide', 'add'] operations.", "id": "gma-205"}
{"problem": "Owen has 35 stamps. Then he triples them. Then he splits his stamps evenly into 5 groups and keeps one group. Owen triples. Owen buys 12 more stamps. He doubles them. Owen splits them evenly into 2 groups and keeps one group. He receives 12 stamps. How many stamps does Owen have altogether?", "expected_answer": 87, "expected_unit": "stamps", "ground_truth_graph": {"entities": ["Owen"], "initial_state": [{"entity": "Owen", "quantity": {"unit": "stamps", "value": 35}}], "operations": [{"actor": "Owen", "kind": "multiply", "operand": {"unit": "stamps", "value": 3}}, {"actor": "Owen", "kind": "divide", "operand": {"unit": "stamps", "value": 5}}, {"actor": "Owen", "kind": "multiply", "operand": {"unit": "stamps", "value": 3}}, {"actor": "Owen", "kind": "add", "operand": {"unit": "stamps", "value": 12}}, {"actor": "Owen", "kind": "multiply", "operand": {"unit": "stamps", "value": 2}}, {"actor": "Owen", "kind": "divide", "operand": {"unit": "stamps", "value": 2}}, {"actor": "Owen", "kind": "add", "operand": {"unit": "stamps", "value": 12}}], "unknown": {"entity": "Owen", "unit": "stamps"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['multiply', 'divide', 'multiply', 'add', 'multiply', 'divide', 'add'] operations.", "id": "gma-206"}
{"problem": "Owen has 37 stamps. Iris has 34 stamps. Owen sends 25 to Iris. Owen donates 5. Iris adds 6 stamps. Iris eats 56 stamps. Iris sends 3 stamps to Owen. Owen sends 6 to Iris. How many stamps does Owen have in total?", "expected_answer": 4, "expected_unit": "stamps", "ground_truth_graph": {"entities": ["Owen", "Iris"], "initial_state": [{"entity": "Owen", "quantity": {"unit": "stamps", "value": 37}}, {"entity": "Iris", "quantity": {"unit": "stamps", "value": 34}}], "operations": [{"actor": "Owen", "kind": "transfer", "operand": {"unit": "stamps", "value": 25}, "target": "Iris"}, {"actor": "Owen", "kind": "subtract", "operand": {"unit": "stamps", "value": 5}}, {"actor": "Iris", "kind": "add", "operand": {"unit": "stamps", "value": 6}}, {"actor": "Iris", "kind": "subtract", "operand": {"unit": "stamps", "value": 56}}, {"actor": "Iris", "kind": "transfer", "operand": {"unit": "stamps", "value": 3}, "target": "Owen"}, {"actor": "Owen", "kind": "transfer", "operand": {"unit": "stamps", "value": 6}, "target": "Iris"}], "unknown": {"entity": "Owen", "unit": "stamps"}}, "patterns": ["initial_has", "operation_add", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 6 exercising ['transfer', 'subtract', 'divide', 'subtract', 'transfer', 'transfer'] operations.", "id": "gma-207"}
{"problem": "Yara has 33 dollars. Zane has 15 dollars. Nia has 12 dollars. Zane gives 11 to Yara. Nia triples. Then she splits them evenly into 2 groups. Zane gets 7 more. Zane passes 9 to Nia. He gets 6 more. He sends 1 to Nia. Then he doubles his dollars. How many dollars does Zane have in total?", "expected_answer": 14, "expected_unit": "dollars", "ground_truth_graph": {"entities": ["Yara", "Zane", "Nia"], "initial_state": [{"entity": "Yara", "quantity": {"unit": "dollars", "value": 33}}, {"entity": "Zane", "quantity": {"unit": "dollars", "value": 15}}, {"entity": "Nia", "quantity": {"unit": "dollars", "value": 12}}], "operations": [{"actor": "Zane", "kind": "transfer", "operand": {"unit": "dollars", "value": 11}, "target": "Yara"}, {"actor": "Nia", "kind": "multiply", "operand": {"unit": "dollars", "value": 3}}, {"actor": "Nia", "kind": "divide", "operand": {"unit": "dollars", "value": 2}}, {"actor": "Zane", "kind": "add", "operand": {"unit": "dollars", "value": 7}}, {"actor": "Zane", "kind": "transfer", "operand": {"unit": "dollars", "value": 9}, "target": "Nia"}, {"actor": "Zane", "kind": "add", "operand": {"unit": "dollars", "value": 6}}, {"actor": "Zane", "kind": "transfer", "operand": {"unit": "dollars", "value": 1}, "target": "Nia"}, {"actor": "Zane", "kind": "multiply", "operand": {"unit": "dollars", "value": 2}}], "unknown": {"entity": "Zane", "unit": "dollars"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 8 exercising ['transfer', 'multiply', 'divide', 'subtract', 'transfer', 'subtract', 'transfer', 'divide'] operations.", "id": "gma-208"}
{"problem": "Wren has 27 crayons. She removes 23 crayons. Wren buys 10 more. Wren finds 7 crayons. Then she earns 2 crayons. Then she doubles them. Wren triples. Then she uses 65. Then she doubles them. How many crayons does Wren have in total?", "expected_answer": 146, "expected_unit": "crayons", "ground_truth_graph": {"entities": ["Wren"], "initial_state": [{"entity": "Wren", "quantity": {"unit": "crayons", "value": 27}}], "operations": [{"actor": "Wren", "kind": "subtract", "operand": {"unit": "crayons", "value": 23}}, {"actor": "Wren", "kind": "add", "operand": {"unit": "crayons", "value": 10}}, {"actor": "Wren", "kind": "add", "operand": {"unit": "crayons", "value": 7}}, {"actor": "Wren", "kind": "add", "operand": {"unit": "crayons", "value": 2}}, {"actor": "Wren", "kind": "multiply", "operand": {"unit": "crayons", "value": 2}}, {"actor": "Wren", "kind": "multiply", "operand": {"unit": "crayons", "value": 3}}, {"actor": "Wren", "kind": "subtract", "operand": {"unit": "crayons", "value": 65}}, {"actor": "Wren", "kind": "multiply", "operand": {"unit": "crayons", "value": 2}}], "unknown": {"entity": "Wren", "unit": "crayons"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 8 exercising ['subtract', 'add', 'add', 'add', 'divide', 'multiply', 'subtract', 'multiply'] operations.", "id": "gma-209"}
{"problem": "Lux has 11 stamps. He triples them. Then he splits his stamps evenly into 3 groups and keeps one group. Then he loses 4. He adds 6 stamps. Lux doubles. Then he splits them evenly into 2 groups. Lux spends 7. Then he doubles them. How many stamps does Lux have?", "expected_answer": 12, "expected_unit": "stamps", "ground_truth_graph": {"entities": ["Lux"], "initial_state": [{"entity": "Lux", "quantity": {"unit": "stamps", "value": 11}}], "operations": [{"actor": "Lux", "kind": "multiply", "operand": {"unit": "stamps", "value": 3}}, {"actor": "Lux", "kind": "divide", "operand": {"unit": "stamps", "value": 3}}, {"actor": "Lux", "kind": "subtract", "operand": {"unit": "stamps", "value": 4}}, {"actor": "Lux", "kind": "add", "operand": {"unit": "stamps", "value": 6}}, {"actor": "Lux", "kind": "multiply", "operand": {"unit": "stamps", "value": 2}}, {"actor": "Lux", "kind": "divide", "operand": {"unit": "stamps", "value": 2}}, {"actor": "Lux", "kind": "subtract", "operand": {"unit": "stamps", "value": 7}}, {"actor": "Lux", "kind": "multiply", "operand": {"unit": "stamps", "value": 2}}], "unknown": {"entity": "Lux", "unit": "stamps"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 8 exercising ['divide', 'divide', 'subtract', 'add', 'divide', 'divide', 'subtract', 'multiply'] operations.", "id": "gma-210"}
{"problem": "Clara has 10 dollars. Clara triples. She earns 5 dollars. Clara splits them evenly into 5 groups and keeps one group. Clara gets 14 more. Clara eats 4 dollars. Clara buys 15 more. How many dollars does Clara have altogether?", "expected_answer": 32, "expected_unit": "dollars", "ground_truth_graph": {"entities": ["Clara"], "initial_state": [{"entity": "Clara", "quantity": {"unit": "dollars", "value": 10}}], "operations": [{"actor": "Clara", "kind": "multiply", "operand": {"unit": "dollars", "value": 3}}, {"actor": "Clara", "kind": "add", "operand": {"unit": "dollars", "value": 5}}, {"actor": "Clara", "kind": "divide", "operand": {"unit": "dollars", "value": 5}}, {"actor": "Clara", "kind": "add", "operand": {"unit": "dollars", "value": 14}}, {"actor": "Clara", "kind": "subtract", "operand": {"unit": "dollars", "value": 4}}, {"actor": "Clara", "kind": "add", "operand": {"unit": "dollars", "value": 15}}], "unknown": {"entity": "Clara", "unit": "dollars"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 6 exercising ['multiply', 'add', 'divide', 'divide', 'subtract', 'add'] operations.", "id": "gma-211"}
{"problem": "Wren has 27 balls. She triples. Wren splits her balls evenly into 3 groups and keeps one group. Then she splits her balls evenly into 3 groups. She splits them evenly into 3 groups and keeps one group. Wren adds 5 balls. She finds 9 balls. Wren adds 2 balls. Then she triples her balls. How many balls does Wren have altogether?", "expected_answer": 57, "expected_unit": "balls", "ground_truth_graph": {"entities": ["Wren"], "initial_state": [{"entity": "Wren", "quantity": {"unit": "balls", "value": 27}}], "operations": [{"actor": "Wren", "kind": "multiply", "operand": {"unit": "balls", "value": 3}}, {"actor": "Wren", "kind": "divide", "operand": {"unit": "balls", "value": 3}}, {"actor": "Wren", "kind": "divide", "operand": {"unit": "balls", "value": 3}}, {"actor": "Wren", "kind": "divide", "operand": {"unit": "balls", "value": 3}}, {"actor": "Wren", "kind": "add", "operand": {"unit": "balls", "value": 5}}, {"actor": "Wren", "kind": "add", "operand": {"unit": "balls", "value": 9}}, {"actor": "Wren", "kind": "add", "operand": {"unit": "balls", "value": 2}}, {"actor": "Wren", "kind": "multiply", "operand": {"unit": "balls", "value": 3}}], "unknown": {"entity": "Wren", "unit": "balls"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 8 exercising ['multiply', 'divide', 'divide', 'divide', 'add', 'add', 'add', 'multiply'] operations.", "id": "gma-212"}
{"problem": "Peter has 18 pens. Peter splits his pens evenly into 2 groups and keeps one group. Peter splits them evenly into 3 groups. Then he adds 8 pens. Then he triples. Peter triples his pens. Then he triples them. Then he doubles his pens. How many pens does Peter have?", "expected_answer": 594, "expected_unit": "pens", "ground_truth_graph": {"entities": ["Peter"], "initial_state": [{"entity": "Peter", "quantity": {"unit": "pens", "value": 18}}], "operations": [{"actor": "Peter", "kind": "divide", "operand": {"unit": "pens", "value": 2}}, {"actor": "Peter", "kind": "divide", "operand": {"unit": "pens", "value": 3}}, {"actor": "Peter", "kind": "add", "operand": {"unit": "pens", "value": 8}}, {"actor": "Peter", "kind": "multiply", "operand": {"unit": "pens", "value": 3}}, {"actor": "Peter", "kind": "multiply", "operand": {"unit": "pens", "value": 3}}, {"actor": "Peter", "kind": "multiply", "operand": {"unit": "pens", "value": 3}}, {"actor": "Peter", "kind": "multiply", "operand": {"unit": "pens", "value": 2}}], "unknown": {"entity": "Peter", "unit": "pens"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['divide', 'divide', 'subtract', 'divide', 'multiply', 'multiply', 'multiply'] operations.", "id": "gma-213"}
{"problem": "Rina has 22 pens. Dina has 32 pens. Dina splits them evenly into 4 groups. She gives 2 to Rina. Rina mails 21 pens to Dina. Then she adds 13 pens. Rina splits her pens evenly into 2 groups. Rina passes 1 to Dina. Dina splits them evenly into 2 groups. How many pens does Dina have in total?", "expected_answer": 14, "expected_unit": "pens", "ground_truth_graph": {"entities": ["Rina", "Dina"], "initial_state": [{"entity": "Rina", "quantity": {"unit": "pens", "value": 22}}, {"entity": "Dina", "quantity": {"unit": "pens", "value": 32}}], "operations": [{"actor": "Dina", "kind": "divide", "operand": {"unit": "pens", "value": 4}}, {"actor": "Dina", "kind": "transfer", "operand": {"unit": "pens", "value": 2}, "target": "Rina"}, {"actor": "Rina", "kind": "transfer", "operand": {"unit": "pens", "value": 21}, "target": "Dina"}, {"actor": "Rina", "kind": "add", "operand": {"unit": "pens", "value": 13}}, {"actor": "Rina", "kind": "divide", "operand": {"unit": "pens", "value": 2}}, {"actor": "Rina", "kind": "transfer", "operand": {"unit": "pens", "value": 1}, "target": "Dina"}, {"actor": "Dina", "kind": "divide", "operand": {"unit": "pens", "value": 2}}], "unknown": {"entity": "Dina", "unit": "pens"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['divide', 'transfer', 'transfer', 'add', 'divide', 'transfer', 'divide'] operations.", "id": "gma-214"}
{"problem": "Kai has 18 beads. He loses 4. Kai splits his beads evenly into 2 groups. Kai buys 2 more. Kai eats 7 beads. He triples his beads. Kai earns 9 beads. How many beads does Kai have altogether?", "expected_answer": 15, "expected_unit": "beads", "ground_truth_graph": {"entities": ["Kai"], "initial_state": [{"entity": "Kai", "quantity": {"unit": "beads", "value": 18}}], "operations": [{"actor": "Kai", "kind": "subtract", "operand": {"unit": "beads", "value": 4}}, {"actor": "Kai", "kind": "divide", "operand": {"unit": "beads", "value": 2}}, {"actor": "Kai", "kind": "add", "operand": {"unit": "beads", "value": 2}}, {"actor": "Kai", "kind": "subtract", "operand": {"unit": "beads", "value": 7}}, {"actor": "Kai", "kind": "multiply", "operand": {"unit": "beads", "value": 3}}, {"actor": "Kai", "kind": "add", "operand": {"unit": "beads", "value": 9}}], "unknown": {"entity": "Kai", "unit": "beads"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 6 exercising ['subtract', 'divide', 'add', 'subtract', 'multiply', 'add'] operations.", "id": "gma-215"}
{"problem": "Hal has 36 ribbons. Uma has 26 ribbons. Uma triples her ribbons. She hands 3 to Hal. Hal mails 7 ribbons to Uma. He sells 26. He spends 4. Hal finds 14 ribbons. How many ribbons do they have altogether?", "expected_answer": 98, "expected_unit": "ribbons", "ground_truth_graph": {"entities": ["Hal", "Uma"], "initial_state": [{"entity": "Hal", "quantity": {"unit": "ribbons", "value": 36}}, {"entity": "Uma", "quantity": {"unit": "ribbons", "value": 26}}], "operations": [{"actor": "Uma", "kind": "multiply", "operand": {"unit": "ribbons", "value": 3}}, {"actor": "Uma", "kind": "transfer", "operand": {"unit": "ribbons", "value": 3}, "target": "Hal"}, {"actor": "Hal", "kind": "transfer", "operand": {"unit": "ribbons", "value": 7}, "target": "Uma"}, {"actor": "Hal", "kind": "subtract", "operand": {"unit": "ribbons", "value": 26}}, {"actor": "Hal", "kind": "subtract", "operand": {"unit": "ribbons", "value": 4}}, {"actor": "Hal", "kind": "add", "operand": {"unit": "ribbons", "value": 14}}], "unknown": {"entity": null, "unit": "ribbons"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 6 exercising ['multiply', 'transfer', 'transfer', 'subtract', 'subtract', 'transfer'] operations.", "id": "gma-216"}
{"problem": "Cora has 27 beads. Drew has 29 beads. Gwen has 34 beads. Drew doubles them. Gwen buys 10 more beads. Gwen passes 3 beads to Cora. Cora doubles her beads. Gwen finds 2 beads. Drew earns 2 beads. How many beads does Cora have in total?", "expected_answer": 60, "expected_unit": "beads", "ground_truth_graph": {"entities": ["Cora", "Drew", "Gwen"], "initial_state": [{"entity": "Cora", "quantity": {"unit": "beads", "value": 27}}, {"entity": "Drew", "quantity": {"unit": "beads", "value": 29}}, {"entity": "Gwen", "quantity": {"unit": "beads", "value": 34}}], "operations": [{"actor": "Drew", "kind": "multiply", "operand": {"unit": "beads", "value": 2}}, {"actor": "Gwen", "kind": "add", "operand": {"unit": "beads", "value": 10}}, {"actor": "Gwen", "kind": "transfer", "operand": {"unit": "beads", "value": 3}, "target": "Cora"}, {"actor": "Cora", "kind": "multiply", "operand": {"unit": "beads", "value": 2}}, {"actor": "Gwen", "kind": "add", "operand": {"unit": "beads", "value": 2}}, {"actor": "Drew", "kind": "add", "operand": {"unit": "beads", "value": 2}}], "unknown": {"entity": "Cora", "unit": "beads"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 6 exercising ['multiply', 'add', 'transfer', 'multiply', 'add', 'add'] operations.", "id": "gma-217"}
{"problem": "Sara has 38 letters. Ben has 15 letters. Leo has 10 letters. Ben buys 9 more. Sara drops 28 letters. Leo buys 14 more letters. He sends 3 to Sara. He mails 11 letters to Sara. Then he doubles his letters. Leo gets 4 more letters. How many letters do they have left?", "expected_answer": 72, "expected_unit": "letters", "ground_truth_graph": {"entities": ["Sara", "Ben", "Leo"], "initial_state": [{"entity": "Sara", "quantity": {"unit": "letters", "value": 38}}, {"entity": "Ben", "quantity": {"unit": "letters", "value": 15}}, {"entity": "Leo", "quantity": {"unit": "letters", "value": 10}}], "operations": [{"actor": "Ben", "kind": "add", "operand": {"unit": "letters", "value": 9}}, {"actor": "Sara", "kind": "subtract", "operand": {"unit": "letters", "value": 28}}, {"actor": "Leo", "kind": "add", "operand": {"unit": "letters", "value": 14}}, {"actor": "Leo", "kind": "transfer", "operand": {"unit": "letters", "value": 3}, "target": "Sara"}, {"actor": "Leo", "kind": "transfer", "operand": {"unit": "letters", "value": 11}, "target": "Sara"}, {"actor": "Leo", "kind": "multiply", "operand": {"unit": "letters", "value": 2}}, {"actor": "Leo", "kind": "add", "operand": {"unit": "letters", "value": 4}}], "unknown": {"entity": null, "unit": "letters"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 7 exercising ['add', 'subtract', 'add', 'transfer', 'transfer', 'multiply', 'add'] operations.", "id": "gma-218"}
{"problem": "Quinn has 28 oranges. Quinn triples. Then he splits them evenly into 3 groups. He buys 2 more. Quinn donates 2 oranges. Quinn removes 16 oranges. He doubles them. Then he spends 3 oranges. Then he gets 7 more oranges. How many oranges does Quinn have in total?", "expected_answer": 28, "expected_unit": "oranges", "ground_truth_graph": {"entities": ["Quinn"], "initial_state": [{"entity": "Quinn", "quantity": {"unit": "oranges", "value": 28}}], "operations": [{"actor": "Quinn", "kind": "multiply", "operand": {"unit": "oranges", "value": 3}}, {"actor": "Quinn", "kind": "divide", "operand": {"unit": "oranges", "value": 3}}, {"actor": "Quinn", "kind": "add", "operand": {"unit": "oranges", "value": 2}}, {"actor": "Quinn", "kind": "subtract", "operand": {"unit": "oranges", "value": 2}}, {"actor": "Quinn", "kind": "subtract", "operand": {"unit": "oranges", "value": 16}}, {"actor": "Quinn", "kind": "multiply", "operand": {"unit": "oranges", "value": 2}}, {"actor": "Quinn", "kind": "subtract", "operand": {"unit": "oranges", "value": 3}}, {"actor": "Quinn", "kind": "add", "operand": {"unit": "oranges", "value": 7}}], "unknown": {"entity": "Quinn", "unit": "oranges"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 8 exercising ['multiply', 'divide', 'add', 'subtract', 'subtract', 'multiply', 'subtract', 'add'] operations.", "id": "gma-219"}
{"problem": "Noah has 33 stamps. Seth has 37 stamps. Noah hands 2 stamps to Seth. Seth uses 5 stamps. Then he splits them evenly into 2 groups and keeps one group. Noah doubles his stamps. Noah sends 42 stamps to Seth. Noah gives 8 stamps to Seth. Noah adds 15 stamps. How many stamps do they have altogether?", "expected_answer": 94, "expected_unit": "stamps", "ground_truth_graph": {"entities": ["Noah", "Seth"], "initial_state": [{"entity": "Noah", "quantity": {"unit": "stamps", "value": 33}}, {"entity": "Seth", "quantity": {"unit": "stamps", "value": 37}}], "operations": [{"actor": "Noah", "kind": "transfer", "operand": {"unit": "stamps", "value": 2}, "target": "Seth"}, {"actor": "Seth", "kind": "subtract", "operand": {"unit": "stamps", "value": 5}}, {"actor": "Seth", "kind": "divide", "operand": {"unit": "stamps", "value": 2}}, {"actor": "Noah", "kind": "multiply", "operand": {"unit": "stamps", "value": 2}}, {"actor": "Noah", "kind": "transfer", "operand": {"unit": "stamps", "value": 42}, "target": "Seth"}, {"actor": "Noah", "kind": "transfer", "operand": {"unit": "stamps", "value": 8}, "target": "Seth"}, {"actor": "Noah", "kind": "add", "operand": {"unit": "stamps", "value": 15}}], "unknown": {"entity": null, "unit": "stamps"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 7 exercising ['transfer', 'subtract', 'divide', 'divide', 'transfer', 'transfer', 'add'] operations.", "id": "gma-220"}
{"problem": "Aria has 25 cups. She splits her cups evenly into 5 groups. Aria receives 11 cups. She finds 4 cups. Then she doubles them. Aria triples. Then she sells 1 cups. Aria triples. How many cups does Aria have altogether?", "expected_answer": 357, "expected_unit": "cups", "ground_truth_graph": {"entities": ["Aria"], "initial_state": [{"entity": "Aria", "quantity": {"unit": "cups", "value": 25}}], "operations": [{"actor": "Aria", "kind": "divide", "operand": {"unit": "cups", "value": 5}}, {"actor": "Aria", "kind": "add", "operand": {"unit": "cups", "value": 11}}, {"actor": "Aria", "kind": "add", "operand": {"unit": "cups", "value": 4}}, {"actor": "Aria", "kind": "multiply", "operand": {"unit": "cups", "value": 2}}, {"actor": "Aria", "kind": "multiply", "operand": {"unit": "cups", "value": 3}}, {"actor": "Aria", "kind": "subtract", "operand": {"unit": "cups", "value": 1}}, {"actor": "Aria", "kind": "multiply", "operand": {"unit": "cups", "value": 3}}], "unknown": {"entity": "Aria", "unit": "cups"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['divide', 'add', 'add', 'multiply', 'multiply', 'subtract', 'multiply'] operations.", "id": "gma-221"}
{"problem": "Kai has 23 dollars. Iris has 31 dollars. Iris uses 8 dollars. She triples her dollars. Iris splits her dollars evenly into 3 groups and keeps one group. Iris sends 9 to Kai. Kai mails 27 dollars to Iris. Iris triples. Then she loses 29. Kai splits them evenly into 5 groups and keeps one group. How many dollars do they have altogether?", "expected_answer": 95, "expected_unit": "dollars", "ground_truth_graph": {"entities": ["Kai", "Iris"], "initial_state": [{"entity": "Kai", "quantity": {"unit": "dollars", "value": 23}}, {"entity": "Iris", "quantity": {"unit": "dollars", "value": 31}}], "operations": [{"actor": "Iris", "kind": "subtract", "operand": {"unit": "dollars", "value": 8}}, {"actor": "Iris", "kind": "multiply", "operand": {"unit": "dollars", "value": 3}}, {"actor": "Iris", "kind": "divide", "operand": {"unit": "dollars", "value": 3}}, {"actor": "Iris", "kind": "transfer", "operand": {"unit": "dollars", "value": 9}, "target": "Kai"}, {"actor": "Kai", "kind": "transfer", "operand": {"unit": "dollars", "value": 27}, "target": "Iris"}, {"actor": "Iris", "kind": "multiply", "operand": {"unit": "dollars", "value": 3}}, {"actor": "Iris", "kind": "subtract", "operand": {"unit": "dollars", "value": 29}}, {"actor": "Kai", "kind": "divide", "operand": {"unit": "dollars", "value": 5}}], "unknown": {"entity": null, "unit": "dollars"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 8 exercising ['subtract', 'multiply', 'divide', 'transfer', 'transfer', 'multiply', 'subtract', 'divide'] operations.", "id": "gma-222"}
{"problem": "Ivan has 10 beads. Gina has 25 beads. Anna has 36 beads. Hal has 20 beads. Ivan doubles. Gina sells 15. Hal splits them evenly into 5 groups and keeps one group. Hal finds 4 beads. Hal splits his beads evenly into 4 groups. Ivan splits his beads evenly into 5 groups and keeps one group. Gina triples her beads. How many beads does Ivan have now?", "expected_answer": 4, "expected_unit": "beads", "ground_truth_graph": {"entities": ["Ivan", "Gina", "Anna", "Hal"], "initial_state": [{"entity": "Ivan", "quantity": {"unit": "beads", "value": 10}}, {"entity": "Gina", "quantity": {"unit": "beads", "value": 25}}, {"entity": "Anna", "quantity": {"unit": "beads", "value": 36}}, {"entity": "Hal", "quantity": {"unit": "beads", "value": 20}}], "operations": [{"actor": "Ivan", "kind": "multiply", "operand": {"unit": "beads", "value": 2}}, {"actor": "Gina", "kind": "subtract", "operand": {"unit": "beads", "value": 15}}, {"actor": "Hal", "kind": "divide", "operand": {"unit": "beads", "value": 5}}, {"actor": "Hal", "kind": "add", "operand": {"unit": "beads", "value": 4}}, {"actor": "Hal", "kind": "divide", "operand": {"unit": "beads", "value": 4}}, {"actor": "Ivan", "kind": "divide", "operand": {"unit": "beads", "value": 5}}, {"actor": "Gina", "kind": "multiply", "operand": {"unit": "beads", "value": 3}}], "unknown": {"entity": "Ivan", "unit": "beads"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['multiply', 'subtract', 'divide', 'add', 'divide', 'divide', 'multiply'] operations.", "id": "gma-223"}
{"problem": "Noah has 39 cards. He doubles his cards. Noah earns 9 cards. Noah doubles. He eats 150 cards. Then he receives 11 cards. He eats 9 cards. Noah splits his cards evenly into 2 groups and keeps one group. He receives 15 cards. How many cards does Noah have altogether?", "expected_answer": 28, "expected_unit": "cards", "ground_truth_graph": {"entities": ["Noah"], "initial_state": [{"entity": "Noah", "quantity": {"unit": "cards", "value": 39}}], "operations": [{"actor": "Noah", "kind": "multiply", "operand": {"unit": "cards", "value": 2}}, {"actor": "Noah", "kind": "add", "operand": {"unit": "cards", "value": 9}}, {"actor": "Noah", "kind": "multiply", "operand": {"unit": "cards", "value": 2}}, {"actor": "Noah", "kind": "subtract", "operand": {"unit": "cards", "value": 150}}, {"actor": "Noah", "kind": "add", "operand": {"unit": "cards", "value": 11}}, {"actor": "Noah", "kind": "subtract", "operand": {"unit": "cards", "value": 9}}, {"actor": "Noah", "kind": "divide", "operand": {"unit": "cards", "value": 2}}, {"actor": "Noah", "kind": "add", "operand": {"unit": "cards", "value": 15}}], "unknown": {"entity": "Noah", "unit": "cards"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 8 exercising ['multiply', 'add', 'multiply', 'subtract', 'add', 'subtract', 'divide', 'add'] operations.", "id": "gma-224"}
{"problem": "Ina has 33 shells. Noah has 21 shells. Wren has 27 shells. Sara has 11 shells. Ina gives 9 to Sara. Wren splits them evenly into 3 groups. Ina gets 14 more shells. Ina triples them. She eats 70 shells. Sara splits them evenly into 4 groups. How many shells do they have?", "expected_answer": 79, "expected_unit": "shells", "ground_truth_graph": {"entities": ["Ina", "Noah", "Wren", "Sara"], "initial_state": [{"entity": "Ina", "quantity": {"unit": "shells", "value": 33}}, {"entity": "Noah", "quantity": {"unit": "shells", "value": 21}}, {"entity": "Wren", "quantity": {"unit": "shells", "value": 27}}, {"entity": "Sara", "quantity": {"unit": "shells", "value": 11}}], "operations": [{"actor": "Ina", "kind": "transfer", "operand": {"unit": "shells", "value": 9}, "target": "Sara"}, {"actor": "Wren", "kind": "divide", "operand": {"unit": "shells", "value": 3}}, {"actor": "Ina", "kind": "add", "operand": {"unit": "shells", "value": 14}}, {"actor": "Ina", "kind": "multiply", "operand": {"unit": "shells", "value": 3}}, {"actor": "Ina", "kind": "subtract", "operand": {"unit": "shells", "value": 70}}, {"actor": "Sara", "kind": "divide", "operand": {"unit": "shells", "value": 4}}], "unknown": {"entity": null, "unit": "shells"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 6 exercising ['transfer', 'divide', 'add', 'multiply', 'subtract', 'divide'] operations.", "id": "gma-225"}
{"problem": "Rina has 28 oranges. Yara has 35 oranges. Rina hands 25 oranges to Yara. Rina earns 10 oranges. Yara earns 8 oranges. Rina adds 11 oranges. Rina donates 6. She earns 13 oranges. Rina triples her oranges. How many oranges does Yara have altogether?", "expected_answer": 68, "expected_unit": "oranges", "ground_truth_graph": {"entities": ["Rina", "Yara"], "initial_state": [{"entity": "Rina", "quantity": {"unit": "oranges", "value": 28}}, {"entity": "Yara", "quantity": {"unit": "oranges", "value": 35}}], "operations": [{"actor": "Rina", "kind": "transfer", "operand": {"unit": "oranges", "value": 25}, "target": "Yara"}, {"actor": "Rina", "kind": "add", "operand": {"unit": "oranges", "value": 10}}, {"actor": "Yara", "kind": "add", "operand": {"unit": "oranges", "value": 8}}, {"actor": "Rina", "kind": "add", "operand": {"unit": "oranges", "value": 11}}, {"actor": "Rina", "kind": "subtract", "operand": {"unit": "oranges", "value": 6}}, {"actor": "Rina", "kind": "add", "operand": {"unit": "oranges", "value": 13}}, {"actor": "Rina", "kind": "multiply", "operand": {"unit": "oranges", "value": 3}}], "unknown": {"entity": "Yara", "unit": "oranges"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['transfer', 'transfer', 'add', 'divide', 'subtract', 'add', 'multiply'] operations.", "id": "gma-226"}
{"problem": "Nori has 26 scarves. Gina has 26 scarves. Then she splits them evenly into 2 groups. Nori sends 20 to Gina. Nori doubles them. Nori adds 11 scarves. She removes 2 scarves. Nori triples. Gina finds 14 scarves. How many scarves do they have now?", "expected_answer": 110, "expected_unit": "scarves", "ground_truth_graph": {"entities": ["Nori", "Gina"], "initial_state": [{"entity": "Nori", "quantity": {"unit": "scarves", "value": 26}}, {"entity": "Gina", "quantity": {"unit": "scarves", "value": 26}}], "operations": [{"actor": "Gina", "kind": "divide", "operand": {"unit": "scarves", "value": 2}}, {"actor": "Nori", "kind": "transfer", "operand": {"unit": "scarves", "value": 20}, "target": "Gina"}, {"actor": "Nori", "kind": "multiply", "operand": {"unit": "scarves", "value": 2}}, {"actor": "Nori", "kind": "add", "operand": {"unit": "scarves", "value": 11}}, {"actor": "Nori", "kind": "subtract", "operand": {"unit": "scarves", "value": 2}}, {"actor": "Nori", "kind": "multiply", "operand": {"unit": "scarves", "value": 3}}, {"actor": "Gina", "kind": "add", "operand": {"unit": "scarves", "value": 14}}], "unknown": {"entity": null, "unit": "scarves"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 7 exercising ['divide', 'transfer', 'multiply', 'add', 'subtract', 'multiply', 'add'] operations.", "id": "gma-227"}
{"problem": "Gina has 36 tickets. Tom has 39 tickets. Lisa has 40 tickets. Then she mails 4 to Gina. Lisa doubles them. Lisa adds 6 tickets. Gina buys 11 more tickets. Lisa earns 14 tickets. Lisa splits them evenly into 4 groups. Lisa adds 14 tickets. How many tickets do they have?", "expected_answer": 127, "expected_unit": "tickets", "ground_truth_graph": {"entities": ["Gina", "Tom", "Lisa"], "initial_state": [{"entity": "Gina", "quantity": {"unit": "tickets", "value": 36}}, {"entity": "Tom", "quantity": {"unit": "tickets", "value": 39}}, {"entity": "Lisa", "quantity": {"unit": "tickets", "value": 40}}], "operations": [{"actor": "Lisa", "kind": "transfer", "operand": {"unit": "tickets", "value": 4}, "target": "Gina"}, {"actor": "Lisa", "kind": "multiply", "operand": {"unit": "tickets", "value": 2}}, {"actor": "Lisa", "kind": "add", "operand": {"unit": "tickets", "value": 6}}, {"actor": "Gina", "kind": "add", "operand": {"unit": "tickets", "value": 11}}, {"actor": "Lisa", "kind": "add", "operand": {"unit": "tickets", "value": 14}}, {"actor": "Lisa", "kind": "divide", "operand": {"unit": "tickets", "value": 4}}, {"actor": "Lisa", "kind": "add", "operand": {"unit": "tickets", "value": 14}}], "unknown": {"entity": null, "unit": "tickets"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 7 exercising ['transfer', 'multiply', 'add', 'add', 'add', 'divide', 'add'] operations.", "id": "gma-228"}
{"problem": "Aria has 10 letters. Then she triples. She doubles her letters. She splits them evenly into 4 groups and keeps one group. She splits her letters evenly into 3 groups. Aria triples them. Then she loses 12 letters. How many letters does Aria have in total?", "expected_answer": 3, "expected_unit": "letters", "ground_truth_graph": {"entities": ["Aria"], "initial_state": [{"entity": "Aria", "quantity": {"unit": "letters", "value": 10}}], "operations": [{"actor": "Aria", "kind": "multiply", "operand": {"unit": "letters", "value": 3}}, {"actor": "Aria", "kind": "multiply", "operand": {"unit": "letters", "value": 2}}, {"actor": "Aria", "kind": "divide", "operand": {"unit": "letters", "value": 4}}, {"actor": "Aria", "kind": "divide", "operand": {"unit": "letters", "value": 3}}, {"actor": "Aria", "kind": "multiply", "operand": {"unit": "letters", "value": 3}}, {"actor": "Aria", "kind": "subtract", "operand": {"unit": "letters", "value": 12}}], "unknown": {"entity": "Aria", "unit": "letters"}}, "patterns": ["initial_has", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 6 exercising ['multiply', 'multiply', 'divide', 'divide', 'multiply', 'subtract'] operations.", "id": "gma-229"}
{"problem": "Yara has 10 candies. Yara splits them evenly into 2 groups and keeps one group. Then she triples her candies. Yara splits them evenly into 3 groups. She splits her candies evenly into 5 groups. Yara gets 12 more candies. She buys 10 more candies. She triples her candies. She splits her candies evenly into 3 groups. How many candies does Yara have?", "expected_answer": 23, "expected_unit": "candies", "ground_truth_graph": {"entities": ["Yara"], "initial_state": [{"entity": "Yara", "quantity": {"unit": "candies", "value": 10}}], "operations": [{"actor": "Yara", "kind": "divide", "operand": {"unit": "candies", "value": 2}}, {"actor": "Yara", "kind": "multiply", "operand": {"unit": "candies", "value": 3}}, {"actor": "Yara", "kind": "divide", "operand": {"unit": "candies", "value": 3}}, {"actor": "Yara", "kind": "divide", "operand": {"unit": "candies", "value": 5}}, {"actor": "Yara", "kind": "add", "operand": {"unit": "candies", "value": 12}}, {"actor": "Yara", "kind": "add", "operand": {"unit": "candies", "value": 10}}, {"actor": "Yara", "kind": "multiply", "operand": {"unit": "candies", "value": 3}}, {"actor": "Yara", "kind": "divide", "operand": {"unit": "candies", "value": 3}}], "unknown": {"entity": "Yara", "unit": "candies"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 8 exercising ['divide', 'multiply', 'divide', 'divide', 'subtract', 'divide', 'multiply', 'divide'] operations.", "id": "gma-230"}
{"problem": "Lux has 27 shells. Aria has 11 shells. Jade has 16 shells. Nia has 33 shells. Lux buys 3 more. Nia passes 7 to Lux. She eats 13. Jade splits them evenly into 4 groups. She buys 5 more. Lux gives 3 shells to Nia. How many shells does Nia have?", "expected_answer": 16, "expected_unit": "shells", "ground_truth_graph": {"entities": ["Lux", "Aria", "Jade", "Nia"], "initial_state": [{"entity": "Lux", "quantity": {"unit": "shells", "value": 27}}, {"entity": "Aria", "quantity": {"unit": "shells", "value": 11}}, {"entity": "Jade", "quantity": {"unit": "shells", "value": 16}}, {"entity": "Nia", "quantity": {"unit": "shells", "value": 33}}], "operations": [{"actor": "Lux", "kind": "add", "operand": {"unit": "shells", "value": 3}}, {"actor": "Nia", "kind": "transfer", "operand": {"unit": "shells", "value": 7}, "target": "Lux"}, {"actor": "Nia", "kind": "subtract", "operand": {"unit": "shells", "value": 13}}, {"actor": "Jade", "kind": "divide", "operand": {"unit": "shells", "value": 4}}, {"actor": "Jade", "kind": "add", "operand": {"unit": "shells", "value": 5}}, {"actor": "Lux", "kind": "transfer", "operand": {"unit": "shells", "value": 3}, "target": "Nia"}], "unknown": {"entity": "Nia", "unit": "shells"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 6 exercising ['add', 'transfer', 'subtract', 'divide', 'transfer', 'transfer'] operations.", "id": "gma-231"}
{"problem": "Hugo has 27 pens. He loses 15. Then he triples. Hugo eats 16. Hugo spends 1. Hugo triples them. Hugo gets 3 more. How many pens does Hugo have altogether?", "expected_answer": 60, "expected_unit": "pens", "ground_truth_graph": {"entities": ["Hugo"], "initial_state": [{"entity": "Hugo", "quantity": {"unit": "pens", "value": 27}}], "operations": [{"actor": "Hugo", "kind": "subtract", "operand": {"unit": "pens", "value": 15}}, {"actor": "Hugo", "kind": "multiply", "operand": {"unit": "pens", "value": 3}}, {"actor": "Hugo", "kind": "subtract", "operand": {"unit": "pens", "value": 16}}, {"actor": "Hugo", "kind": "subtract", "operand": {"unit": "pens", "value": 1}}, {"actor": "Hugo", "kind": "multiply", "operand": {"unit": "pens", "value": 3}}, {"actor": "Hugo", "kind": "add", "operand": {"unit": "pens", "value": 3}}], "unknown": {"entity": "Hugo", "unit": "pens"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 6 exercising ['subtract', 'multiply', 'subtract', 'subtract', 'divide', 'add'] operations.", "id": "gma-232"}
{"problem": "Mila has 28 stickers. Mila splits her stickers evenly into 2 groups. Mila triples her stickers. Mila gets 12 more stickers. Mila splits them evenly into 2 groups. Then she spends 21. Then she uses 3 stickers. How many stickers does Mila have left?", "expected_answer": 3, "expected_unit": "stickers", "ground_truth_graph": {"entities": ["Mila"], "initial_state": [{"entity": "Mila", "quantity": {"unit": "stickers", "value": 28}}], "operations": [{"actor": "Mila", "kind": "divide", "operand": {"unit": "stickers", "value": 2}}, {"actor": "Mila", "kind": "multiply", "operand": {"unit": "stickers", "value": 3}}, {"actor": "Mila", "kind": "add", "operand": {"unit": "stickers", "value": 12}}, {"actor": "Mila", "kind": "divide", "operand": {"unit": "stickers", "value": 2}}, {"actor": "Mila", "kind": "subtract", "operand": {"unit": "stickers", "value": 21}}, {"actor": "Mila", "kind": "subtract", "operand": {"unit": "stickers", "value": 3}}], "unknown": {"entity": "Mila", "unit": "stickers"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 6 exercising ['divide', 'multiply', 'add', 'divide', 'subtract', 'subtract'] operations.", "id": "gma-233"}
{"problem": "Oren has 38 scarves. Oren spends 8 scarves. Oren gets 8 more. Oren splits them evenly into 2 groups. He gets 8 more scarves. He splits his scarves evenly into 3 groups. Oren buys 12 more scarves. Oren splits them evenly into 3 groups. How many scarves does Oren have in total?", "expected_answer": 7, "expected_unit": "scarves", "ground_truth_graph": {"entities": ["Oren"], "initial_state": [{"entity": "Oren", "quantity": {"unit": "scarves", "value": 38}}], "operations": [{"actor": "Oren", "kind": "subtract", "operand": {"unit": "scarves", "value": 8}}, {"actor": "Oren", "kind": "add", "operand": {"unit": "scarves", "value": 8}}, {"actor": "Oren", "kind": "divide", "operand": {"unit": "scarves", "value": 2}}, {"actor": "Oren", "kind": "add", "operand": {"unit": "scarves", "value": 8}}, {"actor": "Oren", "kind": "divide", "operand": {"unit": "scarves", "value": 3}}, {"actor": "Oren", "kind": "add", "operand": {"unit": "scarves", "value": 12}}, {"actor": "Oren", "kind": "divide", "operand": {"unit": "scarves", "value": 3}}], "unknown": {"entity": "Oren", "unit": "scarves"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['subtract', 'add', 'divide', 'add', 'divide', 'add', 'divide'] operations.", "id": "gma-234"}
{"problem": "Lux has 17 buttons. Then he earns 13 buttons. Then he gets 6 more. He splits his buttons evenly into 3 groups. Lux splits his buttons evenly into 2 groups and keeps one group. Then he splits them evenly into 3 groups. He splits them evenly into 2 groups. He doubles his buttons. Lux adds 10 buttons. How many buttons does Lux have in total?", "expected_answer": 12, "expected_unit": "buttons", "ground_truth_graph": {"entities": ["Lux"], "initial_state": [{"entity": "Lux", "quantity": {"unit": "buttons", "value": 17}}], "operations": [{"actor": "Lux", "kind": "add", "operand": {"unit": "buttons", "value": 13}}, {"actor": "Lux", "kind": "add", "operand": {"unit": "buttons", "value": 6}}, {"actor": "Lux", "kind": "divide", "operand": {"unit": "buttons", "value": 3}}, {"actor": "Lux", "kind": "divide", "operand": {"unit": "buttons", "value": 2}}, {"actor": "Lux", "kind": "divide", "operand": {"unit": "buttons", "value": 3}}, {"actor": "Lux", "kind": "divide", "operand": {"unit": "buttons", "value": 2}}, {"actor": "Lux", "kind": "multiply", "operand": {"unit": "buttons", "value": 2}}, {"actor": "Lux", "kind": "add", "operand": {"unit": "buttons", "value": 10}}], "unknown": {"entity": "Lux", "unit": "buttons"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 8 exercising ['add', 'add', 'divide', 'divide', 'divide', 'divide', 'multiply', 'subtract'] operations.", "id": "gma-235"}
{"problem": "Aria has 39 pencils. Aria splits her pencils evenly into 3 groups. Aria triples her pencils. Aria sells 31 pencils. She splits them evenly into 4 groups. Aria adds 10 pencils. Then she eats 4. How many pencils does Aria have altogether?", "expected_answer": 8, "expected_unit": "pencils", "ground_truth_graph": {"entities": ["Aria"], "initial_state": [{"entity": "Aria", "quantity": {"unit": "pencils", "value": 39}}], "operations": [{"actor": "Aria", "kind": "divide", "operand": {"unit": "pencils", "value": 3}}, {"actor": "Aria", "kind": "multiply", "operand": {"unit": "pencils", "value": 3}}, {"actor": "Aria", "kind": "subtract", "operand": {"unit": "pencils", "value": 31}}, {"actor": "Aria", "kind": "divide", "operand": {"unit": "pencils", "value": 4}}, {"actor": "Aria", "kind": "add", "operand": {"unit": "pencils", "value": 10}}, {"actor": "Aria", "kind": "subtract", "operand": {"unit": "pencils", "value": 4}}], "unknown": {"entity": "Aria", "unit": "pencils"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 6 exercising ['divide', 'divide', 'subtract', 'divide', 'add', 'subtract'] operations.", "id": "gma-236"}
{"problem": "Hugo has 40 buttons. Gina has 18 buttons. She drops 5 buttons. Hugo spends 24. Then he sends 4 to Gina. Then he sells 6 buttons. Hugo sends 4 to Gina. Gina removes 14 buttons. Hugo finds 7 buttons. Hugo triples them. How many buttons do they have altogether?", "expected_answer": 34, "expected_unit": "buttons", "ground_truth_graph": {"entities": ["Hugo", "Gina"], "initial_state": [{"entity": "Hugo", "quantity": {"unit": "buttons", "value": 40}}, {"entity": "Gina", "quantity": {"unit": "buttons", "value": 18}}], "operations": [{"actor": "Gina", "kind": "subtract", "operand": {"unit": "buttons", "value": 5}}, {"actor": "Hugo", "kind": "subtract", "operand": {"unit": "buttons", "value": 24}}, {"actor": "Hugo", "kind": "transfer", "operand": {"unit": "buttons", "value": 4}, "target": "Gina"}, {"actor": "Hugo", "kind": "subtract", "operand": {"unit": "buttons", "value": 6}}, {"actor": "Hugo", "kind": "transfer", "operand": {"unit": "buttons", "value": 4}, "target": "Gina"}, {"actor": "Gina", "kind": "subtract", "operand": {"unit": "buttons", "value": 14}}, {"actor": "Hugo", "kind": "add", "operand": {"unit": "buttons", "value": 7}}, {"actor": "Hugo", "kind": "multiply", "operand": {"unit": "buttons", "value": 3}}], "unknown": {"entity": null, "unit": "buttons"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 8 exercising ['subtract', 'subtract', 'transfer', 'subtract', 'transfer', 'subtract', 'subtract', 'multiply'] operations.", "id": "gma-237"}
{"problem": "Uma has 33 stamps. She splits them evenly into 3 groups. She receives 4 stamps. She removes 6. Uma doubles. Then she splits them evenly into 2 groups. Uma drops 7 stamps. Uma gets 15 more. Uma triples them. How many stamps does Uma have now?", "expected_answer": 51, "expected_unit": "stamps", "ground_truth_graph": {"entities": ["Uma"], "initial_state": [{"entity": "Uma", "quantity": {"unit": "stamps", "value": 33}}], "operations": [{"actor": "Uma", "kind": "divide", "operand": {"unit": "stamps", "value": 3}}, {"actor": "Uma", "kind": "add", "operand": {"unit": "stamps", "value": 4}}, {"actor": "Uma", "kind": "subtract", "operand": {"unit": "stamps", "value": 6}}, {"actor": "Uma", "kind": "multiply", "operand": {"unit": "stamps", "value": 2}}, {"actor": "Uma", "kind": "divide", "operand": {"unit": "stamps", "value": 2}}, {"actor": "Uma", "kind": "subtract", "operand": {"unit": "stamps", "value": 7}}, {"actor": "Uma", "kind": "add", "operand": {"unit": "stamps", "value": 15}}, {"actor": "Uma", "kind": "multiply", "operand": {"unit": "stamps", "value": 3}}], "unknown": {"entity": "Uma", "unit": "stamps"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 8 exercising ['divide', 'add', 'subtract', 'multiply', 'divide', 'subtract', 'add', 'multiply'] operations.", "id": "gma-238"}
{"problem": "Tara has 34 tickets. Ruth has 27 tickets. Noah has 22 tickets. Quinn has 15 tickets. Noah buys 9 more tickets. Tara splits them evenly into 2 groups and keeps one group. Then she finds 7 tickets. Noah sells 2 tickets. Tara doubles them. Quinn passes 8 tickets to Ruth. Ruth triples. How many tickets does Tara have now?", "expected_answer": 48, "expected_unit": "tickets", "ground_truth_graph": {"entities": ["Tara", "Ruth", "Noah", "Quinn"], "initial_state": [{"entity": "Tara", "quantity": {"unit": "tickets", "value": 34}}, {"entity": "Ruth", "quantity": {"unit": "tickets", "value": 27}}, {"entity": "Noah", "quantity": {"unit": "tickets", "value": 22}}, {"entity": "Quinn", "quantity": {"unit": "tickets", "value": 15}}], "operations": [{"actor": "Noah", "kind": "add", "operand": {"unit": "tickets", "value": 9}}, {"actor": "Tara", "kind": "divide", "operand": {"unit": "tickets", "value": 2}}, {"actor": "Tara", "kind": "add", "operand": {"unit": "tickets", "value": 7}}, {"actor": "Noah", "kind": "subtract", "operand": {"unit": "tickets", "value": 2}}, {"actor": "Tara", "kind": "multiply", "operand": {"unit": "tickets", "value": 2}}, {"actor": "Quinn", "kind": "transfer", "operand": {"unit": "tickets", "value": 8}, "target": "Ruth"}, {"actor": "Ruth", "kind": "multiply", "operand": {"unit": "tickets", "value": 3}}], "unknown": {"entity": "Tara", "unit": "tickets"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['add', 'divide', 'add', 'subtract', 'multiply', 'transfer', 'multiply'] operations.", "id": "gma-239"}
{"problem": "Uma has 29 crayons. Uma earns 10 crayons. She buys 7 more crayons. She adds 8 crayons. Uma drops 30 crayons. Then she splits them evenly into 2 groups. Uma doubles her crayons. Uma splits them evenly into 2 groups. How many crayons does Uma have now?", "expected_answer": 12, "expected_unit": "crayons", "ground_truth_graph": {"entities": ["Uma"], "initial_state": [{"entity": "Uma", "quantity": {"unit": "crayons", "value": 29}}], "operations": [{"actor": "Uma", "kind": "add", "operand": {"unit": "crayons", "value": 10}}, {"actor": "Uma", "kind": "add", "operand": {"unit": "crayons", "value": 7}}, {"actor": "Uma", "kind": "add", "operand": {"unit": "crayons", "value": 8}}, {"actor": "Uma", "kind": "subtract", "operand": {"unit": "crayons", "value": 30}}, {"actor": "Uma", "kind": "divide", "operand": {"unit": "crayons", "value": 2}}, {"actor": "Uma", "kind": "multiply", "operand": {"unit": "crayons", "value": 2}}, {"actor": "Uma", "kind": "divide", "operand": {"unit": "crayons", "value": 2}}], "unknown": {"entity": "Uma", "unit": "crayons"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['divide', 'add', 'add', 'subtract', 'divide', 'multiply', 'divide'] operations.", "id": "gma-240"}
{"problem": "Lena has 19 stickers. Nori has 21 stickers. Then she doubles her stickers. Nori triples them. She buys 2 more. She earns 10 stickers. Nori receives 15 stickers. She splits them evenly into 3 groups. Nori splits them evenly into 3 groups and keeps one group. She buys 9 more. How many stickers do they have altogether?", "expected_answer": 45, "expected_unit": "stickers", "ground_truth_graph": {"entities": ["Lena", "Nori"], "initial_state": [{"entity": "Lena", "quantity": {"unit": "stickers", "value": 19}}, {"entity": "Nori", "quantity": {"unit": "stickers", "value": 21}}], "operations": [{"actor": "Nori", "kind": "multiply", "operand": {"unit": "stickers", "value": 2}}, {"actor": "Nori", "kind": "multiply", "operand": {"unit": "stickers", "value": 3}}, {"actor": "Nori", "kind": "add", "operand": {"unit": "stickers", "value": 2}}, {"actor": "Nori", "kind": "add", "operand": {"unit": "stickers", "value": 10}}, {"actor": "Nori", "kind": "add", "operand": {"unit": "stickers", "value": 15}}, {"actor": "Nori", "kind": "divide", "operand": {"unit": "stickers", "value": 3}}, {"actor": "Nori", "kind": "divide", "operand": {"unit": "stickers", "value": 3}}, {"actor": "Nori", "kind": "add", "operand": {"unit": "stickers", "value": 9}}], "unknown": {"entity": null, "unit": "stickers"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "question_how_many_total"], "notes": "Original authored case of depth 8 exercising ['multiply', 'multiply', 'add', 'add', 'add', 'divide', 'divide', 'add'] operations.", "id": "gma-241"}
{"problem": "Milo has 29 letters. Tara has 27 letters. Jay has 35 letters. He doubles them. Milo spends 1. Jay uses 12. He earns 10 letters. Then he buys 5 more letters. Milo buys 3 more letters. Jay passes 1 letters to Milo. How many letters do they have?", "expected_answer": 131, "expected_unit": "letters", "ground_truth_graph": {"entities": ["Milo", "Tara", "Jay"], "initial_state": [{"entity": "Milo", "quantity": {"unit": "letters", "value": 29}}, {"entity": "Tara", "quantity": {"unit": "letters", "value": 27}}, {"entity": "Jay", "quantity": {"unit": "letters", "value": 35}}], "operations": [{"actor": "Jay", "kind": "multiply", "operand": {"unit": "letters", "value": 2}}, {"actor": "Milo", "kind": "subtract", "operand": {"unit": "letters", "value": 1}}, {"actor": "Jay", "kind": "subtract", "operand": {"unit": "letters", "value": 12}}, {"actor": "Jay", "kind": "add", "operand": {"unit": "letters", "value": 10}}, {"actor": "Jay", "kind": "add", "operand": {"unit": "letters", "value": 5}}, {"actor": "Milo", "kind": "add", "operand": {"unit": "letters", "value": 3}}, {"actor": "Jay", "kind": "transfer", "operand": {"unit": "letters", "value": 1}, "target": "Milo"}], "unknown": {"entity": null, "unit": "letters"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 7 exercising ['multiply', 'subtract', 'subtract', 'add', 'add', 'add', 'transfer'] operations.", "id": "gma-242"}
{"problem": "Rina has 35 marbles. Tara has 18 marbles. Nori has 24 marbles. Lux has 24 marbles. Tara doubles her marbles. Nori splits her marbles evenly into 2 groups. She sends 1 marbles to Rina. Lux sends 20 marbles to Rina. Lux receives 9 marbles. Tara donates 21 marbles. How many marbles do they have altogether?", "expected_answer": 95, "expected_unit": "marbles", "ground_truth_graph": {"entities": ["Rina", "Tara", "Nori", "Lux"], "initial_state": [{"entity": "Rina", "quantity": {"unit": "marbles", "value": 35}}, {"entity": "Tara", "quantity": {"unit": "marbles", "value": 18}}, {"entity": "Nori", "quantity": {"unit": "marbles", "value": 24}}, {"entity": "Lux", "quantity": {"unit": "marbles", "value": 24}}], "operations": [{"actor": "Tara", "kind": "multiply", "operand": {"unit": "marbles", "value": 2}}, {"actor": "Nori", "kind": "divide", "operand": {"unit": "marbles", "value": 2}}, {"actor": "Nori", "kind": "transfer", "operand": {"unit": "marbles", "value": 1}, "target": "Rina"}, {"actor": "Lux", "kind": "transfer", "operand": {"unit": "marbles", "value": 20}, "target": "Rina"}, {"actor": "Lux", "kind": "add", "operand": {"unit": "marbles", "value": 9}}, {"actor": "Tara", "kind": "subtract", "operand": {"unit": "marbles", "value": 21}}], "unknown": {"entity": null, "unit": "marbles"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 6 exercising ['multiply', 'divide', 'transfer', 'transfer', 'transfer', 'subtract'] operations.", "id": "gma-243"}
{"problem": "Pia has 22 scarves. Cora has 20 scarves. Nia has 27 scarves. Pia gets 6 more scarves. Cora sends 16 scarves to Nia. She triples her scarves. Pia adds 5 scarves. She splits her scarves evenly into 3 groups and keeps one group. Nia triples. Then she donates 110. How many scarves do they have now?", "expected_answer": 42, "expected_unit": "scarves", "ground_truth_graph": {"entities": ["Pia", "Cora", "Nia"], "initial_state": [{"entity": "Pia", "quantity": {"unit": "scarves", "value": 22}}, {"entity": "Cora", "quantity": {"unit": "scarves", "value": 20}}, {"entity": "Nia", "quantity": {"unit": "scarves", "value": 27}}], "operations": [{"actor": "Pia", "kind": "add", "operand": {"unit": "scarves", "value": 6}}, {"actor": "Cora", "kind": "transfer", "operand": {"unit": "scarves", "value": 16}, "target": "Nia"}, {"actor": "Cora", "kind": "multiply", "operand": {"unit": "scarves", "value": 3}}, {"actor": "Pia", "kind": "add", "operand": {"unit": "scarves", "value": 5}}, {"actor": "Pia", "kind": "divide", "operand": {"unit": "scarves", "value": 3}}, {"actor": "Nia", "kind": "multiply", "operand": {"unit": "scarves", "value": 3}}, {"actor": "Nia", "kind": "subtract", "operand": {"unit": "scarves", "value": 110}}], "unknown": {"entity": null, "unit": "scarves"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 7 exercising ['add', 'transfer', 'multiply', 'add', 'divide', 'multiply', 'subtract'] operations.", "id": "gma-244"}
{"problem": "Ben has 14 marbles. Gwen has 17 marbles. Clara has 15 marbles. Ben doubles. Gwen passes 11 to Clara. Then she splits them evenly into 3 groups and keeps one group. She adds 8 marbles. Ben buys 3 more. He finds 4 marbles. Ben eats 27 marbles. How many marbles do they have left?", "expected_answer": 44, "expected_unit": "marbles", "ground_truth_graph": {"entities": ["Ben", "Gwen", "Clara"], "initial_state": [{"entity": "Ben", "quantity": {"unit": "marbles", "value": 14}}, {"entity": "Gwen", "quantity": {"unit": "marbles", "value": 17}}, {"entity": "Clara", "quantity": {"unit": "marbles", "value": 15}}], "operations": [{"actor": "Ben", "kind": "multiply", "operand": {"unit": "marbles", "value": 2}}, {"actor": "Gwen", "kind": "transfer", "operand": {"unit": "marbles", "value": 11}, "target": "Clara"}, {"actor": "Gwen", "kind": "divide", "operand": {"unit": "marbles", "value": 3}}, {"actor": "Gwen", "kind": "add", "operand": {"unit": "marbles", "value": 8}}, {"actor": "Ben", "kind": "add", "operand": {"unit": "marbles", "value": 3}}, {"actor": "Ben", "kind": "add", "operand": {"unit": "marbles", "value": 4}}, {"actor": "Ben", "kind": "subtract", "operand": {"unit": "marbles", "value": 27}}], "unknown": {"entity": null, "unit": "marbles"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_total"], "notes": "Original authored case of depth 7 exercising ['multiply', 'transfer', 'divide', 'subtract', 'add', 'add', 'subtract'] operations.", "id": "gma-245"}
{"problem": "Leo has 19 marbles. Hugo has 34 marbles. Then he passes 8 marbles to Leo. Leo triples his marbles. He splits them evenly into 3 groups and keeps one group. He triples his marbles. He buys 14 more. Hugo buys 6 more. Leo eats 39. How many marbles does Hugo have now?", "expected_answer": 32, "expected_unit": "marbles", "ground_truth_graph": {"entities": ["Leo", "Hugo"], "initial_state": [{"entity": "Leo", "quantity": {"unit": "marbles", "value": 19}}, {"entity": "Hugo", "quantity": {"unit": "marbles", "value": 34}}], "operations": [{"actor": "Hugo", "kind": "transfer", "operand": {"unit": "marbles", "value": 8}, "target": "Leo"}, {"actor": "Leo", "kind": "multiply", "operand": {"unit": "marbles", "value": 3}}, {"actor": "Leo", "kind": "divide", "operand": {"unit": "marbles", "value": 3}}, {"actor": "Leo", "kind": "multiply", "operand": {"unit": "marbles", "value": 3}}, {"actor": "Leo", "kind": "add", "operand": {"unit": "marbles", "value": 14}}, {"actor": "Hugo", "kind": "add", "operand": {"unit": "marbles", "value": 6}}, {"actor": "Leo", "kind": "subtract", "operand": {"unit": "marbles", "value": 39}}], "unknown": {"entity": "Hugo", "unit": "marbles"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['transfer', 'multiply', 'divide', 'multiply', 'add', 'add', 'subtract'] operations.", "id": "gma-246"}
{"problem": "Nia has 39 pencils. Noah has 17 pencils. Lux has 35 pencils. Then he removes 7 pencils. Then he triples. Lux passes 34 pencils to Nia. Noah triples his pencils. Lux gives 7 to Noah. Noah gives 54 to Lux. Then he buys 9 more. How many pencils does Lux have in total?", "expected_answer": 97, "expected_unit": "pencils", "ground_truth_graph": {"entities": ["Nia", "Noah", "Lux"], "initial_state": [{"entity": "Nia", "quantity": {"unit": "pencils", "value": 39}}, {"entity": "Noah", "quantity": {"unit": "pencils", "value": 17}}, {"entity": "Lux", "quantity": {"unit": "pencils", "value": 35}}], "operations": [{"actor": "Lux", "kind": "subtract", "operand": {"unit": "pencils", "value": 7}}, {"actor": "Lux", "kind": "multiply", "operand": {"unit": "pencils", "value": 3}}, {"actor": "Lux", "kind": "transfer", "operand": {"unit": "pencils", "value": 34}, "target": "Nia"}, {"actor": "Noah", "kind": "multiply", "operand": {"unit": "pencils", "value": 3}}, {"actor": "Lux", "kind": "transfer", "operand": {"unit": "pencils", "value": 7}, "target": "Noah"}, {"actor": "Noah", "kind": "transfer", "operand": {"unit": "pencils", "value": 54}, "target": "Lux"}, {"actor": "Noah", "kind": "add", "operand": {"unit": "pencils", "value": 9}}], "unknown": {"entity": "Lux", "unit": "pencils"}}, "patterns": ["initial_has", "operation_add", "operation_multiply", "operation_subtract", "operation_transfer", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['subtract', 'multiply', 'transfer', 'multiply', 'transfer', 'transfer', 'add'] operations.", "id": "gma-247"}
{"problem": "Gina has 33 crayons. Then she splits them evenly into 3 groups. Then she buys 3 more. She triples. Gina triples them. Gina triples her crayons. Then she triples her crayons. She triples them. How many crayons does Gina have?", "expected_answer": 3402, "expected_unit": "crayons", "ground_truth_graph": {"entities": ["Gina"], "initial_state": [{"entity": "Gina", "quantity": {"unit": "crayons", "value": 33}}], "operations": [{"actor": "Gina", "kind": "divide", "operand": {"unit": "crayons", "value": 3}}, {"actor": "Gina", "kind": "add", "operand": {"unit": "crayons", "value": 3}}, {"actor": "Gina", "kind": "multiply", "operand": {"unit": "crayons", "value": 3}}, {"actor": "Gina", "kind": "multiply", "operand": {"unit": "crayons", "value": 3}}, {"actor": "Gina", "kind": "multiply", "operand": {"unit": "crayons", "value": 3}}, {"actor": "Gina", "kind": "multiply", "operand": {"unit": "crayons", "value": 3}}, {"actor": "Gina", "kind": "multiply", "operand": {"unit": "crayons", "value": 3}}], "unknown": {"entity": "Gina", "unit": "crayons"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['divide', 'add', 'multiply', 'multiply', 'multiply', 'multiply', 'multiply'] operations.", "id": "gma-248"}
{"problem": "Rina has 22 dollars. Then she splits her dollars evenly into 2 groups. Then she removes 9 dollars. Rina gets 2 more. She doubles her dollars. She splits them evenly into 2 groups. Then she receives 14 dollars. Rina splits her dollars evenly into 2 groups. How many dollars does Rina have altogether?", "expected_answer": 9, "expected_unit": "dollars", "ground_truth_graph": {"entities": ["Rina"], "initial_state": [{"entity": "Rina", "quantity": {"unit": "dollars", "value": 22}}], "operations": [{"actor": "Rina", "kind": "divide", "operand": {"unit": "dollars", "value": 2}}, {"actor": "Rina", "kind": "subtract", "operand": {"unit": "dollars", "value": 9}}, {"actor": "Rina", "kind": "add", "operand": {"unit": "dollars", "value": 2}}, {"actor": "Rina", "kind": "multiply", "operand": {"unit": "dollars", "value": 2}}, {"actor": "Rina", "kind": "divide", "operand": {"unit": "dollars", "value": 2}}, {"actor": "Rina", "kind": "add", "operand": {"unit": "dollars", "value": 14}}, {"actor": "Rina", "kind": "divide", "operand": {"unit": "dollars", "value": 2}}], "unknown": {"entity": "Rina", "unit": "dollars"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['divide', 'subtract', 'subtract', 'multiply', 'divide', 'add', 'divide'] operations.", "id": "gma-249"}
{"problem": "Sam has 33 kites. Then he gets 15 more. Then he splits them evenly into 3 groups. Sam loses 6. He removes 7 kites. Sam splits them evenly into 3 groups and keeps one group. Sam doubles his kites. He gets 15 more kites. How many kites does Sam have altogether?", "expected_answer": 17, "expected_unit": "kites", "ground_truth_graph": {"entities": ["Sam"], "initial_state": [{"entity": "Sam", "quantity": {"unit": "kites", "value": 33}}], "operations": [{"actor": "Sam", "kind": "add", "operand": {"unit": "kites", "value": 15}}, {"actor": "Sam", "kind": "divide", "operand": {"unit": "kites", "value": 3}}, {"actor": "Sam", "kind": "subtract", "operand": {"unit": "kites", "value": 6}}, {"actor": "Sam", "kind": "subtract", "operand": {"unit": "kites", "value": 7}}, {"actor": "Sam", "kind": "divide", "operand": {"unit": "kites", "value": 3}}, {"actor": "Sam", "kind": "multiply", "operand": {"unit": "kites", "value": 2}}, {"actor": "Sam", "kind": "add", "operand": {"unit": "kites", "value": 15}}], "unknown": {"entity": "Sam", "unit": "kites"}}, "patterns": ["initial_has", "operation_add", "operation_divide", "operation_multiply", "operation_subtract", "question_how_many_entity"], "notes": "Original authored case of depth 7 exercising ['add', 'divide', 'subtract', 'subtract', 'divide', 'divide', 'add'] operations.", "id": "gma-250"}

107
evals/gsm8k_math/verify.py Normal file
View file

@ -0,0 +1,107 @@
#!/usr/bin/env python3
import json
import sys
from collections import defaultdict
from pathlib import Path
# Add the workspace root to sys.path
sys.path.insert(0, str(Path(__file__).resolve().parents[2]))
from generate.math_parser import parse_problem, ParseError
from generate.math_problem_graph import graph_from_dict
from generate.math_solver import solve, SolveError
def verify_cases():
root = Path(__file__).resolve().parents[2]
dev_path = root / "evals/gsm8k_math/dev/cases.jsonl"
public_path = root / "evals/gsm8k_math/public/v1/cases.jsonl"
cases = []
for path in (dev_path, public_path):
if not path.exists():
print(f"Error: file not found at {path}")
return False
with open(path, "r", encoding="utf-8") as f:
for line in f:
if line.strip():
cases.append(json.loads(line))
if len(cases) != 200:
print(f"Error: expected exactly 200 cases total, got {len(cases)}")
return False
# Check distributions
depth_counts = defaultdict(int)
op_counts = defaultdict(int)
multi_entity_count = 0
passed = 0
for case in cases:
case_id = case.get("id", "unknown")
problem = case["problem"]
expected_ans = case["expected_answer"]
expected_unit = case["expected_unit"]
gt_dict = case["ground_truth_graph"]
try:
# 1. Parse
parsed_graph = parse_problem(problem)
# 2. Match GT graph
gt_graph_obj = graph_from_dict(gt_dict)
if parsed_graph.canonical_bytes() != gt_graph_obj.canonical_bytes():
print(f"FAIL {case_id}: Graph canonical bytes mismatch.")
continue
# 3. Solve and match answer
trace = solve(parsed_graph)
if trace.answer_value != expected_ans:
print(f"FAIL {case_id}: Answer value mismatch. Expected {expected_ans}, got {trace.answer_value}")
continue
# 4. Match unit
if trace.answer_unit != expected_unit:
print(f"FAIL {case_id}: Answer unit mismatch. Expected {expected_unit!r}, got {trace.answer_unit!r}")
continue
passed += 1
# Record stats
depth = len(gt_dict["operations"])
if depth == 1:
depth_counts[1] += 1
elif 2 <= depth <= 3:
depth_counts["2-3"] += 1
elif 4 <= depth <= 5:
depth_counts["4-5"] += 1
elif 6 <= depth <= 8:
depth_counts["6-8"] += 1
else:
depth_counts["OOD"] += 1
for op in gt_dict["operations"]:
op_counts[op["kind"]] += 1
if len(gt_dict["entities"]) >= 2:
multi_entity_count += 1
except (ParseError, SolveError, Exception) as e:
print(f"FAIL {case_id}: Exception raised - {type(e).__name__}: {e}")
continue
print(f"\n--- Verification Stats ---")
print(f"Cases parsed and solved successfully: {passed}/200")
print(f"Depth distribution: {dict(depth_counts)}")
print(f"Operation distribution: {dict(op_counts)}")
print(f"Multi-entity cases: {multi_entity_count}")
if passed == 200:
print("\n200/200 OK")
return True
else:
print(f"\nFAIL: Only {passed}/200 cases passed verification.")
return False
if __name__ == "__main__":
success = verify_cases()
sys.exit(0 if success else 1)