STRIVE · 08/28/2026
Prefill sample 13
One shared clip across Baselines 1, 2, 3, and E2E, including exactly what was injected.
Ground-truth Sentinel
[SCENE-START] [OBJS-START] [OBJ] 0 "brown and orange leather wingtip shoe" 0 24 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 "white plastic lutein supplement bottle" 0 24 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 15 17 474 18 9 466 19 9 505 21 1 501 23 null null [OBJ] 2 "wooden spelling toy" 0 24 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 14 443 318 15 458 318 16 482 310 17 494 302 18 544 310 19 537 294 20 556 291 21 591 298 22 591 287 23 615 291 [OBJ] 3 "khaki fabric boat shoe" 0 24 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 14 134 638 [OBJ] 4 "black cardboard Asus Z97I-PLUS motherboard box" 0 24 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 14 83 267 22 103 275 [OBJ] 5 "brown ceramic flower pot" 0 24 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 15 138 486 18 130 482 19 123 478 20 123 490 21 115 486 [OBJ] 6 "blush metallic leather ballet flat" 0 24 [PX] 0 220 599 2 228 603 5 220 607 18 212 599 20 201 595 [OBJ] 7 "multicolored cardboard Scrabble game" 0 24 [PX] 0 291 548 3 298 552 [OBJ] 8 "glittery rose gold leather ballet flat" 0 24 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 14 357 513 17 380 458 20 388 451 [OBJ] 9 "light yellow and dark blue cardboard whey protein box" 0 24 [PX] 0 478 193 [OBJ] 10 "yellow plastic toy school bus" 0 24 [PX] 0 525 552 11 521 560 [OBJ] 11 "yellow wooden toy roller" 0 24 [PX] 0 669 80 21 666 72 [OBJ] 12 "multi-colored wooden roller" 0 24 [PX] 0 697 197 17 689 193 22 705 177 [OBJ] 13 "black can opener" 0 24 [PX] 0 791 755 [OBJ] 14 "white and orange cardboard cosmetic box" 0 24 [PX] 0 822 68 [OBJ] 15 "dark grey metallic cake pan set" 0 24 [PX] 0 919 720 [OBJ] 16 "black cardboard motherboard box" 4 24 [PX] 0 null null 4 1 373 9 null null 18 1 373 22 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 4 "contact" 0 1 [IN] 1 5 [OUT] 1 5 [INTERACT] 26 "contact" 0 1 [IN] 3 5 [OUT] 3 5 [INTERACT] 37 "contact" 0 1 [IN] 5 8 [OUT] 5 8 [INTERACT] 0 "contact" 0 6 [IN] 0 3 [OUT] 0 3 [INTERACT] 29 "contact" 0 7 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 36 "contact" 0 15 [IN] 5 7 [OUT] 5 7 [INTERACT] 34 "contact" 0 17 [IN] 5 6 [OUT] 5 6 [INTERACT] 3 "contact" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 6 "contact" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 32 "contact" 0 23 [IN] 4 16 [OUT] 4 16 [INTERACT] 33 "contact" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 35 "contact" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 39 "contact" 0 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 40 "contact" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 46 "contact" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 47 "contact" 0 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 7 "contact" 0 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 8 "contact" 0 23 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 9 "contact" 0 23 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 10 "contact" 0 23 [IN] 13 15 [OUT] 13 15 [INTERACT] 11 "contact" 0 23 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 12 "contact" 0 23 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 13 "contact" 0 23 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 14 "contact" 0 23 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 17 "collision" 1 1 [IN] 2 5 [OUT] 2 5 [INTERACT] 43 "collision" 2 3 [IN] 7 8 [OUT] 7 8 [INTERACT] 18 "contact" 2 4 [IN] 2 5 [OUT] 2 5 [INTERACT] 38 "collision" 5 6 [IN] 5 8 [OUT] 5 8 [INTERACT] 25 "collision" 6 6 [IN] 2 8 [OUT] 2 8 [INTERACT] 23 "collision" 6 6 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 44 "collision" 6 6 [IN] 7 8 [OUT] 7 8 [INTERACT] 24 "collision" 8 8 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 45 "collision" 8 8 [IN] 8 10 [OUT] 8 10 [INTERACT] 31 "collision" 9 9 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 19 "collision" 10 10 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 30 "contact" 10 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 20 "contact" 11 13 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 41 "collision" 14 14 [IN] 7 8 [OUT] 7 8 [INTERACT] 5 "collision" 15 15 [IN] 1 5 [OUT] 1 5 [INTERACT] 21 "collision" 15 15 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 42 "contact" 15 23 [IN] 7 8 [OUT] 7 8 [INTERACT] 27 "collision" 16 16 [IN] 3 5 [OUT] 3 5 [INTERACT] 22 "contact" 16 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 28 "contact" 17 23 [IN] 3 5 [OUT] 3 5 [INTERACT] 1 "collision" 21 21 [IN] 0 5 [OUT] 0 5 [INTERACT] 15 "collision" 21 21 [IN] 2 12 [OUT] 2 12 [INTERACT] 2 "contact" 22 23 [IN] 0 5 [OUT] 0 5 [INTERACT] 16 "contact" 22 23 [IN] 2 12 [OUT] 2 12 [INTERACTIONS-END] [SCENE-END]
Parsed ground truth
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 9,
"y": 650
},
{
"t": 4,
"x": 13,
"y": 634
},
{
"t": 5,
"x": 13,
"y": 611
}
],
"birth": 0,
"death": 24,
"type": "brown and orange leather wingtip shoe"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 13,
"y": 470
},
{
"t": 1,
"x": 25,
"y": 466
},
{
"t": 2,
"x": 13,
"y": 466
},
{
"t": 6,
"x": 13,
"y": 501
},
{
"t": 10,
"x": 9,
"y": 470
},
{
"t": 15,
"x": 17,
"y": 474
},
{
"t": 18,
"x": 9,
"y": 466
},
{
"t": 19,
"x": 9,
"y": 505
},
{
"t": 21,
"x": 1,
"y": 501
},
{
"t": 23,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "white plastic lutein supplement bottle"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 37,
"y": 146
},
{
"t": 1,
"x": 83,
"y": 142
},
{
"t": 2,
"x": 134,
"y": 169
},
{
"t": 3,
"x": 181,
"y": 197
},
{
"t": 4,
"x": 224,
"y": 232
},
{
"t": 5,
"x": 267,
"y": 267
},
{
"t": 6,
"x": 302,
"y": 294
},
{
"t": 7,
"x": 333,
"y": 314
},
{
"t": 8,
"x": 361,
"y": 322
},
{
"t": 9,
"x": 380,
"y": 318
},
{
"t": 10,
"x": 416,
"y": 314
},
{
"t": 11,
"x": 384,
"y": 314
},
{
"t": 12,
"x": 408,
"y": 314
},
{
"t": 13,
"x": 431,
"y": 314
},
{
"t": 14,
"x": 443,
"y": 318
},
{
"t": 15,
"x": 458,
"y": 318
},
{
"t": 16,
"x": 482,
"y": 310
},
{
"t": 17,
"x": 494,
"y": 302
},
{
"t": 18,
"x": 544,
"y": 310
},
{
"t": 19,
"x": 537,
"y": 294
},
{
"t": 20,
"x": 556,
"y": 291
},
{
"t": 21,
"x": 591,
"y": 298
},
{
"t": 22,
"x": 591,
"y": 287
},
{
"t": 23,
"x": 615,
"y": 291
}
],
"birth": 0,
"death": 24,
"type": "wooden spelling toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 44,
"y": 626
},
{
"t": 3,
"x": 44,
"y": 615
},
{
"t": 4,
"x": 68,
"y": 630
},
{
"t": 5,
"x": 80,
"y": 626
},
{
"t": 6,
"x": 91,
"y": 630
},
{
"t": 7,
"x": 103,
"y": 634
},
{
"t": 8,
"x": 111,
"y": 638
},
{
"t": 9,
"x": 103,
"y": 611
},
{
"t": 10,
"x": 111,
"y": 615
},
{
"t": 11,
"x": 123,
"y": 630
},
{
"t": 14,
"x": 134,
"y": 638
}
],
"birth": 0,
"death": 24,
"type": "khaki fabric boat shoe"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 119,
"y": 263
},
{
"t": 1,
"x": 146,
"y": 275
},
{
"t": 2,
"x": 41,
"y": 216
},
{
"t": 3,
"x": 56,
"y": 236
},
{
"t": 4,
"x": 72,
"y": 255
},
{
"t": 5,
"x": 87,
"y": 275
},
{
"t": 6,
"x": 91,
"y": 283
},
{
"t": 12,
"x": 87,
"y": 275
},
{
"t": 14,
"x": 83,
"y": 267
},
{
"t": 22,
"x": 103,
"y": 275
}
],
"birth": 0,
"death": 24,
"type": "black cardboard Asus Z97I-PLUS motherboard box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 134,
"y": 478
},
{
"t": 4,
"x": 142,
"y": 458
},
{
"t": 7,
"x": 146,
"y": 451
},
{
"t": 9,
"x": 142,
"y": 458
},
{
"t": 13,
"x": 134,
"y": 478
},
{
"t": 15,
"x": 138,
"y": 486
},
{
"t": 18,
"x": 130,
"y": 482
},
{
"t": 19,
"x": 123,
"y": 478
},
{
"t": 20,
"x": 123,
"y": 490
},
{
"t": 21,
"x": 115,
"y": 486
}
],
"birth": 0,
"death": 24,
"type": "brown ceramic flower pot"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 220,
"y": 599
},
{
"t": 2,
"x": 228,
"y": 603
},
{
"t": 5,
"x": 220,
"y": 607
},
{
"t": 18,
"x": 212,
"y": 599
},
{
"t": 20,
"x": 201,
"y": 595
}
],
"birth": 0,
"death": 24,
"type": "blush metallic leather ballet flat"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 291,
"y": 548
},
{
"t": 3,
"x": 298,
"y": 552
}
],
"birth": 0,
"death": 24,
"type": "multicolored cardboard Scrabble game"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 306,
"y": 470
},
{
"t": 6,
"x": 326,
"y": 482
},
{
"t": 7,
"x": 337,
"y": 490
},
{
"t": 8,
"x": 345,
"y": 501
},
{
"t": 11,
"x": 349,
"y": 509
},
{
"t": 12,
"x": 361,
"y": 451
},
{
"t": 13,
"x": 369,
"y": 447
},
{
"t": 14,
"x": 357,
"y": 513
},
{
"t": 17,
"x": 380,
"y": 458
},
{
"t": 20,
"x": 388,
"y": 451
}
],
"birth": 0,
"death": 24,
"type": "glittery rose gold leather ballet flat"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 478,
"y": 193
}
],
"birth": 0,
"death": 24,
"type": "light yellow and dark blue cardboard whey protein box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 525,
"y": 552
},
{
"t": 11,
"x": 521,
"y": 560
}
],
"birth": 0,
"death": 24,
"type": "yellow plastic toy school bus"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 669,
"y": 80
},
{
"t": 21,
"x": 666,
"y": 72
}
],
"birth": 0,
"death": 24,
"type": "yellow wooden toy roller"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 697,
"y": 197
},
{
"t": 17,
"x": 689,
"y": 193
},
{
"t": 22,
"x": 705,
"y": 177
}
],
"birth": 0,
"death": 24,
"type": "multi-colored wooden roller"
},
{
"id": 13,
"image_positions": [
{
"t": 0,
"x": 791,
"y": 755
}
],
"birth": 0,
"death": 24,
"type": "black can opener"
},
{
"id": 14,
"image_positions": [
{
"t": 0,
"x": 822,
"y": 68
}
],
"birth": 0,
"death": 24,
"type": "white and orange cardboard cosmetic box"
},
{
"id": 15,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 720
}
],
"birth": 0,
"death": 24,
"type": "dark grey metallic cake pan set"
},
{
"id": 16,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 4,
"x": 1,
"y": 373
},
{
"t": 9,
"x": null,
"y": null
},
{
"t": 18,
"x": 1,
"y": 373
},
{
"t": 22,
"x": null,
"y": null
}
],
"birth": 4,
"death": 24,
"type": "black cardboard motherboard box"
}
],
"interactions": [
{
"id": 4,
"inputs": [
1,
5
],
"outputs": [
1,
5
],
"begins_at": 0,
"ends_at": 1,
"type": "contact"
},
{
"id": 26,
"inputs": [
3,
5
],
"outputs": [
3,
5
],
"begins_at": 0,
"ends_at": 1,
"type": "contact"
},
{
"id": 37,
"inputs": [
5,
8
],
"outputs": [
5,
8
],
"begins_at": 0,
"ends_at": 1,
"type": "contact"
},
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 6,
"type": "contact"
},
{
"id": 29,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 7,
"type": "contact"
},
{
"id": 36,
"inputs": [
5,
7
],
"outputs": [
5,
7
],
"begins_at": 0,
"ends_at": 15,
"type": "contact"
},
{
"id": 34,
"inputs": [
5,
6
],
"outputs": [
5,
6
],
"begins_at": 0,
"ends_at": 17,
"type": "contact"
},
{
"id": 3,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 6,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 32,
"inputs": [
4,
16
],
"outputs": [
4,
16
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 33,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 35,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 39,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 40,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 46,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 47,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 7,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 8,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 9,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 10,
"inputs": [
13,
15
],
"outputs": [
13,
15
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 11,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 12,
"inputs": [
14,
65535
],
"outputs": [
14,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 13,
"inputs": [
15,
65535
],
"outputs": [
15,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 14,
"inputs": [
16,
65535
],
"outputs": [
16,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 17,
"inputs": [
2,
5
],
"outputs": [
2,
5
],
"begins_at": 1,
"ends_at": 1,
"type": "collision"
},
{
"id": 43,
"inputs": [
7,
8
],
"outputs": [
7,
8
],
"begins_at": 2,
"ends_at": 3,
"type": "collision"
},
{
"id": 18,
"inputs": [
2,
5
],
"outputs": [
2,
5
],
"begins_at": 2,
"ends_at": 4,
"type": "contact"
},
{
"id": 38,
"inputs": [
5,
8
],
"outputs": [
5,
8
],
"begins_at": 5,
"ends_at": 6,
"type": "collision"
},
{
"id": 25,
"inputs": [
2,
8
],
"outputs": [
2,
8
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 23,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 44,
"inputs": [
7,
8
],
"outputs": [
7,
8
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 24,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 45,
"inputs": [
8,
10
],
"outputs": [
8,
10
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 31,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 19,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 30,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 10,
"ends_at": 23,
"type": "contact"
},
{
"id": 20,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 11,
"ends_at": 13,
"type": "contact"
},
{
"id": 41,
"inputs": [
7,
8
],
"outputs": [
7,
8
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 5,
"inputs": [
1,
5
],
"outputs": [
1,
5
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 21,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 42,
"inputs": [
7,
8
],
"outputs": [
7,
8
],
"begins_at": 15,
"ends_at": 23,
"type": "contact"
},
{
"id": 27,
"inputs": [
3,
5
],
"outputs": [
3,
5
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 22,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 16,
"ends_at": 23,
"type": "contact"
},
{
"id": 28,
"inputs": [
3,
5
],
"outputs": [
3,
5
],
"begins_at": 17,
"ends_at": 23,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
5
],
"outputs": [
0,
5
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 15,
"inputs": [
2,
12
],
"outputs": [
2,
12
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 2,
"inputs": [
0,
5
],
"outputs": [
0,
5
],
"begins_at": 22,
"ends_at": 23,
"type": "contact"
},
{
"id": 16,
"inputs": [
2,
12
],
"outputs": [
2,
12
],
"begins_at": 22,
"ends_at": 23,
"type": "contact"
}
]
}Per-frame GT object prefill
Each one-frame detector request was assistant-prefilled with the exact visible GT objects using canonical IDs. B1 generated only the interaction suffix; the saved frame outputs below are the exact persisted requests and generations.
Every persisted/reconstructed prefill step
[
{
"frame_index": 0,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 1 [PX] 0 9 650 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 13 470 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 37 146 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 44 626 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 119 263 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 134 478 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 220 599 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 291 548 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 306 470 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 1 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 1 [PX] 0 525 552 [OBJ] 11 \"yellow wooden toy roller\" 0 1 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 1 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 1 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 1 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 1 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 2 4 [OUT] 2 4 [INTERACT] 10 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 16 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 17 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 15 65535 [OUT] 15 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 1 [PX] 0 9 650 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 13 470 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 37 146 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 44 626 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 119 263 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 134 478 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 220 599 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 291 548 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 306 470 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 1 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 1 [PX] 0 525 552 [OBJ] 11 \"yellow wooden toy roller\" 0 1 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 1 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 1 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 1 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 1 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 2 4 [OUT] 2 4 [INTERACT] 10 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 16 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 17 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 15 65535 [OUT] 15 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12,
"13": 13,
"14": 14,
"15": 15,
"16": 16
},
"parsed_object_count": 17,
"parsed_interaction_count": 18
},
{
"frame_index": 1,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 25 466 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 83 142 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 146 275 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 2 [OUT] 1 2 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 25 466 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 83 142 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 146 275 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 2 [OUT] 1 2 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"4": 4
},
"parsed_object_count": 3,
"parsed_interaction_count": 9
},
{
"frame_index": 2,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 13 466 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 134 169 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 41 216 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 228 603 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 4 [OUT] 2 4 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 13 466 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 134 169 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 41 216 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 228 603 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 4 [OUT] 2 4 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"4": 4,
"6": 6
},
"parsed_object_count": 4,
"parsed_interaction_count": 11
},
{
"frame_index": 3,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 181 197 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 44 615 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 56 236 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 298 552 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 181 197 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 44 615 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 56 236 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 298 552 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"3": 3,
"4": 4,
"7": 7
},
"parsed_object_count": 4,
"parsed_interaction_count": 8
},
{
"frame_index": 4,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 1 [PX] 0 13 634 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 224 232 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 68 630 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 72 255 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 142 458 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 1 373 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 2 4 [OUT] 2 4 [INTERACT] 16 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 17 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 18 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 19 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 20 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 21 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 22 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 23 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 17 65535 [OUT] 17 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 19 65535 [OUT] 19 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 20 65535 [OUT] 20 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 21 65535 [OUT] 21 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 1 [PX] 0 13 634 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 224 232 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 68 630 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 72 255 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 142 458 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 1 373 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 2 4 [OUT] 2 4 [INTERACT] 16 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 17 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 18 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 19 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 20 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 21 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 22 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 23 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 17 65535 [OUT] 17 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 19 65535 [OUT] 19 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 20 65535 [OUT] 20 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 21 65535 [OUT] 21 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"16": 16
},
"parsed_object_count": 6,
"parsed_interaction_count": 24
},
{
"frame_index": 5,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 1 [PX] 0 13 611 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 267 267 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 80 626 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 87 275 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 220 607 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 1 [PX] 0 13 611 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 267 267 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 80 626 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 87 275 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 220 607 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"6": 6
},
"parsed_object_count": 5,
"parsed_interaction_count": 7
},
{
"frame_index": 6,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 13 501 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 302 294 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 91 630 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 91 283 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 326 482 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 13 501 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 302 294 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 91 630 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 91 283 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 326 482 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"8": 8
},
"parsed_object_count": 5,
"parsed_interaction_count": 5
},
{
"frame_index": 7,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 333 314 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 103 634 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 146 451 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 337 490 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 5 [OUT] 1 5 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 333 314 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 103 634 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 146 451 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 337 490 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 5 [OUT] 1 5 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"3": 3,
"5": 5,
"8": 8
},
"parsed_object_count": 4,
"parsed_interaction_count": 9
},
{
"frame_index": 8,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 361 322 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 111 638 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 345 501 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 361 322 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 111 638 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 345 501 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"3": 3,
"8": 8
},
"parsed_object_count": 3,
"parsed_interaction_count": 10
},
{
"frame_index": 9,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 380 318 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 103 611 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 142 458 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 5 [OUT] 0 5 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 3 5 [OUT] 3 5 [INTERACT] 15 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 16 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 17 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 18 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 19 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 20 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 17 65535 [OUT] 17 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 19 65535 [OUT] 19 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 380 318 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 103 611 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 142 458 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 5 [OUT] 0 5 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 3 5 [OUT] 3 5 [INTERACT] 15 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 16 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 17 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 18 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 19 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 20 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 17 65535 [OUT] 17 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 19 65535 [OUT] 19 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"3": 3,
"5": 5,
"16": 16
},
"parsed_object_count": 4,
"parsed_interaction_count": 21
},
{
"frame_index": 10,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 9 470 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 416 314 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 111 615 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 9 470 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 416 314 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 111 615 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3
},
"parsed_object_count": 3,
"parsed_interaction_count": 10
},
{
"frame_index": 11,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 384 314 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 123 630 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 349 509 [OBJ] 10 \"yellow plastic toy school bus\" 0 1 [PX] 0 521 560 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 384 314 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 123 630 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 349 509 [OBJ] 10 \"yellow plastic toy school bus\" 0 1 [PX] 0 521 560 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"3": 3,
"8": 8,
"10": 10
},
"parsed_object_count": 4,
"parsed_interaction_count": 10
},
{
"frame_index": 12,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 408 314 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 87 275 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 361 451 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 408 314 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 87 275 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 361 451 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"4": 4,
"8": 8
},
"parsed_object_count": 3,
"parsed_interaction_count": 8
},
{
"frame_index": 13,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 431 314 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 134 478 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 369 447 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 5 [OUT] 0 5 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 431 314 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 134 478 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 369 447 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 5 [OUT] 0 5 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"5": 5,
"8": 8
},
"parsed_object_count": 3,
"parsed_interaction_count": 11
},
{
"frame_index": 14,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 443 318 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 134 638 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 83 267 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 357 513 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 443 318 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 134 638 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 83 267 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 357 513 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"3": 3,
"4": 4,
"8": 8
},
"parsed_object_count": 4,
"parsed_interaction_count": 10
},
{
"frame_index": 15,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 17 474 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 458 318 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 138 486 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 5 [OUT] 1 5 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 17 474 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 458 318 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 138 486 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 5 [OUT] 1 5 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"5": 5
},
"parsed_object_count": 3,
"parsed_interaction_count": 11
},
{
"frame_index": 16,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 482 310 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 482 310 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2
},
"parsed_object_count": 1,
"parsed_interaction_count": 10
},
{
"frame_index": 17,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 494 302 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 380 458 [OBJ] 12 \"multi-colored wooden roller\" 0 1 [PX] 0 689 193 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 12 [OUT] 10 12 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 494 302 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 380 458 [OBJ] 12 \"multi-colored wooden roller\" 0 1 [PX] 0 689 193 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 12 [OUT] 10 12 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"8": 8,
"12": 12
},
"parsed_object_count": 3,
"parsed_interaction_count": 16
},
{
"frame_index": 18,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 9 466 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 544 310 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 130 482 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 212 599 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 1 373 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 16 [OUT] 0 16 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 5 [OUT] 1 5 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 16 \"contact\" 0 0 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 17 \"contact\" 0 0 [IN] 16 65535 [OUT] 16 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 9 466 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 544 310 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 130 482 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 212 599 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 1 373 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 16 [OUT] 0 16 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 5 [OUT] 1 5 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 16 \"contact\" 0 0 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 17 \"contact\" 0 0 [IN] 16 65535 [OUT] 16 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"5": 5,
"6": 6,
"16": 16
},
"parsed_object_count": 5,
"parsed_interaction_count": 18
},
{
"frame_index": 19,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 9 505 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 537 294 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 123 478 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 5 [OUT] 0 5 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 9 505 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 537 294 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 123 478 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 5 [OUT] 0 5 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"5": 5
},
"parsed_object_count": 3,
"parsed_interaction_count": 11
},
{
"frame_index": 20,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 556 291 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 123 490 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 201 595 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 388 451 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 556 291 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 123 490 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 201 595 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 388 451 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"5": 5,
"6": 6,
"8": 8
},
"parsed_object_count": 4,
"parsed_interaction_count": 9
},
{
"frame_index": 21,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 1 501 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 591 298 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 115 486 [OBJ] 11 \"yellow wooden toy roller\" 0 1 [PX] 0 666 72 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 5 [OUT] 0 5 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 1 501 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 591 298 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 115 486 [OBJ] 11 \"yellow wooden toy roller\" 0 1 [PX] 0 666 72 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 5 [OUT] 0 5 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"5": 5,
"11": 11
},
"parsed_object_count": 4,
"parsed_interaction_count": 11
},
{
"frame_index": 22,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 591 287 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 103 275 [OBJ] 12 \"multi-colored wooden roller\" 0 1 [PX] 0 705 177 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 591 287 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 103 275 [OBJ] 12 \"multi-colored wooden roller\" 0 1 [PX] 0 705 177 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"4": 4,
"12": 12,
"16": 16
},
"parsed_object_count": 4,
"parsed_interaction_count": 10
},
{
"frame_index": 23,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 null null [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 615 291 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 null null [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 615 291 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2
},
"parsed_object_count": 2,
"parsed_interaction_count": 10
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "brown and orange leather wingtip shoe" 0 24 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 "white plastic lutein supplement bottle" 0 24 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 15 17 474 18 9 466 19 9 505 21 1 501 23 null null [OBJ] 2 "wooden spelling toy" 0 24 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 14 443 318 15 458 318 16 482 310 17 494 302 18 544 310 19 537 294 20 556 291 21 591 298 22 591 287 23 615 291 [OBJ] 3 "khaki fabric boat shoe" 0 24 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 14 134 638 [OBJ] 4 "black cardboard Asus Z97I-PLUS motherboard box" 0 24 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 14 83 267 22 103 275 [OBJ] 5 "brown ceramic flower pot" 0 24 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 15 138 486 18 130 482 19 123 478 20 123 490 21 115 486 [OBJ] 6 "blush metallic leather ballet flat" 0 24 [PX] 0 220 599 2 228 603 5 220 607 18 212 599 20 201 595 [OBJ] 7 "multicolored cardboard Scrabble game" 0 24 [PX] 0 291 548 3 298 552 [OBJ] 8 "glittery rose gold leather ballet flat" 0 24 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 14 357 513 17 380 458 20 388 451 [OBJ] 9 "light yellow and dark blue cardboard whey protein box" 0 24 [PX] 0 478 193 [OBJ] 10 "yellow plastic toy school bus" 0 24 [PX] 0 525 552 11 521 560 [OBJ] 11 "yellow wooden toy roller" 0 24 [PX] 0 669 80 21 666 72 [OBJ] 12 "multi-colored wooden roller" 0 24 [PX] 0 697 197 17 689 193 22 705 177 [OBJ] 13 "black can opener" 0 24 [PX] 0 791 755 [OBJ] 14 "white and orange cardboard cosmetic box" 0 24 [PX] 0 822 68 [OBJ] 15 "dark grey metallic cake pan set" 0 24 [PX] 0 919 720 [OBJ] 16 "black cardboard motherboard box" 4 24 [PX] 0 null null 4 1 373 9 null null 18 1 373 22 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 "contact" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 "contact" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 "contact" 0 0 [IN] 2 4 [OUT] 2 4 [INTERACT] 3 "contact" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 "contact" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 "contact" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 "contact" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 "contact" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 "contact" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 9 "contact" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 10 "contact" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 11 "contact" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 12 "contact" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 13 "contact" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 14 "contact" 0 0 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 15 "contact" 0 2 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 16 "contact" 0 6 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 17 "contact" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 18 "collision" 1 1 [IN] 1 2 [OUT] 1 2 [INTERACT] 19 "collision" 1 1 [IN] 65535 [OUT] 65535 [INTERACT] 20 "collision" 2 2 [IN] 2 4 [OUT] 2 4 [INTERACT] 21 "collision" 2 2 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 22 "contact" 2 5 [IN] 65535 [OUT] 65535 [INTERACT] 23 "collision" 3 3 [IN] 2 [OUT] 2 [INTERACT] 24 "collision" 3 3 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 25 "collision" 3 3 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 26 "collision" 4 4 [IN] 0 3 [OUT] 0 3 [INTERACT] 27 "collision" 4 4 [IN] 2 4 [OUT] 2 4 [INTERACT] 28 "collision" 4 4 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 29 "collision" 4 4 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 30 "collision" 4 5 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 31 "contact" 4 11 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 32 "collision" 5 5 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 33 "collision" 6 6 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 34 "collision" 6 6 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 35 "collision" 7 7 [IN] 5 [OUT] 5 [INTERACT] 36 "collision" 7 7 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 37 "collision" 7 7 [IN] 65535 [OUT] 65535 [INTERACT] 38 "contact" 7 8 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 39 "collision" 8 8 [IN] 3 [OUT] 3 [INTERACT] 40 "contact" 8 23 [IN] 65535 [OUT] 65535 [INTERACT] 41 "collision" 9 9 [IN] 3 5 [OUT] 3 5 [INTERACT] 42 "collision" 9 9 [IN] 5 [OUT] 5 [INTERACT] 43 "collision" 9 9 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 44 "collision" 9 9 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 45 "collision" 10 10 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 46 "collision" 11 11 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 47 "collision" 12 12 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 48 "contact" 12 14 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 49 "collision" 13 13 [IN] 5 [OUT] 5 [INTERACT] 50 "collision" 13 13 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 51 "collision" 14 14 [IN] 3 [OUT] 3 [INTERACT] 52 "collision" 14 14 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 53 "collision" 14 14 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 54 "collision" 15 15 [IN] 1 5 [OUT] 1 5 [INTERACT] 55 "collision" 15 15 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 56 "collision" 15 15 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 57 "collision" 17 17 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 58 "collision" 17 17 [IN] 12 [OUT] 12 [INTERACT] 59 "collision" 17 17 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 60 "collision" 18 18 [IN] 1 5 [OUT] 1 5 [INTERACT] 61 "collision" 18 18 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 62 "collision" 18 18 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 63 "collision" 18 18 [IN] 16 [OUT] 16 [INTERACT] 64 "collision" 18 18 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 65 "collision" 18 19 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 66 "collision" 19 19 [IN] 5 [OUT] 5 [INTERACT] 67 "contact" 19 21 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 68 "collision" 20 20 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 69 "collision" 20 20 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 70 "collision" 21 21 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 71 "collision" 21 21 [IN] 5 [OUT] 5 [INTERACT] 72 "collision" 22 22 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 73 "collision" 23 23 [IN] 1 65535 [OUT] 1 65535 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 9,
"y": 650
},
{
"t": 4,
"x": 13,
"y": 634
},
{
"t": 5,
"x": 13,
"y": 611
}
],
"birth": 0,
"death": 24,
"type": "brown and orange leather wingtip shoe"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 13,
"y": 470
},
{
"t": 1,
"x": 25,
"y": 466
},
{
"t": 2,
"x": 13,
"y": 466
},
{
"t": 6,
"x": 13,
"y": 501
},
{
"t": 10,
"x": 9,
"y": 470
},
{
"t": 15,
"x": 17,
"y": 474
},
{
"t": 18,
"x": 9,
"y": 466
},
{
"t": 19,
"x": 9,
"y": 505
},
{
"t": 21,
"x": 1,
"y": 501
},
{
"t": 23,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "white plastic lutein supplement bottle"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 37,
"y": 146
},
{
"t": 1,
"x": 83,
"y": 142
},
{
"t": 2,
"x": 134,
"y": 169
},
{
"t": 3,
"x": 181,
"y": 197
},
{
"t": 4,
"x": 224,
"y": 232
},
{
"t": 5,
"x": 267,
"y": 267
},
{
"t": 6,
"x": 302,
"y": 294
},
{
"t": 7,
"x": 333,
"y": 314
},
{
"t": 8,
"x": 361,
"y": 322
},
{
"t": 9,
"x": 380,
"y": 318
},
{
"t": 10,
"x": 416,
"y": 314
},
{
"t": 11,
"x": 384,
"y": 314
},
{
"t": 12,
"x": 408,
"y": 314
},
{
"t": 13,
"x": 431,
"y": 314
},
{
"t": 14,
"x": 443,
"y": 318
},
{
"t": 15,
"x": 458,
"y": 318
},
{
"t": 16,
"x": 482,
"y": 310
},
{
"t": 17,
"x": 494,
"y": 302
},
{
"t": 18,
"x": 544,
"y": 310
},
{
"t": 19,
"x": 537,
"y": 294
},
{
"t": 20,
"x": 556,
"y": 291
},
{
"t": 21,
"x": 591,
"y": 298
},
{
"t": 22,
"x": 591,
"y": 287
},
{
"t": 23,
"x": 615,
"y": 291
}
],
"birth": 0,
"death": 24,
"type": "wooden spelling toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 44,
"y": 626
},
{
"t": 3,
"x": 44,
"y": 615
},
{
"t": 4,
"x": 68,
"y": 630
},
{
"t": 5,
"x": 80,
"y": 626
},
{
"t": 6,
"x": 91,
"y": 630
},
{
"t": 7,
"x": 103,
"y": 634
},
{
"t": 8,
"x": 111,
"y": 638
},
{
"t": 9,
"x": 103,
"y": 611
},
{
"t": 10,
"x": 111,
"y": 615
},
{
"t": 11,
"x": 123,
"y": 630
},
{
"t": 14,
"x": 134,
"y": 638
}
],
"birth": 0,
"death": 24,
"type": "khaki fabric boat shoe"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 119,
"y": 263
},
{
"t": 1,
"x": 146,
"y": 275
},
{
"t": 2,
"x": 41,
"y": 216
},
{
"t": 3,
"x": 56,
"y": 236
},
{
"t": 4,
"x": 72,
"y": 255
},
{
"t": 5,
"x": 87,
"y": 275
},
{
"t": 6,
"x": 91,
"y": 283
},
{
"t": 12,
"x": 87,
"y": 275
},
{
"t": 14,
"x": 83,
"y": 267
},
{
"t": 22,
"x": 103,
"y": 275
}
],
"birth": 0,
"death": 24,
"type": "black cardboard Asus Z97I-PLUS motherboard box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 134,
"y": 478
},
{
"t": 4,
"x": 142,
"y": 458
},
{
"t": 7,
"x": 146,
"y": 451
},
{
"t": 9,
"x": 142,
"y": 458
},
{
"t": 13,
"x": 134,
"y": 478
},
{
"t": 15,
"x": 138,
"y": 486
},
{
"t": 18,
"x": 130,
"y": 482
},
{
"t": 19,
"x": 123,
"y": 478
},
{
"t": 20,
"x": 123,
"y": 490
},
{
"t": 21,
"x": 115,
"y": 486
}
],
"birth": 0,
"death": 24,
"type": "brown ceramic flower pot"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 220,
"y": 599
},
{
"t": 2,
"x": 228,
"y": 603
},
{
"t": 5,
"x": 220,
"y": 607
},
{
"t": 18,
"x": 212,
"y": 599
},
{
"t": 20,
"x": 201,
"y": 595
}
],
"birth": 0,
"death": 24,
"type": "blush metallic leather ballet flat"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 291,
"y": 548
},
{
"t": 3,
"x": 298,
"y": 552
}
],
"birth": 0,
"death": 24,
"type": "multicolored cardboard Scrabble game"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 306,
"y": 470
},
{
"t": 6,
"x": 326,
"y": 482
},
{
"t": 7,
"x": 337,
"y": 490
},
{
"t": 8,
"x": 345,
"y": 501
},
{
"t": 11,
"x": 349,
"y": 509
},
{
"t": 12,
"x": 361,
"y": 451
},
{
"t": 13,
"x": 369,
"y": 447
},
{
"t": 14,
"x": 357,
"y": 513
},
{
"t": 17,
"x": 380,
"y": 458
},
{
"t": 20,
"x": 388,
"y": 451
}
],
"birth": 0,
"death": 24,
"type": "glittery rose gold leather ballet flat"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 478,
"y": 193
}
],
"birth": 0,
"death": 24,
"type": "light yellow and dark blue cardboard whey protein box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 525,
"y": 552
},
{
"t": 11,
"x": 521,
"y": 560
}
],
"birth": 0,
"death": 24,
"type": "yellow plastic toy school bus"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 669,
"y": 80
},
{
"t": 21,
"x": 666,
"y": 72
}
],
"birth": 0,
"death": 24,
"type": "yellow wooden toy roller"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 697,
"y": 197
},
{
"t": 17,
"x": 689,
"y": 193
},
{
"t": 22,
"x": 705,
"y": 177
}
],
"birth": 0,
"death": 24,
"type": "multi-colored wooden roller"
},
{
"id": 13,
"image_positions": [
{
"t": 0,
"x": 791,
"y": 755
}
],
"birth": 0,
"death": 24,
"type": "black can opener"
},
{
"id": 14,
"image_positions": [
{
"t": 0,
"x": 822,
"y": 68
}
],
"birth": 0,
"death": 24,
"type": "white and orange cardboard cosmetic box"
},
{
"id": 15,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 720
}
],
"birth": 0,
"death": 24,
"type": "dark grey metallic cake pan set"
},
{
"id": 16,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 4,
"x": 1,
"y": 373
},
{
"t": 9,
"x": null,
"y": null
},
{
"t": 18,
"x": 1,
"y": 373
},
{
"t": 22,
"x": null,
"y": null
}
],
"birth": 4,
"death": 24,
"type": "black cardboard motherboard box"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
4
],
"outputs": [
2,
4
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 11,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 12,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 13,
"inputs": [
14,
65535
],
"outputs": [
14,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 14,
"inputs": [
15,
65535
],
"outputs": [
15,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 15,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 2,
"type": "contact"
},
{
"id": 16,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 6,
"type": "contact"
},
{
"id": 17,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 18,
"inputs": [
1,
2
],
"outputs": [
1,
2
],
"begins_at": 1,
"ends_at": 1,
"type": "collision"
},
{
"id": 19,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 1,
"ends_at": 1,
"type": "collision"
},
{
"id": 20,
"inputs": [
2,
4
],
"outputs": [
2,
4
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 21,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 22,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 2,
"ends_at": 5,
"type": "contact"
},
{
"id": 23,
"inputs": [
2
],
"outputs": [
2
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 24,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 25,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 26,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 27,
"inputs": [
2,
4
],
"outputs": [
2,
4
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 28,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 29,
"inputs": [
16,
65535
],
"outputs": [
16,
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 30,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 4,
"ends_at": 5,
"type": "collision"
},
{
"id": 31,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 4,
"ends_at": 11,
"type": "contact"
},
{
"id": 32,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 33,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 34,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 35,
"inputs": [
5
],
"outputs": [
5
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 36,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 37,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 38,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 7,
"ends_at": 8,
"type": "contact"
},
{
"id": 39,
"inputs": [
3
],
"outputs": [
3
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 40,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 8,
"ends_at": 23,
"type": "contact"
},
{
"id": 41,
"inputs": [
3,
5
],
"outputs": [
3,
5
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 42,
"inputs": [
5
],
"outputs": [
5
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 43,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 44,
"inputs": [
16,
65535
],
"outputs": [
16,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 45,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 46,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 47,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 48,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 12,
"ends_at": 14,
"type": "contact"
},
{
"id": 49,
"inputs": [
5
],
"outputs": [
5
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 50,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 51,
"inputs": [
3
],
"outputs": [
3
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 52,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 53,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 54,
"inputs": [
1,
5
],
"outputs": [
1,
5
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 55,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 56,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 57,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 58,
"inputs": [
12
],
"outputs": [
12
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 59,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 60,
"inputs": [
1,
5
],
"outputs": [
1,
5
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 61,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 62,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 63,
"inputs": [
16
],
"outputs": [
16
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 64,
"inputs": [
16,
65535
],
"outputs": [
16,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 65,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 18,
"ends_at": 19,
"type": "collision"
},
{
"id": 66,
"inputs": [
5
],
"outputs": [
5
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 67,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 19,
"ends_at": 21,
"type": "contact"
},
{
"id": 68,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 69,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 70,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 71,
"inputs": [
5
],
"outputs": [
5
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 72,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 73,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 0.9974424552429667,
"avg_image_position_segmentation_acc_small": 0.9956521739130434,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 0.9974424552429667,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": 1.0,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 1.0,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 1.0,
"num_matches": 17,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.43977347883597906,
"avg_interaction_input_object_jaccard": 0.19791666666666666,
"avg_interaction_output_object_jaccard": 0.19791666666666666,
"avg_interaction_type_exact_match_acc": 0.8333333333333334,
"num_interaction_matches": 48,
"num_unmatched_pred_interactions": 26,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 27,
"false_positives": 47,
"false_negatives": 0
},
"0.5": {
"true_positives": 24,
"false_positives": 50,
"false_negatives": 0
},
"0.75": {
"true_positives": 15,
"false_positives": 59,
"false_negatives": 0
},
"1.0": {
"true_positives": 13,
"false_positives": 61,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.36486486486486486,
"0.5": 0.32432432432432434,
"0.75": 0.20270270270270271,
"1.0": 0.17567567567567569
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.5346534653465346,
"0.5": 0.489795918367347,
"0.75": 0.3370786516853933,
"1.0": 0.2988505747126437
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 26,
"false_positives": 48,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 72,
"false_negatives": 0
},
"0.75": {
"true_positives": 1,
"false_positives": 73,
"false_negatives": 0
},
"1.0": {
"true_positives": 1,
"false_positives": 73,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.35135135135135137,
"0.5": 0.02702702702702703,
"0.75": 0.013513513513513514,
"1.0": 0.013513513513513514
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.52,
"0.5": 0.052631578947368425,
"0.75": 0.026666666666666665,
"1.0": 0.026666666666666665
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 26,
"false_positives": 48,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 72,
"false_negatives": 0
},
"0.75": {
"true_positives": 1,
"false_positives": 73,
"false_negatives": 0
},
"1.0": {
"true_positives": 1,
"false_positives": 73,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.35135135135135137,
"0.5": 0.02702702702702703,
"0.75": 0.013513513513513514,
"1.0": 0.013513513513513514
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.52,
"0.5": 0.052631578947368425,
"0.75": 0.026666666666666665,
"1.0": 0.026666666666666665
}
}
}Prompt
<video> Analyze the provided video and return ONLY a valid sentinel sequence in this format: [SCENE-START] [OBJS-START] [OBJ] id "type" birth death [PX] t px py ... [OBJ] ... [OBJS-END] [INTERACTIONS-START] [INTERACT] id "type" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ... [INTERACT] ... [INTERACTIONS-END] [SCENE-END] Constraints: - Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose). - Keep tags exactly as written: `[SCENE-START] [OBJS-START] [OBJ] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]` - Use quoted strings for `type` (double quotes). - `PX` uses repeated groups of 3 values in order: `t px py`. - `t` is the timestamp (frame number). - `px` and `py` are the pixel coordinates of the object in that frame, normalized to [0,1] relative to the frame dimensions, scaled by 1000 and rounded to the nearest integer. For example, `px` of 0.1234 would be represented as 123. - When an object is occluded or not visible in a frame, `PX` may use `t null null`. - `IN` and `OUT` contain whitespace-separated integer ids.
B1 cache + injected GT identity map
B2 consumed the persisted B1-oracle frame cache. Its learned mapper call was bypassed at every streaming step and replaced with the shown stable-ID → detector-ID identity map; the ordinary staged merger still produced the final interaction prediction.
Every persisted/reconstructed prefill step
[
{
"frame_index": 0,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 1 [PX] 0 9 650 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 13 470 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 37 146 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 44 626 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 119 263 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 134 478 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 220 599 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 291 548 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 306 470 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 1 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 1 [PX] 0 525 552 [OBJ] 11 \"yellow wooden toy roller\" 0 1 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 1 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 1 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 1 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 1 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 2 4 [OUT] 2 4 [INTERACT] 10 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 16 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 17 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 15 65535 [OUT] 15 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 1 [PX] 0 9 650 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 13 470 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 37 146 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 44 626 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 119 263 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 134 478 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 220 599 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 291 548 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 306 470 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 1 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 1 [PX] 0 525 552 [OBJ] 11 \"yellow wooden toy roller\" 0 1 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 1 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 1 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 1 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 1 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 2 4 [OUT] 2 4 [INTERACT] 10 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 16 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 17 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 15 65535 [OUT] 15 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 9,
"y": 650
}
],
"birth": 0,
"death": 1,
"type": "brown and orange leather wingtip shoe"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 13,
"y": 470
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 37,
"y": 146
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 44,
"y": 626
}
],
"birth": 0,
"death": 1,
"type": "khaki fabric boat shoe"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 119,
"y": 263
}
],
"birth": 0,
"death": 1,
"type": "black cardboard Asus Z97I-PLUS motherboard box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 134,
"y": 478
}
],
"birth": 0,
"death": 1,
"type": "brown ceramic flower pot"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 220,
"y": 599
}
],
"birth": 0,
"death": 1,
"type": "blush metallic leather ballet flat"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 291,
"y": 548
}
],
"birth": 0,
"death": 1,
"type": "multicolored cardboard Scrabble game"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 306,
"y": 470
}
],
"birth": 0,
"death": 1,
"type": "glittery rose gold leather ballet flat"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 478,
"y": 193
}
],
"birth": 0,
"death": 1,
"type": "light yellow and dark blue cardboard whey protein box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 525,
"y": 552
}
],
"birth": 0,
"death": 1,
"type": "yellow plastic toy school bus"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 669,
"y": 80
}
],
"birth": 0,
"death": 1,
"type": "yellow wooden toy roller"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 697,
"y": 197
}
],
"birth": 0,
"death": 1,
"type": "multi-colored wooden roller"
},
{
"id": 13,
"image_positions": [
{
"t": 0,
"x": 791,
"y": 755
}
],
"birth": 0,
"death": 1,
"type": "black can opener"
},
{
"id": 14,
"image_positions": [
{
"t": 0,
"x": 822,
"y": 68
}
],
"birth": 0,
"death": 1,
"type": "white and orange cardboard cosmetic box"
},
{
"id": 15,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 720
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 16,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
}
],
"birth": 0,
"death": 1,
"type": "black cardboard motherboard box"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
2,
4
],
"outputs": [
2,
4
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 11,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 12,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 13,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 14,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 15,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 16,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 17,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
14,
65535
],
"outputs": [
14,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
15,
65535
],
"outputs": [
15,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12,
"13": 13,
"14": 14,
"15": 15,
"16": 16
},
"mapping_note": "identity_ids=True initialization; mapper not called",
"mapper_called": false
},
{
"frame_index": 1,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 25 466 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 83 142 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 146 275 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 2 [OUT] 1 2 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 25 466 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 83 142 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 146 275 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 2 [OUT] 1 2 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 25,
"y": 466
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 83,
"y": 142
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 146,
"y": 275
}
],
"birth": 0,
"death": 1,
"type": "black cardboard Asus Z97I-PLUS motherboard box"
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
2
],
"outputs": [
1,
2
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"4": 4
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 2,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 13 466 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 134 169 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 41 216 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 228 603 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 4 [OUT] 2 4 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 13 466 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 134 169 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 41 216 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 228 603 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 4 [OUT] 2 4 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 13,
"y": 466
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 134,
"y": 169
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 41,
"y": 216
}
],
"birth": 0,
"death": 1,
"type": "black cardboard Asus Z97I-PLUS motherboard box"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 228,
"y": 603
}
],
"birth": 0,
"death": 1,
"type": "blush metallic leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
4
],
"outputs": [
2,
4
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"4": 4,
"6": 6
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 3,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 181 197 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 44 615 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 56 236 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 298 552 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 181 197 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 44 615 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 56 236 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 298 552 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 181,
"y": 197
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 44,
"y": 615
}
],
"birth": 0,
"death": 1,
"type": "khaki fabric boat shoe"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 56,
"y": 236
}
],
"birth": 0,
"death": 1,
"type": "black cardboard Asus Z97I-PLUS motherboard box"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 298,
"y": 552
}
],
"birth": 0,
"death": 1,
"type": "multicolored cardboard Scrabble game"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
2
],
"outputs": [
0,
2
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"3": 3,
"4": 4,
"7": 7
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 4,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 1 [PX] 0 13 634 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 224 232 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 68 630 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 72 255 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 142 458 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 1 373 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 2 4 [OUT] 2 4 [INTERACT] 16 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 17 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 18 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 19 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 20 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 21 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 22 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 23 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 17 65535 [OUT] 17 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 19 65535 [OUT] 19 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 20 65535 [OUT] 20 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 21 65535 [OUT] 21 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 1 [PX] 0 13 634 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 224 232 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 68 630 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 72 255 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 142 458 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 1 373 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 2 4 [OUT] 2 4 [INTERACT] 16 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 17 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 18 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 19 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 20 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 21 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 22 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 23 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 17 65535 [OUT] 17 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 19 65535 [OUT] 19 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 20 65535 [OUT] 20 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 21 65535 [OUT] 21 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 13,
"y": 634
}
],
"birth": 0,
"death": 1,
"type": "brown and orange leather wingtip shoe"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 224,
"y": 232
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 68,
"y": 630
}
],
"birth": 0,
"death": 1,
"type": "khaki fabric boat shoe"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 72,
"y": 255
}
],
"birth": 0,
"death": 1,
"type": "black cardboard Asus Z97I-PLUS motherboard box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 142,
"y": 458
}
],
"birth": 0,
"death": 1,
"type": "brown ceramic flower pot"
},
{
"id": 16,
"image_positions": [
{
"t": 0,
"x": 1,
"y": 373
}
],
"birth": 0,
"death": 1,
"type": "black cardboard motherboard box"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 15,
"inputs": [
2,
4
],
"outputs": [
2,
4
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 16,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 17,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 18,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 19,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 20,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 21,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 22,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 23,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
14,
65535
],
"outputs": [
14,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
15,
65535
],
"outputs": [
15,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
16,
65535
],
"outputs": [
16,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
17,
65535
],
"outputs": [
17,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 11,
"inputs": [
18,
65535
],
"outputs": [
18,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 12,
"inputs": [
19,
65535
],
"outputs": [
19,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 13,
"inputs": [
20,
65535
],
"outputs": [
20,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 14,
"inputs": [
21,
65535
],
"outputs": [
21,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"16": 16
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 5,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 1 [PX] 0 13 611 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 267 267 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 80 626 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 87 275 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 220 607 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 1 [PX] 0 13 611 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 267 267 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 80 626 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 87 275 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 220 607 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 13,
"y": 611
}
],
"birth": 0,
"death": 1,
"type": "brown and orange leather wingtip shoe"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 267,
"y": 267
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 80,
"y": 626
}
],
"birth": 0,
"death": 1,
"type": "khaki fabric boat shoe"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 87,
"y": 275
}
],
"birth": 0,
"death": 1,
"type": "black cardboard Asus Z97I-PLUS motherboard box"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 220,
"y": 607
}
],
"birth": 0,
"death": 1,
"type": "blush metallic leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"6": 6
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 6,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 13 501 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 302 294 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 91 630 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 91 283 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 326 482 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 13 501 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 302 294 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 91 630 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 91 283 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 326 482 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 13,
"y": 501
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 302,
"y": 294
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 91,
"y": 630
}
],
"birth": 0,
"death": 1,
"type": "khaki fabric boat shoe"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 91,
"y": 283
}
],
"birth": 0,
"death": 1,
"type": "black cardboard Asus Z97I-PLUS motherboard box"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 326,
"y": 482
}
],
"birth": 0,
"death": 1,
"type": "glittery rose gold leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 7,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 333 314 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 103 634 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 146 451 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 337 490 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 5 [OUT] 1 5 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 333 314 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 103 634 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 146 451 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 337 490 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 5 [OUT] 1 5 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 333,
"y": 314
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 103,
"y": 634
}
],
"birth": 0,
"death": 1,
"type": "khaki fabric boat shoe"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 146,
"y": 451
}
],
"birth": 0,
"death": 1,
"type": "brown ceramic flower pot"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 337,
"y": 490
}
],
"birth": 0,
"death": 1,
"type": "glittery rose gold leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
5
],
"outputs": [
1,
5
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"3": 3,
"5": 5,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 8,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 361 322 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 111 638 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 345 501 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 361 322 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 111 638 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 345 501 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 361,
"y": 322
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 111,
"y": 638
}
],
"birth": 0,
"death": 1,
"type": "khaki fabric boat shoe"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 345,
"y": 501
}
],
"birth": 0,
"death": 1,
"type": "glittery rose gold leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"3": 3,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 9,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 380 318 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 103 611 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 142 458 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 5 [OUT] 0 5 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 3 5 [OUT] 3 5 [INTERACT] 15 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 16 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 17 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 18 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 19 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 20 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 17 65535 [OUT] 17 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 19 65535 [OUT] 19 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 380 318 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 103 611 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 142 458 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 5 [OUT] 0 5 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 3 5 [OUT] 3 5 [INTERACT] 15 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 16 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 17 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 18 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 19 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 20 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 17 65535 [OUT] 17 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 19 65535 [OUT] 19 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 380,
"y": 318
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 103,
"y": 611
}
],
"birth": 0,
"death": 1,
"type": "khaki fabric boat shoe"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 142,
"y": 458
}
],
"birth": 0,
"death": 1,
"type": "brown ceramic flower pot"
},
{
"id": 16,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
}
],
"birth": 0,
"death": 1,
"type": "black cardboard motherboard box"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
5
],
"outputs": [
0,
5
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 13,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 14,
"inputs": [
3,
5
],
"outputs": [
3,
5
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 15,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 16,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 17,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 18,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 19,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 20,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
14,
65535
],
"outputs": [
14,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
15,
65535
],
"outputs": [
15,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
16,
65535
],
"outputs": [
16,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
17,
65535
],
"outputs": [
17,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 11,
"inputs": [
18,
65535
],
"outputs": [
18,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 12,
"inputs": [
19,
65535
],
"outputs": [
19,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"3": 3,
"5": 5,
"16": 16
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 10,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 9 470 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 416 314 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 111 615 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 9 470 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 416 314 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 111 615 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 9,
"y": 470
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 416,
"y": 314
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 111,
"y": 615
}
],
"birth": 0,
"death": 1,
"type": "khaki fabric boat shoe"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 11,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 384 314 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 123 630 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 349 509 [OBJ] 10 \"yellow plastic toy school bus\" 0 1 [PX] 0 521 560 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 384 314 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 123 630 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 349 509 [OBJ] 10 \"yellow plastic toy school bus\" 0 1 [PX] 0 521 560 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 384,
"y": 314
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 123,
"y": 630
}
],
"birth": 0,
"death": 1,
"type": "khaki fabric boat shoe"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 349,
"y": 509
}
],
"birth": 0,
"death": 1,
"type": "glittery rose gold leather ballet flat"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 521,
"y": 560
}
],
"birth": 0,
"death": 1,
"type": "yellow plastic toy school bus"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"3": 3,
"8": 8,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 12,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 408 314 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 87 275 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 361 451 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 408 314 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 87 275 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 361 451 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 408,
"y": 314
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 87,
"y": 275
}
],
"birth": 0,
"death": 1,
"type": "black cardboard Asus Z97I-PLUS motherboard box"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 361,
"y": 451
}
],
"birth": 0,
"death": 1,
"type": "glittery rose gold leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"4": 4,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 13,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 431 314 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 134 478 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 369 447 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 5 [OUT] 0 5 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 431 314 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 134 478 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 369 447 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 5 [OUT] 0 5 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 431,
"y": 314
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 134,
"y": 478
}
],
"birth": 0,
"death": 1,
"type": "brown ceramic flower pot"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 369,
"y": 447
}
],
"birth": 0,
"death": 1,
"type": "glittery rose gold leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
5
],
"outputs": [
0,
5
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"5": 5,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 14,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 443 318 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 134 638 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 83 267 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 357 513 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 443 318 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 134 638 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 83 267 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 357 513 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 443,
"y": 318
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 134,
"y": 638
}
],
"birth": 0,
"death": 1,
"type": "khaki fabric boat shoe"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 83,
"y": 267
}
],
"birth": 0,
"death": 1,
"type": "black cardboard Asus Z97I-PLUS motherboard box"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 357,
"y": 513
}
],
"birth": 0,
"death": 1,
"type": "glittery rose gold leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"3": 3,
"4": 4,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 15,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 17 474 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 458 318 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 138 486 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 5 [OUT] 1 5 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 17 474 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 458 318 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 138 486 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 5 [OUT] 1 5 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 17,
"y": 474
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 458,
"y": 318
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 138,
"y": 486
}
],
"birth": 0,
"death": 1,
"type": "brown ceramic flower pot"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
5
],
"outputs": [
1,
5
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"5": 5
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 16,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 482 310 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 482 310 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 482,
"y": 310
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 17,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 494 302 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 380 458 [OBJ] 12 \"multi-colored wooden roller\" 0 1 [PX] 0 689 193 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 12 [OUT] 10 12 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 494 302 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 380 458 [OBJ] 12 \"multi-colored wooden roller\" 0 1 [PX] 0 689 193 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 12 [OUT] 10 12 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 494,
"y": 302
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 380,
"y": 458
}
],
"birth": 0,
"death": 1,
"type": "glittery rose gold leather ballet flat"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 689,
"y": 193
}
],
"birth": 0,
"death": 1,
"type": "multi-colored wooden roller"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 11,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 12,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 13,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 14,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 15,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
10,
12
],
"outputs": [
10,
12
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
14,
65535
],
"outputs": [
14,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"8": 8,
"12": 12
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 18,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 9 466 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 544 310 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 130 482 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 212 599 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 1 373 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 16 [OUT] 0 16 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 5 [OUT] 1 5 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 16 \"contact\" 0 0 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 17 \"contact\" 0 0 [IN] 16 65535 [OUT] 16 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 9 466 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 544 310 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 130 482 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 212 599 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 1 373 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 16 [OUT] 0 16 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 5 [OUT] 1 5 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 16 \"contact\" 0 0 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 17 \"contact\" 0 0 [IN] 16 65535 [OUT] 16 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 9,
"y": 466
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 544,
"y": 310
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 130,
"y": 482
}
],
"birth": 0,
"death": 1,
"type": "brown ceramic flower pot"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 212,
"y": 599
}
],
"birth": 0,
"death": 1,
"type": "blush metallic leather ballet flat"
},
{
"id": 16,
"image_positions": [
{
"t": 0,
"x": 1,
"y": 373
}
],
"birth": 0,
"death": 1,
"type": "black cardboard motherboard box"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
16
],
"outputs": [
0,
16
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
5
],
"outputs": [
1,
5
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 11,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 12,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 13,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 14,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 15,
"inputs": [
14,
65535
],
"outputs": [
14,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 16,
"inputs": [
15,
65535
],
"outputs": [
15,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 17,
"inputs": [
16,
65535
],
"outputs": [
16,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"5": 5,
"6": 6,
"16": 16
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 19,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 9 505 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 537 294 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 123 478 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 5 [OUT] 0 5 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 9 505 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 537 294 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 123 478 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 5 [OUT] 0 5 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 9,
"y": 505
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 537,
"y": 294
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 123,
"y": 478
}
],
"birth": 0,
"death": 1,
"type": "brown ceramic flower pot"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
5
],
"outputs": [
0,
5
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"5": 5
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 20,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 556 291 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 123 490 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 201 595 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 388 451 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 556 291 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 123 490 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 201 595 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 388 451 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 556,
"y": 291
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 123,
"y": 490
}
],
"birth": 0,
"death": 1,
"type": "brown ceramic flower pot"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 201,
"y": 595
}
],
"birth": 0,
"death": 1,
"type": "blush metallic leather ballet flat"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 388,
"y": 451
}
],
"birth": 0,
"death": 1,
"type": "glittery rose gold leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"5": 5,
"6": 6,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 21,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 1 501 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 591 298 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 115 486 [OBJ] 11 \"yellow wooden toy roller\" 0 1 [PX] 0 666 72 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 5 [OUT] 0 5 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 1 501 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 591 298 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 115 486 [OBJ] 11 \"yellow wooden toy roller\" 0 1 [PX] 0 666 72 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 5 [OUT] 0 5 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 1,
"y": 501
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 591,
"y": 298
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 115,
"y": 486
}
],
"birth": 0,
"death": 1,
"type": "brown ceramic flower pot"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 666,
"y": 72
}
],
"birth": 0,
"death": 1,
"type": "yellow wooden toy roller"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
5
],
"outputs": [
0,
5
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"5": 5,
"11": 11
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 22,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 591 287 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 103 275 [OBJ] 12 \"multi-colored wooden roller\" 0 1 [PX] 0 705 177 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 591 287 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 103 275 [OBJ] 12 \"multi-colored wooden roller\" 0 1 [PX] 0 705 177 [OBJ] 16 \"black cardboard motherboard box\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 591,
"y": 287
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 103,
"y": 275
}
],
"birth": 0,
"death": 1,
"type": "black cardboard Asus Z97I-PLUS motherboard box"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 705,
"y": 177
}
],
"birth": 0,
"death": 1,
"type": "multi-colored wooden roller"
},
{
"id": 16,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
}
],
"birth": 0,
"death": 1,
"type": "black cardboard motherboard box"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"4": 4,
"12": 12,
"16": 16
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 23,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 null null [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 615 291 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 null null [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 615 291 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 615,
"y": 291
}
],
"birth": 0,
"death": 1,
"type": "wooden spelling toy"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "brown and orange leather wingtip shoe" 0 24 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 "white plastic lutein supplement bottle" 0 24 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 15 17 474 18 9 466 19 9 505 21 1 501 23 null null [OBJ] 2 "wooden spelling toy" 0 24 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 14 443 318 15 458 318 16 482 310 17 494 302 18 544 310 19 537 294 20 556 291 21 591 298 22 591 287 23 615 291 [OBJ] 3 "khaki fabric boat shoe" 0 24 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 14 134 638 [OBJ] 4 "black cardboard Asus Z97I-PLUS motherboard box" 0 24 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 14 83 267 22 103 275 [OBJ] 5 "brown ceramic flower pot" 0 24 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 15 138 486 18 130 482 19 123 478 20 123 490 21 115 486 [OBJ] 6 "blush metallic leather ballet flat" 0 24 [PX] 0 220 599 2 228 603 5 220 607 18 212 599 20 201 595 [OBJ] 7 "multicolored cardboard Scrabble game" 0 24 [PX] 0 291 548 3 298 552 [OBJ] 8 "glittery rose gold leather ballet flat" 0 24 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 14 357 513 17 380 458 20 388 451 [OBJ] 9 "light yellow and dark blue cardboard whey protein box" 0 24 [PX] 0 478 193 [OBJ] 10 "yellow plastic toy school bus" 0 24 [PX] 0 525 552 11 521 560 [OBJ] 11 "yellow wooden toy roller" 0 24 [PX] 0 669 80 21 666 72 [OBJ] 12 "multi-colored wooden roller" 0 24 [PX] 0 697 197 17 689 193 22 705 177 [OBJ] 13 "black can opener" 0 24 [PX] 0 791 755 [OBJ] 14 "white and orange cardboard cosmetic box" 0 24 [PX] 0 822 68 [OBJ] 15 "dark grey metallic cake pan set" 0 24 [PX] 0 919 720 [OBJ] 16 "black cardboard motherboard box" 4 24 [PX] 0 null null 4 1 373 9 null null 18 1 373 22 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 "contact" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 "contact" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 "contact" 0 0 [IN] 2 4 [OUT] 2 4 [INTERACT] 3 "contact" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 "contact" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 "contact" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 "contact" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 "contact" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 "contact" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 9 "contact" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 10 "contact" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 11 "contact" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 12 "contact" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 13 "contact" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 14 "contact" 0 0 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 15 "contact" 0 2 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 16 "contact" 0 6 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 17 "contact" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 18 "collision" 1 1 [IN] 1 2 [OUT] 1 2 [INTERACT] 19 "collision" 1 1 [IN] 65535 [OUT] 65535 [INTERACT] 20 "collision" 2 2 [IN] 2 4 [OUT] 2 4 [INTERACT] 21 "collision" 2 2 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 22 "contact" 2 5 [IN] 65535 [OUT] 65535 [INTERACT] 23 "collision" 3 3 [IN] 2 [OUT] 2 [INTERACT] 24 "collision" 3 3 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 25 "collision" 3 3 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 26 "collision" 4 4 [IN] 0 3 [OUT] 0 3 [INTERACT] 27 "collision" 4 4 [IN] 2 4 [OUT] 2 4 [INTERACT] 28 "collision" 4 4 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 29 "collision" 4 4 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 30 "collision" 4 5 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 31 "contact" 4 11 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 32 "collision" 5 5 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 33 "collision" 6 6 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 34 "collision" 6 6 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 35 "collision" 7 7 [IN] 5 [OUT] 5 [INTERACT] 36 "collision" 7 7 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 37 "collision" 7 7 [IN] 65535 [OUT] 65535 [INTERACT] 38 "contact" 7 8 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 39 "collision" 8 8 [IN] 3 [OUT] 3 [INTERACT] 40 "contact" 8 23 [IN] 65535 [OUT] 65535 [INTERACT] 41 "collision" 9 9 [IN] 3 5 [OUT] 3 5 [INTERACT] 42 "collision" 9 9 [IN] 5 [OUT] 5 [INTERACT] 43 "collision" 9 9 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 44 "collision" 9 9 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 45 "collision" 10 10 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 46 "collision" 11 11 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 47 "collision" 12 12 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 48 "contact" 12 14 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 49 "collision" 13 13 [IN] 5 [OUT] 5 [INTERACT] 50 "collision" 13 13 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 51 "collision" 14 14 [IN] 3 [OUT] 3 [INTERACT] 52 "collision" 14 14 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 53 "collision" 14 14 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 54 "collision" 15 15 [IN] 1 5 [OUT] 1 5 [INTERACT] 55 "collision" 15 15 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 56 "collision" 15 15 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 57 "collision" 17 17 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 58 "collision" 17 17 [IN] 12 [OUT] 12 [INTERACT] 59 "collision" 17 17 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 60 "collision" 18 18 [IN] 1 5 [OUT] 1 5 [INTERACT] 61 "collision" 18 18 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 62 "collision" 18 18 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 63 "collision" 18 18 [IN] 16 [OUT] 16 [INTERACT] 64 "collision" 18 18 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 65 "collision" 18 19 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 66 "collision" 19 19 [IN] 5 [OUT] 5 [INTERACT] 67 "contact" 19 21 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 68 "collision" 20 20 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 69 "collision" 20 20 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 70 "collision" 21 21 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 71 "collision" 21 21 [IN] 5 [OUT] 5 [INTERACT] 72 "collision" 22 22 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 73 "collision" 23 23 [IN] 1 65535 [OUT] 1 65535 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 9,
"y": 650
},
{
"t": 4,
"x": 13,
"y": 634
},
{
"t": 5,
"x": 13,
"y": 611
}
],
"birth": 0,
"death": 24,
"type": "brown and orange leather wingtip shoe"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 13,
"y": 470
},
{
"t": 1,
"x": 25,
"y": 466
},
{
"t": 2,
"x": 13,
"y": 466
},
{
"t": 6,
"x": 13,
"y": 501
},
{
"t": 10,
"x": 9,
"y": 470
},
{
"t": 15,
"x": 17,
"y": 474
},
{
"t": 18,
"x": 9,
"y": 466
},
{
"t": 19,
"x": 9,
"y": 505
},
{
"t": 21,
"x": 1,
"y": 501
},
{
"t": 23,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "white plastic lutein supplement bottle"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 37,
"y": 146
},
{
"t": 1,
"x": 83,
"y": 142
},
{
"t": 2,
"x": 134,
"y": 169
},
{
"t": 3,
"x": 181,
"y": 197
},
{
"t": 4,
"x": 224,
"y": 232
},
{
"t": 5,
"x": 267,
"y": 267
},
{
"t": 6,
"x": 302,
"y": 294
},
{
"t": 7,
"x": 333,
"y": 314
},
{
"t": 8,
"x": 361,
"y": 322
},
{
"t": 9,
"x": 380,
"y": 318
},
{
"t": 10,
"x": 416,
"y": 314
},
{
"t": 11,
"x": 384,
"y": 314
},
{
"t": 12,
"x": 408,
"y": 314
},
{
"t": 13,
"x": 431,
"y": 314
},
{
"t": 14,
"x": 443,
"y": 318
},
{
"t": 15,
"x": 458,
"y": 318
},
{
"t": 16,
"x": 482,
"y": 310
},
{
"t": 17,
"x": 494,
"y": 302
},
{
"t": 18,
"x": 544,
"y": 310
},
{
"t": 19,
"x": 537,
"y": 294
},
{
"t": 20,
"x": 556,
"y": 291
},
{
"t": 21,
"x": 591,
"y": 298
},
{
"t": 22,
"x": 591,
"y": 287
},
{
"t": 23,
"x": 615,
"y": 291
}
],
"birth": 0,
"death": 24,
"type": "wooden spelling toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 44,
"y": 626
},
{
"t": 3,
"x": 44,
"y": 615
},
{
"t": 4,
"x": 68,
"y": 630
},
{
"t": 5,
"x": 80,
"y": 626
},
{
"t": 6,
"x": 91,
"y": 630
},
{
"t": 7,
"x": 103,
"y": 634
},
{
"t": 8,
"x": 111,
"y": 638
},
{
"t": 9,
"x": 103,
"y": 611
},
{
"t": 10,
"x": 111,
"y": 615
},
{
"t": 11,
"x": 123,
"y": 630
},
{
"t": 14,
"x": 134,
"y": 638
}
],
"birth": 0,
"death": 24,
"type": "khaki fabric boat shoe"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 119,
"y": 263
},
{
"t": 1,
"x": 146,
"y": 275
},
{
"t": 2,
"x": 41,
"y": 216
},
{
"t": 3,
"x": 56,
"y": 236
},
{
"t": 4,
"x": 72,
"y": 255
},
{
"t": 5,
"x": 87,
"y": 275
},
{
"t": 6,
"x": 91,
"y": 283
},
{
"t": 12,
"x": 87,
"y": 275
},
{
"t": 14,
"x": 83,
"y": 267
},
{
"t": 22,
"x": 103,
"y": 275
}
],
"birth": 0,
"death": 24,
"type": "black cardboard Asus Z97I-PLUS motherboard box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 134,
"y": 478
},
{
"t": 4,
"x": 142,
"y": 458
},
{
"t": 7,
"x": 146,
"y": 451
},
{
"t": 9,
"x": 142,
"y": 458
},
{
"t": 13,
"x": 134,
"y": 478
},
{
"t": 15,
"x": 138,
"y": 486
},
{
"t": 18,
"x": 130,
"y": 482
},
{
"t": 19,
"x": 123,
"y": 478
},
{
"t": 20,
"x": 123,
"y": 490
},
{
"t": 21,
"x": 115,
"y": 486
}
],
"birth": 0,
"death": 24,
"type": "brown ceramic flower pot"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 220,
"y": 599
},
{
"t": 2,
"x": 228,
"y": 603
},
{
"t": 5,
"x": 220,
"y": 607
},
{
"t": 18,
"x": 212,
"y": 599
},
{
"t": 20,
"x": 201,
"y": 595
}
],
"birth": 0,
"death": 24,
"type": "blush metallic leather ballet flat"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 291,
"y": 548
},
{
"t": 3,
"x": 298,
"y": 552
}
],
"birth": 0,
"death": 24,
"type": "multicolored cardboard Scrabble game"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 306,
"y": 470
},
{
"t": 6,
"x": 326,
"y": 482
},
{
"t": 7,
"x": 337,
"y": 490
},
{
"t": 8,
"x": 345,
"y": 501
},
{
"t": 11,
"x": 349,
"y": 509
},
{
"t": 12,
"x": 361,
"y": 451
},
{
"t": 13,
"x": 369,
"y": 447
},
{
"t": 14,
"x": 357,
"y": 513
},
{
"t": 17,
"x": 380,
"y": 458
},
{
"t": 20,
"x": 388,
"y": 451
}
],
"birth": 0,
"death": 24,
"type": "glittery rose gold leather ballet flat"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 478,
"y": 193
}
],
"birth": 0,
"death": 24,
"type": "light yellow and dark blue cardboard whey protein box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 525,
"y": 552
},
{
"t": 11,
"x": 521,
"y": 560
}
],
"birth": 0,
"death": 24,
"type": "yellow plastic toy school bus"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 669,
"y": 80
},
{
"t": 21,
"x": 666,
"y": 72
}
],
"birth": 0,
"death": 24,
"type": "yellow wooden toy roller"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 697,
"y": 197
},
{
"t": 17,
"x": 689,
"y": 193
},
{
"t": 22,
"x": 705,
"y": 177
}
],
"birth": 0,
"death": 24,
"type": "multi-colored wooden roller"
},
{
"id": 13,
"image_positions": [
{
"t": 0,
"x": 791,
"y": 755
}
],
"birth": 0,
"death": 24,
"type": "black can opener"
},
{
"id": 14,
"image_positions": [
{
"t": 0,
"x": 822,
"y": 68
}
],
"birth": 0,
"death": 24,
"type": "white and orange cardboard cosmetic box"
},
{
"id": 15,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 720
}
],
"birth": 0,
"death": 24,
"type": "dark grey metallic cake pan set"
},
{
"id": 16,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 4,
"x": 1,
"y": 373
},
{
"t": 9,
"x": null,
"y": null
},
{
"t": 18,
"x": 1,
"y": 373
},
{
"t": 22,
"x": null,
"y": null
}
],
"birth": 4,
"death": 24,
"type": "black cardboard motherboard box"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
4
],
"outputs": [
2,
4
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 11,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 12,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 13,
"inputs": [
14,
65535
],
"outputs": [
14,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 14,
"inputs": [
15,
65535
],
"outputs": [
15,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 15,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 2,
"type": "contact"
},
{
"id": 16,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 6,
"type": "contact"
},
{
"id": 17,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 18,
"inputs": [
1,
2
],
"outputs": [
1,
2
],
"begins_at": 1,
"ends_at": 1,
"type": "collision"
},
{
"id": 19,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 1,
"ends_at": 1,
"type": "collision"
},
{
"id": 20,
"inputs": [
2,
4
],
"outputs": [
2,
4
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 21,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 22,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 2,
"ends_at": 5,
"type": "contact"
},
{
"id": 23,
"inputs": [
2
],
"outputs": [
2
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 24,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 25,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 26,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 27,
"inputs": [
2,
4
],
"outputs": [
2,
4
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 28,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 29,
"inputs": [
16,
65535
],
"outputs": [
16,
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 30,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 4,
"ends_at": 5,
"type": "collision"
},
{
"id": 31,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 4,
"ends_at": 11,
"type": "contact"
},
{
"id": 32,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 33,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 34,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 35,
"inputs": [
5
],
"outputs": [
5
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 36,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 37,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 38,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 7,
"ends_at": 8,
"type": "contact"
},
{
"id": 39,
"inputs": [
3
],
"outputs": [
3
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 40,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 8,
"ends_at": 23,
"type": "contact"
},
{
"id": 41,
"inputs": [
3,
5
],
"outputs": [
3,
5
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 42,
"inputs": [
5
],
"outputs": [
5
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 43,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 44,
"inputs": [
16,
65535
],
"outputs": [
16,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 45,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 46,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 47,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 48,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 12,
"ends_at": 14,
"type": "contact"
},
{
"id": 49,
"inputs": [
5
],
"outputs": [
5
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 50,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 51,
"inputs": [
3
],
"outputs": [
3
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 52,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 53,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 54,
"inputs": [
1,
5
],
"outputs": [
1,
5
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 55,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 56,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 57,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 58,
"inputs": [
12
],
"outputs": [
12
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 59,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 60,
"inputs": [
1,
5
],
"outputs": [
1,
5
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 61,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 62,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 63,
"inputs": [
16
],
"outputs": [
16
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 64,
"inputs": [
16,
65535
],
"outputs": [
16,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 65,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 18,
"ends_at": 19,
"type": "collision"
},
{
"id": 66,
"inputs": [
5
],
"outputs": [
5
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 67,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 19,
"ends_at": 21,
"type": "contact"
},
{
"id": 68,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 69,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 70,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 71,
"inputs": [
5
],
"outputs": [
5
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 72,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 73,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 0.9974424552429667,
"avg_image_position_segmentation_acc_small": 0.9956521739130434,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 0.9974424552429667,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": 1.0,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 1.0,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 1.0,
"num_matches": 17,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.43977347883597906,
"avg_interaction_input_object_jaccard": 0.19791666666666666,
"avg_interaction_output_object_jaccard": 0.19791666666666666,
"avg_interaction_type_exact_match_acc": 0.8333333333333334,
"num_interaction_matches": 48,
"num_unmatched_pred_interactions": 26,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 27,
"false_positives": 47,
"false_negatives": 0
},
"0.5": {
"true_positives": 24,
"false_positives": 50,
"false_negatives": 0
},
"0.75": {
"true_positives": 15,
"false_positives": 59,
"false_negatives": 0
},
"1.0": {
"true_positives": 13,
"false_positives": 61,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.36486486486486486,
"0.5": 0.32432432432432434,
"0.75": 0.20270270270270271,
"1.0": 0.17567567567567569
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.5346534653465346,
"0.5": 0.489795918367347,
"0.75": 0.3370786516853933,
"1.0": 0.2988505747126437
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 26,
"false_positives": 48,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 72,
"false_negatives": 0
},
"0.75": {
"true_positives": 1,
"false_positives": 73,
"false_negatives": 0
},
"1.0": {
"true_positives": 1,
"false_positives": 73,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.35135135135135137,
"0.5": 0.02702702702702703,
"0.75": 0.013513513513513514,
"1.0": 0.013513513513513514
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.52,
"0.5": 0.052631578947368425,
"0.75": 0.026666666666666665,
"1.0": 0.026666666666666665
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 26,
"false_positives": 48,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 72,
"false_negatives": 0
},
"0.75": {
"true_positives": 1,
"false_positives": 73,
"false_negatives": 0
},
"1.0": {
"true_positives": 1,
"false_positives": 73,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.35135135135135137,
"0.5": 0.02702702702702703,
"0.75": 0.013513513513513514,
"1.0": 0.013513513513513514
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.52,
"0.5": 0.052631578947368425,
"0.75": 0.026666666666666665,
"1.0": 0.026666666666666665
}
}
}Prompt
Growing GT object-track prefill
At prefix step t, B3 saw frames 0..t and an assistant prefill containing GT object tracks only through t. The prefills are deterministically reconstructed with the exact oracle helper; only the final full-clip generation was persisted by inference.
Every persisted/reconstructed prefill step
[
{
"frame_index": 0,
"frames_visible": "0..0",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 1 [PX] 0 9 650 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 13 470 [OBJ] 2 \"wooden spelling toy\" 0 1 [PX] 0 37 146 [OBJ] 3 \"khaki fabric boat shoe\" 0 1 [PX] 0 44 626 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 1 [PX] 0 119 263 [OBJ] 5 \"brown ceramic flower pot\" 0 1 [PX] 0 134 478 [OBJ] 6 \"blush metallic leather ballet flat\" 0 1 [PX] 0 220 599 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 291 548 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 1 [PX] 0 306 470 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 1 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 1 [PX] 0 525 552 [OBJ] 11 \"yellow wooden toy roller\" 0 1 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 1 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 1 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 1 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 1 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 1,
"frames_visible": "0..1",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 2 [PX] 0 9 650 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 2 [PX] 0 13 470 1 25 466 [OBJ] 2 \"wooden spelling toy\" 0 2 [PX] 0 37 146 1 83 142 [OBJ] 3 \"khaki fabric boat shoe\" 0 2 [PX] 0 44 626 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 2 [PX] 0 119 263 1 146 275 [OBJ] 5 \"brown ceramic flower pot\" 0 2 [PX] 0 134 478 [OBJ] 6 \"blush metallic leather ballet flat\" 0 2 [PX] 0 220 599 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 2 [PX] 0 291 548 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 2 [PX] 0 306 470 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 2 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 2 [PX] 0 525 552 [OBJ] 11 \"yellow wooden toy roller\" 0 2 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 2 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 2 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 2 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 2 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 2 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 2,
"frames_visible": "0..2",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 3 [PX] 0 9 650 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 3 [PX] 0 13 470 1 25 466 2 13 466 [OBJ] 2 \"wooden spelling toy\" 0 3 [PX] 0 37 146 1 83 142 2 134 169 [OBJ] 3 \"khaki fabric boat shoe\" 0 3 [PX] 0 44 626 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 3 [PX] 0 119 263 1 146 275 2 41 216 [OBJ] 5 \"brown ceramic flower pot\" 0 3 [PX] 0 134 478 [OBJ] 6 \"blush metallic leather ballet flat\" 0 3 [PX] 0 220 599 2 228 603 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 3 [PX] 0 291 548 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 3 [PX] 0 306 470 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 3 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 3 [PX] 0 525 552 [OBJ] 11 \"yellow wooden toy roller\" 0 3 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 3 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 3 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 3 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 3 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 3 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 3,
"frames_visible": "0..3",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 4 [PX] 0 9 650 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 4 [PX] 0 13 470 1 25 466 2 13 466 [OBJ] 2 \"wooden spelling toy\" 0 4 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 [OBJ] 3 \"khaki fabric boat shoe\" 0 4 [PX] 0 44 626 3 44 615 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 4 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 [OBJ] 5 \"brown ceramic flower pot\" 0 4 [PX] 0 134 478 [OBJ] 6 \"blush metallic leather ballet flat\" 0 4 [PX] 0 220 599 2 228 603 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 4 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 4 [PX] 0 306 470 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 4 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 4 [PX] 0 525 552 [OBJ] 11 \"yellow wooden toy roller\" 0 4 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 4 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 4 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 4 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 4 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 4 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 4,
"frames_visible": "0..4",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 5 [PX] 0 9 650 4 13 634 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 5 [PX] 0 13 470 1 25 466 2 13 466 [OBJ] 2 \"wooden spelling toy\" 0 5 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 [OBJ] 3 \"khaki fabric boat shoe\" 0 5 [PX] 0 44 626 3 44 615 4 68 630 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 5 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 [OBJ] 5 \"brown ceramic flower pot\" 0 5 [PX] 0 134 478 4 142 458 [OBJ] 6 \"blush metallic leather ballet flat\" 0 5 [PX] 0 220 599 2 228 603 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 5 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 5 [PX] 0 306 470 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 5 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 5 [PX] 0 525 552 [OBJ] 11 \"yellow wooden toy roller\" 0 5 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 5 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 5 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 5 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 5 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 5 [PX] 0 null null 4 1 373 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 5,
"frames_visible": "0..5",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 6 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 6 [PX] 0 13 470 1 25 466 2 13 466 [OBJ] 2 \"wooden spelling toy\" 0 6 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 [OBJ] 3 \"khaki fabric boat shoe\" 0 6 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 6 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 [OBJ] 5 \"brown ceramic flower pot\" 0 6 [PX] 0 134 478 4 142 458 [OBJ] 6 \"blush metallic leather ballet flat\" 0 6 [PX] 0 220 599 2 228 603 5 220 607 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 6 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 6 [PX] 0 306 470 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 6 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 6 [PX] 0 525 552 [OBJ] 11 \"yellow wooden toy roller\" 0 6 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 6 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 6 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 6 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 6 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 6 [PX] 0 null null 4 1 373 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 6,
"frames_visible": "0..6",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 7 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 7 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 [OBJ] 2 \"wooden spelling toy\" 0 7 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 [OBJ] 3 \"khaki fabric boat shoe\" 0 7 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 7 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 [OBJ] 5 \"brown ceramic flower pot\" 0 7 [PX] 0 134 478 4 142 458 [OBJ] 6 \"blush metallic leather ballet flat\" 0 7 [PX] 0 220 599 2 228 603 5 220 607 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 7 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 7 [PX] 0 306 470 6 326 482 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 7 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 7 [PX] 0 525 552 [OBJ] 11 \"yellow wooden toy roller\" 0 7 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 7 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 7 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 7 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 7 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 7 [PX] 0 null null 4 1 373 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 7,
"frames_visible": "0..7",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 8 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 8 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 [OBJ] 2 \"wooden spelling toy\" 0 8 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 [OBJ] 3 \"khaki fabric boat shoe\" 0 8 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 8 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 [OBJ] 5 \"brown ceramic flower pot\" 0 8 [PX] 0 134 478 4 142 458 7 146 451 [OBJ] 6 \"blush metallic leather ballet flat\" 0 8 [PX] 0 220 599 2 228 603 5 220 607 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 8 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 8 [PX] 0 306 470 6 326 482 7 337 490 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 8 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 8 [PX] 0 525 552 [OBJ] 11 \"yellow wooden toy roller\" 0 8 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 8 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 8 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 8 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 8 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 8 [PX] 0 null null 4 1 373 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 8,
"frames_visible": "0..8",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 9 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 9 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 [OBJ] 2 \"wooden spelling toy\" 0 9 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 [OBJ] 3 \"khaki fabric boat shoe\" 0 9 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 9 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 [OBJ] 5 \"brown ceramic flower pot\" 0 9 [PX] 0 134 478 4 142 458 7 146 451 [OBJ] 6 \"blush metallic leather ballet flat\" 0 9 [PX] 0 220 599 2 228 603 5 220 607 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 9 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 9 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 9 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 9 [PX] 0 525 552 [OBJ] 11 \"yellow wooden toy roller\" 0 9 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 9 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 9 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 9 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 9 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 9 [PX] 0 null null 4 1 373 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 9,
"frames_visible": "0..9",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 10 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 10 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 [OBJ] 2 \"wooden spelling toy\" 0 10 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 [OBJ] 3 \"khaki fabric boat shoe\" 0 10 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 10 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 [OBJ] 5 \"brown ceramic flower pot\" 0 10 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 [OBJ] 6 \"blush metallic leather ballet flat\" 0 10 [PX] 0 220 599 2 228 603 5 220 607 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 10 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 10 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 10 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 10 [PX] 0 525 552 [OBJ] 11 \"yellow wooden toy roller\" 0 10 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 10 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 10 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 10 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 10 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 10 [PX] 0 null null 4 1 373 9 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 10,
"frames_visible": "0..10",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 11 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 11 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 [OBJ] 2 \"wooden spelling toy\" 0 11 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 [OBJ] 3 \"khaki fabric boat shoe\" 0 11 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 11 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 [OBJ] 5 \"brown ceramic flower pot\" 0 11 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 [OBJ] 6 \"blush metallic leather ballet flat\" 0 11 [PX] 0 220 599 2 228 603 5 220 607 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 11 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 11 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 11 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 11 [PX] 0 525 552 [OBJ] 11 \"yellow wooden toy roller\" 0 11 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 11 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 11 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 11 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 11 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 11 [PX] 0 null null 4 1 373 9 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 11,
"frames_visible": "0..11",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 12 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 12 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 [OBJ] 2 \"wooden spelling toy\" 0 12 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 [OBJ] 3 \"khaki fabric boat shoe\" 0 12 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 12 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 [OBJ] 5 \"brown ceramic flower pot\" 0 12 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 [OBJ] 6 \"blush metallic leather ballet flat\" 0 12 [PX] 0 220 599 2 228 603 5 220 607 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 12 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 12 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 12 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 12 [PX] 0 525 552 11 521 560 [OBJ] 11 \"yellow wooden toy roller\" 0 12 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 12 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 12 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 12 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 12 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 12 [PX] 0 null null 4 1 373 9 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 12,
"frames_visible": "0..12",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 13 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 13 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 [OBJ] 2 \"wooden spelling toy\" 0 13 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 [OBJ] 3 \"khaki fabric boat shoe\" 0 13 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 13 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 [OBJ] 5 \"brown ceramic flower pot\" 0 13 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 [OBJ] 6 \"blush metallic leather ballet flat\" 0 13 [PX] 0 220 599 2 228 603 5 220 607 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 13 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 13 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 13 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 13 [PX] 0 525 552 11 521 560 [OBJ] 11 \"yellow wooden toy roller\" 0 13 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 13 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 13 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 13 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 13 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 13 [PX] 0 null null 4 1 373 9 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 13,
"frames_visible": "0..13",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 14 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 14 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 [OBJ] 2 \"wooden spelling toy\" 0 14 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 [OBJ] 3 \"khaki fabric boat shoe\" 0 14 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 14 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 [OBJ] 5 \"brown ceramic flower pot\" 0 14 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 [OBJ] 6 \"blush metallic leather ballet flat\" 0 14 [PX] 0 220 599 2 228 603 5 220 607 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 14 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 14 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 14 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 14 [PX] 0 525 552 11 521 560 [OBJ] 11 \"yellow wooden toy roller\" 0 14 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 14 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 14 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 14 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 14 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 14 [PX] 0 null null 4 1 373 9 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 14,
"frames_visible": "0..14",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 15 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 15 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 [OBJ] 2 \"wooden spelling toy\" 0 15 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 14 443 318 [OBJ] 3 \"khaki fabric boat shoe\" 0 15 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 14 134 638 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 15 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 14 83 267 [OBJ] 5 \"brown ceramic flower pot\" 0 15 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 [OBJ] 6 \"blush metallic leather ballet flat\" 0 15 [PX] 0 220 599 2 228 603 5 220 607 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 15 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 15 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 14 357 513 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 15 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 15 [PX] 0 525 552 11 521 560 [OBJ] 11 \"yellow wooden toy roller\" 0 15 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 15 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 15 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 15 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 15 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 15 [PX] 0 null null 4 1 373 9 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 15,
"frames_visible": "0..15",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 16 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 16 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 15 17 474 [OBJ] 2 \"wooden spelling toy\" 0 16 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 14 443 318 15 458 318 [OBJ] 3 \"khaki fabric boat shoe\" 0 16 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 14 134 638 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 16 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 14 83 267 [OBJ] 5 \"brown ceramic flower pot\" 0 16 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 15 138 486 [OBJ] 6 \"blush metallic leather ballet flat\" 0 16 [PX] 0 220 599 2 228 603 5 220 607 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 16 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 16 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 14 357 513 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 16 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 16 [PX] 0 525 552 11 521 560 [OBJ] 11 \"yellow wooden toy roller\" 0 16 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 16 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 16 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 16 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 16 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 16 [PX] 0 null null 4 1 373 9 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 16,
"frames_visible": "0..16",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 17 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 17 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 15 17 474 [OBJ] 2 \"wooden spelling toy\" 0 17 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 14 443 318 15 458 318 16 482 310 [OBJ] 3 \"khaki fabric boat shoe\" 0 17 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 14 134 638 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 17 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 14 83 267 [OBJ] 5 \"brown ceramic flower pot\" 0 17 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 15 138 486 [OBJ] 6 \"blush metallic leather ballet flat\" 0 17 [PX] 0 220 599 2 228 603 5 220 607 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 17 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 17 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 14 357 513 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 17 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 17 [PX] 0 525 552 11 521 560 [OBJ] 11 \"yellow wooden toy roller\" 0 17 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 17 [PX] 0 697 197 [OBJ] 13 \"black can opener\" 0 17 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 17 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 17 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 17 [PX] 0 null null 4 1 373 9 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 17,
"frames_visible": "0..17",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 18 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 18 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 15 17 474 [OBJ] 2 \"wooden spelling toy\" 0 18 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 14 443 318 15 458 318 16 482 310 17 494 302 [OBJ] 3 \"khaki fabric boat shoe\" 0 18 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 14 134 638 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 18 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 14 83 267 [OBJ] 5 \"brown ceramic flower pot\" 0 18 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 15 138 486 [OBJ] 6 \"blush metallic leather ballet flat\" 0 18 [PX] 0 220 599 2 228 603 5 220 607 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 18 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 18 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 14 357 513 17 380 458 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 18 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 18 [PX] 0 525 552 11 521 560 [OBJ] 11 \"yellow wooden toy roller\" 0 18 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 18 [PX] 0 697 197 17 689 193 [OBJ] 13 \"black can opener\" 0 18 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 18 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 18 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 18 [PX] 0 null null 4 1 373 9 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 18,
"frames_visible": "0..18",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 19 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 19 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 15 17 474 18 9 466 [OBJ] 2 \"wooden spelling toy\" 0 19 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 14 443 318 15 458 318 16 482 310 17 494 302 18 544 310 [OBJ] 3 \"khaki fabric boat shoe\" 0 19 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 14 134 638 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 19 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 14 83 267 [OBJ] 5 \"brown ceramic flower pot\" 0 19 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 15 138 486 18 130 482 [OBJ] 6 \"blush metallic leather ballet flat\" 0 19 [PX] 0 220 599 2 228 603 5 220 607 18 212 599 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 19 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 19 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 14 357 513 17 380 458 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 19 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 19 [PX] 0 525 552 11 521 560 [OBJ] 11 \"yellow wooden toy roller\" 0 19 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 19 [PX] 0 697 197 17 689 193 [OBJ] 13 \"black can opener\" 0 19 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 19 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 19 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 19 [PX] 0 null null 4 1 373 9 null null 18 1 373 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 19,
"frames_visible": "0..19",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 20 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 20 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 15 17 474 18 9 466 19 9 505 [OBJ] 2 \"wooden spelling toy\" 0 20 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 14 443 318 15 458 318 16 482 310 17 494 302 18 544 310 19 537 294 [OBJ] 3 \"khaki fabric boat shoe\" 0 20 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 14 134 638 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 20 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 14 83 267 [OBJ] 5 \"brown ceramic flower pot\" 0 20 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 15 138 486 18 130 482 19 123 478 [OBJ] 6 \"blush metallic leather ballet flat\" 0 20 [PX] 0 220 599 2 228 603 5 220 607 18 212 599 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 20 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 20 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 14 357 513 17 380 458 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 20 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 20 [PX] 0 525 552 11 521 560 [OBJ] 11 \"yellow wooden toy roller\" 0 20 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 20 [PX] 0 697 197 17 689 193 [OBJ] 13 \"black can opener\" 0 20 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 20 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 20 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 20 [PX] 0 null null 4 1 373 9 null null 18 1 373 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 20,
"frames_visible": "0..20",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 21 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 21 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 15 17 474 18 9 466 19 9 505 [OBJ] 2 \"wooden spelling toy\" 0 21 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 14 443 318 15 458 318 16 482 310 17 494 302 18 544 310 19 537 294 20 556 291 [OBJ] 3 \"khaki fabric boat shoe\" 0 21 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 14 134 638 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 21 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 14 83 267 [OBJ] 5 \"brown ceramic flower pot\" 0 21 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 15 138 486 18 130 482 19 123 478 20 123 490 [OBJ] 6 \"blush metallic leather ballet flat\" 0 21 [PX] 0 220 599 2 228 603 5 220 607 18 212 599 20 201 595 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 21 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 21 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 14 357 513 17 380 458 20 388 451 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 21 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 21 [PX] 0 525 552 11 521 560 [OBJ] 11 \"yellow wooden toy roller\" 0 21 [PX] 0 669 80 [OBJ] 12 \"multi-colored wooden roller\" 0 21 [PX] 0 697 197 17 689 193 [OBJ] 13 \"black can opener\" 0 21 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 21 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 21 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 21 [PX] 0 null null 4 1 373 9 null null 18 1 373 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 21,
"frames_visible": "0..21",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 22 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 22 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 15 17 474 18 9 466 19 9 505 21 1 501 [OBJ] 2 \"wooden spelling toy\" 0 22 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 14 443 318 15 458 318 16 482 310 17 494 302 18 544 310 19 537 294 20 556 291 21 591 298 [OBJ] 3 \"khaki fabric boat shoe\" 0 22 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 14 134 638 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 22 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 14 83 267 [OBJ] 5 \"brown ceramic flower pot\" 0 22 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 15 138 486 18 130 482 19 123 478 20 123 490 21 115 486 [OBJ] 6 \"blush metallic leather ballet flat\" 0 22 [PX] 0 220 599 2 228 603 5 220 607 18 212 599 20 201 595 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 22 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 22 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 14 357 513 17 380 458 20 388 451 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 22 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 22 [PX] 0 525 552 11 521 560 [OBJ] 11 \"yellow wooden toy roller\" 0 22 [PX] 0 669 80 21 666 72 [OBJ] 12 \"multi-colored wooden roller\" 0 22 [PX] 0 697 197 17 689 193 [OBJ] 13 \"black can opener\" 0 22 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 22 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 22 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 22 [PX] 0 null null 4 1 373 9 null null 18 1 373 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 22,
"frames_visible": "0..22",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 23 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 23 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 15 17 474 18 9 466 19 9 505 21 1 501 [OBJ] 2 \"wooden spelling toy\" 0 23 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 14 443 318 15 458 318 16 482 310 17 494 302 18 544 310 19 537 294 20 556 291 21 591 298 22 591 287 [OBJ] 3 \"khaki fabric boat shoe\" 0 23 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 14 134 638 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 23 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 14 83 267 22 103 275 [OBJ] 5 \"brown ceramic flower pot\" 0 23 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 15 138 486 18 130 482 19 123 478 20 123 490 21 115 486 [OBJ] 6 \"blush metallic leather ballet flat\" 0 23 [PX] 0 220 599 2 228 603 5 220 607 18 212 599 20 201 595 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 23 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 23 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 14 357 513 17 380 458 20 388 451 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 23 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 23 [PX] 0 525 552 11 521 560 [OBJ] 11 \"yellow wooden toy roller\" 0 23 [PX] 0 669 80 21 666 72 [OBJ] 12 \"multi-colored wooden roller\" 0 23 [PX] 0 697 197 17 689 193 22 705 177 [OBJ] 13 \"black can opener\" 0 23 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 23 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 23 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 23 [PX] 0 null null 4 1 373 9 null null 18 1 373 22 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 23,
"frames_visible": "0..23",
"provenance": "exact persisted final-step prefill and generation",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 24 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 24 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 15 17 474 18 9 466 19 9 505 21 1 501 23 null null [OBJ] 2 \"wooden spelling toy\" 0 24 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 14 443 318 15 458 318 16 482 310 17 494 302 18 544 310 19 537 294 20 556 291 21 591 298 22 591 287 23 615 291 [OBJ] 3 \"khaki fabric boat shoe\" 0 24 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 14 134 638 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 24 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 14 83 267 22 103 275 [OBJ] 5 \"brown ceramic flower pot\" 0 24 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 15 138 486 18 130 482 19 123 478 20 123 490 21 115 486 [OBJ] 6 \"blush metallic leather ballet flat\" 0 24 [PX] 0 220 599 2 228 603 5 220 607 18 212 599 20 201 595 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 24 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 24 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 14 357 513 17 380 458 20 388 451 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 24 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 24 [PX] 0 525 552 11 521 560 [OBJ] 11 \"yellow wooden toy roller\" 0 24 [PX] 0 669 80 21 666 72 [OBJ] 12 \"multi-colored wooden roller\" 0 24 [PX] 0 697 197 17 689 193 22 705 177 [OBJ] 13 \"black can opener\" 0 24 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 24 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 24 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 24 [PX] 0 null null 4 1 373 9 null null 18 1 373 22 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 8 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 8 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 9 \"contact\" 0 8 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 10 \"contact\" 0 8 [IN] 11 12 [OUT] 11 12 [INTERACT] 11 \"contact\" 0 8 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 12 \"contact\" 0 8 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 13 \"contact\" 0 8 [IN] 13 15 [OUT] 13 15 [INTERACT] 14 \"contact\" 0 8 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 15 \"contact\" 0 8 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 16 \"contact\" 0 8 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 17 \"contact\" 0 8 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 18 \"contact\" 0 8 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 19 \"contact\" 0 8 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 20 \"contact\" 0 8 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 21 \"contact\" 0 8 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 22 \"contact\" 0 8 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 23 \"contact\" 0 8 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 24 \"contact\" 0 8 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"collision\" 8 8 [IN] 10 16 [OUT] 10 16 [INTERACT] 3 \"contact\" 9 8 [IN] 10 16 [OUT] 10 16 [INTERACT] 4 \"collision\" 11 11 [IN] 10 16 [OUT] 10 16 [INTERACT] 5 \"collision\" 14 14 [IN] 10 16 [OUT] 10 16 [INTERACT] 6 \"contact\" 15 16 [IN] 10 16 [OUT] 10 16 [INTERACT] 7 \"collision\" 19 19 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 8 \"contact\" 20 20 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 24 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 24 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 15 17 474 18 9 466 19 9 505 21 1 501 23 null null [OBJ] 2 \"wooden spelling toy\" 0 24 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 14 443 318 15 458 318 16 482 310 17 494 302 18 544 310 19 537 294 20 556 291 21 591 298 22 591 287 23 615 291 [OBJ] 3 \"khaki fabric boat shoe\" 0 24 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 14 134 638 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 24 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 14 83 267 22 103 275 [OBJ] 5 \"brown ceramic flower pot\" 0 24 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 15 138 486 18 130 482 19 123 478 20 123 490 21 115 486 [OBJ] 6 \"blush metallic leather ballet flat\" 0 24 [PX] 0 220 599 2 228 603 5 220 607 18 212 599 20 201 595 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 24 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 24 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 14 357 513 17 380 458 20 388 451 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 24 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 24 [PX] 0 525 552 11 521 560 [OBJ] 11 \"yellow wooden toy roller\" 0 24 [PX] 0 669 80 21 666 72 [OBJ] 12 \"multi-colored wooden roller\" 0 24 [PX] 0 697 197 17 689 193 22 705 177 [OBJ] 13 \"black can opener\" 0 24 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 24 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 24 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 24 [PX] 0 null null 4 1 373 9 null null 18 1 373 22 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 8 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 8 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 9 \"contact\" 0 8 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 10 \"contact\" 0 8 [IN] 11 12 [OUT] 11 12 [INTERACT] 11 \"contact\" 0 8 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 12 \"contact\" 0 8 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 13 \"contact\" 0 8 [IN] 13 15 [OUT] 13 15 [INTERACT] 14 \"contact\" 0 8 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 15 \"contact\" 0 8 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 16 \"contact\" 0 8 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 17 \"contact\" 0 8 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 18 \"contact\" 0 8 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 19 \"contact\" 0 8 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 20 \"contact\" 0 8 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 21 \"contact\" 0 8 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 22 \"contact\" 0 8 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 23 \"contact\" 0 8 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 24 \"contact\" 0 8 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"collision\" 8 8 [IN] 10 16 [OUT] 10 16 [INTERACT] 3 \"contact\" 9 8 [IN] 10 16 [OUT] 10 16 [INTERACT] 4 \"collision\" 11 11 [IN] 10 16 [OUT] 10 16 [INTERACT] 5 \"collision\" 14 14 [IN] 10 16 [OUT] 10 16 [INTERACT] 6 \"contact\" 15 16 [IN] 10 16 [OUT] 10 16 [INTERACT] 7 \"collision\" 19 19 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 8 \"contact\" 20 20 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"intermediate_prediction_persisted": true
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "brown and orange leather wingtip shoe" 0 24 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 "white plastic lutein supplement bottle" 0 24 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 15 17 474 18 9 466 19 9 505 21 1 501 23 null null [OBJ] 2 "wooden spelling toy" 0 24 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 14 443 318 15 458 318 16 482 310 17 494 302 18 544 310 19 537 294 20 556 291 21 591 298 22 591 287 23 615 291 [OBJ] 3 "khaki fabric boat shoe" 0 24 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 14 134 638 [OBJ] 4 "black cardboard Asus Z97I-PLUS motherboard box" 0 24 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 14 83 267 22 103 275 [OBJ] 5 "brown ceramic flower pot" 0 24 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 15 138 486 18 130 482 19 123 478 20 123 490 21 115 486 [OBJ] 6 "blush metallic leather ballet flat" 0 24 [PX] 0 220 599 2 228 603 5 220 607 18 212 599 20 201 595 [OBJ] 7 "multicolored cardboard Scrabble game" 0 24 [PX] 0 291 548 3 298 552 [OBJ] 8 "glittery rose gold leather ballet flat" 0 24 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 14 357 513 17 380 458 20 388 451 [OBJ] 9 "light yellow and dark blue cardboard whey protein box" 0 24 [PX] 0 478 193 [OBJ] 10 "yellow plastic toy school bus" 0 24 [PX] 0 525 552 11 521 560 [OBJ] 11 "yellow wooden toy roller" 0 24 [PX] 0 669 80 21 666 72 [OBJ] 12 "multi-colored wooden roller" 0 24 [PX] 0 697 197 17 689 193 22 705 177 [OBJ] 13 "black can opener" 0 24 [PX] 0 791 755 [OBJ] 14 "white and orange cardboard cosmetic box" 0 24 [PX] 0 822 68 [OBJ] 15 "dark grey metallic cake pan set" 0 24 [PX] 0 919 720 [OBJ] 16 "black cardboard motherboard box" 4 24 [PX] 0 null null 4 1 373 9 null null 18 1 373 22 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 "contact" 0 8 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 "contact" 0 8 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 9 "contact" 0 8 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 10 "contact" 0 8 [IN] 11 12 [OUT] 11 12 [INTERACT] 11 "contact" 0 8 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 12 "contact" 0 8 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 13 "contact" 0 8 [IN] 13 15 [OUT] 13 15 [INTERACT] 14 "contact" 0 8 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 15 "contact" 0 8 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 16 "contact" 0 8 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 17 "contact" 0 8 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 18 "contact" 0 8 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 19 "contact" 0 8 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 20 "contact" 0 8 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 21 "contact" 0 8 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 22 "contact" 0 8 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 23 "contact" 0 8 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 24 "contact" 0 8 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 "collision" 8 8 [IN] 10 16 [OUT] 10 16 [INTERACT] 3 "contact" 9 8 [IN] 10 16 [OUT] 10 16 [INTERACT] 4 "collision" 11 11 [IN] 10 16 [OUT] 10 16 [INTERACT] 5 "collision" 14 14 [IN] 10 16 [OUT] 10 16 [INTERACT] 6 "contact" 15 16 [IN] 10 16 [OUT] 10 16 [INTERACT] 7 "collision" 19 19 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 8 "contact" 20 20 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 9,
"y": 650
},
{
"t": 4,
"x": 13,
"y": 634
},
{
"t": 5,
"x": 13,
"y": 611
}
],
"birth": 0,
"death": 24,
"type": "brown and orange leather wingtip shoe"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 13,
"y": 470
},
{
"t": 1,
"x": 25,
"y": 466
},
{
"t": 2,
"x": 13,
"y": 466
},
{
"t": 6,
"x": 13,
"y": 501
},
{
"t": 10,
"x": 9,
"y": 470
},
{
"t": 15,
"x": 17,
"y": 474
},
{
"t": 18,
"x": 9,
"y": 466
},
{
"t": 19,
"x": 9,
"y": 505
},
{
"t": 21,
"x": 1,
"y": 501
},
{
"t": 23,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "white plastic lutein supplement bottle"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 37,
"y": 146
},
{
"t": 1,
"x": 83,
"y": 142
},
{
"t": 2,
"x": 134,
"y": 169
},
{
"t": 3,
"x": 181,
"y": 197
},
{
"t": 4,
"x": 224,
"y": 232
},
{
"t": 5,
"x": 267,
"y": 267
},
{
"t": 6,
"x": 302,
"y": 294
},
{
"t": 7,
"x": 333,
"y": 314
},
{
"t": 8,
"x": 361,
"y": 322
},
{
"t": 9,
"x": 380,
"y": 318
},
{
"t": 10,
"x": 416,
"y": 314
},
{
"t": 11,
"x": 384,
"y": 314
},
{
"t": 12,
"x": 408,
"y": 314
},
{
"t": 13,
"x": 431,
"y": 314
},
{
"t": 14,
"x": 443,
"y": 318
},
{
"t": 15,
"x": 458,
"y": 318
},
{
"t": 16,
"x": 482,
"y": 310
},
{
"t": 17,
"x": 494,
"y": 302
},
{
"t": 18,
"x": 544,
"y": 310
},
{
"t": 19,
"x": 537,
"y": 294
},
{
"t": 20,
"x": 556,
"y": 291
},
{
"t": 21,
"x": 591,
"y": 298
},
{
"t": 22,
"x": 591,
"y": 287
},
{
"t": 23,
"x": 615,
"y": 291
}
],
"birth": 0,
"death": 24,
"type": "wooden spelling toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 44,
"y": 626
},
{
"t": 3,
"x": 44,
"y": 615
},
{
"t": 4,
"x": 68,
"y": 630
},
{
"t": 5,
"x": 80,
"y": 626
},
{
"t": 6,
"x": 91,
"y": 630
},
{
"t": 7,
"x": 103,
"y": 634
},
{
"t": 8,
"x": 111,
"y": 638
},
{
"t": 9,
"x": 103,
"y": 611
},
{
"t": 10,
"x": 111,
"y": 615
},
{
"t": 11,
"x": 123,
"y": 630
},
{
"t": 14,
"x": 134,
"y": 638
}
],
"birth": 0,
"death": 24,
"type": "khaki fabric boat shoe"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 119,
"y": 263
},
{
"t": 1,
"x": 146,
"y": 275
},
{
"t": 2,
"x": 41,
"y": 216
},
{
"t": 3,
"x": 56,
"y": 236
},
{
"t": 4,
"x": 72,
"y": 255
},
{
"t": 5,
"x": 87,
"y": 275
},
{
"t": 6,
"x": 91,
"y": 283
},
{
"t": 12,
"x": 87,
"y": 275
},
{
"t": 14,
"x": 83,
"y": 267
},
{
"t": 22,
"x": 103,
"y": 275
}
],
"birth": 0,
"death": 24,
"type": "black cardboard Asus Z97I-PLUS motherboard box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 134,
"y": 478
},
{
"t": 4,
"x": 142,
"y": 458
},
{
"t": 7,
"x": 146,
"y": 451
},
{
"t": 9,
"x": 142,
"y": 458
},
{
"t": 13,
"x": 134,
"y": 478
},
{
"t": 15,
"x": 138,
"y": 486
},
{
"t": 18,
"x": 130,
"y": 482
},
{
"t": 19,
"x": 123,
"y": 478
},
{
"t": 20,
"x": 123,
"y": 490
},
{
"t": 21,
"x": 115,
"y": 486
}
],
"birth": 0,
"death": 24,
"type": "brown ceramic flower pot"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 220,
"y": 599
},
{
"t": 2,
"x": 228,
"y": 603
},
{
"t": 5,
"x": 220,
"y": 607
},
{
"t": 18,
"x": 212,
"y": 599
},
{
"t": 20,
"x": 201,
"y": 595
}
],
"birth": 0,
"death": 24,
"type": "blush metallic leather ballet flat"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 291,
"y": 548
},
{
"t": 3,
"x": 298,
"y": 552
}
],
"birth": 0,
"death": 24,
"type": "multicolored cardboard Scrabble game"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 306,
"y": 470
},
{
"t": 6,
"x": 326,
"y": 482
},
{
"t": 7,
"x": 337,
"y": 490
},
{
"t": 8,
"x": 345,
"y": 501
},
{
"t": 11,
"x": 349,
"y": 509
},
{
"t": 12,
"x": 361,
"y": 451
},
{
"t": 13,
"x": 369,
"y": 447
},
{
"t": 14,
"x": 357,
"y": 513
},
{
"t": 17,
"x": 380,
"y": 458
},
{
"t": 20,
"x": 388,
"y": 451
}
],
"birth": 0,
"death": 24,
"type": "glittery rose gold leather ballet flat"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 478,
"y": 193
}
],
"birth": 0,
"death": 24,
"type": "light yellow and dark blue cardboard whey protein box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 525,
"y": 552
},
{
"t": 11,
"x": 521,
"y": 560
}
],
"birth": 0,
"death": 24,
"type": "yellow plastic toy school bus"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 669,
"y": 80
},
{
"t": 21,
"x": 666,
"y": 72
}
],
"birth": 0,
"death": 24,
"type": "yellow wooden toy roller"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 697,
"y": 197
},
{
"t": 17,
"x": 689,
"y": 193
},
{
"t": 22,
"x": 705,
"y": 177
}
],
"birth": 0,
"death": 24,
"type": "multi-colored wooden roller"
},
{
"id": 13,
"image_positions": [
{
"t": 0,
"x": 791,
"y": 755
}
],
"birth": 0,
"death": 24,
"type": "black can opener"
},
{
"id": 14,
"image_positions": [
{
"t": 0,
"x": 822,
"y": 68
}
],
"birth": 0,
"death": 24,
"type": "white and orange cardboard cosmetic box"
},
{
"id": 15,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 720
}
],
"birth": 0,
"death": 24,
"type": "dark grey metallic cake pan set"
},
{
"id": 16,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 4,
"x": 1,
"y": 373
},
{
"t": 9,
"x": null,
"y": null
},
{
"t": 18,
"x": 1,
"y": 373
},
{
"t": 22,
"x": null,
"y": null
}
],
"birth": 4,
"death": 24,
"type": "black cardboard motherboard box"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 9,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 10,
"inputs": [
11,
12
],
"outputs": [
11,
12
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 11,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 12,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 13,
"inputs": [
13,
15
],
"outputs": [
13,
15
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 14,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 15,
"inputs": [
14,
65535
],
"outputs": [
14,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 16,
"inputs": [
15,
65535
],
"outputs": [
15,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 17,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 18,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 19,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 20,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 21,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 22,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 23,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 24,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 2,
"inputs": [
10,
16
],
"outputs": [
10,
16
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 3,
"inputs": [
10,
16
],
"outputs": [
10,
16
],
"begins_at": 9,
"ends_at": 8,
"type": "contact"
},
{
"id": 4,
"inputs": [
10,
16
],
"outputs": [
10,
16
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 5,
"inputs": [
10,
16
],
"outputs": [
10,
16
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 6,
"inputs": [
10,
16
],
"outputs": [
10,
16
],
"begins_at": 15,
"ends_at": 16,
"type": "contact"
},
{
"id": 7,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 8,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "contact"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 0.9974424552429667,
"avg_image_position_segmentation_acc_small": 0.9956521739130434,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 0.9974424552429667,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": 1.0,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 1.0,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 1.0,
"num_matches": 17,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.4171213624338624,
"avg_interaction_input_object_jaccard": 0.18055555555555555,
"avg_interaction_output_object_jaccard": 0.18055555555555555,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 24,
"num_unmatched_pred_interactions": 1,
"num_unmatched_target_interactions": 24,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 20,
"false_positives": 5,
"false_negatives": 24
},
"0.5": {
"true_positives": 6,
"false_positives": 19,
"false_negatives": 24
},
"0.75": {
"true_positives": 4,
"false_positives": 21,
"false_negatives": 24
},
"1.0": {
"true_positives": 2,
"false_positives": 23,
"false_negatives": 24
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.8,
"0.5": 0.24,
"0.75": 0.16,
"1.0": 0.08
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.45454545454545453,
"0.5": 0.2,
"0.75": 0.14285714285714285,
"1.0": 0.07692307692307693
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.5797101449275363,
"0.5": 0.2181818181818182,
"0.75": 0.15094339622641512,
"1.0": 0.0784313725490196
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 13,
"false_positives": 12,
"false_negatives": 24
},
"0.5": {
"true_positives": 0,
"false_positives": 25,
"false_negatives": 24
},
"0.75": {
"true_positives": 0,
"false_positives": 25,
"false_negatives": 24
},
"1.0": {
"true_positives": 0,
"false_positives": 25,
"false_negatives": 24
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.52,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.35135135135135137,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.4193548387096775,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 13,
"false_positives": 12,
"false_negatives": 24
},
"0.5": {
"true_positives": 0,
"false_positives": 25,
"false_negatives": 24
},
"0.75": {
"true_positives": 0,
"false_positives": 25,
"false_negatives": 24
},
"1.0": {
"true_positives": 0,
"false_positives": 25,
"false_negatives": 24
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.52,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.35135135135135137,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.4193548387096775,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
}Prompt
<video> Analyze the provided video and return ONLY a valid sentinel sequence in this format: [SCENE-START] [OBJS-START] [OBJ] id "type" birth death [PX] t px py ... [OBJ] ... [OBJS-END] [INTERACTIONS-START] [INTERACT] id "type" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ... [INTERACT] ... [INTERACTIONS-END] [SCENE-END] Constraints: - Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose). - Keep tags exactly as written: `[SCENE-START] [OBJS-START] [OBJ] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]` - Use quoted strings for `type` (double quotes). - `PX` uses repeated groups of 3 values in order: `t px py`. - `t` is the timestamp (frame number). - `px` and `py` are the pixel coordinates of the object in that frame, normalized to [0,1] relative to the frame dimensions, scaled by 1000 and rounded to the nearest integer. For example, `px` of 0.1234 would be represented as 123. - When an object is occluded or not visible in a frame, `PX` may use `t null null`. - `IN` and `OUT` contain whitespace-separated integer ids.
One full-clip GT object prefill
The E2E model saw all 24 frames once. Its assistant text was the exact GT object section through [INTERACTIONS-START], and the model generated only the interaction suffix shown here.
Every persisted/reconstructed prefill step
[
{
"frame_index": 23,
"frames_visible": "0..23",
"provenance": "exact persisted full-clip prefill and generation",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 24 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 24 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 15 17 474 18 9 466 19 9 505 21 1 501 23 null null [OBJ] 2 \"wooden spelling toy\" 0 24 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 14 443 318 15 458 318 16 482 310 17 494 302 18 544 310 19 537 294 20 556 291 21 591 298 22 591 287 23 615 291 [OBJ] 3 \"khaki fabric boat shoe\" 0 24 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 14 134 638 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 24 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 14 83 267 22 103 275 [OBJ] 5 \"brown ceramic flower pot\" 0 24 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 15 138 486 18 130 482 19 123 478 20 123 490 21 115 486 [OBJ] 6 \"blush metallic leather ballet flat\" 0 24 [PX] 0 220 599 2 228 603 5 220 607 18 212 599 20 201 595 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 24 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 24 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 14 357 513 17 380 458 20 388 451 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 24 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 24 [PX] 0 525 552 11 521 560 [OBJ] 11 \"yellow wooden toy roller\" 0 24 [PX] 0 669 80 21 666 72 [OBJ] 12 \"multi-colored wooden roller\" 0 24 [PX] 0 697 197 17 689 193 22 705 177 [OBJ] 13 \"black can opener\" 0 24 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 24 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 24 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 24 [PX] 0 null null 4 1 373 9 null null 18 1 373 22 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 28 \"contact\" 0 2 [IN] 5 8 [OUT] 5 8 [INTERACT] 22 \"contact\" 0 6 [IN] 3 5 [OUT] 3 5 [INTERACT] 23 \"contact\" 0 6 [IN] 3 6 [OUT] 3 6 [INTERACT] 3 \"contact\" 0 10 [IN] 1 5 [OUT] 1 5 [INTERACT] 16 \"contact\" 0 11 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 26 \"contact\" 0 15 [IN] 5 6 [OUT] 5 6 [INTERACT] 0 \"contact\" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 23 [IN] 1 16 [OUT] 1 16 [INTERACT] 2 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 25 \"contact\" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 30 \"contact\" 0 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 31 \"contact\" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 32 \"contact\" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 33 \"contact\" 0 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 5 \"contact\" 0 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 6 \"contact\" 0 23 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 7 \"contact\" 0 23 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 8 \"contact\" 0 23 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 9 \"contact\" 0 23 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 10 \"contact\" 0 23 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 11 \"contact\" 0 23 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 14 \"collision\" 5 5 [IN] 2 5 [OUT] 2 5 [INTERACT] 15 \"contact\" 6 10 [IN] 2 5 [OUT] 2 5 [INTERACT] 12 \"collision\" 10 10 [IN] 2 12 [OUT] 2 12 [INTERACT] 24 \"collision\" 10 10 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 13 \"contact\" 11 12 [IN] 2 12 [OUT] 2 12 [INTERACT] 17 \"collision\" 14 14 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 29 \"collision\" 15 15 [IN] 5 8 [OUT] 5 8 [INTERACT] 18 \"collision\" 16 16 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 27 \"collision\" 17 17 [IN] 5 6 [OUT] 5 6 [INTERACT] 19 \"contact\" 17 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 20 \"collision\" 18 18 [IN] 3 5 [OUT] 3 5 [INTERACT] 21 \"contact\" 19 23 [IN] 3 5 [OUT] 3 5 [INTERACT] 4 \"collision\" 23 23 [IN] 1 5 [OUT] 1 5 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown and orange leather wingtip shoe\" 0 24 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 \"white plastic lutein supplement bottle\" 0 24 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 15 17 474 18 9 466 19 9 505 21 1 501 23 null null [OBJ] 2 \"wooden spelling toy\" 0 24 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 14 443 318 15 458 318 16 482 310 17 494 302 18 544 310 19 537 294 20 556 291 21 591 298 22 591 287 23 615 291 [OBJ] 3 \"khaki fabric boat shoe\" 0 24 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 14 134 638 [OBJ] 4 \"black cardboard Asus Z97I-PLUS motherboard box\" 0 24 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 14 83 267 22 103 275 [OBJ] 5 \"brown ceramic flower pot\" 0 24 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 15 138 486 18 130 482 19 123 478 20 123 490 21 115 486 [OBJ] 6 \"blush metallic leather ballet flat\" 0 24 [PX] 0 220 599 2 228 603 5 220 607 18 212 599 20 201 595 [OBJ] 7 \"multicolored cardboard Scrabble game\" 0 24 [PX] 0 291 548 3 298 552 [OBJ] 8 \"glittery rose gold leather ballet flat\" 0 24 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 14 357 513 17 380 458 20 388 451 [OBJ] 9 \"light yellow and dark blue cardboard whey protein box\" 0 24 [PX] 0 478 193 [OBJ] 10 \"yellow plastic toy school bus\" 0 24 [PX] 0 525 552 11 521 560 [OBJ] 11 \"yellow wooden toy roller\" 0 24 [PX] 0 669 80 21 666 72 [OBJ] 12 \"multi-colored wooden roller\" 0 24 [PX] 0 697 197 17 689 193 22 705 177 [OBJ] 13 \"black can opener\" 0 24 [PX] 0 791 755 [OBJ] 14 \"white and orange cardboard cosmetic box\" 0 24 [PX] 0 822 68 [OBJ] 15 \"dark grey metallic cake pan set\" 0 24 [PX] 0 919 720 [OBJ] 16 \"black cardboard motherboard box\" 4 24 [PX] 0 null null 4 1 373 9 null null 18 1 373 22 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 28 \"contact\" 0 2 [IN] 5 8 [OUT] 5 8 [INTERACT] 22 \"contact\" 0 6 [IN] 3 5 [OUT] 3 5 [INTERACT] 23 \"contact\" 0 6 [IN] 3 6 [OUT] 3 6 [INTERACT] 3 \"contact\" 0 10 [IN] 1 5 [OUT] 1 5 [INTERACT] 16 \"contact\" 0 11 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 26 \"contact\" 0 15 [IN] 5 6 [OUT] 5 6 [INTERACT] 0 \"contact\" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 23 [IN] 1 16 [OUT] 1 16 [INTERACT] 2 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 25 \"contact\" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 30 \"contact\" 0 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 31 \"contact\" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 32 \"contact\" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 33 \"contact\" 0 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 5 \"contact\" 0 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 6 \"contact\" 0 23 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 7 \"contact\" 0 23 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 8 \"contact\" 0 23 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 9 \"contact\" 0 23 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 10 \"contact\" 0 23 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 11 \"contact\" 0 23 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 14 \"collision\" 5 5 [IN] 2 5 [OUT] 2 5 [INTERACT] 15 \"contact\" 6 10 [IN] 2 5 [OUT] 2 5 [INTERACT] 12 \"collision\" 10 10 [IN] 2 12 [OUT] 2 12 [INTERACT] 24 \"collision\" 10 10 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 13 \"contact\" 11 12 [IN] 2 12 [OUT] 2 12 [INTERACT] 17 \"collision\" 14 14 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 29 \"collision\" 15 15 [IN] 5 8 [OUT] 5 8 [INTERACT] 18 \"collision\" 16 16 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 27 \"collision\" 17 17 [IN] 5 6 [OUT] 5 6 [INTERACT] 19 \"contact\" 17 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 20 \"collision\" 18 18 [IN] 3 5 [OUT] 3 5 [INTERACT] 21 \"contact\" 19 23 [IN] 3 5 [OUT] 3 5 [INTERACT] 4 \"collision\" 23 23 [IN] 1 5 [OUT] 1 5 [INTERACTIONS-END] [SCENE-END]"
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "brown and orange leather wingtip shoe" 0 24 [PX] 0 9 650 4 13 634 5 13 611 [OBJ] 1 "white plastic lutein supplement bottle" 0 24 [PX] 0 13 470 1 25 466 2 13 466 6 13 501 10 9 470 15 17 474 18 9 466 19 9 505 21 1 501 23 null null [OBJ] 2 "wooden spelling toy" 0 24 [PX] 0 37 146 1 83 142 2 134 169 3 181 197 4 224 232 5 267 267 6 302 294 7 333 314 8 361 322 9 380 318 10 416 314 11 384 314 12 408 314 13 431 314 14 443 318 15 458 318 16 482 310 17 494 302 18 544 310 19 537 294 20 556 291 21 591 298 22 591 287 23 615 291 [OBJ] 3 "khaki fabric boat shoe" 0 24 [PX] 0 44 626 3 44 615 4 68 630 5 80 626 6 91 630 7 103 634 8 111 638 9 103 611 10 111 615 11 123 630 14 134 638 [OBJ] 4 "black cardboard Asus Z97I-PLUS motherboard box" 0 24 [PX] 0 119 263 1 146 275 2 41 216 3 56 236 4 72 255 5 87 275 6 91 283 12 87 275 14 83 267 22 103 275 [OBJ] 5 "brown ceramic flower pot" 0 24 [PX] 0 134 478 4 142 458 7 146 451 9 142 458 13 134 478 15 138 486 18 130 482 19 123 478 20 123 490 21 115 486 [OBJ] 6 "blush metallic leather ballet flat" 0 24 [PX] 0 220 599 2 228 603 5 220 607 18 212 599 20 201 595 [OBJ] 7 "multicolored cardboard Scrabble game" 0 24 [PX] 0 291 548 3 298 552 [OBJ] 8 "glittery rose gold leather ballet flat" 0 24 [PX] 0 306 470 6 326 482 7 337 490 8 345 501 11 349 509 12 361 451 13 369 447 14 357 513 17 380 458 20 388 451 [OBJ] 9 "light yellow and dark blue cardboard whey protein box" 0 24 [PX] 0 478 193 [OBJ] 10 "yellow plastic toy school bus" 0 24 [PX] 0 525 552 11 521 560 [OBJ] 11 "yellow wooden toy roller" 0 24 [PX] 0 669 80 21 666 72 [OBJ] 12 "multi-colored wooden roller" 0 24 [PX] 0 697 197 17 689 193 22 705 177 [OBJ] 13 "black can opener" 0 24 [PX] 0 791 755 [OBJ] 14 "white and orange cardboard cosmetic box" 0 24 [PX] 0 822 68 [OBJ] 15 "dark grey metallic cake pan set" 0 24 [PX] 0 919 720 [OBJ] 16 "black cardboard motherboard box" 4 24 [PX] 0 null null 4 1 373 9 null null 18 1 373 22 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 28 "contact" 0 2 [IN] 5 8 [OUT] 5 8 [INTERACT] 22 "contact" 0 6 [IN] 3 5 [OUT] 3 5 [INTERACT] 23 "contact" 0 6 [IN] 3 6 [OUT] 3 6 [INTERACT] 3 "contact" 0 10 [IN] 1 5 [OUT] 1 5 [INTERACT] 16 "contact" 0 11 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 26 "contact" 0 15 [IN] 5 6 [OUT] 5 6 [INTERACT] 0 "contact" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 "contact" 0 23 [IN] 1 16 [OUT] 1 16 [INTERACT] 2 "contact" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 25 "contact" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 30 "contact" 0 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 31 "contact" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 32 "contact" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 33 "contact" 0 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 5 "contact" 0 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 6 "contact" 0 23 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 7 "contact" 0 23 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 8 "contact" 0 23 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 9 "contact" 0 23 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 10 "contact" 0 23 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 11 "contact" 0 23 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 14 "collision" 5 5 [IN] 2 5 [OUT] 2 5 [INTERACT] 15 "contact" 6 10 [IN] 2 5 [OUT] 2 5 [INTERACT] 12 "collision" 10 10 [IN] 2 12 [OUT] 2 12 [INTERACT] 24 "collision" 10 10 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 13 "contact" 11 12 [IN] 2 12 [OUT] 2 12 [INTERACT] 17 "collision" 14 14 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 29 "collision" 15 15 [IN] 5 8 [OUT] 5 8 [INTERACT] 18 "collision" 16 16 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 27 "collision" 17 17 [IN] 5 6 [OUT] 5 6 [INTERACT] 19 "contact" 17 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 20 "collision" 18 18 [IN] 3 5 [OUT] 3 5 [INTERACT] 21 "contact" 19 23 [IN] 3 5 [OUT] 3 5 [INTERACT] 4 "collision" 23 23 [IN] 1 5 [OUT] 1 5 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 9,
"y": 650
},
{
"t": 4,
"x": 13,
"y": 634
},
{
"t": 5,
"x": 13,
"y": 611
}
],
"birth": 0,
"death": 24,
"type": "brown and orange leather wingtip shoe"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 13,
"y": 470
},
{
"t": 1,
"x": 25,
"y": 466
},
{
"t": 2,
"x": 13,
"y": 466
},
{
"t": 6,
"x": 13,
"y": 501
},
{
"t": 10,
"x": 9,
"y": 470
},
{
"t": 15,
"x": 17,
"y": 474
},
{
"t": 18,
"x": 9,
"y": 466
},
{
"t": 19,
"x": 9,
"y": 505
},
{
"t": 21,
"x": 1,
"y": 501
},
{
"t": 23,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "white plastic lutein supplement bottle"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 37,
"y": 146
},
{
"t": 1,
"x": 83,
"y": 142
},
{
"t": 2,
"x": 134,
"y": 169
},
{
"t": 3,
"x": 181,
"y": 197
},
{
"t": 4,
"x": 224,
"y": 232
},
{
"t": 5,
"x": 267,
"y": 267
},
{
"t": 6,
"x": 302,
"y": 294
},
{
"t": 7,
"x": 333,
"y": 314
},
{
"t": 8,
"x": 361,
"y": 322
},
{
"t": 9,
"x": 380,
"y": 318
},
{
"t": 10,
"x": 416,
"y": 314
},
{
"t": 11,
"x": 384,
"y": 314
},
{
"t": 12,
"x": 408,
"y": 314
},
{
"t": 13,
"x": 431,
"y": 314
},
{
"t": 14,
"x": 443,
"y": 318
},
{
"t": 15,
"x": 458,
"y": 318
},
{
"t": 16,
"x": 482,
"y": 310
},
{
"t": 17,
"x": 494,
"y": 302
},
{
"t": 18,
"x": 544,
"y": 310
},
{
"t": 19,
"x": 537,
"y": 294
},
{
"t": 20,
"x": 556,
"y": 291
},
{
"t": 21,
"x": 591,
"y": 298
},
{
"t": 22,
"x": 591,
"y": 287
},
{
"t": 23,
"x": 615,
"y": 291
}
],
"birth": 0,
"death": 24,
"type": "wooden spelling toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 44,
"y": 626
},
{
"t": 3,
"x": 44,
"y": 615
},
{
"t": 4,
"x": 68,
"y": 630
},
{
"t": 5,
"x": 80,
"y": 626
},
{
"t": 6,
"x": 91,
"y": 630
},
{
"t": 7,
"x": 103,
"y": 634
},
{
"t": 8,
"x": 111,
"y": 638
},
{
"t": 9,
"x": 103,
"y": 611
},
{
"t": 10,
"x": 111,
"y": 615
},
{
"t": 11,
"x": 123,
"y": 630
},
{
"t": 14,
"x": 134,
"y": 638
}
],
"birth": 0,
"death": 24,
"type": "khaki fabric boat shoe"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 119,
"y": 263
},
{
"t": 1,
"x": 146,
"y": 275
},
{
"t": 2,
"x": 41,
"y": 216
},
{
"t": 3,
"x": 56,
"y": 236
},
{
"t": 4,
"x": 72,
"y": 255
},
{
"t": 5,
"x": 87,
"y": 275
},
{
"t": 6,
"x": 91,
"y": 283
},
{
"t": 12,
"x": 87,
"y": 275
},
{
"t": 14,
"x": 83,
"y": 267
},
{
"t": 22,
"x": 103,
"y": 275
}
],
"birth": 0,
"death": 24,
"type": "black cardboard Asus Z97I-PLUS motherboard box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 134,
"y": 478
},
{
"t": 4,
"x": 142,
"y": 458
},
{
"t": 7,
"x": 146,
"y": 451
},
{
"t": 9,
"x": 142,
"y": 458
},
{
"t": 13,
"x": 134,
"y": 478
},
{
"t": 15,
"x": 138,
"y": 486
},
{
"t": 18,
"x": 130,
"y": 482
},
{
"t": 19,
"x": 123,
"y": 478
},
{
"t": 20,
"x": 123,
"y": 490
},
{
"t": 21,
"x": 115,
"y": 486
}
],
"birth": 0,
"death": 24,
"type": "brown ceramic flower pot"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 220,
"y": 599
},
{
"t": 2,
"x": 228,
"y": 603
},
{
"t": 5,
"x": 220,
"y": 607
},
{
"t": 18,
"x": 212,
"y": 599
},
{
"t": 20,
"x": 201,
"y": 595
}
],
"birth": 0,
"death": 24,
"type": "blush metallic leather ballet flat"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 291,
"y": 548
},
{
"t": 3,
"x": 298,
"y": 552
}
],
"birth": 0,
"death": 24,
"type": "multicolored cardboard Scrabble game"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 306,
"y": 470
},
{
"t": 6,
"x": 326,
"y": 482
},
{
"t": 7,
"x": 337,
"y": 490
},
{
"t": 8,
"x": 345,
"y": 501
},
{
"t": 11,
"x": 349,
"y": 509
},
{
"t": 12,
"x": 361,
"y": 451
},
{
"t": 13,
"x": 369,
"y": 447
},
{
"t": 14,
"x": 357,
"y": 513
},
{
"t": 17,
"x": 380,
"y": 458
},
{
"t": 20,
"x": 388,
"y": 451
}
],
"birth": 0,
"death": 24,
"type": "glittery rose gold leather ballet flat"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 478,
"y": 193
}
],
"birth": 0,
"death": 24,
"type": "light yellow and dark blue cardboard whey protein box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 525,
"y": 552
},
{
"t": 11,
"x": 521,
"y": 560
}
],
"birth": 0,
"death": 24,
"type": "yellow plastic toy school bus"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 669,
"y": 80
},
{
"t": 21,
"x": 666,
"y": 72
}
],
"birth": 0,
"death": 24,
"type": "yellow wooden toy roller"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 697,
"y": 197
},
{
"t": 17,
"x": 689,
"y": 193
},
{
"t": 22,
"x": 705,
"y": 177
}
],
"birth": 0,
"death": 24,
"type": "multi-colored wooden roller"
},
{
"id": 13,
"image_positions": [
{
"t": 0,
"x": 791,
"y": 755
}
],
"birth": 0,
"death": 24,
"type": "black can opener"
},
{
"id": 14,
"image_positions": [
{
"t": 0,
"x": 822,
"y": 68
}
],
"birth": 0,
"death": 24,
"type": "white and orange cardboard cosmetic box"
},
{
"id": 15,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 720
}
],
"birth": 0,
"death": 24,
"type": "dark grey metallic cake pan set"
},
{
"id": 16,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 4,
"x": 1,
"y": 373
},
{
"t": 9,
"x": null,
"y": null
},
{
"t": 18,
"x": 1,
"y": 373
},
{
"t": 22,
"x": null,
"y": null
}
],
"birth": 4,
"death": 24,
"type": "black cardboard motherboard box"
}
],
"interactions": [
{
"id": 28,
"inputs": [
5,
8
],
"outputs": [
5,
8
],
"begins_at": 0,
"ends_at": 2,
"type": "contact"
},
{
"id": 22,
"inputs": [
3,
5
],
"outputs": [
3,
5
],
"begins_at": 0,
"ends_at": 6,
"type": "contact"
},
{
"id": 23,
"inputs": [
3,
6
],
"outputs": [
3,
6
],
"begins_at": 0,
"ends_at": 6,
"type": "contact"
},
{
"id": 3,
"inputs": [
1,
5
],
"outputs": [
1,
5
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 16,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 11,
"type": "contact"
},
{
"id": 26,
"inputs": [
5,
6
],
"outputs": [
5,
6
],
"begins_at": 0,
"ends_at": 15,
"type": "contact"
},
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
16
],
"outputs": [
1,
16
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 25,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 30,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 31,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 32,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 33,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 5,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 6,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 7,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 8,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 9,
"inputs": [
14,
65535
],
"outputs": [
14,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 10,
"inputs": [
15,
65535
],
"outputs": [
15,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 11,
"inputs": [
16,
65535
],
"outputs": [
16,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 14,
"inputs": [
2,
5
],
"outputs": [
2,
5
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 15,
"inputs": [
2,
5
],
"outputs": [
2,
5
],
"begins_at": 6,
"ends_at": 10,
"type": "contact"
},
{
"id": 12,
"inputs": [
2,
12
],
"outputs": [
2,
12
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 24,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 13,
"inputs": [
2,
12
],
"outputs": [
2,
12
],
"begins_at": 11,
"ends_at": 12,
"type": "contact"
},
{
"id": 17,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 29,
"inputs": [
5,
8
],
"outputs": [
5,
8
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 18,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 27,
"inputs": [
5,
6
],
"outputs": [
5,
6
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 19,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 17,
"ends_at": 23,
"type": "contact"
},
{
"id": 20,
"inputs": [
3,
5
],
"outputs": [
3,
5
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 21,
"inputs": [
3,
5
],
"outputs": [
3,
5
],
"begins_at": 19,
"ends_at": 23,
"type": "contact"
},
{
"id": 4,
"inputs": [
1,
5
],
"outputs": [
1,
5
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 0.9974424552429667,
"avg_image_position_segmentation_acc_small": 0.9956521739130434,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 0.9974424552429667,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": 1.0,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 1.0,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 1.0,
"num_matches": 17,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.7499999999999999,
"avg_interaction_input_object_jaccard": 0.4607843137254903,
"avg_interaction_output_object_jaccard": 0.4607843137254903,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 34,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 14,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 29,
"false_positives": 5,
"false_negatives": 14
},
"0.5": {
"true_positives": 28,
"false_positives": 6,
"false_negatives": 14
},
"0.75": {
"true_positives": 23,
"false_positives": 11,
"false_negatives": 14
},
"1.0": {
"true_positives": 22,
"false_positives": 12,
"false_negatives": 14
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.8529411764705882,
"0.5": 0.8235294117647058,
"0.75": 0.6764705882352942,
"1.0": 0.6470588235294118
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.6744186046511628,
"0.5": 0.6666666666666666,
"0.75": 0.6216216216216216,
"1.0": 0.6111111111111112
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.7532467532467532,
"0.5": 0.7368421052631577,
"0.75": 0.6478873239436619,
"1.0": 0.6285714285714287
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 25,
"false_positives": 9,
"false_negatives": 14
},
"0.5": {
"true_positives": 11,
"false_positives": 23,
"false_negatives": 14
},
"0.75": {
"true_positives": 11,
"false_positives": 23,
"false_negatives": 14
},
"1.0": {
"true_positives": 11,
"false_positives": 23,
"false_negatives": 14
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.7352941176470589,
"0.5": 0.3235294117647059,
"0.75": 0.3235294117647059,
"1.0": 0.3235294117647059
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.6410256410256411,
"0.5": 0.44,
"0.75": 0.44,
"1.0": 0.44
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.6849315068493151,
"0.5": 0.3728813559322034,
"0.75": 0.3728813559322034,
"1.0": 0.3728813559322034
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 25,
"false_positives": 9,
"false_negatives": 14
},
"0.5": {
"true_positives": 11,
"false_positives": 23,
"false_negatives": 14
},
"0.75": {
"true_positives": 11,
"false_positives": 23,
"false_negatives": 14
},
"1.0": {
"true_positives": 11,
"false_positives": 23,
"false_negatives": 14
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.7352941176470589,
"0.5": 0.3235294117647059,
"0.75": 0.3235294117647059,
"1.0": 0.3235294117647059
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.6410256410256411,
"0.5": 0.44,
"0.75": 0.44,
"1.0": 0.44
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.6849315068493151,
"0.5": 0.3728813559322034,
"0.75": 0.3728813559322034,
"1.0": 0.3728813559322034
}
}
}Prompt
user Analyze the provided video and return ONLY a valid sentinel sequence in this format: [SCENE-START] [OBJS-START] [OBJ] id "type" birth death [PX] t px py ... [OBJ] ... [OBJS-END] [INTERACTIONS-START] [INTERACT] id "type" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ... [INTERACT] ... [INTERACTIONS-END] [SCENE-END] Constraints: - Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose). - Keep tags exactly as written: `[SCENE-START] [OBJS-START] [OBJ] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]` - Use quoted strings for `type` (double quotes). - `PX` uses repeated groups of 3 values in order: `t px py`. - `t` is the timestamp (frame number). - `px` and `py` are the pixel coordinates of the object in that frame, normalized to [0,1] relative to the frame dimensions, scaled by 1000 and rounded to the nearest integer. For example, `px` of 0.1234 would be represented as 123. - When an object is occluded or not visible in a frame, `PX` may use `t null null`. - `IN` and `OUT` contain whitespace-separated integer ids. assistant