STRIVE · 08/28/2026
Prefill sample 5
One shared clip across Baselines 1, 2, 3, and E2E, including exactly what was injected.
Ground-truth Sentinel
[SCENE-START] [OBJS-START] [OBJ] 0 "multicolored wooden stacking toy" 0 24 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 14 251 271 15 232 263 16 228 244 17 208 236 18 201 244 19 197 216 21 162 193 22 154 181 [OBJ] 1 "black and yellow cardboard motherboard box" 0 24 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 14 357 583 16 361 591 17 357 599 19 361 611 22 365 619 [OBJ] 2 "white plastic lutein supplement bottle" 0 24 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 "Colorful wooden geometric sorting board" 0 24 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 15 353 255 16 361 244 18 369 232 20 369 220 21 333 220 22 330 212 [OBJ] 4 "white cardboard box of diaper pail refill bags" 0 24 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 14 201 326 15 189 314 16 173 306 17 154 306 18 138 298 19 126 291 20 111 287 21 95 283 22 80 279 23 68 275 [OBJ] 5 "magenta suede pump" 0 24 [PX] 0 505 494 7 490 505 8 null null 9 513 490 17 521 486 [OBJ] 6 "peach and blue cardboard 12-pack of soda cans" 0 24 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 14 505 775 15 521 818 16 521 845 17 505 853 18 513 884 19 490 880 20 482 888 21 458 876 22 412 833 23 455 896 [OBJ] 7 "grey and orange athletic shoe" 0 24 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 15 701 271 18 693 263 21 685 255 [OBJ] 8 "white cardboard moisturizer box" 0 24 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 15 744 498 16 740 513 17 748 498 18 744 505 19 740 525 20 740 548 22 748 564 [OBJ] 9 "blue high-top sneaker" 0 24 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 16 916 341 20 904 333 22 900 326 23 892 322 [OBJ] 10 "multicolored cardboard Scrabble game" 0 24 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 14 939 451 16 931 447 23 931 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 20 "contact" 0 3 [IN] 8 10 [OUT] 8 10 [INTERACT] 4 "contact" 0 10 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 0 "contact" 0 14 [IN] 0 3 [OUT] 0 3 [INTERACT] 24 "contact" 0 22 [IN] 9 10 [OUT] 9 10 [INTERACT] 2 "contact" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 3 "contact" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 8 "contact" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 9 "contact" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 13 "contact" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 19 "contact" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 23 "contact" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 25 "contact" 0 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 17 "collision" 3 3 [IN] 6 8 [OUT] 6 8 [INTERACT] 18 "contact" 4 6 [IN] 6 8 [OUT] 6 8 [INTERACT] 21 "collision" 5 5 [IN] 8 10 [OUT] 8 10 [INTERACT] 22 "contact" 6 8 [IN] 8 10 [OUT] 8 10 [INTERACT] 12 "collision" 7 8 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 1 "collision" 10 11 [IN] 0 4 [OUT] 0 4 [INTERACT] 14 "collision" 10 11 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 10 "collision" 12 12 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 "collision" 12 12 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 15 "collision" 13 13 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 11 "contact" 13 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 "contact" 13 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 16 "contact" 14 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 "collision" 20 20 [IN] 2 6 [OUT] 2 6 [INTERACTIONS-END] [SCENE-END]
Parsed ground truth
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 298,
"y": 318
},
{
"t": 1,
"x": 330,
"y": 314
},
{
"t": 2,
"x": 294,
"y": 318
},
{
"t": 4,
"x": 322,
"y": 310
},
{
"t": 5,
"x": 287,
"y": 310
},
{
"t": 6,
"x": 244,
"y": 341
},
{
"t": 7,
"x": 283,
"y": 310
},
{
"t": 9,
"x": 310,
"y": 306
},
{
"t": 10,
"x": 302,
"y": 302
},
{
"t": 12,
"x": 263,
"y": 283
},
{
"t": 13,
"x": 255,
"y": 279
},
{
"t": 14,
"x": 251,
"y": 271
},
{
"t": 15,
"x": 232,
"y": 263
},
{
"t": 16,
"x": 228,
"y": 244
},
{
"t": 17,
"x": 208,
"y": 236
},
{
"t": 18,
"x": 201,
"y": 244
},
{
"t": 19,
"x": 197,
"y": 216
},
{
"t": 21,
"x": 162,
"y": 193
},
{
"t": 22,
"x": 154,
"y": 181
}
],
"birth": 0,
"death": 24,
"type": "multicolored wooden stacking toy"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 333,
"y": 587
},
{
"t": 2,
"x": 349,
"y": 583
},
{
"t": 7,
"x": 353,
"y": 591
},
{
"t": 10,
"x": 330,
"y": 607
},
{
"t": 12,
"x": 322,
"y": 603
},
{
"t": 13,
"x": 314,
"y": 611
},
{
"t": 14,
"x": 357,
"y": 583
},
{
"t": 16,
"x": 361,
"y": 591
},
{
"t": 17,
"x": 357,
"y": 599
},
{
"t": 19,
"x": 361,
"y": 611
},
{
"t": 22,
"x": 365,
"y": 619
}
],
"birth": 0,
"death": 24,
"type": "black and yellow cardboard motherboard box"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 380,
"y": 970
},
{
"t": 1,
"x": 392,
"y": 974
},
{
"t": 3,
"x": 404,
"y": 978
},
{
"t": 4,
"x": 416,
"y": 982
},
{
"t": 6,
"x": 423,
"y": 986
},
{
"t": 7,
"x": 431,
"y": 990
},
{
"t": 8,
"x": 443,
"y": 990
},
{
"t": 9,
"x": 451,
"y": 994
},
{
"t": 11,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "white plastic lutein supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 388,
"y": 306
},
{
"t": 4,
"x": 380,
"y": 302
},
{
"t": 7,
"x": 373,
"y": 298
},
{
"t": 9,
"x": 365,
"y": 294
},
{
"t": 11,
"x": 373,
"y": 283
},
{
"t": 12,
"x": 337,
"y": 271
},
{
"t": 13,
"x": 341,
"y": 263
},
{
"t": 15,
"x": 353,
"y": 255
},
{
"t": 16,
"x": 361,
"y": 244
},
{
"t": 18,
"x": 369,
"y": 232
},
{
"t": 20,
"x": 369,
"y": 220
},
{
"t": 21,
"x": 333,
"y": 220
},
{
"t": 22,
"x": 330,
"y": 212
}
],
"birth": 0,
"death": 24,
"type": "Colorful wooden geometric sorting board"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 423,
"y": 509
},
{
"t": 1,
"x": 419,
"y": 427
},
{
"t": 2,
"x": 400,
"y": 408
},
{
"t": 3,
"x": 384,
"y": 400
},
{
"t": 4,
"x": 369,
"y": 396
},
{
"t": 5,
"x": 357,
"y": 400
},
{
"t": 6,
"x": 341,
"y": 416
},
{
"t": 7,
"x": 318,
"y": 443
},
{
"t": 8,
"x": 318,
"y": 392
},
{
"t": 9,
"x": 291,
"y": 369
},
{
"t": 10,
"x": 275,
"y": 345
},
{
"t": 11,
"x": 259,
"y": 322
},
{
"t": 12,
"x": 236,
"y": 333
},
{
"t": 13,
"x": 216,
"y": 330
},
{
"t": 14,
"x": 201,
"y": 326
},
{
"t": 15,
"x": 189,
"y": 314
},
{
"t": 16,
"x": 173,
"y": 306
},
{
"t": 17,
"x": 154,
"y": 306
},
{
"t": 18,
"x": 138,
"y": 298
},
{
"t": 19,
"x": 126,
"y": 291
},
{
"t": 20,
"x": 111,
"y": 287
},
{
"t": 21,
"x": 95,
"y": 283
},
{
"t": 22,
"x": 80,
"y": 279
},
{
"t": 23,
"x": 68,
"y": 275
}
],
"birth": 0,
"death": 24,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 505,
"y": 494
},
{
"t": 7,
"x": 490,
"y": 505
},
{
"t": 8,
"x": null,
"y": null
},
{
"t": 9,
"x": 513,
"y": 490
},
{
"t": 17,
"x": 521,
"y": 486
}
],
"birth": 0,
"death": 24,
"type": "magenta suede pump"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 642,
"y": 146
},
{
"t": 1,
"x": 623,
"y": 158
},
{
"t": 2,
"x": 623,
"y": 212
},
{
"t": 3,
"x": 673,
"y": 353
},
{
"t": 4,
"x": 576,
"y": 271
},
{
"t": 5,
"x": 572,
"y": 337
},
{
"t": 6,
"x": 611,
"y": 451
},
{
"t": 7,
"x": 646,
"y": 548
},
{
"t": 8,
"x": 583,
"y": 568
},
{
"t": 9,
"x": 607,
"y": 666
},
{
"t": 10,
"x": 537,
"y": 673
},
{
"t": 11,
"x": 548,
"y": 708
},
{
"t": 12,
"x": 537,
"y": 728
},
{
"t": 13,
"x": 521,
"y": 751
},
{
"t": 14,
"x": 505,
"y": 775
},
{
"t": 15,
"x": 521,
"y": 818
},
{
"t": 16,
"x": 521,
"y": 845
},
{
"t": 17,
"x": 505,
"y": 853
},
{
"t": 18,
"x": 513,
"y": 884
},
{
"t": 19,
"x": 490,
"y": 880
},
{
"t": 20,
"x": 482,
"y": 888
},
{
"t": 21,
"x": 458,
"y": 876
},
{
"t": 22,
"x": 412,
"y": 833
},
{
"t": 23,
"x": 455,
"y": 896
}
],
"birth": 0,
"death": 24,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 298
},
{
"t": 1,
"x": null,
"y": null
},
{
"t": 2,
"x": 783,
"y": 306
},
{
"t": 3,
"x": 771,
"y": 318
},
{
"t": 4,
"x": 724,
"y": 298
},
{
"t": 7,
"x": 716,
"y": 291
},
{
"t": 9,
"x": 708,
"y": 283
},
{
"t": 10,
"x": 716,
"y": 287
},
{
"t": 12,
"x": 708,
"y": 279
},
{
"t": 15,
"x": 701,
"y": 271
},
{
"t": 18,
"x": 693,
"y": 263
},
{
"t": 21,
"x": 685,
"y": 255
}
],
"birth": 0,
"death": 24,
"type": "grey and orange athletic shoe"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 837,
"y": 525
},
{
"t": 2,
"x": 818,
"y": 529
},
{
"t": 3,
"x": 845,
"y": 521
},
{
"t": 4,
"x": 873,
"y": 501
},
{
"t": 6,
"x": 845,
"y": 458
},
{
"t": 7,
"x": 814,
"y": 474
},
{
"t": 8,
"x": 794,
"y": 490
},
{
"t": 9,
"x": 783,
"y": 490
},
{
"t": 10,
"x": 775,
"y": 494
},
{
"t": 11,
"x": 767,
"y": 501
},
{
"t": 12,
"x": 755,
"y": 517
},
{
"t": 13,
"x": 751,
"y": 501
},
{
"t": 15,
"x": 744,
"y": 498
},
{
"t": 16,
"x": 740,
"y": 513
},
{
"t": 17,
"x": 748,
"y": 498
},
{
"t": 18,
"x": 744,
"y": 505
},
{
"t": 19,
"x": 740,
"y": 525
},
{
"t": 20,
"x": 740,
"y": 548
},
{
"t": 22,
"x": 748,
"y": 564
}
],
"birth": 0,
"death": 24,
"type": "white cardboard moisturizer box"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 384
},
{
"t": 2,
"x": 908,
"y": 388
},
{
"t": 4,
"x": null,
"y": null
},
{
"t": 8,
"x": 931,
"y": 345
},
{
"t": 10,
"x": 927,
"y": 357
},
{
"t": 11,
"x": 935,
"y": 349
},
{
"t": 13,
"x": 923,
"y": 349
},
{
"t": 16,
"x": 916,
"y": 341
},
{
"t": 20,
"x": 904,
"y": 333
},
{
"t": 22,
"x": 900,
"y": 326
},
{
"t": 23,
"x": 892,
"y": 322
}
],
"birth": 0,
"death": 24,
"type": "blue high-top sneaker"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 947,
"y": 333
},
{
"t": 2,
"x": 947,
"y": 353
},
{
"t": 3,
"x": 943,
"y": 361
},
{
"t": 7,
"x": 943,
"y": 373
},
{
"t": 8,
"x": 958,
"y": 392
},
{
"t": 9,
"x": 962,
"y": 400
},
{
"t": 10,
"x": 958,
"y": 482
},
{
"t": 11,
"x": 951,
"y": 486
},
{
"t": 13,
"x": 939,
"y": 474
},
{
"t": 14,
"x": 939,
"y": 451
},
{
"t": 16,
"x": 931,
"y": 447
},
{
"t": 23,
"x": 931,
"y": 462
}
],
"birth": 0,
"death": 24,
"type": "multicolored cardboard Scrabble game"
}
],
"interactions": [
{
"id": 20,
"inputs": [
8,
10
],
"outputs": [
8,
10
],
"begins_at": 0,
"ends_at": 3,
"type": "contact"
},
{
"id": 4,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 14,
"type": "contact"
},
{
"id": 24,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 0,
"ends_at": 22,
"type": "contact"
},
{
"id": 2,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 3,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 8,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 9,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 13,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 19,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 23,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 25,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 17,
"inputs": [
6,
8
],
"outputs": [
6,
8
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 18,
"inputs": [
6,
8
],
"outputs": [
6,
8
],
"begins_at": 4,
"ends_at": 6,
"type": "contact"
},
{
"id": 21,
"inputs": [
8,
10
],
"outputs": [
8,
10
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 22,
"inputs": [
8,
10
],
"outputs": [
8,
10
],
"begins_at": 6,
"ends_at": 8,
"type": "contact"
},
{
"id": 12,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 7,
"ends_at": 8,
"type": "collision"
},
{
"id": 1,
"inputs": [
0,
4
],
"outputs": [
0,
4
],
"begins_at": 10,
"ends_at": 11,
"type": "collision"
},
{
"id": 14,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 10,
"ends_at": 11,
"type": "collision"
},
{
"id": 10,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 5,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 15,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 11,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 13,
"ends_at": 23,
"type": "contact"
},
{
"id": 6,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 13,
"ends_at": 23,
"type": "contact"
},
{
"id": 16,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 14,
"ends_at": 23,
"type": "contact"
},
{
"id": 7,
"inputs": [
2,
6
],
"outputs": [
2,
6
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
}
]
}Per-frame GT object prefill
Each one-frame detector request was assistant-prefilled with the exact visible GT objects using canonical IDs. B1 generated only the interaction suffix; the saved frame outputs below are the exact persisted requests and generations.
Every persisted/reconstructed prefill step
[
{
"frame_index": 0,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 298 318 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 333 587 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 380 970 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 388 306 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 423 509 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 505 494 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 642 146 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 646 298 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 837 525 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 919 384 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 947 333 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 4 [OUT] 1 4 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 298 318 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 333 587 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 380 970 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 388 306 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 423 509 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 505 494 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 642 146 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 646 298 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 837 525 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 919 384 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 947 333 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 4 [OUT] 1 4 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"8": 8,
"9": 9,
"10": 10
},
"parsed_object_count": 11,
"parsed_interaction_count": 12
},
{
"frame_index": 1,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 330 314 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 392 974 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 419 427 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 623 158 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 330 314 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 392 974 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 419 427 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 623 158 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"2": 2,
"4": 4,
"6": 6,
"7": 7
},
"parsed_object_count": 5,
"parsed_interaction_count": 5
},
{
"frame_index": 2,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 294 318 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 349 583 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 400 408 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 623 212 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 783 306 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 818 529 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 908 388 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 947 353 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 294 318 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 349 583 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 400 408 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 623 212 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 783 306 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 818 529 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 908 388 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 947 353 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"4": 4,
"6": 6,
"7": 7,
"8": 8,
"9": 9,
"10": 10
},
"parsed_object_count": 8,
"parsed_interaction_count": 9
},
{
"frame_index": 3,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 404 978 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 384 400 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 673 353 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 771 318 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 845 521 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 943 361 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 8 [OUT] 6 8 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 404 978 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 384 400 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 673 353 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 771 318 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 845 521 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 943 361 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 8 [OUT] 6 8 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"4": 4,
"6": 6,
"7": 7,
"8": 8,
"10": 10
},
"parsed_object_count": 6,
"parsed_interaction_count": 9
},
{
"frame_index": 4,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 322 310 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 416 982 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 380 302 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 369 396 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 576 271 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 724 298 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 873 501 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 8 [OUT] 6 8 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 322 310 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 416 982 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 380 302 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 369 396 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 576 271 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 724 298 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 873 501 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 8 [OUT] 6 8 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"6": 6,
"7": 7,
"8": 8,
"9": 9
},
"parsed_object_count": 8,
"parsed_interaction_count": 10
},
{
"frame_index": 5,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 287 310 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 357 400 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 572 337 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 287 310 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 357 400 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 572 337 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"4": 4,
"6": 6
},
"parsed_object_count": 3,
"parsed_interaction_count": 10
},
{
"frame_index": 6,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 244 341 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 423 986 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 341 416 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 611 451 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 845 458 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 244 341 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 423 986 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 341 416 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 611 451 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 845 458 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"2": 2,
"4": 4,
"6": 6,
"8": 8
},
"parsed_object_count": 5,
"parsed_interaction_count": 9
},
{
"frame_index": 7,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 283 310 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 353 591 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 431 990 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 373 298 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 318 443 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 490 505 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 646 548 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 716 291 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 814 474 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 943 373 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 6 [OUT] 5 6 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 283 310 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 353 591 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 431 990 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 373 298 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 318 443 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 490 505 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 646 548 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 716 291 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 814 474 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 943 373 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 6 [OUT] 5 6 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"8": 8,
"10": 10
},
"parsed_object_count": 10,
"parsed_interaction_count": 11
},
{
"frame_index": 8,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 443 990 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 318 392 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 null null [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 583 568 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 794 490 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 931 345 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 958 392 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 443 990 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 318 392 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 null null [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 583 568 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 794 490 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 931 345 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 958 392 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"4": 4,
"5": 5,
"6": 6,
"8": 8,
"9": 9,
"10": 10
},
"parsed_object_count": 7,
"parsed_interaction_count": 10
},
{
"frame_index": 9,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 310 306 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 451 994 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 365 294 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 291 369 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 513 490 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 607 666 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 708 283 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 783 490 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 962 400 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 310 306 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 451 994 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 365 294 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 291 369 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 513 490 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 607 666 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 708 283 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 783 490 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 962 400 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"8": 8,
"10": 10
},
"parsed_object_count": 9,
"parsed_interaction_count": 11
},
{
"frame_index": 10,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 302 302 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 330 607 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 275 345 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 537 673 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 716 287 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 775 494 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 927 357 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 958 482 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 10 [OUT] 8 10 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 302 302 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 330 607 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 275 345 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 537 673 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 716 287 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 775 494 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 927 357 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 958 482 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 10 [OUT] 8 10 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"4": 4,
"6": 6,
"7": 7,
"8": 8,
"9": 9,
"10": 10
},
"parsed_object_count": 8,
"parsed_interaction_count": 10
},
{
"frame_index": 11,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 373 283 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 259 322 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 548 708 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 767 501 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 935 349 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 951 486 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 10 [OUT] 8 10 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 373 283 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 259 322 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 548 708 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 767 501 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 935 349 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 951 486 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 10 [OUT] 8 10 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"3": 3,
"4": 4,
"6": 6,
"8": 8,
"9": 9,
"10": 10
},
"parsed_object_count": 7,
"parsed_interaction_count": 9
},
{
"frame_index": 12,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 263 283 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 322 603 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 337 271 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 236 333 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 537 728 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 708 279 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 755 517 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 6 [OUT] 1 6 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 263 283 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 322 603 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 337 271 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 236 333 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 537 728 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 708 279 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 755 517 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 6 [OUT] 1 6 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"3": 3,
"4": 4,
"6": 6,
"7": 7,
"8": 8
},
"parsed_object_count": 7,
"parsed_interaction_count": 9
},
{
"frame_index": 13,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 255 279 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 314 611 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 341 263 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 216 330 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 521 751 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 751 501 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 923 349 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 939 474 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 6 [OUT] 1 6 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 255 279 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 314 611 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 341 263 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 216 330 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 521 751 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 751 501 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 923 349 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 939 474 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 6 [OUT] 1 6 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"3": 3,
"4": 4,
"6": 6,
"8": 8,
"9": 9,
"10": 10
},
"parsed_object_count": 8,
"parsed_interaction_count": 9
},
{
"frame_index": 14,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 251 271 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 357 583 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 201 326 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 505 775 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 939 451 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 6 [OUT] 1 6 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 251 271 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 357 583 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 201 326 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 505 775 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 939 451 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 6 [OUT] 1 6 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"4": 4,
"6": 6,
"10": 10
},
"parsed_object_count": 5,
"parsed_interaction_count": 11
},
{
"frame_index": 15,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 232 263 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 353 255 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 189 314 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 521 818 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 701 271 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 744 498 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 232 263 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 353 255 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 189 314 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 521 818 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 701 271 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 744 498 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"3": 3,
"4": 4,
"6": 6,
"7": 7,
"8": 8
},
"parsed_object_count": 6,
"parsed_interaction_count": 8
},
{
"frame_index": 16,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 228 244 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 361 591 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 361 244 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 173 306 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 521 845 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 740 513 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 916 341 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 931 447 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 228 244 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 361 591 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 361 244 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 173 306 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 521 845 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 740 513 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 916 341 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 931 447 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"3": 3,
"4": 4,
"6": 6,
"8": 8,
"9": 9,
"10": 10
},
"parsed_object_count": 8,
"parsed_interaction_count": 9
},
{
"frame_index": 17,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 208 236 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 357 599 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 154 306 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 521 486 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 505 853 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 748 498 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 208 236 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 357 599 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 154 306 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 521 486 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 505 853 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 748 498 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"4": 4,
"5": 5,
"6": 6,
"8": 8
},
"parsed_object_count": 6,
"parsed_interaction_count": 9
},
{
"frame_index": 18,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 201 244 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 369 232 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 138 298 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 513 884 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 693 263 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 744 505 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 3 [OUT] 2 3 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 201 244 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 369 232 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 138 298 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 513 884 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 693 263 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 744 505 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 3 [OUT] 2 3 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"3": 3,
"4": 4,
"6": 6,
"7": 7,
"8": 8
},
"parsed_object_count": 6,
"parsed_interaction_count": 9
},
{
"frame_index": 19,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 197 216 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 361 611 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 126 291 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 490 880 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 740 525 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 197 216 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 361 611 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 126 291 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 490 880 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 740 525 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"4": 4,
"6": 6,
"8": 8
},
"parsed_object_count": 5,
"parsed_interaction_count": 9
},
{
"frame_index": 20,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 369 220 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 111 287 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 482 888 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 740 548 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 904 333 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 369 220 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 111 287 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 482 888 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 740 548 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 904 333 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"3": 3,
"4": 4,
"6": 6,
"8": 8,
"9": 9
},
"parsed_object_count": 5,
"parsed_interaction_count": 7
},
{
"frame_index": 21,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 162 193 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 333 220 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 95 283 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 458 876 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 685 255 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 162 193 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 333 220 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 95 283 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 458 876 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 685 255 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"3": 3,
"4": 4,
"6": 6,
"7": 7
},
"parsed_object_count": 5,
"parsed_interaction_count": 7
},
{
"frame_index": 22,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 154 181 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 365 619 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 330 212 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 80 279 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 412 833 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 748 564 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 900 326 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 154 181 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 365 619 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 330 212 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 80 279 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 412 833 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 748 564 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 900 326 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"3": 3,
"4": 4,
"6": 6,
"8": 8,
"9": 9
},
"parsed_object_count": 7,
"parsed_interaction_count": 7
},
{
"frame_index": 23,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 68 275 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 455 896 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 892 322 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 931 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 68 275 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 455 896 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 892 322 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 931 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"4": 4,
"6": 6,
"9": 9,
"10": 10
},
"parsed_object_count": 4,
"parsed_interaction_count": 10
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "multicolored wooden stacking toy" 0 24 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 14 251 271 15 232 263 16 228 244 17 208 236 18 201 244 19 197 216 21 162 193 22 154 181 [OBJ] 1 "black and yellow cardboard motherboard box" 0 24 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 14 357 583 16 361 591 17 357 599 19 361 611 22 365 619 [OBJ] 2 "white plastic lutein supplement bottle" 0 24 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 "Colorful wooden geometric sorting board" 0 24 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 15 353 255 16 361 244 18 369 232 20 369 220 21 333 220 22 330 212 [OBJ] 4 "white cardboard box of diaper pail refill bags" 0 24 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 14 201 326 15 189 314 16 173 306 17 154 306 18 138 298 19 126 291 20 111 287 21 95 283 22 80 279 23 68 275 [OBJ] 5 "magenta suede pump" 0 24 [PX] 0 505 494 7 490 505 8 null null 9 513 490 17 521 486 [OBJ] 6 "peach and blue cardboard 12-pack of soda cans" 0 24 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 14 505 775 15 521 818 16 521 845 17 505 853 18 513 884 19 490 880 20 482 888 21 458 876 22 412 833 23 455 896 [OBJ] 7 "grey and orange athletic shoe" 0 24 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 15 701 271 18 693 263 21 685 255 [OBJ] 8 "white cardboard moisturizer box" 0 24 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 15 744 498 16 740 513 17 748 498 18 744 505 19 740 525 20 740 548 22 748 564 [OBJ] 9 "blue high-top sneaker" 0 24 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 16 916 341 20 904 333 22 900 326 23 892 322 [OBJ] 10 "multicolored cardboard Scrabble game" 0 24 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 14 939 451 16 931 447 23 931 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 "contact" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 "contact" 0 0 [IN] 1 4 [OUT] 1 4 [INTERACT] 2 "contact" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 "contact" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 "contact" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 "contact" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 "contact" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 7 "contact" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 8 "contact" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 9 "contact" 0 1 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 10 "contact" 0 2 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 11 "contact" 0 4 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 12 "collision" 1 1 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 13 "collision" 1 1 [IN] 65535 [OUT] 65535 [INTERACT] 14 "collision" 2 2 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 15 "collision" 2 2 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 16 "collision" 2 2 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 17 "collision" 2 2 [IN] 9 10 [OUT] 9 10 [INTERACT] 18 "collision" 2 2 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 19 "contact" 2 11 [IN] 65535 [OUT] 65535 [INTERACT] 20 "contact" 2 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 21 "collision" 3 4 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 22 "collision" 3 4 [IN] 6 8 [OUT] 6 8 [INTERACT] 23 "contact" 3 4 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 24 "collision" 4 4 [IN] 0 3 [OUT] 0 3 [INTERACT] 25 "collision" 4 4 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 26 "collision" 4 4 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 27 "collision" 4 4 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 28 "collision" 5 5 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 29 "contact" 5 7 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 30 "collision" 6 6 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 31 "collision" 6 6 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 32 "contact" 6 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 33 "collision" 7 7 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 34 "collision" 7 7 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 35 "collision" 7 7 [IN] 5 6 [OUT] 5 6 [INTERACT] 36 "collision" 7 7 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 37 "collision" 7 7 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 38 "contact" 7 9 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 39 "contact" 7 13 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 40 "collision" 8 8 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 41 "contact" 8 9 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 42 "collision" 9 9 [IN] 0 3 [OUT] 0 3 [INTERACT] 43 "collision" 9 9 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 44 "collision" 9 10 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 45 "collision" 9 10 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 46 "collision" 10 10 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 47 "collision" 10 11 [IN] 8 10 [OUT] 8 10 [INTERACT] 48 "collision" 10 11 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 49 "collision" 11 11 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 50 "collision" 11 11 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 51 "collision" 12 12 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 52 "collision" 12 12 [IN] 1 6 [OUT] 1 6 [INTERACT] 53 "collision" 12 12 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 54 "collision" 12 12 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 55 "collision" 12 13 [IN] 0 3 [OUT] 0 3 [INTERACT] 56 "contact" 12 13 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 57 "collision" 13 13 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 58 "contact" 13 14 [IN] 1 6 [OUT] 1 6 [INTERACT] 59 "contact" 13 14 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 60 "contact" 13 19 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 61 "collision" 14 14 [IN] 65535 [OUT] 65535 [INTERACT] 62 "collision" 15 15 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 63 "collision" 15 15 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 64 "collision" 15 16 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 65 "contact" 15 21 [IN] 65535 [OUT] 65535 [INTERACT] 66 "collision" 16 16 [IN] 0 3 [OUT] 0 3 [INTERACT] 67 "collision" 16 16 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 68 "collision" 16 17 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 69 "contact" 16 20 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 70 "collision" 17 17 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 71 "collision" 18 18 [IN] 3 [OUT] 3 [INTERACT] 72 "collision" 18 18 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 73 "collision" 18 18 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 74 "collision" 19 19 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 75 "collision" 20 20 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 76 "collision" 20 20 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 77 "collision" 21 21 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 78 "collision" 21 22 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 79 "contact" 21 22 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 80 "collision" 22 22 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 81 "collision" 22 22 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 82 "collision" 22 22 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 83 "collision" 23 23 [IN] 65535 [OUT] 65535 [INTERACT] 84 "contact" 23 23 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 298,
"y": 318
},
{
"t": 1,
"x": 330,
"y": 314
},
{
"t": 2,
"x": 294,
"y": 318
},
{
"t": 4,
"x": 322,
"y": 310
},
{
"t": 5,
"x": 287,
"y": 310
},
{
"t": 6,
"x": 244,
"y": 341
},
{
"t": 7,
"x": 283,
"y": 310
},
{
"t": 9,
"x": 310,
"y": 306
},
{
"t": 10,
"x": 302,
"y": 302
},
{
"t": 12,
"x": 263,
"y": 283
},
{
"t": 13,
"x": 255,
"y": 279
},
{
"t": 14,
"x": 251,
"y": 271
},
{
"t": 15,
"x": 232,
"y": 263
},
{
"t": 16,
"x": 228,
"y": 244
},
{
"t": 17,
"x": 208,
"y": 236
},
{
"t": 18,
"x": 201,
"y": 244
},
{
"t": 19,
"x": 197,
"y": 216
},
{
"t": 21,
"x": 162,
"y": 193
},
{
"t": 22,
"x": 154,
"y": 181
}
],
"birth": 0,
"death": 24,
"type": "multicolored wooden stacking toy"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 333,
"y": 587
},
{
"t": 2,
"x": 349,
"y": 583
},
{
"t": 7,
"x": 353,
"y": 591
},
{
"t": 10,
"x": 330,
"y": 607
},
{
"t": 12,
"x": 322,
"y": 603
},
{
"t": 13,
"x": 314,
"y": 611
},
{
"t": 14,
"x": 357,
"y": 583
},
{
"t": 16,
"x": 361,
"y": 591
},
{
"t": 17,
"x": 357,
"y": 599
},
{
"t": 19,
"x": 361,
"y": 611
},
{
"t": 22,
"x": 365,
"y": 619
}
],
"birth": 0,
"death": 24,
"type": "black and yellow cardboard motherboard box"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 380,
"y": 970
},
{
"t": 1,
"x": 392,
"y": 974
},
{
"t": 3,
"x": 404,
"y": 978
},
{
"t": 4,
"x": 416,
"y": 982
},
{
"t": 6,
"x": 423,
"y": 986
},
{
"t": 7,
"x": 431,
"y": 990
},
{
"t": 8,
"x": 443,
"y": 990
},
{
"t": 9,
"x": 451,
"y": 994
},
{
"t": 11,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "white plastic lutein supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 388,
"y": 306
},
{
"t": 4,
"x": 380,
"y": 302
},
{
"t": 7,
"x": 373,
"y": 298
},
{
"t": 9,
"x": 365,
"y": 294
},
{
"t": 11,
"x": 373,
"y": 283
},
{
"t": 12,
"x": 337,
"y": 271
},
{
"t": 13,
"x": 341,
"y": 263
},
{
"t": 15,
"x": 353,
"y": 255
},
{
"t": 16,
"x": 361,
"y": 244
},
{
"t": 18,
"x": 369,
"y": 232
},
{
"t": 20,
"x": 369,
"y": 220
},
{
"t": 21,
"x": 333,
"y": 220
},
{
"t": 22,
"x": 330,
"y": 212
}
],
"birth": 0,
"death": 24,
"type": "Colorful wooden geometric sorting board"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 423,
"y": 509
},
{
"t": 1,
"x": 419,
"y": 427
},
{
"t": 2,
"x": 400,
"y": 408
},
{
"t": 3,
"x": 384,
"y": 400
},
{
"t": 4,
"x": 369,
"y": 396
},
{
"t": 5,
"x": 357,
"y": 400
},
{
"t": 6,
"x": 341,
"y": 416
},
{
"t": 7,
"x": 318,
"y": 443
},
{
"t": 8,
"x": 318,
"y": 392
},
{
"t": 9,
"x": 291,
"y": 369
},
{
"t": 10,
"x": 275,
"y": 345
},
{
"t": 11,
"x": 259,
"y": 322
},
{
"t": 12,
"x": 236,
"y": 333
},
{
"t": 13,
"x": 216,
"y": 330
},
{
"t": 14,
"x": 201,
"y": 326
},
{
"t": 15,
"x": 189,
"y": 314
},
{
"t": 16,
"x": 173,
"y": 306
},
{
"t": 17,
"x": 154,
"y": 306
},
{
"t": 18,
"x": 138,
"y": 298
},
{
"t": 19,
"x": 126,
"y": 291
},
{
"t": 20,
"x": 111,
"y": 287
},
{
"t": 21,
"x": 95,
"y": 283
},
{
"t": 22,
"x": 80,
"y": 279
},
{
"t": 23,
"x": 68,
"y": 275
}
],
"birth": 0,
"death": 24,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 505,
"y": 494
},
{
"t": 7,
"x": 490,
"y": 505
},
{
"t": 8,
"x": null,
"y": null
},
{
"t": 9,
"x": 513,
"y": 490
},
{
"t": 17,
"x": 521,
"y": 486
}
],
"birth": 0,
"death": 24,
"type": "magenta suede pump"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 642,
"y": 146
},
{
"t": 1,
"x": 623,
"y": 158
},
{
"t": 2,
"x": 623,
"y": 212
},
{
"t": 3,
"x": 673,
"y": 353
},
{
"t": 4,
"x": 576,
"y": 271
},
{
"t": 5,
"x": 572,
"y": 337
},
{
"t": 6,
"x": 611,
"y": 451
},
{
"t": 7,
"x": 646,
"y": 548
},
{
"t": 8,
"x": 583,
"y": 568
},
{
"t": 9,
"x": 607,
"y": 666
},
{
"t": 10,
"x": 537,
"y": 673
},
{
"t": 11,
"x": 548,
"y": 708
},
{
"t": 12,
"x": 537,
"y": 728
},
{
"t": 13,
"x": 521,
"y": 751
},
{
"t": 14,
"x": 505,
"y": 775
},
{
"t": 15,
"x": 521,
"y": 818
},
{
"t": 16,
"x": 521,
"y": 845
},
{
"t": 17,
"x": 505,
"y": 853
},
{
"t": 18,
"x": 513,
"y": 884
},
{
"t": 19,
"x": 490,
"y": 880
},
{
"t": 20,
"x": 482,
"y": 888
},
{
"t": 21,
"x": 458,
"y": 876
},
{
"t": 22,
"x": 412,
"y": 833
},
{
"t": 23,
"x": 455,
"y": 896
}
],
"birth": 0,
"death": 24,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 298
},
{
"t": 1,
"x": null,
"y": null
},
{
"t": 2,
"x": 783,
"y": 306
},
{
"t": 3,
"x": 771,
"y": 318
},
{
"t": 4,
"x": 724,
"y": 298
},
{
"t": 7,
"x": 716,
"y": 291
},
{
"t": 9,
"x": 708,
"y": 283
},
{
"t": 10,
"x": 716,
"y": 287
},
{
"t": 12,
"x": 708,
"y": 279
},
{
"t": 15,
"x": 701,
"y": 271
},
{
"t": 18,
"x": 693,
"y": 263
},
{
"t": 21,
"x": 685,
"y": 255
}
],
"birth": 0,
"death": 24,
"type": "grey and orange athletic shoe"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 837,
"y": 525
},
{
"t": 2,
"x": 818,
"y": 529
},
{
"t": 3,
"x": 845,
"y": 521
},
{
"t": 4,
"x": 873,
"y": 501
},
{
"t": 6,
"x": 845,
"y": 458
},
{
"t": 7,
"x": 814,
"y": 474
},
{
"t": 8,
"x": 794,
"y": 490
},
{
"t": 9,
"x": 783,
"y": 490
},
{
"t": 10,
"x": 775,
"y": 494
},
{
"t": 11,
"x": 767,
"y": 501
},
{
"t": 12,
"x": 755,
"y": 517
},
{
"t": 13,
"x": 751,
"y": 501
},
{
"t": 15,
"x": 744,
"y": 498
},
{
"t": 16,
"x": 740,
"y": 513
},
{
"t": 17,
"x": 748,
"y": 498
},
{
"t": 18,
"x": 744,
"y": 505
},
{
"t": 19,
"x": 740,
"y": 525
},
{
"t": 20,
"x": 740,
"y": 548
},
{
"t": 22,
"x": 748,
"y": 564
}
],
"birth": 0,
"death": 24,
"type": "white cardboard moisturizer box"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 384
},
{
"t": 2,
"x": 908,
"y": 388
},
{
"t": 4,
"x": null,
"y": null
},
{
"t": 8,
"x": 931,
"y": 345
},
{
"t": 10,
"x": 927,
"y": 357
},
{
"t": 11,
"x": 935,
"y": 349
},
{
"t": 13,
"x": 923,
"y": 349
},
{
"t": 16,
"x": 916,
"y": 341
},
{
"t": 20,
"x": 904,
"y": 333
},
{
"t": 22,
"x": 900,
"y": 326
},
{
"t": 23,
"x": 892,
"y": 322
}
],
"birth": 0,
"death": 24,
"type": "blue high-top sneaker"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 947,
"y": 333
},
{
"t": 2,
"x": 947,
"y": 353
},
{
"t": 3,
"x": 943,
"y": 361
},
{
"t": 7,
"x": 943,
"y": 373
},
{
"t": 8,
"x": 958,
"y": 392
},
{
"t": 9,
"x": 962,
"y": 400
},
{
"t": 10,
"x": 958,
"y": 482
},
{
"t": 11,
"x": 951,
"y": 486
},
{
"t": 13,
"x": 939,
"y": 474
},
{
"t": 14,
"x": 939,
"y": 451
},
{
"t": 16,
"x": 931,
"y": 447
},
{
"t": 23,
"x": 931,
"y": 462
}
],
"birth": 0,
"death": 24,
"type": "multicolored cardboard Scrabble game"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
4
],
"outputs": [
1,
4
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 1,
"type": "contact"
},
{
"id": 10,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 2,
"type": "contact"
},
{
"id": 11,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 4,
"type": "contact"
},
{
"id": 12,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 1,
"ends_at": 1,
"type": "collision"
},
{
"id": 13,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 1,
"ends_at": 1,
"type": "collision"
},
{
"id": 14,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 15,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 16,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 17,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 18,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 19,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 2,
"ends_at": 11,
"type": "contact"
},
{
"id": 20,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 2,
"ends_at": 23,
"type": "contact"
},
{
"id": 21,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 3,
"ends_at": 4,
"type": "collision"
},
{
"id": 22,
"inputs": [
6,
8
],
"outputs": [
6,
8
],
"begins_at": 3,
"ends_at": 4,
"type": "collision"
},
{
"id": 23,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 3,
"ends_at": 4,
"type": "contact"
},
{
"id": 24,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 25,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 26,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 27,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 28,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 29,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 5,
"ends_at": 7,
"type": "contact"
},
{
"id": 30,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 31,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 32,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 6,
"ends_at": 23,
"type": "contact"
},
{
"id": 33,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 34,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 35,
"inputs": [
5,
6
],
"outputs": [
5,
6
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 36,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 37,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 38,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 7,
"ends_at": 9,
"type": "contact"
},
{
"id": 39,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 7,
"ends_at": 13,
"type": "contact"
},
{
"id": 40,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 41,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 8,
"ends_at": 9,
"type": "contact"
},
{
"id": 42,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 43,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 44,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 9,
"ends_at": 10,
"type": "collision"
},
{
"id": 45,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 9,
"ends_at": 10,
"type": "collision"
},
{
"id": 46,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 47,
"inputs": [
8,
10
],
"outputs": [
8,
10
],
"begins_at": 10,
"ends_at": 11,
"type": "collision"
},
{
"id": 48,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 10,
"ends_at": 11,
"type": "collision"
},
{
"id": 49,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 50,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 51,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 52,
"inputs": [
1,
6
],
"outputs": [
1,
6
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 53,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 54,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 55,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 12,
"ends_at": 13,
"type": "collision"
},
{
"id": 56,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 12,
"ends_at": 13,
"type": "contact"
},
{
"id": 57,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 58,
"inputs": [
1,
6
],
"outputs": [
1,
6
],
"begins_at": 13,
"ends_at": 14,
"type": "contact"
},
{
"id": 59,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 13,
"ends_at": 14,
"type": "contact"
},
{
"id": 60,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 13,
"ends_at": 19,
"type": "contact"
},
{
"id": 61,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 62,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 63,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 64,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 15,
"ends_at": 16,
"type": "collision"
},
{
"id": 65,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 15,
"ends_at": 21,
"type": "contact"
},
{
"id": 66,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 67,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 68,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 16,
"ends_at": 17,
"type": "collision"
},
{
"id": 69,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 16,
"ends_at": 20,
"type": "contact"
},
{
"id": 70,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 71,
"inputs": [
3
],
"outputs": [
3
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 72,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 73,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 74,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 75,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 76,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 77,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 78,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 21,
"ends_at": 22,
"type": "collision"
},
{
"id": 79,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 21,
"ends_at": 22,
"type": "contact"
},
{
"id": 80,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 81,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 82,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 83,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
},
{
"id": 84,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "contact"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 1.0,
"avg_image_position_segmentation_acc_small": 1.0,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 1.0,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": 1.0,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 1.0,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 1.0,
"num_matches": 11,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.582370528022702,
"avg_interaction_input_object_jaccard": 0.20512820512820512,
"avg_interaction_output_object_jaccard": 0.20512820512820512,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 26,
"num_unmatched_pred_interactions": 59,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 19,
"false_positives": 66,
"false_negatives": 0
},
"0.5": {
"true_positives": 17,
"false_positives": 68,
"false_negatives": 0
},
"0.75": {
"true_positives": 11,
"false_positives": 74,
"false_negatives": 0
},
"1.0": {
"true_positives": 7,
"false_positives": 78,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.2235294117647059,
"0.5": 0.2,
"0.75": 0.12941176470588237,
"1.0": 0.08235294117647059
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.36538461538461536,
"0.5": 0.33333333333333337,
"0.75": 0.22916666666666669,
"1.0": 0.15217391304347827
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 15,
"false_positives": 70,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 83,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 85,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 85,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.17647058823529413,
"0.5": 0.023529411764705882,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.3,
"0.5": 0.04597701149425288,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 15,
"false_positives": 70,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 83,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 85,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 85,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.17647058823529413,
"0.5": 0.023529411764705882,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.3,
"0.5": 0.04597701149425288,
"0.75": 0.0,
"1.0": 0.0
}
}
}Prompt
<video> Analyze the provided video and return ONLY a valid sentinel sequence in this format: [SCENE-START] [OBJS-START] [OBJ] id "type" birth death [PX] t px py ... [OBJ] ... [OBJS-END] [INTERACTIONS-START] [INTERACT] id "type" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ... [INTERACT] ... [INTERACTIONS-END] [SCENE-END] Constraints: - Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose). - Keep tags exactly as written: `[SCENE-START] [OBJS-START] [OBJ] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]` - Use quoted strings for `type` (double quotes). - `PX` uses repeated groups of 3 values in order: `t px py`. - `t` is the timestamp (frame number). - `px` and `py` are the pixel coordinates of the object in that frame, normalized to [0,1] relative to the frame dimensions, scaled by 1000 and rounded to the nearest integer. For example, `px` of 0.1234 would be represented as 123. - When an object is occluded or not visible in a frame, `PX` may use `t null null`. - `IN` and `OUT` contain whitespace-separated integer ids.
B1 cache + injected GT identity map
B2 consumed the persisted B1-oracle frame cache. Its learned mapper call was bypassed at every streaming step and replaced with the shown stable-ID → detector-ID identity map; the ordinary staged merger still produced the final interaction prediction.
Every persisted/reconstructed prefill step
[
{
"frame_index": 0,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 298 318 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 333 587 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 380 970 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 388 306 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 423 509 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 505 494 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 642 146 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 646 298 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 837 525 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 919 384 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 947 333 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 4 [OUT] 1 4 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 298 318 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 333 587 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 380 970 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 388 306 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 423 509 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 505 494 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 642 146 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 646 298 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 837 525 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 919 384 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 947 333 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 4 [OUT] 1 4 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 298,
"y": 318
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 333,
"y": 587
}
],
"birth": 0,
"death": 1,
"type": "black and yellow cardboard motherboard box"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 380,
"y": 970
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 388,
"y": 306
}
],
"birth": 0,
"death": 1,
"type": "Colorful wooden geometric sorting board"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 423,
"y": 509
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 505,
"y": 494
}
],
"birth": 0,
"death": 1,
"type": "magenta suede pump"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 642,
"y": 146
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 298
}
],
"birth": 0,
"death": 1,
"type": "grey and orange athletic shoe"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 837,
"y": 525
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 384
}
],
"birth": 0,
"death": 1,
"type": "blue high-top sneaker"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 947,
"y": 333
}
],
"birth": 0,
"death": 1,
"type": "multicolored cardboard Scrabble game"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
4
],
"outputs": [
1,
4
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 11,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"8": 8,
"9": 9,
"10": 10
},
"mapping_note": "identity_ids=True initialization; mapper not called",
"mapper_called": false
},
{
"frame_index": 1,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 330 314 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 392 974 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 419 427 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 623 158 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 330 314 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 392 974 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 419 427 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 623 158 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 330,
"y": 314
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 392,
"y": 974
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 419,
"y": 427
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 623,
"y": 158
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
}
],
"birth": 0,
"death": 1,
"type": "grey and orange athletic shoe"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"2": 2,
"4": 4,
"6": 6,
"7": 7
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 2,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 294 318 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 349 583 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 400 408 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 623 212 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 783 306 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 818 529 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 908 388 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 947 353 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 294 318 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 349 583 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 400 408 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 623 212 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 783 306 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 818 529 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 908 388 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 947 353 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 294,
"y": 318
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 349,
"y": 583
}
],
"birth": 0,
"death": 1,
"type": "black and yellow cardboard motherboard box"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 400,
"y": 408
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 623,
"y": 212
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 783,
"y": 306
}
],
"birth": 0,
"death": 1,
"type": "grey and orange athletic shoe"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 818,
"y": 529
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 908,
"y": 388
}
],
"birth": 0,
"death": 1,
"type": "blue high-top sneaker"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 947,
"y": 353
}
],
"birth": 0,
"death": 1,
"type": "multicolored cardboard Scrabble game"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"4": 4,
"6": 6,
"7": 7,
"8": 8,
"9": 9,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 3,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 404 978 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 384 400 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 673 353 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 771 318 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 845 521 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 943 361 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 8 [OUT] 6 8 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 404 978 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 384 400 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 673 353 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 771 318 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 845 521 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 943 361 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 8 [OUT] 6 8 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 404,
"y": 978
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 384,
"y": 400
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 673,
"y": 353
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 771,
"y": 318
}
],
"birth": 0,
"death": 1,
"type": "grey and orange athletic shoe"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 845,
"y": 521
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 943,
"y": 361
}
],
"birth": 0,
"death": 1,
"type": "multicolored cardboard Scrabble game"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
6,
8
],
"outputs": [
6,
8
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"4": 4,
"6": 6,
"7": 7,
"8": 8,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 4,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 322 310 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 416 982 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 380 302 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 369 396 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 576 271 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 724 298 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 873 501 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 8 [OUT] 6 8 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 322 310 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 416 982 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 380 302 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 369 396 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 576 271 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 724 298 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 873 501 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 8 [OUT] 6 8 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 322,
"y": 310
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 416,
"y": 982
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 380,
"y": 302
}
],
"birth": 0,
"death": 1,
"type": "Colorful wooden geometric sorting board"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 369,
"y": 396
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 576,
"y": 271
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 724,
"y": 298
}
],
"birth": 0,
"death": 1,
"type": "grey and orange athletic shoe"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 873,
"y": 501
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
}
],
"birth": 0,
"death": 1,
"type": "blue high-top sneaker"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
8
],
"outputs": [
6,
8
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"6": 6,
"7": 7,
"8": 8,
"9": 9
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 5,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 287 310 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 357 400 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 572 337 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 287 310 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 357 400 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 572 337 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 287,
"y": 310
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 357,
"y": 400
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 572,
"y": 337
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"4": 4,
"6": 6
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 6,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 244 341 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 423 986 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 341 416 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 611 451 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 845 458 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 244 341 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 423 986 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 341 416 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 611 451 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 845 458 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 244,
"y": 341
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 423,
"y": 986
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 341,
"y": 416
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 611,
"y": 451
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 845,
"y": 458
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"2": 2,
"4": 4,
"6": 6,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 7,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 283 310 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 353 591 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 431 990 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 373 298 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 318 443 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 490 505 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 646 548 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 716 291 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 814 474 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 943 373 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 6 [OUT] 5 6 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 283 310 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 353 591 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 431 990 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 373 298 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 318 443 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 490 505 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 646 548 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 716 291 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 814 474 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 943 373 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 6 [OUT] 5 6 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 283,
"y": 310
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 353,
"y": 591
}
],
"birth": 0,
"death": 1,
"type": "black and yellow cardboard motherboard box"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 431,
"y": 990
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 373,
"y": 298
}
],
"birth": 0,
"death": 1,
"type": "Colorful wooden geometric sorting board"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 318,
"y": 443
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 490,
"y": 505
}
],
"birth": 0,
"death": 1,
"type": "magenta suede pump"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 548
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 716,
"y": 291
}
],
"birth": 0,
"death": 1,
"type": "grey and orange athletic shoe"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 814,
"y": 474
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 943,
"y": 373
}
],
"birth": 0,
"death": 1,
"type": "multicolored cardboard Scrabble game"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
6
],
"outputs": [
5,
6
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"8": 8,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 8,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 443 990 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 318 392 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 null null [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 583 568 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 794 490 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 931 345 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 958 392 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 443 990 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 318 392 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 null null [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 583 568 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 794 490 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 931 345 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 958 392 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 443,
"y": 990
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 318,
"y": 392
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
}
],
"birth": 0,
"death": 1,
"type": "magenta suede pump"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 583,
"y": 568
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 794,
"y": 490
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 931,
"y": 345
}
],
"birth": 0,
"death": 1,
"type": "blue high-top sneaker"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 958,
"y": 392
}
],
"birth": 0,
"death": 1,
"type": "multicolored cardboard Scrabble game"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"4": 4,
"5": 5,
"6": 6,
"8": 8,
"9": 9,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 9,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 310 306 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 451 994 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 365 294 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 291 369 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 513 490 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 607 666 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 708 283 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 783 490 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 962 400 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 310 306 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 451 994 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 365 294 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 291 369 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 513 490 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 607 666 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 708 283 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 783 490 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 962 400 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 310,
"y": 306
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 451,
"y": 994
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 365,
"y": 294
}
],
"birth": 0,
"death": 1,
"type": "Colorful wooden geometric sorting board"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 291,
"y": 369
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 513,
"y": 490
}
],
"birth": 0,
"death": 1,
"type": "magenta suede pump"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 607,
"y": 666
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 708,
"y": 283
}
],
"birth": 0,
"death": 1,
"type": "grey and orange athletic shoe"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 783,
"y": 490
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 962,
"y": 400
}
],
"birth": 0,
"death": 1,
"type": "multicolored cardboard Scrabble game"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"8": 8,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 10,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 302 302 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 330 607 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 275 345 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 537 673 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 716 287 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 775 494 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 927 357 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 958 482 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 10 [OUT] 8 10 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 302 302 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 330 607 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 275 345 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 537 673 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 716 287 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 775 494 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 927 357 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 958 482 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 10 [OUT] 8 10 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 302,
"y": 302
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 330,
"y": 607
}
],
"birth": 0,
"death": 1,
"type": "black and yellow cardboard motherboard box"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 275,
"y": 345
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 537,
"y": 673
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 716,
"y": 287
}
],
"birth": 0,
"death": 1,
"type": "grey and orange athletic shoe"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 775,
"y": 494
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 927,
"y": 357
}
],
"birth": 0,
"death": 1,
"type": "blue high-top sneaker"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 958,
"y": 482
}
],
"birth": 0,
"death": 1,
"type": "multicolored cardboard Scrabble game"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
10
],
"outputs": [
8,
10
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"4": 4,
"6": 6,
"7": 7,
"8": 8,
"9": 9,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 11,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 373 283 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 259 322 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 548 708 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 767 501 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 935 349 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 951 486 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 10 [OUT] 8 10 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 373 283 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 259 322 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 548 708 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 767 501 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 935 349 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 951 486 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 10 [OUT] 8 10 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
}
],
"birth": 0,
"death": 1,
"type": "white plastic lutein supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 373,
"y": 283
}
],
"birth": 0,
"death": 1,
"type": "Colorful wooden geometric sorting board"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 259,
"y": 322
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 548,
"y": 708
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 767,
"y": 501
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 935,
"y": 349
}
],
"birth": 0,
"death": 1,
"type": "blue high-top sneaker"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 951,
"y": 486
}
],
"birth": 0,
"death": 1,
"type": "multicolored cardboard Scrabble game"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
8,
10
],
"outputs": [
8,
10
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"3": 3,
"4": 4,
"6": 6,
"8": 8,
"9": 9,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 12,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 263 283 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 322 603 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 337 271 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 236 333 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 537 728 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 708 279 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 755 517 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 6 [OUT] 1 6 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 263 283 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 322 603 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 337 271 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 236 333 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 537 728 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 708 279 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 755 517 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 6 [OUT] 1 6 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 263,
"y": 283
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 322,
"y": 603
}
],
"birth": 0,
"death": 1,
"type": "black and yellow cardboard motherboard box"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 337,
"y": 271
}
],
"birth": 0,
"death": 1,
"type": "Colorful wooden geometric sorting board"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 236,
"y": 333
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 537,
"y": 728
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 708,
"y": 279
}
],
"birth": 0,
"death": 1,
"type": "grey and orange athletic shoe"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 755,
"y": 517
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
6
],
"outputs": [
1,
6
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"3": 3,
"4": 4,
"6": 6,
"7": 7,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 13,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 255 279 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 314 611 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 341 263 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 216 330 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 521 751 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 751 501 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 923 349 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 939 474 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 6 [OUT] 1 6 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 255 279 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 314 611 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 341 263 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 216 330 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 521 751 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 751 501 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 923 349 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 939 474 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 6 [OUT] 1 6 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 255,
"y": 279
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 314,
"y": 611
}
],
"birth": 0,
"death": 1,
"type": "black and yellow cardboard motherboard box"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 341,
"y": 263
}
],
"birth": 0,
"death": 1,
"type": "Colorful wooden geometric sorting board"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 216,
"y": 330
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 521,
"y": 751
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 751,
"y": 501
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 923,
"y": 349
}
],
"birth": 0,
"death": 1,
"type": "blue high-top sneaker"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 939,
"y": 474
}
],
"birth": 0,
"death": 1,
"type": "multicolored cardboard Scrabble game"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
6
],
"outputs": [
1,
6
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"3": 3,
"4": 4,
"6": 6,
"8": 8,
"9": 9,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 14,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 251 271 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 357 583 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 201 326 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 505 775 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 939 451 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 6 [OUT] 1 6 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 251 271 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 357 583 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 201 326 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 505 775 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 939 451 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 6 [OUT] 1 6 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 251,
"y": 271
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 357,
"y": 583
}
],
"birth": 0,
"death": 1,
"type": "black and yellow cardboard motherboard box"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 201,
"y": 326
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 505,
"y": 775
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 939,
"y": 451
}
],
"birth": 0,
"death": 1,
"type": "multicolored cardboard Scrabble game"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
6
],
"outputs": [
1,
6
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"4": 4,
"6": 6,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 15,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 232 263 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 353 255 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 189 314 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 521 818 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 701 271 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 744 498 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 232 263 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 353 255 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 189 314 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 521 818 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 701 271 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 744 498 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 232,
"y": 263
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 353,
"y": 255
}
],
"birth": 0,
"death": 1,
"type": "Colorful wooden geometric sorting board"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 189,
"y": 314
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 521,
"y": 818
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 701,
"y": 271
}
],
"birth": 0,
"death": 1,
"type": "grey and orange athletic shoe"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 744,
"y": 498
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"3": 3,
"4": 4,
"6": 6,
"7": 7,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 16,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 228 244 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 361 591 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 361 244 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 173 306 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 521 845 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 740 513 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 916 341 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 931 447 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 228 244 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 361 591 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 361 244 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 173 306 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 521 845 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 740 513 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 916 341 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 931 447 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 228,
"y": 244
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 361,
"y": 591
}
],
"birth": 0,
"death": 1,
"type": "black and yellow cardboard motherboard box"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 361,
"y": 244
}
],
"birth": 0,
"death": 1,
"type": "Colorful wooden geometric sorting board"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 173,
"y": 306
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 521,
"y": 845
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 740,
"y": 513
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 916,
"y": 341
}
],
"birth": 0,
"death": 1,
"type": "blue high-top sneaker"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 931,
"y": 447
}
],
"birth": 0,
"death": 1,
"type": "multicolored cardboard Scrabble game"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"3": 3,
"4": 4,
"6": 6,
"8": 8,
"9": 9,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 17,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 208 236 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 357 599 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 154 306 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 521 486 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 505 853 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 748 498 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 208 236 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 357 599 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 154 306 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 521 486 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 505 853 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 748 498 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 208,
"y": 236
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 357,
"y": 599
}
],
"birth": 0,
"death": 1,
"type": "black and yellow cardboard motherboard box"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 154,
"y": 306
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 521,
"y": 486
}
],
"birth": 0,
"death": 1,
"type": "magenta suede pump"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 505,
"y": 853
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 748,
"y": 498
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"4": 4,
"5": 5,
"6": 6,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 18,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 201 244 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 369 232 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 138 298 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 513 884 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 693 263 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 744 505 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 3 [OUT] 2 3 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 201 244 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 369 232 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 138 298 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 513 884 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 693 263 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 744 505 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 3 [OUT] 2 3 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 201,
"y": 244
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 369,
"y": 232
}
],
"birth": 0,
"death": 1,
"type": "Colorful wooden geometric sorting board"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 138,
"y": 298
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 513,
"y": 884
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 693,
"y": 263
}
],
"birth": 0,
"death": 1,
"type": "grey and orange athletic shoe"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 744,
"y": 505
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
3
],
"outputs": [
2,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"3": 3,
"4": 4,
"6": 6,
"7": 7,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 19,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 197 216 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 361 611 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 126 291 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 490 880 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 740 525 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 197 216 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 361 611 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 126 291 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 490 880 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 740 525 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 197,
"y": 216
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 361,
"y": 611
}
],
"birth": 0,
"death": 1,
"type": "black and yellow cardboard motherboard box"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 126,
"y": 291
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 490,
"y": 880
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 740,
"y": 525
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"4": 4,
"6": 6,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 20,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 369 220 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 111 287 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 482 888 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 740 548 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 904 333 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 369 220 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 111 287 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 482 888 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 740 548 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 904 333 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 369,
"y": 220
}
],
"birth": 0,
"death": 1,
"type": "Colorful wooden geometric sorting board"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 111,
"y": 287
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 482,
"y": 888
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 740,
"y": 548
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 904,
"y": 333
}
],
"birth": 0,
"death": 1,
"type": "blue high-top sneaker"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"3": 3,
"4": 4,
"6": 6,
"8": 8,
"9": 9
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 21,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 162 193 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 333 220 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 95 283 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 458 876 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 685 255 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 162 193 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 333 220 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 95 283 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 458 876 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 685 255 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 162,
"y": 193
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 333,
"y": 220
}
],
"birth": 0,
"death": 1,
"type": "Colorful wooden geometric sorting board"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 95,
"y": 283
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 458,
"y": 876
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 685,
"y": 255
}
],
"birth": 0,
"death": 1,
"type": "grey and orange athletic shoe"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"3": 3,
"4": 4,
"6": 6,
"7": 7
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 22,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 154 181 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 365 619 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 330 212 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 80 279 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 412 833 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 748 564 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 900 326 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 154 181 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 365 619 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 330 212 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 80 279 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 412 833 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 748 564 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 900 326 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 154,
"y": 181
}
],
"birth": 0,
"death": 1,
"type": "multicolored wooden stacking toy"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 365,
"y": 619
}
],
"birth": 0,
"death": 1,
"type": "black and yellow cardboard motherboard box"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 330,
"y": 212
}
],
"birth": 0,
"death": 1,
"type": "Colorful wooden geometric sorting board"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 80,
"y": 279
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 412,
"y": 833
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 748,
"y": 564
}
],
"birth": 0,
"death": 1,
"type": "white cardboard moisturizer box"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 900,
"y": 326
}
],
"birth": 0,
"death": 1,
"type": "blue high-top sneaker"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"3": 3,
"4": 4,
"6": 6,
"8": 8,
"9": 9
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 23,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 68 275 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 455 896 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 892 322 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 931 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 68 275 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 455 896 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 892 322 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 931 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 68,
"y": 275
}
],
"birth": 0,
"death": 1,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 455,
"y": 896
}
],
"birth": 0,
"death": 1,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 892,
"y": 322
}
],
"birth": 0,
"death": 1,
"type": "blue high-top sneaker"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 931,
"y": 462
}
],
"birth": 0,
"death": 1,
"type": "multicolored cardboard Scrabble game"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"4": 4,
"6": 6,
"9": 9,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "multicolored wooden stacking toy" 0 24 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 14 251 271 15 232 263 16 228 244 17 208 236 18 201 244 19 197 216 21 162 193 22 154 181 [OBJ] 1 "black and yellow cardboard motherboard box" 0 24 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 14 357 583 16 361 591 17 357 599 19 361 611 22 365 619 [OBJ] 2 "white plastic lutein supplement bottle" 0 24 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 "Colorful wooden geometric sorting board" 0 24 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 15 353 255 16 361 244 18 369 232 20 369 220 21 333 220 22 330 212 [OBJ] 4 "white cardboard box of diaper pail refill bags" 0 24 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 14 201 326 15 189 314 16 173 306 17 154 306 18 138 298 19 126 291 20 111 287 21 95 283 22 80 279 23 68 275 [OBJ] 5 "magenta suede pump" 0 24 [PX] 0 505 494 7 490 505 8 null null 9 513 490 17 521 486 [OBJ] 6 "peach and blue cardboard 12-pack of soda cans" 0 24 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 14 505 775 15 521 818 16 521 845 17 505 853 18 513 884 19 490 880 20 482 888 21 458 876 22 412 833 23 455 896 [OBJ] 7 "grey and orange athletic shoe" 0 24 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 15 701 271 18 693 263 21 685 255 [OBJ] 8 "white cardboard moisturizer box" 0 24 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 15 744 498 16 740 513 17 748 498 18 744 505 19 740 525 20 740 548 22 748 564 [OBJ] 9 "blue high-top sneaker" 0 24 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 16 916 341 20 904 333 22 900 326 23 892 322 [OBJ] 10 "multicolored cardboard Scrabble game" 0 24 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 14 939 451 16 931 447 23 931 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 "contact" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 "contact" 0 0 [IN] 1 4 [OUT] 1 4 [INTERACT] 2 "contact" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 "contact" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 "contact" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 "contact" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 "contact" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 7 "contact" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 8 "contact" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 9 "contact" 0 1 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 10 "contact" 0 2 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 11 "contact" 0 4 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 12 "collision" 1 1 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 13 "collision" 1 1 [IN] 65535 [OUT] 65535 [INTERACT] 14 "collision" 2 2 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 15 "collision" 2 2 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 16 "collision" 2 2 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 17 "collision" 2 2 [IN] 9 10 [OUT] 9 10 [INTERACT] 18 "collision" 2 2 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 19 "contact" 2 11 [IN] 65535 [OUT] 65535 [INTERACT] 20 "contact" 2 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 21 "collision" 3 4 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 22 "collision" 3 4 [IN] 6 8 [OUT] 6 8 [INTERACT] 23 "contact" 3 4 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 24 "collision" 4 4 [IN] 0 3 [OUT] 0 3 [INTERACT] 25 "collision" 4 4 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 26 "collision" 4 4 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 27 "collision" 4 4 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 28 "collision" 5 5 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 29 "contact" 5 7 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 30 "collision" 6 6 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 31 "collision" 6 6 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 32 "contact" 6 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 33 "collision" 7 7 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 34 "collision" 7 7 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 35 "collision" 7 7 [IN] 5 6 [OUT] 5 6 [INTERACT] 36 "collision" 7 7 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 37 "collision" 7 7 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 38 "contact" 7 9 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 39 "contact" 7 13 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 40 "collision" 8 8 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 41 "contact" 8 9 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 42 "collision" 9 9 [IN] 0 3 [OUT] 0 3 [INTERACT] 43 "collision" 9 9 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 44 "collision" 9 10 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 45 "collision" 9 10 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 46 "collision" 10 10 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 47 "collision" 10 11 [IN] 8 10 [OUT] 8 10 [INTERACT] 48 "collision" 10 11 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 49 "collision" 11 11 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 50 "collision" 11 11 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 51 "collision" 12 12 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 52 "collision" 12 12 [IN] 1 6 [OUT] 1 6 [INTERACT] 53 "collision" 12 12 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 54 "collision" 12 12 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 55 "collision" 12 13 [IN] 0 3 [OUT] 0 3 [INTERACT] 56 "contact" 12 13 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 57 "collision" 13 13 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 58 "contact" 13 14 [IN] 1 6 [OUT] 1 6 [INTERACT] 59 "contact" 13 14 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 60 "contact" 13 19 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 61 "collision" 14 14 [IN] 65535 [OUT] 65535 [INTERACT] 62 "collision" 15 15 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 63 "collision" 15 15 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 64 "collision" 15 16 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 65 "contact" 15 21 [IN] 65535 [OUT] 65535 [INTERACT] 66 "collision" 16 16 [IN] 0 3 [OUT] 0 3 [INTERACT] 67 "collision" 16 16 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 68 "collision" 16 17 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 69 "contact" 16 20 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 70 "collision" 17 17 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 71 "collision" 18 18 [IN] 3 [OUT] 3 [INTERACT] 72 "collision" 18 18 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 73 "collision" 18 18 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 74 "collision" 19 19 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 75 "collision" 20 20 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 76 "collision" 20 20 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 77 "collision" 21 21 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 78 "collision" 21 22 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 79 "contact" 21 22 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 80 "collision" 22 22 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 81 "collision" 22 22 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 82 "collision" 22 22 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 83 "collision" 23 23 [IN] 65535 [OUT] 65535 [INTERACT] 84 "contact" 23 23 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 298,
"y": 318
},
{
"t": 1,
"x": 330,
"y": 314
},
{
"t": 2,
"x": 294,
"y": 318
},
{
"t": 4,
"x": 322,
"y": 310
},
{
"t": 5,
"x": 287,
"y": 310
},
{
"t": 6,
"x": 244,
"y": 341
},
{
"t": 7,
"x": 283,
"y": 310
},
{
"t": 9,
"x": 310,
"y": 306
},
{
"t": 10,
"x": 302,
"y": 302
},
{
"t": 12,
"x": 263,
"y": 283
},
{
"t": 13,
"x": 255,
"y": 279
},
{
"t": 14,
"x": 251,
"y": 271
},
{
"t": 15,
"x": 232,
"y": 263
},
{
"t": 16,
"x": 228,
"y": 244
},
{
"t": 17,
"x": 208,
"y": 236
},
{
"t": 18,
"x": 201,
"y": 244
},
{
"t": 19,
"x": 197,
"y": 216
},
{
"t": 21,
"x": 162,
"y": 193
},
{
"t": 22,
"x": 154,
"y": 181
}
],
"birth": 0,
"death": 24,
"type": "multicolored wooden stacking toy"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 333,
"y": 587
},
{
"t": 2,
"x": 349,
"y": 583
},
{
"t": 7,
"x": 353,
"y": 591
},
{
"t": 10,
"x": 330,
"y": 607
},
{
"t": 12,
"x": 322,
"y": 603
},
{
"t": 13,
"x": 314,
"y": 611
},
{
"t": 14,
"x": 357,
"y": 583
},
{
"t": 16,
"x": 361,
"y": 591
},
{
"t": 17,
"x": 357,
"y": 599
},
{
"t": 19,
"x": 361,
"y": 611
},
{
"t": 22,
"x": 365,
"y": 619
}
],
"birth": 0,
"death": 24,
"type": "black and yellow cardboard motherboard box"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 380,
"y": 970
},
{
"t": 1,
"x": 392,
"y": 974
},
{
"t": 3,
"x": 404,
"y": 978
},
{
"t": 4,
"x": 416,
"y": 982
},
{
"t": 6,
"x": 423,
"y": 986
},
{
"t": 7,
"x": 431,
"y": 990
},
{
"t": 8,
"x": 443,
"y": 990
},
{
"t": 9,
"x": 451,
"y": 994
},
{
"t": 11,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "white plastic lutein supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 388,
"y": 306
},
{
"t": 4,
"x": 380,
"y": 302
},
{
"t": 7,
"x": 373,
"y": 298
},
{
"t": 9,
"x": 365,
"y": 294
},
{
"t": 11,
"x": 373,
"y": 283
},
{
"t": 12,
"x": 337,
"y": 271
},
{
"t": 13,
"x": 341,
"y": 263
},
{
"t": 15,
"x": 353,
"y": 255
},
{
"t": 16,
"x": 361,
"y": 244
},
{
"t": 18,
"x": 369,
"y": 232
},
{
"t": 20,
"x": 369,
"y": 220
},
{
"t": 21,
"x": 333,
"y": 220
},
{
"t": 22,
"x": 330,
"y": 212
}
],
"birth": 0,
"death": 24,
"type": "Colorful wooden geometric sorting board"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 423,
"y": 509
},
{
"t": 1,
"x": 419,
"y": 427
},
{
"t": 2,
"x": 400,
"y": 408
},
{
"t": 3,
"x": 384,
"y": 400
},
{
"t": 4,
"x": 369,
"y": 396
},
{
"t": 5,
"x": 357,
"y": 400
},
{
"t": 6,
"x": 341,
"y": 416
},
{
"t": 7,
"x": 318,
"y": 443
},
{
"t": 8,
"x": 318,
"y": 392
},
{
"t": 9,
"x": 291,
"y": 369
},
{
"t": 10,
"x": 275,
"y": 345
},
{
"t": 11,
"x": 259,
"y": 322
},
{
"t": 12,
"x": 236,
"y": 333
},
{
"t": 13,
"x": 216,
"y": 330
},
{
"t": 14,
"x": 201,
"y": 326
},
{
"t": 15,
"x": 189,
"y": 314
},
{
"t": 16,
"x": 173,
"y": 306
},
{
"t": 17,
"x": 154,
"y": 306
},
{
"t": 18,
"x": 138,
"y": 298
},
{
"t": 19,
"x": 126,
"y": 291
},
{
"t": 20,
"x": 111,
"y": 287
},
{
"t": 21,
"x": 95,
"y": 283
},
{
"t": 22,
"x": 80,
"y": 279
},
{
"t": 23,
"x": 68,
"y": 275
}
],
"birth": 0,
"death": 24,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 505,
"y": 494
},
{
"t": 7,
"x": 490,
"y": 505
},
{
"t": 8,
"x": null,
"y": null
},
{
"t": 9,
"x": 513,
"y": 490
},
{
"t": 17,
"x": 521,
"y": 486
}
],
"birth": 0,
"death": 24,
"type": "magenta suede pump"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 642,
"y": 146
},
{
"t": 1,
"x": 623,
"y": 158
},
{
"t": 2,
"x": 623,
"y": 212
},
{
"t": 3,
"x": 673,
"y": 353
},
{
"t": 4,
"x": 576,
"y": 271
},
{
"t": 5,
"x": 572,
"y": 337
},
{
"t": 6,
"x": 611,
"y": 451
},
{
"t": 7,
"x": 646,
"y": 548
},
{
"t": 8,
"x": 583,
"y": 568
},
{
"t": 9,
"x": 607,
"y": 666
},
{
"t": 10,
"x": 537,
"y": 673
},
{
"t": 11,
"x": 548,
"y": 708
},
{
"t": 12,
"x": 537,
"y": 728
},
{
"t": 13,
"x": 521,
"y": 751
},
{
"t": 14,
"x": 505,
"y": 775
},
{
"t": 15,
"x": 521,
"y": 818
},
{
"t": 16,
"x": 521,
"y": 845
},
{
"t": 17,
"x": 505,
"y": 853
},
{
"t": 18,
"x": 513,
"y": 884
},
{
"t": 19,
"x": 490,
"y": 880
},
{
"t": 20,
"x": 482,
"y": 888
},
{
"t": 21,
"x": 458,
"y": 876
},
{
"t": 22,
"x": 412,
"y": 833
},
{
"t": 23,
"x": 455,
"y": 896
}
],
"birth": 0,
"death": 24,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 298
},
{
"t": 1,
"x": null,
"y": null
},
{
"t": 2,
"x": 783,
"y": 306
},
{
"t": 3,
"x": 771,
"y": 318
},
{
"t": 4,
"x": 724,
"y": 298
},
{
"t": 7,
"x": 716,
"y": 291
},
{
"t": 9,
"x": 708,
"y": 283
},
{
"t": 10,
"x": 716,
"y": 287
},
{
"t": 12,
"x": 708,
"y": 279
},
{
"t": 15,
"x": 701,
"y": 271
},
{
"t": 18,
"x": 693,
"y": 263
},
{
"t": 21,
"x": 685,
"y": 255
}
],
"birth": 0,
"death": 24,
"type": "grey and orange athletic shoe"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 837,
"y": 525
},
{
"t": 2,
"x": 818,
"y": 529
},
{
"t": 3,
"x": 845,
"y": 521
},
{
"t": 4,
"x": 873,
"y": 501
},
{
"t": 6,
"x": 845,
"y": 458
},
{
"t": 7,
"x": 814,
"y": 474
},
{
"t": 8,
"x": 794,
"y": 490
},
{
"t": 9,
"x": 783,
"y": 490
},
{
"t": 10,
"x": 775,
"y": 494
},
{
"t": 11,
"x": 767,
"y": 501
},
{
"t": 12,
"x": 755,
"y": 517
},
{
"t": 13,
"x": 751,
"y": 501
},
{
"t": 15,
"x": 744,
"y": 498
},
{
"t": 16,
"x": 740,
"y": 513
},
{
"t": 17,
"x": 748,
"y": 498
},
{
"t": 18,
"x": 744,
"y": 505
},
{
"t": 19,
"x": 740,
"y": 525
},
{
"t": 20,
"x": 740,
"y": 548
},
{
"t": 22,
"x": 748,
"y": 564
}
],
"birth": 0,
"death": 24,
"type": "white cardboard moisturizer box"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 384
},
{
"t": 2,
"x": 908,
"y": 388
},
{
"t": 4,
"x": null,
"y": null
},
{
"t": 8,
"x": 931,
"y": 345
},
{
"t": 10,
"x": 927,
"y": 357
},
{
"t": 11,
"x": 935,
"y": 349
},
{
"t": 13,
"x": 923,
"y": 349
},
{
"t": 16,
"x": 916,
"y": 341
},
{
"t": 20,
"x": 904,
"y": 333
},
{
"t": 22,
"x": 900,
"y": 326
},
{
"t": 23,
"x": 892,
"y": 322
}
],
"birth": 0,
"death": 24,
"type": "blue high-top sneaker"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 947,
"y": 333
},
{
"t": 2,
"x": 947,
"y": 353
},
{
"t": 3,
"x": 943,
"y": 361
},
{
"t": 7,
"x": 943,
"y": 373
},
{
"t": 8,
"x": 958,
"y": 392
},
{
"t": 9,
"x": 962,
"y": 400
},
{
"t": 10,
"x": 958,
"y": 482
},
{
"t": 11,
"x": 951,
"y": 486
},
{
"t": 13,
"x": 939,
"y": 474
},
{
"t": 14,
"x": 939,
"y": 451
},
{
"t": 16,
"x": 931,
"y": 447
},
{
"t": 23,
"x": 931,
"y": 462
}
],
"birth": 0,
"death": 24,
"type": "multicolored cardboard Scrabble game"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
4
],
"outputs": [
1,
4
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 1,
"type": "contact"
},
{
"id": 10,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 2,
"type": "contact"
},
{
"id": 11,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 4,
"type": "contact"
},
{
"id": 12,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 1,
"ends_at": 1,
"type": "collision"
},
{
"id": 13,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 1,
"ends_at": 1,
"type": "collision"
},
{
"id": 14,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 15,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 16,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 17,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 18,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 19,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 2,
"ends_at": 11,
"type": "contact"
},
{
"id": 20,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 2,
"ends_at": 23,
"type": "contact"
},
{
"id": 21,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 3,
"ends_at": 4,
"type": "collision"
},
{
"id": 22,
"inputs": [
6,
8
],
"outputs": [
6,
8
],
"begins_at": 3,
"ends_at": 4,
"type": "collision"
},
{
"id": 23,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 3,
"ends_at": 4,
"type": "contact"
},
{
"id": 24,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 25,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 26,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 27,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 28,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 29,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 5,
"ends_at": 7,
"type": "contact"
},
{
"id": 30,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 31,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 32,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 6,
"ends_at": 23,
"type": "contact"
},
{
"id": 33,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 34,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 35,
"inputs": [
5,
6
],
"outputs": [
5,
6
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 36,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 37,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 38,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 7,
"ends_at": 9,
"type": "contact"
},
{
"id": 39,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 7,
"ends_at": 13,
"type": "contact"
},
{
"id": 40,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 41,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 8,
"ends_at": 9,
"type": "contact"
},
{
"id": 42,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 43,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 44,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 9,
"ends_at": 10,
"type": "collision"
},
{
"id": 45,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 9,
"ends_at": 10,
"type": "collision"
},
{
"id": 46,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 47,
"inputs": [
8,
10
],
"outputs": [
8,
10
],
"begins_at": 10,
"ends_at": 11,
"type": "collision"
},
{
"id": 48,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 10,
"ends_at": 11,
"type": "collision"
},
{
"id": 49,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 50,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 51,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 52,
"inputs": [
1,
6
],
"outputs": [
1,
6
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 53,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 54,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 55,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 12,
"ends_at": 13,
"type": "collision"
},
{
"id": 56,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 12,
"ends_at": 13,
"type": "contact"
},
{
"id": 57,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 58,
"inputs": [
1,
6
],
"outputs": [
1,
6
],
"begins_at": 13,
"ends_at": 14,
"type": "contact"
},
{
"id": 59,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 13,
"ends_at": 14,
"type": "contact"
},
{
"id": 60,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 13,
"ends_at": 19,
"type": "contact"
},
{
"id": 61,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 62,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 63,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 64,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 15,
"ends_at": 16,
"type": "collision"
},
{
"id": 65,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 15,
"ends_at": 21,
"type": "contact"
},
{
"id": 66,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 67,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 68,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 16,
"ends_at": 17,
"type": "collision"
},
{
"id": 69,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 16,
"ends_at": 20,
"type": "contact"
},
{
"id": 70,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 71,
"inputs": [
3
],
"outputs": [
3
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 72,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 73,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 74,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 75,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 76,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 77,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 78,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 21,
"ends_at": 22,
"type": "collision"
},
{
"id": 79,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 21,
"ends_at": 22,
"type": "contact"
},
{
"id": 80,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 81,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 82,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 83,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
},
{
"id": 84,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "contact"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 1.0,
"avg_image_position_segmentation_acc_small": 1.0,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 1.0,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": 1.0,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 1.0,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 1.0,
"num_matches": 11,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.582370528022702,
"avg_interaction_input_object_jaccard": 0.20512820512820512,
"avg_interaction_output_object_jaccard": 0.20512820512820512,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 26,
"num_unmatched_pred_interactions": 59,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 19,
"false_positives": 66,
"false_negatives": 0
},
"0.5": {
"true_positives": 17,
"false_positives": 68,
"false_negatives": 0
},
"0.75": {
"true_positives": 11,
"false_positives": 74,
"false_negatives": 0
},
"1.0": {
"true_positives": 7,
"false_positives": 78,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.2235294117647059,
"0.5": 0.2,
"0.75": 0.12941176470588237,
"1.0": 0.08235294117647059
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.36538461538461536,
"0.5": 0.33333333333333337,
"0.75": 0.22916666666666669,
"1.0": 0.15217391304347827
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 15,
"false_positives": 70,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 83,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 85,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 85,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.17647058823529413,
"0.5": 0.023529411764705882,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.3,
"0.5": 0.04597701149425288,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 15,
"false_positives": 70,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 83,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 85,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 85,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.17647058823529413,
"0.5": 0.023529411764705882,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.3,
"0.5": 0.04597701149425288,
"0.75": 0.0,
"1.0": 0.0
}
}
}Prompt
Growing GT object-track prefill
At prefix step t, B3 saw frames 0..t and an assistant prefill containing GT object tracks only through t. The prefills are deterministically reconstructed with the exact oracle helper; only the final full-clip generation was persisted by inference.
Every persisted/reconstructed prefill step
[
{
"frame_index": 0,
"frames_visible": "0..0",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 1 [PX] 0 298 318 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 1 [PX] 0 333 587 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 1 [PX] 0 380 970 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 1 [PX] 0 388 306 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 1 [PX] 0 423 509 [OBJ] 5 \"magenta suede pump\" 0 1 [PX] 0 505 494 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 1 [PX] 0 642 146 [OBJ] 7 \"grey and orange athletic shoe\" 0 1 [PX] 0 646 298 [OBJ] 8 \"white cardboard moisturizer box\" 0 1 [PX] 0 837 525 [OBJ] 9 \"blue high-top sneaker\" 0 1 [PX] 0 919 384 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 1 [PX] 0 947 333 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 1,
"frames_visible": "0..1",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 2 [PX] 0 298 318 1 330 314 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 2 [PX] 0 333 587 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 2 [PX] 0 380 970 1 392 974 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 2 [PX] 0 388 306 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 2 [PX] 0 423 509 1 419 427 [OBJ] 5 \"magenta suede pump\" 0 2 [PX] 0 505 494 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 2 [PX] 0 642 146 1 623 158 [OBJ] 7 \"grey and orange athletic shoe\" 0 2 [PX] 0 646 298 1 null null [OBJ] 8 \"white cardboard moisturizer box\" 0 2 [PX] 0 837 525 [OBJ] 9 \"blue high-top sneaker\" 0 2 [PX] 0 919 384 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 2 [PX] 0 947 333 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 2,
"frames_visible": "0..2",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 3 [PX] 0 298 318 1 330 314 2 294 318 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 3 [PX] 0 333 587 2 349 583 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 3 [PX] 0 380 970 1 392 974 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 3 [PX] 0 388 306 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 3 [PX] 0 423 509 1 419 427 2 400 408 [OBJ] 5 \"magenta suede pump\" 0 3 [PX] 0 505 494 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 3 [PX] 0 642 146 1 623 158 2 623 212 [OBJ] 7 \"grey and orange athletic shoe\" 0 3 [PX] 0 646 298 1 null null 2 783 306 [OBJ] 8 \"white cardboard moisturizer box\" 0 3 [PX] 0 837 525 2 818 529 [OBJ] 9 \"blue high-top sneaker\" 0 3 [PX] 0 919 384 2 908 388 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 3 [PX] 0 947 333 2 947 353 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 3,
"frames_visible": "0..3",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 4 [PX] 0 298 318 1 330 314 2 294 318 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 4 [PX] 0 333 587 2 349 583 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 4 [PX] 0 380 970 1 392 974 3 404 978 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 4 [PX] 0 388 306 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 4 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 [OBJ] 5 \"magenta suede pump\" 0 4 [PX] 0 505 494 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 4 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 [OBJ] 7 \"grey and orange athletic shoe\" 0 4 [PX] 0 646 298 1 null null 2 783 306 3 771 318 [OBJ] 8 \"white cardboard moisturizer box\" 0 4 [PX] 0 837 525 2 818 529 3 845 521 [OBJ] 9 \"blue high-top sneaker\" 0 4 [PX] 0 919 384 2 908 388 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 4 [PX] 0 947 333 2 947 353 3 943 361 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 4,
"frames_visible": "0..4",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 5 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 5 [PX] 0 333 587 2 349 583 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 5 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 5 [PX] 0 388 306 4 380 302 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 5 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 [OBJ] 5 \"magenta suede pump\" 0 5 [PX] 0 505 494 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 5 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 [OBJ] 7 \"grey and orange athletic shoe\" 0 5 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 [OBJ] 8 \"white cardboard moisturizer box\" 0 5 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 [OBJ] 9 \"blue high-top sneaker\" 0 5 [PX] 0 919 384 2 908 388 4 null null [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 5 [PX] 0 947 333 2 947 353 3 943 361 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 5,
"frames_visible": "0..5",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 6 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 6 [PX] 0 333 587 2 349 583 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 6 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 6 [PX] 0 388 306 4 380 302 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 6 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 [OBJ] 5 \"magenta suede pump\" 0 6 [PX] 0 505 494 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 6 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 [OBJ] 7 \"grey and orange athletic shoe\" 0 6 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 [OBJ] 8 \"white cardboard moisturizer box\" 0 6 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 [OBJ] 9 \"blue high-top sneaker\" 0 6 [PX] 0 919 384 2 908 388 4 null null [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 6 [PX] 0 947 333 2 947 353 3 943 361 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 6,
"frames_visible": "0..6",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 7 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 7 [PX] 0 333 587 2 349 583 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 7 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 7 [PX] 0 388 306 4 380 302 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 7 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 [OBJ] 5 \"magenta suede pump\" 0 7 [PX] 0 505 494 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 7 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 [OBJ] 7 \"grey and orange athletic shoe\" 0 7 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 [OBJ] 8 \"white cardboard moisturizer box\" 0 7 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 [OBJ] 9 \"blue high-top sneaker\" 0 7 [PX] 0 919 384 2 908 388 4 null null [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 7 [PX] 0 947 333 2 947 353 3 943 361 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 7,
"frames_visible": "0..7",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 8 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 8 [PX] 0 333 587 2 349 583 7 353 591 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 8 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 8 [PX] 0 388 306 4 380 302 7 373 298 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 8 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 [OBJ] 5 \"magenta suede pump\" 0 8 [PX] 0 505 494 7 490 505 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 8 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 [OBJ] 7 \"grey and orange athletic shoe\" 0 8 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 [OBJ] 8 \"white cardboard moisturizer box\" 0 8 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 [OBJ] 9 \"blue high-top sneaker\" 0 8 [PX] 0 919 384 2 908 388 4 null null [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 8 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 8,
"frames_visible": "0..8",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 9 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 9 [PX] 0 333 587 2 349 583 7 353 591 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 9 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 9 [PX] 0 388 306 4 380 302 7 373 298 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 9 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 [OBJ] 5 \"magenta suede pump\" 0 9 [PX] 0 505 494 7 490 505 8 null null [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 9 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 [OBJ] 7 \"grey and orange athletic shoe\" 0 9 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 [OBJ] 8 \"white cardboard moisturizer box\" 0 9 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 [OBJ] 9 \"blue high-top sneaker\" 0 9 [PX] 0 919 384 2 908 388 4 null null 8 931 345 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 9 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 9,
"frames_visible": "0..9",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 10 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 10 [PX] 0 333 587 2 349 583 7 353 591 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 10 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 10 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 10 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 [OBJ] 5 \"magenta suede pump\" 0 10 [PX] 0 505 494 7 490 505 8 null null 9 513 490 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 10 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 [OBJ] 7 \"grey and orange athletic shoe\" 0 10 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 [OBJ] 8 \"white cardboard moisturizer box\" 0 10 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 [OBJ] 9 \"blue high-top sneaker\" 0 10 [PX] 0 919 384 2 908 388 4 null null 8 931 345 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 10 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 10,
"frames_visible": "0..10",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 11 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 11 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 11 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 11 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 11 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 [OBJ] 5 \"magenta suede pump\" 0 11 [PX] 0 505 494 7 490 505 8 null null 9 513 490 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 11 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 [OBJ] 7 \"grey and orange athletic shoe\" 0 11 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 [OBJ] 8 \"white cardboard moisturizer box\" 0 11 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 [OBJ] 9 \"blue high-top sneaker\" 0 11 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 11 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 11,
"frames_visible": "0..11",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 12 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 12 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 12 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 12 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 12 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 [OBJ] 5 \"magenta suede pump\" 0 12 [PX] 0 505 494 7 490 505 8 null null 9 513 490 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 12 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 [OBJ] 7 \"grey and orange athletic shoe\" 0 12 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 [OBJ] 8 \"white cardboard moisturizer box\" 0 12 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 [OBJ] 9 \"blue high-top sneaker\" 0 12 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 12 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 12,
"frames_visible": "0..12",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 13 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 13 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 13 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 13 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 13 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 [OBJ] 5 \"magenta suede pump\" 0 13 [PX] 0 505 494 7 490 505 8 null null 9 513 490 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 13 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 [OBJ] 7 \"grey and orange athletic shoe\" 0 13 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 [OBJ] 8 \"white cardboard moisturizer box\" 0 13 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 [OBJ] 9 \"blue high-top sneaker\" 0 13 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 13 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 13,
"frames_visible": "0..13",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 14 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 14 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 14 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 14 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 14 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 [OBJ] 5 \"magenta suede pump\" 0 14 [PX] 0 505 494 7 490 505 8 null null 9 513 490 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 14 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 [OBJ] 7 \"grey and orange athletic shoe\" 0 14 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 [OBJ] 8 \"white cardboard moisturizer box\" 0 14 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 [OBJ] 9 \"blue high-top sneaker\" 0 14 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 14 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 14,
"frames_visible": "0..14",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 15 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 14 251 271 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 15 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 14 357 583 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 15 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 15 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 15 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 14 201 326 [OBJ] 5 \"magenta suede pump\" 0 15 [PX] 0 505 494 7 490 505 8 null null 9 513 490 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 15 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 14 505 775 [OBJ] 7 \"grey and orange athletic shoe\" 0 15 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 [OBJ] 8 \"white cardboard moisturizer box\" 0 15 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 [OBJ] 9 \"blue high-top sneaker\" 0 15 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 15 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 14 939 451 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 15,
"frames_visible": "0..15",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 16 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 14 251 271 15 232 263 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 16 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 14 357 583 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 16 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 16 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 15 353 255 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 16 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 14 201 326 15 189 314 [OBJ] 5 \"magenta suede pump\" 0 16 [PX] 0 505 494 7 490 505 8 null null 9 513 490 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 16 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 14 505 775 15 521 818 [OBJ] 7 \"grey and orange athletic shoe\" 0 16 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 15 701 271 [OBJ] 8 \"white cardboard moisturizer box\" 0 16 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 15 744 498 [OBJ] 9 \"blue high-top sneaker\" 0 16 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 16 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 14 939 451 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 16,
"frames_visible": "0..16",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 17 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 14 251 271 15 232 263 16 228 244 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 17 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 14 357 583 16 361 591 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 17 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 17 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 15 353 255 16 361 244 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 17 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 14 201 326 15 189 314 16 173 306 [OBJ] 5 \"magenta suede pump\" 0 17 [PX] 0 505 494 7 490 505 8 null null 9 513 490 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 17 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 14 505 775 15 521 818 16 521 845 [OBJ] 7 \"grey and orange athletic shoe\" 0 17 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 15 701 271 [OBJ] 8 \"white cardboard moisturizer box\" 0 17 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 15 744 498 16 740 513 [OBJ] 9 \"blue high-top sneaker\" 0 17 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 16 916 341 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 17 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 14 939 451 16 931 447 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 17,
"frames_visible": "0..17",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 18 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 14 251 271 15 232 263 16 228 244 17 208 236 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 18 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 14 357 583 16 361 591 17 357 599 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 18 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 18 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 15 353 255 16 361 244 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 18 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 14 201 326 15 189 314 16 173 306 17 154 306 [OBJ] 5 \"magenta suede pump\" 0 18 [PX] 0 505 494 7 490 505 8 null null 9 513 490 17 521 486 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 18 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 14 505 775 15 521 818 16 521 845 17 505 853 [OBJ] 7 \"grey and orange athletic shoe\" 0 18 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 15 701 271 [OBJ] 8 \"white cardboard moisturizer box\" 0 18 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 15 744 498 16 740 513 17 748 498 [OBJ] 9 \"blue high-top sneaker\" 0 18 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 16 916 341 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 18 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 14 939 451 16 931 447 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 18,
"frames_visible": "0..18",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 19 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 14 251 271 15 232 263 16 228 244 17 208 236 18 201 244 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 19 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 14 357 583 16 361 591 17 357 599 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 19 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 19 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 15 353 255 16 361 244 18 369 232 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 19 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 14 201 326 15 189 314 16 173 306 17 154 306 18 138 298 [OBJ] 5 \"magenta suede pump\" 0 19 [PX] 0 505 494 7 490 505 8 null null 9 513 490 17 521 486 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 19 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 14 505 775 15 521 818 16 521 845 17 505 853 18 513 884 [OBJ] 7 \"grey and orange athletic shoe\" 0 19 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 15 701 271 18 693 263 [OBJ] 8 \"white cardboard moisturizer box\" 0 19 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 15 744 498 16 740 513 17 748 498 18 744 505 [OBJ] 9 \"blue high-top sneaker\" 0 19 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 16 916 341 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 19 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 14 939 451 16 931 447 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 19,
"frames_visible": "0..19",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 20 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 14 251 271 15 232 263 16 228 244 17 208 236 18 201 244 19 197 216 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 20 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 14 357 583 16 361 591 17 357 599 19 361 611 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 20 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 20 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 15 353 255 16 361 244 18 369 232 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 20 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 14 201 326 15 189 314 16 173 306 17 154 306 18 138 298 19 126 291 [OBJ] 5 \"magenta suede pump\" 0 20 [PX] 0 505 494 7 490 505 8 null null 9 513 490 17 521 486 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 20 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 14 505 775 15 521 818 16 521 845 17 505 853 18 513 884 19 490 880 [OBJ] 7 \"grey and orange athletic shoe\" 0 20 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 15 701 271 18 693 263 [OBJ] 8 \"white cardboard moisturizer box\" 0 20 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 15 744 498 16 740 513 17 748 498 18 744 505 19 740 525 [OBJ] 9 \"blue high-top sneaker\" 0 20 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 16 916 341 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 20 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 14 939 451 16 931 447 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 20,
"frames_visible": "0..20",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 21 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 14 251 271 15 232 263 16 228 244 17 208 236 18 201 244 19 197 216 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 21 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 14 357 583 16 361 591 17 357 599 19 361 611 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 21 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 21 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 15 353 255 16 361 244 18 369 232 20 369 220 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 21 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 14 201 326 15 189 314 16 173 306 17 154 306 18 138 298 19 126 291 20 111 287 [OBJ] 5 \"magenta suede pump\" 0 21 [PX] 0 505 494 7 490 505 8 null null 9 513 490 17 521 486 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 21 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 14 505 775 15 521 818 16 521 845 17 505 853 18 513 884 19 490 880 20 482 888 [OBJ] 7 \"grey and orange athletic shoe\" 0 21 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 15 701 271 18 693 263 [OBJ] 8 \"white cardboard moisturizer box\" 0 21 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 15 744 498 16 740 513 17 748 498 18 744 505 19 740 525 20 740 548 [OBJ] 9 \"blue high-top sneaker\" 0 21 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 16 916 341 20 904 333 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 21 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 14 939 451 16 931 447 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 21,
"frames_visible": "0..21",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 22 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 14 251 271 15 232 263 16 228 244 17 208 236 18 201 244 19 197 216 21 162 193 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 22 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 14 357 583 16 361 591 17 357 599 19 361 611 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 22 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 22 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 15 353 255 16 361 244 18 369 232 20 369 220 21 333 220 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 22 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 14 201 326 15 189 314 16 173 306 17 154 306 18 138 298 19 126 291 20 111 287 21 95 283 [OBJ] 5 \"magenta suede pump\" 0 22 [PX] 0 505 494 7 490 505 8 null null 9 513 490 17 521 486 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 22 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 14 505 775 15 521 818 16 521 845 17 505 853 18 513 884 19 490 880 20 482 888 21 458 876 [OBJ] 7 \"grey and orange athletic shoe\" 0 22 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 15 701 271 18 693 263 21 685 255 [OBJ] 8 \"white cardboard moisturizer box\" 0 22 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 15 744 498 16 740 513 17 748 498 18 744 505 19 740 525 20 740 548 [OBJ] 9 \"blue high-top sneaker\" 0 22 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 16 916 341 20 904 333 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 22 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 14 939 451 16 931 447 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 22,
"frames_visible": "0..22",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 23 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 14 251 271 15 232 263 16 228 244 17 208 236 18 201 244 19 197 216 21 162 193 22 154 181 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 23 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 14 357 583 16 361 591 17 357 599 19 361 611 22 365 619 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 23 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 23 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 15 353 255 16 361 244 18 369 232 20 369 220 21 333 220 22 330 212 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 23 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 14 201 326 15 189 314 16 173 306 17 154 306 18 138 298 19 126 291 20 111 287 21 95 283 22 80 279 [OBJ] 5 \"magenta suede pump\" 0 23 [PX] 0 505 494 7 490 505 8 null null 9 513 490 17 521 486 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 23 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 14 505 775 15 521 818 16 521 845 17 505 853 18 513 884 19 490 880 20 482 888 21 458 876 22 412 833 [OBJ] 7 \"grey and orange athletic shoe\" 0 23 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 15 701 271 18 693 263 21 685 255 [OBJ] 8 \"white cardboard moisturizer box\" 0 23 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 15 744 498 16 740 513 17 748 498 18 744 505 19 740 525 20 740 548 22 748 564 [OBJ] 9 \"blue high-top sneaker\" 0 23 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 16 916 341 20 904 333 22 900 326 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 23 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 14 939 451 16 931 447 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 23,
"frames_visible": "0..23",
"provenance": "exact persisted final-step prefill and generation",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 24 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 14 251 271 15 232 263 16 228 244 17 208 236 18 201 244 19 197 216 21 162 193 22 154 181 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 24 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 14 357 583 16 361 591 17 357 599 19 361 611 22 365 619 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 24 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 24 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 15 353 255 16 361 244 18 369 232 20 369 220 21 333 220 22 330 212 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 24 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 14 201 326 15 189 314 16 173 306 17 154 306 18 138 298 19 126 291 20 111 287 21 95 283 22 80 279 23 68 275 [OBJ] 5 \"magenta suede pump\" 0 24 [PX] 0 505 494 7 490 505 8 null null 9 513 490 17 521 486 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 24 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 14 505 775 15 521 818 16 521 845 17 505 853 18 513 884 19 490 880 20 482 888 21 458 876 22 412 833 23 455 896 [OBJ] 7 \"grey and orange athletic shoe\" 0 24 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 15 701 271 18 693 263 21 685 255 [OBJ] 8 \"white cardboard moisturizer box\" 0 24 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 15 744 498 16 740 513 17 748 498 18 744 505 19 740 525 20 740 548 22 748 564 [OBJ] 9 \"blue high-top sneaker\" 0 24 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 16 916 341 20 904 333 22 900 326 23 892 322 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 24 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 14 939 451 16 931 447 23 931 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 8 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 20 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 21 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 21 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 21 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 21 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 21 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 21 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"collision\" 22 22 [IN] 1 65535 [OUT] 1 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 24 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 14 251 271 15 232 263 16 228 244 17 208 236 18 201 244 19 197 216 21 162 193 22 154 181 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 24 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 14 357 583 16 361 591 17 357 599 19 361 611 22 365 619 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 24 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 24 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 15 353 255 16 361 244 18 369 232 20 369 220 21 333 220 22 330 212 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 24 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 14 201 326 15 189 314 16 173 306 17 154 306 18 138 298 19 126 291 20 111 287 21 95 283 22 80 279 23 68 275 [OBJ] 5 \"magenta suede pump\" 0 24 [PX] 0 505 494 7 490 505 8 null null 9 513 490 17 521 486 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 24 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 14 505 775 15 521 818 16 521 845 17 505 853 18 513 884 19 490 880 20 482 888 21 458 876 22 412 833 23 455 896 [OBJ] 7 \"grey and orange athletic shoe\" 0 24 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 15 701 271 18 693 263 21 685 255 [OBJ] 8 \"white cardboard moisturizer box\" 0 24 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 15 744 498 16 740 513 17 748 498 18 744 505 19 740 525 20 740 548 22 748 564 [OBJ] 9 \"blue high-top sneaker\" 0 24 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 16 916 341 20 904 333 22 900 326 23 892 322 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 24 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 14 939 451 16 931 447 23 931 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 8 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 20 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 21 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 21 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 21 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 21 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 21 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 21 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"collision\" 22 22 [IN] 1 65535 [OUT] 1 65535 [INTERACTIONS-END] [SCENE-END]",
"intermediate_prediction_persisted": true
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "multicolored wooden stacking toy" 0 24 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 14 251 271 15 232 263 16 228 244 17 208 236 18 201 244 19 197 216 21 162 193 22 154 181 [OBJ] 1 "black and yellow cardboard motherboard box" 0 24 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 14 357 583 16 361 591 17 357 599 19 361 611 22 365 619 [OBJ] 2 "white plastic lutein supplement bottle" 0 24 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 "Colorful wooden geometric sorting board" 0 24 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 15 353 255 16 361 244 18 369 232 20 369 220 21 333 220 22 330 212 [OBJ] 4 "white cardboard box of diaper pail refill bags" 0 24 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 14 201 326 15 189 314 16 173 306 17 154 306 18 138 298 19 126 291 20 111 287 21 95 283 22 80 279 23 68 275 [OBJ] 5 "magenta suede pump" 0 24 [PX] 0 505 494 7 490 505 8 null null 9 513 490 17 521 486 [OBJ] 6 "peach and blue cardboard 12-pack of soda cans" 0 24 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 14 505 775 15 521 818 16 521 845 17 505 853 18 513 884 19 490 880 20 482 888 21 458 876 22 412 833 23 455 896 [OBJ] 7 "grey and orange athletic shoe" 0 24 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 15 701 271 18 693 263 21 685 255 [OBJ] 8 "white cardboard moisturizer box" 0 24 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 15 744 498 16 740 513 17 748 498 18 744 505 19 740 525 20 740 548 22 748 564 [OBJ] 9 "blue high-top sneaker" 0 24 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 16 916 341 20 904 333 22 900 326 23 892 322 [OBJ] 10 "multicolored cardboard Scrabble game" 0 24 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 14 939 451 16 931 447 23 931 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 "contact" 0 8 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 "contact" 0 20 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 "contact" 0 21 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 "contact" 0 21 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 "contact" 0 21 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 "contact" 0 21 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 "contact" 0 21 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 "contact" 0 21 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 "collision" 22 22 [IN] 1 65535 [OUT] 1 65535 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 298,
"y": 318
},
{
"t": 1,
"x": 330,
"y": 314
},
{
"t": 2,
"x": 294,
"y": 318
},
{
"t": 4,
"x": 322,
"y": 310
},
{
"t": 5,
"x": 287,
"y": 310
},
{
"t": 6,
"x": 244,
"y": 341
},
{
"t": 7,
"x": 283,
"y": 310
},
{
"t": 9,
"x": 310,
"y": 306
},
{
"t": 10,
"x": 302,
"y": 302
},
{
"t": 12,
"x": 263,
"y": 283
},
{
"t": 13,
"x": 255,
"y": 279
},
{
"t": 14,
"x": 251,
"y": 271
},
{
"t": 15,
"x": 232,
"y": 263
},
{
"t": 16,
"x": 228,
"y": 244
},
{
"t": 17,
"x": 208,
"y": 236
},
{
"t": 18,
"x": 201,
"y": 244
},
{
"t": 19,
"x": 197,
"y": 216
},
{
"t": 21,
"x": 162,
"y": 193
},
{
"t": 22,
"x": 154,
"y": 181
}
],
"birth": 0,
"death": 24,
"type": "multicolored wooden stacking toy"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 333,
"y": 587
},
{
"t": 2,
"x": 349,
"y": 583
},
{
"t": 7,
"x": 353,
"y": 591
},
{
"t": 10,
"x": 330,
"y": 607
},
{
"t": 12,
"x": 322,
"y": 603
},
{
"t": 13,
"x": 314,
"y": 611
},
{
"t": 14,
"x": 357,
"y": 583
},
{
"t": 16,
"x": 361,
"y": 591
},
{
"t": 17,
"x": 357,
"y": 599
},
{
"t": 19,
"x": 361,
"y": 611
},
{
"t": 22,
"x": 365,
"y": 619
}
],
"birth": 0,
"death": 24,
"type": "black and yellow cardboard motherboard box"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 380,
"y": 970
},
{
"t": 1,
"x": 392,
"y": 974
},
{
"t": 3,
"x": 404,
"y": 978
},
{
"t": 4,
"x": 416,
"y": 982
},
{
"t": 6,
"x": 423,
"y": 986
},
{
"t": 7,
"x": 431,
"y": 990
},
{
"t": 8,
"x": 443,
"y": 990
},
{
"t": 9,
"x": 451,
"y": 994
},
{
"t": 11,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "white plastic lutein supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 388,
"y": 306
},
{
"t": 4,
"x": 380,
"y": 302
},
{
"t": 7,
"x": 373,
"y": 298
},
{
"t": 9,
"x": 365,
"y": 294
},
{
"t": 11,
"x": 373,
"y": 283
},
{
"t": 12,
"x": 337,
"y": 271
},
{
"t": 13,
"x": 341,
"y": 263
},
{
"t": 15,
"x": 353,
"y": 255
},
{
"t": 16,
"x": 361,
"y": 244
},
{
"t": 18,
"x": 369,
"y": 232
},
{
"t": 20,
"x": 369,
"y": 220
},
{
"t": 21,
"x": 333,
"y": 220
},
{
"t": 22,
"x": 330,
"y": 212
}
],
"birth": 0,
"death": 24,
"type": "Colorful wooden geometric sorting board"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 423,
"y": 509
},
{
"t": 1,
"x": 419,
"y": 427
},
{
"t": 2,
"x": 400,
"y": 408
},
{
"t": 3,
"x": 384,
"y": 400
},
{
"t": 4,
"x": 369,
"y": 396
},
{
"t": 5,
"x": 357,
"y": 400
},
{
"t": 6,
"x": 341,
"y": 416
},
{
"t": 7,
"x": 318,
"y": 443
},
{
"t": 8,
"x": 318,
"y": 392
},
{
"t": 9,
"x": 291,
"y": 369
},
{
"t": 10,
"x": 275,
"y": 345
},
{
"t": 11,
"x": 259,
"y": 322
},
{
"t": 12,
"x": 236,
"y": 333
},
{
"t": 13,
"x": 216,
"y": 330
},
{
"t": 14,
"x": 201,
"y": 326
},
{
"t": 15,
"x": 189,
"y": 314
},
{
"t": 16,
"x": 173,
"y": 306
},
{
"t": 17,
"x": 154,
"y": 306
},
{
"t": 18,
"x": 138,
"y": 298
},
{
"t": 19,
"x": 126,
"y": 291
},
{
"t": 20,
"x": 111,
"y": 287
},
{
"t": 21,
"x": 95,
"y": 283
},
{
"t": 22,
"x": 80,
"y": 279
},
{
"t": 23,
"x": 68,
"y": 275
}
],
"birth": 0,
"death": 24,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 505,
"y": 494
},
{
"t": 7,
"x": 490,
"y": 505
},
{
"t": 8,
"x": null,
"y": null
},
{
"t": 9,
"x": 513,
"y": 490
},
{
"t": 17,
"x": 521,
"y": 486
}
],
"birth": 0,
"death": 24,
"type": "magenta suede pump"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 642,
"y": 146
},
{
"t": 1,
"x": 623,
"y": 158
},
{
"t": 2,
"x": 623,
"y": 212
},
{
"t": 3,
"x": 673,
"y": 353
},
{
"t": 4,
"x": 576,
"y": 271
},
{
"t": 5,
"x": 572,
"y": 337
},
{
"t": 6,
"x": 611,
"y": 451
},
{
"t": 7,
"x": 646,
"y": 548
},
{
"t": 8,
"x": 583,
"y": 568
},
{
"t": 9,
"x": 607,
"y": 666
},
{
"t": 10,
"x": 537,
"y": 673
},
{
"t": 11,
"x": 548,
"y": 708
},
{
"t": 12,
"x": 537,
"y": 728
},
{
"t": 13,
"x": 521,
"y": 751
},
{
"t": 14,
"x": 505,
"y": 775
},
{
"t": 15,
"x": 521,
"y": 818
},
{
"t": 16,
"x": 521,
"y": 845
},
{
"t": 17,
"x": 505,
"y": 853
},
{
"t": 18,
"x": 513,
"y": 884
},
{
"t": 19,
"x": 490,
"y": 880
},
{
"t": 20,
"x": 482,
"y": 888
},
{
"t": 21,
"x": 458,
"y": 876
},
{
"t": 22,
"x": 412,
"y": 833
},
{
"t": 23,
"x": 455,
"y": 896
}
],
"birth": 0,
"death": 24,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 298
},
{
"t": 1,
"x": null,
"y": null
},
{
"t": 2,
"x": 783,
"y": 306
},
{
"t": 3,
"x": 771,
"y": 318
},
{
"t": 4,
"x": 724,
"y": 298
},
{
"t": 7,
"x": 716,
"y": 291
},
{
"t": 9,
"x": 708,
"y": 283
},
{
"t": 10,
"x": 716,
"y": 287
},
{
"t": 12,
"x": 708,
"y": 279
},
{
"t": 15,
"x": 701,
"y": 271
},
{
"t": 18,
"x": 693,
"y": 263
},
{
"t": 21,
"x": 685,
"y": 255
}
],
"birth": 0,
"death": 24,
"type": "grey and orange athletic shoe"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 837,
"y": 525
},
{
"t": 2,
"x": 818,
"y": 529
},
{
"t": 3,
"x": 845,
"y": 521
},
{
"t": 4,
"x": 873,
"y": 501
},
{
"t": 6,
"x": 845,
"y": 458
},
{
"t": 7,
"x": 814,
"y": 474
},
{
"t": 8,
"x": 794,
"y": 490
},
{
"t": 9,
"x": 783,
"y": 490
},
{
"t": 10,
"x": 775,
"y": 494
},
{
"t": 11,
"x": 767,
"y": 501
},
{
"t": 12,
"x": 755,
"y": 517
},
{
"t": 13,
"x": 751,
"y": 501
},
{
"t": 15,
"x": 744,
"y": 498
},
{
"t": 16,
"x": 740,
"y": 513
},
{
"t": 17,
"x": 748,
"y": 498
},
{
"t": 18,
"x": 744,
"y": 505
},
{
"t": 19,
"x": 740,
"y": 525
},
{
"t": 20,
"x": 740,
"y": 548
},
{
"t": 22,
"x": 748,
"y": 564
}
],
"birth": 0,
"death": 24,
"type": "white cardboard moisturizer box"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 384
},
{
"t": 2,
"x": 908,
"y": 388
},
{
"t": 4,
"x": null,
"y": null
},
{
"t": 8,
"x": 931,
"y": 345
},
{
"t": 10,
"x": 927,
"y": 357
},
{
"t": 11,
"x": 935,
"y": 349
},
{
"t": 13,
"x": 923,
"y": 349
},
{
"t": 16,
"x": 916,
"y": 341
},
{
"t": 20,
"x": 904,
"y": 333
},
{
"t": 22,
"x": 900,
"y": 326
},
{
"t": 23,
"x": 892,
"y": 322
}
],
"birth": 0,
"death": 24,
"type": "blue high-top sneaker"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 947,
"y": 333
},
{
"t": 2,
"x": 947,
"y": 353
},
{
"t": 3,
"x": 943,
"y": 361
},
{
"t": 7,
"x": 943,
"y": 373
},
{
"t": 8,
"x": 958,
"y": 392
},
{
"t": 9,
"x": 962,
"y": 400
},
{
"t": 10,
"x": 958,
"y": 482
},
{
"t": 11,
"x": 951,
"y": 486
},
{
"t": 13,
"x": 939,
"y": 474
},
{
"t": 14,
"x": 939,
"y": 451
},
{
"t": 16,
"x": 931,
"y": 447
},
{
"t": 23,
"x": 931,
"y": 462
}
],
"birth": 0,
"death": 24,
"type": "multicolored cardboard Scrabble game"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 20,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 21,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 21,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 21,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 21,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 21,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 21,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 1.0,
"avg_image_position_segmentation_acc_small": 1.0,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 1.0,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": 1.0,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 1.0,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 1.0,
"num_matches": 11,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.7666337285902504,
"avg_interaction_input_object_jaccard": 0.25925925925925924,
"avg_interaction_output_object_jaccard": 0.25925925925925924,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 9,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 17,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 8,
"false_positives": 1,
"false_negatives": 17
},
"0.5": {
"true_positives": 8,
"false_positives": 1,
"false_negatives": 17
},
"0.75": {
"true_positives": 8,
"false_positives": 1,
"false_negatives": 17
},
"1.0": {
"true_positives": 0,
"false_positives": 9,
"false_negatives": 17
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.8888888888888888,
"0.5": 0.8888888888888888,
"0.75": 0.8888888888888888,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.32,
"0.5": 0.32,
"0.75": 0.32,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.47058823529411764,
"0.5": 0.47058823529411764,
"0.75": 0.47058823529411764,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 7,
"false_positives": 2,
"false_negatives": 17
},
"0.5": {
"true_positives": 0,
"false_positives": 9,
"false_negatives": 17
},
"0.75": {
"true_positives": 0,
"false_positives": 9,
"false_negatives": 17
},
"1.0": {
"true_positives": 0,
"false_positives": 9,
"false_negatives": 17
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.7777777777777778,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.2916666666666667,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.42424242424242425,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 7,
"false_positives": 2,
"false_negatives": 17
},
"0.5": {
"true_positives": 0,
"false_positives": 9,
"false_negatives": 17
},
"0.75": {
"true_positives": 0,
"false_positives": 9,
"false_negatives": 17
},
"1.0": {
"true_positives": 0,
"false_positives": 9,
"false_negatives": 17
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.7777777777777778,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.2916666666666667,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.42424242424242425,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
}Prompt
<video> Analyze the provided video and return ONLY a valid sentinel sequence in this format: [SCENE-START] [OBJS-START] [OBJ] id "type" birth death [PX] t px py ... [OBJ] ... [OBJS-END] [INTERACTIONS-START] [INTERACT] id "type" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ... [INTERACT] ... [INTERACTIONS-END] [SCENE-END] Constraints: - Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose). - Keep tags exactly as written: `[SCENE-START] [OBJS-START] [OBJ] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]` - Use quoted strings for `type` (double quotes). - `PX` uses repeated groups of 3 values in order: `t px py`. - `t` is the timestamp (frame number). - `px` and `py` are the pixel coordinates of the object in that frame, normalized to [0,1] relative to the frame dimensions, scaled by 1000 and rounded to the nearest integer. For example, `px` of 0.1234 would be represented as 123. - When an object is occluded or not visible in a frame, `PX` may use `t null null`. - `IN` and `OUT` contain whitespace-separated integer ids.
One full-clip GT object prefill
The E2E model saw all 24 frames once. Its assistant text was the exact GT object section through [INTERACTIONS-START], and the model generated only the interaction suffix shown here.
Every persisted/reconstructed prefill step
[
{
"frame_index": 23,
"frames_visible": "0..23",
"provenance": "exact persisted full-clip prefill and generation",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 24 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 14 251 271 15 232 263 16 228 244 17 208 236 18 201 244 19 197 216 21 162 193 22 154 181 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 24 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 14 357 583 16 361 591 17 357 599 19 361 611 22 365 619 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 24 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 24 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 15 353 255 16 361 244 18 369 232 20 369 220 21 333 220 22 330 212 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 24 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 14 201 326 15 189 314 16 173 306 17 154 306 18 138 298 19 126 291 20 111 287 21 95 283 22 80 279 23 68 275 [OBJ] 5 \"magenta suede pump\" 0 24 [PX] 0 505 494 7 490 505 8 null null 9 513 490 17 521 486 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 24 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 14 505 775 15 521 818 16 521 845 17 505 853 18 513 884 19 490 880 20 482 888 21 458 876 22 412 833 23 455 896 [OBJ] 7 \"grey and orange athletic shoe\" 0 24 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 15 701 271 18 693 263 21 685 255 [OBJ] 8 \"white cardboard moisturizer box\" 0 24 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 15 744 498 16 740 513 17 748 498 18 744 505 19 740 525 20 740 548 22 748 564 [OBJ] 9 \"blue high-top sneaker\" 0 24 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 16 916 341 20 904 333 22 900 326 23 892 322 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 24 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 14 939 451 16 931 447 23 931 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 1 \"contact\" 0 23 [IN] 0 3 [OUT] 0 3 [INTERACT] 2 \"contact\" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 3 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 \"contact\" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 12 \"contact\" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 17 \"contact\" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 18 \"contact\" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 19 \"contact\" 0 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 4 \"contact\" 0 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 16 \"collision\" 2 2 [IN] 6 8 [OUT] 6 8 [INTERACT] 13 \"collision\" 5 5 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 14 \"collision\" 7 7 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 15 \"contact\" 8 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 0 \"collision\" 9 9 [IN] 0 4 [OUT] 0 4 [INTERACT] 7 \"collision\" 10 10 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 8 \"collision\" 12 12 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 9 \"collision\" 14 14 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 10 \"collision\" 16 16 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 11 \"contact\" 17 23 [IN] 4 65535 [OUT] 4 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"multicolored wooden stacking toy\" 0 24 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 14 251 271 15 232 263 16 228 244 17 208 236 18 201 244 19 197 216 21 162 193 22 154 181 [OBJ] 1 \"black and yellow cardboard motherboard box\" 0 24 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 14 357 583 16 361 591 17 357 599 19 361 611 22 365 619 [OBJ] 2 \"white plastic lutein supplement bottle\" 0 24 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 \"Colorful wooden geometric sorting board\" 0 24 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 15 353 255 16 361 244 18 369 232 20 369 220 21 333 220 22 330 212 [OBJ] 4 \"white cardboard box of diaper pail refill bags\" 0 24 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 14 201 326 15 189 314 16 173 306 17 154 306 18 138 298 19 126 291 20 111 287 21 95 283 22 80 279 23 68 275 [OBJ] 5 \"magenta suede pump\" 0 24 [PX] 0 505 494 7 490 505 8 null null 9 513 490 17 521 486 [OBJ] 6 \"peach and blue cardboard 12-pack of soda cans\" 0 24 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 14 505 775 15 521 818 16 521 845 17 505 853 18 513 884 19 490 880 20 482 888 21 458 876 22 412 833 23 455 896 [OBJ] 7 \"grey and orange athletic shoe\" 0 24 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 15 701 271 18 693 263 21 685 255 [OBJ] 8 \"white cardboard moisturizer box\" 0 24 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 15 744 498 16 740 513 17 748 498 18 744 505 19 740 525 20 740 548 22 748 564 [OBJ] 9 \"blue high-top sneaker\" 0 24 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 16 916 341 20 904 333 22 900 326 23 892 322 [OBJ] 10 \"multicolored cardboard Scrabble game\" 0 24 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 14 939 451 16 931 447 23 931 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 1 \"contact\" 0 23 [IN] 0 3 [OUT] 0 3 [INTERACT] 2 \"contact\" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 3 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 \"contact\" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 12 \"contact\" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 17 \"contact\" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 18 \"contact\" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 19 \"contact\" 0 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 4 \"contact\" 0 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 16 \"collision\" 2 2 [IN] 6 8 [OUT] 6 8 [INTERACT] 13 \"collision\" 5 5 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 14 \"collision\" 7 7 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 15 \"contact\" 8 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 0 \"collision\" 9 9 [IN] 0 4 [OUT] 0 4 [INTERACT] 7 \"collision\" 10 10 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 8 \"collision\" 12 12 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 9 \"collision\" 14 14 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 10 \"collision\" 16 16 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 11 \"contact\" 17 23 [IN] 4 65535 [OUT] 4 65535 [INTERACTIONS-END] [SCENE-END]"
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "multicolored wooden stacking toy" 0 24 [PX] 0 298 318 1 330 314 2 294 318 4 322 310 5 287 310 6 244 341 7 283 310 9 310 306 10 302 302 12 263 283 13 255 279 14 251 271 15 232 263 16 228 244 17 208 236 18 201 244 19 197 216 21 162 193 22 154 181 [OBJ] 1 "black and yellow cardboard motherboard box" 0 24 [PX] 0 333 587 2 349 583 7 353 591 10 330 607 12 322 603 13 314 611 14 357 583 16 361 591 17 357 599 19 361 611 22 365 619 [OBJ] 2 "white plastic lutein supplement bottle" 0 24 [PX] 0 380 970 1 392 974 3 404 978 4 416 982 6 423 986 7 431 990 8 443 990 9 451 994 11 null null [OBJ] 3 "Colorful wooden geometric sorting board" 0 24 [PX] 0 388 306 4 380 302 7 373 298 9 365 294 11 373 283 12 337 271 13 341 263 15 353 255 16 361 244 18 369 232 20 369 220 21 333 220 22 330 212 [OBJ] 4 "white cardboard box of diaper pail refill bags" 0 24 [PX] 0 423 509 1 419 427 2 400 408 3 384 400 4 369 396 5 357 400 6 341 416 7 318 443 8 318 392 9 291 369 10 275 345 11 259 322 12 236 333 13 216 330 14 201 326 15 189 314 16 173 306 17 154 306 18 138 298 19 126 291 20 111 287 21 95 283 22 80 279 23 68 275 [OBJ] 5 "magenta suede pump" 0 24 [PX] 0 505 494 7 490 505 8 null null 9 513 490 17 521 486 [OBJ] 6 "peach and blue cardboard 12-pack of soda cans" 0 24 [PX] 0 642 146 1 623 158 2 623 212 3 673 353 4 576 271 5 572 337 6 611 451 7 646 548 8 583 568 9 607 666 10 537 673 11 548 708 12 537 728 13 521 751 14 505 775 15 521 818 16 521 845 17 505 853 18 513 884 19 490 880 20 482 888 21 458 876 22 412 833 23 455 896 [OBJ] 7 "grey and orange athletic shoe" 0 24 [PX] 0 646 298 1 null null 2 783 306 3 771 318 4 724 298 7 716 291 9 708 283 10 716 287 12 708 279 15 701 271 18 693 263 21 685 255 [OBJ] 8 "white cardboard moisturizer box" 0 24 [PX] 0 837 525 2 818 529 3 845 521 4 873 501 6 845 458 7 814 474 8 794 490 9 783 490 10 775 494 11 767 501 12 755 517 13 751 501 15 744 498 16 740 513 17 748 498 18 744 505 19 740 525 20 740 548 22 748 564 [OBJ] 9 "blue high-top sneaker" 0 24 [PX] 0 919 384 2 908 388 4 null null 8 931 345 10 927 357 11 935 349 13 923 349 16 916 341 20 904 333 22 900 326 23 892 322 [OBJ] 10 "multicolored cardboard Scrabble game" 0 24 [PX] 0 947 333 2 947 353 3 943 361 7 943 373 8 958 392 9 962 400 10 958 482 11 951 486 13 939 474 14 939 451 16 931 447 23 931 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 1 "contact" 0 23 [IN] 0 3 [OUT] 0 3 [INTERACT] 2 "contact" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 3 "contact" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 "contact" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 "contact" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 12 "contact" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 17 "contact" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 18 "contact" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 19 "contact" 0 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 4 "contact" 0 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 16 "collision" 2 2 [IN] 6 8 [OUT] 6 8 [INTERACT] 13 "collision" 5 5 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 14 "collision" 7 7 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 15 "contact" 8 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 0 "collision" 9 9 [IN] 0 4 [OUT] 0 4 [INTERACT] 7 "collision" 10 10 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 8 "collision" 12 12 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 9 "collision" 14 14 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 10 "collision" 16 16 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 11 "contact" 17 23 [IN] 4 65535 [OUT] 4 65535 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 298,
"y": 318
},
{
"t": 1,
"x": 330,
"y": 314
},
{
"t": 2,
"x": 294,
"y": 318
},
{
"t": 4,
"x": 322,
"y": 310
},
{
"t": 5,
"x": 287,
"y": 310
},
{
"t": 6,
"x": 244,
"y": 341
},
{
"t": 7,
"x": 283,
"y": 310
},
{
"t": 9,
"x": 310,
"y": 306
},
{
"t": 10,
"x": 302,
"y": 302
},
{
"t": 12,
"x": 263,
"y": 283
},
{
"t": 13,
"x": 255,
"y": 279
},
{
"t": 14,
"x": 251,
"y": 271
},
{
"t": 15,
"x": 232,
"y": 263
},
{
"t": 16,
"x": 228,
"y": 244
},
{
"t": 17,
"x": 208,
"y": 236
},
{
"t": 18,
"x": 201,
"y": 244
},
{
"t": 19,
"x": 197,
"y": 216
},
{
"t": 21,
"x": 162,
"y": 193
},
{
"t": 22,
"x": 154,
"y": 181
}
],
"birth": 0,
"death": 24,
"type": "multicolored wooden stacking toy"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 333,
"y": 587
},
{
"t": 2,
"x": 349,
"y": 583
},
{
"t": 7,
"x": 353,
"y": 591
},
{
"t": 10,
"x": 330,
"y": 607
},
{
"t": 12,
"x": 322,
"y": 603
},
{
"t": 13,
"x": 314,
"y": 611
},
{
"t": 14,
"x": 357,
"y": 583
},
{
"t": 16,
"x": 361,
"y": 591
},
{
"t": 17,
"x": 357,
"y": 599
},
{
"t": 19,
"x": 361,
"y": 611
},
{
"t": 22,
"x": 365,
"y": 619
}
],
"birth": 0,
"death": 24,
"type": "black and yellow cardboard motherboard box"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 380,
"y": 970
},
{
"t": 1,
"x": 392,
"y": 974
},
{
"t": 3,
"x": 404,
"y": 978
},
{
"t": 4,
"x": 416,
"y": 982
},
{
"t": 6,
"x": 423,
"y": 986
},
{
"t": 7,
"x": 431,
"y": 990
},
{
"t": 8,
"x": 443,
"y": 990
},
{
"t": 9,
"x": 451,
"y": 994
},
{
"t": 11,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "white plastic lutein supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 388,
"y": 306
},
{
"t": 4,
"x": 380,
"y": 302
},
{
"t": 7,
"x": 373,
"y": 298
},
{
"t": 9,
"x": 365,
"y": 294
},
{
"t": 11,
"x": 373,
"y": 283
},
{
"t": 12,
"x": 337,
"y": 271
},
{
"t": 13,
"x": 341,
"y": 263
},
{
"t": 15,
"x": 353,
"y": 255
},
{
"t": 16,
"x": 361,
"y": 244
},
{
"t": 18,
"x": 369,
"y": 232
},
{
"t": 20,
"x": 369,
"y": 220
},
{
"t": 21,
"x": 333,
"y": 220
},
{
"t": 22,
"x": 330,
"y": 212
}
],
"birth": 0,
"death": 24,
"type": "Colorful wooden geometric sorting board"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 423,
"y": 509
},
{
"t": 1,
"x": 419,
"y": 427
},
{
"t": 2,
"x": 400,
"y": 408
},
{
"t": 3,
"x": 384,
"y": 400
},
{
"t": 4,
"x": 369,
"y": 396
},
{
"t": 5,
"x": 357,
"y": 400
},
{
"t": 6,
"x": 341,
"y": 416
},
{
"t": 7,
"x": 318,
"y": 443
},
{
"t": 8,
"x": 318,
"y": 392
},
{
"t": 9,
"x": 291,
"y": 369
},
{
"t": 10,
"x": 275,
"y": 345
},
{
"t": 11,
"x": 259,
"y": 322
},
{
"t": 12,
"x": 236,
"y": 333
},
{
"t": 13,
"x": 216,
"y": 330
},
{
"t": 14,
"x": 201,
"y": 326
},
{
"t": 15,
"x": 189,
"y": 314
},
{
"t": 16,
"x": 173,
"y": 306
},
{
"t": 17,
"x": 154,
"y": 306
},
{
"t": 18,
"x": 138,
"y": 298
},
{
"t": 19,
"x": 126,
"y": 291
},
{
"t": 20,
"x": 111,
"y": 287
},
{
"t": 21,
"x": 95,
"y": 283
},
{
"t": 22,
"x": 80,
"y": 279
},
{
"t": 23,
"x": 68,
"y": 275
}
],
"birth": 0,
"death": 24,
"type": "white cardboard box of diaper pail refill bags"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 505,
"y": 494
},
{
"t": 7,
"x": 490,
"y": 505
},
{
"t": 8,
"x": null,
"y": null
},
{
"t": 9,
"x": 513,
"y": 490
},
{
"t": 17,
"x": 521,
"y": 486
}
],
"birth": 0,
"death": 24,
"type": "magenta suede pump"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 642,
"y": 146
},
{
"t": 1,
"x": 623,
"y": 158
},
{
"t": 2,
"x": 623,
"y": 212
},
{
"t": 3,
"x": 673,
"y": 353
},
{
"t": 4,
"x": 576,
"y": 271
},
{
"t": 5,
"x": 572,
"y": 337
},
{
"t": 6,
"x": 611,
"y": 451
},
{
"t": 7,
"x": 646,
"y": 548
},
{
"t": 8,
"x": 583,
"y": 568
},
{
"t": 9,
"x": 607,
"y": 666
},
{
"t": 10,
"x": 537,
"y": 673
},
{
"t": 11,
"x": 548,
"y": 708
},
{
"t": 12,
"x": 537,
"y": 728
},
{
"t": 13,
"x": 521,
"y": 751
},
{
"t": 14,
"x": 505,
"y": 775
},
{
"t": 15,
"x": 521,
"y": 818
},
{
"t": 16,
"x": 521,
"y": 845
},
{
"t": 17,
"x": 505,
"y": 853
},
{
"t": 18,
"x": 513,
"y": 884
},
{
"t": 19,
"x": 490,
"y": 880
},
{
"t": 20,
"x": 482,
"y": 888
},
{
"t": 21,
"x": 458,
"y": 876
},
{
"t": 22,
"x": 412,
"y": 833
},
{
"t": 23,
"x": 455,
"y": 896
}
],
"birth": 0,
"death": 24,
"type": "peach and blue cardboard 12-pack of soda cans"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 298
},
{
"t": 1,
"x": null,
"y": null
},
{
"t": 2,
"x": 783,
"y": 306
},
{
"t": 3,
"x": 771,
"y": 318
},
{
"t": 4,
"x": 724,
"y": 298
},
{
"t": 7,
"x": 716,
"y": 291
},
{
"t": 9,
"x": 708,
"y": 283
},
{
"t": 10,
"x": 716,
"y": 287
},
{
"t": 12,
"x": 708,
"y": 279
},
{
"t": 15,
"x": 701,
"y": 271
},
{
"t": 18,
"x": 693,
"y": 263
},
{
"t": 21,
"x": 685,
"y": 255
}
],
"birth": 0,
"death": 24,
"type": "grey and orange athletic shoe"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 837,
"y": 525
},
{
"t": 2,
"x": 818,
"y": 529
},
{
"t": 3,
"x": 845,
"y": 521
},
{
"t": 4,
"x": 873,
"y": 501
},
{
"t": 6,
"x": 845,
"y": 458
},
{
"t": 7,
"x": 814,
"y": 474
},
{
"t": 8,
"x": 794,
"y": 490
},
{
"t": 9,
"x": 783,
"y": 490
},
{
"t": 10,
"x": 775,
"y": 494
},
{
"t": 11,
"x": 767,
"y": 501
},
{
"t": 12,
"x": 755,
"y": 517
},
{
"t": 13,
"x": 751,
"y": 501
},
{
"t": 15,
"x": 744,
"y": 498
},
{
"t": 16,
"x": 740,
"y": 513
},
{
"t": 17,
"x": 748,
"y": 498
},
{
"t": 18,
"x": 744,
"y": 505
},
{
"t": 19,
"x": 740,
"y": 525
},
{
"t": 20,
"x": 740,
"y": 548
},
{
"t": 22,
"x": 748,
"y": 564
}
],
"birth": 0,
"death": 24,
"type": "white cardboard moisturizer box"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 384
},
{
"t": 2,
"x": 908,
"y": 388
},
{
"t": 4,
"x": null,
"y": null
},
{
"t": 8,
"x": 931,
"y": 345
},
{
"t": 10,
"x": 927,
"y": 357
},
{
"t": 11,
"x": 935,
"y": 349
},
{
"t": 13,
"x": 923,
"y": 349
},
{
"t": 16,
"x": 916,
"y": 341
},
{
"t": 20,
"x": 904,
"y": 333
},
{
"t": 22,
"x": 900,
"y": 326
},
{
"t": 23,
"x": 892,
"y": 322
}
],
"birth": 0,
"death": 24,
"type": "blue high-top sneaker"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 947,
"y": 333
},
{
"t": 2,
"x": 947,
"y": 353
},
{
"t": 3,
"x": 943,
"y": 361
},
{
"t": 7,
"x": 943,
"y": 373
},
{
"t": 8,
"x": 958,
"y": 392
},
{
"t": 9,
"x": 962,
"y": 400
},
{
"t": 10,
"x": 958,
"y": 482
},
{
"t": 11,
"x": 951,
"y": 486
},
{
"t": 13,
"x": 939,
"y": 474
},
{
"t": 14,
"x": 939,
"y": 451
},
{
"t": 16,
"x": 931,
"y": 447
},
{
"t": 23,
"x": 931,
"y": 462
}
],
"birth": 0,
"death": 24,
"type": "multicolored cardboard Scrabble game"
}
],
"interactions": [
{
"id": 1,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 2,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 3,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 5,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 6,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 12,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 17,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 18,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 19,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 4,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 16,
"inputs": [
6,
8
],
"outputs": [
6,
8
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 13,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 14,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 15,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 8,
"ends_at": 23,
"type": "contact"
},
{
"id": 0,
"inputs": [
0,
4
],
"outputs": [
0,
4
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 7,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 8,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 9,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 10,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 11,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 17,
"ends_at": 23,
"type": "contact"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 1.0,
"avg_image_position_segmentation_acc_small": 1.0,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 1.0,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": 1.0,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 1.0,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 1.0,
"num_matches": 11,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.6685416666666667,
"avg_interaction_input_object_jaccard": 0.2833333333333333,
"avg_interaction_output_object_jaccard": 0.2833333333333333,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 20,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 6,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 16,
"false_positives": 4,
"false_negatives": 6
},
"0.5": {
"true_positives": 16,
"false_positives": 4,
"false_negatives": 6
},
"0.75": {
"true_positives": 11,
"false_positives": 9,
"false_negatives": 6
},
"1.0": {
"true_positives": 10,
"false_positives": 10,
"false_negatives": 6
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.8,
"0.5": 0.8,
"0.75": 0.55,
"1.0": 0.5
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.7272727272727273,
"0.5": 0.7272727272727273,
"0.75": 0.6470588235294118,
"1.0": 0.625
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.761904761904762,
"0.5": 0.761904761904762,
"0.75": 0.5945945945945946,
"1.0": 0.5555555555555556
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 15,
"false_positives": 5,
"false_negatives": 6
},
"0.5": {
"true_positives": 1,
"false_positives": 19,
"false_negatives": 6
},
"0.75": {
"true_positives": 1,
"false_positives": 19,
"false_negatives": 6
},
"1.0": {
"true_positives": 1,
"false_positives": 19,
"false_negatives": 6
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.75,
"0.5": 0.05,
"0.75": 0.05,
"1.0": 0.05
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.7142857142857143,
"0.5": 0.14285714285714285,
"0.75": 0.14285714285714285,
"1.0": 0.14285714285714285
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.7317073170731706,
"0.5": 0.07407407407407408,
"0.75": 0.07407407407407408,
"1.0": 0.07407407407407408
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 15,
"false_positives": 5,
"false_negatives": 6
},
"0.5": {
"true_positives": 1,
"false_positives": 19,
"false_negatives": 6
},
"0.75": {
"true_positives": 1,
"false_positives": 19,
"false_negatives": 6
},
"1.0": {
"true_positives": 1,
"false_positives": 19,
"false_negatives": 6
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.75,
"0.5": 0.05,
"0.75": 0.05,
"1.0": 0.05
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.7142857142857143,
"0.5": 0.14285714285714285,
"0.75": 0.14285714285714285,
"1.0": 0.14285714285714285
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.7317073170731706,
"0.5": 0.07407407407407408,
"0.75": 0.07407407407407408,
"1.0": 0.07407407407407408
}
}
}Prompt
user Analyze the provided video and return ONLY a valid sentinel sequence in this format: [SCENE-START] [OBJS-START] [OBJ] id "type" birth death [PX] t px py ... [OBJ] ... [OBJS-END] [INTERACTIONS-START] [INTERACT] id "type" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ... [INTERACT] ... [INTERACTIONS-END] [SCENE-END] Constraints: - Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose). - Keep tags exactly as written: `[SCENE-START] [OBJS-START] [OBJ] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]` - Use quoted strings for `type` (double quotes). - `PX` uses repeated groups of 3 values in order: `t px py`. - `t` is the timestamp (frame number). - `px` and `py` are the pixel coordinates of the object in that frame, normalized to [0,1] relative to the frame dimensions, scaled by 1000 and rounded to the nearest integer. For example, `px` of 0.1234 would be represented as 123. - When an object is occluded or not visible in a frame, `PX` may use `t null null`. - `IN` and `OUT` contain whitespace-separated integer ids. assistant