STRIVE · 08/28/2026
Prefill sample 2
One shared clip across Baselines 1, 2, 3, and E2E, including exactly what was injected.
Ground-truth Sentinel
[SCENE-START] [OBJS-START] [OBJ] 0 "red ceramic planter" 0 24 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 "black canvas boat shoe with white sole" 0 24 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 15 9 267 18 1 271 19 1 291 20 null null [OBJ] 2 "purple and pink fabric sneaker" 0 24 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 14 41 466 15 33 482 16 25 494 17 25 576 18 29 595 19 29 583 20 33 595 23 41 603 [OBJ] 3 "grey, purple, and mint green high-top sneaker" 0 24 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 14 48 345 17 44 353 19 41 361 21 37 376 23 29 373 [OBJ] 4 "white Lego Creationary game box" 0 24 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 14 314 755 15 255 763 16 322 763 17 365 763 18 388 767 19 349 771 20 369 771 21 298 783 22 396 775 [OBJ] 5 "white and green cardboard ink cartridge box" 0 24 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 14 404 951 15 423 951 17 443 951 19 458 955 20 474 951 21 486 951 23 498 955 [OBJ] 6 "black laptop" 0 24 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 19 486 388 22 478 400 [OBJ] 7 "beige fabric pencil case with horse print" 0 24 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 14 638 642 17 650 642 21 658 638 23 662 630 [OBJ] 8 "blue and orange plastic Therizinosaurus figurine" 0 24 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 16 541 56 17 525 64 18 529 56 19 521 60 20 505 68 21 494 72 23 482 76 [OBJ] 9 "black cardboard panty liner box" 0 24 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 14 576 189 15 560 185 16 544 189 17 529 197 18 517 208 19 505 220 20 482 232 21 458 255 22 427 279 23 400 291 [OBJ] 10 "light blue and green cardboard fruit snack box" 0 24 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 16 720 423 17 732 423 18 771 427 19 787 427 20 806 427 21 830 427 22 677 404 [OBJ] 11 "silver leather boat shoe" 0 24 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 16 716 177 18 708 173 19 705 181 20 697 173 22 689 181 23 681 193 [OBJ] 12 "wooden toy railroad crossing" 1 24 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 14 603 76 15 626 60 17 666 48 19 685 44 20 708 29 21 720 17 22 728 9 [OBJ] 13 "white plastic supplement bottle" 17 24 [PX] 0 null null 17 912 998 18 888 998 19 908 994 20 923 994 21 970 990 22 978 986 [OBJS-END] [INTERACTIONS-START] [INTERACT] 18 "contact" 0 7 [IN] 6 10 [OUT] 6 10 [INTERACT] 0 "contact" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 "contact" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 11 "contact" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 16 "contact" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 17 "contact" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 19 "contact" 0 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 22 "contact" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 23 "contact" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 3 "contact" 0 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 "contact" 0 23 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 9 "contact" 0 23 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 25 "collision" 6 7 [IN] 9 10 [OUT] 9 10 [INTERACT] 14 "collision" 7 7 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 10 "collision" 7 8 [IN] 2 3 [OUT] 2 3 [INTERACT] 15 "collision" 9 9 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 26 "collision" 9 9 [IN] 9 10 [OUT] 9 10 [INTERACT] 5 "collision" 10 11 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 24 "contact" 10 20 [IN] 9 10 [OUT] 9 10 [INTERACT] 1 "collision" 12 13 [IN] 1 3 [OUT] 1 3 [INTERACT] 12 "collision" 13 13 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 13 "contact" 14 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 "collision" 17 17 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 7 "collision" 19 19 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 8 "contact" 20 23 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 20 "collision" 22 22 [IN] 6 9 [OUT] 6 9 [INTERACT] 21 "contact" 23 23 [IN] 6 9 [OUT] 6 9 [INTERACT] 27 "collision" 23 23 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]
Parsed ground truth
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 52,
"y": 83
},
{
"t": 1,
"x": 41,
"y": 87
},
{
"t": 2,
"x": 21,
"y": 72
},
{
"t": 3,
"x": 33,
"y": 95
},
{
"t": 6,
"x": 25,
"y": 99
},
{
"t": 7,
"x": 17,
"y": 95
},
{
"t": 10,
"x": 5,
"y": 99
},
{
"t": 11,
"x": 1,
"y": 107
},
{
"t": 12,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "red ceramic planter"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 72,
"y": 263
},
{
"t": 1,
"x": 64,
"y": 267
},
{
"t": 2,
"x": 56,
"y": 271
},
{
"t": 3,
"x": 48,
"y": 275
},
{
"t": 4,
"x": 25,
"y": 291
},
{
"t": 5,
"x": 21,
"y": 283
},
{
"t": 6,
"x": 44,
"y": 259
},
{
"t": 7,
"x": 33,
"y": 271
},
{
"t": 9,
"x": 25,
"y": 267
},
{
"t": 13,
"x": 13,
"y": 259
},
{
"t": 15,
"x": 9,
"y": 267
},
{
"t": 18,
"x": 1,
"y": 271
},
{
"t": 19,
"x": 1,
"y": 291
},
{
"t": 20,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 99,
"y": 392
},
{
"t": 1,
"x": 68,
"y": 396
},
{
"t": 2,
"x": 60,
"y": 400
},
{
"t": 3,
"x": 87,
"y": 400
},
{
"t": 4,
"x": 80,
"y": 404
},
{
"t": 5,
"x": 72,
"y": 408
},
{
"t": 6,
"x": 64,
"y": 412
},
{
"t": 7,
"x": 48,
"y": 427
},
{
"t": 8,
"x": 41,
"y": 439
},
{
"t": 9,
"x": 91,
"y": 439
},
{
"t": 10,
"x": 80,
"y": 439
},
{
"t": 11,
"x": 72,
"y": 443
},
{
"t": 12,
"x": 60,
"y": 451
},
{
"t": 13,
"x": 52,
"y": 455
},
{
"t": 14,
"x": 41,
"y": 466
},
{
"t": 15,
"x": 33,
"y": 482
},
{
"t": 16,
"x": 25,
"y": 494
},
{
"t": 17,
"x": 25,
"y": 576
},
{
"t": 18,
"x": 29,
"y": 595
},
{
"t": 19,
"x": 29,
"y": 583
},
{
"t": 20,
"x": 33,
"y": 595
},
{
"t": 23,
"x": 41,
"y": 603
}
],
"birth": 0,
"death": 24,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 216,
"y": 138
},
{
"t": 1,
"x": 189,
"y": 150
},
{
"t": 2,
"x": 169,
"y": 162
},
{
"t": 3,
"x": 142,
"y": 193
},
{
"t": 4,
"x": 126,
"y": 220
},
{
"t": 5,
"x": 95,
"y": 271
},
{
"t": 6,
"x": 83,
"y": 310
},
{
"t": 7,
"x": 99,
"y": 330
},
{
"t": 8,
"x": 60,
"y": 353
},
{
"t": 9,
"x": 52,
"y": 349
},
{
"t": 10,
"x": 41,
"y": 337
},
{
"t": 13,
"x": 56,
"y": 349
},
{
"t": 14,
"x": 48,
"y": 345
},
{
"t": 17,
"x": 44,
"y": 353
},
{
"t": 19,
"x": 41,
"y": 361
},
{
"t": 21,
"x": 37,
"y": 376
},
{
"t": 23,
"x": 29,
"y": 373
}
],
"birth": 0,
"death": 24,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 228,
"y": 701
},
{
"t": 2,
"x": 275,
"y": 716
},
{
"t": 3,
"x": 232,
"y": 716
},
{
"t": 6,
"x": 341,
"y": 736
},
{
"t": 7,
"x": 236,
"y": 732
},
{
"t": 10,
"x": 236,
"y": 744
},
{
"t": 12,
"x": 244,
"y": 751
},
{
"t": 14,
"x": 314,
"y": 755
},
{
"t": 15,
"x": 255,
"y": 763
},
{
"t": 16,
"x": 322,
"y": 763
},
{
"t": 17,
"x": 365,
"y": 763
},
{
"t": 18,
"x": 388,
"y": 767
},
{
"t": 19,
"x": 349,
"y": 771
},
{
"t": 20,
"x": 369,
"y": 771
},
{
"t": 21,
"x": 298,
"y": 783
},
{
"t": 22,
"x": 396,
"y": 775
}
],
"birth": 0,
"death": 24,
"type": "white Lego Creationary game box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 259,
"y": 923
},
{
"t": 1,
"x": 287,
"y": 927
},
{
"t": 2,
"x": 302,
"y": 927
},
{
"t": 3,
"x": 318,
"y": 931
},
{
"t": 4,
"x": 330,
"y": 931
},
{
"t": 5,
"x": 337,
"y": 935
},
{
"t": 7,
"x": 353,
"y": 939
},
{
"t": 9,
"x": 365,
"y": 943
},
{
"t": 11,
"x": 373,
"y": 947
},
{
"t": 12,
"x": 400,
"y": 943
},
{
"t": 14,
"x": 404,
"y": 951
},
{
"t": 15,
"x": 423,
"y": 951
},
{
"t": 17,
"x": 443,
"y": 951
},
{
"t": 19,
"x": 458,
"y": 955
},
{
"t": 20,
"x": 474,
"y": 951
},
{
"t": 21,
"x": 486,
"y": 951
},
{
"t": 23,
"x": 498,
"y": 955
}
],
"birth": 0,
"death": 24,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 525,
"y": 404
},
{
"t": 3,
"x": 529,
"y": 396
},
{
"t": 4,
"x": 521,
"y": 400
},
{
"t": 5,
"x": 529,
"y": 392
},
{
"t": 7,
"x": 513,
"y": 396
},
{
"t": 9,
"x": 509,
"y": 388
},
{
"t": 10,
"x": 501,
"y": 392
},
{
"t": 12,
"x": 505,
"y": 384
},
{
"t": 13,
"x": 498,
"y": 392
},
{
"t": 19,
"x": 486,
"y": 388
},
{
"t": 22,
"x": 478,
"y": 400
}
],
"birth": 0,
"death": 24,
"type": "black laptop"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 587,
"y": 658
},
{
"t": 1,
"x": 595,
"y": 650
},
{
"t": 2,
"x": 587,
"y": 662
},
{
"t": 3,
"x": 599,
"y": 646
},
{
"t": 6,
"x": 595,
"y": 654
},
{
"t": 8,
"x": 607,
"y": 642
},
{
"t": 10,
"x": 611,
"y": 650
},
{
"t": 11,
"x": 623,
"y": 642
},
{
"t": 13,
"x": 630,
"y": 646
},
{
"t": 14,
"x": 638,
"y": 642
},
{
"t": 17,
"x": 650,
"y": 642
},
{
"t": 21,
"x": 658,
"y": 638
},
{
"t": 23,
"x": 662,
"y": 630
}
],
"birth": 0,
"death": 24,
"type": "beige fabric pencil case with horse print"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 68
},
{
"t": 2,
"x": 626,
"y": 68
},
{
"t": 4,
"x": 619,
"y": 64
},
{
"t": 5,
"x": 607,
"y": 64
},
{
"t": 6,
"x": 615,
"y": 52
},
{
"t": 7,
"x": 599,
"y": 60
},
{
"t": 9,
"x": 583,
"y": 60
},
{
"t": 11,
"x": 568,
"y": 60
},
{
"t": 13,
"x": 552,
"y": 60
},
{
"t": 16,
"x": 541,
"y": 56
},
{
"t": 17,
"x": 525,
"y": 64
},
{
"t": 18,
"x": 529,
"y": 56
},
{
"t": 19,
"x": 521,
"y": 60
},
{
"t": 20,
"x": 505,
"y": 68
},
{
"t": 21,
"x": 494,
"y": 72
},
{
"t": 23,
"x": 482,
"y": 76
}
],
"birth": 0,
"death": 24,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 744,
"y": 91
},
{
"t": 1,
"x": 732,
"y": 83
},
{
"t": 3,
"x": 716,
"y": 91
},
{
"t": 4,
"x": 701,
"y": 115
},
{
"t": 5,
"x": 685,
"y": 146
},
{
"t": 6,
"x": 673,
"y": 169
},
{
"t": 7,
"x": 658,
"y": 185
},
{
"t": 8,
"x": 646,
"y": 173
},
{
"t": 9,
"x": 630,
"y": 177
},
{
"t": 11,
"x": 607,
"y": 177
},
{
"t": 12,
"x": 599,
"y": 185
},
{
"t": 13,
"x": 583,
"y": 181
},
{
"t": 14,
"x": 576,
"y": 189
},
{
"t": 15,
"x": 560,
"y": 185
},
{
"t": 16,
"x": 544,
"y": 189
},
{
"t": 17,
"x": 529,
"y": 197
},
{
"t": 18,
"x": 517,
"y": 208
},
{
"t": 19,
"x": 505,
"y": 220
},
{
"t": 20,
"x": 482,
"y": 232
},
{
"t": 21,
"x": 458,
"y": 255
},
{
"t": 22,
"x": 427,
"y": 279
},
{
"t": 23,
"x": 400,
"y": 291
}
],
"birth": 0,
"death": 24,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 751,
"y": 486
},
{
"t": 1,
"x": 658,
"y": 427
},
{
"t": 2,
"x": 681,
"y": 439
},
{
"t": 3,
"x": 693,
"y": 443
},
{
"t": 4,
"x": 712,
"y": 451
},
{
"t": 5,
"x": 759,
"y": 474
},
{
"t": 7,
"x": 716,
"y": 443
},
{
"t": 9,
"x": 736,
"y": 447
},
{
"t": 10,
"x": 720,
"y": 439
},
{
"t": 11,
"x": 771,
"y": 451
},
{
"t": 12,
"x": 806,
"y": 455
},
{
"t": 13,
"x": 705,
"y": 427
},
{
"t": 16,
"x": 720,
"y": 423
},
{
"t": 17,
"x": 732,
"y": 423
},
{
"t": 18,
"x": 771,
"y": 427
},
{
"t": 19,
"x": 787,
"y": 427
},
{
"t": 20,
"x": 806,
"y": 427
},
{
"t": 21,
"x": 830,
"y": 427
},
{
"t": 22,
"x": 677,
"y": 404
}
],
"birth": 0,
"death": 24,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 798,
"y": 216
},
{
"t": 1,
"x": 791,
"y": 220
},
{
"t": 2,
"x": 787,
"y": 208
},
{
"t": 3,
"x": 779,
"y": 216
},
{
"t": 4,
"x": 775,
"y": 205
},
{
"t": 5,
"x": 771,
"y": 193
},
{
"t": 6,
"x": 763,
"y": 208
},
{
"t": 7,
"x": 759,
"y": 193
},
{
"t": 9,
"x": 751,
"y": 185
},
{
"t": 11,
"x": 744,
"y": 181
},
{
"t": 13,
"x": 732,
"y": 177
},
{
"t": 16,
"x": 716,
"y": 177
},
{
"t": 18,
"x": 708,
"y": 173
},
{
"t": 19,
"x": 705,
"y": 181
},
{
"t": 20,
"x": 697,
"y": 173
},
{
"t": 22,
"x": 689,
"y": 181
},
{
"t": 23,
"x": 681,
"y": 193
}
],
"birth": 0,
"death": 24,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 1,
"x": 1,
"y": 1
},
{
"t": 2,
"x": 72,
"y": 5
},
{
"t": 3,
"x": 138,
"y": 5
},
{
"t": 4,
"x": 205,
"y": 9
},
{
"t": 5,
"x": 263,
"y": 25
},
{
"t": 6,
"x": 314,
"y": 48
},
{
"t": 7,
"x": 361,
"y": 76
},
{
"t": 8,
"x": 404,
"y": 107
},
{
"t": 9,
"x": 435,
"y": 138
},
{
"t": 10,
"x": 470,
"y": 162
},
{
"t": 11,
"x": 501,
"y": 158
},
{
"t": 12,
"x": 498,
"y": 130
},
{
"t": 13,
"x": 529,
"y": 111
},
{
"t": 14,
"x": 603,
"y": 76
},
{
"t": 15,
"x": 626,
"y": 60
},
{
"t": 17,
"x": 666,
"y": 48
},
{
"t": 19,
"x": 685,
"y": 44
},
{
"t": 20,
"x": 708,
"y": 29
},
{
"t": 21,
"x": 720,
"y": 17
},
{
"t": 22,
"x": 728,
"y": 9
}
],
"birth": 1,
"death": 24,
"type": "wooden toy railroad crossing"
},
{
"id": 13,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 17,
"x": 912,
"y": 998
},
{
"t": 18,
"x": 888,
"y": 998
},
{
"t": 19,
"x": 908,
"y": 994
},
{
"t": 20,
"x": 923,
"y": 994
},
{
"t": 21,
"x": 970,
"y": 990
},
{
"t": 22,
"x": 978,
"y": 986
}
],
"birth": 17,
"death": 24,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 18,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 0,
"ends_at": 7,
"type": "contact"
},
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 11,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 16,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 17,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 19,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 22,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 23,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 3,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 4,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 9,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 25,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 6,
"ends_at": 7,
"type": "collision"
},
{
"id": 14,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 10,
"inputs": [
2,
3
],
"outputs": [
2,
3
],
"begins_at": 7,
"ends_at": 8,
"type": "collision"
},
{
"id": 15,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 26,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 5,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 10,
"ends_at": 11,
"type": "collision"
},
{
"id": 24,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 10,
"ends_at": 20,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
3
],
"outputs": [
1,
3
],
"begins_at": 12,
"ends_at": 13,
"type": "collision"
},
{
"id": 12,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 13,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 14,
"ends_at": 23,
"type": "contact"
},
{
"id": 6,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 7,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 8,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 20,
"ends_at": 23,
"type": "contact"
},
{
"id": 20,
"inputs": [
6,
9
],
"outputs": [
6,
9
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 21,
"inputs": [
6,
9
],
"outputs": [
6,
9
],
"begins_at": 23,
"ends_at": 23,
"type": "contact"
},
{
"id": 27,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
}
]
}Per-frame GT object prefill
Each one-frame detector request was assistant-prefilled with the exact visible GT objects using canonical IDs. B1 generated only the interaction suffix; the saved frame outputs below are the exact persisted requests and generations.
Every persisted/reconstructed prefill step
[
{
"frame_index": 0,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 52 83 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 72 263 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 99 392 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 216 138 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 228 701 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 259 923 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 525 404 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 587 658 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 646 68 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 744 91 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 751 486 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 798 216 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 null null [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 11 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 52 83 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 72 263 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 99 392 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 216 138 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 228 701 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 259 923 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 525 404 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 587 658 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 646 68 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 744 91 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 751 486 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 798 216 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 null null [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 11 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12,
"13": 13
},
"parsed_object_count": 14,
"parsed_interaction_count": 15
},
{
"frame_index": 1,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 41 87 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 64 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 68 396 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 189 150 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 287 927 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 595 650 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 732 83 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 658 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 791 220 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 1 1 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 11 [OUT] 9 11 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 41 87 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 64 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 68 396 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 189 150 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 287 927 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 595 650 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 732 83 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 658 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 791 220 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 1 1 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 11 [OUT] 9 11 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"5": 5,
"7": 7,
"9": 9,
"10": 10,
"11": 11,
"12": 12
},
"parsed_object_count": 10,
"parsed_interaction_count": 10
},
{
"frame_index": 2,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 21 72 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 56 271 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 60 400 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 169 162 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 275 716 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 302 927 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 587 662 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 626 68 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 681 439 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 787 208 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 72 5 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 21 72 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 56 271 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 60 400 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 169 162 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 275 716 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 302 927 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 587 662 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 626 68 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 681 439 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 787 208 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 72 5 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"7": 7,
"8": 8,
"10": 10,
"11": 11,
"12": 12
},
"parsed_object_count": 11,
"parsed_interaction_count": 10
},
{
"frame_index": 3,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 33 95 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 48 275 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 87 400 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 142 193 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 232 716 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 318 931 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 529 396 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 599 646 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 716 91 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 693 443 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 779 216 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 138 5 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 11 [OUT] 9 11 [INTERACT] 12 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 33 95 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 48 275 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 87 400 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 142 193 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 232 716 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 318 931 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 529 396 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 599 646 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 716 91 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 693 443 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 779 216 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 138 5 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 11 [OUT] 9 11 [INTERACT] 12 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"9": 9,
"10": 10,
"11": 11,
"12": 12
},
"parsed_object_count": 12,
"parsed_interaction_count": 13
},
{
"frame_index": 4,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 25 291 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 80 404 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 126 220 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 330 931 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 521 400 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 619 64 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 701 115 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 712 451 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 775 205 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 205 9 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 25 291 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 80 404 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 126 220 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 330 931 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 521 400 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 619 64 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 701 115 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 712 451 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 775 205 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 205 9 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"5": 5,
"6": 6,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12
},
"parsed_object_count": 10,
"parsed_interaction_count": 10
},
{
"frame_index": 5,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 21 283 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 72 408 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 95 271 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 337 935 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 529 392 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 607 64 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 685 146 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 759 474 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 771 193 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 263 25 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 21 283 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 72 408 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 95 271 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 337 935 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 529 392 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 607 64 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 685 146 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 759 474 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 771 193 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 263 25 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"5": 5,
"6": 6,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12
},
"parsed_object_count": 10,
"parsed_interaction_count": 11
},
{
"frame_index": 6,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 25 99 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 44 259 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 64 412 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 83 310 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 341 736 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 595 654 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 615 52 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 673 169 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 763 208 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 314 48 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 3 [OUT] 1 3 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 25 99 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 44 259 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 64 412 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 83 310 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 341 736 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 595 654 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 615 52 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 673 169 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 763 208 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 314 48 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 3 [OUT] 1 3 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"7": 7,
"8": 8,
"9": 9,
"11": 11,
"12": 12
},
"parsed_object_count": 10,
"parsed_interaction_count": 9
},
{
"frame_index": 7,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 17 95 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 33 271 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 48 427 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 99 330 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 236 732 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 353 939 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 513 396 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 599 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 658 185 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 716 443 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 759 193 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 361 76 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 17 95 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 33 271 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 48 427 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 99 330 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 236 732 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 353 939 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 513 396 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 599 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 658 185 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 716 443 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 759 193 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 361 76 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12
},
"parsed_object_count": 12,
"parsed_interaction_count": 11
},
{
"frame_index": 8,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 41 439 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 60 353 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 607 642 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 646 173 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 404 107 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 41 439 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 60 353 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 607 642 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 646 173 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 404 107 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"3": 3,
"7": 7,
"9": 9,
"12": 12
},
"parsed_object_count": 5,
"parsed_interaction_count": 10
},
{
"frame_index": 9,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 25 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 91 439 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 52 349 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 365 943 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 509 388 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 583 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 630 177 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 736 447 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 751 185 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 435 138 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 25 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 91 439 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 52 349 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 365 943 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 509 388 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 583 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 630 177 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 736 447 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 751 185 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 435 138 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"5": 5,
"6": 6,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12
},
"parsed_object_count": 10,
"parsed_interaction_count": 9
},
{
"frame_index": 10,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 5 99 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 80 439 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 41 337 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 236 744 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 501 392 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 611 650 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 720 439 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 470 162 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 5 99 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 80 439 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 41 337 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 236 744 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 501 392 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 611 650 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 720 439 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 470 162 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"6": 6,
"7": 7,
"10": 10,
"12": 12
},
"parsed_object_count": 8,
"parsed_interaction_count": 9
},
{
"frame_index": 11,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 1 107 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 72 443 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 373 947 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 623 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 568 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 607 177 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 771 451 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 744 181 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 501 158 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 1 107 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 72 443 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 373 947 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 623 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 568 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 607 177 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 771 451 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 744 181 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 501 158 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"2": 2,
"5": 5,
"7": 7,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12
},
"parsed_object_count": 9,
"parsed_interaction_count": 9
},
{
"frame_index": 12,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 null null [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 60 451 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 244 751 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 400 943 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 505 384 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 599 185 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 806 455 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 498 130 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 null null [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 60 451 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 244 751 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 400 943 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 505 384 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 599 185 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 806 455 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 498 130 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"2": 2,
"4": 4,
"5": 5,
"6": 6,
"9": 9,
"10": 10,
"12": 12
},
"parsed_object_count": 8,
"parsed_interaction_count": 8
},
{
"frame_index": 13,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 13 259 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 52 455 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 56 349 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 498 392 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 630 646 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 552 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 583 181 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 705 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 732 177 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 529 111 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 13 259 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 52 455 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 56 349 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 498 392 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 630 646 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 552 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 583 181 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 705 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 732 177 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 529 111 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"6": 6,
"7": 7,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12
},
"parsed_object_count": 10,
"parsed_interaction_count": 9
},
{
"frame_index": 14,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 41 466 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 48 345 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 314 755 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 404 951 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 638 642 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 576 189 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 603 76 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 41 466 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 48 345 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 314 755 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 404 951 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 638 642 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 576 189 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 603 76 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"7": 7,
"9": 9,
"12": 12
},
"parsed_object_count": 7,
"parsed_interaction_count": 9
},
{
"frame_index": 15,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 9 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 33 482 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 255 763 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 423 951 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 560 185 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 626 60 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 9 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 33 482 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 255 763 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 423 951 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 560 185 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 626 60 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"4": 4,
"5": 5,
"9": 9,
"12": 12
},
"parsed_object_count": 6,
"parsed_interaction_count": 5
},
{
"frame_index": 16,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 25 494 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 322 763 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 541 56 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 544 189 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 720 423 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 716 177 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 25 494 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 322 763 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 541 56 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 544 189 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 720 423 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 716 177 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"4": 4,
"8": 8,
"9": 9,
"10": 10,
"11": 11
},
"parsed_object_count": 6,
"parsed_interaction_count": 11
},
{
"frame_index": 17,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 25 576 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 44 353 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 365 763 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 443 951 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 650 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 525 64 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 529 197 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 732 423 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 666 48 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 912 998 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 25 576 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 44 353 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 365 763 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 443 951 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 650 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 525 64 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 529 197 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 732 423 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 666 48 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 912 998 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"7": 7,
"8": 8,
"9": 9,
"10": 10,
"12": 12,
"13": 13
},
"parsed_object_count": 10,
"parsed_interaction_count": 13
},
{
"frame_index": 18,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 1 271 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 29 595 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 388 767 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 529 56 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 517 208 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 771 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 708 173 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 888 998 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 1 271 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 29 595 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 388 767 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 529 56 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 517 208 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 771 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 708 173 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 888 998 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"4": 4,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"13": 13
},
"parsed_object_count": 8,
"parsed_interaction_count": 11
},
{
"frame_index": 19,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 1 291 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 29 583 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 41 361 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 349 771 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 458 955 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 486 388 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 521 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 505 220 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 787 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 705 181 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 685 44 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 908 994 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 6 9 [OUT] 6 9 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 7 10 [OUT] 7 10 [INTERACT] 11 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 1 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 1 291 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 29 583 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 41 361 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 349 771 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 458 955 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 486 388 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 521 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 505 220 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 787 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 705 181 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 685 44 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 908 994 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 6 9 [OUT] 6 9 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 7 10 [OUT] 7 10 [INTERACT] 11 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 1 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12,
"13": 13
},
"parsed_object_count": 12,
"parsed_interaction_count": 14
},
{
"frame_index": 20,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 null null [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 33 595 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 369 771 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 474 951 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 505 68 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 482 232 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 806 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 697 173 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 708 29 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 923 994 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 null null [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 33 595 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 369 771 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 474 951 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 505 68 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 482 232 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 806 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 697 173 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 708 29 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 923 994 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"4": 4,
"5": 5,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12,
"13": 13
},
"parsed_object_count": 10,
"parsed_interaction_count": 12
},
{
"frame_index": 21,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 37 376 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 298 783 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 486 951 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 658 638 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 494 72 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 458 255 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 830 427 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 720 17 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 970 990 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 4 [OUT] 2 4 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 37 376 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 298 783 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 486 951 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 658 638 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 494 72 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 458 255 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 830 427 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 720 17 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 970 990 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 4 [OUT] 2 4 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"3": 3,
"4": 4,
"5": 5,
"7": 7,
"8": 8,
"9": 9,
"10": 10,
"12": 12,
"13": 13
},
"parsed_object_count": 9,
"parsed_interaction_count": 12
},
{
"frame_index": 22,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 396 775 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 478 400 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 427 279 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 677 404 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 689 181 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 728 9 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 978 986 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 396 775 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 478 400 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 427 279 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 677 404 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 689 181 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 728 9 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 978 986 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"4": 4,
"6": 6,
"9": 9,
"10": 10,
"11": 11,
"12": 12,
"13": 13
},
"parsed_object_count": 7,
"parsed_interaction_count": 11
},
{
"frame_index": 23,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 41 603 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 29 373 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 498 955 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 662 630 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 482 76 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 400 291 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 681 193 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 41 603 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 29 373 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 498 955 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 662 630 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 482 76 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 400 291 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 681 193 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"3": 3,
"5": 5,
"7": 7,
"8": 8,
"9": 9,
"11": 11
},
"parsed_object_count": 7,
"parsed_interaction_count": 9
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "red ceramic planter" 0 24 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 "black canvas boat shoe with white sole" 0 24 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 15 9 267 18 1 271 19 1 291 20 null null [OBJ] 2 "purple and pink fabric sneaker" 0 24 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 14 41 466 15 33 482 16 25 494 17 25 576 18 29 595 19 29 583 20 33 595 23 41 603 [OBJ] 3 "grey, purple, and mint green high-top sneaker" 0 24 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 14 48 345 17 44 353 19 41 361 21 37 376 23 29 373 [OBJ] 4 "white Lego Creationary game box" 0 24 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 14 314 755 15 255 763 16 322 763 17 365 763 18 388 767 19 349 771 20 369 771 21 298 783 22 396 775 [OBJ] 5 "white and green cardboard ink cartridge box" 0 24 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 14 404 951 15 423 951 17 443 951 19 458 955 20 474 951 21 486 951 23 498 955 [OBJ] 6 "black laptop" 0 24 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 19 486 388 22 478 400 [OBJ] 7 "beige fabric pencil case with horse print" 0 24 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 14 638 642 17 650 642 21 658 638 23 662 630 [OBJ] 8 "blue and orange plastic Therizinosaurus figurine" 0 24 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 16 541 56 17 525 64 18 529 56 19 521 60 20 505 68 21 494 72 23 482 76 [OBJ] 9 "black cardboard panty liner box" 0 24 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 14 576 189 15 560 185 16 544 189 17 529 197 18 517 208 19 505 220 20 482 232 21 458 255 22 427 279 23 400 291 [OBJ] 10 "light blue and green cardboard fruit snack box" 0 24 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 16 720 423 17 732 423 18 771 427 19 787 427 20 806 427 21 830 427 22 677 404 [OBJ] 11 "silver leather boat shoe" 0 24 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 16 716 177 18 708 173 19 705 181 20 697 173 22 689 181 23 681 193 [OBJ] 12 "wooden toy railroad crossing" 1 24 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 14 603 76 15 626 60 17 666 48 19 685 44 20 708 29 21 720 17 22 728 9 [OBJ] 13 "white plastic supplement bottle" 17 24 [PX] 0 null null 17 912 998 18 888 998 19 908 994 20 923 994 21 970 990 22 978 986 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 "contact" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 1 "contact" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 2 "contact" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 3 "contact" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 4 "contact" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 5 "contact" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 6 "contact" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 7 "contact" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 8 "contact" 0 1 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 9 "contact" 0 3 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 10 "contact" 0 3 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 11 "contact" 0 5 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 12 "contact" 0 7 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 13 "contact" 0 10 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 14 "contact" 0 20 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 15 "collision" 1 1 [IN] 9 11 [OUT] 9 11 [INTERACT] 16 "collision" 1 2 [IN] 65535 [OUT] 65535 [INTERACT] 17 "collision" 2 2 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 18 "collision" 2 3 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 19 "collision" 2 3 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 20 "collision" 3 3 [IN] 6 10 [OUT] 6 10 [INTERACT] 21 "collision" 3 3 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 22 "collision" 3 3 [IN] 9 11 [OUT] 9 11 [INTERACT] 23 "collision" 3 3 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 24 "collision" 3 3 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 25 "collision" 4 4 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 26 "collision" 4 5 [IN] 65535 [OUT] 65535 [INTERACT] 27 "contact" 4 5 [IN] 6 10 [OUT] 6 10 [INTERACT] 28 "contact" 4 5 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 29 "contact" 4 9 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 30 "collision" 5 5 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 31 "contact" 5 7 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 32 "collision" 6 6 [IN] 1 3 [OUT] 1 3 [INTERACT] 33 "collision" 6 6 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 34 "collision" 6 7 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 35 "collision" 6 7 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 36 "collision" 7 7 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 37 "collision" 7 7 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 38 "collision" 7 7 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 39 "collision" 7 7 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 40 "collision" 8 8 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 41 "collision" 8 8 [IN] 65535 [OUT] 65535 [INTERACT] 42 "collision" 9 9 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 43 "collision" 9 9 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 44 "collision" 9 9 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 45 "collision" 9 9 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 46 "collision" 9 10 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 47 "contact" 9 12 [IN] 65535 [OUT] 65535 [INTERACT] 48 "collision" 10 10 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 49 "collision" 10 10 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 50 "collision" 10 11 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 51 "collision" 11 11 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 52 "collision" 11 11 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 53 "collision" 11 12 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 54 "contact" 11 12 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 55 "collision" 12 12 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 56 "collision" 12 13 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 57 "collision" 12 13 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 58 "contact" 12 18 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 59 "collision" 13 13 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 60 "collision" 13 13 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 61 "collision" 13 13 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 62 "collision" 13 14 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 63 "collision" 13 14 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 64 "collision" 14 14 [IN] 2 [OUT] 2 [INTERACT] 65 "collision" 14 14 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 66 "collision" 14 14 [IN] 65535 [OUT] 65535 [INTERACT] 67 "collision" 14 15 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 68 "collision" 15 15 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 69 "contact" 15 22 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 70 "collision" 16 16 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 71 "collision" 16 16 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 72 "collision" 16 16 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 73 "collision" 16 16 [IN] 65535 [OUT] 65535 [INTERACT] 74 "collision" 17 17 [IN] 2 [OUT] 2 [INTERACT] 75 "collision" 17 17 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 76 "collision" 17 17 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 77 "collision" 17 17 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 78 "collision" 17 17 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 79 "contact" 17 21 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 80 "contact" 17 22 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 81 "contact" 17 23 [IN] 65535 [OUT] 65535 [INTERACT] 82 "collision" 18 18 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 83 "collision" 18 18 [IN] 9 10 [OUT] 9 10 [INTERACT] 84 "collision" 18 19 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 85 "contact" 18 22 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 86 "collision" 19 19 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 87 "collision" 19 19 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 88 "collision" 19 19 [IN] 6 9 [OUT] 6 9 [INTERACT] 89 "collision" 19 19 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 90 "collision" 19 19 [IN] 10 [OUT] 10 [INTERACT] 91 "contact" 19 20 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 92 "contact" 19 20 [IN] 9 10 [OUT] 9 10 [INTERACT] 93 "collision" 20 20 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 94 "contact" 20 21 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 95 "collision" 21 21 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 96 "collision" 21 21 [IN] 4 [OUT] 4 [INTERACT] 97 "collision" 21 21 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 98 "contact" 21 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 99 "collision" 22 22 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 100 "collision" 22 22 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 101 "collision" 22 22 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 102 "collision" 23 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 103 "collision" 23 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 104 "collision" 23 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 105 "collision" 23 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 106 "collision" 23 23 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 52,
"y": 83
},
{
"t": 1,
"x": 41,
"y": 87
},
{
"t": 2,
"x": 21,
"y": 72
},
{
"t": 3,
"x": 33,
"y": 95
},
{
"t": 6,
"x": 25,
"y": 99
},
{
"t": 7,
"x": 17,
"y": 95
},
{
"t": 10,
"x": 5,
"y": 99
},
{
"t": 11,
"x": 1,
"y": 107
},
{
"t": 12,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "red ceramic planter"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 72,
"y": 263
},
{
"t": 1,
"x": 64,
"y": 267
},
{
"t": 2,
"x": 56,
"y": 271
},
{
"t": 3,
"x": 48,
"y": 275
},
{
"t": 4,
"x": 25,
"y": 291
},
{
"t": 5,
"x": 21,
"y": 283
},
{
"t": 6,
"x": 44,
"y": 259
},
{
"t": 7,
"x": 33,
"y": 271
},
{
"t": 9,
"x": 25,
"y": 267
},
{
"t": 13,
"x": 13,
"y": 259
},
{
"t": 15,
"x": 9,
"y": 267
},
{
"t": 18,
"x": 1,
"y": 271
},
{
"t": 19,
"x": 1,
"y": 291
},
{
"t": 20,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 99,
"y": 392
},
{
"t": 1,
"x": 68,
"y": 396
},
{
"t": 2,
"x": 60,
"y": 400
},
{
"t": 3,
"x": 87,
"y": 400
},
{
"t": 4,
"x": 80,
"y": 404
},
{
"t": 5,
"x": 72,
"y": 408
},
{
"t": 6,
"x": 64,
"y": 412
},
{
"t": 7,
"x": 48,
"y": 427
},
{
"t": 8,
"x": 41,
"y": 439
},
{
"t": 9,
"x": 91,
"y": 439
},
{
"t": 10,
"x": 80,
"y": 439
},
{
"t": 11,
"x": 72,
"y": 443
},
{
"t": 12,
"x": 60,
"y": 451
},
{
"t": 13,
"x": 52,
"y": 455
},
{
"t": 14,
"x": 41,
"y": 466
},
{
"t": 15,
"x": 33,
"y": 482
},
{
"t": 16,
"x": 25,
"y": 494
},
{
"t": 17,
"x": 25,
"y": 576
},
{
"t": 18,
"x": 29,
"y": 595
},
{
"t": 19,
"x": 29,
"y": 583
},
{
"t": 20,
"x": 33,
"y": 595
},
{
"t": 23,
"x": 41,
"y": 603
}
],
"birth": 0,
"death": 24,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 216,
"y": 138
},
{
"t": 1,
"x": 189,
"y": 150
},
{
"t": 2,
"x": 169,
"y": 162
},
{
"t": 3,
"x": 142,
"y": 193
},
{
"t": 4,
"x": 126,
"y": 220
},
{
"t": 5,
"x": 95,
"y": 271
},
{
"t": 6,
"x": 83,
"y": 310
},
{
"t": 7,
"x": 99,
"y": 330
},
{
"t": 8,
"x": 60,
"y": 353
},
{
"t": 9,
"x": 52,
"y": 349
},
{
"t": 10,
"x": 41,
"y": 337
},
{
"t": 13,
"x": 56,
"y": 349
},
{
"t": 14,
"x": 48,
"y": 345
},
{
"t": 17,
"x": 44,
"y": 353
},
{
"t": 19,
"x": 41,
"y": 361
},
{
"t": 21,
"x": 37,
"y": 376
},
{
"t": 23,
"x": 29,
"y": 373
}
],
"birth": 0,
"death": 24,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 228,
"y": 701
},
{
"t": 2,
"x": 275,
"y": 716
},
{
"t": 3,
"x": 232,
"y": 716
},
{
"t": 6,
"x": 341,
"y": 736
},
{
"t": 7,
"x": 236,
"y": 732
},
{
"t": 10,
"x": 236,
"y": 744
},
{
"t": 12,
"x": 244,
"y": 751
},
{
"t": 14,
"x": 314,
"y": 755
},
{
"t": 15,
"x": 255,
"y": 763
},
{
"t": 16,
"x": 322,
"y": 763
},
{
"t": 17,
"x": 365,
"y": 763
},
{
"t": 18,
"x": 388,
"y": 767
},
{
"t": 19,
"x": 349,
"y": 771
},
{
"t": 20,
"x": 369,
"y": 771
},
{
"t": 21,
"x": 298,
"y": 783
},
{
"t": 22,
"x": 396,
"y": 775
}
],
"birth": 0,
"death": 24,
"type": "white Lego Creationary game box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 259,
"y": 923
},
{
"t": 1,
"x": 287,
"y": 927
},
{
"t": 2,
"x": 302,
"y": 927
},
{
"t": 3,
"x": 318,
"y": 931
},
{
"t": 4,
"x": 330,
"y": 931
},
{
"t": 5,
"x": 337,
"y": 935
},
{
"t": 7,
"x": 353,
"y": 939
},
{
"t": 9,
"x": 365,
"y": 943
},
{
"t": 11,
"x": 373,
"y": 947
},
{
"t": 12,
"x": 400,
"y": 943
},
{
"t": 14,
"x": 404,
"y": 951
},
{
"t": 15,
"x": 423,
"y": 951
},
{
"t": 17,
"x": 443,
"y": 951
},
{
"t": 19,
"x": 458,
"y": 955
},
{
"t": 20,
"x": 474,
"y": 951
},
{
"t": 21,
"x": 486,
"y": 951
},
{
"t": 23,
"x": 498,
"y": 955
}
],
"birth": 0,
"death": 24,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 525,
"y": 404
},
{
"t": 3,
"x": 529,
"y": 396
},
{
"t": 4,
"x": 521,
"y": 400
},
{
"t": 5,
"x": 529,
"y": 392
},
{
"t": 7,
"x": 513,
"y": 396
},
{
"t": 9,
"x": 509,
"y": 388
},
{
"t": 10,
"x": 501,
"y": 392
},
{
"t": 12,
"x": 505,
"y": 384
},
{
"t": 13,
"x": 498,
"y": 392
},
{
"t": 19,
"x": 486,
"y": 388
},
{
"t": 22,
"x": 478,
"y": 400
}
],
"birth": 0,
"death": 24,
"type": "black laptop"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 587,
"y": 658
},
{
"t": 1,
"x": 595,
"y": 650
},
{
"t": 2,
"x": 587,
"y": 662
},
{
"t": 3,
"x": 599,
"y": 646
},
{
"t": 6,
"x": 595,
"y": 654
},
{
"t": 8,
"x": 607,
"y": 642
},
{
"t": 10,
"x": 611,
"y": 650
},
{
"t": 11,
"x": 623,
"y": 642
},
{
"t": 13,
"x": 630,
"y": 646
},
{
"t": 14,
"x": 638,
"y": 642
},
{
"t": 17,
"x": 650,
"y": 642
},
{
"t": 21,
"x": 658,
"y": 638
},
{
"t": 23,
"x": 662,
"y": 630
}
],
"birth": 0,
"death": 24,
"type": "beige fabric pencil case with horse print"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 68
},
{
"t": 2,
"x": 626,
"y": 68
},
{
"t": 4,
"x": 619,
"y": 64
},
{
"t": 5,
"x": 607,
"y": 64
},
{
"t": 6,
"x": 615,
"y": 52
},
{
"t": 7,
"x": 599,
"y": 60
},
{
"t": 9,
"x": 583,
"y": 60
},
{
"t": 11,
"x": 568,
"y": 60
},
{
"t": 13,
"x": 552,
"y": 60
},
{
"t": 16,
"x": 541,
"y": 56
},
{
"t": 17,
"x": 525,
"y": 64
},
{
"t": 18,
"x": 529,
"y": 56
},
{
"t": 19,
"x": 521,
"y": 60
},
{
"t": 20,
"x": 505,
"y": 68
},
{
"t": 21,
"x": 494,
"y": 72
},
{
"t": 23,
"x": 482,
"y": 76
}
],
"birth": 0,
"death": 24,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 744,
"y": 91
},
{
"t": 1,
"x": 732,
"y": 83
},
{
"t": 3,
"x": 716,
"y": 91
},
{
"t": 4,
"x": 701,
"y": 115
},
{
"t": 5,
"x": 685,
"y": 146
},
{
"t": 6,
"x": 673,
"y": 169
},
{
"t": 7,
"x": 658,
"y": 185
},
{
"t": 8,
"x": 646,
"y": 173
},
{
"t": 9,
"x": 630,
"y": 177
},
{
"t": 11,
"x": 607,
"y": 177
},
{
"t": 12,
"x": 599,
"y": 185
},
{
"t": 13,
"x": 583,
"y": 181
},
{
"t": 14,
"x": 576,
"y": 189
},
{
"t": 15,
"x": 560,
"y": 185
},
{
"t": 16,
"x": 544,
"y": 189
},
{
"t": 17,
"x": 529,
"y": 197
},
{
"t": 18,
"x": 517,
"y": 208
},
{
"t": 19,
"x": 505,
"y": 220
},
{
"t": 20,
"x": 482,
"y": 232
},
{
"t": 21,
"x": 458,
"y": 255
},
{
"t": 22,
"x": 427,
"y": 279
},
{
"t": 23,
"x": 400,
"y": 291
}
],
"birth": 0,
"death": 24,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 751,
"y": 486
},
{
"t": 1,
"x": 658,
"y": 427
},
{
"t": 2,
"x": 681,
"y": 439
},
{
"t": 3,
"x": 693,
"y": 443
},
{
"t": 4,
"x": 712,
"y": 451
},
{
"t": 5,
"x": 759,
"y": 474
},
{
"t": 7,
"x": 716,
"y": 443
},
{
"t": 9,
"x": 736,
"y": 447
},
{
"t": 10,
"x": 720,
"y": 439
},
{
"t": 11,
"x": 771,
"y": 451
},
{
"t": 12,
"x": 806,
"y": 455
},
{
"t": 13,
"x": 705,
"y": 427
},
{
"t": 16,
"x": 720,
"y": 423
},
{
"t": 17,
"x": 732,
"y": 423
},
{
"t": 18,
"x": 771,
"y": 427
},
{
"t": 19,
"x": 787,
"y": 427
},
{
"t": 20,
"x": 806,
"y": 427
},
{
"t": 21,
"x": 830,
"y": 427
},
{
"t": 22,
"x": 677,
"y": 404
}
],
"birth": 0,
"death": 24,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 798,
"y": 216
},
{
"t": 1,
"x": 791,
"y": 220
},
{
"t": 2,
"x": 787,
"y": 208
},
{
"t": 3,
"x": 779,
"y": 216
},
{
"t": 4,
"x": 775,
"y": 205
},
{
"t": 5,
"x": 771,
"y": 193
},
{
"t": 6,
"x": 763,
"y": 208
},
{
"t": 7,
"x": 759,
"y": 193
},
{
"t": 9,
"x": 751,
"y": 185
},
{
"t": 11,
"x": 744,
"y": 181
},
{
"t": 13,
"x": 732,
"y": 177
},
{
"t": 16,
"x": 716,
"y": 177
},
{
"t": 18,
"x": 708,
"y": 173
},
{
"t": 19,
"x": 705,
"y": 181
},
{
"t": 20,
"x": 697,
"y": 173
},
{
"t": 22,
"x": 689,
"y": 181
},
{
"t": 23,
"x": 681,
"y": 193
}
],
"birth": 0,
"death": 24,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 1,
"x": 1,
"y": 1
},
{
"t": 2,
"x": 72,
"y": 5
},
{
"t": 3,
"x": 138,
"y": 5
},
{
"t": 4,
"x": 205,
"y": 9
},
{
"t": 5,
"x": 263,
"y": 25
},
{
"t": 6,
"x": 314,
"y": 48
},
{
"t": 7,
"x": 361,
"y": 76
},
{
"t": 8,
"x": 404,
"y": 107
},
{
"t": 9,
"x": 435,
"y": 138
},
{
"t": 10,
"x": 470,
"y": 162
},
{
"t": 11,
"x": 501,
"y": 158
},
{
"t": 12,
"x": 498,
"y": 130
},
{
"t": 13,
"x": 529,
"y": 111
},
{
"t": 14,
"x": 603,
"y": 76
},
{
"t": 15,
"x": 626,
"y": 60
},
{
"t": 17,
"x": 666,
"y": 48
},
{
"t": 19,
"x": 685,
"y": 44
},
{
"t": 20,
"x": 708,
"y": 29
},
{
"t": 21,
"x": 720,
"y": 17
},
{
"t": 22,
"x": 728,
"y": 9
}
],
"birth": 1,
"death": 24,
"type": "wooden toy railroad crossing"
},
{
"id": 13,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 17,
"x": 912,
"y": 998
},
{
"t": 18,
"x": 888,
"y": 998
},
{
"t": 19,
"x": 908,
"y": 994
},
{
"t": 20,
"x": 923,
"y": 994
},
{
"t": 21,
"x": 970,
"y": 990
},
{
"t": 22,
"x": 978,
"y": 986
}
],
"birth": 17,
"death": 24,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 1,
"type": "contact"
},
{
"id": 9,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 3,
"type": "contact"
},
{
"id": 10,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 3,
"type": "contact"
},
{
"id": 11,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 5,
"type": "contact"
},
{
"id": 12,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 7,
"type": "contact"
},
{
"id": 13,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 14,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 20,
"type": "contact"
},
{
"id": 15,
"inputs": [
9,
11
],
"outputs": [
9,
11
],
"begins_at": 1,
"ends_at": 1,
"type": "collision"
},
{
"id": 16,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 1,
"ends_at": 2,
"type": "collision"
},
{
"id": 17,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 18,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 2,
"ends_at": 3,
"type": "collision"
},
{
"id": 19,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 2,
"ends_at": 3,
"type": "collision"
},
{
"id": 20,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 21,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 22,
"inputs": [
9,
11
],
"outputs": [
9,
11
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 23,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 24,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 25,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 26,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 4,
"ends_at": 5,
"type": "collision"
},
{
"id": 27,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 4,
"ends_at": 5,
"type": "contact"
},
{
"id": 28,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 4,
"ends_at": 5,
"type": "contact"
},
{
"id": 29,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 4,
"ends_at": 9,
"type": "contact"
},
{
"id": 30,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 31,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 5,
"ends_at": 7,
"type": "contact"
},
{
"id": 32,
"inputs": [
1,
3
],
"outputs": [
1,
3
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 33,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 34,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 6,
"ends_at": 7,
"type": "collision"
},
{
"id": 35,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 6,
"ends_at": 7,
"type": "collision"
},
{
"id": 36,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 37,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 38,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 39,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 40,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 41,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 42,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 43,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 44,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 45,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 46,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 9,
"ends_at": 10,
"type": "collision"
},
{
"id": 47,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 9,
"ends_at": 12,
"type": "contact"
},
{
"id": 48,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 49,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 50,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 10,
"ends_at": 11,
"type": "collision"
},
{
"id": 51,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 52,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 53,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 11,
"ends_at": 12,
"type": "collision"
},
{
"id": 54,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 11,
"ends_at": 12,
"type": "contact"
},
{
"id": 55,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 56,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 12,
"ends_at": 13,
"type": "collision"
},
{
"id": 57,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 12,
"ends_at": 13,
"type": "collision"
},
{
"id": 58,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 12,
"ends_at": 18,
"type": "contact"
},
{
"id": 59,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 60,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 61,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 62,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 13,
"ends_at": 14,
"type": "collision"
},
{
"id": 63,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 13,
"ends_at": 14,
"type": "collision"
},
{
"id": 64,
"inputs": [
2
],
"outputs": [
2
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 65,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 66,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 67,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 14,
"ends_at": 15,
"type": "collision"
},
{
"id": 68,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 69,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 15,
"ends_at": 22,
"type": "contact"
},
{
"id": 70,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 71,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 72,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 73,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 74,
"inputs": [
2
],
"outputs": [
2
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 75,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 76,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 77,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 78,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 79,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 17,
"ends_at": 21,
"type": "contact"
},
{
"id": 80,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 17,
"ends_at": 22,
"type": "contact"
},
{
"id": 81,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 17,
"ends_at": 23,
"type": "contact"
},
{
"id": 82,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 83,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 84,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 18,
"ends_at": 19,
"type": "collision"
},
{
"id": 85,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 18,
"ends_at": 22,
"type": "contact"
},
{
"id": 86,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 87,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 88,
"inputs": [
6,
9
],
"outputs": [
6,
9
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 89,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 90,
"inputs": [
10
],
"outputs": [
10
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 91,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 19,
"ends_at": 20,
"type": "contact"
},
{
"id": 92,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 19,
"ends_at": 20,
"type": "contact"
},
{
"id": 93,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 94,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 20,
"ends_at": 21,
"type": "contact"
},
{
"id": 95,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 96,
"inputs": [
4
],
"outputs": [
4
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 97,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 98,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 21,
"ends_at": 23,
"type": "contact"
},
{
"id": 99,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 100,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 101,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 102,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
},
{
"id": 103,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
},
{
"id": 104,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
},
{
"id": 105,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
},
{
"id": 106,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 1.0,
"avg_image_position_segmentation_acc_small": 1.0,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 1.0,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": 1.0,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 1.0,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 1.0,
"num_matches": 14,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.6450487012987013,
"avg_interaction_input_object_jaccard": 0.2976190476190475,
"avg_interaction_output_object_jaccard": 0.2976190476190475,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 28,
"num_unmatched_pred_interactions": 79,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 23,
"false_positives": 84,
"false_negatives": 0
},
"0.5": {
"true_positives": 17,
"false_positives": 90,
"false_negatives": 0
},
"0.75": {
"true_positives": 14,
"false_positives": 93,
"false_negatives": 0
},
"1.0": {
"true_positives": 12,
"false_positives": 95,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.21495327102803738,
"0.5": 0.1588785046728972,
"0.75": 0.1308411214953271,
"1.0": 0.11214953271028037
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.35384615384615387,
"0.5": 0.27419354838709675,
"0.75": 0.23140495867768593,
"1.0": 0.20168067226890757
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 22,
"false_positives": 85,
"false_negatives": 0
},
"0.5": {
"true_positives": 3,
"false_positives": 104,
"false_negatives": 0
},
"0.75": {
"true_positives": 1,
"false_positives": 106,
"false_negatives": 0
},
"1.0": {
"true_positives": 1,
"false_positives": 106,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.205607476635514,
"0.5": 0.028037383177570093,
"0.75": 0.009345794392523364,
"1.0": 0.009345794392523364
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.34108527131782945,
"0.5": 0.05454545454545455,
"0.75": 0.018518518518518517,
"1.0": 0.018518518518518517
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 22,
"false_positives": 85,
"false_negatives": 0
},
"0.5": {
"true_positives": 3,
"false_positives": 104,
"false_negatives": 0
},
"0.75": {
"true_positives": 1,
"false_positives": 106,
"false_negatives": 0
},
"1.0": {
"true_positives": 1,
"false_positives": 106,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.205607476635514,
"0.5": 0.028037383177570093,
"0.75": 0.009345794392523364,
"1.0": 0.009345794392523364
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.34108527131782945,
"0.5": 0.05454545454545455,
"0.75": 0.018518518518518517,
"1.0": 0.018518518518518517
}
}
}Prompt
<video> Analyze the provided video and return ONLY a valid sentinel sequence in this format: [SCENE-START] [OBJS-START] [OBJ] id "type" birth death [PX] t px py ... [OBJ] ... [OBJS-END] [INTERACTIONS-START] [INTERACT] id "type" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ... [INTERACT] ... [INTERACTIONS-END] [SCENE-END] Constraints: - Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose). - Keep tags exactly as written: `[SCENE-START] [OBJS-START] [OBJ] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]` - Use quoted strings for `type` (double quotes). - `PX` uses repeated groups of 3 values in order: `t px py`. - `t` is the timestamp (frame number). - `px` and `py` are the pixel coordinates of the object in that frame, normalized to [0,1] relative to the frame dimensions, scaled by 1000 and rounded to the nearest integer. For example, `px` of 0.1234 would be represented as 123. - When an object is occluded or not visible in a frame, `PX` may use `t null null`. - `IN` and `OUT` contain whitespace-separated integer ids.
B1 cache + injected GT identity map
B2 consumed the persisted B1-oracle frame cache. Its learned mapper call was bypassed at every streaming step and replaced with the shown stable-ID → detector-ID identity map; the ordinary staged merger still produced the final interaction prediction.
Every persisted/reconstructed prefill step
[
{
"frame_index": 0,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 52 83 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 72 263 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 99 392 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 216 138 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 228 701 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 259 923 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 525 404 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 587 658 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 646 68 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 744 91 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 751 486 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 798 216 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 null null [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 11 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 52 83 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 72 263 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 99 392 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 216 138 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 228 701 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 259 923 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 525 404 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 587 658 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 646 68 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 744 91 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 751 486 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 798 216 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 null null [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 11 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 52,
"y": 83
}
],
"birth": 0,
"death": 1,
"type": "red ceramic planter"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 72,
"y": 263
}
],
"birth": 0,
"death": 1,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 99,
"y": 392
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 216,
"y": 138
}
],
"birth": 0,
"death": 1,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 228,
"y": 701
}
],
"birth": 0,
"death": 1,
"type": "white Lego Creationary game box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 259,
"y": 923
}
],
"birth": 0,
"death": 1,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 525,
"y": 404
}
],
"birth": 0,
"death": 1,
"type": "black laptop"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 587,
"y": 658
}
],
"birth": 0,
"death": 1,
"type": "beige fabric pencil case with horse print"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 68
}
],
"birth": 0,
"death": 1,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 744,
"y": 91
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 751,
"y": 486
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 798,
"y": 216
}
],
"birth": 0,
"death": 1,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
},
{
"id": 13,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
}
],
"birth": 0,
"death": 1,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 11,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 12,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 13,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 14,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12,
"13": 13
},
"mapping_note": "identity_ids=True initialization; mapper not called",
"mapper_called": false
},
{
"frame_index": 1,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 41 87 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 64 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 68 396 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 189 150 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 287 927 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 595 650 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 732 83 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 658 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 791 220 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 1 1 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 11 [OUT] 9 11 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 41 87 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 64 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 68 396 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 189 150 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 287 927 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 595 650 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 732 83 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 658 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 791 220 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 1 1 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 11 [OUT] 9 11 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 41,
"y": 87
}
],
"birth": 0,
"death": 1,
"type": "red ceramic planter"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 64,
"y": 267
}
],
"birth": 0,
"death": 1,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 68,
"y": 396
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 189,
"y": 150
}
],
"birth": 0,
"death": 1,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 287,
"y": 927
}
],
"birth": 0,
"death": 1,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 595,
"y": 650
}
],
"birth": 0,
"death": 1,
"type": "beige fabric pencil case with horse print"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 732,
"y": 83
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 658,
"y": 427
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 791,
"y": 220
}
],
"birth": 0,
"death": 1,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 1,
"y": 1
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
11
],
"outputs": [
9,
11
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"5": 5,
"7": 7,
"9": 9,
"10": 10,
"11": 11,
"12": 12
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 2,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 21 72 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 56 271 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 60 400 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 169 162 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 275 716 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 302 927 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 587 662 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 626 68 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 681 439 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 787 208 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 72 5 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 21 72 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 56 271 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 60 400 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 169 162 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 275 716 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 302 927 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 587 662 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 626 68 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 681 439 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 787 208 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 72 5 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 21,
"y": 72
}
],
"birth": 0,
"death": 1,
"type": "red ceramic planter"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 56,
"y": 271
}
],
"birth": 0,
"death": 1,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 60,
"y": 400
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 169,
"y": 162
}
],
"birth": 0,
"death": 1,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 275,
"y": 716
}
],
"birth": 0,
"death": 1,
"type": "white Lego Creationary game box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 302,
"y": 927
}
],
"birth": 0,
"death": 1,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 587,
"y": 662
}
],
"birth": 0,
"death": 1,
"type": "beige fabric pencil case with horse print"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 626,
"y": 68
}
],
"birth": 0,
"death": 1,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 681,
"y": 439
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 787,
"y": 208
}
],
"birth": 0,
"death": 1,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 72,
"y": 5
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"7": 7,
"8": 8,
"10": 10,
"11": 11,
"12": 12
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 3,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 33 95 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 48 275 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 87 400 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 142 193 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 232 716 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 318 931 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 529 396 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 599 646 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 716 91 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 693 443 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 779 216 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 138 5 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 11 [OUT] 9 11 [INTERACT] 12 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 33 95 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 48 275 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 87 400 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 142 193 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 232 716 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 318 931 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 529 396 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 599 646 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 716 91 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 693 443 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 779 216 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 138 5 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 11 [OUT] 9 11 [INTERACT] 12 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 33,
"y": 95
}
],
"birth": 0,
"death": 1,
"type": "red ceramic planter"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 48,
"y": 275
}
],
"birth": 0,
"death": 1,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 87,
"y": 400
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 142,
"y": 193
}
],
"birth": 0,
"death": 1,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 232,
"y": 716
}
],
"birth": 0,
"death": 1,
"type": "white Lego Creationary game box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 318,
"y": 931
}
],
"birth": 0,
"death": 1,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 529,
"y": 396
}
],
"birth": 0,
"death": 1,
"type": "black laptop"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 599,
"y": 646
}
],
"birth": 0,
"death": 1,
"type": "beige fabric pencil case with horse print"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 716,
"y": 91
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 693,
"y": 443
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 779,
"y": 216
}
],
"birth": 0,
"death": 1,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 138,
"y": 5
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 11,
"inputs": [
9,
11
],
"outputs": [
9,
11
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 12,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"9": 9,
"10": 10,
"11": 11,
"12": 12
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 4,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 25 291 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 80 404 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 126 220 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 330 931 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 521 400 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 619 64 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 701 115 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 712 451 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 775 205 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 205 9 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 25 291 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 80 404 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 126 220 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 330 931 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 521 400 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 619 64 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 701 115 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 712 451 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 775 205 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 205 9 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 25,
"y": 291
}
],
"birth": 0,
"death": 1,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 80,
"y": 404
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 126,
"y": 220
}
],
"birth": 0,
"death": 1,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 330,
"y": 931
}
],
"birth": 0,
"death": 1,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 521,
"y": 400
}
],
"birth": 0,
"death": 1,
"type": "black laptop"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 619,
"y": 64
}
],
"birth": 0,
"death": 1,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 701,
"y": 115
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 712,
"y": 451
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 775,
"y": 205
}
],
"birth": 0,
"death": 1,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 205,
"y": 9
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"5": 5,
"6": 6,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 5,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 21 283 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 72 408 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 95 271 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 337 935 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 529 392 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 607 64 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 685 146 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 759 474 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 771 193 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 263 25 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 21 283 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 72 408 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 95 271 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 337 935 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 529 392 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 607 64 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 685 146 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 759 474 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 771 193 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 263 25 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 21,
"y": 283
}
],
"birth": 0,
"death": 1,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 72,
"y": 408
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 95,
"y": 271
}
],
"birth": 0,
"death": 1,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 337,
"y": 935
}
],
"birth": 0,
"death": 1,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 529,
"y": 392
}
],
"birth": 0,
"death": 1,
"type": "black laptop"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 607,
"y": 64
}
],
"birth": 0,
"death": 1,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 685,
"y": 146
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 759,
"y": 474
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 771,
"y": 193
}
],
"birth": 0,
"death": 1,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 263,
"y": 25
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"5": 5,
"6": 6,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 6,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 25 99 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 44 259 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 64 412 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 83 310 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 341 736 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 595 654 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 615 52 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 673 169 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 763 208 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 314 48 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 3 [OUT] 1 3 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 25 99 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 44 259 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 64 412 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 83 310 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 341 736 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 595 654 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 615 52 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 673 169 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 763 208 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 314 48 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 3 [OUT] 1 3 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 25,
"y": 99
}
],
"birth": 0,
"death": 1,
"type": "red ceramic planter"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 44,
"y": 259
}
],
"birth": 0,
"death": 1,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 64,
"y": 412
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 83,
"y": 310
}
],
"birth": 0,
"death": 1,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 341,
"y": 736
}
],
"birth": 0,
"death": 1,
"type": "white Lego Creationary game box"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 595,
"y": 654
}
],
"birth": 0,
"death": 1,
"type": "beige fabric pencil case with horse print"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 615,
"y": 52
}
],
"birth": 0,
"death": 1,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 673,
"y": 169
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 763,
"y": 208
}
],
"birth": 0,
"death": 1,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 314,
"y": 48
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
3
],
"outputs": [
1,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"7": 7,
"8": 8,
"9": 9,
"11": 11,
"12": 12
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 7,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 17 95 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 33 271 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 48 427 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 99 330 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 236 732 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 353 939 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 513 396 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 599 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 658 185 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 716 443 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 759 193 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 361 76 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 17 95 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 33 271 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 48 427 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 99 330 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 236 732 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 353 939 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 513 396 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 599 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 658 185 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 716 443 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 759 193 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 361 76 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 17,
"y": 95
}
],
"birth": 0,
"death": 1,
"type": "red ceramic planter"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 33,
"y": 271
}
],
"birth": 0,
"death": 1,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 48,
"y": 427
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 99,
"y": 330
}
],
"birth": 0,
"death": 1,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 236,
"y": 732
}
],
"birth": 0,
"death": 1,
"type": "white Lego Creationary game box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 353,
"y": 939
}
],
"birth": 0,
"death": 1,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 513,
"y": 396
}
],
"birth": 0,
"death": 1,
"type": "black laptop"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 599,
"y": 60
}
],
"birth": 0,
"death": 1,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 658,
"y": 185
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 716,
"y": 443
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 759,
"y": 193
}
],
"birth": 0,
"death": 1,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 361,
"y": 76
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 8,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 41 439 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 60 353 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 607 642 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 646 173 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 404 107 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 41 439 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 60 353 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 607 642 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 646 173 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 404 107 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 41,
"y": 439
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 60,
"y": 353
}
],
"birth": 0,
"death": 1,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 607,
"y": 642
}
],
"birth": 0,
"death": 1,
"type": "beige fabric pencil case with horse print"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 173
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 404,
"y": 107
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"3": 3,
"7": 7,
"9": 9,
"12": 12
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 9,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 25 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 91 439 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 52 349 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 365 943 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 509 388 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 583 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 630 177 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 736 447 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 751 185 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 435 138 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 25 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 91 439 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 52 349 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 365 943 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 509 388 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 583 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 630 177 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 736 447 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 751 185 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 435 138 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 25,
"y": 267
}
],
"birth": 0,
"death": 1,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 91,
"y": 439
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 52,
"y": 349
}
],
"birth": 0,
"death": 1,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 365,
"y": 943
}
],
"birth": 0,
"death": 1,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 509,
"y": 388
}
],
"birth": 0,
"death": 1,
"type": "black laptop"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 583,
"y": 60
}
],
"birth": 0,
"death": 1,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 630,
"y": 177
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 736,
"y": 447
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 751,
"y": 185
}
],
"birth": 0,
"death": 1,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 435,
"y": 138
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"5": 5,
"6": 6,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 10,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 5 99 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 80 439 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 41 337 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 236 744 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 501 392 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 611 650 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 720 439 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 470 162 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 5 99 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 80 439 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 41 337 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 236 744 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 501 392 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 611 650 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 720 439 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 470 162 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 5,
"y": 99
}
],
"birth": 0,
"death": 1,
"type": "red ceramic planter"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 80,
"y": 439
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 41,
"y": 337
}
],
"birth": 0,
"death": 1,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 236,
"y": 744
}
],
"birth": 0,
"death": 1,
"type": "white Lego Creationary game box"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 501,
"y": 392
}
],
"birth": 0,
"death": 1,
"type": "black laptop"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 611,
"y": 650
}
],
"birth": 0,
"death": 1,
"type": "beige fabric pencil case with horse print"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 720,
"y": 439
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 470,
"y": 162
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"6": 6,
"7": 7,
"10": 10,
"12": 12
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 11,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 1 107 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 72 443 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 373 947 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 623 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 568 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 607 177 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 771 451 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 744 181 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 501 158 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 1 107 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 72 443 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 373 947 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 623 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 568 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 607 177 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 771 451 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 744 181 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 501 158 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 1,
"y": 107
}
],
"birth": 0,
"death": 1,
"type": "red ceramic planter"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 72,
"y": 443
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 373,
"y": 947
}
],
"birth": 0,
"death": 1,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 623,
"y": 642
}
],
"birth": 0,
"death": 1,
"type": "beige fabric pencil case with horse print"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 568,
"y": 60
}
],
"birth": 0,
"death": 1,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 607,
"y": 177
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 771,
"y": 451
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 744,
"y": 181
}
],
"birth": 0,
"death": 1,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 501,
"y": 158
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"2": 2,
"5": 5,
"7": 7,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 12,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 null null [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 60 451 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 244 751 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 400 943 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 505 384 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 599 185 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 806 455 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 498 130 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 null null [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 60 451 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 244 751 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 400 943 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 505 384 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 599 185 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 806 455 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 498 130 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
}
],
"birth": 0,
"death": 1,
"type": "red ceramic planter"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 60,
"y": 451
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 244,
"y": 751
}
],
"birth": 0,
"death": 1,
"type": "white Lego Creationary game box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 400,
"y": 943
}
],
"birth": 0,
"death": 1,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 505,
"y": 384
}
],
"birth": 0,
"death": 1,
"type": "black laptop"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 599,
"y": 185
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 806,
"y": 455
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 498,
"y": 130
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"2": 2,
"4": 4,
"5": 5,
"6": 6,
"9": 9,
"10": 10,
"12": 12
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 13,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 13 259 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 52 455 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 56 349 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 498 392 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 630 646 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 552 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 583 181 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 705 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 732 177 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 529 111 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 13 259 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 52 455 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 56 349 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 498 392 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 630 646 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 552 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 583 181 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 705 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 732 177 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 529 111 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 13,
"y": 259
}
],
"birth": 0,
"death": 1,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 52,
"y": 455
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 56,
"y": 349
}
],
"birth": 0,
"death": 1,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 498,
"y": 392
}
],
"birth": 0,
"death": 1,
"type": "black laptop"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 630,
"y": 646
}
],
"birth": 0,
"death": 1,
"type": "beige fabric pencil case with horse print"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 552,
"y": 60
}
],
"birth": 0,
"death": 1,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 583,
"y": 181
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 705,
"y": 427
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 732,
"y": 177
}
],
"birth": 0,
"death": 1,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 529,
"y": 111
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"6": 6,
"7": 7,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 14,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 41 466 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 48 345 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 314 755 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 404 951 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 638 642 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 576 189 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 603 76 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 41 466 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 48 345 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 314 755 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 404 951 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 638 642 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 576 189 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 603 76 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 41,
"y": 466
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 48,
"y": 345
}
],
"birth": 0,
"death": 1,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 314,
"y": 755
}
],
"birth": 0,
"death": 1,
"type": "white Lego Creationary game box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 404,
"y": 951
}
],
"birth": 0,
"death": 1,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 638,
"y": 642
}
],
"birth": 0,
"death": 1,
"type": "beige fabric pencil case with horse print"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 576,
"y": 189
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 603,
"y": 76
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
2
],
"outputs": [
0,
2
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"7": 7,
"9": 9,
"12": 12
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 15,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 9 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 33 482 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 255 763 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 423 951 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 560 185 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 626 60 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 9 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 33 482 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 255 763 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 423 951 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 560 185 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 626 60 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 9,
"y": 267
}
],
"birth": 0,
"death": 1,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 33,
"y": 482
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 255,
"y": 763
}
],
"birth": 0,
"death": 1,
"type": "white Lego Creationary game box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 423,
"y": 951
}
],
"birth": 0,
"death": 1,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 560,
"y": 185
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 626,
"y": 60
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"4": 4,
"5": 5,
"9": 9,
"12": 12
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 16,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 25 494 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 322 763 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 541 56 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 544 189 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 720 423 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 716 177 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 25 494 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 322 763 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 541 56 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 544 189 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 720 423 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 716 177 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 25,
"y": 494
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 322,
"y": 763
}
],
"birth": 0,
"death": 1,
"type": "white Lego Creationary game box"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 541,
"y": 56
}
],
"birth": 0,
"death": 1,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 544,
"y": 189
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 720,
"y": 423
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 716,
"y": 177
}
],
"birth": 0,
"death": 1,
"type": "silver leather boat shoe"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 11,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"4": 4,
"8": 8,
"9": 9,
"10": 10,
"11": 11
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 17,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 25 576 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 44 353 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 365 763 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 443 951 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 650 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 525 64 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 529 197 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 732 423 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 666 48 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 912 998 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 25 576 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 44 353 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 365 763 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 443 951 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 650 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 525 64 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 529 197 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 732 423 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 666 48 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 912 998 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 25,
"y": 576
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 44,
"y": 353
}
],
"birth": 0,
"death": 1,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 365,
"y": 763
}
],
"birth": 0,
"death": 1,
"type": "white Lego Creationary game box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 443,
"y": 951
}
],
"birth": 0,
"death": 1,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 650,
"y": 642
}
],
"birth": 0,
"death": 1,
"type": "beige fabric pencil case with horse print"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 525,
"y": 64
}
],
"birth": 0,
"death": 1,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 529,
"y": 197
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 732,
"y": 423
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 666,
"y": 48
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
},
{
"id": 13,
"image_positions": [
{
"t": 0,
"x": 912,
"y": 998
}
],
"birth": 0,
"death": 1,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
2
],
"outputs": [
0,
2
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 11,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 12,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"7": 7,
"8": 8,
"9": 9,
"10": 10,
"12": 12,
"13": 13
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 18,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 1 271 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 29 595 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 388 767 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 529 56 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 517 208 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 771 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 708 173 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 888 998 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 1 271 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 29 595 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 388 767 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 529 56 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 517 208 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 771 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 708 173 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 888 998 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 1,
"y": 271
}
],
"birth": 0,
"death": 1,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 29,
"y": 595
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 388,
"y": 767
}
],
"birth": 0,
"death": 1,
"type": "white Lego Creationary game box"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 529,
"y": 56
}
],
"birth": 0,
"death": 1,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 517,
"y": 208
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 771,
"y": 427
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 708,
"y": 173
}
],
"birth": 0,
"death": 1,
"type": "silver leather boat shoe"
},
{
"id": 13,
"image_positions": [
{
"t": 0,
"x": 888,
"y": 998
}
],
"birth": 0,
"death": 1,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 12,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 13,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 14,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"4": 4,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"13": 13
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 19,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 1 291 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 29 583 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 41 361 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 349 771 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 458 955 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 486 388 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 521 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 505 220 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 787 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 705 181 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 685 44 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 908 994 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 6 9 [OUT] 6 9 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 7 10 [OUT] 7 10 [INTERACT] 11 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 1 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 1 291 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 29 583 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 41 361 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 349 771 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 458 955 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 486 388 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 521 60 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 505 220 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 787 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 705 181 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 685 44 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 908 994 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 6 9 [OUT] 6 9 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 7 10 [OUT] 7 10 [INTERACT] 11 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 1 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 1,
"y": 291
}
],
"birth": 0,
"death": 1,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 29,
"y": 583
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 41,
"y": 361
}
],
"birth": 0,
"death": 1,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 349,
"y": 771
}
],
"birth": 0,
"death": 1,
"type": "white Lego Creationary game box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 458,
"y": 955
}
],
"birth": 0,
"death": 1,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 486,
"y": 388
}
],
"birth": 0,
"death": 1,
"type": "black laptop"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 521,
"y": 60
}
],
"birth": 0,
"death": 1,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 505,
"y": 220
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 787,
"y": 427
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 705,
"y": 181
}
],
"birth": 0,
"death": 1,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 685,
"y": 44
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
},
{
"id": 13,
"image_positions": [
{
"t": 0,
"x": 908,
"y": 994
}
],
"birth": 0,
"death": 1,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
6,
9
],
"outputs": [
6,
9
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
7,
10
],
"outputs": [
7,
10
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 11,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 12,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 13,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12,
"13": 13
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 20,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 null null [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 33 595 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 369 771 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 474 951 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 505 68 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 482 232 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 806 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 697 173 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 708 29 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 923 994 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 null null [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 33 595 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 369 771 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 474 951 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 505 68 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 482 232 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 806 427 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 697 173 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 708 29 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 923 994 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 10 [OUT] 9 10 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
}
],
"birth": 0,
"death": 1,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 33,
"y": 595
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 369,
"y": 771
}
],
"birth": 0,
"death": 1,
"type": "white Lego Creationary game box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 474,
"y": 951
}
],
"birth": 0,
"death": 1,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 505,
"y": 68
}
],
"birth": 0,
"death": 1,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 482,
"y": 232
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 806,
"y": 427
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 697,
"y": 173
}
],
"birth": 0,
"death": 1,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 708,
"y": 29
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
},
{
"id": 13,
"image_positions": [
{
"t": 0,
"x": 923,
"y": 994
}
],
"birth": 0,
"death": 1,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 11,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"4": 4,
"5": 5,
"8": 8,
"9": 9,
"10": 10,
"11": 11,
"12": 12,
"13": 13
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 21,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 37 376 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 298 783 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 486 951 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 658 638 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 494 72 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 458 255 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 830 427 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 720 17 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 970 990 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 4 [OUT] 2 4 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 37 376 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 298 783 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 486 951 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 658 638 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 494 72 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 458 255 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 830 427 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 720 17 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 970 990 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 4 [OUT] 2 4 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 37,
"y": 376
}
],
"birth": 0,
"death": 1,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 298,
"y": 783
}
],
"birth": 0,
"death": 1,
"type": "white Lego Creationary game box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 486,
"y": 951
}
],
"birth": 0,
"death": 1,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 658,
"y": 638
}
],
"birth": 0,
"death": 1,
"type": "beige fabric pencil case with horse print"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 494,
"y": 72
}
],
"birth": 0,
"death": 1,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 458,
"y": 255
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 830,
"y": 427
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 720,
"y": 17
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
},
{
"id": 13,
"image_positions": [
{
"t": 0,
"x": 970,
"y": 990
}
],
"birth": 0,
"death": 1,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
2,
4
],
"outputs": [
2,
4
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 11,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"3": 3,
"4": 4,
"5": 5,
"7": 7,
"8": 8,
"9": 9,
"10": 10,
"12": 12,
"13": 13
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 22,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 396 775 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 478 400 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 427 279 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 677 404 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 689 181 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 728 9 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 978 986 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 396 775 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 478 400 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 427 279 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 677 404 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 689 181 [OBJ] 12 \"wooden toy railroad crossing\" 0 1 [PX] 0 728 9 [OBJ] 13 \"white plastic supplement bottle\" 0 1 [PX] 0 978 986 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 396,
"y": 775
}
],
"birth": 0,
"death": 1,
"type": "white Lego Creationary game box"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 478,
"y": 400
}
],
"birth": 0,
"death": 1,
"type": "black laptop"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 427,
"y": 279
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 677,
"y": 404
}
],
"birth": 0,
"death": 1,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 689,
"y": 181
}
],
"birth": 0,
"death": 1,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": 728,
"y": 9
}
],
"birth": 0,
"death": 1,
"type": "wooden toy railroad crossing"
},
{
"id": 13,
"image_positions": [
{
"t": 0,
"x": 978,
"y": 986
}
],
"birth": 0,
"death": 1,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"4": 4,
"6": 6,
"9": 9,
"10": 10,
"11": 11,
"12": 12,
"13": 13
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 23,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 41 603 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 29 373 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 498 955 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 662 630 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 482 76 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 400 291 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 681 193 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 41 603 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 29 373 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 498 955 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 662 630 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 482 76 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 400 291 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 681 193 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 41,
"y": 603
}
],
"birth": 0,
"death": 1,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 29,
"y": 373
}
],
"birth": 0,
"death": 1,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 498,
"y": 955
}
],
"birth": 0,
"death": 1,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 662,
"y": 630
}
],
"birth": 0,
"death": 1,
"type": "beige fabric pencil case with horse print"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 482,
"y": 76
}
],
"birth": 0,
"death": 1,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 400,
"y": 291
}
],
"birth": 0,
"death": 1,
"type": "black cardboard panty liner box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 681,
"y": 193
}
],
"birth": 0,
"death": 1,
"type": "silver leather boat shoe"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"3": 3,
"5": 5,
"7": 7,
"8": 8,
"9": 9,
"11": 11
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "red ceramic planter" 0 24 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 "black canvas boat shoe with white sole" 0 24 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 15 9 267 18 1 271 19 1 291 20 null null [OBJ] 2 "purple and pink fabric sneaker" 0 24 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 14 41 466 15 33 482 16 25 494 17 25 576 18 29 595 19 29 583 20 33 595 23 41 603 [OBJ] 3 "grey, purple, and mint green high-top sneaker" 0 24 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 14 48 345 17 44 353 19 41 361 21 37 376 23 29 373 [OBJ] 4 "white Lego Creationary game box" 0 24 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 14 314 755 15 255 763 16 322 763 17 365 763 18 388 767 19 349 771 20 369 771 21 298 783 22 396 775 [OBJ] 5 "white and green cardboard ink cartridge box" 0 24 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 14 404 951 15 423 951 17 443 951 19 458 955 20 474 951 21 486 951 23 498 955 [OBJ] 6 "black laptop" 0 24 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 19 486 388 22 478 400 [OBJ] 7 "beige fabric pencil case with horse print" 0 24 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 14 638 642 17 650 642 21 658 638 23 662 630 [OBJ] 8 "blue and orange plastic Therizinosaurus figurine" 0 24 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 16 541 56 17 525 64 18 529 56 19 521 60 20 505 68 21 494 72 23 482 76 [OBJ] 9 "black cardboard panty liner box" 0 24 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 14 576 189 15 560 185 16 544 189 17 529 197 18 517 208 19 505 220 20 482 232 21 458 255 22 427 279 23 400 291 [OBJ] 10 "light blue and green cardboard fruit snack box" 0 24 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 16 720 423 17 732 423 18 771 427 19 787 427 20 806 427 21 830 427 22 677 404 [OBJ] 11 "silver leather boat shoe" 0 24 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 16 716 177 18 708 173 19 705 181 20 697 173 22 689 181 23 681 193 [OBJ] 12 "wooden toy railroad crossing" 1 24 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 14 603 76 15 626 60 17 666 48 19 685 44 20 708 29 21 720 17 22 728 9 [OBJ] 13 "white plastic supplement bottle" 17 24 [PX] 0 null null 17 912 998 18 888 998 19 908 994 20 923 994 21 970 990 22 978 986 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 "contact" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 1 "contact" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 2 "contact" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 3 "contact" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 4 "contact" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 5 "contact" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 6 "contact" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 7 "contact" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 8 "contact" 0 1 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 9 "contact" 0 3 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 10 "contact" 0 3 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 11 "contact" 0 5 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 12 "contact" 0 7 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 13 "contact" 0 10 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 14 "contact" 0 20 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 15 "collision" 1 1 [IN] 9 11 [OUT] 9 11 [INTERACT] 16 "collision" 1 2 [IN] 65535 [OUT] 65535 [INTERACT] 17 "collision" 2 2 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 18 "collision" 2 3 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 19 "collision" 2 3 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 20 "collision" 3 3 [IN] 6 10 [OUT] 6 10 [INTERACT] 21 "collision" 3 3 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 22 "collision" 3 3 [IN] 9 11 [OUT] 9 11 [INTERACT] 23 "collision" 3 3 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 24 "collision" 3 3 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 25 "collision" 4 4 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 26 "collision" 4 5 [IN] 65535 [OUT] 65535 [INTERACT] 27 "contact" 4 5 [IN] 6 10 [OUT] 6 10 [INTERACT] 28 "contact" 4 5 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 29 "contact" 4 9 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 30 "collision" 5 5 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 31 "contact" 5 7 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 32 "collision" 6 6 [IN] 1 3 [OUT] 1 3 [INTERACT] 33 "collision" 6 6 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 34 "collision" 6 7 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 35 "collision" 6 7 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 36 "collision" 7 7 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 37 "collision" 7 7 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 38 "collision" 7 7 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 39 "collision" 7 7 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 40 "collision" 8 8 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 41 "collision" 8 8 [IN] 65535 [OUT] 65535 [INTERACT] 42 "collision" 9 9 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 43 "collision" 9 9 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 44 "collision" 9 9 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 45 "collision" 9 9 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 46 "collision" 9 10 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 47 "contact" 9 12 [IN] 65535 [OUT] 65535 [INTERACT] 48 "collision" 10 10 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 49 "collision" 10 10 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 50 "collision" 10 11 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 51 "collision" 11 11 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 52 "collision" 11 11 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 53 "collision" 11 12 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 54 "contact" 11 12 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 55 "collision" 12 12 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 56 "collision" 12 13 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 57 "collision" 12 13 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 58 "contact" 12 18 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 59 "collision" 13 13 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 60 "collision" 13 13 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 61 "collision" 13 13 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 62 "collision" 13 14 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 63 "collision" 13 14 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 64 "collision" 14 14 [IN] 2 [OUT] 2 [INTERACT] 65 "collision" 14 14 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 66 "collision" 14 14 [IN] 65535 [OUT] 65535 [INTERACT] 67 "collision" 14 15 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 68 "collision" 15 15 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 69 "contact" 15 22 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 70 "collision" 16 16 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 71 "collision" 16 16 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 72 "collision" 16 16 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 73 "collision" 16 16 [IN] 65535 [OUT] 65535 [INTERACT] 74 "collision" 17 17 [IN] 2 [OUT] 2 [INTERACT] 75 "collision" 17 17 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 76 "collision" 17 17 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 77 "collision" 17 17 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 78 "collision" 17 17 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 79 "contact" 17 21 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 80 "contact" 17 22 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 81 "contact" 17 23 [IN] 65535 [OUT] 65535 [INTERACT] 82 "collision" 18 18 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 83 "collision" 18 18 [IN] 9 10 [OUT] 9 10 [INTERACT] 84 "collision" 18 19 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 85 "contact" 18 22 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 86 "collision" 19 19 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 87 "collision" 19 19 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 88 "collision" 19 19 [IN] 6 9 [OUT] 6 9 [INTERACT] 89 "collision" 19 19 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 90 "collision" 19 19 [IN] 10 [OUT] 10 [INTERACT] 91 "contact" 19 20 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 92 "contact" 19 20 [IN] 9 10 [OUT] 9 10 [INTERACT] 93 "collision" 20 20 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 94 "contact" 20 21 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 95 "collision" 21 21 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 96 "collision" 21 21 [IN] 4 [OUT] 4 [INTERACT] 97 "collision" 21 21 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 98 "contact" 21 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 99 "collision" 22 22 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 100 "collision" 22 22 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 101 "collision" 22 22 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 102 "collision" 23 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 103 "collision" 23 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 104 "collision" 23 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 105 "collision" 23 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 106 "collision" 23 23 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 52,
"y": 83
},
{
"t": 1,
"x": 41,
"y": 87
},
{
"t": 2,
"x": 21,
"y": 72
},
{
"t": 3,
"x": 33,
"y": 95
},
{
"t": 6,
"x": 25,
"y": 99
},
{
"t": 7,
"x": 17,
"y": 95
},
{
"t": 10,
"x": 5,
"y": 99
},
{
"t": 11,
"x": 1,
"y": 107
},
{
"t": 12,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "red ceramic planter"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 72,
"y": 263
},
{
"t": 1,
"x": 64,
"y": 267
},
{
"t": 2,
"x": 56,
"y": 271
},
{
"t": 3,
"x": 48,
"y": 275
},
{
"t": 4,
"x": 25,
"y": 291
},
{
"t": 5,
"x": 21,
"y": 283
},
{
"t": 6,
"x": 44,
"y": 259
},
{
"t": 7,
"x": 33,
"y": 271
},
{
"t": 9,
"x": 25,
"y": 267
},
{
"t": 13,
"x": 13,
"y": 259
},
{
"t": 15,
"x": 9,
"y": 267
},
{
"t": 18,
"x": 1,
"y": 271
},
{
"t": 19,
"x": 1,
"y": 291
},
{
"t": 20,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 99,
"y": 392
},
{
"t": 1,
"x": 68,
"y": 396
},
{
"t": 2,
"x": 60,
"y": 400
},
{
"t": 3,
"x": 87,
"y": 400
},
{
"t": 4,
"x": 80,
"y": 404
},
{
"t": 5,
"x": 72,
"y": 408
},
{
"t": 6,
"x": 64,
"y": 412
},
{
"t": 7,
"x": 48,
"y": 427
},
{
"t": 8,
"x": 41,
"y": 439
},
{
"t": 9,
"x": 91,
"y": 439
},
{
"t": 10,
"x": 80,
"y": 439
},
{
"t": 11,
"x": 72,
"y": 443
},
{
"t": 12,
"x": 60,
"y": 451
},
{
"t": 13,
"x": 52,
"y": 455
},
{
"t": 14,
"x": 41,
"y": 466
},
{
"t": 15,
"x": 33,
"y": 482
},
{
"t": 16,
"x": 25,
"y": 494
},
{
"t": 17,
"x": 25,
"y": 576
},
{
"t": 18,
"x": 29,
"y": 595
},
{
"t": 19,
"x": 29,
"y": 583
},
{
"t": 20,
"x": 33,
"y": 595
},
{
"t": 23,
"x": 41,
"y": 603
}
],
"birth": 0,
"death": 24,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 216,
"y": 138
},
{
"t": 1,
"x": 189,
"y": 150
},
{
"t": 2,
"x": 169,
"y": 162
},
{
"t": 3,
"x": 142,
"y": 193
},
{
"t": 4,
"x": 126,
"y": 220
},
{
"t": 5,
"x": 95,
"y": 271
},
{
"t": 6,
"x": 83,
"y": 310
},
{
"t": 7,
"x": 99,
"y": 330
},
{
"t": 8,
"x": 60,
"y": 353
},
{
"t": 9,
"x": 52,
"y": 349
},
{
"t": 10,
"x": 41,
"y": 337
},
{
"t": 13,
"x": 56,
"y": 349
},
{
"t": 14,
"x": 48,
"y": 345
},
{
"t": 17,
"x": 44,
"y": 353
},
{
"t": 19,
"x": 41,
"y": 361
},
{
"t": 21,
"x": 37,
"y": 376
},
{
"t": 23,
"x": 29,
"y": 373
}
],
"birth": 0,
"death": 24,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 228,
"y": 701
},
{
"t": 2,
"x": 275,
"y": 716
},
{
"t": 3,
"x": 232,
"y": 716
},
{
"t": 6,
"x": 341,
"y": 736
},
{
"t": 7,
"x": 236,
"y": 732
},
{
"t": 10,
"x": 236,
"y": 744
},
{
"t": 12,
"x": 244,
"y": 751
},
{
"t": 14,
"x": 314,
"y": 755
},
{
"t": 15,
"x": 255,
"y": 763
},
{
"t": 16,
"x": 322,
"y": 763
},
{
"t": 17,
"x": 365,
"y": 763
},
{
"t": 18,
"x": 388,
"y": 767
},
{
"t": 19,
"x": 349,
"y": 771
},
{
"t": 20,
"x": 369,
"y": 771
},
{
"t": 21,
"x": 298,
"y": 783
},
{
"t": 22,
"x": 396,
"y": 775
}
],
"birth": 0,
"death": 24,
"type": "white Lego Creationary game box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 259,
"y": 923
},
{
"t": 1,
"x": 287,
"y": 927
},
{
"t": 2,
"x": 302,
"y": 927
},
{
"t": 3,
"x": 318,
"y": 931
},
{
"t": 4,
"x": 330,
"y": 931
},
{
"t": 5,
"x": 337,
"y": 935
},
{
"t": 7,
"x": 353,
"y": 939
},
{
"t": 9,
"x": 365,
"y": 943
},
{
"t": 11,
"x": 373,
"y": 947
},
{
"t": 12,
"x": 400,
"y": 943
},
{
"t": 14,
"x": 404,
"y": 951
},
{
"t": 15,
"x": 423,
"y": 951
},
{
"t": 17,
"x": 443,
"y": 951
},
{
"t": 19,
"x": 458,
"y": 955
},
{
"t": 20,
"x": 474,
"y": 951
},
{
"t": 21,
"x": 486,
"y": 951
},
{
"t": 23,
"x": 498,
"y": 955
}
],
"birth": 0,
"death": 24,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 525,
"y": 404
},
{
"t": 3,
"x": 529,
"y": 396
},
{
"t": 4,
"x": 521,
"y": 400
},
{
"t": 5,
"x": 529,
"y": 392
},
{
"t": 7,
"x": 513,
"y": 396
},
{
"t": 9,
"x": 509,
"y": 388
},
{
"t": 10,
"x": 501,
"y": 392
},
{
"t": 12,
"x": 505,
"y": 384
},
{
"t": 13,
"x": 498,
"y": 392
},
{
"t": 19,
"x": 486,
"y": 388
},
{
"t": 22,
"x": 478,
"y": 400
}
],
"birth": 0,
"death": 24,
"type": "black laptop"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 587,
"y": 658
},
{
"t": 1,
"x": 595,
"y": 650
},
{
"t": 2,
"x": 587,
"y": 662
},
{
"t": 3,
"x": 599,
"y": 646
},
{
"t": 6,
"x": 595,
"y": 654
},
{
"t": 8,
"x": 607,
"y": 642
},
{
"t": 10,
"x": 611,
"y": 650
},
{
"t": 11,
"x": 623,
"y": 642
},
{
"t": 13,
"x": 630,
"y": 646
},
{
"t": 14,
"x": 638,
"y": 642
},
{
"t": 17,
"x": 650,
"y": 642
},
{
"t": 21,
"x": 658,
"y": 638
},
{
"t": 23,
"x": 662,
"y": 630
}
],
"birth": 0,
"death": 24,
"type": "beige fabric pencil case with horse print"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 68
},
{
"t": 2,
"x": 626,
"y": 68
},
{
"t": 4,
"x": 619,
"y": 64
},
{
"t": 5,
"x": 607,
"y": 64
},
{
"t": 6,
"x": 615,
"y": 52
},
{
"t": 7,
"x": 599,
"y": 60
},
{
"t": 9,
"x": 583,
"y": 60
},
{
"t": 11,
"x": 568,
"y": 60
},
{
"t": 13,
"x": 552,
"y": 60
},
{
"t": 16,
"x": 541,
"y": 56
},
{
"t": 17,
"x": 525,
"y": 64
},
{
"t": 18,
"x": 529,
"y": 56
},
{
"t": 19,
"x": 521,
"y": 60
},
{
"t": 20,
"x": 505,
"y": 68
},
{
"t": 21,
"x": 494,
"y": 72
},
{
"t": 23,
"x": 482,
"y": 76
}
],
"birth": 0,
"death": 24,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 744,
"y": 91
},
{
"t": 1,
"x": 732,
"y": 83
},
{
"t": 3,
"x": 716,
"y": 91
},
{
"t": 4,
"x": 701,
"y": 115
},
{
"t": 5,
"x": 685,
"y": 146
},
{
"t": 6,
"x": 673,
"y": 169
},
{
"t": 7,
"x": 658,
"y": 185
},
{
"t": 8,
"x": 646,
"y": 173
},
{
"t": 9,
"x": 630,
"y": 177
},
{
"t": 11,
"x": 607,
"y": 177
},
{
"t": 12,
"x": 599,
"y": 185
},
{
"t": 13,
"x": 583,
"y": 181
},
{
"t": 14,
"x": 576,
"y": 189
},
{
"t": 15,
"x": 560,
"y": 185
},
{
"t": 16,
"x": 544,
"y": 189
},
{
"t": 17,
"x": 529,
"y": 197
},
{
"t": 18,
"x": 517,
"y": 208
},
{
"t": 19,
"x": 505,
"y": 220
},
{
"t": 20,
"x": 482,
"y": 232
},
{
"t": 21,
"x": 458,
"y": 255
},
{
"t": 22,
"x": 427,
"y": 279
},
{
"t": 23,
"x": 400,
"y": 291
}
],
"birth": 0,
"death": 24,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 751,
"y": 486
},
{
"t": 1,
"x": 658,
"y": 427
},
{
"t": 2,
"x": 681,
"y": 439
},
{
"t": 3,
"x": 693,
"y": 443
},
{
"t": 4,
"x": 712,
"y": 451
},
{
"t": 5,
"x": 759,
"y": 474
},
{
"t": 7,
"x": 716,
"y": 443
},
{
"t": 9,
"x": 736,
"y": 447
},
{
"t": 10,
"x": 720,
"y": 439
},
{
"t": 11,
"x": 771,
"y": 451
},
{
"t": 12,
"x": 806,
"y": 455
},
{
"t": 13,
"x": 705,
"y": 427
},
{
"t": 16,
"x": 720,
"y": 423
},
{
"t": 17,
"x": 732,
"y": 423
},
{
"t": 18,
"x": 771,
"y": 427
},
{
"t": 19,
"x": 787,
"y": 427
},
{
"t": 20,
"x": 806,
"y": 427
},
{
"t": 21,
"x": 830,
"y": 427
},
{
"t": 22,
"x": 677,
"y": 404
}
],
"birth": 0,
"death": 24,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 798,
"y": 216
},
{
"t": 1,
"x": 791,
"y": 220
},
{
"t": 2,
"x": 787,
"y": 208
},
{
"t": 3,
"x": 779,
"y": 216
},
{
"t": 4,
"x": 775,
"y": 205
},
{
"t": 5,
"x": 771,
"y": 193
},
{
"t": 6,
"x": 763,
"y": 208
},
{
"t": 7,
"x": 759,
"y": 193
},
{
"t": 9,
"x": 751,
"y": 185
},
{
"t": 11,
"x": 744,
"y": 181
},
{
"t": 13,
"x": 732,
"y": 177
},
{
"t": 16,
"x": 716,
"y": 177
},
{
"t": 18,
"x": 708,
"y": 173
},
{
"t": 19,
"x": 705,
"y": 181
},
{
"t": 20,
"x": 697,
"y": 173
},
{
"t": 22,
"x": 689,
"y": 181
},
{
"t": 23,
"x": 681,
"y": 193
}
],
"birth": 0,
"death": 24,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 1,
"x": 1,
"y": 1
},
{
"t": 2,
"x": 72,
"y": 5
},
{
"t": 3,
"x": 138,
"y": 5
},
{
"t": 4,
"x": 205,
"y": 9
},
{
"t": 5,
"x": 263,
"y": 25
},
{
"t": 6,
"x": 314,
"y": 48
},
{
"t": 7,
"x": 361,
"y": 76
},
{
"t": 8,
"x": 404,
"y": 107
},
{
"t": 9,
"x": 435,
"y": 138
},
{
"t": 10,
"x": 470,
"y": 162
},
{
"t": 11,
"x": 501,
"y": 158
},
{
"t": 12,
"x": 498,
"y": 130
},
{
"t": 13,
"x": 529,
"y": 111
},
{
"t": 14,
"x": 603,
"y": 76
},
{
"t": 15,
"x": 626,
"y": 60
},
{
"t": 17,
"x": 666,
"y": 48
},
{
"t": 19,
"x": 685,
"y": 44
},
{
"t": 20,
"x": 708,
"y": 29
},
{
"t": 21,
"x": 720,
"y": 17
},
{
"t": 22,
"x": 728,
"y": 9
}
],
"birth": 1,
"death": 24,
"type": "wooden toy railroad crossing"
},
{
"id": 13,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 17,
"x": 912,
"y": 998
},
{
"t": 18,
"x": 888,
"y": 998
},
{
"t": 19,
"x": 908,
"y": 994
},
{
"t": 20,
"x": 923,
"y": 994
},
{
"t": 21,
"x": 970,
"y": 990
},
{
"t": 22,
"x": 978,
"y": 986
}
],
"birth": 17,
"death": 24,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 1,
"type": "contact"
},
{
"id": 9,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 3,
"type": "contact"
},
{
"id": 10,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 3,
"type": "contact"
},
{
"id": 11,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 5,
"type": "contact"
},
{
"id": 12,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 7,
"type": "contact"
},
{
"id": 13,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 14,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 20,
"type": "contact"
},
{
"id": 15,
"inputs": [
9,
11
],
"outputs": [
9,
11
],
"begins_at": 1,
"ends_at": 1,
"type": "collision"
},
{
"id": 16,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 1,
"ends_at": 2,
"type": "collision"
},
{
"id": 17,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 18,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 2,
"ends_at": 3,
"type": "collision"
},
{
"id": 19,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 2,
"ends_at": 3,
"type": "collision"
},
{
"id": 20,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 21,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 22,
"inputs": [
9,
11
],
"outputs": [
9,
11
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 23,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 24,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 25,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 26,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 4,
"ends_at": 5,
"type": "collision"
},
{
"id": 27,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 4,
"ends_at": 5,
"type": "contact"
},
{
"id": 28,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 4,
"ends_at": 5,
"type": "contact"
},
{
"id": 29,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 4,
"ends_at": 9,
"type": "contact"
},
{
"id": 30,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 31,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 5,
"ends_at": 7,
"type": "contact"
},
{
"id": 32,
"inputs": [
1,
3
],
"outputs": [
1,
3
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 33,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 34,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 6,
"ends_at": 7,
"type": "collision"
},
{
"id": 35,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 6,
"ends_at": 7,
"type": "collision"
},
{
"id": 36,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 37,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 38,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 39,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 40,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 41,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 42,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 43,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 44,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 45,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 46,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 9,
"ends_at": 10,
"type": "collision"
},
{
"id": 47,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 9,
"ends_at": 12,
"type": "contact"
},
{
"id": 48,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 49,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 50,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 10,
"ends_at": 11,
"type": "collision"
},
{
"id": 51,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 52,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 53,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 11,
"ends_at": 12,
"type": "collision"
},
{
"id": 54,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 11,
"ends_at": 12,
"type": "contact"
},
{
"id": 55,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 56,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 12,
"ends_at": 13,
"type": "collision"
},
{
"id": 57,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 12,
"ends_at": 13,
"type": "collision"
},
{
"id": 58,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 12,
"ends_at": 18,
"type": "contact"
},
{
"id": 59,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 60,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 61,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 62,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 13,
"ends_at": 14,
"type": "collision"
},
{
"id": 63,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 13,
"ends_at": 14,
"type": "collision"
},
{
"id": 64,
"inputs": [
2
],
"outputs": [
2
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 65,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 66,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 67,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 14,
"ends_at": 15,
"type": "collision"
},
{
"id": 68,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 69,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 15,
"ends_at": 22,
"type": "contact"
},
{
"id": 70,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 71,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 72,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 73,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 74,
"inputs": [
2
],
"outputs": [
2
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 75,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 76,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 77,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 78,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 79,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 17,
"ends_at": 21,
"type": "contact"
},
{
"id": 80,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 17,
"ends_at": 22,
"type": "contact"
},
{
"id": 81,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 17,
"ends_at": 23,
"type": "contact"
},
{
"id": 82,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 83,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 84,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 18,
"ends_at": 19,
"type": "collision"
},
{
"id": 85,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 18,
"ends_at": 22,
"type": "contact"
},
{
"id": 86,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 87,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 88,
"inputs": [
6,
9
],
"outputs": [
6,
9
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 89,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 90,
"inputs": [
10
],
"outputs": [
10
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 91,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 19,
"ends_at": 20,
"type": "contact"
},
{
"id": 92,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 19,
"ends_at": 20,
"type": "contact"
},
{
"id": 93,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 94,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 20,
"ends_at": 21,
"type": "contact"
},
{
"id": 95,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 96,
"inputs": [
4
],
"outputs": [
4
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 97,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 98,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 21,
"ends_at": 23,
"type": "contact"
},
{
"id": 99,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 100,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 101,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 102,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
},
{
"id": 103,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
},
{
"id": 104,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
},
{
"id": 105,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
},
{
"id": 106,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 1.0,
"avg_image_position_segmentation_acc_small": 1.0,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 1.0,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": 1.0,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 1.0,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 1.0,
"num_matches": 14,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.6450487012987013,
"avg_interaction_input_object_jaccard": 0.2976190476190475,
"avg_interaction_output_object_jaccard": 0.2976190476190475,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 28,
"num_unmatched_pred_interactions": 79,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 23,
"false_positives": 84,
"false_negatives": 0
},
"0.5": {
"true_positives": 17,
"false_positives": 90,
"false_negatives": 0
},
"0.75": {
"true_positives": 14,
"false_positives": 93,
"false_negatives": 0
},
"1.0": {
"true_positives": 12,
"false_positives": 95,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.21495327102803738,
"0.5": 0.1588785046728972,
"0.75": 0.1308411214953271,
"1.0": 0.11214953271028037
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.35384615384615387,
"0.5": 0.27419354838709675,
"0.75": 0.23140495867768593,
"1.0": 0.20168067226890757
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 22,
"false_positives": 85,
"false_negatives": 0
},
"0.5": {
"true_positives": 3,
"false_positives": 104,
"false_negatives": 0
},
"0.75": {
"true_positives": 1,
"false_positives": 106,
"false_negatives": 0
},
"1.0": {
"true_positives": 1,
"false_positives": 106,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.205607476635514,
"0.5": 0.028037383177570093,
"0.75": 0.009345794392523364,
"1.0": 0.009345794392523364
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.34108527131782945,
"0.5": 0.05454545454545455,
"0.75": 0.018518518518518517,
"1.0": 0.018518518518518517
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 22,
"false_positives": 85,
"false_negatives": 0
},
"0.5": {
"true_positives": 3,
"false_positives": 104,
"false_negatives": 0
},
"0.75": {
"true_positives": 1,
"false_positives": 106,
"false_negatives": 0
},
"1.0": {
"true_positives": 1,
"false_positives": 106,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.205607476635514,
"0.5": 0.028037383177570093,
"0.75": 0.009345794392523364,
"1.0": 0.009345794392523364
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.34108527131782945,
"0.5": 0.05454545454545455,
"0.75": 0.018518518518518517,
"1.0": 0.018518518518518517
}
}
}Prompt
Growing GT object-track prefill
At prefix step t, B3 saw frames 0..t and an assistant prefill containing GT object tracks only through t. The prefills are deterministically reconstructed with the exact oracle helper; only the final full-clip generation was persisted by inference.
Every persisted/reconstructed prefill step
[
{
"frame_index": 0,
"frames_visible": "0..0",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 1 [PX] 0 52 83 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 1 [PX] 0 72 263 [OBJ] 2 \"purple and pink fabric sneaker\" 0 1 [PX] 0 99 392 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 1 [PX] 0 216 138 [OBJ] 4 \"white Lego Creationary game box\" 0 1 [PX] 0 228 701 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 1 [PX] 0 259 923 [OBJ] 6 \"black laptop\" 0 1 [PX] 0 525 404 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 1 [PX] 0 587 658 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 1 [PX] 0 646 68 [OBJ] 9 \"black cardboard panty liner box\" 0 1 [PX] 0 744 91 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 1 [PX] 0 751 486 [OBJ] 11 \"silver leather boat shoe\" 0 1 [PX] 0 798 216 [OBJ] 12 \"wooden toy railroad crossing\" 1 1 [PX] 0 null null [OBJ] 13 \"white plastic supplement bottle\" 17 1 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 1,
"frames_visible": "0..1",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 2 [PX] 0 52 83 1 41 87 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 2 [PX] 0 72 263 1 64 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 2 [PX] 0 99 392 1 68 396 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 2 [PX] 0 216 138 1 189 150 [OBJ] 4 \"white Lego Creationary game box\" 0 2 [PX] 0 228 701 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 2 [PX] 0 259 923 1 287 927 [OBJ] 6 \"black laptop\" 0 2 [PX] 0 525 404 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 2 [PX] 0 587 658 1 595 650 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 2 [PX] 0 646 68 [OBJ] 9 \"black cardboard panty liner box\" 0 2 [PX] 0 744 91 1 732 83 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 2 [PX] 0 751 486 1 658 427 [OBJ] 11 \"silver leather boat shoe\" 0 2 [PX] 0 798 216 1 791 220 [OBJ] 12 \"wooden toy railroad crossing\" 1 2 [PX] 0 null null 1 1 1 [OBJ] 13 \"white plastic supplement bottle\" 17 2 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 2,
"frames_visible": "0..2",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 3 [PX] 0 52 83 1 41 87 2 21 72 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 3 [PX] 0 72 263 1 64 267 2 56 271 [OBJ] 2 \"purple and pink fabric sneaker\" 0 3 [PX] 0 99 392 1 68 396 2 60 400 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 3 [PX] 0 216 138 1 189 150 2 169 162 [OBJ] 4 \"white Lego Creationary game box\" 0 3 [PX] 0 228 701 2 275 716 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 3 [PX] 0 259 923 1 287 927 2 302 927 [OBJ] 6 \"black laptop\" 0 3 [PX] 0 525 404 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 3 [PX] 0 587 658 1 595 650 2 587 662 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 3 [PX] 0 646 68 2 626 68 [OBJ] 9 \"black cardboard panty liner box\" 0 3 [PX] 0 744 91 1 732 83 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 3 [PX] 0 751 486 1 658 427 2 681 439 [OBJ] 11 \"silver leather boat shoe\" 0 3 [PX] 0 798 216 1 791 220 2 787 208 [OBJ] 12 \"wooden toy railroad crossing\" 1 3 [PX] 0 null null 1 1 1 2 72 5 [OBJ] 13 \"white plastic supplement bottle\" 17 3 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 3,
"frames_visible": "0..3",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 4 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 4 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 [OBJ] 2 \"purple and pink fabric sneaker\" 0 4 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 4 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 [OBJ] 4 \"white Lego Creationary game box\" 0 4 [PX] 0 228 701 2 275 716 3 232 716 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 4 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 [OBJ] 6 \"black laptop\" 0 4 [PX] 0 525 404 3 529 396 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 4 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 4 [PX] 0 646 68 2 626 68 [OBJ] 9 \"black cardboard panty liner box\" 0 4 [PX] 0 744 91 1 732 83 3 716 91 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 4 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 [OBJ] 11 \"silver leather boat shoe\" 0 4 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 [OBJ] 12 \"wooden toy railroad crossing\" 1 4 [PX] 0 null null 1 1 1 2 72 5 3 138 5 [OBJ] 13 \"white plastic supplement bottle\" 17 4 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 4,
"frames_visible": "0..4",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 5 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 5 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 [OBJ] 2 \"purple and pink fabric sneaker\" 0 5 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 5 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 [OBJ] 4 \"white Lego Creationary game box\" 0 5 [PX] 0 228 701 2 275 716 3 232 716 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 5 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 [OBJ] 6 \"black laptop\" 0 5 [PX] 0 525 404 3 529 396 4 521 400 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 5 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 5 [PX] 0 646 68 2 626 68 4 619 64 [OBJ] 9 \"black cardboard panty liner box\" 0 5 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 5 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 [OBJ] 11 \"silver leather boat shoe\" 0 5 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 [OBJ] 12 \"wooden toy railroad crossing\" 1 5 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 [OBJ] 13 \"white plastic supplement bottle\" 17 5 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 5,
"frames_visible": "0..5",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 6 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 6 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 [OBJ] 2 \"purple and pink fabric sneaker\" 0 6 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 6 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 [OBJ] 4 \"white Lego Creationary game box\" 0 6 [PX] 0 228 701 2 275 716 3 232 716 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 6 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 [OBJ] 6 \"black laptop\" 0 6 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 6 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 6 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 [OBJ] 9 \"black cardboard panty liner box\" 0 6 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 6 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 [OBJ] 11 \"silver leather boat shoe\" 0 6 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 [OBJ] 12 \"wooden toy railroad crossing\" 1 6 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 [OBJ] 13 \"white plastic supplement bottle\" 17 6 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 6,
"frames_visible": "0..6",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 7 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 7 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 [OBJ] 2 \"purple and pink fabric sneaker\" 0 7 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 7 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 [OBJ] 4 \"white Lego Creationary game box\" 0 7 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 7 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 [OBJ] 6 \"black laptop\" 0 7 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 7 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 7 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 [OBJ] 9 \"black cardboard panty liner box\" 0 7 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 7 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 [OBJ] 11 \"silver leather boat shoe\" 0 7 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 [OBJ] 12 \"wooden toy railroad crossing\" 1 7 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 [OBJ] 13 \"white plastic supplement bottle\" 17 7 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 7,
"frames_visible": "0..7",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 8 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 8 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 [OBJ] 2 \"purple and pink fabric sneaker\" 0 8 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 8 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 [OBJ] 4 \"white Lego Creationary game box\" 0 8 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 8 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 [OBJ] 6 \"black laptop\" 0 8 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 8 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 8 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 [OBJ] 9 \"black cardboard panty liner box\" 0 8 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 8 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 [OBJ] 11 \"silver leather boat shoe\" 0 8 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 [OBJ] 12 \"wooden toy railroad crossing\" 1 8 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 [OBJ] 13 \"white plastic supplement bottle\" 17 8 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 8,
"frames_visible": "0..8",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 9 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 9 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 [OBJ] 2 \"purple and pink fabric sneaker\" 0 9 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 9 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 [OBJ] 4 \"white Lego Creationary game box\" 0 9 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 9 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 [OBJ] 6 \"black laptop\" 0 9 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 9 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 9 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 [OBJ] 9 \"black cardboard panty liner box\" 0 9 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 9 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 [OBJ] 11 \"silver leather boat shoe\" 0 9 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 [OBJ] 12 \"wooden toy railroad crossing\" 1 9 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 [OBJ] 13 \"white plastic supplement bottle\" 17 9 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 9,
"frames_visible": "0..9",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 10 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 10 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 10 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 10 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 [OBJ] 4 \"white Lego Creationary game box\" 0 10 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 10 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 [OBJ] 6 \"black laptop\" 0 10 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 10 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 10 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 [OBJ] 9 \"black cardboard panty liner box\" 0 10 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 10 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 [OBJ] 11 \"silver leather boat shoe\" 0 10 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 [OBJ] 12 \"wooden toy railroad crossing\" 1 10 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 [OBJ] 13 \"white plastic supplement bottle\" 17 10 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 10,
"frames_visible": "0..10",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 11 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 11 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 11 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 11 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 [OBJ] 4 \"white Lego Creationary game box\" 0 11 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 11 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 [OBJ] 6 \"black laptop\" 0 11 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 11 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 11 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 [OBJ] 9 \"black cardboard panty liner box\" 0 11 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 11 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 [OBJ] 11 \"silver leather boat shoe\" 0 11 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 [OBJ] 12 \"wooden toy railroad crossing\" 1 11 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 [OBJ] 13 \"white plastic supplement bottle\" 17 11 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 11,
"frames_visible": "0..11",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 12 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 [OBJ] 1 \"black canvas boat shoe with white sole\" 0 12 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 12 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 12 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 [OBJ] 4 \"white Lego Creationary game box\" 0 12 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 12 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 [OBJ] 6 \"black laptop\" 0 12 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 12 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 12 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 [OBJ] 9 \"black cardboard panty liner box\" 0 12 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 12 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 [OBJ] 11 \"silver leather boat shoe\" 0 12 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 [OBJ] 12 \"wooden toy railroad crossing\" 1 12 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 [OBJ] 13 \"white plastic supplement bottle\" 17 12 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 12,
"frames_visible": "0..12",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 13 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 \"black canvas boat shoe with white sole\" 0 13 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 13 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 13 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 [OBJ] 4 \"white Lego Creationary game box\" 0 13 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 13 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 [OBJ] 6 \"black laptop\" 0 13 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 13 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 13 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 [OBJ] 9 \"black cardboard panty liner box\" 0 13 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 13 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 [OBJ] 11 \"silver leather boat shoe\" 0 13 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 [OBJ] 12 \"wooden toy railroad crossing\" 1 13 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 [OBJ] 13 \"white plastic supplement bottle\" 17 13 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 13,
"frames_visible": "0..13",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 14 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 \"black canvas boat shoe with white sole\" 0 14 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 [OBJ] 2 \"purple and pink fabric sneaker\" 0 14 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 14 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 [OBJ] 4 \"white Lego Creationary game box\" 0 14 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 14 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 [OBJ] 6 \"black laptop\" 0 14 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 14 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 14 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 [OBJ] 9 \"black cardboard panty liner box\" 0 14 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 14 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 [OBJ] 11 \"silver leather boat shoe\" 0 14 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 [OBJ] 12 \"wooden toy railroad crossing\" 1 14 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 [OBJ] 13 \"white plastic supplement bottle\" 17 14 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 14,
"frames_visible": "0..14",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 15 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 \"black canvas boat shoe with white sole\" 0 15 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 [OBJ] 2 \"purple and pink fabric sneaker\" 0 15 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 14 41 466 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 15 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 14 48 345 [OBJ] 4 \"white Lego Creationary game box\" 0 15 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 14 314 755 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 15 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 14 404 951 [OBJ] 6 \"black laptop\" 0 15 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 15 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 14 638 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 15 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 [OBJ] 9 \"black cardboard panty liner box\" 0 15 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 14 576 189 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 15 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 [OBJ] 11 \"silver leather boat shoe\" 0 15 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 [OBJ] 12 \"wooden toy railroad crossing\" 1 15 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 14 603 76 [OBJ] 13 \"white plastic supplement bottle\" 17 15 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 15,
"frames_visible": "0..15",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 16 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 \"black canvas boat shoe with white sole\" 0 16 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 15 9 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 16 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 14 41 466 15 33 482 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 16 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 14 48 345 [OBJ] 4 \"white Lego Creationary game box\" 0 16 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 14 314 755 15 255 763 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 16 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 14 404 951 15 423 951 [OBJ] 6 \"black laptop\" 0 16 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 16 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 14 638 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 16 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 [OBJ] 9 \"black cardboard panty liner box\" 0 16 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 14 576 189 15 560 185 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 16 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 [OBJ] 11 \"silver leather boat shoe\" 0 16 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 [OBJ] 12 \"wooden toy railroad crossing\" 1 16 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 14 603 76 15 626 60 [OBJ] 13 \"white plastic supplement bottle\" 17 16 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 16,
"frames_visible": "0..16",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 17 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 \"black canvas boat shoe with white sole\" 0 17 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 15 9 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 17 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 14 41 466 15 33 482 16 25 494 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 17 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 14 48 345 [OBJ] 4 \"white Lego Creationary game box\" 0 17 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 14 314 755 15 255 763 16 322 763 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 17 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 14 404 951 15 423 951 [OBJ] 6 \"black laptop\" 0 17 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 17 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 14 638 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 17 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 16 541 56 [OBJ] 9 \"black cardboard panty liner box\" 0 17 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 14 576 189 15 560 185 16 544 189 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 17 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 16 720 423 [OBJ] 11 \"silver leather boat shoe\" 0 17 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 16 716 177 [OBJ] 12 \"wooden toy railroad crossing\" 1 17 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 14 603 76 15 626 60 [OBJ] 13 \"white plastic supplement bottle\" 17 17 [PX] 0 null null [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 17,
"frames_visible": "0..17",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 18 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 \"black canvas boat shoe with white sole\" 0 18 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 15 9 267 [OBJ] 2 \"purple and pink fabric sneaker\" 0 18 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 14 41 466 15 33 482 16 25 494 17 25 576 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 18 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 14 48 345 17 44 353 [OBJ] 4 \"white Lego Creationary game box\" 0 18 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 14 314 755 15 255 763 16 322 763 17 365 763 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 18 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 14 404 951 15 423 951 17 443 951 [OBJ] 6 \"black laptop\" 0 18 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 18 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 14 638 642 17 650 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 18 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 16 541 56 17 525 64 [OBJ] 9 \"black cardboard panty liner box\" 0 18 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 14 576 189 15 560 185 16 544 189 17 529 197 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 18 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 16 720 423 17 732 423 [OBJ] 11 \"silver leather boat shoe\" 0 18 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 16 716 177 [OBJ] 12 \"wooden toy railroad crossing\" 1 18 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 14 603 76 15 626 60 17 666 48 [OBJ] 13 \"white plastic supplement bottle\" 17 18 [PX] 0 null null 17 912 998 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 18,
"frames_visible": "0..18",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 19 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 \"black canvas boat shoe with white sole\" 0 19 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 15 9 267 18 1 271 [OBJ] 2 \"purple and pink fabric sneaker\" 0 19 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 14 41 466 15 33 482 16 25 494 17 25 576 18 29 595 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 19 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 14 48 345 17 44 353 [OBJ] 4 \"white Lego Creationary game box\" 0 19 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 14 314 755 15 255 763 16 322 763 17 365 763 18 388 767 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 19 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 14 404 951 15 423 951 17 443 951 [OBJ] 6 \"black laptop\" 0 19 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 19 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 14 638 642 17 650 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 19 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 16 541 56 17 525 64 18 529 56 [OBJ] 9 \"black cardboard panty liner box\" 0 19 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 14 576 189 15 560 185 16 544 189 17 529 197 18 517 208 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 19 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 16 720 423 17 732 423 18 771 427 [OBJ] 11 \"silver leather boat shoe\" 0 19 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 16 716 177 18 708 173 [OBJ] 12 \"wooden toy railroad crossing\" 1 19 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 14 603 76 15 626 60 17 666 48 [OBJ] 13 \"white plastic supplement bottle\" 17 19 [PX] 0 null null 17 912 998 18 888 998 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 19,
"frames_visible": "0..19",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 20 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 \"black canvas boat shoe with white sole\" 0 20 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 15 9 267 18 1 271 19 1 291 [OBJ] 2 \"purple and pink fabric sneaker\" 0 20 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 14 41 466 15 33 482 16 25 494 17 25 576 18 29 595 19 29 583 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 20 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 14 48 345 17 44 353 19 41 361 [OBJ] 4 \"white Lego Creationary game box\" 0 20 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 14 314 755 15 255 763 16 322 763 17 365 763 18 388 767 19 349 771 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 20 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 14 404 951 15 423 951 17 443 951 19 458 955 [OBJ] 6 \"black laptop\" 0 20 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 19 486 388 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 20 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 14 638 642 17 650 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 20 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 16 541 56 17 525 64 18 529 56 19 521 60 [OBJ] 9 \"black cardboard panty liner box\" 0 20 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 14 576 189 15 560 185 16 544 189 17 529 197 18 517 208 19 505 220 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 20 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 16 720 423 17 732 423 18 771 427 19 787 427 [OBJ] 11 \"silver leather boat shoe\" 0 20 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 16 716 177 18 708 173 19 705 181 [OBJ] 12 \"wooden toy railroad crossing\" 1 20 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 14 603 76 15 626 60 17 666 48 19 685 44 [OBJ] 13 \"white plastic supplement bottle\" 17 20 [PX] 0 null null 17 912 998 18 888 998 19 908 994 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 20,
"frames_visible": "0..20",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 21 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 \"black canvas boat shoe with white sole\" 0 21 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 15 9 267 18 1 271 19 1 291 20 null null [OBJ] 2 \"purple and pink fabric sneaker\" 0 21 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 14 41 466 15 33 482 16 25 494 17 25 576 18 29 595 19 29 583 20 33 595 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 21 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 14 48 345 17 44 353 19 41 361 [OBJ] 4 \"white Lego Creationary game box\" 0 21 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 14 314 755 15 255 763 16 322 763 17 365 763 18 388 767 19 349 771 20 369 771 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 21 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 14 404 951 15 423 951 17 443 951 19 458 955 20 474 951 [OBJ] 6 \"black laptop\" 0 21 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 19 486 388 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 21 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 14 638 642 17 650 642 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 21 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 16 541 56 17 525 64 18 529 56 19 521 60 20 505 68 [OBJ] 9 \"black cardboard panty liner box\" 0 21 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 14 576 189 15 560 185 16 544 189 17 529 197 18 517 208 19 505 220 20 482 232 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 21 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 16 720 423 17 732 423 18 771 427 19 787 427 20 806 427 [OBJ] 11 \"silver leather boat shoe\" 0 21 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 16 716 177 18 708 173 19 705 181 20 697 173 [OBJ] 12 \"wooden toy railroad crossing\" 1 21 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 14 603 76 15 626 60 17 666 48 19 685 44 20 708 29 [OBJ] 13 \"white plastic supplement bottle\" 17 21 [PX] 0 null null 17 912 998 18 888 998 19 908 994 20 923 994 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 21,
"frames_visible": "0..21",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 22 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 \"black canvas boat shoe with white sole\" 0 22 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 15 9 267 18 1 271 19 1 291 20 null null [OBJ] 2 \"purple and pink fabric sneaker\" 0 22 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 14 41 466 15 33 482 16 25 494 17 25 576 18 29 595 19 29 583 20 33 595 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 22 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 14 48 345 17 44 353 19 41 361 21 37 376 [OBJ] 4 \"white Lego Creationary game box\" 0 22 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 14 314 755 15 255 763 16 322 763 17 365 763 18 388 767 19 349 771 20 369 771 21 298 783 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 22 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 14 404 951 15 423 951 17 443 951 19 458 955 20 474 951 21 486 951 [OBJ] 6 \"black laptop\" 0 22 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 19 486 388 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 22 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 14 638 642 17 650 642 21 658 638 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 22 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 16 541 56 17 525 64 18 529 56 19 521 60 20 505 68 21 494 72 [OBJ] 9 \"black cardboard panty liner box\" 0 22 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 14 576 189 15 560 185 16 544 189 17 529 197 18 517 208 19 505 220 20 482 232 21 458 255 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 22 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 16 720 423 17 732 423 18 771 427 19 787 427 20 806 427 21 830 427 [OBJ] 11 \"silver leather boat shoe\" 0 22 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 16 716 177 18 708 173 19 705 181 20 697 173 [OBJ] 12 \"wooden toy railroad crossing\" 1 22 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 14 603 76 15 626 60 17 666 48 19 685 44 20 708 29 21 720 17 [OBJ] 13 \"white plastic supplement bottle\" 17 22 [PX] 0 null null 17 912 998 18 888 998 19 908 994 20 923 994 21 970 990 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 22,
"frames_visible": "0..22",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 23 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 \"black canvas boat shoe with white sole\" 0 23 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 15 9 267 18 1 271 19 1 291 20 null null [OBJ] 2 \"purple and pink fabric sneaker\" 0 23 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 14 41 466 15 33 482 16 25 494 17 25 576 18 29 595 19 29 583 20 33 595 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 23 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 14 48 345 17 44 353 19 41 361 21 37 376 [OBJ] 4 \"white Lego Creationary game box\" 0 23 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 14 314 755 15 255 763 16 322 763 17 365 763 18 388 767 19 349 771 20 369 771 21 298 783 22 396 775 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 23 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 14 404 951 15 423 951 17 443 951 19 458 955 20 474 951 21 486 951 [OBJ] 6 \"black laptop\" 0 23 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 19 486 388 22 478 400 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 23 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 14 638 642 17 650 642 21 658 638 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 23 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 16 541 56 17 525 64 18 529 56 19 521 60 20 505 68 21 494 72 [OBJ] 9 \"black cardboard panty liner box\" 0 23 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 14 576 189 15 560 185 16 544 189 17 529 197 18 517 208 19 505 220 20 482 232 21 458 255 22 427 279 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 23 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 16 720 423 17 732 423 18 771 427 19 787 427 20 806 427 21 830 427 22 677 404 [OBJ] 11 \"silver leather boat shoe\" 0 23 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 16 716 177 18 708 173 19 705 181 20 697 173 22 689 181 [OBJ] 12 \"wooden toy railroad crossing\" 1 23 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 14 603 76 15 626 60 17 666 48 19 685 44 20 708 29 21 720 17 22 728 9 [OBJ] 13 \"white plastic supplement bottle\" 17 23 [PX] 0 null null 17 912 998 18 888 998 19 908 994 20 923 994 21 970 990 22 978 986 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 23,
"frames_visible": "0..23",
"provenance": "exact persisted final-step prefill and generation",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 24 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 \"black canvas boat shoe with white sole\" 0 24 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 15 9 267 18 1 271 19 1 291 20 null null [OBJ] 2 \"purple and pink fabric sneaker\" 0 24 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 14 41 466 15 33 482 16 25 494 17 25 576 18 29 595 19 29 583 20 33 595 23 41 603 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 24 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 14 48 345 17 44 353 19 41 361 21 37 376 23 29 373 [OBJ] 4 \"white Lego Creationary game box\" 0 24 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 14 314 755 15 255 763 16 322 763 17 365 763 18 388 767 19 349 771 20 369 771 21 298 783 22 396 775 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 24 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 14 404 951 15 423 951 17 443 951 19 458 955 20 474 951 21 486 951 23 498 955 [OBJ] 6 \"black laptop\" 0 24 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 19 486 388 22 478 400 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 24 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 14 638 642 17 650 642 21 658 638 23 662 630 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 24 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 16 541 56 17 525 64 18 529 56 19 521 60 20 505 68 21 494 72 23 482 76 [OBJ] 9 \"black cardboard panty liner box\" 0 24 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 14 576 189 15 560 185 16 544 189 17 529 197 18 517 208 19 505 220 20 482 232 21 458 255 22 427 279 23 400 291 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 24 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 16 720 423 17 732 423 18 771 427 19 787 427 20 806 427 21 830 427 22 677 404 [OBJ] 11 \"silver leather boat shoe\" 0 24 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 16 716 177 18 708 173 19 705 181 20 697 173 22 689 181 23 681 193 [OBJ] 12 \"wooden toy railroad crossing\" 1 24 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 14 603 76 15 626 60 17 666 48 19 685 44 20 708 29 21 720 17 22 728 9 [OBJ] 13 \"white plastic supplement bottle\" 17 24 [PX] 0 null null 17 912 998 18 888 998 19 908 994 20 923 994 21 970 990 22 978 986 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 8 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 20 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 20 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 20 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 4 \"contact\" 0 20 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 5 \"contact\" 0 20 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 6 \"contact\" 0 22 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 7 \"contact\" 0 22 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 8 \"contact\" 0 22 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 \"contact\" 0 22 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 10 \"contact\" 0 22 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 11 \"contact\" 0 22 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 12 \"collision\" 23 23 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 24 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 \"black canvas boat shoe with white sole\" 0 24 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 15 9 267 18 1 271 19 1 291 20 null null [OBJ] 2 \"purple and pink fabric sneaker\" 0 24 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 14 41 466 15 33 482 16 25 494 17 25 576 18 29 595 19 29 583 20 33 595 23 41 603 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 24 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 14 48 345 17 44 353 19 41 361 21 37 376 23 29 373 [OBJ] 4 \"white Lego Creationary game box\" 0 24 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 14 314 755 15 255 763 16 322 763 17 365 763 18 388 767 19 349 771 20 369 771 21 298 783 22 396 775 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 24 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 14 404 951 15 423 951 17 443 951 19 458 955 20 474 951 21 486 951 23 498 955 [OBJ] 6 \"black laptop\" 0 24 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 19 486 388 22 478 400 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 24 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 14 638 642 17 650 642 21 658 638 23 662 630 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 24 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 16 541 56 17 525 64 18 529 56 19 521 60 20 505 68 21 494 72 23 482 76 [OBJ] 9 \"black cardboard panty liner box\" 0 24 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 14 576 189 15 560 185 16 544 189 17 529 197 18 517 208 19 505 220 20 482 232 21 458 255 22 427 279 23 400 291 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 24 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 16 720 423 17 732 423 18 771 427 19 787 427 20 806 427 21 830 427 22 677 404 [OBJ] 11 \"silver leather boat shoe\" 0 24 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 16 716 177 18 708 173 19 705 181 20 697 173 22 689 181 23 681 193 [OBJ] 12 \"wooden toy railroad crossing\" 1 24 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 14 603 76 15 626 60 17 666 48 19 685 44 20 708 29 21 720 17 22 728 9 [OBJ] 13 \"white plastic supplement bottle\" 17 24 [PX] 0 null null 17 912 998 18 888 998 19 908 994 20 923 994 21 970 990 22 978 986 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 8 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 20 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 20 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 20 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 4 \"contact\" 0 20 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 5 \"contact\" 0 20 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 6 \"contact\" 0 22 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 7 \"contact\" 0 22 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 8 \"contact\" 0 22 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 \"contact\" 0 22 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 10 \"contact\" 0 22 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 11 \"contact\" 0 22 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 12 \"collision\" 23 23 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"intermediate_prediction_persisted": true
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "red ceramic planter" 0 24 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 "black canvas boat shoe with white sole" 0 24 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 15 9 267 18 1 271 19 1 291 20 null null [OBJ] 2 "purple and pink fabric sneaker" 0 24 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 14 41 466 15 33 482 16 25 494 17 25 576 18 29 595 19 29 583 20 33 595 23 41 603 [OBJ] 3 "grey, purple, and mint green high-top sneaker" 0 24 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 14 48 345 17 44 353 19 41 361 21 37 376 23 29 373 [OBJ] 4 "white Lego Creationary game box" 0 24 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 14 314 755 15 255 763 16 322 763 17 365 763 18 388 767 19 349 771 20 369 771 21 298 783 22 396 775 [OBJ] 5 "white and green cardboard ink cartridge box" 0 24 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 14 404 951 15 423 951 17 443 951 19 458 955 20 474 951 21 486 951 23 498 955 [OBJ] 6 "black laptop" 0 24 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 19 486 388 22 478 400 [OBJ] 7 "beige fabric pencil case with horse print" 0 24 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 14 638 642 17 650 642 21 658 638 23 662 630 [OBJ] 8 "blue and orange plastic Therizinosaurus figurine" 0 24 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 16 541 56 17 525 64 18 529 56 19 521 60 20 505 68 21 494 72 23 482 76 [OBJ] 9 "black cardboard panty liner box" 0 24 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 14 576 189 15 560 185 16 544 189 17 529 197 18 517 208 19 505 220 20 482 232 21 458 255 22 427 279 23 400 291 [OBJ] 10 "light blue and green cardboard fruit snack box" 0 24 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 16 720 423 17 732 423 18 771 427 19 787 427 20 806 427 21 830 427 22 677 404 [OBJ] 11 "silver leather boat shoe" 0 24 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 16 716 177 18 708 173 19 705 181 20 697 173 22 689 181 23 681 193 [OBJ] 12 "wooden toy railroad crossing" 1 24 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 14 603 76 15 626 60 17 666 48 19 685 44 20 708 29 21 720 17 22 728 9 [OBJ] 13 "white plastic supplement bottle" 17 24 [PX] 0 null null 17 912 998 18 888 998 19 908 994 20 923 994 21 970 990 22 978 986 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 "contact" 0 8 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 "contact" 0 20 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 "contact" 0 20 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 "contact" 0 20 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 4 "contact" 0 20 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 5 "contact" 0 20 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 6 "contact" 0 22 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 7 "contact" 0 22 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 8 "contact" 0 22 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 9 "contact" 0 22 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 10 "contact" 0 22 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 11 "contact" 0 22 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 12 "collision" 23 23 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 52,
"y": 83
},
{
"t": 1,
"x": 41,
"y": 87
},
{
"t": 2,
"x": 21,
"y": 72
},
{
"t": 3,
"x": 33,
"y": 95
},
{
"t": 6,
"x": 25,
"y": 99
},
{
"t": 7,
"x": 17,
"y": 95
},
{
"t": 10,
"x": 5,
"y": 99
},
{
"t": 11,
"x": 1,
"y": 107
},
{
"t": 12,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "red ceramic planter"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 72,
"y": 263
},
{
"t": 1,
"x": 64,
"y": 267
},
{
"t": 2,
"x": 56,
"y": 271
},
{
"t": 3,
"x": 48,
"y": 275
},
{
"t": 4,
"x": 25,
"y": 291
},
{
"t": 5,
"x": 21,
"y": 283
},
{
"t": 6,
"x": 44,
"y": 259
},
{
"t": 7,
"x": 33,
"y": 271
},
{
"t": 9,
"x": 25,
"y": 267
},
{
"t": 13,
"x": 13,
"y": 259
},
{
"t": 15,
"x": 9,
"y": 267
},
{
"t": 18,
"x": 1,
"y": 271
},
{
"t": 19,
"x": 1,
"y": 291
},
{
"t": 20,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 99,
"y": 392
},
{
"t": 1,
"x": 68,
"y": 396
},
{
"t": 2,
"x": 60,
"y": 400
},
{
"t": 3,
"x": 87,
"y": 400
},
{
"t": 4,
"x": 80,
"y": 404
},
{
"t": 5,
"x": 72,
"y": 408
},
{
"t": 6,
"x": 64,
"y": 412
},
{
"t": 7,
"x": 48,
"y": 427
},
{
"t": 8,
"x": 41,
"y": 439
},
{
"t": 9,
"x": 91,
"y": 439
},
{
"t": 10,
"x": 80,
"y": 439
},
{
"t": 11,
"x": 72,
"y": 443
},
{
"t": 12,
"x": 60,
"y": 451
},
{
"t": 13,
"x": 52,
"y": 455
},
{
"t": 14,
"x": 41,
"y": 466
},
{
"t": 15,
"x": 33,
"y": 482
},
{
"t": 16,
"x": 25,
"y": 494
},
{
"t": 17,
"x": 25,
"y": 576
},
{
"t": 18,
"x": 29,
"y": 595
},
{
"t": 19,
"x": 29,
"y": 583
},
{
"t": 20,
"x": 33,
"y": 595
},
{
"t": 23,
"x": 41,
"y": 603
}
],
"birth": 0,
"death": 24,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 216,
"y": 138
},
{
"t": 1,
"x": 189,
"y": 150
},
{
"t": 2,
"x": 169,
"y": 162
},
{
"t": 3,
"x": 142,
"y": 193
},
{
"t": 4,
"x": 126,
"y": 220
},
{
"t": 5,
"x": 95,
"y": 271
},
{
"t": 6,
"x": 83,
"y": 310
},
{
"t": 7,
"x": 99,
"y": 330
},
{
"t": 8,
"x": 60,
"y": 353
},
{
"t": 9,
"x": 52,
"y": 349
},
{
"t": 10,
"x": 41,
"y": 337
},
{
"t": 13,
"x": 56,
"y": 349
},
{
"t": 14,
"x": 48,
"y": 345
},
{
"t": 17,
"x": 44,
"y": 353
},
{
"t": 19,
"x": 41,
"y": 361
},
{
"t": 21,
"x": 37,
"y": 376
},
{
"t": 23,
"x": 29,
"y": 373
}
],
"birth": 0,
"death": 24,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 228,
"y": 701
},
{
"t": 2,
"x": 275,
"y": 716
},
{
"t": 3,
"x": 232,
"y": 716
},
{
"t": 6,
"x": 341,
"y": 736
},
{
"t": 7,
"x": 236,
"y": 732
},
{
"t": 10,
"x": 236,
"y": 744
},
{
"t": 12,
"x": 244,
"y": 751
},
{
"t": 14,
"x": 314,
"y": 755
},
{
"t": 15,
"x": 255,
"y": 763
},
{
"t": 16,
"x": 322,
"y": 763
},
{
"t": 17,
"x": 365,
"y": 763
},
{
"t": 18,
"x": 388,
"y": 767
},
{
"t": 19,
"x": 349,
"y": 771
},
{
"t": 20,
"x": 369,
"y": 771
},
{
"t": 21,
"x": 298,
"y": 783
},
{
"t": 22,
"x": 396,
"y": 775
}
],
"birth": 0,
"death": 24,
"type": "white Lego Creationary game box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 259,
"y": 923
},
{
"t": 1,
"x": 287,
"y": 927
},
{
"t": 2,
"x": 302,
"y": 927
},
{
"t": 3,
"x": 318,
"y": 931
},
{
"t": 4,
"x": 330,
"y": 931
},
{
"t": 5,
"x": 337,
"y": 935
},
{
"t": 7,
"x": 353,
"y": 939
},
{
"t": 9,
"x": 365,
"y": 943
},
{
"t": 11,
"x": 373,
"y": 947
},
{
"t": 12,
"x": 400,
"y": 943
},
{
"t": 14,
"x": 404,
"y": 951
},
{
"t": 15,
"x": 423,
"y": 951
},
{
"t": 17,
"x": 443,
"y": 951
},
{
"t": 19,
"x": 458,
"y": 955
},
{
"t": 20,
"x": 474,
"y": 951
},
{
"t": 21,
"x": 486,
"y": 951
},
{
"t": 23,
"x": 498,
"y": 955
}
],
"birth": 0,
"death": 24,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 525,
"y": 404
},
{
"t": 3,
"x": 529,
"y": 396
},
{
"t": 4,
"x": 521,
"y": 400
},
{
"t": 5,
"x": 529,
"y": 392
},
{
"t": 7,
"x": 513,
"y": 396
},
{
"t": 9,
"x": 509,
"y": 388
},
{
"t": 10,
"x": 501,
"y": 392
},
{
"t": 12,
"x": 505,
"y": 384
},
{
"t": 13,
"x": 498,
"y": 392
},
{
"t": 19,
"x": 486,
"y": 388
},
{
"t": 22,
"x": 478,
"y": 400
}
],
"birth": 0,
"death": 24,
"type": "black laptop"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 587,
"y": 658
},
{
"t": 1,
"x": 595,
"y": 650
},
{
"t": 2,
"x": 587,
"y": 662
},
{
"t": 3,
"x": 599,
"y": 646
},
{
"t": 6,
"x": 595,
"y": 654
},
{
"t": 8,
"x": 607,
"y": 642
},
{
"t": 10,
"x": 611,
"y": 650
},
{
"t": 11,
"x": 623,
"y": 642
},
{
"t": 13,
"x": 630,
"y": 646
},
{
"t": 14,
"x": 638,
"y": 642
},
{
"t": 17,
"x": 650,
"y": 642
},
{
"t": 21,
"x": 658,
"y": 638
},
{
"t": 23,
"x": 662,
"y": 630
}
],
"birth": 0,
"death": 24,
"type": "beige fabric pencil case with horse print"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 68
},
{
"t": 2,
"x": 626,
"y": 68
},
{
"t": 4,
"x": 619,
"y": 64
},
{
"t": 5,
"x": 607,
"y": 64
},
{
"t": 6,
"x": 615,
"y": 52
},
{
"t": 7,
"x": 599,
"y": 60
},
{
"t": 9,
"x": 583,
"y": 60
},
{
"t": 11,
"x": 568,
"y": 60
},
{
"t": 13,
"x": 552,
"y": 60
},
{
"t": 16,
"x": 541,
"y": 56
},
{
"t": 17,
"x": 525,
"y": 64
},
{
"t": 18,
"x": 529,
"y": 56
},
{
"t": 19,
"x": 521,
"y": 60
},
{
"t": 20,
"x": 505,
"y": 68
},
{
"t": 21,
"x": 494,
"y": 72
},
{
"t": 23,
"x": 482,
"y": 76
}
],
"birth": 0,
"death": 24,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 744,
"y": 91
},
{
"t": 1,
"x": 732,
"y": 83
},
{
"t": 3,
"x": 716,
"y": 91
},
{
"t": 4,
"x": 701,
"y": 115
},
{
"t": 5,
"x": 685,
"y": 146
},
{
"t": 6,
"x": 673,
"y": 169
},
{
"t": 7,
"x": 658,
"y": 185
},
{
"t": 8,
"x": 646,
"y": 173
},
{
"t": 9,
"x": 630,
"y": 177
},
{
"t": 11,
"x": 607,
"y": 177
},
{
"t": 12,
"x": 599,
"y": 185
},
{
"t": 13,
"x": 583,
"y": 181
},
{
"t": 14,
"x": 576,
"y": 189
},
{
"t": 15,
"x": 560,
"y": 185
},
{
"t": 16,
"x": 544,
"y": 189
},
{
"t": 17,
"x": 529,
"y": 197
},
{
"t": 18,
"x": 517,
"y": 208
},
{
"t": 19,
"x": 505,
"y": 220
},
{
"t": 20,
"x": 482,
"y": 232
},
{
"t": 21,
"x": 458,
"y": 255
},
{
"t": 22,
"x": 427,
"y": 279
},
{
"t": 23,
"x": 400,
"y": 291
}
],
"birth": 0,
"death": 24,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 751,
"y": 486
},
{
"t": 1,
"x": 658,
"y": 427
},
{
"t": 2,
"x": 681,
"y": 439
},
{
"t": 3,
"x": 693,
"y": 443
},
{
"t": 4,
"x": 712,
"y": 451
},
{
"t": 5,
"x": 759,
"y": 474
},
{
"t": 7,
"x": 716,
"y": 443
},
{
"t": 9,
"x": 736,
"y": 447
},
{
"t": 10,
"x": 720,
"y": 439
},
{
"t": 11,
"x": 771,
"y": 451
},
{
"t": 12,
"x": 806,
"y": 455
},
{
"t": 13,
"x": 705,
"y": 427
},
{
"t": 16,
"x": 720,
"y": 423
},
{
"t": 17,
"x": 732,
"y": 423
},
{
"t": 18,
"x": 771,
"y": 427
},
{
"t": 19,
"x": 787,
"y": 427
},
{
"t": 20,
"x": 806,
"y": 427
},
{
"t": 21,
"x": 830,
"y": 427
},
{
"t": 22,
"x": 677,
"y": 404
}
],
"birth": 0,
"death": 24,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 798,
"y": 216
},
{
"t": 1,
"x": 791,
"y": 220
},
{
"t": 2,
"x": 787,
"y": 208
},
{
"t": 3,
"x": 779,
"y": 216
},
{
"t": 4,
"x": 775,
"y": 205
},
{
"t": 5,
"x": 771,
"y": 193
},
{
"t": 6,
"x": 763,
"y": 208
},
{
"t": 7,
"x": 759,
"y": 193
},
{
"t": 9,
"x": 751,
"y": 185
},
{
"t": 11,
"x": 744,
"y": 181
},
{
"t": 13,
"x": 732,
"y": 177
},
{
"t": 16,
"x": 716,
"y": 177
},
{
"t": 18,
"x": 708,
"y": 173
},
{
"t": 19,
"x": 705,
"y": 181
},
{
"t": 20,
"x": 697,
"y": 173
},
{
"t": 22,
"x": 689,
"y": 181
},
{
"t": 23,
"x": 681,
"y": 193
}
],
"birth": 0,
"death": 24,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 1,
"x": 1,
"y": 1
},
{
"t": 2,
"x": 72,
"y": 5
},
{
"t": 3,
"x": 138,
"y": 5
},
{
"t": 4,
"x": 205,
"y": 9
},
{
"t": 5,
"x": 263,
"y": 25
},
{
"t": 6,
"x": 314,
"y": 48
},
{
"t": 7,
"x": 361,
"y": 76
},
{
"t": 8,
"x": 404,
"y": 107
},
{
"t": 9,
"x": 435,
"y": 138
},
{
"t": 10,
"x": 470,
"y": 162
},
{
"t": 11,
"x": 501,
"y": 158
},
{
"t": 12,
"x": 498,
"y": 130
},
{
"t": 13,
"x": 529,
"y": 111
},
{
"t": 14,
"x": 603,
"y": 76
},
{
"t": 15,
"x": 626,
"y": 60
},
{
"t": 17,
"x": 666,
"y": 48
},
{
"t": 19,
"x": 685,
"y": 44
},
{
"t": 20,
"x": 708,
"y": 29
},
{
"t": 21,
"x": 720,
"y": 17
},
{
"t": 22,
"x": 728,
"y": 9
}
],
"birth": 1,
"death": 24,
"type": "wooden toy railroad crossing"
},
{
"id": 13,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 17,
"x": 912,
"y": 998
},
{
"t": 18,
"x": 888,
"y": 998
},
{
"t": 19,
"x": 908,
"y": 994
},
{
"t": 20,
"x": 923,
"y": 994
},
{
"t": 21,
"x": 970,
"y": 990
},
{
"t": 22,
"x": 978,
"y": 986
}
],
"birth": 17,
"death": 24,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 20,
"type": "contact"
},
{
"id": 2,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 20,
"type": "contact"
},
{
"id": 3,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 20,
"type": "contact"
},
{
"id": 4,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 20,
"type": "contact"
},
{
"id": 5,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 20,
"type": "contact"
},
{
"id": 6,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 22,
"type": "contact"
},
{
"id": 7,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 22,
"type": "contact"
},
{
"id": 8,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 22,
"type": "contact"
},
{
"id": 9,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 22,
"type": "contact"
},
{
"id": 10,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 22,
"type": "contact"
},
{
"id": 11,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 22,
"type": "contact"
},
{
"id": 12,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 1.0,
"avg_image_position_segmentation_acc_small": 1.0,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 1.0,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": 1.0,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 1.0,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 1.0,
"num_matches": 14,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.9241452991452992,
"avg_interaction_input_object_jaccard": 0.7179487179487178,
"avg_interaction_output_object_jaccard": 0.7179487179487178,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 13,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 15,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 13,
"false_positives": 0,
"false_negatives": 15
},
"0.5": {
"true_positives": 13,
"false_positives": 0,
"false_negatives": 15
},
"0.75": {
"true_positives": 13,
"false_positives": 0,
"false_negatives": 15
},
"1.0": {
"true_positives": 1,
"false_positives": 12,
"false_negatives": 15
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 0.07692307692307693
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.4642857142857143,
"0.5": 0.4642857142857143,
"0.75": 0.4642857142857143,
"1.0": 0.0625
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.6341463414634146,
"0.5": 0.6341463414634146,
"0.75": 0.6341463414634146,
"1.0": 0.06896551724137931
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 12,
"false_positives": 1,
"false_negatives": 15
},
"0.5": {
"true_positives": 8,
"false_positives": 5,
"false_negatives": 15
},
"0.75": {
"true_positives": 8,
"false_positives": 5,
"false_negatives": 15
},
"1.0": {
"true_positives": 8,
"false_positives": 5,
"false_negatives": 15
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.9230769230769231,
"0.5": 0.6153846153846154,
"0.75": 0.6153846153846154,
"1.0": 0.6153846153846154
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.4444444444444444,
"0.5": 0.34782608695652173,
"0.75": 0.34782608695652173,
"1.0": 0.34782608695652173
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.6,
"0.5": 0.4444444444444444,
"0.75": 0.4444444444444444,
"1.0": 0.4444444444444444
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 12,
"false_positives": 1,
"false_negatives": 15
},
"0.5": {
"true_positives": 8,
"false_positives": 5,
"false_negatives": 15
},
"0.75": {
"true_positives": 8,
"false_positives": 5,
"false_negatives": 15
},
"1.0": {
"true_positives": 8,
"false_positives": 5,
"false_negatives": 15
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.9230769230769231,
"0.5": 0.6153846153846154,
"0.75": 0.6153846153846154,
"1.0": 0.6153846153846154
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.4444444444444444,
"0.5": 0.34782608695652173,
"0.75": 0.34782608695652173,
"1.0": 0.34782608695652173
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.6,
"0.5": 0.4444444444444444,
"0.75": 0.4444444444444444,
"1.0": 0.4444444444444444
}
}
}Prompt
<video> Analyze the provided video and return ONLY a valid sentinel sequence in this format: [SCENE-START] [OBJS-START] [OBJ] id "type" birth death [PX] t px py ... [OBJ] ... [OBJS-END] [INTERACTIONS-START] [INTERACT] id "type" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ... [INTERACT] ... [INTERACTIONS-END] [SCENE-END] Constraints: - Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose). - Keep tags exactly as written: `[SCENE-START] [OBJS-START] [OBJ] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]` - Use quoted strings for `type` (double quotes). - `PX` uses repeated groups of 3 values in order: `t px py`. - `t` is the timestamp (frame number). - `px` and `py` are the pixel coordinates of the object in that frame, normalized to [0,1] relative to the frame dimensions, scaled by 1000 and rounded to the nearest integer. For example, `px` of 0.1234 would be represented as 123. - When an object is occluded or not visible in a frame, `PX` may use `t null null`. - `IN` and `OUT` contain whitespace-separated integer ids.
One full-clip GT object prefill
The E2E model saw all 24 frames once. Its assistant text was the exact GT object section through [INTERACTIONS-START], and the model generated only the interaction suffix shown here.
Every persisted/reconstructed prefill step
[
{
"frame_index": 23,
"frames_visible": "0..23",
"provenance": "exact persisted full-clip prefill and generation",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 24 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 \"black canvas boat shoe with white sole\" 0 24 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 15 9 267 18 1 271 19 1 291 20 null null [OBJ] 2 \"purple and pink fabric sneaker\" 0 24 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 14 41 466 15 33 482 16 25 494 17 25 576 18 29 595 19 29 583 20 33 595 23 41 603 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 24 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 14 48 345 17 44 353 19 41 361 21 37 376 23 29 373 [OBJ] 4 \"white Lego Creationary game box\" 0 24 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 14 314 755 15 255 763 16 322 763 17 365 763 18 388 767 19 349 771 20 369 771 21 298 783 22 396 775 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 24 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 14 404 951 15 423 951 17 443 951 19 458 955 20 474 951 21 486 951 23 498 955 [OBJ] 6 \"black laptop\" 0 24 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 19 486 388 22 478 400 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 24 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 14 638 642 17 650 642 21 658 638 23 662 630 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 24 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 16 541 56 17 525 64 18 529 56 19 521 60 20 505 68 21 494 72 23 482 76 [OBJ] 9 \"black cardboard panty liner box\" 0 24 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 14 576 189 15 560 185 16 544 189 17 529 197 18 517 208 19 505 220 20 482 232 21 458 255 22 427 279 23 400 291 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 24 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 16 720 423 17 732 423 18 771 427 19 787 427 20 806 427 21 830 427 22 677 404 [OBJ] 11 \"silver leather boat shoe\" 0 24 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 16 716 177 18 708 173 19 705 181 20 697 173 22 689 181 23 681 193 [OBJ] 12 \"wooden toy railroad crossing\" 1 24 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 14 603 76 15 626 60 17 666 48 19 685 44 20 708 29 21 720 17 22 728 9 [OBJ] 13 \"white plastic supplement bottle\" 17 24 [PX] 0 null null 17 912 998 18 888 998 19 908 994 20 923 994 21 970 990 22 978 986 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 10 \"contact\" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 14 \"contact\" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 15 \"contact\" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 16 \"contact\" 0 23 [IN] 6 10 [OUT] 6 10 [INTERACT] 17 \"contact\" 0 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 18 \"contact\" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 19 \"contact\" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 2 \"contact\" 0 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 23 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 8 \"contact\" 0 23 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 9 \"collision\" 6 6 [IN] 2 3 [OUT] 2 3 [INTERACT] 26 \"collision\" 6 6 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 23 \"collision\" 7 7 [IN] 9 10 [OUT] 9 10 [INTERACT] 27 \"collision\" 9 9 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 24 \"collision\" 10 10 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 25 \"contact\" 11 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 11 \"collision\" 13 13 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 12 \"collision\" 15 15 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 20 \"collision\" 15 15 [IN] 9 10 [OUT] 9 10 [INTERACT] 13 \"contact\" 16 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 21 \"collision\" 17 17 [IN] 9 10 [OUT] 9 10 [INTERACT] 22 \"contact\" 18 23 [IN] 9 10 [OUT] 9 10 [INTERACT] 4 \"collision\" 22 22 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 5 \"contact\" 23 23 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 \"collision\" 20 20 [IN] 13 17 [OUT] 13 17 [INTERACT] 7 \"collision\" 22 22 [IN] 13 17 [OUT] 13 17 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red ceramic planter\" 0 24 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 \"black canvas boat shoe with white sole\" 0 24 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 15 9 267 18 1 271 19 1 291 20 null null [OBJ] 2 \"purple and pink fabric sneaker\" 0 24 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 14 41 466 15 33 482 16 25 494 17 25 576 18 29 595 19 29 583 20 33 595 23 41 603 [OBJ] 3 \"grey, purple, and mint green high-top sneaker\" 0 24 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 14 48 345 17 44 353 19 41 361 21 37 376 23 29 373 [OBJ] 4 \"white Lego Creationary game box\" 0 24 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 14 314 755 15 255 763 16 322 763 17 365 763 18 388 767 19 349 771 20 369 771 21 298 783 22 396 775 [OBJ] 5 \"white and green cardboard ink cartridge box\" 0 24 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 14 404 951 15 423 951 17 443 951 19 458 955 20 474 951 21 486 951 23 498 955 [OBJ] 6 \"black laptop\" 0 24 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 19 486 388 22 478 400 [OBJ] 7 \"beige fabric pencil case with horse print\" 0 24 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 14 638 642 17 650 642 21 658 638 23 662 630 [OBJ] 8 \"blue and orange plastic Therizinosaurus figurine\" 0 24 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 16 541 56 17 525 64 18 529 56 19 521 60 20 505 68 21 494 72 23 482 76 [OBJ] 9 \"black cardboard panty liner box\" 0 24 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 14 576 189 15 560 185 16 544 189 17 529 197 18 517 208 19 505 220 20 482 232 21 458 255 22 427 279 23 400 291 [OBJ] 10 \"light blue and green cardboard fruit snack box\" 0 24 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 16 720 423 17 732 423 18 771 427 19 787 427 20 806 427 21 830 427 22 677 404 [OBJ] 11 \"silver leather boat shoe\" 0 24 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 16 716 177 18 708 173 19 705 181 20 697 173 22 689 181 23 681 193 [OBJ] 12 \"wooden toy railroad crossing\" 1 24 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 14 603 76 15 626 60 17 666 48 19 685 44 20 708 29 21 720 17 22 728 9 [OBJ] 13 \"white plastic supplement bottle\" 17 24 [PX] 0 null null 17 912 998 18 888 998 19 908 994 20 923 994 21 970 990 22 978 986 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 10 \"contact\" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 14 \"contact\" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 15 \"contact\" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 16 \"contact\" 0 23 [IN] 6 10 [OUT] 6 10 [INTERACT] 17 \"contact\" 0 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 18 \"contact\" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 19 \"contact\" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 2 \"contact\" 0 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 23 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 8 \"contact\" 0 23 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 9 \"collision\" 6 6 [IN] 2 3 [OUT] 2 3 [INTERACT] 26 \"collision\" 6 6 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 23 \"collision\" 7 7 [IN] 9 10 [OUT] 9 10 [INTERACT] 27 \"collision\" 9 9 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 24 \"collision\" 10 10 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 25 \"contact\" 11 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 11 \"collision\" 13 13 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 12 \"collision\" 15 15 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 20 \"collision\" 15 15 [IN] 9 10 [OUT] 9 10 [INTERACT] 13 \"contact\" 16 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 21 \"collision\" 17 17 [IN] 9 10 [OUT] 9 10 [INTERACT] 22 \"contact\" 18 23 [IN] 9 10 [OUT] 9 10 [INTERACT] 4 \"collision\" 22 22 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 5 \"contact\" 23 23 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 \"collision\" 20 20 [IN] 13 17 [OUT] 13 17 [INTERACT] 7 \"collision\" 22 22 [IN] 13 17 [OUT] 13 17 [INTERACTIONS-END] [SCENE-END]"
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "red ceramic planter" 0 24 [PX] 0 52 83 1 41 87 2 21 72 3 33 95 6 25 99 7 17 95 10 5 99 11 1 107 12 null null [OBJ] 1 "black canvas boat shoe with white sole" 0 24 [PX] 0 72 263 1 64 267 2 56 271 3 48 275 4 25 291 5 21 283 6 44 259 7 33 271 9 25 267 13 13 259 15 9 267 18 1 271 19 1 291 20 null null [OBJ] 2 "purple and pink fabric sneaker" 0 24 [PX] 0 99 392 1 68 396 2 60 400 3 87 400 4 80 404 5 72 408 6 64 412 7 48 427 8 41 439 9 91 439 10 80 439 11 72 443 12 60 451 13 52 455 14 41 466 15 33 482 16 25 494 17 25 576 18 29 595 19 29 583 20 33 595 23 41 603 [OBJ] 3 "grey, purple, and mint green high-top sneaker" 0 24 [PX] 0 216 138 1 189 150 2 169 162 3 142 193 4 126 220 5 95 271 6 83 310 7 99 330 8 60 353 9 52 349 10 41 337 13 56 349 14 48 345 17 44 353 19 41 361 21 37 376 23 29 373 [OBJ] 4 "white Lego Creationary game box" 0 24 [PX] 0 228 701 2 275 716 3 232 716 6 341 736 7 236 732 10 236 744 12 244 751 14 314 755 15 255 763 16 322 763 17 365 763 18 388 767 19 349 771 20 369 771 21 298 783 22 396 775 [OBJ] 5 "white and green cardboard ink cartridge box" 0 24 [PX] 0 259 923 1 287 927 2 302 927 3 318 931 4 330 931 5 337 935 7 353 939 9 365 943 11 373 947 12 400 943 14 404 951 15 423 951 17 443 951 19 458 955 20 474 951 21 486 951 23 498 955 [OBJ] 6 "black laptop" 0 24 [PX] 0 525 404 3 529 396 4 521 400 5 529 392 7 513 396 9 509 388 10 501 392 12 505 384 13 498 392 19 486 388 22 478 400 [OBJ] 7 "beige fabric pencil case with horse print" 0 24 [PX] 0 587 658 1 595 650 2 587 662 3 599 646 6 595 654 8 607 642 10 611 650 11 623 642 13 630 646 14 638 642 17 650 642 21 658 638 23 662 630 [OBJ] 8 "blue and orange plastic Therizinosaurus figurine" 0 24 [PX] 0 646 68 2 626 68 4 619 64 5 607 64 6 615 52 7 599 60 9 583 60 11 568 60 13 552 60 16 541 56 17 525 64 18 529 56 19 521 60 20 505 68 21 494 72 23 482 76 [OBJ] 9 "black cardboard panty liner box" 0 24 [PX] 0 744 91 1 732 83 3 716 91 4 701 115 5 685 146 6 673 169 7 658 185 8 646 173 9 630 177 11 607 177 12 599 185 13 583 181 14 576 189 15 560 185 16 544 189 17 529 197 18 517 208 19 505 220 20 482 232 21 458 255 22 427 279 23 400 291 [OBJ] 10 "light blue and green cardboard fruit snack box" 0 24 [PX] 0 751 486 1 658 427 2 681 439 3 693 443 4 712 451 5 759 474 7 716 443 9 736 447 10 720 439 11 771 451 12 806 455 13 705 427 16 720 423 17 732 423 18 771 427 19 787 427 20 806 427 21 830 427 22 677 404 [OBJ] 11 "silver leather boat shoe" 0 24 [PX] 0 798 216 1 791 220 2 787 208 3 779 216 4 775 205 5 771 193 6 763 208 7 759 193 9 751 185 11 744 181 13 732 177 16 716 177 18 708 173 19 705 181 20 697 173 22 689 181 23 681 193 [OBJ] 12 "wooden toy railroad crossing" 1 24 [PX] 0 null null 1 1 1 2 72 5 3 138 5 4 205 9 5 263 25 6 314 48 7 361 76 8 404 107 9 435 138 10 470 162 11 501 158 12 498 130 13 529 111 14 603 76 15 626 60 17 666 48 19 685 44 20 708 29 21 720 17 22 728 9 [OBJ] 13 "white plastic supplement bottle" 17 24 [PX] 0 null null 17 912 998 18 888 998 19 908 994 20 923 994 21 970 990 22 978 986 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 "contact" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 "contact" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 10 "contact" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 14 "contact" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 15 "contact" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 16 "contact" 0 23 [IN] 6 10 [OUT] 6 10 [INTERACT] 17 "contact" 0 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 18 "contact" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 19 "contact" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 2 "contact" 0 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 "contact" 0 23 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 8 "contact" 0 23 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 9 "collision" 6 6 [IN] 2 3 [OUT] 2 3 [INTERACT] 26 "collision" 6 6 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 23 "collision" 7 7 [IN] 9 10 [OUT] 9 10 [INTERACT] 27 "collision" 9 9 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 24 "collision" 10 10 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 25 "contact" 11 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 11 "collision" 13 13 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 12 "collision" 15 15 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 20 "collision" 15 15 [IN] 9 10 [OUT] 9 10 [INTERACT] 13 "contact" 16 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 21 "collision" 17 17 [IN] 9 10 [OUT] 9 10 [INTERACT] 22 "contact" 18 23 [IN] 9 10 [OUT] 9 10 [INTERACT] 4 "collision" 22 22 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 5 "contact" 23 23 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 6 "collision" 20 20 [IN] 13 17 [OUT] 13 17 [INTERACT] 7 "collision" 22 22 [IN] 13 17 [OUT] 13 17 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 52,
"y": 83
},
{
"t": 1,
"x": 41,
"y": 87
},
{
"t": 2,
"x": 21,
"y": 72
},
{
"t": 3,
"x": 33,
"y": 95
},
{
"t": 6,
"x": 25,
"y": 99
},
{
"t": 7,
"x": 17,
"y": 95
},
{
"t": 10,
"x": 5,
"y": 99
},
{
"t": 11,
"x": 1,
"y": 107
},
{
"t": 12,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "red ceramic planter"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 72,
"y": 263
},
{
"t": 1,
"x": 64,
"y": 267
},
{
"t": 2,
"x": 56,
"y": 271
},
{
"t": 3,
"x": 48,
"y": 275
},
{
"t": 4,
"x": 25,
"y": 291
},
{
"t": 5,
"x": 21,
"y": 283
},
{
"t": 6,
"x": 44,
"y": 259
},
{
"t": 7,
"x": 33,
"y": 271
},
{
"t": 9,
"x": 25,
"y": 267
},
{
"t": 13,
"x": 13,
"y": 259
},
{
"t": 15,
"x": 9,
"y": 267
},
{
"t": 18,
"x": 1,
"y": 271
},
{
"t": 19,
"x": 1,
"y": 291
},
{
"t": 20,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "black canvas boat shoe with white sole"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 99,
"y": 392
},
{
"t": 1,
"x": 68,
"y": 396
},
{
"t": 2,
"x": 60,
"y": 400
},
{
"t": 3,
"x": 87,
"y": 400
},
{
"t": 4,
"x": 80,
"y": 404
},
{
"t": 5,
"x": 72,
"y": 408
},
{
"t": 6,
"x": 64,
"y": 412
},
{
"t": 7,
"x": 48,
"y": 427
},
{
"t": 8,
"x": 41,
"y": 439
},
{
"t": 9,
"x": 91,
"y": 439
},
{
"t": 10,
"x": 80,
"y": 439
},
{
"t": 11,
"x": 72,
"y": 443
},
{
"t": 12,
"x": 60,
"y": 451
},
{
"t": 13,
"x": 52,
"y": 455
},
{
"t": 14,
"x": 41,
"y": 466
},
{
"t": 15,
"x": 33,
"y": 482
},
{
"t": 16,
"x": 25,
"y": 494
},
{
"t": 17,
"x": 25,
"y": 576
},
{
"t": 18,
"x": 29,
"y": 595
},
{
"t": 19,
"x": 29,
"y": 583
},
{
"t": 20,
"x": 33,
"y": 595
},
{
"t": 23,
"x": 41,
"y": 603
}
],
"birth": 0,
"death": 24,
"type": "purple and pink fabric sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 216,
"y": 138
},
{
"t": 1,
"x": 189,
"y": 150
},
{
"t": 2,
"x": 169,
"y": 162
},
{
"t": 3,
"x": 142,
"y": 193
},
{
"t": 4,
"x": 126,
"y": 220
},
{
"t": 5,
"x": 95,
"y": 271
},
{
"t": 6,
"x": 83,
"y": 310
},
{
"t": 7,
"x": 99,
"y": 330
},
{
"t": 8,
"x": 60,
"y": 353
},
{
"t": 9,
"x": 52,
"y": 349
},
{
"t": 10,
"x": 41,
"y": 337
},
{
"t": 13,
"x": 56,
"y": 349
},
{
"t": 14,
"x": 48,
"y": 345
},
{
"t": 17,
"x": 44,
"y": 353
},
{
"t": 19,
"x": 41,
"y": 361
},
{
"t": 21,
"x": 37,
"y": 376
},
{
"t": 23,
"x": 29,
"y": 373
}
],
"birth": 0,
"death": 24,
"type": "grey, purple, and mint green high-top sneaker"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 228,
"y": 701
},
{
"t": 2,
"x": 275,
"y": 716
},
{
"t": 3,
"x": 232,
"y": 716
},
{
"t": 6,
"x": 341,
"y": 736
},
{
"t": 7,
"x": 236,
"y": 732
},
{
"t": 10,
"x": 236,
"y": 744
},
{
"t": 12,
"x": 244,
"y": 751
},
{
"t": 14,
"x": 314,
"y": 755
},
{
"t": 15,
"x": 255,
"y": 763
},
{
"t": 16,
"x": 322,
"y": 763
},
{
"t": 17,
"x": 365,
"y": 763
},
{
"t": 18,
"x": 388,
"y": 767
},
{
"t": 19,
"x": 349,
"y": 771
},
{
"t": 20,
"x": 369,
"y": 771
},
{
"t": 21,
"x": 298,
"y": 783
},
{
"t": 22,
"x": 396,
"y": 775
}
],
"birth": 0,
"death": 24,
"type": "white Lego Creationary game box"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 259,
"y": 923
},
{
"t": 1,
"x": 287,
"y": 927
},
{
"t": 2,
"x": 302,
"y": 927
},
{
"t": 3,
"x": 318,
"y": 931
},
{
"t": 4,
"x": 330,
"y": 931
},
{
"t": 5,
"x": 337,
"y": 935
},
{
"t": 7,
"x": 353,
"y": 939
},
{
"t": 9,
"x": 365,
"y": 943
},
{
"t": 11,
"x": 373,
"y": 947
},
{
"t": 12,
"x": 400,
"y": 943
},
{
"t": 14,
"x": 404,
"y": 951
},
{
"t": 15,
"x": 423,
"y": 951
},
{
"t": 17,
"x": 443,
"y": 951
},
{
"t": 19,
"x": 458,
"y": 955
},
{
"t": 20,
"x": 474,
"y": 951
},
{
"t": 21,
"x": 486,
"y": 951
},
{
"t": 23,
"x": 498,
"y": 955
}
],
"birth": 0,
"death": 24,
"type": "white and green cardboard ink cartridge box"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 525,
"y": 404
},
{
"t": 3,
"x": 529,
"y": 396
},
{
"t": 4,
"x": 521,
"y": 400
},
{
"t": 5,
"x": 529,
"y": 392
},
{
"t": 7,
"x": 513,
"y": 396
},
{
"t": 9,
"x": 509,
"y": 388
},
{
"t": 10,
"x": 501,
"y": 392
},
{
"t": 12,
"x": 505,
"y": 384
},
{
"t": 13,
"x": 498,
"y": 392
},
{
"t": 19,
"x": 486,
"y": 388
},
{
"t": 22,
"x": 478,
"y": 400
}
],
"birth": 0,
"death": 24,
"type": "black laptop"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 587,
"y": 658
},
{
"t": 1,
"x": 595,
"y": 650
},
{
"t": 2,
"x": 587,
"y": 662
},
{
"t": 3,
"x": 599,
"y": 646
},
{
"t": 6,
"x": 595,
"y": 654
},
{
"t": 8,
"x": 607,
"y": 642
},
{
"t": 10,
"x": 611,
"y": 650
},
{
"t": 11,
"x": 623,
"y": 642
},
{
"t": 13,
"x": 630,
"y": 646
},
{
"t": 14,
"x": 638,
"y": 642
},
{
"t": 17,
"x": 650,
"y": 642
},
{
"t": 21,
"x": 658,
"y": 638
},
{
"t": 23,
"x": 662,
"y": 630
}
],
"birth": 0,
"death": 24,
"type": "beige fabric pencil case with horse print"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 68
},
{
"t": 2,
"x": 626,
"y": 68
},
{
"t": 4,
"x": 619,
"y": 64
},
{
"t": 5,
"x": 607,
"y": 64
},
{
"t": 6,
"x": 615,
"y": 52
},
{
"t": 7,
"x": 599,
"y": 60
},
{
"t": 9,
"x": 583,
"y": 60
},
{
"t": 11,
"x": 568,
"y": 60
},
{
"t": 13,
"x": 552,
"y": 60
},
{
"t": 16,
"x": 541,
"y": 56
},
{
"t": 17,
"x": 525,
"y": 64
},
{
"t": 18,
"x": 529,
"y": 56
},
{
"t": 19,
"x": 521,
"y": 60
},
{
"t": 20,
"x": 505,
"y": 68
},
{
"t": 21,
"x": 494,
"y": 72
},
{
"t": 23,
"x": 482,
"y": 76
}
],
"birth": 0,
"death": 24,
"type": "blue and orange plastic Therizinosaurus figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 744,
"y": 91
},
{
"t": 1,
"x": 732,
"y": 83
},
{
"t": 3,
"x": 716,
"y": 91
},
{
"t": 4,
"x": 701,
"y": 115
},
{
"t": 5,
"x": 685,
"y": 146
},
{
"t": 6,
"x": 673,
"y": 169
},
{
"t": 7,
"x": 658,
"y": 185
},
{
"t": 8,
"x": 646,
"y": 173
},
{
"t": 9,
"x": 630,
"y": 177
},
{
"t": 11,
"x": 607,
"y": 177
},
{
"t": 12,
"x": 599,
"y": 185
},
{
"t": 13,
"x": 583,
"y": 181
},
{
"t": 14,
"x": 576,
"y": 189
},
{
"t": 15,
"x": 560,
"y": 185
},
{
"t": 16,
"x": 544,
"y": 189
},
{
"t": 17,
"x": 529,
"y": 197
},
{
"t": 18,
"x": 517,
"y": 208
},
{
"t": 19,
"x": 505,
"y": 220
},
{
"t": 20,
"x": 482,
"y": 232
},
{
"t": 21,
"x": 458,
"y": 255
},
{
"t": 22,
"x": 427,
"y": 279
},
{
"t": 23,
"x": 400,
"y": 291
}
],
"birth": 0,
"death": 24,
"type": "black cardboard panty liner box"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 751,
"y": 486
},
{
"t": 1,
"x": 658,
"y": 427
},
{
"t": 2,
"x": 681,
"y": 439
},
{
"t": 3,
"x": 693,
"y": 443
},
{
"t": 4,
"x": 712,
"y": 451
},
{
"t": 5,
"x": 759,
"y": 474
},
{
"t": 7,
"x": 716,
"y": 443
},
{
"t": 9,
"x": 736,
"y": 447
},
{
"t": 10,
"x": 720,
"y": 439
},
{
"t": 11,
"x": 771,
"y": 451
},
{
"t": 12,
"x": 806,
"y": 455
},
{
"t": 13,
"x": 705,
"y": 427
},
{
"t": 16,
"x": 720,
"y": 423
},
{
"t": 17,
"x": 732,
"y": 423
},
{
"t": 18,
"x": 771,
"y": 427
},
{
"t": 19,
"x": 787,
"y": 427
},
{
"t": 20,
"x": 806,
"y": 427
},
{
"t": 21,
"x": 830,
"y": 427
},
{
"t": 22,
"x": 677,
"y": 404
}
],
"birth": 0,
"death": 24,
"type": "light blue and green cardboard fruit snack box"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 798,
"y": 216
},
{
"t": 1,
"x": 791,
"y": 220
},
{
"t": 2,
"x": 787,
"y": 208
},
{
"t": 3,
"x": 779,
"y": 216
},
{
"t": 4,
"x": 775,
"y": 205
},
{
"t": 5,
"x": 771,
"y": 193
},
{
"t": 6,
"x": 763,
"y": 208
},
{
"t": 7,
"x": 759,
"y": 193
},
{
"t": 9,
"x": 751,
"y": 185
},
{
"t": 11,
"x": 744,
"y": 181
},
{
"t": 13,
"x": 732,
"y": 177
},
{
"t": 16,
"x": 716,
"y": 177
},
{
"t": 18,
"x": 708,
"y": 173
},
{
"t": 19,
"x": 705,
"y": 181
},
{
"t": 20,
"x": 697,
"y": 173
},
{
"t": 22,
"x": 689,
"y": 181
},
{
"t": 23,
"x": 681,
"y": 193
}
],
"birth": 0,
"death": 24,
"type": "silver leather boat shoe"
},
{
"id": 12,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 1,
"x": 1,
"y": 1
},
{
"t": 2,
"x": 72,
"y": 5
},
{
"t": 3,
"x": 138,
"y": 5
},
{
"t": 4,
"x": 205,
"y": 9
},
{
"t": 5,
"x": 263,
"y": 25
},
{
"t": 6,
"x": 314,
"y": 48
},
{
"t": 7,
"x": 361,
"y": 76
},
{
"t": 8,
"x": 404,
"y": 107
},
{
"t": 9,
"x": 435,
"y": 138
},
{
"t": 10,
"x": 470,
"y": 162
},
{
"t": 11,
"x": 501,
"y": 158
},
{
"t": 12,
"x": 498,
"y": 130
},
{
"t": 13,
"x": 529,
"y": 111
},
{
"t": 14,
"x": 603,
"y": 76
},
{
"t": 15,
"x": 626,
"y": 60
},
{
"t": 17,
"x": 666,
"y": 48
},
{
"t": 19,
"x": 685,
"y": 44
},
{
"t": 20,
"x": 708,
"y": 29
},
{
"t": 21,
"x": 720,
"y": 17
},
{
"t": 22,
"x": 728,
"y": 9
}
],
"birth": 1,
"death": 24,
"type": "wooden toy railroad crossing"
},
{
"id": 13,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 17,
"x": 912,
"y": 998
},
{
"t": 18,
"x": 888,
"y": 998
},
{
"t": 19,
"x": 908,
"y": 994
},
{
"t": 20,
"x": 923,
"y": 994
},
{
"t": 21,
"x": 970,
"y": 990
},
{
"t": 22,
"x": 978,
"y": 986
}
],
"birth": 17,
"death": 24,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 10,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 14,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 15,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 16,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 17,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 18,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 19,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 2,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 3,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 8,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 9,
"inputs": [
2,
3
],
"outputs": [
2,
3
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 26,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 23,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 27,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 24,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 25,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 11,
"ends_at": 23,
"type": "contact"
},
{
"id": 11,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 12,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 20,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 13,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 16,
"ends_at": 23,
"type": "contact"
},
{
"id": 21,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 22,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 18,
"ends_at": 23,
"type": "contact"
},
{
"id": 4,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 5,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "contact"
},
{
"id": 6,
"inputs": [
13,
17
],
"outputs": [
13,
17
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 7,
"inputs": [
13,
17
],
"outputs": [
13,
17
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 1.0,
"avg_image_position_segmentation_acc_small": 1.0,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 1.0,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": 1.0,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 1.0,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 1.0,
"num_matches": 14,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.6982142857142859,
"avg_interaction_input_object_jaccard": 0.6309523809523808,
"avg_interaction_output_object_jaccard": 0.6309523809523808,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 28,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 23,
"false_positives": 5,
"false_negatives": 0
},
"0.5": {
"true_positives": 22,
"false_positives": 6,
"false_negatives": 0
},
"0.75": {
"true_positives": 18,
"false_positives": 10,
"false_negatives": 0
},
"1.0": {
"true_positives": 17,
"false_positives": 11,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.8214285714285714,
"0.5": 0.7857142857142857,
"0.75": 0.6428571428571429,
"1.0": 0.6071428571428571
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.9019607843137255,
"0.5": 0.88,
"0.75": 0.782608695652174,
"1.0": 0.7555555555555554
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 21,
"false_positives": 7,
"false_negatives": 0
},
"0.5": {
"true_positives": 16,
"false_positives": 12,
"false_negatives": 0
},
"0.75": {
"true_positives": 16,
"false_positives": 12,
"false_negatives": 0
},
"1.0": {
"true_positives": 16,
"false_positives": 12,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.75,
"0.5": 0.5714285714285714,
"0.75": 0.5714285714285714,
"1.0": 0.5714285714285714
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.8571428571428571,
"0.5": 0.7272727272727273,
"0.75": 0.7272727272727273,
"1.0": 0.7272727272727273
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 21,
"false_positives": 7,
"false_negatives": 0
},
"0.5": {
"true_positives": 16,
"false_positives": 12,
"false_negatives": 0
},
"0.75": {
"true_positives": 16,
"false_positives": 12,
"false_negatives": 0
},
"1.0": {
"true_positives": 16,
"false_positives": 12,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.75,
"0.5": 0.5714285714285714,
"0.75": 0.5714285714285714,
"1.0": 0.5714285714285714
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.8571428571428571,
"0.5": 0.7272727272727273,
"0.75": 0.7272727272727273,
"1.0": 0.7272727272727273
}
}
}Prompt
user Analyze the provided video and return ONLY a valid sentinel sequence in this format: [SCENE-START] [OBJS-START] [OBJ] id "type" birth death [PX] t px py ... [OBJ] ... [OBJS-END] [INTERACTIONS-START] [INTERACT] id "type" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ... [INTERACT] ... [INTERACTIONS-END] [SCENE-END] Constraints: - Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose). - Keep tags exactly as written: `[SCENE-START] [OBJS-START] [OBJ] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]` - Use quoted strings for `type` (double quotes). - `PX` uses repeated groups of 3 values in order: `t px py`. - `t` is the timestamp (frame number). - `px` and `py` are the pixel coordinates of the object in that frame, normalized to [0,1] relative to the frame dimensions, scaled by 1000 and rounded to the nearest integer. For example, `px` of 0.1234 would be represented as 123. - When an object is occluded or not visible in a frame, `PX` may use `t null null`. - `IN` and `OUT` contain whitespace-separated integer ids. assistant