STRIVE · 08/28/2026
Prefill sample 1
One shared clip across Baselines 1, 2, 3, and E2E, including exactly what was injected.
Ground-truth Sentinel
[SCENE-START] [OBJS-START] [OBJ] 0 "navy blue, grey, and pink sneaker" 0 24 [PX] 0 279 537 11 291 537 17 337 533 23 279 537 [OBJ] 1 "dark blue fabric high-top sneaker" 0 24 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 15 431 431 [OBJ] 2 "caramel suede bootie" 0 24 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 14 533 318 15 541 310 19 544 326 22 537 330 [OBJ] 3 "dark brown snake print ballet flat" 0 24 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 18 505 455 [OBJ] 4 "orange and black work gloves" 0 24 [PX] 0 599 572 12 587 572 22 576 572 [OBJ] 5 "turquoise ceramic tray" 0 24 [PX] 0 615 458 6 null null [OBJ] 6 "white and tan plastic unicorn figurine" 0 24 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 14 681 458 15 646 474 17 681 451 18 638 478 19 681 462 20 634 486 21 677 486 22 646 498 23 630 494 [OBJ] 7 "green metallic lime squeezer" 0 24 [PX] 0 677 455 6 null null [OBJ] 8 "turquoise pot" 0 24 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 18 701 345 20 712 349 [OBJ] 9 "grey plastic Nintendo 64 game cartridge" 0 24 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 15 525 451 16 533 447 18 529 458 22 634 451 23 564 458 [OBJ] 10 "neon yellow leather ballet flat" 0 24 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 14 791 439 16 798 435 19 791 447 20 779 455 21 748 443 23 744 451 [OBJ] 11 "white plastic supplement bottle" 0 24 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 14 912 458 15 908 482 16 908 462 18 904 478 20 904 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 25 "contact" 0 7 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 0 "contact" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 5 "contact" 0 23 [IN] 1 3 [OUT] 1 3 [INTERACT] 6 "contact" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 19 "contact" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 22 "contact" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 23 "contact" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 28 "contact" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 35 "contact" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 12 "contact" 0 23 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 13 "collision" 1 2 [IN] 2 10 [OUT] 2 10 [INTERACT] 31 "collision" 4 4 [IN] 7 8 [OUT] 7 8 [INTERACT] 39 "collision" 4 5 [IN] 9 10 [OUT] 9 10 [INTERACT] 32 "contact" 5 13 [IN] 7 8 [OUT] 7 8 [INTERACT] 41 "collision" 6 6 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 24 "collision" 6 7 [IN] 6 10 [OUT] 6 10 [INTERACT] 11 "collision" 6 7 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 14 "collision" 7 7 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 21 "collision" 7 7 [IN] 3 9 [OUT] 3 9 [INTERACT] 42 "contact" 7 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 8 "collision" 8 8 [IN] 1 9 [OUT] 1 9 [INTERACT] 18 "collision" 8 8 [IN] 2 9 [OUT] 2 9 [INTERACT] 4 "collision" 9 9 [IN] 1 2 [OUT] 1 2 [INTERACT] 40 "collision" 9 9 [IN] 9 10 [OUT] 9 10 [INTERACT] 9 "collision" 10 10 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 20 "collision" 10 11 [IN] 3 9 [OUT] 3 9 [INTERACT] 7 "collision" 11 11 [IN] 1 9 [OUT] 1 9 [INTERACT] 15 "collision" 11 11 [IN] 2 9 [OUT] 2 9 [INTERACT] 33 "collision" 11 11 [IN] 7 9 [OUT] 7 9 [INTERACT] 36 "collision" 11 11 [IN] 8 9 [OUT] 8 9 [INTERACT] 37 "collision" 11 11 [IN] 9 10 [OUT] 9 10 [INTERACT] 10 "contact" 11 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 38 "contact" 12 13 [IN] 9 10 [OUT] 9 10 [INTERACT] 34 "contact" 12 19 [IN] 7 9 [OUT] 7 9 [INTERACT] 16 "collision" 13 13 [IN] 2 9 [OUT] 2 9 [INTERACT] 26 "collision" 13 13 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 17 "contact" 14 23 [IN] 2 9 [OUT] 2 9 [INTERACT] 27 "contact" 14 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 29 "collision" 15 15 [IN] 7 8 [OUT] 7 8 [INTERACT] 30 "contact" 16 18 [IN] 7 8 [OUT] 7 8 [INTERACT] 1 "collision" 18 18 [IN] 1 2 [OUT] 1 2 [INTERACT] 2 "collision" 20 20 [IN] 1 2 [OUT] 1 2 [INTERACT] 3 "contact" 21 23 [IN] 1 2 [OUT] 1 2 [INTERACTIONS-END] [SCENE-END]
Parsed ground truth
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 279,
"y": 537
},
{
"t": 11,
"x": 291,
"y": 537
},
{
"t": 17,
"x": 337,
"y": 533
},
{
"t": 23,
"x": 279,
"y": 537
}
],
"birth": 0,
"death": 24,
"type": "navy blue, grey, and pink sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 458,
"y": 423
},
{
"t": 2,
"x": 470,
"y": 419
},
{
"t": 5,
"x": 451,
"y": 427
},
{
"t": 6,
"x": 400,
"y": 435
},
{
"t": 7,
"x": 376,
"y": 443
},
{
"t": 9,
"x": 388,
"y": 439
},
{
"t": 10,
"x": 396,
"y": 435
},
{
"t": 12,
"x": 412,
"y": 435
},
{
"t": 15,
"x": 431,
"y": 431
}
],
"birth": 0,
"death": 24,
"type": "dark blue fabric high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 541,
"y": 138
},
{
"t": 1,
"x": 576,
"y": 162
},
{
"t": 2,
"x": 556,
"y": 189
},
{
"t": 3,
"x": 537,
"y": 220
},
{
"t": 4,
"x": 513,
"y": 228
},
{
"t": 5,
"x": 517,
"y": 236
},
{
"t": 6,
"x": 517,
"y": 318
},
{
"t": 7,
"x": 486,
"y": 392
},
{
"t": 8,
"x": 478,
"y": 380
},
{
"t": 9,
"x": 474,
"y": 369
},
{
"t": 10,
"x": 482,
"y": 373
},
{
"t": 11,
"x": 494,
"y": 333
},
{
"t": 12,
"x": 513,
"y": 333
},
{
"t": 13,
"x": 525,
"y": 322
},
{
"t": 14,
"x": 533,
"y": 318
},
{
"t": 15,
"x": 541,
"y": 310
},
{
"t": 19,
"x": 544,
"y": 326
},
{
"t": 22,
"x": 537,
"y": 330
}
],
"birth": 0,
"death": 24,
"type": "caramel suede bootie"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 572,
"y": 451
},
{
"t": 5,
"x": 525,
"y": 455
},
{
"t": 6,
"x": 490,
"y": 462
},
{
"t": 7,
"x": 525,
"y": 439
},
{
"t": 8,
"x": null,
"y": null
},
{
"t": 9,
"x": 501,
"y": 466
},
{
"t": 12,
"x": 498,
"y": 458
},
{
"t": 18,
"x": 505,
"y": 455
}
],
"birth": 0,
"death": 24,
"type": "dark brown snake print ballet flat"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 599,
"y": 572
},
{
"t": 12,
"x": 587,
"y": 572
},
{
"t": 22,
"x": 576,
"y": 572
}
],
"birth": 0,
"death": 24,
"type": "orange and black work gloves"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 615,
"y": 458
},
{
"t": 6,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "turquoise ceramic tray"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 505
},
{
"t": 6,
"x": 638,
"y": 486
},
{
"t": 7,
"x": 662,
"y": 451
},
{
"t": 8,
"x": 658,
"y": 419
},
{
"t": 9,
"x": 646,
"y": 396
},
{
"t": 11,
"x": 642,
"y": 408
},
{
"t": 12,
"x": 654,
"y": 439
},
{
"t": 13,
"x": 689,
"y": 470
},
{
"t": 14,
"x": 681,
"y": 458
},
{
"t": 15,
"x": 646,
"y": 474
},
{
"t": 17,
"x": 681,
"y": 451
},
{
"t": 18,
"x": 638,
"y": 478
},
{
"t": 19,
"x": 681,
"y": 462
},
{
"t": 20,
"x": 634,
"y": 486
},
{
"t": 21,
"x": 677,
"y": 486
},
{
"t": 22,
"x": 646,
"y": 498
},
{
"t": 23,
"x": 630,
"y": 494
}
],
"birth": 0,
"death": 24,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 677,
"y": 455
},
{
"t": 6,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "green metallic lime squeezer"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 689,
"y": 388
},
{
"t": 1,
"x": 705,
"y": 400
},
{
"t": 2,
"x": 736,
"y": 408
},
{
"t": 3,
"x": 732,
"y": 416
},
{
"t": 4,
"x": 705,
"y": 431
},
{
"t": 5,
"x": 806,
"y": 373
},
{
"t": 6,
"x": 685,
"y": 322
},
{
"t": 7,
"x": 689,
"y": 337
},
{
"t": 9,
"x": 697,
"y": 322
},
{
"t": 10,
"x": 748,
"y": 349
},
{
"t": 11,
"x": 705,
"y": 341
},
{
"t": 12,
"x": 712,
"y": 349
},
{
"t": 13,
"x": 689,
"y": 341
},
{
"t": 18,
"x": 701,
"y": 345
},
{
"t": 20,
"x": 712,
"y": 349
}
],
"birth": 0,
"death": 24,
"type": "turquoise pot"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 716,
"y": 283
},
{
"t": 1,
"x": 673,
"y": 298
},
{
"t": 2,
"x": 642,
"y": 314
},
{
"t": 3,
"x": 619,
"y": 337
},
{
"t": 4,
"x": 595,
"y": 369
},
{
"t": 5,
"x": 572,
"y": 408
},
{
"t": 6,
"x": 552,
"y": 443
},
{
"t": 7,
"x": 556,
"y": 455
},
{
"t": 11,
"x": 548,
"y": 458
},
{
"t": 13,
"x": 521,
"y": 458
},
{
"t": 15,
"x": 525,
"y": 451
},
{
"t": 16,
"x": 533,
"y": 447
},
{
"t": 18,
"x": 529,
"y": 458
},
{
"t": 22,
"x": 634,
"y": 451
},
{
"t": 23,
"x": 564,
"y": 458
}
],
"birth": 0,
"death": 24,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 755,
"y": 185
},
{
"t": 1,
"x": 736,
"y": 232
},
{
"t": 2,
"x": 716,
"y": 255
},
{
"t": 3,
"x": 689,
"y": 287
},
{
"t": 4,
"x": 685,
"y": 337
},
{
"t": 5,
"x": 673,
"y": 392
},
{
"t": 6,
"x": 783,
"y": 455
},
{
"t": 7,
"x": 802,
"y": 455
},
{
"t": 8,
"x": 802,
"y": 443
},
{
"t": 10,
"x": 791,
"y": 451
},
{
"t": 14,
"x": 791,
"y": 439
},
{
"t": 16,
"x": 798,
"y": 435
},
{
"t": 19,
"x": 791,
"y": 447
},
{
"t": 20,
"x": 779,
"y": 455
},
{
"t": 21,
"x": 748,
"y": 443
},
{
"t": 23,
"x": 744,
"y": 451
}
],
"birth": 0,
"death": 24,
"type": "neon yellow leather ballet flat"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 474
},
{
"t": 1,
"x": 919,
"y": 462
},
{
"t": 10,
"x": 919,
"y": 451
},
{
"t": 11,
"x": 916,
"y": 474
},
{
"t": 12,
"x": 916,
"y": 458
},
{
"t": 13,
"x": 912,
"y": 474
},
{
"t": 14,
"x": 912,
"y": 458
},
{
"t": 15,
"x": 908,
"y": 482
},
{
"t": 16,
"x": 908,
"y": 462
},
{
"t": 18,
"x": 904,
"y": 478
},
{
"t": 20,
"x": 904,
"y": 462
}
],
"birth": 0,
"death": 24,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 25,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 7,
"type": "contact"
},
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 5,
"inputs": [
1,
3
],
"outputs": [
1,
3
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 6,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 19,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 22,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 23,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 28,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 35,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 12,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 13,
"inputs": [
2,
10
],
"outputs": [
2,
10
],
"begins_at": 1,
"ends_at": 2,
"type": "collision"
},
{
"id": 31,
"inputs": [
7,
8
],
"outputs": [
7,
8
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 39,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 4,
"ends_at": 5,
"type": "collision"
},
{
"id": 32,
"inputs": [
7,
8
],
"outputs": [
7,
8
],
"begins_at": 5,
"ends_at": 13,
"type": "contact"
},
{
"id": 41,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 24,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 6,
"ends_at": 7,
"type": "collision"
},
{
"id": 11,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 6,
"ends_at": 7,
"type": "collision"
},
{
"id": 14,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 21,
"inputs": [
3,
9
],
"outputs": [
3,
9
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 42,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 7,
"ends_at": 23,
"type": "contact"
},
{
"id": 8,
"inputs": [
1,
9
],
"outputs": [
1,
9
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 18,
"inputs": [
2,
9
],
"outputs": [
2,
9
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 4,
"inputs": [
1,
2
],
"outputs": [
1,
2
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 40,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 9,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 20,
"inputs": [
3,
9
],
"outputs": [
3,
9
],
"begins_at": 10,
"ends_at": 11,
"type": "collision"
},
{
"id": 7,
"inputs": [
1,
9
],
"outputs": [
1,
9
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 15,
"inputs": [
2,
9
],
"outputs": [
2,
9
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 33,
"inputs": [
7,
9
],
"outputs": [
7,
9
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 36,
"inputs": [
8,
9
],
"outputs": [
8,
9
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 37,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 10,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 11,
"ends_at": 23,
"type": "contact"
},
{
"id": 38,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 12,
"ends_at": 13,
"type": "contact"
},
{
"id": 34,
"inputs": [
7,
9
],
"outputs": [
7,
9
],
"begins_at": 12,
"ends_at": 19,
"type": "contact"
},
{
"id": 16,
"inputs": [
2,
9
],
"outputs": [
2,
9
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 26,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 17,
"inputs": [
2,
9
],
"outputs": [
2,
9
],
"begins_at": 14,
"ends_at": 23,
"type": "contact"
},
{
"id": 27,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 14,
"ends_at": 23,
"type": "contact"
},
{
"id": 29,
"inputs": [
7,
8
],
"outputs": [
7,
8
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 30,
"inputs": [
7,
8
],
"outputs": [
7,
8
],
"begins_at": 16,
"ends_at": 18,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
2
],
"outputs": [
1,
2
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 2,
"inputs": [
1,
2
],
"outputs": [
1,
2
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 3,
"inputs": [
1,
2
],
"outputs": [
1,
2
],
"begins_at": 21,
"ends_at": 23,
"type": "contact"
}
]
}Per-frame GT object prefill
Each one-frame detector request was assistant-prefilled with the exact visible GT objects using canonical IDs. B1 generated only the interaction suffix; the saved frame outputs below are the exact persisted requests and generations.
Every persisted/reconstructed prefill step
[
{
"frame_index": 0,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 1 [PX] 0 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 458 423 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 541 138 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 572 451 [OBJ] 4 \"orange and black work gloves\" 0 1 [PX] 0 599 572 [OBJ] 5 \"turquoise ceramic tray\" 0 1 [PX] 0 615 458 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 646 505 [OBJ] 7 \"green metallic lime squeezer\" 0 1 [PX] 0 677 455 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 689 388 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 716 283 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 755 185 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 919 474 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 3 [OUT] 1 3 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 5 [OUT] 3 5 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 1 [PX] 0 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 458 423 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 541 138 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 572 451 [OBJ] 4 \"orange and black work gloves\" 0 1 [PX] 0 599 572 [OBJ] 5 \"turquoise ceramic tray\" 0 1 [PX] 0 615 458 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 646 505 [OBJ] 7 \"green metallic lime squeezer\" 0 1 [PX] 0 677 455 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 689 388 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 716 283 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 755 185 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 919 474 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 3 [OUT] 1 3 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 5 [OUT] 3 5 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"8": 8,
"9": 9,
"10": 10,
"11": 11
},
"parsed_object_count": 12,
"parsed_interaction_count": 12
},
{
"frame_index": 1,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 576 162 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 705 400 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 673 298 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 736 232 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 919 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 576 162 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 705 400 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 673 298 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 736 232 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 919 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"8": 8,
"9": 9,
"10": 10,
"11": 11
},
"parsed_object_count": 5,
"parsed_interaction_count": 8
},
{
"frame_index": 2,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 470 419 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 556 189 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 736 408 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 642 314 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 716 255 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 470 419 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 556 189 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 736 408 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 642 314 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 716 255 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"8": 8,
"9": 9,
"10": 10
},
"parsed_object_count": 5,
"parsed_interaction_count": 8
},
{
"frame_index": 3,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 537 220 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 732 416 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 619 337 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 689 287 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 8 10 [OUT] 8 10 [INTERACT] 1 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 537 220 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 732 416 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 619 337 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 689 287 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 8 10 [OUT] 8 10 [INTERACT] 1 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"8": 8,
"9": 9,
"10": 10
},
"parsed_object_count": 4,
"parsed_interaction_count": 4
},
{
"frame_index": 4,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 513 228 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 705 431 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 595 369 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 685 337 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 513 228 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 705 431 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 595 369 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 685 337 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"8": 8,
"9": 9,
"10": 10
},
"parsed_object_count": 4,
"parsed_interaction_count": 11
},
{
"frame_index": 5,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 451 427 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 517 236 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 525 455 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 806 373 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 572 408 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 673 392 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 3 [OUT] 1 3 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 451 427 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 517 236 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 525 455 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 806 373 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 572 408 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 673 392 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 3 [OUT] 1 3 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"8": 8,
"9": 9,
"10": 10
},
"parsed_object_count": 6,
"parsed_interaction_count": 5
},
{
"frame_index": 6,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 400 435 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 517 318 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 490 462 [OBJ] 5 \"turquoise ceramic tray\" 0 1 [PX] 0 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 638 486 [OBJ] 7 \"green metallic lime squeezer\" 0 1 [PX] 0 null null [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 685 322 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 552 443 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 783 455 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 400 435 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 517 318 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 490 462 [OBJ] 5 \"turquoise ceramic tray\" 0 1 [PX] 0 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 638 486 [OBJ] 7 \"green metallic lime squeezer\" 0 1 [PX] 0 null null [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 685 322 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 552 443 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 783 455 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"5": 5,
"6": 6,
"7": 7,
"8": 8,
"9": 9,
"10": 10
},
"parsed_object_count": 9,
"parsed_interaction_count": 7
},
{
"frame_index": 7,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 376 443 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 486 392 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 525 439 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 662 451 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 689 337 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 556 455 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 802 455 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 376 443 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 486 392 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 525 439 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 662 451 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 689 337 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 556 455 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 802 455 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"6": 6,
"8": 8,
"9": 9,
"10": 10
},
"parsed_object_count": 7,
"parsed_interaction_count": 6
},
{
"frame_index": 8,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 478 380 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 658 419 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 802 443 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 478 380 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 658 419 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 802 443 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"3": 3,
"6": 6,
"10": 10
},
"parsed_object_count": 4,
"parsed_interaction_count": 10
},
{
"frame_index": 9,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 388 439 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 474 369 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 501 466 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 646 396 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 697 322 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 3 [OUT] 2 3 [INTERACT] 4 \"contact\" 0 0 [IN] 2 6 [OUT] 2 6 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 388 439 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 474 369 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 501 466 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 646 396 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 697 322 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 3 [OUT] 2 3 [INTERACT] 4 \"contact\" 0 0 [IN] 2 6 [OUT] 2 6 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"6": 6,
"8": 8
},
"parsed_object_count": 5,
"parsed_interaction_count": 9
},
{
"frame_index": 10,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 396 435 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 482 373 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 748 349 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 791 451 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 919 451 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 396 435 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 482 373 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 748 349 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 791 451 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 919 451 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"8": 8,
"10": 10,
"11": 11
},
"parsed_object_count": 5,
"parsed_interaction_count": 10
},
{
"frame_index": 11,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 1 [PX] 0 291 537 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 494 333 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 642 408 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 705 341 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 548 458 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 916 474 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 1 [PX] 0 291 537 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 494 333 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 642 408 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 705 341 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 548 458 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 916 474 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"2": 2,
"6": 6,
"8": 8,
"9": 9,
"11": 11
},
"parsed_object_count": 6,
"parsed_interaction_count": 10
},
{
"frame_index": 12,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 412 435 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 513 333 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 498 458 [OBJ] 4 \"orange and black work gloves\" 0 1 [PX] 0 587 572 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 654 439 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 712 349 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 916 458 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 3 [OUT] 2 3 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 412 435 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 513 333 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 498 458 [OBJ] 4 \"orange and black work gloves\" 0 1 [PX] 0 587 572 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 654 439 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 712 349 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 916 458 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 3 [OUT] 2 3 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"6": 6,
"8": 8,
"11": 11
},
"parsed_object_count": 7,
"parsed_interaction_count": 10
},
{
"frame_index": 13,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 525 322 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 689 470 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 689 341 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 521 458 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 912 474 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 525 322 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 689 470 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 689 341 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 521 458 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 912 474 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"6": 6,
"8": 8,
"9": 9,
"11": 11
},
"parsed_object_count": 5,
"parsed_interaction_count": 7
},
{
"frame_index": 14,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 533 318 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 681 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 791 439 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 912 458 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 533 318 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 681 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 791 439 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 912 458 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"6": 6,
"10": 10,
"11": 11
},
"parsed_object_count": 4,
"parsed_interaction_count": 10
},
{
"frame_index": 15,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 431 431 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 541 310 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 646 474 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 525 451 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 908 482 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 431 431 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 541 310 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 646 474 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 525 451 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 908 482 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"6": 6,
"9": 9,
"11": 11
},
"parsed_object_count": 5,
"parsed_interaction_count": 10
},
{
"frame_index": 16,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 533 447 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 798 435 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 908 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 9 [OUT] 0 9 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 16 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 10 11 [OUT] 10 11 [INTERACT] 7 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 533 447 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 798 435 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 908 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 9 [OUT] 0 9 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 16 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 10 11 [OUT] 10 11 [INTERACT] 7 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"9": 9,
"10": 10,
"11": 11
},
"parsed_object_count": 3,
"parsed_interaction_count": 17
},
{
"frame_index": 17,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 1 [PX] 0 337 533 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 681 451 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 1 [PX] 0 337 533 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 681 451 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"6": 6
},
"parsed_object_count": 2,
"parsed_interaction_count": 9
},
{
"frame_index": 18,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 505 455 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 638 478 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 701 345 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 529 458 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 904 478 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 505 455 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 638 478 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 701 345 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 529 458 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 904 478 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"3": 3,
"6": 6,
"8": 8,
"9": 9,
"11": 11
},
"parsed_object_count": 5,
"parsed_interaction_count": 5
},
{
"frame_index": 19,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 544 326 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 681 462 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 791 447 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 544 326 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 681 462 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 791 447 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"6": 6,
"10": 10
},
"parsed_object_count": 3,
"parsed_interaction_count": 9
},
{
"frame_index": 20,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 634 486 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 712 349 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 779 455 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 904 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 634 486 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 712 349 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 779 455 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 904 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"6": 6,
"8": 8,
"10": 10,
"11": 11
},
"parsed_object_count": 4,
"parsed_interaction_count": 10
},
{
"frame_index": 21,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 677 486 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 748 443 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 677 486 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 748 443 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"6": 6,
"10": 10
},
"parsed_object_count": 2,
"parsed_interaction_count": 10
},
{
"frame_index": 22,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 537 330 [OBJ] 4 \"orange and black work gloves\" 0 1 [PX] 0 576 572 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 646 498 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 634 451 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 6 [OUT] 4 6 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 537 330 [OBJ] 4 \"orange and black work gloves\" 0 1 [PX] 0 576 572 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 646 498 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 634 451 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 6 [OUT] 4 6 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"4": 4,
"6": 6,
"9": 9
},
"parsed_object_count": 4,
"parsed_interaction_count": 9
},
{
"frame_index": 23,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 1 [PX] 0 279 537 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 630 494 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 564 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 744 451 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 1 [PX] 0 279 537 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 630 494 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 564 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 744 451 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"6": 6,
"9": 9,
"10": 10
},
"parsed_object_count": 4,
"parsed_interaction_count": 7
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "navy blue, grey, and pink sneaker" 0 24 [PX] 0 279 537 11 291 537 17 337 533 23 279 537 [OBJ] 1 "dark blue fabric high-top sneaker" 0 24 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 15 431 431 [OBJ] 2 "caramel suede bootie" 0 24 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 14 533 318 15 541 310 19 544 326 22 537 330 [OBJ] 3 "dark brown snake print ballet flat" 0 24 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 18 505 455 [OBJ] 4 "orange and black work gloves" 0 24 [PX] 0 599 572 12 587 572 22 576 572 [OBJ] 5 "turquoise ceramic tray" 0 24 [PX] 0 615 458 6 null null [OBJ] 6 "white and tan plastic unicorn figurine" 0 24 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 14 681 458 15 646 474 17 681 451 18 638 478 19 681 462 20 634 486 21 677 486 22 646 498 23 630 494 [OBJ] 7 "green metallic lime squeezer" 0 24 [PX] 0 677 455 6 null null [OBJ] 8 "turquoise pot" 0 24 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 18 701 345 20 712 349 [OBJ] 9 "grey plastic Nintendo 64 game cartridge" 0 24 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 15 525 451 16 533 447 18 529 458 22 634 451 23 564 458 [OBJ] 10 "neon yellow leather ballet flat" 0 24 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 14 791 439 16 798 435 19 791 447 20 779 455 21 748 443 23 744 451 [OBJ] 11 "white plastic supplement bottle" 0 24 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 14 912 458 15 908 482 16 908 462 18 904 478 20 904 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 "contact" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 "contact" 0 0 [IN] 1 3 [OUT] 1 3 [INTERACT] 2 "contact" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 "contact" 0 0 [IN] 3 5 [OUT] 3 5 [INTERACT] 4 "contact" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 "contact" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 "contact" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 "contact" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 "contact" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 "contact" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 10 "contact" 0 7 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 11 "contact" 0 7 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 12 "collision" 1 2 [IN] 65535 [OUT] 65535 [INTERACT] 13 "collision" 2 2 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 14 "collision" 3 3 [IN] 8 10 [OUT] 8 10 [INTERACT] 15 "collision" 3 3 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 16 "collision" 4 4 [IN] 2 [OUT] 2 [INTERACT] 17 "collision" 4 4 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 18 "collision" 4 4 [IN] 65535 [OUT] 65535 [INTERACT] 19 "collision" 5 5 [IN] 1 3 [OUT] 1 3 [INTERACT] 20 "collision" 5 5 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 21 "collision" 5 5 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 22 "collision" 6 6 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 23 "collision" 6 6 [IN] 6 10 [OUT] 6 10 [INTERACT] 24 "collision" 6 6 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 25 "contact" 6 7 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 26 "contact" 6 9 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 27 "collision" 7 7 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 28 "contact" 7 9 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 29 "collision" 8 8 [IN] 65535 [OUT] 65535 [INTERACT] 30 "contact" 8 15 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 31 "collision" 9 9 [IN] 2 3 [OUT] 2 3 [INTERACT] 32 "collision" 9 9 [IN] 2 6 [OUT] 2 6 [INTERACT] 33 "collision" 9 9 [IN] 3 [OUT] 3 [INTERACT] 34 "collision" 9 9 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 35 "collision" 9 10 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 36 "contact" 9 17 [IN] 65535 [OUT] 65535 [INTERACT] 37 "contact" 10 13 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 38 "collision" 11 11 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 39 "collision" 11 11 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 40 "collision" 11 11 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 41 "collision" 11 11 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 42 "collision" 12 12 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 43 "collision" 12 12 [IN] 2 3 [OUT] 2 3 [INTERACT] 44 "collision" 12 12 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 45 "collision" 12 12 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 46 "contact" 12 15 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 47 "collision" 13 13 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 48 "collision" 15 15 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 49 "collision" 15 16 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 50 "collision" 16 16 [IN] 9 [OUT] 9 [INTERACT] 51 "collision" 16 16 [IN] 10 11 [OUT] 10 11 [INTERACT] 52 "collision" 16 16 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 53 "collision" 16 16 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 54 "collision" 17 17 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 55 "collision" 17 17 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 56 "collision" 18 18 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 57 "collision" 18 18 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 58 "collision" 18 18 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 59 "collision" 18 18 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 60 "contact" 18 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 61 "collision" 19 19 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 62 "collision" 19 19 [IN] 65535 [OUT] 65535 [INTERACT] 63 "collision" 20 20 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 64 "contact" 20 23 [IN] 65535 [OUT] 65535 [INTERACT] 65 "collision" 22 22 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 66 "collision" 22 22 [IN] 4 6 [OUT] 4 6 [INTERACT] 67 "collision" 22 22 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 68 "collision" 22 22 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 69 "collision" 23 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 70 "contact" 23 23 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 279,
"y": 537
},
{
"t": 11,
"x": 291,
"y": 537
},
{
"t": 17,
"x": 337,
"y": 533
},
{
"t": 23,
"x": 279,
"y": 537
}
],
"birth": 0,
"death": 24,
"type": "navy blue, grey, and pink sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 458,
"y": 423
},
{
"t": 2,
"x": 470,
"y": 419
},
{
"t": 5,
"x": 451,
"y": 427
},
{
"t": 6,
"x": 400,
"y": 435
},
{
"t": 7,
"x": 376,
"y": 443
},
{
"t": 9,
"x": 388,
"y": 439
},
{
"t": 10,
"x": 396,
"y": 435
},
{
"t": 12,
"x": 412,
"y": 435
},
{
"t": 15,
"x": 431,
"y": 431
}
],
"birth": 0,
"death": 24,
"type": "dark blue fabric high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 541,
"y": 138
},
{
"t": 1,
"x": 576,
"y": 162
},
{
"t": 2,
"x": 556,
"y": 189
},
{
"t": 3,
"x": 537,
"y": 220
},
{
"t": 4,
"x": 513,
"y": 228
},
{
"t": 5,
"x": 517,
"y": 236
},
{
"t": 6,
"x": 517,
"y": 318
},
{
"t": 7,
"x": 486,
"y": 392
},
{
"t": 8,
"x": 478,
"y": 380
},
{
"t": 9,
"x": 474,
"y": 369
},
{
"t": 10,
"x": 482,
"y": 373
},
{
"t": 11,
"x": 494,
"y": 333
},
{
"t": 12,
"x": 513,
"y": 333
},
{
"t": 13,
"x": 525,
"y": 322
},
{
"t": 14,
"x": 533,
"y": 318
},
{
"t": 15,
"x": 541,
"y": 310
},
{
"t": 19,
"x": 544,
"y": 326
},
{
"t": 22,
"x": 537,
"y": 330
}
],
"birth": 0,
"death": 24,
"type": "caramel suede bootie"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 572,
"y": 451
},
{
"t": 5,
"x": 525,
"y": 455
},
{
"t": 6,
"x": 490,
"y": 462
},
{
"t": 7,
"x": 525,
"y": 439
},
{
"t": 8,
"x": null,
"y": null
},
{
"t": 9,
"x": 501,
"y": 466
},
{
"t": 12,
"x": 498,
"y": 458
},
{
"t": 18,
"x": 505,
"y": 455
}
],
"birth": 0,
"death": 24,
"type": "dark brown snake print ballet flat"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 599,
"y": 572
},
{
"t": 12,
"x": 587,
"y": 572
},
{
"t": 22,
"x": 576,
"y": 572
}
],
"birth": 0,
"death": 24,
"type": "orange and black work gloves"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 615,
"y": 458
},
{
"t": 6,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "turquoise ceramic tray"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 505
},
{
"t": 6,
"x": 638,
"y": 486
},
{
"t": 7,
"x": 662,
"y": 451
},
{
"t": 8,
"x": 658,
"y": 419
},
{
"t": 9,
"x": 646,
"y": 396
},
{
"t": 11,
"x": 642,
"y": 408
},
{
"t": 12,
"x": 654,
"y": 439
},
{
"t": 13,
"x": 689,
"y": 470
},
{
"t": 14,
"x": 681,
"y": 458
},
{
"t": 15,
"x": 646,
"y": 474
},
{
"t": 17,
"x": 681,
"y": 451
},
{
"t": 18,
"x": 638,
"y": 478
},
{
"t": 19,
"x": 681,
"y": 462
},
{
"t": 20,
"x": 634,
"y": 486
},
{
"t": 21,
"x": 677,
"y": 486
},
{
"t": 22,
"x": 646,
"y": 498
},
{
"t": 23,
"x": 630,
"y": 494
}
],
"birth": 0,
"death": 24,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 677,
"y": 455
},
{
"t": 6,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "green metallic lime squeezer"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 689,
"y": 388
},
{
"t": 1,
"x": 705,
"y": 400
},
{
"t": 2,
"x": 736,
"y": 408
},
{
"t": 3,
"x": 732,
"y": 416
},
{
"t": 4,
"x": 705,
"y": 431
},
{
"t": 5,
"x": 806,
"y": 373
},
{
"t": 6,
"x": 685,
"y": 322
},
{
"t": 7,
"x": 689,
"y": 337
},
{
"t": 9,
"x": 697,
"y": 322
},
{
"t": 10,
"x": 748,
"y": 349
},
{
"t": 11,
"x": 705,
"y": 341
},
{
"t": 12,
"x": 712,
"y": 349
},
{
"t": 13,
"x": 689,
"y": 341
},
{
"t": 18,
"x": 701,
"y": 345
},
{
"t": 20,
"x": 712,
"y": 349
}
],
"birth": 0,
"death": 24,
"type": "turquoise pot"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 716,
"y": 283
},
{
"t": 1,
"x": 673,
"y": 298
},
{
"t": 2,
"x": 642,
"y": 314
},
{
"t": 3,
"x": 619,
"y": 337
},
{
"t": 4,
"x": 595,
"y": 369
},
{
"t": 5,
"x": 572,
"y": 408
},
{
"t": 6,
"x": 552,
"y": 443
},
{
"t": 7,
"x": 556,
"y": 455
},
{
"t": 11,
"x": 548,
"y": 458
},
{
"t": 13,
"x": 521,
"y": 458
},
{
"t": 15,
"x": 525,
"y": 451
},
{
"t": 16,
"x": 533,
"y": 447
},
{
"t": 18,
"x": 529,
"y": 458
},
{
"t": 22,
"x": 634,
"y": 451
},
{
"t": 23,
"x": 564,
"y": 458
}
],
"birth": 0,
"death": 24,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 755,
"y": 185
},
{
"t": 1,
"x": 736,
"y": 232
},
{
"t": 2,
"x": 716,
"y": 255
},
{
"t": 3,
"x": 689,
"y": 287
},
{
"t": 4,
"x": 685,
"y": 337
},
{
"t": 5,
"x": 673,
"y": 392
},
{
"t": 6,
"x": 783,
"y": 455
},
{
"t": 7,
"x": 802,
"y": 455
},
{
"t": 8,
"x": 802,
"y": 443
},
{
"t": 10,
"x": 791,
"y": 451
},
{
"t": 14,
"x": 791,
"y": 439
},
{
"t": 16,
"x": 798,
"y": 435
},
{
"t": 19,
"x": 791,
"y": 447
},
{
"t": 20,
"x": 779,
"y": 455
},
{
"t": 21,
"x": 748,
"y": 443
},
{
"t": 23,
"x": 744,
"y": 451
}
],
"birth": 0,
"death": 24,
"type": "neon yellow leather ballet flat"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 474
},
{
"t": 1,
"x": 919,
"y": 462
},
{
"t": 10,
"x": 919,
"y": 451
},
{
"t": 11,
"x": 916,
"y": 474
},
{
"t": 12,
"x": 916,
"y": 458
},
{
"t": 13,
"x": 912,
"y": 474
},
{
"t": 14,
"x": 912,
"y": 458
},
{
"t": 15,
"x": 908,
"y": 482
},
{
"t": 16,
"x": 908,
"y": 462
},
{
"t": 18,
"x": 904,
"y": 478
},
{
"t": 20,
"x": 904,
"y": 462
}
],
"birth": 0,
"death": 24,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
3
],
"outputs": [
1,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
5
],
"outputs": [
3,
5
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 7,
"type": "contact"
},
{
"id": 11,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 7,
"type": "contact"
},
{
"id": 12,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 1,
"ends_at": 2,
"type": "collision"
},
{
"id": 13,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 14,
"inputs": [
8,
10
],
"outputs": [
8,
10
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 15,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 16,
"inputs": [
2
],
"outputs": [
2
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 17,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 18,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 19,
"inputs": [
1,
3
],
"outputs": [
1,
3
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 20,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 21,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 22,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 23,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 24,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 25,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 6,
"ends_at": 7,
"type": "contact"
},
{
"id": 26,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 6,
"ends_at": 9,
"type": "contact"
},
{
"id": 27,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 28,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 7,
"ends_at": 9,
"type": "contact"
},
{
"id": 29,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 30,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 8,
"ends_at": 15,
"type": "contact"
},
{
"id": 31,
"inputs": [
2,
3
],
"outputs": [
2,
3
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 32,
"inputs": [
2,
6
],
"outputs": [
2,
6
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 33,
"inputs": [
3
],
"outputs": [
3
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 34,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 35,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 9,
"ends_at": 10,
"type": "collision"
},
{
"id": 36,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 9,
"ends_at": 17,
"type": "contact"
},
{
"id": 37,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 10,
"ends_at": 13,
"type": "contact"
},
{
"id": 38,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 39,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 40,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 41,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 42,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 43,
"inputs": [
2,
3
],
"outputs": [
2,
3
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 44,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 45,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 46,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 12,
"ends_at": 15,
"type": "contact"
},
{
"id": 47,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 48,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 49,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 15,
"ends_at": 16,
"type": "collision"
},
{
"id": 50,
"inputs": [
9
],
"outputs": [
9
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 51,
"inputs": [
10,
11
],
"outputs": [
10,
11
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 52,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 53,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 54,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 55,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 56,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 57,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 58,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 59,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 60,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 18,
"ends_at": 23,
"type": "contact"
},
{
"id": 61,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 62,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 63,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 64,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 20,
"ends_at": 23,
"type": "contact"
},
{
"id": 65,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 66,
"inputs": [
4,
6
],
"outputs": [
4,
6
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 67,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 68,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 69,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
},
{
"id": 70,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "contact"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 1.0,
"avg_image_position_segmentation_acc_small": 1.0,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 1.0,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": 1.0,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 1.0,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 1.0,
"num_matches": 12,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.5106608147134822,
"avg_interaction_input_object_jaccard": 0.2131782945736434,
"avg_interaction_output_object_jaccard": 0.2131782945736434,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 43,
"num_unmatched_pred_interactions": 28,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 27,
"false_positives": 44,
"false_negatives": 0
},
"0.5": {
"true_positives": 24,
"false_positives": 47,
"false_negatives": 0
},
"0.75": {
"true_positives": 17,
"false_positives": 54,
"false_negatives": 0
},
"1.0": {
"true_positives": 16,
"false_positives": 55,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.38028169014084506,
"0.5": 0.3380281690140845,
"0.75": 0.23943661971830985,
"1.0": 0.22535211267605634
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.5510204081632654,
"0.5": 0.5052631578947369,
"0.75": 0.38636363636363635,
"1.0": 0.36781609195402304
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 23,
"false_positives": 48,
"false_negatives": 0
},
"0.5": {
"true_positives": 3,
"false_positives": 68,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 69,
"false_negatives": 0
},
"1.0": {
"true_positives": 2,
"false_positives": 69,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.323943661971831,
"0.5": 0.04225352112676056,
"0.75": 0.028169014084507043,
"1.0": 0.028169014084507043
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.4893617021276596,
"0.5": 0.08108108108108109,
"0.75": 0.05479452054794521,
"1.0": 0.05479452054794521
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 23,
"false_positives": 48,
"false_negatives": 0
},
"0.5": {
"true_positives": 3,
"false_positives": 68,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 69,
"false_negatives": 0
},
"1.0": {
"true_positives": 2,
"false_positives": 69,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.323943661971831,
"0.5": 0.04225352112676056,
"0.75": 0.028169014084507043,
"1.0": 0.028169014084507043
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.4893617021276596,
"0.5": 0.08108108108108109,
"0.75": 0.05479452054794521,
"1.0": 0.05479452054794521
}
}
}Prompt
<video> Analyze the provided video and return ONLY a valid sentinel sequence in this format: [SCENE-START] [OBJS-START] [OBJ] id "type" birth death [PX] t px py ... [OBJ] ... [OBJS-END] [INTERACTIONS-START] [INTERACT] id "type" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ... [INTERACT] ... [INTERACTIONS-END] [SCENE-END] Constraints: - Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose). - Keep tags exactly as written: `[SCENE-START] [OBJS-START] [OBJ] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]` - Use quoted strings for `type` (double quotes). - `PX` uses repeated groups of 3 values in order: `t px py`. - `t` is the timestamp (frame number). - `px` and `py` are the pixel coordinates of the object in that frame, normalized to [0,1] relative to the frame dimensions, scaled by 1000 and rounded to the nearest integer. For example, `px` of 0.1234 would be represented as 123. - When an object is occluded or not visible in a frame, `PX` may use `t null null`. - `IN` and `OUT` contain whitespace-separated integer ids.
B1 cache + injected GT identity map
B2 consumed the persisted B1-oracle frame cache. Its learned mapper call was bypassed at every streaming step and replaced with the shown stable-ID → detector-ID identity map; the ordinary staged merger still produced the final interaction prediction.
Every persisted/reconstructed prefill step
[
{
"frame_index": 0,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 1 [PX] 0 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 458 423 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 541 138 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 572 451 [OBJ] 4 \"orange and black work gloves\" 0 1 [PX] 0 599 572 [OBJ] 5 \"turquoise ceramic tray\" 0 1 [PX] 0 615 458 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 646 505 [OBJ] 7 \"green metallic lime squeezer\" 0 1 [PX] 0 677 455 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 689 388 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 716 283 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 755 185 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 919 474 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 3 [OUT] 1 3 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 5 [OUT] 3 5 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 1 [PX] 0 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 458 423 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 541 138 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 572 451 [OBJ] 4 \"orange and black work gloves\" 0 1 [PX] 0 599 572 [OBJ] 5 \"turquoise ceramic tray\" 0 1 [PX] 0 615 458 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 646 505 [OBJ] 7 \"green metallic lime squeezer\" 0 1 [PX] 0 677 455 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 689 388 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 716 283 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 755 185 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 919 474 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 3 [OUT] 1 3 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 5 [OUT] 3 5 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 279,
"y": 537
}
],
"birth": 0,
"death": 1,
"type": "navy blue, grey, and pink sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 458,
"y": 423
}
],
"birth": 0,
"death": 1,
"type": "dark blue fabric high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 541,
"y": 138
}
],
"birth": 0,
"death": 1,
"type": "caramel suede bootie"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 572,
"y": 451
}
],
"birth": 0,
"death": 1,
"type": "dark brown snake print ballet flat"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 599,
"y": 572
}
],
"birth": 0,
"death": 1,
"type": "orange and black work gloves"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 615,
"y": 458
}
],
"birth": 0,
"death": 1,
"type": "turquoise ceramic tray"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 505
}
],
"birth": 0,
"death": 1,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 677,
"y": 455
}
],
"birth": 0,
"death": 1,
"type": "green metallic lime squeezer"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 689,
"y": 388
}
],
"birth": 0,
"death": 1,
"type": "turquoise pot"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 716,
"y": 283
}
],
"birth": 0,
"death": 1,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 755,
"y": 185
}
],
"birth": 0,
"death": 1,
"type": "neon yellow leather ballet flat"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 474
}
],
"birth": 0,
"death": 1,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
3
],
"outputs": [
1,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
5
],
"outputs": [
3,
5
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 11,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"8": 8,
"9": 9,
"10": 10,
"11": 11
},
"mapping_note": "identity_ids=True initialization; mapper not called",
"mapper_called": false
},
{
"frame_index": 1,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 576 162 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 705 400 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 673 298 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 736 232 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 919 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 576 162 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 705 400 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 673 298 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 736 232 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 919 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 576,
"y": 162
}
],
"birth": 0,
"death": 1,
"type": "caramel suede bootie"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 705,
"y": 400
}
],
"birth": 0,
"death": 1,
"type": "turquoise pot"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 673,
"y": 298
}
],
"birth": 0,
"death": 1,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 736,
"y": 232
}
],
"birth": 0,
"death": 1,
"type": "neon yellow leather ballet flat"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 462
}
],
"birth": 0,
"death": 1,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"8": 8,
"9": 9,
"10": 10,
"11": 11
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 2,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 470 419 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 556 189 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 736 408 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 642 314 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 716 255 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 470 419 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 556 189 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 736 408 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 642 314 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 716 255 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 470,
"y": 419
}
],
"birth": 0,
"death": 1,
"type": "dark blue fabric high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 556,
"y": 189
}
],
"birth": 0,
"death": 1,
"type": "caramel suede bootie"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 736,
"y": 408
}
],
"birth": 0,
"death": 1,
"type": "turquoise pot"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 642,
"y": 314
}
],
"birth": 0,
"death": 1,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 716,
"y": 255
}
],
"birth": 0,
"death": 1,
"type": "neon yellow leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"8": 8,
"9": 9,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 3,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 537 220 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 732 416 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 619 337 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 689 287 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 8 10 [OUT] 8 10 [INTERACT] 1 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 537 220 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 732 416 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 619 337 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 689 287 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 8 10 [OUT] 8 10 [INTERACT] 1 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 537,
"y": 220
}
],
"birth": 0,
"death": 1,
"type": "caramel suede bootie"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 732,
"y": 416
}
],
"birth": 0,
"death": 1,
"type": "turquoise pot"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 619,
"y": 337
}
],
"birth": 0,
"death": 1,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 689,
"y": 287
}
],
"birth": 0,
"death": 1,
"type": "neon yellow leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
8,
10
],
"outputs": [
8,
10
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"8": 8,
"9": 9,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 4,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 513 228 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 705 431 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 595 369 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 685 337 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 513 228 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 705 431 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 595 369 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 685 337 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 513,
"y": 228
}
],
"birth": 0,
"death": 1,
"type": "caramel suede bootie"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 705,
"y": 431
}
],
"birth": 0,
"death": 1,
"type": "turquoise pot"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 595,
"y": 369
}
],
"birth": 0,
"death": 1,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 685,
"y": 337
}
],
"birth": 0,
"death": 1,
"type": "neon yellow leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
2
],
"outputs": [
0,
2
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"8": 8,
"9": 9,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 5,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 451 427 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 517 236 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 525 455 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 806 373 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 572 408 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 673 392 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 3 [OUT] 1 3 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 451 427 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 517 236 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 525 455 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 806 373 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 572 408 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 673 392 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 3 [OUT] 1 3 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 451,
"y": 427
}
],
"birth": 0,
"death": 1,
"type": "dark blue fabric high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 517,
"y": 236
}
],
"birth": 0,
"death": 1,
"type": "caramel suede bootie"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 525,
"y": 455
}
],
"birth": 0,
"death": 1,
"type": "dark brown snake print ballet flat"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 806,
"y": 373
}
],
"birth": 0,
"death": 1,
"type": "turquoise pot"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 572,
"y": 408
}
],
"birth": 0,
"death": 1,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 673,
"y": 392
}
],
"birth": 0,
"death": 1,
"type": "neon yellow leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
3
],
"outputs": [
1,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"8": 8,
"9": 9,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 6,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 400 435 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 517 318 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 490 462 [OBJ] 5 \"turquoise ceramic tray\" 0 1 [PX] 0 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 638 486 [OBJ] 7 \"green metallic lime squeezer\" 0 1 [PX] 0 null null [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 685 322 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 552 443 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 783 455 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 400 435 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 517 318 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 490 462 [OBJ] 5 \"turquoise ceramic tray\" 0 1 [PX] 0 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 638 486 [OBJ] 7 \"green metallic lime squeezer\" 0 1 [PX] 0 null null [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 685 322 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 552 443 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 783 455 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 6 10 [OUT] 6 10 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 400,
"y": 435
}
],
"birth": 0,
"death": 1,
"type": "dark blue fabric high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 517,
"y": 318
}
],
"birth": 0,
"death": 1,
"type": "caramel suede bootie"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 490,
"y": 462
}
],
"birth": 0,
"death": 1,
"type": "dark brown snake print ballet flat"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
}
],
"birth": 0,
"death": 1,
"type": "turquoise ceramic tray"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 638,
"y": 486
}
],
"birth": 0,
"death": 1,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
}
],
"birth": 0,
"death": 1,
"type": "green metallic lime squeezer"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 685,
"y": 322
}
],
"birth": 0,
"death": 1,
"type": "turquoise pot"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 552,
"y": 443
}
],
"birth": 0,
"death": 1,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 783,
"y": 455
}
],
"birth": 0,
"death": 1,
"type": "neon yellow leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"5": 5,
"6": 6,
"7": 7,
"8": 8,
"9": 9,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 7,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 376 443 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 486 392 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 525 439 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 662 451 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 689 337 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 556 455 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 802 455 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 376 443 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 486 392 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 525 439 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 662 451 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 689 337 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 556 455 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 802 455 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 376,
"y": 443
}
],
"birth": 0,
"death": 1,
"type": "dark blue fabric high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 486,
"y": 392
}
],
"birth": 0,
"death": 1,
"type": "caramel suede bootie"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 525,
"y": 439
}
],
"birth": 0,
"death": 1,
"type": "dark brown snake print ballet flat"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 662,
"y": 451
}
],
"birth": 0,
"death": 1,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 689,
"y": 337
}
],
"birth": 0,
"death": 1,
"type": "turquoise pot"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 556,
"y": 455
}
],
"birth": 0,
"death": 1,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 802,
"y": 455
}
],
"birth": 0,
"death": 1,
"type": "neon yellow leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"6": 6,
"8": 8,
"9": 9,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 8,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 478 380 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 658 419 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 802 443 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 478 380 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 658 419 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 802 443 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 478,
"y": 380
}
],
"birth": 0,
"death": 1,
"type": "caramel suede bootie"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": null,
"y": null
}
],
"birth": 0,
"death": 1,
"type": "dark brown snake print ballet flat"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 658,
"y": 419
}
],
"birth": 0,
"death": 1,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 802,
"y": 443
}
],
"birth": 0,
"death": 1,
"type": "neon yellow leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"3": 3,
"6": 6,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 9,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 388 439 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 474 369 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 501 466 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 646 396 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 697 322 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 3 [OUT] 2 3 [INTERACT] 4 \"contact\" 0 0 [IN] 2 6 [OUT] 2 6 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 388 439 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 474 369 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 501 466 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 646 396 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 697 322 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 3 [OUT] 2 3 [INTERACT] 4 \"contact\" 0 0 [IN] 2 6 [OUT] 2 6 [INTERACT] 5 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 388,
"y": 439
}
],
"birth": 0,
"death": 1,
"type": "dark blue fabric high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 474,
"y": 369
}
],
"birth": 0,
"death": 1,
"type": "caramel suede bootie"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 501,
"y": 466
}
],
"birth": 0,
"death": 1,
"type": "dark brown snake print ballet flat"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 396
}
],
"birth": 0,
"death": 1,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 697,
"y": 322
}
],
"birth": 0,
"death": 1,
"type": "turquoise pot"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
3
],
"outputs": [
2,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
2,
6
],
"outputs": [
2,
6
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"6": 6,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 10,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 396 435 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 482 373 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 748 349 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 791 451 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 919 451 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 396 435 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 482 373 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 748 349 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 791 451 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 919 451 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 396,
"y": 435
}
],
"birth": 0,
"death": 1,
"type": "dark blue fabric high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 482,
"y": 373
}
],
"birth": 0,
"death": 1,
"type": "caramel suede bootie"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 748,
"y": 349
}
],
"birth": 0,
"death": 1,
"type": "turquoise pot"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 791,
"y": 451
}
],
"birth": 0,
"death": 1,
"type": "neon yellow leather ballet flat"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 451
}
],
"birth": 0,
"death": 1,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"8": 8,
"10": 10,
"11": 11
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 11,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 1 [PX] 0 291 537 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 494 333 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 642 408 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 705 341 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 548 458 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 916 474 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 1 [PX] 0 291 537 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 494 333 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 642 408 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 705 341 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 548 458 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 916 474 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 291,
"y": 537
}
],
"birth": 0,
"death": 1,
"type": "navy blue, grey, and pink sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 494,
"y": 333
}
],
"birth": 0,
"death": 1,
"type": "caramel suede bootie"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 642,
"y": 408
}
],
"birth": 0,
"death": 1,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 705,
"y": 341
}
],
"birth": 0,
"death": 1,
"type": "turquoise pot"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 548,
"y": 458
}
],
"birth": 0,
"death": 1,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 916,
"y": 474
}
],
"birth": 0,
"death": 1,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"2": 2,
"6": 6,
"8": 8,
"9": 9,
"11": 11
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 12,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 412 435 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 513 333 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 498 458 [OBJ] 4 \"orange and black work gloves\" 0 1 [PX] 0 587 572 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 654 439 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 712 349 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 916 458 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 3 [OUT] 2 3 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 412 435 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 513 333 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 498 458 [OBJ] 4 \"orange and black work gloves\" 0 1 [PX] 0 587 572 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 654 439 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 712 349 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 916 458 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 3 [OUT] 2 3 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 412,
"y": 435
}
],
"birth": 0,
"death": 1,
"type": "dark blue fabric high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 513,
"y": 333
}
],
"birth": 0,
"death": 1,
"type": "caramel suede bootie"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 498,
"y": 458
}
],
"birth": 0,
"death": 1,
"type": "dark brown snake print ballet flat"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 587,
"y": 572
}
],
"birth": 0,
"death": 1,
"type": "orange and black work gloves"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 654,
"y": 439
}
],
"birth": 0,
"death": 1,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 712,
"y": 349
}
],
"birth": 0,
"death": 1,
"type": "turquoise pot"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 916,
"y": 458
}
],
"birth": 0,
"death": 1,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
3
],
"outputs": [
2,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"6": 6,
"8": 8,
"11": 11
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 13,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 525 322 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 689 470 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 689 341 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 521 458 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 912 474 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 525 322 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 689 470 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 689 341 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 521 458 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 912 474 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 525,
"y": 322
}
],
"birth": 0,
"death": 1,
"type": "caramel suede bootie"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 689,
"y": 470
}
],
"birth": 0,
"death": 1,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 689,
"y": 341
}
],
"birth": 0,
"death": 1,
"type": "turquoise pot"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 521,
"y": 458
}
],
"birth": 0,
"death": 1,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 912,
"y": 474
}
],
"birth": 0,
"death": 1,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"6": 6,
"8": 8,
"9": 9,
"11": 11
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 14,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 533 318 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 681 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 791 439 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 912 458 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 533 318 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 681 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 791 439 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 912 458 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 533,
"y": 318
}
],
"birth": 0,
"death": 1,
"type": "caramel suede bootie"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 681,
"y": 458
}
],
"birth": 0,
"death": 1,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 791,
"y": 439
}
],
"birth": 0,
"death": 1,
"type": "neon yellow leather ballet flat"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 912,
"y": 458
}
],
"birth": 0,
"death": 1,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"6": 6,
"10": 10,
"11": 11
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 15,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 431 431 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 541 310 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 646 474 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 525 451 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 908 482 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 431 431 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 541 310 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 646 474 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 525 451 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 908 482 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 431,
"y": 431
}
],
"birth": 0,
"death": 1,
"type": "dark blue fabric high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 541,
"y": 310
}
],
"birth": 0,
"death": 1,
"type": "caramel suede bootie"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 474
}
],
"birth": 0,
"death": 1,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 525,
"y": 451
}
],
"birth": 0,
"death": 1,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 908,
"y": 482
}
],
"birth": 0,
"death": 1,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"6": 6,
"9": 9,
"11": 11
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 16,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 533 447 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 798 435 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 908 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 9 [OUT] 0 9 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 16 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 10 11 [OUT] 10 11 [INTERACT] 7 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 533 447 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 798 435 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 908 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 9 [OUT] 0 9 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 10 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 11 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 12 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 13 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 14 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 15 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 16 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 10 11 [OUT] 10 11 [INTERACT] 7 \"contact\" 0 0 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 533,
"y": 447
}
],
"birth": 0,
"death": 1,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 798,
"y": 435
}
],
"birth": 0,
"death": 1,
"type": "neon yellow leather ballet flat"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 908,
"y": 462
}
],
"birth": 0,
"death": 1,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
9
],
"outputs": [
0,
9
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 11,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 12,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 13,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 14,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 15,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 16,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
14,
65535
],
"outputs": [
14,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
10,
11
],
"outputs": [
10,
11
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"9": 9,
"10": 10,
"11": 11
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 17,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 1 [PX] 0 337 533 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 681 451 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 1 [PX] 0 337 533 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 681 451 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 337,
"y": 533
}
],
"birth": 0,
"death": 1,
"type": "navy blue, grey, and pink sneaker"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 681,
"y": 451
}
],
"birth": 0,
"death": 1,
"type": "white and tan plastic unicorn figurine"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"6": 6
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 18,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 505 455 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 638 478 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 701 345 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 529 458 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 904 478 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 505 455 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 638 478 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 701 345 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 529 458 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 904 478 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 505,
"y": 455
}
],
"birth": 0,
"death": 1,
"type": "dark brown snake print ballet flat"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 638,
"y": 478
}
],
"birth": 0,
"death": 1,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 701,
"y": 345
}
],
"birth": 0,
"death": 1,
"type": "turquoise pot"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 529,
"y": 458
}
],
"birth": 0,
"death": 1,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 904,
"y": 478
}
],
"birth": 0,
"death": 1,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"3": 3,
"6": 6,
"8": 8,
"9": 9,
"11": 11
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 19,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 544 326 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 681 462 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 791 447 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 544 326 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 681 462 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 791 447 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 544,
"y": 326
}
],
"birth": 0,
"death": 1,
"type": "caramel suede bootie"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 681,
"y": 462
}
],
"birth": 0,
"death": 1,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 791,
"y": 447
}
],
"birth": 0,
"death": 1,
"type": "neon yellow leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"6": 6,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 20,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 634 486 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 712 349 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 779 455 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 904 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 634 486 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 712 349 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 779 455 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 904 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 634,
"y": 486
}
],
"birth": 0,
"death": 1,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 712,
"y": 349
}
],
"birth": 0,
"death": 1,
"type": "turquoise pot"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 779,
"y": 455
}
],
"birth": 0,
"death": 1,
"type": "neon yellow leather ballet flat"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 904,
"y": 462
}
],
"birth": 0,
"death": 1,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"6": 6,
"8": 8,
"10": 10,
"11": 11
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 21,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 677 486 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 748 443 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 677 486 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 748 443 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 677,
"y": 486
}
],
"birth": 0,
"death": 1,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 748,
"y": 443
}
],
"birth": 0,
"death": 1,
"type": "neon yellow leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"6": 6,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 22,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 537 330 [OBJ] 4 \"orange and black work gloves\" 0 1 [PX] 0 576 572 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 646 498 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 634 451 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 6 [OUT] 4 6 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 537 330 [OBJ] 4 \"orange and black work gloves\" 0 1 [PX] 0 576 572 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 646 498 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 634 451 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 6 [OUT] 4 6 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 537,
"y": 330
}
],
"birth": 0,
"death": 1,
"type": "caramel suede bootie"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 576,
"y": 572
}
],
"birth": 0,
"death": 1,
"type": "orange and black work gloves"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 498
}
],
"birth": 0,
"death": 1,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 634,
"y": 451
}
],
"birth": 0,
"death": 1,
"type": "grey plastic Nintendo 64 game cartridge"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
6
],
"outputs": [
4,
6
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"4": 4,
"6": 6,
"9": 9
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 23,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 1 [PX] 0 279 537 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 630 494 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 564 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 744 451 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 1 [PX] 0 279 537 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 630 494 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 564 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 744 451 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 279,
"y": 537
}
],
"birth": 0,
"death": 1,
"type": "navy blue, grey, and pink sneaker"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 630,
"y": 494
}
],
"birth": 0,
"death": 1,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 564,
"y": 458
}
],
"birth": 0,
"death": 1,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 744,
"y": 451
}
],
"birth": 0,
"death": 1,
"type": "neon yellow leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"6": 6,
"9": 9,
"10": 10
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "navy blue, grey, and pink sneaker" 0 24 [PX] 0 279 537 11 291 537 17 337 533 23 279 537 [OBJ] 1 "dark blue fabric high-top sneaker" 0 24 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 15 431 431 [OBJ] 2 "caramel suede bootie" 0 24 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 14 533 318 15 541 310 19 544 326 22 537 330 [OBJ] 3 "dark brown snake print ballet flat" 0 24 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 18 505 455 [OBJ] 4 "orange and black work gloves" 0 24 [PX] 0 599 572 12 587 572 22 576 572 [OBJ] 5 "turquoise ceramic tray" 0 24 [PX] 0 615 458 6 null null [OBJ] 6 "white and tan plastic unicorn figurine" 0 24 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 14 681 458 15 646 474 17 681 451 18 638 478 19 681 462 20 634 486 21 677 486 22 646 498 23 630 494 [OBJ] 7 "green metallic lime squeezer" 0 24 [PX] 0 677 455 6 null null [OBJ] 8 "turquoise pot" 0 24 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 18 701 345 20 712 349 [OBJ] 9 "grey plastic Nintendo 64 game cartridge" 0 24 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 15 525 451 16 533 447 18 529 458 22 634 451 23 564 458 [OBJ] 10 "neon yellow leather ballet flat" 0 24 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 14 791 439 16 798 435 19 791 447 20 779 455 21 748 443 23 744 451 [OBJ] 11 "white plastic supplement bottle" 0 24 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 14 912 458 15 908 482 16 908 462 18 904 478 20 904 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 "contact" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 "contact" 0 0 [IN] 1 3 [OUT] 1 3 [INTERACT] 2 "contact" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 "contact" 0 0 [IN] 3 5 [OUT] 3 5 [INTERACT] 4 "contact" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 "contact" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 "contact" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 "contact" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 "contact" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 "contact" 0 0 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 10 "contact" 0 7 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 11 "contact" 0 7 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 12 "collision" 1 2 [IN] 65535 [OUT] 65535 [INTERACT] 13 "collision" 2 2 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 14 "collision" 3 3 [IN] 8 10 [OUT] 8 10 [INTERACT] 15 "collision" 3 3 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 16 "collision" 4 4 [IN] 2 [OUT] 2 [INTERACT] 17 "collision" 4 4 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 18 "collision" 4 4 [IN] 65535 [OUT] 65535 [INTERACT] 19 "collision" 5 5 [IN] 1 3 [OUT] 1 3 [INTERACT] 20 "collision" 5 5 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 21 "collision" 5 5 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 22 "collision" 6 6 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 23 "collision" 6 6 [IN] 6 10 [OUT] 6 10 [INTERACT] 24 "collision" 6 6 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 25 "contact" 6 7 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 26 "contact" 6 9 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 27 "collision" 7 7 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 28 "contact" 7 9 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 29 "collision" 8 8 [IN] 65535 [OUT] 65535 [INTERACT] 30 "contact" 8 15 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 31 "collision" 9 9 [IN] 2 3 [OUT] 2 3 [INTERACT] 32 "collision" 9 9 [IN] 2 6 [OUT] 2 6 [INTERACT] 33 "collision" 9 9 [IN] 3 [OUT] 3 [INTERACT] 34 "collision" 9 9 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 35 "collision" 9 10 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 36 "contact" 9 17 [IN] 65535 [OUT] 65535 [INTERACT] 37 "contact" 10 13 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 38 "collision" 11 11 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 39 "collision" 11 11 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 40 "collision" 11 11 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 41 "collision" 11 11 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 42 "collision" 12 12 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 43 "collision" 12 12 [IN] 2 3 [OUT] 2 3 [INTERACT] 44 "collision" 12 12 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 45 "collision" 12 12 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 46 "contact" 12 15 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 47 "collision" 13 13 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 48 "collision" 15 15 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 49 "collision" 15 16 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 50 "collision" 16 16 [IN] 9 [OUT] 9 [INTERACT] 51 "collision" 16 16 [IN] 10 11 [OUT] 10 11 [INTERACT] 52 "collision" 16 16 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 53 "collision" 16 16 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 54 "collision" 17 17 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 55 "collision" 17 17 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 56 "collision" 18 18 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 57 "collision" 18 18 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 58 "collision" 18 18 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 59 "collision" 18 18 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 60 "contact" 18 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 61 "collision" 19 19 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 62 "collision" 19 19 [IN] 65535 [OUT] 65535 [INTERACT] 63 "collision" 20 20 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 64 "contact" 20 23 [IN] 65535 [OUT] 65535 [INTERACT] 65 "collision" 22 22 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 66 "collision" 22 22 [IN] 4 6 [OUT] 4 6 [INTERACT] 67 "collision" 22 22 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 68 "collision" 22 22 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 69 "collision" 23 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 70 "contact" 23 23 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 279,
"y": 537
},
{
"t": 11,
"x": 291,
"y": 537
},
{
"t": 17,
"x": 337,
"y": 533
},
{
"t": 23,
"x": 279,
"y": 537
}
],
"birth": 0,
"death": 24,
"type": "navy blue, grey, and pink sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 458,
"y": 423
},
{
"t": 2,
"x": 470,
"y": 419
},
{
"t": 5,
"x": 451,
"y": 427
},
{
"t": 6,
"x": 400,
"y": 435
},
{
"t": 7,
"x": 376,
"y": 443
},
{
"t": 9,
"x": 388,
"y": 439
},
{
"t": 10,
"x": 396,
"y": 435
},
{
"t": 12,
"x": 412,
"y": 435
},
{
"t": 15,
"x": 431,
"y": 431
}
],
"birth": 0,
"death": 24,
"type": "dark blue fabric high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 541,
"y": 138
},
{
"t": 1,
"x": 576,
"y": 162
},
{
"t": 2,
"x": 556,
"y": 189
},
{
"t": 3,
"x": 537,
"y": 220
},
{
"t": 4,
"x": 513,
"y": 228
},
{
"t": 5,
"x": 517,
"y": 236
},
{
"t": 6,
"x": 517,
"y": 318
},
{
"t": 7,
"x": 486,
"y": 392
},
{
"t": 8,
"x": 478,
"y": 380
},
{
"t": 9,
"x": 474,
"y": 369
},
{
"t": 10,
"x": 482,
"y": 373
},
{
"t": 11,
"x": 494,
"y": 333
},
{
"t": 12,
"x": 513,
"y": 333
},
{
"t": 13,
"x": 525,
"y": 322
},
{
"t": 14,
"x": 533,
"y": 318
},
{
"t": 15,
"x": 541,
"y": 310
},
{
"t": 19,
"x": 544,
"y": 326
},
{
"t": 22,
"x": 537,
"y": 330
}
],
"birth": 0,
"death": 24,
"type": "caramel suede bootie"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 572,
"y": 451
},
{
"t": 5,
"x": 525,
"y": 455
},
{
"t": 6,
"x": 490,
"y": 462
},
{
"t": 7,
"x": 525,
"y": 439
},
{
"t": 8,
"x": null,
"y": null
},
{
"t": 9,
"x": 501,
"y": 466
},
{
"t": 12,
"x": 498,
"y": 458
},
{
"t": 18,
"x": 505,
"y": 455
}
],
"birth": 0,
"death": 24,
"type": "dark brown snake print ballet flat"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 599,
"y": 572
},
{
"t": 12,
"x": 587,
"y": 572
},
{
"t": 22,
"x": 576,
"y": 572
}
],
"birth": 0,
"death": 24,
"type": "orange and black work gloves"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 615,
"y": 458
},
{
"t": 6,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "turquoise ceramic tray"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 505
},
{
"t": 6,
"x": 638,
"y": 486
},
{
"t": 7,
"x": 662,
"y": 451
},
{
"t": 8,
"x": 658,
"y": 419
},
{
"t": 9,
"x": 646,
"y": 396
},
{
"t": 11,
"x": 642,
"y": 408
},
{
"t": 12,
"x": 654,
"y": 439
},
{
"t": 13,
"x": 689,
"y": 470
},
{
"t": 14,
"x": 681,
"y": 458
},
{
"t": 15,
"x": 646,
"y": 474
},
{
"t": 17,
"x": 681,
"y": 451
},
{
"t": 18,
"x": 638,
"y": 478
},
{
"t": 19,
"x": 681,
"y": 462
},
{
"t": 20,
"x": 634,
"y": 486
},
{
"t": 21,
"x": 677,
"y": 486
},
{
"t": 22,
"x": 646,
"y": 498
},
{
"t": 23,
"x": 630,
"y": 494
}
],
"birth": 0,
"death": 24,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 677,
"y": 455
},
{
"t": 6,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "green metallic lime squeezer"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 689,
"y": 388
},
{
"t": 1,
"x": 705,
"y": 400
},
{
"t": 2,
"x": 736,
"y": 408
},
{
"t": 3,
"x": 732,
"y": 416
},
{
"t": 4,
"x": 705,
"y": 431
},
{
"t": 5,
"x": 806,
"y": 373
},
{
"t": 6,
"x": 685,
"y": 322
},
{
"t": 7,
"x": 689,
"y": 337
},
{
"t": 9,
"x": 697,
"y": 322
},
{
"t": 10,
"x": 748,
"y": 349
},
{
"t": 11,
"x": 705,
"y": 341
},
{
"t": 12,
"x": 712,
"y": 349
},
{
"t": 13,
"x": 689,
"y": 341
},
{
"t": 18,
"x": 701,
"y": 345
},
{
"t": 20,
"x": 712,
"y": 349
}
],
"birth": 0,
"death": 24,
"type": "turquoise pot"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 716,
"y": 283
},
{
"t": 1,
"x": 673,
"y": 298
},
{
"t": 2,
"x": 642,
"y": 314
},
{
"t": 3,
"x": 619,
"y": 337
},
{
"t": 4,
"x": 595,
"y": 369
},
{
"t": 5,
"x": 572,
"y": 408
},
{
"t": 6,
"x": 552,
"y": 443
},
{
"t": 7,
"x": 556,
"y": 455
},
{
"t": 11,
"x": 548,
"y": 458
},
{
"t": 13,
"x": 521,
"y": 458
},
{
"t": 15,
"x": 525,
"y": 451
},
{
"t": 16,
"x": 533,
"y": 447
},
{
"t": 18,
"x": 529,
"y": 458
},
{
"t": 22,
"x": 634,
"y": 451
},
{
"t": 23,
"x": 564,
"y": 458
}
],
"birth": 0,
"death": 24,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 755,
"y": 185
},
{
"t": 1,
"x": 736,
"y": 232
},
{
"t": 2,
"x": 716,
"y": 255
},
{
"t": 3,
"x": 689,
"y": 287
},
{
"t": 4,
"x": 685,
"y": 337
},
{
"t": 5,
"x": 673,
"y": 392
},
{
"t": 6,
"x": 783,
"y": 455
},
{
"t": 7,
"x": 802,
"y": 455
},
{
"t": 8,
"x": 802,
"y": 443
},
{
"t": 10,
"x": 791,
"y": 451
},
{
"t": 14,
"x": 791,
"y": 439
},
{
"t": 16,
"x": 798,
"y": 435
},
{
"t": 19,
"x": 791,
"y": 447
},
{
"t": 20,
"x": 779,
"y": 455
},
{
"t": 21,
"x": 748,
"y": 443
},
{
"t": 23,
"x": 744,
"y": 451
}
],
"birth": 0,
"death": 24,
"type": "neon yellow leather ballet flat"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 474
},
{
"t": 1,
"x": 919,
"y": 462
},
{
"t": 10,
"x": 919,
"y": 451
},
{
"t": 11,
"x": 916,
"y": 474
},
{
"t": 12,
"x": 916,
"y": 458
},
{
"t": 13,
"x": 912,
"y": 474
},
{
"t": 14,
"x": 912,
"y": 458
},
{
"t": 15,
"x": 908,
"y": 482
},
{
"t": 16,
"x": 908,
"y": 462
},
{
"t": 18,
"x": 904,
"y": 478
},
{
"t": 20,
"x": 904,
"y": 462
}
],
"birth": 0,
"death": 24,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
3
],
"outputs": [
1,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
5
],
"outputs": [
3,
5
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 10,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 7,
"type": "contact"
},
{
"id": 11,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 7,
"type": "contact"
},
{
"id": 12,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 1,
"ends_at": 2,
"type": "collision"
},
{
"id": 13,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 14,
"inputs": [
8,
10
],
"outputs": [
8,
10
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 15,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 16,
"inputs": [
2
],
"outputs": [
2
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 17,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 18,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 19,
"inputs": [
1,
3
],
"outputs": [
1,
3
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 20,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 21,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 22,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 23,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 24,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 25,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 6,
"ends_at": 7,
"type": "contact"
},
{
"id": 26,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 6,
"ends_at": 9,
"type": "contact"
},
{
"id": 27,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 28,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 7,
"ends_at": 9,
"type": "contact"
},
{
"id": 29,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 30,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 8,
"ends_at": 15,
"type": "contact"
},
{
"id": 31,
"inputs": [
2,
3
],
"outputs": [
2,
3
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 32,
"inputs": [
2,
6
],
"outputs": [
2,
6
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 33,
"inputs": [
3
],
"outputs": [
3
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 34,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 35,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 9,
"ends_at": 10,
"type": "collision"
},
{
"id": 36,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 9,
"ends_at": 17,
"type": "contact"
},
{
"id": 37,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 10,
"ends_at": 13,
"type": "contact"
},
{
"id": 38,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 39,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 40,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 41,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 42,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 43,
"inputs": [
2,
3
],
"outputs": [
2,
3
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 44,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 45,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 46,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 12,
"ends_at": 15,
"type": "contact"
},
{
"id": 47,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 48,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 49,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 15,
"ends_at": 16,
"type": "collision"
},
{
"id": 50,
"inputs": [
9
],
"outputs": [
9
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 51,
"inputs": [
10,
11
],
"outputs": [
10,
11
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 52,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 53,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 54,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 55,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 56,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 57,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 58,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 59,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 60,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 18,
"ends_at": 23,
"type": "contact"
},
{
"id": 61,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 62,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 63,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 64,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 20,
"ends_at": 23,
"type": "contact"
},
{
"id": 65,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 66,
"inputs": [
4,
6
],
"outputs": [
4,
6
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 67,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 68,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 69,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
},
{
"id": 70,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "contact"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 1.0,
"avg_image_position_segmentation_acc_small": 1.0,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 1.0,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": 1.0,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 1.0,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 1.0,
"num_matches": 12,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.5106608147134822,
"avg_interaction_input_object_jaccard": 0.2131782945736434,
"avg_interaction_output_object_jaccard": 0.2131782945736434,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 43,
"num_unmatched_pred_interactions": 28,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 27,
"false_positives": 44,
"false_negatives": 0
},
"0.5": {
"true_positives": 24,
"false_positives": 47,
"false_negatives": 0
},
"0.75": {
"true_positives": 17,
"false_positives": 54,
"false_negatives": 0
},
"1.0": {
"true_positives": 16,
"false_positives": 55,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.38028169014084506,
"0.5": 0.3380281690140845,
"0.75": 0.23943661971830985,
"1.0": 0.22535211267605634
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.5510204081632654,
"0.5": 0.5052631578947369,
"0.75": 0.38636363636363635,
"1.0": 0.36781609195402304
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 23,
"false_positives": 48,
"false_negatives": 0
},
"0.5": {
"true_positives": 3,
"false_positives": 68,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 69,
"false_negatives": 0
},
"1.0": {
"true_positives": 2,
"false_positives": 69,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.323943661971831,
"0.5": 0.04225352112676056,
"0.75": 0.028169014084507043,
"1.0": 0.028169014084507043
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.4893617021276596,
"0.5": 0.08108108108108109,
"0.75": 0.05479452054794521,
"1.0": 0.05479452054794521
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 23,
"false_positives": 48,
"false_negatives": 0
},
"0.5": {
"true_positives": 3,
"false_positives": 68,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 69,
"false_negatives": 0
},
"1.0": {
"true_positives": 2,
"false_positives": 69,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.323943661971831,
"0.5": 0.04225352112676056,
"0.75": 0.028169014084507043,
"1.0": 0.028169014084507043
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.4893617021276596,
"0.5": 0.08108108108108109,
"0.75": 0.05479452054794521,
"1.0": 0.05479452054794521
}
}
}Prompt
Growing GT object-track prefill
At prefix step t, B3 saw frames 0..t and an assistant prefill containing GT object tracks only through t. The prefills are deterministically reconstructed with the exact oracle helper; only the final full-clip generation was persisted by inference.
Every persisted/reconstructed prefill step
[
{
"frame_index": 0,
"frames_visible": "0..0",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 1 [PX] 0 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 1 [PX] 0 458 423 [OBJ] 2 \"caramel suede bootie\" 0 1 [PX] 0 541 138 [OBJ] 3 \"dark brown snake print ballet flat\" 0 1 [PX] 0 572 451 [OBJ] 4 \"orange and black work gloves\" 0 1 [PX] 0 599 572 [OBJ] 5 \"turquoise ceramic tray\" 0 1 [PX] 0 615 458 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 1 [PX] 0 646 505 [OBJ] 7 \"green metallic lime squeezer\" 0 1 [PX] 0 677 455 [OBJ] 8 \"turquoise pot\" 0 1 [PX] 0 689 388 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 1 [PX] 0 716 283 [OBJ] 10 \"neon yellow leather ballet flat\" 0 1 [PX] 0 755 185 [OBJ] 11 \"white plastic supplement bottle\" 0 1 [PX] 0 919 474 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 1,
"frames_visible": "0..1",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 2 [PX] 0 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 2 [PX] 0 458 423 [OBJ] 2 \"caramel suede bootie\" 0 2 [PX] 0 541 138 1 576 162 [OBJ] 3 \"dark brown snake print ballet flat\" 0 2 [PX] 0 572 451 [OBJ] 4 \"orange and black work gloves\" 0 2 [PX] 0 599 572 [OBJ] 5 \"turquoise ceramic tray\" 0 2 [PX] 0 615 458 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 2 [PX] 0 646 505 [OBJ] 7 \"green metallic lime squeezer\" 0 2 [PX] 0 677 455 [OBJ] 8 \"turquoise pot\" 0 2 [PX] 0 689 388 1 705 400 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 2 [PX] 0 716 283 1 673 298 [OBJ] 10 \"neon yellow leather ballet flat\" 0 2 [PX] 0 755 185 1 736 232 [OBJ] 11 \"white plastic supplement bottle\" 0 2 [PX] 0 919 474 1 919 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 2,
"frames_visible": "0..2",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 3 [PX] 0 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 3 [PX] 0 458 423 2 470 419 [OBJ] 2 \"caramel suede bootie\" 0 3 [PX] 0 541 138 1 576 162 2 556 189 [OBJ] 3 \"dark brown snake print ballet flat\" 0 3 [PX] 0 572 451 [OBJ] 4 \"orange and black work gloves\" 0 3 [PX] 0 599 572 [OBJ] 5 \"turquoise ceramic tray\" 0 3 [PX] 0 615 458 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 3 [PX] 0 646 505 [OBJ] 7 \"green metallic lime squeezer\" 0 3 [PX] 0 677 455 [OBJ] 8 \"turquoise pot\" 0 3 [PX] 0 689 388 1 705 400 2 736 408 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 3 [PX] 0 716 283 1 673 298 2 642 314 [OBJ] 10 \"neon yellow leather ballet flat\" 0 3 [PX] 0 755 185 1 736 232 2 716 255 [OBJ] 11 \"white plastic supplement bottle\" 0 3 [PX] 0 919 474 1 919 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 3,
"frames_visible": "0..3",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 4 [PX] 0 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 4 [PX] 0 458 423 2 470 419 [OBJ] 2 \"caramel suede bootie\" 0 4 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 [OBJ] 3 \"dark brown snake print ballet flat\" 0 4 [PX] 0 572 451 [OBJ] 4 \"orange and black work gloves\" 0 4 [PX] 0 599 572 [OBJ] 5 \"turquoise ceramic tray\" 0 4 [PX] 0 615 458 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 4 [PX] 0 646 505 [OBJ] 7 \"green metallic lime squeezer\" 0 4 [PX] 0 677 455 [OBJ] 8 \"turquoise pot\" 0 4 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 4 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 [OBJ] 10 \"neon yellow leather ballet flat\" 0 4 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 [OBJ] 11 \"white plastic supplement bottle\" 0 4 [PX] 0 919 474 1 919 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 4,
"frames_visible": "0..4",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 5 [PX] 0 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 5 [PX] 0 458 423 2 470 419 [OBJ] 2 \"caramel suede bootie\" 0 5 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 [OBJ] 3 \"dark brown snake print ballet flat\" 0 5 [PX] 0 572 451 [OBJ] 4 \"orange and black work gloves\" 0 5 [PX] 0 599 572 [OBJ] 5 \"turquoise ceramic tray\" 0 5 [PX] 0 615 458 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 5 [PX] 0 646 505 [OBJ] 7 \"green metallic lime squeezer\" 0 5 [PX] 0 677 455 [OBJ] 8 \"turquoise pot\" 0 5 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 5 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 [OBJ] 10 \"neon yellow leather ballet flat\" 0 5 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 [OBJ] 11 \"white plastic supplement bottle\" 0 5 [PX] 0 919 474 1 919 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 5,
"frames_visible": "0..5",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 6 [PX] 0 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 6 [PX] 0 458 423 2 470 419 5 451 427 [OBJ] 2 \"caramel suede bootie\" 0 6 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 [OBJ] 3 \"dark brown snake print ballet flat\" 0 6 [PX] 0 572 451 5 525 455 [OBJ] 4 \"orange and black work gloves\" 0 6 [PX] 0 599 572 [OBJ] 5 \"turquoise ceramic tray\" 0 6 [PX] 0 615 458 [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 6 [PX] 0 646 505 [OBJ] 7 \"green metallic lime squeezer\" 0 6 [PX] 0 677 455 [OBJ] 8 \"turquoise pot\" 0 6 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 6 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 [OBJ] 10 \"neon yellow leather ballet flat\" 0 6 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 [OBJ] 11 \"white plastic supplement bottle\" 0 6 [PX] 0 919 474 1 919 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 6,
"frames_visible": "0..6",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 7 [PX] 0 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 7 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 [OBJ] 2 \"caramel suede bootie\" 0 7 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 [OBJ] 3 \"dark brown snake print ballet flat\" 0 7 [PX] 0 572 451 5 525 455 6 490 462 [OBJ] 4 \"orange and black work gloves\" 0 7 [PX] 0 599 572 [OBJ] 5 \"turquoise ceramic tray\" 0 7 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 7 [PX] 0 646 505 6 638 486 [OBJ] 7 \"green metallic lime squeezer\" 0 7 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 7 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 7 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 [OBJ] 10 \"neon yellow leather ballet flat\" 0 7 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 [OBJ] 11 \"white plastic supplement bottle\" 0 7 [PX] 0 919 474 1 919 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 7,
"frames_visible": "0..7",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 8 [PX] 0 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 8 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 [OBJ] 2 \"caramel suede bootie\" 0 8 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 [OBJ] 3 \"dark brown snake print ballet flat\" 0 8 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 [OBJ] 4 \"orange and black work gloves\" 0 8 [PX] 0 599 572 [OBJ] 5 \"turquoise ceramic tray\" 0 8 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 8 [PX] 0 646 505 6 638 486 7 662 451 [OBJ] 7 \"green metallic lime squeezer\" 0 8 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 8 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 8 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 [OBJ] 10 \"neon yellow leather ballet flat\" 0 8 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 [OBJ] 11 \"white plastic supplement bottle\" 0 8 [PX] 0 919 474 1 919 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 8,
"frames_visible": "0..8",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 9 [PX] 0 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 9 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 [OBJ] 2 \"caramel suede bootie\" 0 9 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 [OBJ] 3 \"dark brown snake print ballet flat\" 0 9 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null [OBJ] 4 \"orange and black work gloves\" 0 9 [PX] 0 599 572 [OBJ] 5 \"turquoise ceramic tray\" 0 9 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 9 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 [OBJ] 7 \"green metallic lime squeezer\" 0 9 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 9 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 9 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 [OBJ] 10 \"neon yellow leather ballet flat\" 0 9 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 [OBJ] 11 \"white plastic supplement bottle\" 0 9 [PX] 0 919 474 1 919 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 9,
"frames_visible": "0..9",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 10 [PX] 0 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 10 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 [OBJ] 2 \"caramel suede bootie\" 0 10 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 [OBJ] 3 \"dark brown snake print ballet flat\" 0 10 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 [OBJ] 4 \"orange and black work gloves\" 0 10 [PX] 0 599 572 [OBJ] 5 \"turquoise ceramic tray\" 0 10 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 10 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 [OBJ] 7 \"green metallic lime squeezer\" 0 10 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 10 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 10 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 [OBJ] 10 \"neon yellow leather ballet flat\" 0 10 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 [OBJ] 11 \"white plastic supplement bottle\" 0 10 [PX] 0 919 474 1 919 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 10,
"frames_visible": "0..10",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 11 [PX] 0 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 11 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 [OBJ] 2 \"caramel suede bootie\" 0 11 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 [OBJ] 3 \"dark brown snake print ballet flat\" 0 11 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 [OBJ] 4 \"orange and black work gloves\" 0 11 [PX] 0 599 572 [OBJ] 5 \"turquoise ceramic tray\" 0 11 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 11 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 [OBJ] 7 \"green metallic lime squeezer\" 0 11 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 11 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 11 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 [OBJ] 10 \"neon yellow leather ballet flat\" 0 11 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 [OBJ] 11 \"white plastic supplement bottle\" 0 11 [PX] 0 919 474 1 919 462 10 919 451 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 11,
"frames_visible": "0..11",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 12 [PX] 0 279 537 11 291 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 12 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 [OBJ] 2 \"caramel suede bootie\" 0 12 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 [OBJ] 3 \"dark brown snake print ballet flat\" 0 12 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 [OBJ] 4 \"orange and black work gloves\" 0 12 [PX] 0 599 572 [OBJ] 5 \"turquoise ceramic tray\" 0 12 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 12 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 [OBJ] 7 \"green metallic lime squeezer\" 0 12 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 12 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 12 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 12 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 [OBJ] 11 \"white plastic supplement bottle\" 0 12 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 12,
"frames_visible": "0..12",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 13 [PX] 0 279 537 11 291 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 13 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 [OBJ] 2 \"caramel suede bootie\" 0 13 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 [OBJ] 3 \"dark brown snake print ballet flat\" 0 13 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 [OBJ] 4 \"orange and black work gloves\" 0 13 [PX] 0 599 572 12 587 572 [OBJ] 5 \"turquoise ceramic tray\" 0 13 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 13 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 [OBJ] 7 \"green metallic lime squeezer\" 0 13 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 13 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 13 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 13 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 [OBJ] 11 \"white plastic supplement bottle\" 0 13 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 13,
"frames_visible": "0..13",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 14 [PX] 0 279 537 11 291 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 14 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 [OBJ] 2 \"caramel suede bootie\" 0 14 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 [OBJ] 3 \"dark brown snake print ballet flat\" 0 14 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 [OBJ] 4 \"orange and black work gloves\" 0 14 [PX] 0 599 572 12 587 572 [OBJ] 5 \"turquoise ceramic tray\" 0 14 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 14 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 [OBJ] 7 \"green metallic lime squeezer\" 0 14 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 14 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 14 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 14 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 [OBJ] 11 \"white plastic supplement bottle\" 0 14 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 14,
"frames_visible": "0..14",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 15 [PX] 0 279 537 11 291 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 15 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 [OBJ] 2 \"caramel suede bootie\" 0 15 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 14 533 318 [OBJ] 3 \"dark brown snake print ballet flat\" 0 15 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 [OBJ] 4 \"orange and black work gloves\" 0 15 [PX] 0 599 572 12 587 572 [OBJ] 5 \"turquoise ceramic tray\" 0 15 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 15 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 14 681 458 [OBJ] 7 \"green metallic lime squeezer\" 0 15 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 15 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 15 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 15 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 14 791 439 [OBJ] 11 \"white plastic supplement bottle\" 0 15 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 14 912 458 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 15,
"frames_visible": "0..15",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 16 [PX] 0 279 537 11 291 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 16 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 15 431 431 [OBJ] 2 \"caramel suede bootie\" 0 16 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 14 533 318 15 541 310 [OBJ] 3 \"dark brown snake print ballet flat\" 0 16 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 [OBJ] 4 \"orange and black work gloves\" 0 16 [PX] 0 599 572 12 587 572 [OBJ] 5 \"turquoise ceramic tray\" 0 16 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 16 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 14 681 458 15 646 474 [OBJ] 7 \"green metallic lime squeezer\" 0 16 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 16 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 16 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 15 525 451 [OBJ] 10 \"neon yellow leather ballet flat\" 0 16 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 14 791 439 [OBJ] 11 \"white plastic supplement bottle\" 0 16 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 14 912 458 15 908 482 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 16,
"frames_visible": "0..16",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 17 [PX] 0 279 537 11 291 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 17 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 15 431 431 [OBJ] 2 \"caramel suede bootie\" 0 17 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 14 533 318 15 541 310 [OBJ] 3 \"dark brown snake print ballet flat\" 0 17 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 [OBJ] 4 \"orange and black work gloves\" 0 17 [PX] 0 599 572 12 587 572 [OBJ] 5 \"turquoise ceramic tray\" 0 17 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 17 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 14 681 458 15 646 474 [OBJ] 7 \"green metallic lime squeezer\" 0 17 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 17 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 17 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 15 525 451 16 533 447 [OBJ] 10 \"neon yellow leather ballet flat\" 0 17 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 14 791 439 16 798 435 [OBJ] 11 \"white plastic supplement bottle\" 0 17 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 14 912 458 15 908 482 16 908 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 17,
"frames_visible": "0..17",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 18 [PX] 0 279 537 11 291 537 17 337 533 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 18 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 15 431 431 [OBJ] 2 \"caramel suede bootie\" 0 18 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 14 533 318 15 541 310 [OBJ] 3 \"dark brown snake print ballet flat\" 0 18 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 [OBJ] 4 \"orange and black work gloves\" 0 18 [PX] 0 599 572 12 587 572 [OBJ] 5 \"turquoise ceramic tray\" 0 18 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 18 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 14 681 458 15 646 474 17 681 451 [OBJ] 7 \"green metallic lime squeezer\" 0 18 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 18 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 18 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 15 525 451 16 533 447 [OBJ] 10 \"neon yellow leather ballet flat\" 0 18 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 14 791 439 16 798 435 [OBJ] 11 \"white plastic supplement bottle\" 0 18 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 14 912 458 15 908 482 16 908 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 18,
"frames_visible": "0..18",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 19 [PX] 0 279 537 11 291 537 17 337 533 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 19 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 15 431 431 [OBJ] 2 \"caramel suede bootie\" 0 19 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 14 533 318 15 541 310 [OBJ] 3 \"dark brown snake print ballet flat\" 0 19 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 18 505 455 [OBJ] 4 \"orange and black work gloves\" 0 19 [PX] 0 599 572 12 587 572 [OBJ] 5 \"turquoise ceramic tray\" 0 19 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 19 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 14 681 458 15 646 474 17 681 451 18 638 478 [OBJ] 7 \"green metallic lime squeezer\" 0 19 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 19 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 18 701 345 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 19 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 15 525 451 16 533 447 18 529 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 19 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 14 791 439 16 798 435 [OBJ] 11 \"white plastic supplement bottle\" 0 19 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 14 912 458 15 908 482 16 908 462 18 904 478 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 19,
"frames_visible": "0..19",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 20 [PX] 0 279 537 11 291 537 17 337 533 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 20 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 15 431 431 [OBJ] 2 \"caramel suede bootie\" 0 20 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 14 533 318 15 541 310 19 544 326 [OBJ] 3 \"dark brown snake print ballet flat\" 0 20 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 18 505 455 [OBJ] 4 \"orange and black work gloves\" 0 20 [PX] 0 599 572 12 587 572 [OBJ] 5 \"turquoise ceramic tray\" 0 20 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 20 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 14 681 458 15 646 474 17 681 451 18 638 478 19 681 462 [OBJ] 7 \"green metallic lime squeezer\" 0 20 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 20 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 18 701 345 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 20 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 15 525 451 16 533 447 18 529 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 20 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 14 791 439 16 798 435 19 791 447 [OBJ] 11 \"white plastic supplement bottle\" 0 20 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 14 912 458 15 908 482 16 908 462 18 904 478 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 20,
"frames_visible": "0..20",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 21 [PX] 0 279 537 11 291 537 17 337 533 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 21 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 15 431 431 [OBJ] 2 \"caramel suede bootie\" 0 21 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 14 533 318 15 541 310 19 544 326 [OBJ] 3 \"dark brown snake print ballet flat\" 0 21 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 18 505 455 [OBJ] 4 \"orange and black work gloves\" 0 21 [PX] 0 599 572 12 587 572 [OBJ] 5 \"turquoise ceramic tray\" 0 21 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 21 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 14 681 458 15 646 474 17 681 451 18 638 478 19 681 462 20 634 486 [OBJ] 7 \"green metallic lime squeezer\" 0 21 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 21 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 18 701 345 20 712 349 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 21 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 15 525 451 16 533 447 18 529 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 21 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 14 791 439 16 798 435 19 791 447 20 779 455 [OBJ] 11 \"white plastic supplement bottle\" 0 21 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 14 912 458 15 908 482 16 908 462 18 904 478 20 904 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 21,
"frames_visible": "0..21",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 22 [PX] 0 279 537 11 291 537 17 337 533 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 22 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 15 431 431 [OBJ] 2 \"caramel suede bootie\" 0 22 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 14 533 318 15 541 310 19 544 326 [OBJ] 3 \"dark brown snake print ballet flat\" 0 22 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 18 505 455 [OBJ] 4 \"orange and black work gloves\" 0 22 [PX] 0 599 572 12 587 572 [OBJ] 5 \"turquoise ceramic tray\" 0 22 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 22 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 14 681 458 15 646 474 17 681 451 18 638 478 19 681 462 20 634 486 21 677 486 [OBJ] 7 \"green metallic lime squeezer\" 0 22 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 22 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 18 701 345 20 712 349 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 22 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 15 525 451 16 533 447 18 529 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 22 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 14 791 439 16 798 435 19 791 447 20 779 455 21 748 443 [OBJ] 11 \"white plastic supplement bottle\" 0 22 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 14 912 458 15 908 482 16 908 462 18 904 478 20 904 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 22,
"frames_visible": "0..22",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 23 [PX] 0 279 537 11 291 537 17 337 533 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 23 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 15 431 431 [OBJ] 2 \"caramel suede bootie\" 0 23 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 14 533 318 15 541 310 19 544 326 22 537 330 [OBJ] 3 \"dark brown snake print ballet flat\" 0 23 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 18 505 455 [OBJ] 4 \"orange and black work gloves\" 0 23 [PX] 0 599 572 12 587 572 22 576 572 [OBJ] 5 \"turquoise ceramic tray\" 0 23 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 23 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 14 681 458 15 646 474 17 681 451 18 638 478 19 681 462 20 634 486 21 677 486 22 646 498 [OBJ] 7 \"green metallic lime squeezer\" 0 23 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 23 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 18 701 345 20 712 349 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 23 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 15 525 451 16 533 447 18 529 458 22 634 451 [OBJ] 10 \"neon yellow leather ballet flat\" 0 23 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 14 791 439 16 798 435 19 791 447 20 779 455 21 748 443 [OBJ] 11 \"white plastic supplement bottle\" 0 23 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 14 912 458 15 908 482 16 908 462 18 904 478 20 904 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 23,
"frames_visible": "0..23",
"provenance": "exact persisted final-step prefill and generation",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 24 [PX] 0 279 537 11 291 537 17 337 533 23 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 24 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 15 431 431 [OBJ] 2 \"caramel suede bootie\" 0 24 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 14 533 318 15 541 310 19 544 326 22 537 330 [OBJ] 3 \"dark brown snake print ballet flat\" 0 24 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 18 505 455 [OBJ] 4 \"orange and black work gloves\" 0 24 [PX] 0 599 572 12 587 572 22 576 572 [OBJ] 5 \"turquoise ceramic tray\" 0 24 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 24 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 14 681 458 15 646 474 17 681 451 18 638 478 19 681 462 20 634 486 21 677 486 22 646 498 23 630 494 [OBJ] 7 \"green metallic lime squeezer\" 0 24 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 24 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 18 701 345 20 712 349 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 24 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 15 525 451 16 533 447 18 529 458 22 634 451 23 564 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 24 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 14 791 439 16 798 435 19 791 447 20 779 455 21 748 443 23 744 451 [OBJ] 11 \"white plastic supplement bottle\" 0 24 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 14 912 458 15 908 482 16 908 462 18 904 478 20 904 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 8 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 14 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 14 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 \"contact\" 0 19 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 19 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 19 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 19 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 19 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 19 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 2 \"collision\" 4 4 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 5 19 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 11 \"collision\" 11 11 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 12 \"collision\" 21 21 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 13 \"collision\" 23 23 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 24 [PX] 0 279 537 11 291 537 17 337 533 23 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 24 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 15 431 431 [OBJ] 2 \"caramel suede bootie\" 0 24 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 14 533 318 15 541 310 19 544 326 22 537 330 [OBJ] 3 \"dark brown snake print ballet flat\" 0 24 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 18 505 455 [OBJ] 4 \"orange and black work gloves\" 0 24 [PX] 0 599 572 12 587 572 22 576 572 [OBJ] 5 \"turquoise ceramic tray\" 0 24 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 24 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 14 681 458 15 646 474 17 681 451 18 638 478 19 681 462 20 634 486 21 677 486 22 646 498 23 630 494 [OBJ] 7 \"green metallic lime squeezer\" 0 24 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 24 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 18 701 345 20 712 349 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 24 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 15 525 451 16 533 447 18 529 458 22 634 451 23 564 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 24 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 14 791 439 16 798 435 19 791 447 20 779 455 21 748 443 23 744 451 [OBJ] 11 \"white plastic supplement bottle\" 0 24 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 14 912 458 15 908 482 16 908 462 18 904 478 20 904 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 8 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 14 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 14 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 \"contact\" 0 19 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 19 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 \"contact\" 0 19 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 \"contact\" 0 19 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"contact\" 0 19 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 \"contact\" 0 19 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 2 \"collision\" 4 4 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 5 19 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 11 \"collision\" 11 11 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 12 \"collision\" 21 21 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 13 \"collision\" 23 23 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"intermediate_prediction_persisted": true
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "navy blue, grey, and pink sneaker" 0 24 [PX] 0 279 537 11 291 537 17 337 533 23 279 537 [OBJ] 1 "dark blue fabric high-top sneaker" 0 24 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 15 431 431 [OBJ] 2 "caramel suede bootie" 0 24 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 14 533 318 15 541 310 19 544 326 22 537 330 [OBJ] 3 "dark brown snake print ballet flat" 0 24 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 18 505 455 [OBJ] 4 "orange and black work gloves" 0 24 [PX] 0 599 572 12 587 572 22 576 572 [OBJ] 5 "turquoise ceramic tray" 0 24 [PX] 0 615 458 6 null null [OBJ] 6 "white and tan plastic unicorn figurine" 0 24 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 14 681 458 15 646 474 17 681 451 18 638 478 19 681 462 20 634 486 21 677 486 22 646 498 23 630 494 [OBJ] 7 "green metallic lime squeezer" 0 24 [PX] 0 677 455 6 null null [OBJ] 8 "turquoise pot" 0 24 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 18 701 345 20 712 349 [OBJ] 9 "grey plastic Nintendo 64 game cartridge" 0 24 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 15 525 451 16 533 447 18 529 458 22 634 451 23 564 458 [OBJ] 10 "neon yellow leather ballet flat" 0 24 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 14 791 439 16 798 435 19 791 447 20 779 455 21 748 443 23 744 451 [OBJ] 11 "white plastic supplement bottle" 0 24 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 14 912 458 15 908 482 16 908 462 18 904 478 20 904 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 "contact" 0 8 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 "contact" 0 14 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 "contact" 0 14 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 5 "contact" 0 19 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 "contact" 0 19 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 7 "contact" 0 19 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 "contact" 0 19 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 "contact" 0 19 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 10 "contact" 0 19 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 2 "collision" 4 4 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 "contact" 5 19 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 11 "collision" 11 11 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 12 "collision" 21 21 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 13 "collision" 23 23 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 279,
"y": 537
},
{
"t": 11,
"x": 291,
"y": 537
},
{
"t": 17,
"x": 337,
"y": 533
},
{
"t": 23,
"x": 279,
"y": 537
}
],
"birth": 0,
"death": 24,
"type": "navy blue, grey, and pink sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 458,
"y": 423
},
{
"t": 2,
"x": 470,
"y": 419
},
{
"t": 5,
"x": 451,
"y": 427
},
{
"t": 6,
"x": 400,
"y": 435
},
{
"t": 7,
"x": 376,
"y": 443
},
{
"t": 9,
"x": 388,
"y": 439
},
{
"t": 10,
"x": 396,
"y": 435
},
{
"t": 12,
"x": 412,
"y": 435
},
{
"t": 15,
"x": 431,
"y": 431
}
],
"birth": 0,
"death": 24,
"type": "dark blue fabric high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 541,
"y": 138
},
{
"t": 1,
"x": 576,
"y": 162
},
{
"t": 2,
"x": 556,
"y": 189
},
{
"t": 3,
"x": 537,
"y": 220
},
{
"t": 4,
"x": 513,
"y": 228
},
{
"t": 5,
"x": 517,
"y": 236
},
{
"t": 6,
"x": 517,
"y": 318
},
{
"t": 7,
"x": 486,
"y": 392
},
{
"t": 8,
"x": 478,
"y": 380
},
{
"t": 9,
"x": 474,
"y": 369
},
{
"t": 10,
"x": 482,
"y": 373
},
{
"t": 11,
"x": 494,
"y": 333
},
{
"t": 12,
"x": 513,
"y": 333
},
{
"t": 13,
"x": 525,
"y": 322
},
{
"t": 14,
"x": 533,
"y": 318
},
{
"t": 15,
"x": 541,
"y": 310
},
{
"t": 19,
"x": 544,
"y": 326
},
{
"t": 22,
"x": 537,
"y": 330
}
],
"birth": 0,
"death": 24,
"type": "caramel suede bootie"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 572,
"y": 451
},
{
"t": 5,
"x": 525,
"y": 455
},
{
"t": 6,
"x": 490,
"y": 462
},
{
"t": 7,
"x": 525,
"y": 439
},
{
"t": 8,
"x": null,
"y": null
},
{
"t": 9,
"x": 501,
"y": 466
},
{
"t": 12,
"x": 498,
"y": 458
},
{
"t": 18,
"x": 505,
"y": 455
}
],
"birth": 0,
"death": 24,
"type": "dark brown snake print ballet flat"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 599,
"y": 572
},
{
"t": 12,
"x": 587,
"y": 572
},
{
"t": 22,
"x": 576,
"y": 572
}
],
"birth": 0,
"death": 24,
"type": "orange and black work gloves"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 615,
"y": 458
},
{
"t": 6,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "turquoise ceramic tray"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 505
},
{
"t": 6,
"x": 638,
"y": 486
},
{
"t": 7,
"x": 662,
"y": 451
},
{
"t": 8,
"x": 658,
"y": 419
},
{
"t": 9,
"x": 646,
"y": 396
},
{
"t": 11,
"x": 642,
"y": 408
},
{
"t": 12,
"x": 654,
"y": 439
},
{
"t": 13,
"x": 689,
"y": 470
},
{
"t": 14,
"x": 681,
"y": 458
},
{
"t": 15,
"x": 646,
"y": 474
},
{
"t": 17,
"x": 681,
"y": 451
},
{
"t": 18,
"x": 638,
"y": 478
},
{
"t": 19,
"x": 681,
"y": 462
},
{
"t": 20,
"x": 634,
"y": 486
},
{
"t": 21,
"x": 677,
"y": 486
},
{
"t": 22,
"x": 646,
"y": 498
},
{
"t": 23,
"x": 630,
"y": 494
}
],
"birth": 0,
"death": 24,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 677,
"y": 455
},
{
"t": 6,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "green metallic lime squeezer"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 689,
"y": 388
},
{
"t": 1,
"x": 705,
"y": 400
},
{
"t": 2,
"x": 736,
"y": 408
},
{
"t": 3,
"x": 732,
"y": 416
},
{
"t": 4,
"x": 705,
"y": 431
},
{
"t": 5,
"x": 806,
"y": 373
},
{
"t": 6,
"x": 685,
"y": 322
},
{
"t": 7,
"x": 689,
"y": 337
},
{
"t": 9,
"x": 697,
"y": 322
},
{
"t": 10,
"x": 748,
"y": 349
},
{
"t": 11,
"x": 705,
"y": 341
},
{
"t": 12,
"x": 712,
"y": 349
},
{
"t": 13,
"x": 689,
"y": 341
},
{
"t": 18,
"x": 701,
"y": 345
},
{
"t": 20,
"x": 712,
"y": 349
}
],
"birth": 0,
"death": 24,
"type": "turquoise pot"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 716,
"y": 283
},
{
"t": 1,
"x": 673,
"y": 298
},
{
"t": 2,
"x": 642,
"y": 314
},
{
"t": 3,
"x": 619,
"y": 337
},
{
"t": 4,
"x": 595,
"y": 369
},
{
"t": 5,
"x": 572,
"y": 408
},
{
"t": 6,
"x": 552,
"y": 443
},
{
"t": 7,
"x": 556,
"y": 455
},
{
"t": 11,
"x": 548,
"y": 458
},
{
"t": 13,
"x": 521,
"y": 458
},
{
"t": 15,
"x": 525,
"y": 451
},
{
"t": 16,
"x": 533,
"y": 447
},
{
"t": 18,
"x": 529,
"y": 458
},
{
"t": 22,
"x": 634,
"y": 451
},
{
"t": 23,
"x": 564,
"y": 458
}
],
"birth": 0,
"death": 24,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 755,
"y": 185
},
{
"t": 1,
"x": 736,
"y": 232
},
{
"t": 2,
"x": 716,
"y": 255
},
{
"t": 3,
"x": 689,
"y": 287
},
{
"t": 4,
"x": 685,
"y": 337
},
{
"t": 5,
"x": 673,
"y": 392
},
{
"t": 6,
"x": 783,
"y": 455
},
{
"t": 7,
"x": 802,
"y": 455
},
{
"t": 8,
"x": 802,
"y": 443
},
{
"t": 10,
"x": 791,
"y": 451
},
{
"t": 14,
"x": 791,
"y": 439
},
{
"t": 16,
"x": 798,
"y": 435
},
{
"t": 19,
"x": 791,
"y": 447
},
{
"t": 20,
"x": 779,
"y": 455
},
{
"t": 21,
"x": 748,
"y": 443
},
{
"t": 23,
"x": 744,
"y": 451
}
],
"birth": 0,
"death": 24,
"type": "neon yellow leather ballet flat"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 474
},
{
"t": 1,
"x": 919,
"y": 462
},
{
"t": 10,
"x": 919,
"y": 451
},
{
"t": 11,
"x": 916,
"y": 474
},
{
"t": 12,
"x": 916,
"y": 458
},
{
"t": 13,
"x": 912,
"y": 474
},
{
"t": 14,
"x": 912,
"y": 458
},
{
"t": 15,
"x": 908,
"y": 482
},
{
"t": 16,
"x": 908,
"y": 462
},
{
"t": 18,
"x": 904,
"y": 478
},
{
"t": 20,
"x": 904,
"y": 462
}
],
"birth": 0,
"death": 24,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 14,
"type": "contact"
},
{
"id": 4,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 14,
"type": "contact"
},
{
"id": 5,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 19,
"type": "contact"
},
{
"id": 6,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 19,
"type": "contact"
},
{
"id": 7,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 19,
"type": "contact"
},
{
"id": 8,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 19,
"type": "contact"
},
{
"id": 9,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 19,
"type": "contact"
},
{
"id": 10,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 19,
"type": "contact"
},
{
"id": 2,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 3,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 5,
"ends_at": 19,
"type": "contact"
},
{
"id": 11,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 12,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 13,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 1.0,
"avg_image_position_segmentation_acc_small": 1.0,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 1.0,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": 1.0,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 1.0,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 1.0,
"num_matches": 12,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.654030910609858,
"avg_interaction_input_object_jaccard": 0.2380952380952381,
"avg_interaction_output_object_jaccard": 0.2380952380952381,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 14,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 29,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 12,
"false_positives": 2,
"false_negatives": 29
},
"0.5": {
"true_positives": 12,
"false_positives": 2,
"false_negatives": 29
},
"0.75": {
"true_positives": 9,
"false_positives": 5,
"false_negatives": 29
},
"1.0": {
"true_positives": 2,
"false_positives": 12,
"false_negatives": 29
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.8571428571428571,
"0.5": 0.8571428571428571,
"0.75": 0.6428571428571429,
"1.0": 0.14285714285714285
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.2926829268292683,
"0.5": 0.2926829268292683,
"0.75": 0.23684210526315788,
"1.0": 0.06451612903225806
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.4363636363636364,
"0.5": 0.4363636363636364,
"0.75": 0.34615384615384615,
"1.0": 0.08888888888888889
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 10,
"false_positives": 4,
"false_negatives": 29
},
"0.5": {
"true_positives": 0,
"false_positives": 14,
"false_negatives": 29
},
"0.75": {
"true_positives": 0,
"false_positives": 14,
"false_negatives": 29
},
"1.0": {
"true_positives": 0,
"false_positives": 14,
"false_negatives": 29
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.7142857142857143,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.2564102564102564,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.3773584905660377,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 10,
"false_positives": 4,
"false_negatives": 29
},
"0.5": {
"true_positives": 0,
"false_positives": 14,
"false_negatives": 29
},
"0.75": {
"true_positives": 0,
"false_positives": 14,
"false_negatives": 29
},
"1.0": {
"true_positives": 0,
"false_positives": 14,
"false_negatives": 29
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.7142857142857143,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.2564102564102564,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.3773584905660377,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
}Prompt
<video> Analyze the provided video and return ONLY a valid sentinel sequence in this format: [SCENE-START] [OBJS-START] [OBJ] id "type" birth death [PX] t px py ... [OBJ] ... [OBJS-END] [INTERACTIONS-START] [INTERACT] id "type" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ... [INTERACT] ... [INTERACTIONS-END] [SCENE-END] Constraints: - Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose). - Keep tags exactly as written: `[SCENE-START] [OBJS-START] [OBJ] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]` - Use quoted strings for `type` (double quotes). - `PX` uses repeated groups of 3 values in order: `t px py`. - `t` is the timestamp (frame number). - `px` and `py` are the pixel coordinates of the object in that frame, normalized to [0,1] relative to the frame dimensions, scaled by 1000 and rounded to the nearest integer. For example, `px` of 0.1234 would be represented as 123. - When an object is occluded or not visible in a frame, `PX` may use `t null null`. - `IN` and `OUT` contain whitespace-separated integer ids.
One full-clip GT object prefill
The E2E model saw all 24 frames once. Its assistant text was the exact GT object section through [INTERACTIONS-START], and the model generated only the interaction suffix shown here.
Every persisted/reconstructed prefill step
[
{
"frame_index": 23,
"frames_visible": "0..23",
"provenance": "exact persisted full-clip prefill and generation",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 24 [PX] 0 279 537 11 291 537 17 337 533 23 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 24 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 15 431 431 [OBJ] 2 \"caramel suede bootie\" 0 24 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 14 533 318 15 541 310 19 544 326 22 537 330 [OBJ] 3 \"dark brown snake print ballet flat\" 0 24 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 18 505 455 [OBJ] 4 \"orange and black work gloves\" 0 24 [PX] 0 599 572 12 587 572 22 576 572 [OBJ] 5 \"turquoise ceramic tray\" 0 24 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 24 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 14 681 458 15 646 474 17 681 451 18 638 478 19 681 462 20 634 486 21 677 486 22 646 498 23 630 494 [OBJ] 7 \"green metallic lime squeezer\" 0 24 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 24 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 18 701 345 20 712 349 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 24 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 15 525 451 16 533 447 18 529 458 22 634 451 23 564 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 24 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 14 791 439 16 798 435 19 791 447 20 779 455 21 748 443 23 744 451 [OBJ] 11 \"white plastic supplement bottle\" 0 24 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 14 912 458 15 908 482 16 908 462 18 904 478 20 904 462 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 23 \"contact\" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 24 \"contact\" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 25 \"contact\" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 29 \"contact\" 0 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 30 \"contact\" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 31 \"contact\" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 2 \"contact\" 0 23 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 15 \"collision\" 2 2 [IN] 2 6 [OUT] 2 6 [INTERACT] 16 \"collision\" 4 4 [IN] 2 6 [OUT] 2 6 [INTERACT] 17 \"contact\" 5 7 [IN] 2 6 [OUT] 2 6 [INTERACT] 28 \"collision\" 6 6 [IN] 6 10 [OUT] 6 10 [INTERACT] 35 \"collision\" 6 6 [IN] 9 10 [OUT] 9 10 [INTERACT] 4 \"collision\" 6 6 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 32 \"collision\" 6 7 [IN] 8 9 [OUT] 8 9 [INTERACT] 36 \"contact\" 7 8 [IN] 9 10 [OUT] 9 10 [INTERACT] 3 \"collision\" 8 8 [IN] 10 11 [OUT] 10 11 [INTERACT] 5 \"collision\" 8 8 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 26 \"collision\" 10 10 [IN] 6 10 [OUT] 6 10 [INTERACT] 33 \"collision\" 10 10 [IN] 9 10 [OUT] 9 10 [INTERACT] 6 \"collision\" 10 10 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 27 \"contact\" 11 12 [IN] 6 10 [OUT] 6 10 [INTERACT] 34 \"contact\" 11 23 [IN] 9 10 [OUT] 9 10 [INTERACT] 7 \"contact\" 11 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 18 \"collision\" 13 13 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 19 \"collision\" 15 15 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 12 \"collision\" 16 16 [IN] 2 6 [OUT] 2 6 [INTERACT] 20 \"contact\" 16 17 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 8 \"collision\" 17 17 [IN] 10 11 [OUT] 10 11 [INTERACT] 13 \"collision\" 18 18 [IN] 2 6 [OUT] 2 6 [INTERACT] 9 \"contact\" 18 19 [IN] 10 11 [OUT] 10 11 [INTERACT] 14 \"contact\" 19 23 [IN] 2 6 [OUT] 2 6 [INTERACT] 21 \"collision\" 20 20 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 10 \"collision\" 21 21 [IN] 10 11 [OUT] 10 11 [INTERACT] 22 \"contact\" 21 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 11 \"contact\" 22 23 [IN] 10 11 [OUT] 10 11 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"navy blue, grey, and pink sneaker\" 0 24 [PX] 0 279 537 11 291 537 17 337 533 23 279 537 [OBJ] 1 \"dark blue fabric high-top sneaker\" 0 24 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 15 431 431 [OBJ] 2 \"caramel suede bootie\" 0 24 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 14 533 318 15 541 310 19 544 326 22 537 330 [OBJ] 3 \"dark brown snake print ballet flat\" 0 24 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 18 505 455 [OBJ] 4 \"orange and black work gloves\" 0 24 [PX] 0 599 572 12 587 572 22 576 572 [OBJ] 5 \"turquoise ceramic tray\" 0 24 [PX] 0 615 458 6 null null [OBJ] 6 \"white and tan plastic unicorn figurine\" 0 24 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 14 681 458 15 646 474 17 681 451 18 638 478 19 681 462 20 634 486 21 677 486 22 646 498 23 630 494 [OBJ] 7 \"green metallic lime squeezer\" 0 24 [PX] 0 677 455 6 null null [OBJ] 8 \"turquoise pot\" 0 24 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 18 701 345 20 712 349 [OBJ] 9 \"grey plastic Nintendo 64 game cartridge\" 0 24 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 15 525 451 16 533 447 18 529 458 22 634 451 23 564 458 [OBJ] 10 \"neon yellow leather ballet flat\" 0 24 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 14 791 439 16 798 435 19 791 447 20 779 455 21 748 443 23 744 451 [OBJ] 11 \"white plastic supplement bottle\" 0 24 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 14 912 458 15 908 482 16 908 462 18 904 478 20 904 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 23 \"contact\" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 24 \"contact\" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 25 \"contact\" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 29 \"contact\" 0 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 30 \"contact\" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 31 \"contact\" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 2 \"contact\" 0 23 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 15 \"collision\" 2 2 [IN] 2 6 [OUT] 2 6 [INTERACT] 16 \"collision\" 4 4 [IN] 2 6 [OUT] 2 6 [INTERACT] 17 \"contact\" 5 7 [IN] 2 6 [OUT] 2 6 [INTERACT] 28 \"collision\" 6 6 [IN] 6 10 [OUT] 6 10 [INTERACT] 35 \"collision\" 6 6 [IN] 9 10 [OUT] 9 10 [INTERACT] 4 \"collision\" 6 6 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 32 \"collision\" 6 7 [IN] 8 9 [OUT] 8 9 [INTERACT] 36 \"contact\" 7 8 [IN] 9 10 [OUT] 9 10 [INTERACT] 3 \"collision\" 8 8 [IN] 10 11 [OUT] 10 11 [INTERACT] 5 \"collision\" 8 8 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 26 \"collision\" 10 10 [IN] 6 10 [OUT] 6 10 [INTERACT] 33 \"collision\" 10 10 [IN] 9 10 [OUT] 9 10 [INTERACT] 6 \"collision\" 10 10 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 27 \"contact\" 11 12 [IN] 6 10 [OUT] 6 10 [INTERACT] 34 \"contact\" 11 23 [IN] 9 10 [OUT] 9 10 [INTERACT] 7 \"contact\" 11 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 18 \"collision\" 13 13 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 19 \"collision\" 15 15 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 12 \"collision\" 16 16 [IN] 2 6 [OUT] 2 6 [INTERACT] 20 \"contact\" 16 17 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 8 \"collision\" 17 17 [IN] 10 11 [OUT] 10 11 [INTERACT] 13 \"collision\" 18 18 [IN] 2 6 [OUT] 2 6 [INTERACT] 9 \"contact\" 18 19 [IN] 10 11 [OUT] 10 11 [INTERACT] 14 \"contact\" 19 23 [IN] 2 6 [OUT] 2 6 [INTERACT] 21 \"collision\" 20 20 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 10 \"collision\" 21 21 [IN] 10 11 [OUT] 10 11 [INTERACT] 22 \"contact\" 21 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 11 \"contact\" 22 23 [IN] 10 11 [OUT] 10 11 [INTERACTIONS-END] [SCENE-END]"
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "navy blue, grey, and pink sneaker" 0 24 [PX] 0 279 537 11 291 537 17 337 533 23 279 537 [OBJ] 1 "dark blue fabric high-top sneaker" 0 24 [PX] 0 458 423 2 470 419 5 451 427 6 400 435 7 376 443 9 388 439 10 396 435 12 412 435 15 431 431 [OBJ] 2 "caramel suede bootie" 0 24 [PX] 0 541 138 1 576 162 2 556 189 3 537 220 4 513 228 5 517 236 6 517 318 7 486 392 8 478 380 9 474 369 10 482 373 11 494 333 12 513 333 13 525 322 14 533 318 15 541 310 19 544 326 22 537 330 [OBJ] 3 "dark brown snake print ballet flat" 0 24 [PX] 0 572 451 5 525 455 6 490 462 7 525 439 8 null null 9 501 466 12 498 458 18 505 455 [OBJ] 4 "orange and black work gloves" 0 24 [PX] 0 599 572 12 587 572 22 576 572 [OBJ] 5 "turquoise ceramic tray" 0 24 [PX] 0 615 458 6 null null [OBJ] 6 "white and tan plastic unicorn figurine" 0 24 [PX] 0 646 505 6 638 486 7 662 451 8 658 419 9 646 396 11 642 408 12 654 439 13 689 470 14 681 458 15 646 474 17 681 451 18 638 478 19 681 462 20 634 486 21 677 486 22 646 498 23 630 494 [OBJ] 7 "green metallic lime squeezer" 0 24 [PX] 0 677 455 6 null null [OBJ] 8 "turquoise pot" 0 24 [PX] 0 689 388 1 705 400 2 736 408 3 732 416 4 705 431 5 806 373 6 685 322 7 689 337 9 697 322 10 748 349 11 705 341 12 712 349 13 689 341 18 701 345 20 712 349 [OBJ] 9 "grey plastic Nintendo 64 game cartridge" 0 24 [PX] 0 716 283 1 673 298 2 642 314 3 619 337 4 595 369 5 572 408 6 552 443 7 556 455 11 548 458 13 521 458 15 525 451 16 533 447 18 529 458 22 634 451 23 564 458 [OBJ] 10 "neon yellow leather ballet flat" 0 24 [PX] 0 755 185 1 736 232 2 716 255 3 689 287 4 685 337 5 673 392 6 783 455 7 802 455 8 802 443 10 791 451 14 791 439 16 798 435 19 791 447 20 779 455 21 748 443 23 744 451 [OBJ] 11 "white plastic supplement bottle" 0 24 [PX] 0 919 474 1 919 462 10 919 451 11 916 474 12 916 458 13 912 474 14 912 458 15 908 482 16 908 462 18 904 478 20 904 462 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 "contact" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 "contact" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 23 "contact" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 24 "contact" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 25 "contact" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 29 "contact" 0 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 30 "contact" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 31 "contact" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 2 "contact" 0 23 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 15 "collision" 2 2 [IN] 2 6 [OUT] 2 6 [INTERACT] 16 "collision" 4 4 [IN] 2 6 [OUT] 2 6 [INTERACT] 17 "contact" 5 7 [IN] 2 6 [OUT] 2 6 [INTERACT] 28 "collision" 6 6 [IN] 6 10 [OUT] 6 10 [INTERACT] 35 "collision" 6 6 [IN] 9 10 [OUT] 9 10 [INTERACT] 4 "collision" 6 6 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 32 "collision" 6 7 [IN] 8 9 [OUT] 8 9 [INTERACT] 36 "contact" 7 8 [IN] 9 10 [OUT] 9 10 [INTERACT] 3 "collision" 8 8 [IN] 10 11 [OUT] 10 11 [INTERACT] 5 "collision" 8 8 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 26 "collision" 10 10 [IN] 6 10 [OUT] 6 10 [INTERACT] 33 "collision" 10 10 [IN] 9 10 [OUT] 9 10 [INTERACT] 6 "collision" 10 10 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 27 "contact" 11 12 [IN] 6 10 [OUT] 6 10 [INTERACT] 34 "contact" 11 23 [IN] 9 10 [OUT] 9 10 [INTERACT] 7 "contact" 11 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 18 "collision" 13 13 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 19 "collision" 15 15 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 12 "collision" 16 16 [IN] 2 6 [OUT] 2 6 [INTERACT] 20 "contact" 16 17 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 8 "collision" 17 17 [IN] 10 11 [OUT] 10 11 [INTERACT] 13 "collision" 18 18 [IN] 2 6 [OUT] 2 6 [INTERACT] 9 "contact" 18 19 [IN] 10 11 [OUT] 10 11 [INTERACT] 14 "contact" 19 23 [IN] 2 6 [OUT] 2 6 [INTERACT] 21 "collision" 20 20 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 10 "collision" 21 21 [IN] 10 11 [OUT] 10 11 [INTERACT] 22 "contact" 21 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 11 "contact" 22 23 [IN] 10 11 [OUT] 10 11 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 279,
"y": 537
},
{
"t": 11,
"x": 291,
"y": 537
},
{
"t": 17,
"x": 337,
"y": 533
},
{
"t": 23,
"x": 279,
"y": 537
}
],
"birth": 0,
"death": 24,
"type": "navy blue, grey, and pink sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 458,
"y": 423
},
{
"t": 2,
"x": 470,
"y": 419
},
{
"t": 5,
"x": 451,
"y": 427
},
{
"t": 6,
"x": 400,
"y": 435
},
{
"t": 7,
"x": 376,
"y": 443
},
{
"t": 9,
"x": 388,
"y": 439
},
{
"t": 10,
"x": 396,
"y": 435
},
{
"t": 12,
"x": 412,
"y": 435
},
{
"t": 15,
"x": 431,
"y": 431
}
],
"birth": 0,
"death": 24,
"type": "dark blue fabric high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 541,
"y": 138
},
{
"t": 1,
"x": 576,
"y": 162
},
{
"t": 2,
"x": 556,
"y": 189
},
{
"t": 3,
"x": 537,
"y": 220
},
{
"t": 4,
"x": 513,
"y": 228
},
{
"t": 5,
"x": 517,
"y": 236
},
{
"t": 6,
"x": 517,
"y": 318
},
{
"t": 7,
"x": 486,
"y": 392
},
{
"t": 8,
"x": 478,
"y": 380
},
{
"t": 9,
"x": 474,
"y": 369
},
{
"t": 10,
"x": 482,
"y": 373
},
{
"t": 11,
"x": 494,
"y": 333
},
{
"t": 12,
"x": 513,
"y": 333
},
{
"t": 13,
"x": 525,
"y": 322
},
{
"t": 14,
"x": 533,
"y": 318
},
{
"t": 15,
"x": 541,
"y": 310
},
{
"t": 19,
"x": 544,
"y": 326
},
{
"t": 22,
"x": 537,
"y": 330
}
],
"birth": 0,
"death": 24,
"type": "caramel suede bootie"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 572,
"y": 451
},
{
"t": 5,
"x": 525,
"y": 455
},
{
"t": 6,
"x": 490,
"y": 462
},
{
"t": 7,
"x": 525,
"y": 439
},
{
"t": 8,
"x": null,
"y": null
},
{
"t": 9,
"x": 501,
"y": 466
},
{
"t": 12,
"x": 498,
"y": 458
},
{
"t": 18,
"x": 505,
"y": 455
}
],
"birth": 0,
"death": 24,
"type": "dark brown snake print ballet flat"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 599,
"y": 572
},
{
"t": 12,
"x": 587,
"y": 572
},
{
"t": 22,
"x": 576,
"y": 572
}
],
"birth": 0,
"death": 24,
"type": "orange and black work gloves"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 615,
"y": 458
},
{
"t": 6,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "turquoise ceramic tray"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 646,
"y": 505
},
{
"t": 6,
"x": 638,
"y": 486
},
{
"t": 7,
"x": 662,
"y": 451
},
{
"t": 8,
"x": 658,
"y": 419
},
{
"t": 9,
"x": 646,
"y": 396
},
{
"t": 11,
"x": 642,
"y": 408
},
{
"t": 12,
"x": 654,
"y": 439
},
{
"t": 13,
"x": 689,
"y": 470
},
{
"t": 14,
"x": 681,
"y": 458
},
{
"t": 15,
"x": 646,
"y": 474
},
{
"t": 17,
"x": 681,
"y": 451
},
{
"t": 18,
"x": 638,
"y": 478
},
{
"t": 19,
"x": 681,
"y": 462
},
{
"t": 20,
"x": 634,
"y": 486
},
{
"t": 21,
"x": 677,
"y": 486
},
{
"t": 22,
"x": 646,
"y": 498
},
{
"t": 23,
"x": 630,
"y": 494
}
],
"birth": 0,
"death": 24,
"type": "white and tan plastic unicorn figurine"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 677,
"y": 455
},
{
"t": 6,
"x": null,
"y": null
}
],
"birth": 0,
"death": 24,
"type": "green metallic lime squeezer"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 689,
"y": 388
},
{
"t": 1,
"x": 705,
"y": 400
},
{
"t": 2,
"x": 736,
"y": 408
},
{
"t": 3,
"x": 732,
"y": 416
},
{
"t": 4,
"x": 705,
"y": 431
},
{
"t": 5,
"x": 806,
"y": 373
},
{
"t": 6,
"x": 685,
"y": 322
},
{
"t": 7,
"x": 689,
"y": 337
},
{
"t": 9,
"x": 697,
"y": 322
},
{
"t": 10,
"x": 748,
"y": 349
},
{
"t": 11,
"x": 705,
"y": 341
},
{
"t": 12,
"x": 712,
"y": 349
},
{
"t": 13,
"x": 689,
"y": 341
},
{
"t": 18,
"x": 701,
"y": 345
},
{
"t": 20,
"x": 712,
"y": 349
}
],
"birth": 0,
"death": 24,
"type": "turquoise pot"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 716,
"y": 283
},
{
"t": 1,
"x": 673,
"y": 298
},
{
"t": 2,
"x": 642,
"y": 314
},
{
"t": 3,
"x": 619,
"y": 337
},
{
"t": 4,
"x": 595,
"y": 369
},
{
"t": 5,
"x": 572,
"y": 408
},
{
"t": 6,
"x": 552,
"y": 443
},
{
"t": 7,
"x": 556,
"y": 455
},
{
"t": 11,
"x": 548,
"y": 458
},
{
"t": 13,
"x": 521,
"y": 458
},
{
"t": 15,
"x": 525,
"y": 451
},
{
"t": 16,
"x": 533,
"y": 447
},
{
"t": 18,
"x": 529,
"y": 458
},
{
"t": 22,
"x": 634,
"y": 451
},
{
"t": 23,
"x": 564,
"y": 458
}
],
"birth": 0,
"death": 24,
"type": "grey plastic Nintendo 64 game cartridge"
},
{
"id": 10,
"image_positions": [
{
"t": 0,
"x": 755,
"y": 185
},
{
"t": 1,
"x": 736,
"y": 232
},
{
"t": 2,
"x": 716,
"y": 255
},
{
"t": 3,
"x": 689,
"y": 287
},
{
"t": 4,
"x": 685,
"y": 337
},
{
"t": 5,
"x": 673,
"y": 392
},
{
"t": 6,
"x": 783,
"y": 455
},
{
"t": 7,
"x": 802,
"y": 455
},
{
"t": 8,
"x": 802,
"y": 443
},
{
"t": 10,
"x": 791,
"y": 451
},
{
"t": 14,
"x": 791,
"y": 439
},
{
"t": 16,
"x": 798,
"y": 435
},
{
"t": 19,
"x": 791,
"y": 447
},
{
"t": 20,
"x": 779,
"y": 455
},
{
"t": 21,
"x": 748,
"y": 443
},
{
"t": 23,
"x": 744,
"y": 451
}
],
"birth": 0,
"death": 24,
"type": "neon yellow leather ballet flat"
},
{
"id": 11,
"image_positions": [
{
"t": 0,
"x": 919,
"y": 474
},
{
"t": 1,
"x": 919,
"y": 462
},
{
"t": 10,
"x": 919,
"y": 451
},
{
"t": 11,
"x": 916,
"y": 474
},
{
"t": 12,
"x": 916,
"y": 458
},
{
"t": 13,
"x": 912,
"y": 474
},
{
"t": 14,
"x": 912,
"y": 458
},
{
"t": 15,
"x": 908,
"y": 482
},
{
"t": 16,
"x": 908,
"y": 462
},
{
"t": 18,
"x": 904,
"y": 478
},
{
"t": 20,
"x": 904,
"y": 462
}
],
"birth": 0,
"death": 24,
"type": "white plastic supplement bottle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 23,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 24,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 25,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 29,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 30,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 31,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 2,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 15,
"inputs": [
2,
6
],
"outputs": [
2,
6
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 16,
"inputs": [
2,
6
],
"outputs": [
2,
6
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 17,
"inputs": [
2,
6
],
"outputs": [
2,
6
],
"begins_at": 5,
"ends_at": 7,
"type": "contact"
},
{
"id": 28,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 35,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 4,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 32,
"inputs": [
8,
9
],
"outputs": [
8,
9
],
"begins_at": 6,
"ends_at": 7,
"type": "collision"
},
{
"id": 36,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 7,
"ends_at": 8,
"type": "contact"
},
{
"id": 3,
"inputs": [
10,
11
],
"outputs": [
10,
11
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 5,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 26,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 33,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 6,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 27,
"inputs": [
6,
10
],
"outputs": [
6,
10
],
"begins_at": 11,
"ends_at": 12,
"type": "contact"
},
{
"id": 34,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 11,
"ends_at": 23,
"type": "contact"
},
{
"id": 7,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 11,
"ends_at": 23,
"type": "contact"
},
{
"id": 18,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 19,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 12,
"inputs": [
2,
6
],
"outputs": [
2,
6
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 20,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 16,
"ends_at": 17,
"type": "contact"
},
{
"id": 8,
"inputs": [
10,
11
],
"outputs": [
10,
11
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 13,
"inputs": [
2,
6
],
"outputs": [
2,
6
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 9,
"inputs": [
10,
11
],
"outputs": [
10,
11
],
"begins_at": 18,
"ends_at": 19,
"type": "contact"
},
{
"id": 14,
"inputs": [
2,
6
],
"outputs": [
2,
6
],
"begins_at": 19,
"ends_at": 23,
"type": "contact"
},
{
"id": 21,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 10,
"inputs": [
10,
11
],
"outputs": [
10,
11
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 22,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 21,
"ends_at": 23,
"type": "contact"
},
{
"id": 11,
"inputs": [
10,
11
],
"outputs": [
10,
11
],
"begins_at": 22,
"ends_at": 23,
"type": "contact"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 1.0,
"avg_image_position_segmentation_acc_small": 1.0,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 1.0,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": 1.0,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 1.0,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 1.0,
"num_matches": 12,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.6426881235704764,
"avg_interaction_input_object_jaccard": 0.3153153153153153,
"avg_interaction_output_object_jaccard": 0.3153153153153153,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 37,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 6,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 30,
"false_positives": 7,
"false_negatives": 6
},
"0.5": {
"true_positives": 27,
"false_positives": 10,
"false_negatives": 6
},
"0.75": {
"true_positives": 22,
"false_positives": 15,
"false_negatives": 6
},
"1.0": {
"true_positives": 21,
"false_positives": 16,
"false_negatives": 6
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.8108108108108109,
"0.5": 0.7297297297297297,
"0.75": 0.5945945945945946,
"1.0": 0.5675675675675675
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.8333333333333334,
"0.5": 0.8181818181818182,
"0.75": 0.7857142857142857,
"1.0": 0.7777777777777778
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.8219178082191781,
"0.5": 0.7714285714285715,
"0.75": 0.676923076923077,
"1.0": 0.65625
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 23,
"false_positives": 14,
"false_negatives": 6
},
"0.5": {
"true_positives": 6,
"false_positives": 31,
"false_negatives": 6
},
"0.75": {
"true_positives": 6,
"false_positives": 31,
"false_negatives": 6
},
"1.0": {
"true_positives": 6,
"false_positives": 31,
"false_negatives": 6
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.6216216216216216,
"0.5": 0.16216216216216217,
"0.75": 0.16216216216216217,
"1.0": 0.16216216216216217
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.7931034482758621,
"0.5": 0.5,
"0.75": 0.5,
"1.0": 0.5
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.696969696969697,
"0.5": 0.2448979591836735,
"0.75": 0.2448979591836735,
"1.0": 0.2448979591836735
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 23,
"false_positives": 14,
"false_negatives": 6
},
"0.5": {
"true_positives": 6,
"false_positives": 31,
"false_negatives": 6
},
"0.75": {
"true_positives": 6,
"false_positives": 31,
"false_negatives": 6
},
"1.0": {
"true_positives": 6,
"false_positives": 31,
"false_negatives": 6
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.6216216216216216,
"0.5": 0.16216216216216217,
"0.75": 0.16216216216216217,
"1.0": 0.16216216216216217
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.7931034482758621,
"0.5": 0.5,
"0.75": 0.5,
"1.0": 0.5
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.696969696969697,
"0.5": 0.2448979591836735,
"0.75": 0.2448979591836735,
"1.0": 0.2448979591836735
}
}
}Prompt
user Analyze the provided video and return ONLY a valid sentinel sequence in this format: [SCENE-START] [OBJS-START] [OBJ] id "type" birth death [PX] t px py ... [OBJ] ... [OBJS-END] [INTERACTIONS-START] [INTERACT] id "type" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ... [INTERACT] ... [INTERACTIONS-END] [SCENE-END] Constraints: - Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose). - Keep tags exactly as written: `[SCENE-START] [OBJS-START] [OBJ] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]` - Use quoted strings for `type` (double quotes). - `PX` uses repeated groups of 3 values in order: `t px py`. - `t` is the timestamp (frame number). - `px` and `py` are the pixel coordinates of the object in that frame, normalized to [0,1] relative to the frame dimensions, scaled by 1000 and rounded to the nearest integer. For example, `px` of 0.1234 would be represented as 123. - When an object is occluded or not visible in a frame, `PX` may use `t null null`. - `IN` and `OUT` contain whitespace-separated integer ids. assistant