STRIVE · 08/28/2026
Prefill sample 10
One shared clip across Baselines 1, 2, 3, and E2E, including exactly what was injected.
Ground-truth Sentinel
[SCENE-START] [OBJS-START] [OBJ] 0 "black and grey high-top sneaker" 0 24 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 14 298 392 15 314 396 16 326 392 17 337 392 19 357 392 20 365 396 21 373 400 23 376 408 [OBJ] 1 "grey stuffed raccoon" 0 24 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 14 123 419 22 154 408 23 134 419 [OBJ] 2 "white plastic dietary supplement bottle" 0 24 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 15 396 337 17 263 330 19 275 337 21 294 337 22 291 345 [OBJ] 3 "dark grey metallic cake pan set" 0 24 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 14 251 498 15 103 505 16 193 541 17 189 556 18 173 572 19 240 568 20 216 591 21 224 587 22 220 595 23 193 607 [OBJ] 4 "plastic Nintendo 3DS game case" 0 24 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 14 513 353 15 478 341 16 490 341 17 482 337 19 513 337 20 505 333 22 486 322 [OBJ] 5 "metallic copper leather ballet flat" 0 24 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 15 693 791 16 697 798 18 701 814 20 701 826 21 669 818 23 662 826 [OBJ] 6 "white ceramic beaded mug" 0 24 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 14 763 548 16 755 552 18 767 556 20 755 564 22 751 572 [OBJ] 7 "black cardboard box of pads" 0 24 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 15 833 326 16 818 322 17 791 318 19 783 314 20 841 322 21 826 318 23 814 314 [OBJ] 8 "colorful wooden vehicle puzzle" 0 24 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 15 955 533 19 943 537 21 951 541 [OBJ] 9 "brown metallic can of herring fillets" 0 24 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 14 966 708 16 962 716 18 958 728 20 955 740 22 947 748 [OBJS-END] [INTERACTIONS-START] [INTERACT] 5 "contact" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 6 "contact" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 15 "contact" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 16 "contact" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 17 "contact" 0 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 18 "contact" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 19 "contact" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 20 "contact" 0 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 0 "collision" 5 5 [IN] 0 1 [OUT] 0 1 [INTERACT] 1 "collision" 5 6 [IN] 0 3 [OUT] 0 3 [INTERACT] 12 "collision" 6 6 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 "collision" 7 7 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 13 "collision" 8 8 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 "collision" 9 9 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 14 "contact" 9 12 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 2 "contact" 10 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 7 "collision" 14 14 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 8 "contact" 15 16 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 9 "collision" 18 18 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 10 "collision" 20 20 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 11 "contact" 21 23 [IN] 3 65535 [OUT] 3 65535 [INTERACTIONS-END] [SCENE-END]
Parsed ground truth
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 48,
"y": 216
},
{
"t": 1,
"x": 56,
"y": 228
},
{
"t": 2,
"x": 72,
"y": 267
},
{
"t": 3,
"x": 72,
"y": 318
},
{
"t": 4,
"x": 111,
"y": 353
},
{
"t": 5,
"x": 115,
"y": 361
},
{
"t": 6,
"x": 130,
"y": 376
},
{
"t": 8,
"x": 134,
"y": 353
},
{
"t": 9,
"x": 162,
"y": 341
},
{
"t": 10,
"x": 376,
"y": 431
},
{
"t": 11,
"x": 337,
"y": 408
},
{
"t": 12,
"x": 310,
"y": 396
},
{
"t": 14,
"x": 298,
"y": 392
},
{
"t": 15,
"x": 314,
"y": 396
},
{
"t": 16,
"x": 326,
"y": 392
},
{
"t": 17,
"x": 337,
"y": 392
},
{
"t": 19,
"x": 357,
"y": 392
},
{
"t": 20,
"x": 365,
"y": 396
},
{
"t": 21,
"x": 373,
"y": 400
},
{
"t": 23,
"x": 376,
"y": 408
}
],
"birth": 0,
"death": 24,
"type": "black and grey high-top sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 107,
"y": 427
},
{
"t": 3,
"x": 142,
"y": 427
},
{
"t": 4,
"x": 64,
"y": 435
},
{
"t": 5,
"x": 52,
"y": 435
},
{
"t": 8,
"x": 72,
"y": 427
},
{
"t": 9,
"x": 83,
"y": 412
},
{
"t": 11,
"x": 91,
"y": 423
},
{
"t": 13,
"x": 115,
"y": 423
},
{
"t": 14,
"x": 123,
"y": 419
},
{
"t": 22,
"x": 154,
"y": 408
},
{
"t": 23,
"x": 134,
"y": 419
}
],
"birth": 0,
"death": 24,
"type": "grey stuffed raccoon"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 330,
"y": 384
},
{
"t": 3,
"x": 337,
"y": 380
},
{
"t": 4,
"x": 349,
"y": 376
},
{
"t": 5,
"x": 337,
"y": 376
},
{
"t": 6,
"x": 345,
"y": 373
},
{
"t": 7,
"x": 380,
"y": 369
},
{
"t": 9,
"x": 384,
"y": 361
},
{
"t": 10,
"x": 345,
"y": 353
},
{
"t": 11,
"x": 357,
"y": 349
},
{
"t": 12,
"x": 384,
"y": 353
},
{
"t": 13,
"x": 392,
"y": 345
},
{
"t": 15,
"x": 396,
"y": 337
},
{
"t": 17,
"x": 263,
"y": 330
},
{
"t": 19,
"x": 275,
"y": 337
},
{
"t": 21,
"x": 294,
"y": 337
},
{
"t": 22,
"x": 291,
"y": 345
}
],
"birth": 0,
"death": 24,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 341,
"y": 228
},
{
"t": 1,
"x": 322,
"y": 240
},
{
"t": 2,
"x": 302,
"y": 263
},
{
"t": 3,
"x": 283,
"y": 298
},
{
"t": 4,
"x": 267,
"y": 322
},
{
"t": 5,
"x": 255,
"y": 392
},
{
"t": 6,
"x": 244,
"y": 400
},
{
"t": 7,
"x": 232,
"y": 427
},
{
"t": 8,
"x": 236,
"y": 419
},
{
"t": 9,
"x": 224,
"y": 431
},
{
"t": 10,
"x": 220,
"y": 451
},
{
"t": 11,
"x": 232,
"y": 466
},
{
"t": 12,
"x": 236,
"y": 478
},
{
"t": 13,
"x": 255,
"y": 474
},
{
"t": 14,
"x": 251,
"y": 498
},
{
"t": 15,
"x": 103,
"y": 505
},
{
"t": 16,
"x": 193,
"y": 541
},
{
"t": 17,
"x": 189,
"y": 556
},
{
"t": 18,
"x": 173,
"y": 572
},
{
"t": 19,
"x": 240,
"y": 568
},
{
"t": 20,
"x": 216,
"y": 591
},
{
"t": 21,
"x": 224,
"y": 587
},
{
"t": 22,
"x": 220,
"y": 595
},
{
"t": 23,
"x": 193,
"y": 607
}
],
"birth": 0,
"death": 24,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 478,
"y": 392
},
{
"t": 2,
"x": 466,
"y": 384
},
{
"t": 3,
"x": 458,
"y": 380
},
{
"t": 4,
"x": 517,
"y": 384
},
{
"t": 5,
"x": 490,
"y": 376
},
{
"t": 6,
"x": 466,
"y": 369
},
{
"t": 8,
"x": 470,
"y": 361
},
{
"t": 9,
"x": 517,
"y": 369
},
{
"t": 10,
"x": 494,
"y": 361
},
{
"t": 11,
"x": 474,
"y": 353
},
{
"t": 13,
"x": 521,
"y": 357
},
{
"t": 14,
"x": 513,
"y": 353
},
{
"t": 15,
"x": 478,
"y": 341
},
{
"t": 16,
"x": 490,
"y": 341
},
{
"t": 17,
"x": 482,
"y": 337
},
{
"t": 19,
"x": 513,
"y": 337
},
{
"t": 20,
"x": 505,
"y": 333
},
{
"t": 22,
"x": 486,
"y": 322
}
],
"birth": 0,
"death": 24,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 751,
"y": 689
},
{
"t": 1,
"x": 759,
"y": 701
},
{
"t": 2,
"x": 755,
"y": 708
},
{
"t": 3,
"x": 751,
"y": 716
},
{
"t": 4,
"x": 748,
"y": 724
},
{
"t": 5,
"x": 744,
"y": 732
},
{
"t": 7,
"x": 740,
"y": 748
},
{
"t": 9,
"x": 740,
"y": 763
},
{
"t": 11,
"x": 740,
"y": 779
},
{
"t": 13,
"x": 701,
"y": 779
},
{
"t": 15,
"x": 693,
"y": 791
},
{
"t": 16,
"x": 697,
"y": 798
},
{
"t": 18,
"x": 701,
"y": 814
},
{
"t": 20,
"x": 701,
"y": 826
},
{
"t": 21,
"x": 669,
"y": 818
},
{
"t": 23,
"x": 662,
"y": 826
}
],
"birth": 0,
"death": 24,
"type": "metallic copper leather ballet flat"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 798,
"y": 482
},
{
"t": 1,
"x": 791,
"y": 486
},
{
"t": 3,
"x": 783,
"y": 498
},
{
"t": 5,
"x": 779,
"y": 509
},
{
"t": 7,
"x": 779,
"y": 521
},
{
"t": 10,
"x": 775,
"y": 533
},
{
"t": 12,
"x": 767,
"y": 541
},
{
"t": 14,
"x": 763,
"y": 548
},
{
"t": 16,
"x": 755,
"y": 552
},
{
"t": 18,
"x": 767,
"y": 556
},
{
"t": 20,
"x": 755,
"y": 564
},
{
"t": 22,
"x": 751,
"y": 572
}
],
"birth": 0,
"death": 24,
"type": "white ceramic beaded mug"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 884,
"y": 314
},
{
"t": 1,
"x": 732,
"y": 310
},
{
"t": 3,
"x": 861,
"y": 314
},
{
"t": 5,
"x": 869,
"y": 322
},
{
"t": 8,
"x": 861,
"y": 326
},
{
"t": 9,
"x": 849,
"y": 322
},
{
"t": 10,
"x": 857,
"y": 326
},
{
"t": 12,
"x": 845,
"y": 326
},
{
"t": 15,
"x": 833,
"y": 326
},
{
"t": 16,
"x": 818,
"y": 322
},
{
"t": 17,
"x": 791,
"y": 318
},
{
"t": 19,
"x": 783,
"y": 314
},
{
"t": 20,
"x": 841,
"y": 322
},
{
"t": 21,
"x": 826,
"y": 318
},
{
"t": 23,
"x": 814,
"y": 314
}
],
"birth": 0,
"death": 24,
"type": "black cardboard box of pads"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 990,
"y": 505
},
{
"t": 3,
"x": 970,
"y": 505
},
{
"t": 4,
"x": 986,
"y": 513
},
{
"t": 6,
"x": 966,
"y": 509
},
{
"t": 7,
"x": 982,
"y": 517
},
{
"t": 8,
"x": 970,
"y": 517
},
{
"t": 9,
"x": 978,
"y": 525
},
{
"t": 10,
"x": 966,
"y": 521
},
{
"t": 11,
"x": 974,
"y": 529
},
{
"t": 12,
"x": 962,
"y": 525
},
{
"t": 15,
"x": 955,
"y": 533
},
{
"t": 19,
"x": 943,
"y": 537
},
{
"t": 21,
"x": 951,
"y": 541
}
],
"birth": 0,
"death": 24,
"type": "colorful wooden vehicle puzzle"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 990,
"y": 642
},
{
"t": 1,
"x": 990,
"y": 630
},
{
"t": 3,
"x": 986,
"y": 654
},
{
"t": 5,
"x": 982,
"y": 669
},
{
"t": 6,
"x": 982,
"y": 658
},
{
"t": 8,
"x": 978,
"y": 677
},
{
"t": 10,
"x": 974,
"y": 689
},
{
"t": 12,
"x": 970,
"y": 701
},
{
"t": 14,
"x": 966,
"y": 708
},
{
"t": 16,
"x": 962,
"y": 716
},
{
"t": 18,
"x": 958,
"y": 728
},
{
"t": 20,
"x": 955,
"y": 740
},
{
"t": 22,
"x": 947,
"y": 748
}
],
"birth": 0,
"death": 24,
"type": "brown metallic can of herring fillets"
}
],
"interactions": [
{
"id": 5,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 6,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 15,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 16,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 17,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 18,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 19,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 20,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 0,
"inputs": [
0,
1
],
"outputs": [
0,
1
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 1,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 5,
"ends_at": 6,
"type": "collision"
},
{
"id": 12,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 3,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 13,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 4,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 14,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 9,
"ends_at": 12,
"type": "contact"
},
{
"id": 2,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 10,
"ends_at": 23,
"type": "contact"
},
{
"id": 7,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 8,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 15,
"ends_at": 16,
"type": "contact"
},
{
"id": 9,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 10,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 11,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 21,
"ends_at": 23,
"type": "contact"
}
]
}Per-frame GT object prefill
Each one-frame detector request was assistant-prefilled with the exact visible GT objects using canonical IDs. B1 generated only the interaction suffix; the saved frame outputs below are the exact persisted requests and generations.
Every persisted/reconstructed prefill step
[
{
"frame_index": 0,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 48 216 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 107 427 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 330 384 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 341 228 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 478 392 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 751 689 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 798 482 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 884 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 990 505 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 990 642 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 48 216 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 107 427 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 330 384 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 341 228 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 478 392 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 751 689 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 798 482 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 884 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 990 505 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 990 642 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"8": 8,
"9": 9
},
"parsed_object_count": 10,
"parsed_interaction_count": 8
},
{
"frame_index": 1,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 56 228 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 322 240 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 759 701 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 791 486 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 732 310 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 990 630 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 56 228 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 322 240 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 759 701 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 791 486 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 732 310 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 990 630 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"3": 3,
"5": 5,
"6": 6,
"7": 7,
"9": 9
},
"parsed_object_count": 6,
"parsed_interaction_count": 9
},
{
"frame_index": 2,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 72 267 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 302 263 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 466 384 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 755 708 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 4 [OUT] 3 4 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 72 267 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 302 263 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 466 384 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 755 708 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 4 [OUT] 3 4 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"3": 3,
"4": 4,
"5": 5
},
"parsed_object_count": 4,
"parsed_interaction_count": 5
},
{
"frame_index": 3,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 72 318 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 142 427 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 337 380 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 283 298 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 458 380 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 751 716 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 783 498 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 861 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 970 505 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 986 654 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 72 318 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 142 427 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 337 380 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 283 298 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 458 380 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 751 716 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 783 498 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 861 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 970 505 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 986 654 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"8": 8,
"9": 9
},
"parsed_object_count": 10,
"parsed_interaction_count": 9
},
{
"frame_index": 4,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 111 353 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 64 435 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 349 376 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 267 322 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 517 384 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 748 724 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 986 513 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 1 [OUT] 0 1 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 111 353 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 64 435 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 349 376 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 267 322 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 517 384 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 748 724 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 986 513 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 1 [OUT] 0 1 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"8": 8
},
"parsed_object_count": 7,
"parsed_interaction_count": 8
},
{
"frame_index": 5,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 115 361 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 52 435 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 337 376 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 255 392 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 490 376 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 744 732 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 779 509 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 869 322 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 982 669 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 1 [OUT] 0 1 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 115 361 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 52 435 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 337 376 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 255 392 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 490 376 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 744 732 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 779 509 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 869 322 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 982 669 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 1 [OUT] 0 1 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"9": 9
},
"parsed_object_count": 9,
"parsed_interaction_count": 10
},
{
"frame_index": 6,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 130 376 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 345 373 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 244 400 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 466 369 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 966 509 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 982 658 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 130 376 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 345 373 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 244 400 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 466 369 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 966 509 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 982 658 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"8": 8,
"9": 9
},
"parsed_object_count": 6,
"parsed_interaction_count": 7
},
{
"frame_index": 7,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 380 369 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 232 427 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 740 748 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 779 521 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 982 517 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 3 [OUT] 1 3 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 380 369 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 232 427 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 740 748 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 779 521 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 982 517 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 3 [OUT] 1 3 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"2": 2,
"3": 3,
"5": 5,
"6": 6,
"8": 8
},
"parsed_object_count": 5,
"parsed_interaction_count": 9
},
{
"frame_index": 8,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 134 353 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 72 427 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 236 419 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 470 361 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 861 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 970 517 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 978 677 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 134 353 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 72 427 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 236 419 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 470 361 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 861 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 970 517 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 978 677 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"3": 3,
"4": 4,
"7": 7,
"8": 8,
"9": 9
},
"parsed_object_count": 7,
"parsed_interaction_count": 7
},
{
"frame_index": 9,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 162 341 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 83 412 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 384 361 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 224 431 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 517 369 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 740 763 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 849 322 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 978 525 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 162 341 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 83 412 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 384 361 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 224 431 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 517 369 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 740 763 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 849 322 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 978 525 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"7": 7,
"8": 8
},
"parsed_object_count": 8,
"parsed_interaction_count": 8
},
{
"frame_index": 10,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 376 431 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 345 353 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 220 451 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 494 361 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 775 533 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 857 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 966 521 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 974 689 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 376 431 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 345 353 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 220 451 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 494 361 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 775 533 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 857 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 966 521 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 974 689 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"6": 6,
"7": 7,
"8": 8,
"9": 9
},
"parsed_object_count": 8,
"parsed_interaction_count": 9
},
{
"frame_index": 11,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 337 408 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 91 423 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 357 349 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 232 466 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 474 353 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 740 779 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 974 529 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 1 [OUT] 0 1 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 337 408 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 91 423 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 357 349 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 232 466 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 474 353 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 740 779 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 974 529 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 1 [OUT] 0 1 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"8": 8
},
"parsed_object_count": 7,
"parsed_interaction_count": 8
},
{
"frame_index": 12,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 310 396 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 384 353 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 236 478 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 767 541 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 845 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 962 525 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 970 701 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 310 396 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 384 353 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 236 478 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 767 541 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 845 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 962 525 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 970 701 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"6": 6,
"7": 7,
"8": 8,
"9": 9
},
"parsed_object_count": 7,
"parsed_interaction_count": 9
},
{
"frame_index": 13,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 115 423 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 392 345 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 255 474 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 521 357 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 701 779 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 115 423 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 392 345 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 255 474 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 521 357 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 701 779 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5
},
"parsed_object_count": 5,
"parsed_interaction_count": 6
},
{
"frame_index": 14,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 298 392 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 123 419 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 251 498 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 513 353 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 763 548 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 966 708 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 298 392 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 123 419 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 251 498 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 513 353 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 763 548 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 966 708 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"3": 3,
"4": 4,
"6": 6,
"9": 9
},
"parsed_object_count": 6,
"parsed_interaction_count": 7
},
{
"frame_index": 15,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 314 396 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 396 337 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 103 505 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 478 341 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 693 791 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 833 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 955 533 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 314 396 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 396 337 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 103 505 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 478 341 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 693 791 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 833 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 955 533 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"7": 7,
"8": 8
},
"parsed_object_count": 7,
"parsed_interaction_count": 8
},
{
"frame_index": 16,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 326 392 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 193 541 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 490 341 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 697 798 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 755 552 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 818 322 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 962 716 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 326 392 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 193 541 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 490 341 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 697 798 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 755 552 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 818 322 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 962 716 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"9": 9
},
"parsed_object_count": 7,
"parsed_interaction_count": 9
},
{
"frame_index": 17,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 337 392 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 263 330 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 189 556 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 482 337 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 791 318 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 337 392 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 263 330 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 189 556 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 482 337 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 791 318 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"7": 7
},
"parsed_object_count": 5,
"parsed_interaction_count": 7
},
{
"frame_index": 18,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 173 572 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 701 814 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 767 556 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 958 728 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 173 572 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 701 814 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 767 556 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 958 728 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"3": 3,
"5": 5,
"6": 6,
"9": 9
},
"parsed_object_count": 4,
"parsed_interaction_count": 10
},
{
"frame_index": 19,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 357 392 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 275 337 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 240 568 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 513 337 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 783 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 943 537 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 357 392 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 275 337 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 240 568 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 513 337 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 783 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 943 537 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"7": 7,
"8": 8
},
"parsed_object_count": 6,
"parsed_interaction_count": 6
},
{
"frame_index": 20,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 365 396 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 216 591 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 505 333 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 701 826 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 755 564 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 841 322 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 955 740 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 365 396 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 216 591 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 505 333 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 701 826 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 755 564 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 841 322 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 955 740 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"9": 9
},
"parsed_object_count": 7,
"parsed_interaction_count": 7
},
{
"frame_index": 21,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 373 400 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 294 337 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 224 587 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 669 818 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 826 318 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 951 541 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 373 400 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 294 337 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 224 587 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 669 818 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 826 318 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 951 541 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"5": 5,
"7": 7,
"8": 8
},
"parsed_object_count": 6,
"parsed_interaction_count": 7
},
{
"frame_index": 22,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 154 408 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 291 345 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 220 595 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 486 322 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 751 572 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 947 748 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 154 408 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 291 345 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 220 595 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 486 322 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 751 572 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 947 748 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"6": 6,
"9": 9
},
"parsed_object_count": 6,
"parsed_interaction_count": 6
},
{
"frame_index": 23,
"provenance": "exact persisted frame output",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 376 408 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 134 419 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 193 607 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 662 826 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 814 314 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 376 408 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 134 419 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 193 607 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 662 826 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 814 314 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACTIONS-END] [SCENE-END]",
"identity_mapping": {
"0": 0,
"1": 1,
"3": 3,
"5": 5,
"7": 7
},
"parsed_object_count": 5,
"parsed_interaction_count": 5
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "black and grey high-top sneaker" 0 24 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 14 298 392 15 314 396 16 326 392 17 337 392 19 357 392 20 365 396 21 373 400 23 376 408 [OBJ] 1 "grey stuffed raccoon" 0 24 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 14 123 419 22 154 408 23 134 419 [OBJ] 2 "white plastic dietary supplement bottle" 0 24 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 15 396 337 17 263 330 19 275 337 21 294 337 22 291 345 [OBJ] 3 "dark grey metallic cake pan set" 0 24 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 14 251 498 15 103 505 16 193 541 17 189 556 18 173 572 19 240 568 20 216 591 21 224 587 22 220 595 23 193 607 [OBJ] 4 "plastic Nintendo 3DS game case" 0 24 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 14 513 353 15 478 341 16 490 341 17 482 337 19 513 337 20 505 333 22 486 322 [OBJ] 5 "metallic copper leather ballet flat" 0 24 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 15 693 791 16 697 798 18 701 814 20 701 826 21 669 818 23 662 826 [OBJ] 6 "white ceramic beaded mug" 0 24 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 14 763 548 16 755 552 18 767 556 20 755 564 22 751 572 [OBJ] 7 "black cardboard box of pads" 0 24 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 15 833 326 16 818 322 17 791 318 19 783 314 20 841 322 21 826 318 23 814 314 [OBJ] 8 "colorful wooden vehicle puzzle" 0 24 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 15 955 533 19 943 537 21 951 541 [OBJ] 9 "brown metallic can of herring fillets" 0 24 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 14 966 708 16 962 716 18 958 728 20 955 740 22 947 748 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 "contact" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 "contact" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 "contact" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 "contact" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 4 "contact" 0 1 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 "contact" 0 1 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 "contact" 0 1 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 7 "contact" 0 5 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 "collision" 1 1 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 9 "collision" 1 1 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 10 "collision" 1 2 [IN] 65535 [OUT] 65535 [INTERACT] 11 "collision" 2 2 [IN] 3 4 [OUT] 3 4 [INTERACT] 12 "collision" 2 2 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 13 "collision" 3 3 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 14 "collision" 3 3 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 15 "collision" 3 3 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 16 "collision" 3 3 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 17 "collision" 3 3 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 18 "collision" 3 3 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 19 "collision" 3 4 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 20 "contact" 3 6 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 21 "collision" 4 4 [IN] 65535 [OUT] 65535 [INTERACT] 22 "collision" 4 5 [IN] 0 1 [OUT] 0 1 [INTERACT] 23 "contact" 4 5 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 24 "contact" 4 6 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 25 "contact" 4 7 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 26 "collision" 5 5 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 27 "collision" 5 5 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 28 "collision" 5 5 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 29 "collision" 5 6 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 30 "collision" 6 6 [IN] 0 3 [OUT] 0 3 [INTERACT] 31 "collision" 6 6 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 32 "contact" 6 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 33 "collision" 7 7 [IN] 3 [OUT] 3 [INTERACT] 34 "collision" 7 7 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 35 "collision" 7 7 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 36 "collision" 7 7 [IN] 65535 [OUT] 65535 [INTERACT] 37 "contact" 7 12 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 38 "collision" 8 8 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 39 "collision" 8 8 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 40 "collision" 8 8 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 41 "collision" 8 8 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 42 "collision" 8 9 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 43 "collision" 9 9 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 44 "collision" 9 9 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 45 "contact" 9 10 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 46 "contact" 9 11 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 47 "contact" 9 12 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 48 "collision" 10 10 [IN] 0 3 [OUT] 0 3 [INTERACT] 49 "collision" 10 10 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 50 "collision" 10 10 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 51 "contact" 10 13 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 52 "collision" 11 11 [IN] 0 1 [OUT] 0 1 [INTERACT] 53 "collision" 11 11 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 54 "collision" 11 11 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 55 "collision" 12 12 [IN] 0 3 [OUT] 0 3 [INTERACT] 56 "collision" 12 12 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 57 "collision" 12 12 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 58 "collision" 12 12 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 59 "collision" 12 13 [IN] 65535 [OUT] 65535 [INTERACT] 60 "collision" 13 13 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 61 "collision" 13 13 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 62 "collision" 13 14 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 63 "collision" 14 14 [IN] 0 3 [OUT] 0 3 [INTERACT] 64 "collision" 14 14 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 65 "collision" 14 14 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 66 "collision" 14 14 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 67 "contact" 14 17 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 68 "collision" 15 15 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 69 "collision" 15 15 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 70 "collision" 15 15 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 71 "collision" 15 16 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 72 "contact" 15 16 [IN] 0 3 [OUT] 0 3 [INTERACT] 73 "contact" 15 17 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 74 "collision" 16 16 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 75 "collision" 16 16 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 76 "collision" 16 16 [IN] 65535 [OUT] 65535 [INTERACT] 77 "contact" 16 17 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 78 "collision" 17 17 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 79 "contact" 17 18 [IN] 65535 [OUT] 65535 [INTERACT] 80 "collision" 18 18 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 81 "collision" 18 18 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 82 "collision" 18 18 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 83 "collision" 19 19 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 84 "collision" 19 19 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 85 "collision" 19 19 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 86 "collision" 19 19 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 87 "collision" 19 20 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 88 "collision" 20 20 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 89 "collision" 20 20 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 90 "collision" 20 21 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 91 "contact" 20 21 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 92 "contact" 20 21 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 93 "collision" 21 21 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 94 "collision" 21 21 [IN] 65535 [OUT] 65535 [INTERACT] 95 "collision" 21 22 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 96 "collision" 22 22 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 97 "collision" 22 22 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 98 "collision" 22 22 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 99 "collision" 22 22 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 100 "collision" 23 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 101 "collision" 23 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 102 "collision" 23 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 103 "contact" 23 23 [IN] 1 65535 [OUT] 1 65535 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 48,
"y": 216
},
{
"t": 1,
"x": 56,
"y": 228
},
{
"t": 2,
"x": 72,
"y": 267
},
{
"t": 3,
"x": 72,
"y": 318
},
{
"t": 4,
"x": 111,
"y": 353
},
{
"t": 5,
"x": 115,
"y": 361
},
{
"t": 6,
"x": 130,
"y": 376
},
{
"t": 8,
"x": 134,
"y": 353
},
{
"t": 9,
"x": 162,
"y": 341
},
{
"t": 10,
"x": 376,
"y": 431
},
{
"t": 11,
"x": 337,
"y": 408
},
{
"t": 12,
"x": 310,
"y": 396
},
{
"t": 14,
"x": 298,
"y": 392
},
{
"t": 15,
"x": 314,
"y": 396
},
{
"t": 16,
"x": 326,
"y": 392
},
{
"t": 17,
"x": 337,
"y": 392
},
{
"t": 19,
"x": 357,
"y": 392
},
{
"t": 20,
"x": 365,
"y": 396
},
{
"t": 21,
"x": 373,
"y": 400
},
{
"t": 23,
"x": 376,
"y": 408
}
],
"birth": 0,
"death": 24,
"type": "black and grey high-top sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 107,
"y": 427
},
{
"t": 3,
"x": 142,
"y": 427
},
{
"t": 4,
"x": 64,
"y": 435
},
{
"t": 5,
"x": 52,
"y": 435
},
{
"t": 8,
"x": 72,
"y": 427
},
{
"t": 9,
"x": 83,
"y": 412
},
{
"t": 11,
"x": 91,
"y": 423
},
{
"t": 13,
"x": 115,
"y": 423
},
{
"t": 14,
"x": 123,
"y": 419
},
{
"t": 22,
"x": 154,
"y": 408
},
{
"t": 23,
"x": 134,
"y": 419
}
],
"birth": 0,
"death": 24,
"type": "grey stuffed raccoon"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 330,
"y": 384
},
{
"t": 3,
"x": 337,
"y": 380
},
{
"t": 4,
"x": 349,
"y": 376
},
{
"t": 5,
"x": 337,
"y": 376
},
{
"t": 6,
"x": 345,
"y": 373
},
{
"t": 7,
"x": 380,
"y": 369
},
{
"t": 9,
"x": 384,
"y": 361
},
{
"t": 10,
"x": 345,
"y": 353
},
{
"t": 11,
"x": 357,
"y": 349
},
{
"t": 12,
"x": 384,
"y": 353
},
{
"t": 13,
"x": 392,
"y": 345
},
{
"t": 15,
"x": 396,
"y": 337
},
{
"t": 17,
"x": 263,
"y": 330
},
{
"t": 19,
"x": 275,
"y": 337
},
{
"t": 21,
"x": 294,
"y": 337
},
{
"t": 22,
"x": 291,
"y": 345
}
],
"birth": 0,
"death": 24,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 341,
"y": 228
},
{
"t": 1,
"x": 322,
"y": 240
},
{
"t": 2,
"x": 302,
"y": 263
},
{
"t": 3,
"x": 283,
"y": 298
},
{
"t": 4,
"x": 267,
"y": 322
},
{
"t": 5,
"x": 255,
"y": 392
},
{
"t": 6,
"x": 244,
"y": 400
},
{
"t": 7,
"x": 232,
"y": 427
},
{
"t": 8,
"x": 236,
"y": 419
},
{
"t": 9,
"x": 224,
"y": 431
},
{
"t": 10,
"x": 220,
"y": 451
},
{
"t": 11,
"x": 232,
"y": 466
},
{
"t": 12,
"x": 236,
"y": 478
},
{
"t": 13,
"x": 255,
"y": 474
},
{
"t": 14,
"x": 251,
"y": 498
},
{
"t": 15,
"x": 103,
"y": 505
},
{
"t": 16,
"x": 193,
"y": 541
},
{
"t": 17,
"x": 189,
"y": 556
},
{
"t": 18,
"x": 173,
"y": 572
},
{
"t": 19,
"x": 240,
"y": 568
},
{
"t": 20,
"x": 216,
"y": 591
},
{
"t": 21,
"x": 224,
"y": 587
},
{
"t": 22,
"x": 220,
"y": 595
},
{
"t": 23,
"x": 193,
"y": 607
}
],
"birth": 0,
"death": 24,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 478,
"y": 392
},
{
"t": 2,
"x": 466,
"y": 384
},
{
"t": 3,
"x": 458,
"y": 380
},
{
"t": 4,
"x": 517,
"y": 384
},
{
"t": 5,
"x": 490,
"y": 376
},
{
"t": 6,
"x": 466,
"y": 369
},
{
"t": 8,
"x": 470,
"y": 361
},
{
"t": 9,
"x": 517,
"y": 369
},
{
"t": 10,
"x": 494,
"y": 361
},
{
"t": 11,
"x": 474,
"y": 353
},
{
"t": 13,
"x": 521,
"y": 357
},
{
"t": 14,
"x": 513,
"y": 353
},
{
"t": 15,
"x": 478,
"y": 341
},
{
"t": 16,
"x": 490,
"y": 341
},
{
"t": 17,
"x": 482,
"y": 337
},
{
"t": 19,
"x": 513,
"y": 337
},
{
"t": 20,
"x": 505,
"y": 333
},
{
"t": 22,
"x": 486,
"y": 322
}
],
"birth": 0,
"death": 24,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 751,
"y": 689
},
{
"t": 1,
"x": 759,
"y": 701
},
{
"t": 2,
"x": 755,
"y": 708
},
{
"t": 3,
"x": 751,
"y": 716
},
{
"t": 4,
"x": 748,
"y": 724
},
{
"t": 5,
"x": 744,
"y": 732
},
{
"t": 7,
"x": 740,
"y": 748
},
{
"t": 9,
"x": 740,
"y": 763
},
{
"t": 11,
"x": 740,
"y": 779
},
{
"t": 13,
"x": 701,
"y": 779
},
{
"t": 15,
"x": 693,
"y": 791
},
{
"t": 16,
"x": 697,
"y": 798
},
{
"t": 18,
"x": 701,
"y": 814
},
{
"t": 20,
"x": 701,
"y": 826
},
{
"t": 21,
"x": 669,
"y": 818
},
{
"t": 23,
"x": 662,
"y": 826
}
],
"birth": 0,
"death": 24,
"type": "metallic copper leather ballet flat"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 798,
"y": 482
},
{
"t": 1,
"x": 791,
"y": 486
},
{
"t": 3,
"x": 783,
"y": 498
},
{
"t": 5,
"x": 779,
"y": 509
},
{
"t": 7,
"x": 779,
"y": 521
},
{
"t": 10,
"x": 775,
"y": 533
},
{
"t": 12,
"x": 767,
"y": 541
},
{
"t": 14,
"x": 763,
"y": 548
},
{
"t": 16,
"x": 755,
"y": 552
},
{
"t": 18,
"x": 767,
"y": 556
},
{
"t": 20,
"x": 755,
"y": 564
},
{
"t": 22,
"x": 751,
"y": 572
}
],
"birth": 0,
"death": 24,
"type": "white ceramic beaded mug"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 884,
"y": 314
},
{
"t": 1,
"x": 732,
"y": 310
},
{
"t": 3,
"x": 861,
"y": 314
},
{
"t": 5,
"x": 869,
"y": 322
},
{
"t": 8,
"x": 861,
"y": 326
},
{
"t": 9,
"x": 849,
"y": 322
},
{
"t": 10,
"x": 857,
"y": 326
},
{
"t": 12,
"x": 845,
"y": 326
},
{
"t": 15,
"x": 833,
"y": 326
},
{
"t": 16,
"x": 818,
"y": 322
},
{
"t": 17,
"x": 791,
"y": 318
},
{
"t": 19,
"x": 783,
"y": 314
},
{
"t": 20,
"x": 841,
"y": 322
},
{
"t": 21,
"x": 826,
"y": 318
},
{
"t": 23,
"x": 814,
"y": 314
}
],
"birth": 0,
"death": 24,
"type": "black cardboard box of pads"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 990,
"y": 505
},
{
"t": 3,
"x": 970,
"y": 505
},
{
"t": 4,
"x": 986,
"y": 513
},
{
"t": 6,
"x": 966,
"y": 509
},
{
"t": 7,
"x": 982,
"y": 517
},
{
"t": 8,
"x": 970,
"y": 517
},
{
"t": 9,
"x": 978,
"y": 525
},
{
"t": 10,
"x": 966,
"y": 521
},
{
"t": 11,
"x": 974,
"y": 529
},
{
"t": 12,
"x": 962,
"y": 525
},
{
"t": 15,
"x": 955,
"y": 533
},
{
"t": 19,
"x": 943,
"y": 537
},
{
"t": 21,
"x": 951,
"y": 541
}
],
"birth": 0,
"death": 24,
"type": "colorful wooden vehicle puzzle"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 990,
"y": 642
},
{
"t": 1,
"x": 990,
"y": 630
},
{
"t": 3,
"x": 986,
"y": 654
},
{
"t": 5,
"x": 982,
"y": 669
},
{
"t": 6,
"x": 982,
"y": 658
},
{
"t": 8,
"x": 978,
"y": 677
},
{
"t": 10,
"x": 974,
"y": 689
},
{
"t": 12,
"x": 970,
"y": 701
},
{
"t": 14,
"x": 966,
"y": 708
},
{
"t": 16,
"x": 962,
"y": 716
},
{
"t": 18,
"x": 958,
"y": 728
},
{
"t": 20,
"x": 955,
"y": 740
},
{
"t": 22,
"x": 947,
"y": 748
}
],
"birth": 0,
"death": 24,
"type": "brown metallic can of herring fillets"
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 1,
"type": "contact"
},
{
"id": 5,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 1,
"type": "contact"
},
{
"id": 6,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 1,
"type": "contact"
},
{
"id": 7,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 5,
"type": "contact"
},
{
"id": 8,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 1,
"ends_at": 1,
"type": "collision"
},
{
"id": 9,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 1,
"ends_at": 1,
"type": "collision"
},
{
"id": 10,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 1,
"ends_at": 2,
"type": "collision"
},
{
"id": 11,
"inputs": [
3,
4
],
"outputs": [
3,
4
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 12,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 13,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 14,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 15,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 16,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 17,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 18,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 19,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 3,
"ends_at": 4,
"type": "collision"
},
{
"id": 20,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 3,
"ends_at": 6,
"type": "contact"
},
{
"id": 21,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 22,
"inputs": [
0,
1
],
"outputs": [
0,
1
],
"begins_at": 4,
"ends_at": 5,
"type": "collision"
},
{
"id": 23,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 4,
"ends_at": 5,
"type": "contact"
},
{
"id": 24,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 4,
"ends_at": 6,
"type": "contact"
},
{
"id": 25,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 4,
"ends_at": 7,
"type": "contact"
},
{
"id": 26,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 27,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 28,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 29,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 5,
"ends_at": 6,
"type": "collision"
},
{
"id": 30,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 31,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 32,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 6,
"ends_at": 23,
"type": "contact"
},
{
"id": 33,
"inputs": [
3
],
"outputs": [
3
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 34,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 35,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 36,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 37,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 7,
"ends_at": 12,
"type": "contact"
},
{
"id": 38,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 39,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 40,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 41,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 42,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 8,
"ends_at": 9,
"type": "collision"
},
{
"id": 43,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 44,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 45,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 9,
"ends_at": 10,
"type": "contact"
},
{
"id": 46,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 9,
"ends_at": 11,
"type": "contact"
},
{
"id": 47,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 9,
"ends_at": 12,
"type": "contact"
},
{
"id": 48,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 49,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 50,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 51,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 10,
"ends_at": 13,
"type": "contact"
},
{
"id": 52,
"inputs": [
0,
1
],
"outputs": [
0,
1
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 53,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 54,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 55,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 56,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 57,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 58,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 59,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 12,
"ends_at": 13,
"type": "collision"
},
{
"id": 60,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 61,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 62,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 13,
"ends_at": 14,
"type": "collision"
},
{
"id": 63,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 64,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 65,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 66,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 67,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 14,
"ends_at": 17,
"type": "contact"
},
{
"id": 68,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 69,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 70,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 71,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 15,
"ends_at": 16,
"type": "collision"
},
{
"id": 72,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 15,
"ends_at": 16,
"type": "contact"
},
{
"id": 73,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 15,
"ends_at": 17,
"type": "contact"
},
{
"id": 74,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 75,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 76,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 77,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 16,
"ends_at": 17,
"type": "contact"
},
{
"id": 78,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 79,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 17,
"ends_at": 18,
"type": "contact"
},
{
"id": 80,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 81,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 82,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 83,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 84,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 85,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 86,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 87,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 19,
"ends_at": 20,
"type": "collision"
},
{
"id": 88,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 89,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 90,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 20,
"ends_at": 21,
"type": "collision"
},
{
"id": 91,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 20,
"ends_at": 21,
"type": "contact"
},
{
"id": 92,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 20,
"ends_at": 21,
"type": "contact"
},
{
"id": 93,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 94,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 95,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 21,
"ends_at": 22,
"type": "collision"
},
{
"id": 96,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 97,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 98,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 99,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 100,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
},
{
"id": 101,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
},
{
"id": 102,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
},
{
"id": 103,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "contact"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 1.0,
"avg_image_position_segmentation_acc_small": 1.0,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 1.0,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": null,
"num_matches": 10,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.6485260770975055,
"avg_interaction_input_object_jaccard": 0.28571428571428564,
"avg_interaction_output_object_jaccard": 0.28571428571428564,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 21,
"num_unmatched_pred_interactions": 83,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 16,
"false_positives": 88,
"false_negatives": 0
},
"0.5": {
"true_positives": 12,
"false_positives": 92,
"false_negatives": 0
},
"0.75": {
"true_positives": 12,
"false_positives": 92,
"false_negatives": 0
},
"1.0": {
"true_positives": 11,
"false_positives": 93,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.15384615384615385,
"0.5": 0.11538461538461539,
"0.75": 0.11538461538461539,
"1.0": 0.10576923076923077
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.2666666666666667,
"0.5": 0.20689655172413793,
"0.75": 0.20689655172413793,
"1.0": 0.19130434782608693
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 18,
"false_positives": 86,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 104,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 104,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 104,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.17307692307692307,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.29508196721311475,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 18,
"false_positives": 86,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 104,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 104,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 104,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.17307692307692307,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.29508196721311475,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
}Prompt
<video> Analyze the provided video and return ONLY a valid sentinel sequence in this format: [SCENE-START] [OBJS-START] [OBJ] id "type" birth death [PX] t px py ... [OBJ] ... [OBJS-END] [INTERACTIONS-START] [INTERACT] id "type" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ... [INTERACT] ... [INTERACTIONS-END] [SCENE-END] Constraints: - Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose). - Keep tags exactly as written: `[SCENE-START] [OBJS-START] [OBJ] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]` - Use quoted strings for `type` (double quotes). - `PX` uses repeated groups of 3 values in order: `t px py`. - `t` is the timestamp (frame number). - `px` and `py` are the pixel coordinates of the object in that frame, normalized to [0,1] relative to the frame dimensions, scaled by 1000 and rounded to the nearest integer. For example, `px` of 0.1234 would be represented as 123. - When an object is occluded or not visible in a frame, `PX` may use `t null null`. - `IN` and `OUT` contain whitespace-separated integer ids.
B1 cache + injected GT identity map
B2 consumed the persisted B1-oracle frame cache. Its learned mapper call was bypassed at every streaming step and replaced with the shown stable-ID → detector-ID identity map; the ordinary staged merger still produced the final interaction prediction.
Every persisted/reconstructed prefill step
[
{
"frame_index": 0,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 48 216 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 107 427 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 330 384 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 341 228 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 478 392 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 751 689 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 798 482 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 884 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 990 505 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 990 642 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 48 216 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 107 427 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 330 384 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 341 228 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 478 392 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 751 689 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 798 482 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 884 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 990 505 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 990 642 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 48,
"y": 216
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 107,
"y": 427
}
],
"birth": 0,
"death": 1,
"type": "grey stuffed raccoon"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 330,
"y": 384
}
],
"birth": 0,
"death": 1,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 341,
"y": 228
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 478,
"y": 392
}
],
"birth": 0,
"death": 1,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 751,
"y": 689
}
],
"birth": 0,
"death": 1,
"type": "metallic copper leather ballet flat"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 798,
"y": 482
}
],
"birth": 0,
"death": 1,
"type": "white ceramic beaded mug"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 884,
"y": 314
}
],
"birth": 0,
"death": 1,
"type": "black cardboard box of pads"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 990,
"y": 505
}
],
"birth": 0,
"death": 1,
"type": "colorful wooden vehicle puzzle"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 990,
"y": 642
}
],
"birth": 0,
"death": 1,
"type": "brown metallic can of herring fillets"
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"8": 8,
"9": 9
},
"mapping_note": "identity_ids=True initialization; mapper not called",
"mapper_called": false
},
{
"frame_index": 1,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 56 228 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 322 240 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 759 701 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 791 486 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 732 310 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 990 630 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 56 228 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 322 240 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 759 701 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 791 486 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 732 310 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 990 630 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 56,
"y": 228
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 322,
"y": 240
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 759,
"y": 701
}
],
"birth": 0,
"death": 1,
"type": "metallic copper leather ballet flat"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 791,
"y": 486
}
],
"birth": 0,
"death": 1,
"type": "white ceramic beaded mug"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 732,
"y": 310
}
],
"birth": 0,
"death": 1,
"type": "black cardboard box of pads"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 990,
"y": 630
}
],
"birth": 0,
"death": 1,
"type": "brown metallic can of herring fillets"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"3": 3,
"5": 5,
"6": 6,
"7": 7,
"9": 9
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 2,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 72 267 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 302 263 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 466 384 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 755 708 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 4 [OUT] 3 4 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 72 267 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 302 263 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 466 384 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 755 708 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 4 [OUT] 3 4 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 72,
"y": 267
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 302,
"y": 263
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 466,
"y": 384
}
],
"birth": 0,
"death": 1,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 755,
"y": 708
}
],
"birth": 0,
"death": 1,
"type": "metallic copper leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
4
],
"outputs": [
3,
4
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"3": 3,
"4": 4,
"5": 5
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 3,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 72 318 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 142 427 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 337 380 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 283 298 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 458 380 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 751 716 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 783 498 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 861 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 970 505 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 986 654 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 72 318 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 142 427 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 337 380 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 283 298 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 458 380 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 751 716 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 783 498 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 861 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 970 505 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 986 654 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 72,
"y": 318
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 142,
"y": 427
}
],
"birth": 0,
"death": 1,
"type": "grey stuffed raccoon"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 337,
"y": 380
}
],
"birth": 0,
"death": 1,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 283,
"y": 298
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 458,
"y": 380
}
],
"birth": 0,
"death": 1,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 751,
"y": 716
}
],
"birth": 0,
"death": 1,
"type": "metallic copper leather ballet flat"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 783,
"y": 498
}
],
"birth": 0,
"death": 1,
"type": "white ceramic beaded mug"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 861,
"y": 314
}
],
"birth": 0,
"death": 1,
"type": "black cardboard box of pads"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 970,
"y": 505
}
],
"birth": 0,
"death": 1,
"type": "colorful wooden vehicle puzzle"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 986,
"y": 654
}
],
"birth": 0,
"death": 1,
"type": "brown metallic can of herring fillets"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"8": 8,
"9": 9
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 4,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 111 353 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 64 435 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 349 376 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 267 322 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 517 384 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 748 724 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 986 513 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 1 [OUT] 0 1 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 111 353 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 64 435 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 349 376 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 267 322 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 517 384 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 748 724 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 986 513 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 1 [OUT] 0 1 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 111,
"y": 353
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 64,
"y": 435
}
],
"birth": 0,
"death": 1,
"type": "grey stuffed raccoon"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 349,
"y": 376
}
],
"birth": 0,
"death": 1,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 267,
"y": 322
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 517,
"y": 384
}
],
"birth": 0,
"death": 1,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 748,
"y": 724
}
],
"birth": 0,
"death": 1,
"type": "metallic copper leather ballet flat"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 986,
"y": 513
}
],
"birth": 0,
"death": 1,
"type": "colorful wooden vehicle puzzle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
1
],
"outputs": [
0,
1
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 5,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 115 361 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 52 435 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 337 376 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 255 392 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 490 376 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 744 732 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 779 509 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 869 322 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 982 669 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 1 [OUT] 0 1 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 115 361 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 52 435 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 337 376 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 255 392 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 490 376 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 744 732 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 779 509 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 869 322 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 982 669 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 1 [OUT] 0 1 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 115,
"y": 361
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 52,
"y": 435
}
],
"birth": 0,
"death": 1,
"type": "grey stuffed raccoon"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 337,
"y": 376
}
],
"birth": 0,
"death": 1,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 255,
"y": 392
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 490,
"y": 376
}
],
"birth": 0,
"death": 1,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 744,
"y": 732
}
],
"birth": 0,
"death": 1,
"type": "metallic copper leather ballet flat"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 779,
"y": 509
}
],
"birth": 0,
"death": 1,
"type": "white ceramic beaded mug"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 869,
"y": 322
}
],
"birth": 0,
"death": 1,
"type": "black cardboard box of pads"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 982,
"y": 669
}
],
"birth": 0,
"death": 1,
"type": "brown metallic can of herring fillets"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
1
],
"outputs": [
0,
1
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"9": 9
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 6,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 130 376 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 345 373 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 244 400 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 466 369 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 966 509 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 982 658 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 130 376 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 345 373 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 244 400 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 466 369 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 966 509 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 982 658 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 130,
"y": 376
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 345,
"y": 373
}
],
"birth": 0,
"death": 1,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 244,
"y": 400
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 466,
"y": 369
}
],
"birth": 0,
"death": 1,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 966,
"y": 509
}
],
"birth": 0,
"death": 1,
"type": "colorful wooden vehicle puzzle"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 982,
"y": 658
}
],
"birth": 0,
"death": 1,
"type": "brown metallic can of herring fillets"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"8": 8,
"9": 9
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 7,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 380 369 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 232 427 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 740 748 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 779 521 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 982 517 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 3 [OUT] 1 3 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 380 369 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 232 427 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 740 748 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 779 521 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 982 517 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 3 [OUT] 1 3 [INTERACT] 3 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 380,
"y": 369
}
],
"birth": 0,
"death": 1,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 232,
"y": 427
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 740,
"y": 748
}
],
"birth": 0,
"death": 1,
"type": "metallic copper leather ballet flat"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 779,
"y": 521
}
],
"birth": 0,
"death": 1,
"type": "white ceramic beaded mug"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 982,
"y": 517
}
],
"birth": 0,
"death": 1,
"type": "colorful wooden vehicle puzzle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
3
],
"outputs": [
1,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"2": 2,
"3": 3,
"5": 5,
"6": 6,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 8,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 134 353 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 72 427 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 236 419 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 470 361 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 861 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 970 517 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 978 677 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 134 353 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 72 427 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 236 419 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 470 361 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 861 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 970 517 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 978 677 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 134,
"y": 353
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 72,
"y": 427
}
],
"birth": 0,
"death": 1,
"type": "grey stuffed raccoon"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 236,
"y": 419
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 470,
"y": 361
}
],
"birth": 0,
"death": 1,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 861,
"y": 326
}
],
"birth": 0,
"death": 1,
"type": "black cardboard box of pads"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 970,
"y": 517
}
],
"birth": 0,
"death": 1,
"type": "colorful wooden vehicle puzzle"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 978,
"y": 677
}
],
"birth": 0,
"death": 1,
"type": "brown metallic can of herring fillets"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"3": 3,
"4": 4,
"7": 7,
"8": 8,
"9": 9
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 9,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 162 341 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 83 412 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 384 361 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 224 431 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 517 369 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 740 763 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 849 322 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 978 525 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 162 341 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 83 412 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 384 361 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 224 431 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 517 369 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 740 763 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 849 322 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 978 525 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 162,
"y": 341
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 83,
"y": 412
}
],
"birth": 0,
"death": 1,
"type": "grey stuffed raccoon"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 384,
"y": 361
}
],
"birth": 0,
"death": 1,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 224,
"y": 431
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 517,
"y": 369
}
],
"birth": 0,
"death": 1,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 740,
"y": 763
}
],
"birth": 0,
"death": 1,
"type": "metallic copper leather ballet flat"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 849,
"y": 322
}
],
"birth": 0,
"death": 1,
"type": "black cardboard box of pads"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 978,
"y": 525
}
],
"birth": 0,
"death": 1,
"type": "colorful wooden vehicle puzzle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"7": 7,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 10,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 376 431 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 345 353 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 220 451 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 494 361 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 775 533 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 857 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 966 521 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 974 689 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 376 431 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 345 353 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 220 451 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 494 361 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 775 533 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 857 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 966 521 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 974 689 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 376,
"y": 431
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 345,
"y": 353
}
],
"birth": 0,
"death": 1,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 220,
"y": 451
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 494,
"y": 361
}
],
"birth": 0,
"death": 1,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 775,
"y": 533
}
],
"birth": 0,
"death": 1,
"type": "white ceramic beaded mug"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 857,
"y": 326
}
],
"birth": 0,
"death": 1,
"type": "black cardboard box of pads"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 966,
"y": 521
}
],
"birth": 0,
"death": 1,
"type": "colorful wooden vehicle puzzle"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 974,
"y": 689
}
],
"birth": 0,
"death": 1,
"type": "brown metallic can of herring fillets"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"6": 6,
"7": 7,
"8": 8,
"9": 9
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 11,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 337 408 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 91 423 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 357 349 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 232 466 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 474 353 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 740 779 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 974 529 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 1 [OUT] 0 1 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 337 408 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 91 423 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 357 349 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 232 466 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 474 353 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 740 779 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 974 529 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 1 [OUT] 0 1 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 337,
"y": 408
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 91,
"y": 423
}
],
"birth": 0,
"death": 1,
"type": "grey stuffed raccoon"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 357,
"y": 349
}
],
"birth": 0,
"death": 1,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 232,
"y": 466
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 474,
"y": 353
}
],
"birth": 0,
"death": 1,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 740,
"y": 779
}
],
"birth": 0,
"death": 1,
"type": "metallic copper leather ballet flat"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 974,
"y": 529
}
],
"birth": 0,
"death": 1,
"type": "colorful wooden vehicle puzzle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
1
],
"outputs": [
0,
1
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 12,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 310 396 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 384 353 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 236 478 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 767 541 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 845 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 962 525 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 970 701 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 310 396 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 384 353 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 236 478 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 767 541 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 845 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 962 525 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 970 701 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 310,
"y": 396
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 384,
"y": 353
}
],
"birth": 0,
"death": 1,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 236,
"y": 478
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 767,
"y": 541
}
],
"birth": 0,
"death": 1,
"type": "white ceramic beaded mug"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 845,
"y": 326
}
],
"birth": 0,
"death": 1,
"type": "black cardboard box of pads"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 962,
"y": 525
}
],
"birth": 0,
"death": 1,
"type": "colorful wooden vehicle puzzle"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 970,
"y": 701
}
],
"birth": 0,
"death": 1,
"type": "brown metallic can of herring fillets"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"6": 6,
"7": 7,
"8": 8,
"9": 9
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 13,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 115 423 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 392 345 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 255 474 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 521 357 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 701 779 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 115 423 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 392 345 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 255 474 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 521 357 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 701 779 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 115,
"y": 423
}
],
"birth": 0,
"death": 1,
"type": "grey stuffed raccoon"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 392,
"y": 345
}
],
"birth": 0,
"death": 1,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 255,
"y": 474
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 521,
"y": 357
}
],
"birth": 0,
"death": 1,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 701,
"y": 779
}
],
"birth": 0,
"death": 1,
"type": "metallic copper leather ballet flat"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"5": 5
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 14,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 298 392 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 123 419 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 251 498 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 513 353 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 763 548 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 966 708 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 298 392 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 123 419 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 251 498 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 513 353 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 763 548 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 966 708 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 298,
"y": 392
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 123,
"y": 419
}
],
"birth": 0,
"death": 1,
"type": "grey stuffed raccoon"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 251,
"y": 498
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 513,
"y": 353
}
],
"birth": 0,
"death": 1,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 763,
"y": 548
}
],
"birth": 0,
"death": 1,
"type": "white ceramic beaded mug"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 966,
"y": 708
}
],
"birth": 0,
"death": 1,
"type": "brown metallic can of herring fillets"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"3": 3,
"4": 4,
"6": 6,
"9": 9
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 15,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 314 396 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 396 337 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 103 505 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 478 341 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 693 791 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 833 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 955 533 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 314 396 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 396 337 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 103 505 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 478 341 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 693 791 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 833 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 955 533 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 314,
"y": 396
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 396,
"y": 337
}
],
"birth": 0,
"death": 1,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 103,
"y": 505
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 478,
"y": 341
}
],
"birth": 0,
"death": 1,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 693,
"y": 791
}
],
"birth": 0,
"death": 1,
"type": "metallic copper leather ballet flat"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 833,
"y": 326
}
],
"birth": 0,
"death": 1,
"type": "black cardboard box of pads"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 955,
"y": 533
}
],
"birth": 0,
"death": 1,
"type": "colorful wooden vehicle puzzle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"5": 5,
"7": 7,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 16,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 326 392 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 193 541 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 490 341 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 697 798 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 755 552 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 818 322 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 962 716 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 326 392 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 193 541 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 490 341 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 697 798 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 755 552 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 818 322 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 962 716 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 326,
"y": 392
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 193,
"y": 541
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 490,
"y": 341
}
],
"birth": 0,
"death": 1,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 697,
"y": 798
}
],
"birth": 0,
"death": 1,
"type": "metallic copper leather ballet flat"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 755,
"y": 552
}
],
"birth": 0,
"death": 1,
"type": "white ceramic beaded mug"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 818,
"y": 322
}
],
"birth": 0,
"death": 1,
"type": "black cardboard box of pads"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 962,
"y": 716
}
],
"birth": 0,
"death": 1,
"type": "brown metallic can of herring fillets"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"9": 9
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 17,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 337 392 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 263 330 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 189 556 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 482 337 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 791 318 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 337 392 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 263 330 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 189 556 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 482 337 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 791 318 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 337,
"y": 392
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 263,
"y": 330
}
],
"birth": 0,
"death": 1,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 189,
"y": 556
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 482,
"y": 337
}
],
"birth": 0,
"death": 1,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 791,
"y": 318
}
],
"birth": 0,
"death": 1,
"type": "black cardboard box of pads"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"7": 7
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 18,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 173 572 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 701 814 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 767 556 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 958 728 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 173 572 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 701 814 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 767 556 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 958 728 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 8 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 9 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 173,
"y": 572
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 701,
"y": 814
}
],
"birth": 0,
"death": 1,
"type": "metallic copper leather ballet flat"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 767,
"y": 556
}
],
"birth": 0,
"death": 1,
"type": "white ceramic beaded mug"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 958,
"y": 728
}
],
"birth": 0,
"death": 1,
"type": "brown metallic can of herring fillets"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 7,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 8,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 9,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"3": 3,
"5": 5,
"6": 6,
"9": 9
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 19,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 357 392 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 275 337 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 240 568 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 513 337 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 783 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 943 537 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 357 392 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 275 337 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 240 568 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 513 337 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 783 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 943 537 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 357,
"y": 392
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 275,
"y": 337
}
],
"birth": 0,
"death": 1,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 240,
"y": 568
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 513,
"y": 337
}
],
"birth": 0,
"death": 1,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 783,
"y": 314
}
],
"birth": 0,
"death": 1,
"type": "black cardboard box of pads"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 943,
"y": 537
}
],
"birth": 0,
"death": 1,
"type": "colorful wooden vehicle puzzle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"4": 4,
"7": 7,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 20,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 365 396 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 216 591 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 505 333 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 701 826 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 755 564 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 841 322 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 955 740 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 365 396 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 216 591 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 505 333 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 701 826 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 755 564 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 841 322 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 955 740 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 365,
"y": 396
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 216,
"y": 591
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 505,
"y": 333
}
],
"birth": 0,
"death": 1,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 701,
"y": 826
}
],
"birth": 0,
"death": 1,
"type": "metallic copper leather ballet flat"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 755,
"y": 564
}
],
"birth": 0,
"death": 1,
"type": "white ceramic beaded mug"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 841,
"y": 322
}
],
"birth": 0,
"death": 1,
"type": "black cardboard box of pads"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 955,
"y": 740
}
],
"birth": 0,
"death": 1,
"type": "brown metallic can of herring fillets"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"3": 3,
"4": 4,
"5": 5,
"6": 6,
"7": 7,
"9": 9
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 21,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 373 400 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 294 337 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 224 587 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 669 818 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 826 318 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 951 541 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 373 400 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 294 337 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 224 587 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 669 818 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 826 318 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 951 541 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 373,
"y": 400
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 294,
"y": 337
}
],
"birth": 0,
"death": 1,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 224,
"y": 587
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 669,
"y": 818
}
],
"birth": 0,
"death": 1,
"type": "metallic copper leather ballet flat"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 826,
"y": 318
}
],
"birth": 0,
"death": 1,
"type": "black cardboard box of pads"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 951,
"y": 541
}
],
"birth": 0,
"death": 1,
"type": "colorful wooden vehicle puzzle"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 6,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"2": 2,
"3": 3,
"5": 5,
"7": 7,
"8": 8
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 22,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 154 408 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 291 345 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 220 595 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 486 322 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 751 572 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 947 748 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 154 408 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 291 345 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 220 595 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 486 322 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 751 572 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 947 748 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 \"contact\" 0 0 [IN] 9 65535 [OUT] 9 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 154,
"y": 408
}
],
"birth": 0,
"death": 1,
"type": "grey stuffed raccoon"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 291,
"y": 345
}
],
"birth": 0,
"death": 1,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 220,
"y": 595
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 486,
"y": 322
}
],
"birth": 0,
"death": 1,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 751,
"y": 572
}
],
"birth": 0,
"death": 1,
"type": "white ceramic beaded mug"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 947,
"y": 748
}
],
"birth": 0,
"death": 1,
"type": "brown metallic can of herring fillets"
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 5,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"1": 1,
"2": 2,
"3": 3,
"4": 4,
"6": 6,
"9": 9
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
},
{
"frame_index": 23,
"provenance": "exact persisted B1 Stage-1 cache + deterministic injected mapping",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 376 408 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 134 419 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 193 607 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 662 826 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 814 314 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 376 408 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 134 419 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 193 607 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 662 826 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 814 314 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 0 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 0 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 0 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 4 \"contact\" 0 0 [IN] 7 65535 [OUT] 7 65535 [INTERACTIONS-END] [SCENE-END]",
"cached_stage1_parse": {
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 376,
"y": 408
}
],
"birth": 0,
"death": 1,
"type": "black and grey high-top sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 134,
"y": 419
}
],
"birth": 0,
"death": 1,
"type": "grey stuffed raccoon"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 193,
"y": 607
}
],
"birth": 0,
"death": 1,
"type": "dark grey metallic cake pan set"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 662,
"y": 826
}
],
"birth": 0,
"death": 1,
"type": "metallic copper leather ballet flat"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 814,
"y": 314
}
],
"birth": 0,
"death": 1,
"type": "black cardboard box of pads"
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
}
]
},
"identity_mapping": {
"0": 0,
"1": 1,
"3": 3,
"5": 5,
"7": 7
},
"mapping_note": "injected stable-ID → detector-ID map; mapper not called",
"mapper_called": false
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "black and grey high-top sneaker" 0 24 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 14 298 392 15 314 396 16 326 392 17 337 392 19 357 392 20 365 396 21 373 400 23 376 408 [OBJ] 1 "grey stuffed raccoon" 0 24 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 14 123 419 22 154 408 23 134 419 [OBJ] 2 "white plastic dietary supplement bottle" 0 24 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 15 396 337 17 263 330 19 275 337 21 294 337 22 291 345 [OBJ] 3 "dark grey metallic cake pan set" 0 24 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 14 251 498 15 103 505 16 193 541 17 189 556 18 173 572 19 240 568 20 216 591 21 224 587 22 220 595 23 193 607 [OBJ] 4 "plastic Nintendo 3DS game case" 0 24 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 14 513 353 15 478 341 16 490 341 17 482 337 19 513 337 20 505 333 22 486 322 [OBJ] 5 "metallic copper leather ballet flat" 0 24 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 15 693 791 16 697 798 18 701 814 20 701 826 21 669 818 23 662 826 [OBJ] 6 "white ceramic beaded mug" 0 24 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 14 763 548 16 755 552 18 767 556 20 755 564 22 751 572 [OBJ] 7 "black cardboard box of pads" 0 24 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 15 833 326 16 818 322 17 791 318 19 783 314 20 841 322 21 826 318 23 814 314 [OBJ] 8 "colorful wooden vehicle puzzle" 0 24 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 15 955 533 19 943 537 21 951 541 [OBJ] 9 "brown metallic can of herring fillets" 0 24 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 14 966 708 16 962 716 18 958 728 20 955 740 22 947 748 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 "contact" 0 0 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 "contact" 0 0 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 "contact" 0 0 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 "contact" 0 0 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 4 "contact" 0 1 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 5 "contact" 0 1 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 "contact" 0 1 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 7 "contact" 0 5 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 8 "collision" 1 1 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 9 "collision" 1 1 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 10 "collision" 1 2 [IN] 65535 [OUT] 65535 [INTERACT] 11 "collision" 2 2 [IN] 3 4 [OUT] 3 4 [INTERACT] 12 "collision" 2 2 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 13 "collision" 3 3 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 14 "collision" 3 3 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 15 "collision" 3 3 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 16 "collision" 3 3 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 17 "collision" 3 3 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 18 "collision" 3 3 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 19 "collision" 3 4 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 20 "contact" 3 6 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 21 "collision" 4 4 [IN] 65535 [OUT] 65535 [INTERACT] 22 "collision" 4 5 [IN] 0 1 [OUT] 0 1 [INTERACT] 23 "contact" 4 5 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 24 "contact" 4 6 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 25 "contact" 4 7 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 26 "collision" 5 5 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 27 "collision" 5 5 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 28 "collision" 5 5 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 29 "collision" 5 6 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 30 "collision" 6 6 [IN] 0 3 [OUT] 0 3 [INTERACT] 31 "collision" 6 6 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 32 "contact" 6 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 33 "collision" 7 7 [IN] 3 [OUT] 3 [INTERACT] 34 "collision" 7 7 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 35 "collision" 7 7 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 36 "collision" 7 7 [IN] 65535 [OUT] 65535 [INTERACT] 37 "contact" 7 12 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 38 "collision" 8 8 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 39 "collision" 8 8 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 40 "collision" 8 8 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 41 "collision" 8 8 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 42 "collision" 8 9 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 43 "collision" 9 9 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 44 "collision" 9 9 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 45 "contact" 9 10 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 46 "contact" 9 11 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 47 "contact" 9 12 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 48 "collision" 10 10 [IN] 0 3 [OUT] 0 3 [INTERACT] 49 "collision" 10 10 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 50 "collision" 10 10 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 51 "contact" 10 13 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 52 "collision" 11 11 [IN] 0 1 [OUT] 0 1 [INTERACT] 53 "collision" 11 11 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 54 "collision" 11 11 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 55 "collision" 12 12 [IN] 0 3 [OUT] 0 3 [INTERACT] 56 "collision" 12 12 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 57 "collision" 12 12 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 58 "collision" 12 12 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 59 "collision" 12 13 [IN] 65535 [OUT] 65535 [INTERACT] 60 "collision" 13 13 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 61 "collision" 13 13 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 62 "collision" 13 14 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 63 "collision" 14 14 [IN] 0 3 [OUT] 0 3 [INTERACT] 64 "collision" 14 14 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 65 "collision" 14 14 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 66 "collision" 14 14 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 67 "contact" 14 17 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 68 "collision" 15 15 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 69 "collision" 15 15 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 70 "collision" 15 15 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 71 "collision" 15 16 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 72 "contact" 15 16 [IN] 0 3 [OUT] 0 3 [INTERACT] 73 "contact" 15 17 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 74 "collision" 16 16 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 75 "collision" 16 16 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 76 "collision" 16 16 [IN] 65535 [OUT] 65535 [INTERACT] 77 "contact" 16 17 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 78 "collision" 17 17 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 79 "contact" 17 18 [IN] 65535 [OUT] 65535 [INTERACT] 80 "collision" 18 18 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 81 "collision" 18 18 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 82 "collision" 18 18 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 83 "collision" 19 19 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 84 "collision" 19 19 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 85 "collision" 19 19 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 86 "collision" 19 19 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 87 "collision" 19 20 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 88 "collision" 20 20 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 89 "collision" 20 20 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 90 "collision" 20 21 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 91 "contact" 20 21 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 92 "contact" 20 21 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 93 "collision" 21 21 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 94 "collision" 21 21 [IN] 65535 [OUT] 65535 [INTERACT] 95 "collision" 21 22 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 96 "collision" 22 22 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 97 "collision" 22 22 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 98 "collision" 22 22 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 99 "collision" 22 22 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 100 "collision" 23 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 101 "collision" 23 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 102 "collision" 23 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 103 "contact" 23 23 [IN] 1 65535 [OUT] 1 65535 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 48,
"y": 216
},
{
"t": 1,
"x": 56,
"y": 228
},
{
"t": 2,
"x": 72,
"y": 267
},
{
"t": 3,
"x": 72,
"y": 318
},
{
"t": 4,
"x": 111,
"y": 353
},
{
"t": 5,
"x": 115,
"y": 361
},
{
"t": 6,
"x": 130,
"y": 376
},
{
"t": 8,
"x": 134,
"y": 353
},
{
"t": 9,
"x": 162,
"y": 341
},
{
"t": 10,
"x": 376,
"y": 431
},
{
"t": 11,
"x": 337,
"y": 408
},
{
"t": 12,
"x": 310,
"y": 396
},
{
"t": 14,
"x": 298,
"y": 392
},
{
"t": 15,
"x": 314,
"y": 396
},
{
"t": 16,
"x": 326,
"y": 392
},
{
"t": 17,
"x": 337,
"y": 392
},
{
"t": 19,
"x": 357,
"y": 392
},
{
"t": 20,
"x": 365,
"y": 396
},
{
"t": 21,
"x": 373,
"y": 400
},
{
"t": 23,
"x": 376,
"y": 408
}
],
"birth": 0,
"death": 24,
"type": "black and grey high-top sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 107,
"y": 427
},
{
"t": 3,
"x": 142,
"y": 427
},
{
"t": 4,
"x": 64,
"y": 435
},
{
"t": 5,
"x": 52,
"y": 435
},
{
"t": 8,
"x": 72,
"y": 427
},
{
"t": 9,
"x": 83,
"y": 412
},
{
"t": 11,
"x": 91,
"y": 423
},
{
"t": 13,
"x": 115,
"y": 423
},
{
"t": 14,
"x": 123,
"y": 419
},
{
"t": 22,
"x": 154,
"y": 408
},
{
"t": 23,
"x": 134,
"y": 419
}
],
"birth": 0,
"death": 24,
"type": "grey stuffed raccoon"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 330,
"y": 384
},
{
"t": 3,
"x": 337,
"y": 380
},
{
"t": 4,
"x": 349,
"y": 376
},
{
"t": 5,
"x": 337,
"y": 376
},
{
"t": 6,
"x": 345,
"y": 373
},
{
"t": 7,
"x": 380,
"y": 369
},
{
"t": 9,
"x": 384,
"y": 361
},
{
"t": 10,
"x": 345,
"y": 353
},
{
"t": 11,
"x": 357,
"y": 349
},
{
"t": 12,
"x": 384,
"y": 353
},
{
"t": 13,
"x": 392,
"y": 345
},
{
"t": 15,
"x": 396,
"y": 337
},
{
"t": 17,
"x": 263,
"y": 330
},
{
"t": 19,
"x": 275,
"y": 337
},
{
"t": 21,
"x": 294,
"y": 337
},
{
"t": 22,
"x": 291,
"y": 345
}
],
"birth": 0,
"death": 24,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 341,
"y": 228
},
{
"t": 1,
"x": 322,
"y": 240
},
{
"t": 2,
"x": 302,
"y": 263
},
{
"t": 3,
"x": 283,
"y": 298
},
{
"t": 4,
"x": 267,
"y": 322
},
{
"t": 5,
"x": 255,
"y": 392
},
{
"t": 6,
"x": 244,
"y": 400
},
{
"t": 7,
"x": 232,
"y": 427
},
{
"t": 8,
"x": 236,
"y": 419
},
{
"t": 9,
"x": 224,
"y": 431
},
{
"t": 10,
"x": 220,
"y": 451
},
{
"t": 11,
"x": 232,
"y": 466
},
{
"t": 12,
"x": 236,
"y": 478
},
{
"t": 13,
"x": 255,
"y": 474
},
{
"t": 14,
"x": 251,
"y": 498
},
{
"t": 15,
"x": 103,
"y": 505
},
{
"t": 16,
"x": 193,
"y": 541
},
{
"t": 17,
"x": 189,
"y": 556
},
{
"t": 18,
"x": 173,
"y": 572
},
{
"t": 19,
"x": 240,
"y": 568
},
{
"t": 20,
"x": 216,
"y": 591
},
{
"t": 21,
"x": 224,
"y": 587
},
{
"t": 22,
"x": 220,
"y": 595
},
{
"t": 23,
"x": 193,
"y": 607
}
],
"birth": 0,
"death": 24,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 478,
"y": 392
},
{
"t": 2,
"x": 466,
"y": 384
},
{
"t": 3,
"x": 458,
"y": 380
},
{
"t": 4,
"x": 517,
"y": 384
},
{
"t": 5,
"x": 490,
"y": 376
},
{
"t": 6,
"x": 466,
"y": 369
},
{
"t": 8,
"x": 470,
"y": 361
},
{
"t": 9,
"x": 517,
"y": 369
},
{
"t": 10,
"x": 494,
"y": 361
},
{
"t": 11,
"x": 474,
"y": 353
},
{
"t": 13,
"x": 521,
"y": 357
},
{
"t": 14,
"x": 513,
"y": 353
},
{
"t": 15,
"x": 478,
"y": 341
},
{
"t": 16,
"x": 490,
"y": 341
},
{
"t": 17,
"x": 482,
"y": 337
},
{
"t": 19,
"x": 513,
"y": 337
},
{
"t": 20,
"x": 505,
"y": 333
},
{
"t": 22,
"x": 486,
"y": 322
}
],
"birth": 0,
"death": 24,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 751,
"y": 689
},
{
"t": 1,
"x": 759,
"y": 701
},
{
"t": 2,
"x": 755,
"y": 708
},
{
"t": 3,
"x": 751,
"y": 716
},
{
"t": 4,
"x": 748,
"y": 724
},
{
"t": 5,
"x": 744,
"y": 732
},
{
"t": 7,
"x": 740,
"y": 748
},
{
"t": 9,
"x": 740,
"y": 763
},
{
"t": 11,
"x": 740,
"y": 779
},
{
"t": 13,
"x": 701,
"y": 779
},
{
"t": 15,
"x": 693,
"y": 791
},
{
"t": 16,
"x": 697,
"y": 798
},
{
"t": 18,
"x": 701,
"y": 814
},
{
"t": 20,
"x": 701,
"y": 826
},
{
"t": 21,
"x": 669,
"y": 818
},
{
"t": 23,
"x": 662,
"y": 826
}
],
"birth": 0,
"death": 24,
"type": "metallic copper leather ballet flat"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 798,
"y": 482
},
{
"t": 1,
"x": 791,
"y": 486
},
{
"t": 3,
"x": 783,
"y": 498
},
{
"t": 5,
"x": 779,
"y": 509
},
{
"t": 7,
"x": 779,
"y": 521
},
{
"t": 10,
"x": 775,
"y": 533
},
{
"t": 12,
"x": 767,
"y": 541
},
{
"t": 14,
"x": 763,
"y": 548
},
{
"t": 16,
"x": 755,
"y": 552
},
{
"t": 18,
"x": 767,
"y": 556
},
{
"t": 20,
"x": 755,
"y": 564
},
{
"t": 22,
"x": 751,
"y": 572
}
],
"birth": 0,
"death": 24,
"type": "white ceramic beaded mug"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 884,
"y": 314
},
{
"t": 1,
"x": 732,
"y": 310
},
{
"t": 3,
"x": 861,
"y": 314
},
{
"t": 5,
"x": 869,
"y": 322
},
{
"t": 8,
"x": 861,
"y": 326
},
{
"t": 9,
"x": 849,
"y": 322
},
{
"t": 10,
"x": 857,
"y": 326
},
{
"t": 12,
"x": 845,
"y": 326
},
{
"t": 15,
"x": 833,
"y": 326
},
{
"t": 16,
"x": 818,
"y": 322
},
{
"t": 17,
"x": 791,
"y": 318
},
{
"t": 19,
"x": 783,
"y": 314
},
{
"t": 20,
"x": 841,
"y": 322
},
{
"t": 21,
"x": 826,
"y": 318
},
{
"t": 23,
"x": 814,
"y": 314
}
],
"birth": 0,
"death": 24,
"type": "black cardboard box of pads"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 990,
"y": 505
},
{
"t": 3,
"x": 970,
"y": 505
},
{
"t": 4,
"x": 986,
"y": 513
},
{
"t": 6,
"x": 966,
"y": 509
},
{
"t": 7,
"x": 982,
"y": 517
},
{
"t": 8,
"x": 970,
"y": 517
},
{
"t": 9,
"x": 978,
"y": 525
},
{
"t": 10,
"x": 966,
"y": 521
},
{
"t": 11,
"x": 974,
"y": 529
},
{
"t": 12,
"x": 962,
"y": 525
},
{
"t": 15,
"x": 955,
"y": 533
},
{
"t": 19,
"x": 943,
"y": 537
},
{
"t": 21,
"x": 951,
"y": 541
}
],
"birth": 0,
"death": 24,
"type": "colorful wooden vehicle puzzle"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 990,
"y": 642
},
{
"t": 1,
"x": 990,
"y": 630
},
{
"t": 3,
"x": 986,
"y": 654
},
{
"t": 5,
"x": 982,
"y": 669
},
{
"t": 6,
"x": 982,
"y": 658
},
{
"t": 8,
"x": 978,
"y": 677
},
{
"t": 10,
"x": 974,
"y": 689
},
{
"t": 12,
"x": 970,
"y": 701
},
{
"t": 14,
"x": 966,
"y": 708
},
{
"t": 16,
"x": 962,
"y": 716
},
{
"t": 18,
"x": 958,
"y": 728
},
{
"t": 20,
"x": 955,
"y": 740
},
{
"t": 22,
"x": 947,
"y": 748
}
],
"birth": 0,
"death": 24,
"type": "brown metallic can of herring fillets"
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 1,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 2,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 4,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 1,
"type": "contact"
},
{
"id": 5,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 1,
"type": "contact"
},
{
"id": 6,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 1,
"type": "contact"
},
{
"id": 7,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 5,
"type": "contact"
},
{
"id": 8,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 1,
"ends_at": 1,
"type": "collision"
},
{
"id": 9,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 1,
"ends_at": 1,
"type": "collision"
},
{
"id": 10,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 1,
"ends_at": 2,
"type": "collision"
},
{
"id": 11,
"inputs": [
3,
4
],
"outputs": [
3,
4
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 12,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 13,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 14,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 15,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 16,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 17,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 18,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 19,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 3,
"ends_at": 4,
"type": "collision"
},
{
"id": 20,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 3,
"ends_at": 6,
"type": "contact"
},
{
"id": 21,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 22,
"inputs": [
0,
1
],
"outputs": [
0,
1
],
"begins_at": 4,
"ends_at": 5,
"type": "collision"
},
{
"id": 23,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 4,
"ends_at": 5,
"type": "contact"
},
{
"id": 24,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 4,
"ends_at": 6,
"type": "contact"
},
{
"id": 25,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 4,
"ends_at": 7,
"type": "contact"
},
{
"id": 26,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 27,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 28,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 29,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 5,
"ends_at": 6,
"type": "collision"
},
{
"id": 30,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 31,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 32,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 6,
"ends_at": 23,
"type": "contact"
},
{
"id": 33,
"inputs": [
3
],
"outputs": [
3
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 34,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 35,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 36,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 37,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 7,
"ends_at": 12,
"type": "contact"
},
{
"id": 38,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 39,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 40,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 41,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 8,
"ends_at": 8,
"type": "collision"
},
{
"id": 42,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 8,
"ends_at": 9,
"type": "collision"
},
{
"id": 43,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 44,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 45,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 9,
"ends_at": 10,
"type": "contact"
},
{
"id": 46,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 9,
"ends_at": 11,
"type": "contact"
},
{
"id": 47,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 9,
"ends_at": 12,
"type": "contact"
},
{
"id": 48,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 49,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 50,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 51,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 10,
"ends_at": 13,
"type": "contact"
},
{
"id": 52,
"inputs": [
0,
1
],
"outputs": [
0,
1
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 53,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 54,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 55,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 56,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 57,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 58,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 59,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 12,
"ends_at": 13,
"type": "collision"
},
{
"id": 60,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 61,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 62,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 13,
"ends_at": 14,
"type": "collision"
},
{
"id": 63,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 64,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 65,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 66,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 67,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 14,
"ends_at": 17,
"type": "contact"
},
{
"id": 68,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 69,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 70,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 71,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 15,
"ends_at": 16,
"type": "collision"
},
{
"id": 72,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 15,
"ends_at": 16,
"type": "contact"
},
{
"id": 73,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 15,
"ends_at": 17,
"type": "contact"
},
{
"id": 74,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 75,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 76,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 77,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 16,
"ends_at": 17,
"type": "contact"
},
{
"id": 78,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 79,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 17,
"ends_at": 18,
"type": "contact"
},
{
"id": 80,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 81,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 82,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 83,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 84,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 85,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 86,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 19,
"ends_at": 19,
"type": "collision"
},
{
"id": 87,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 19,
"ends_at": 20,
"type": "collision"
},
{
"id": 88,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 89,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 90,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 20,
"ends_at": 21,
"type": "collision"
},
{
"id": 91,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 20,
"ends_at": 21,
"type": "contact"
},
{
"id": 92,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 20,
"ends_at": 21,
"type": "contact"
},
{
"id": 93,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 94,
"inputs": [
65535
],
"outputs": [
65535
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 95,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 21,
"ends_at": 22,
"type": "collision"
},
{
"id": 96,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 97,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 98,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 99,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 100,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
},
{
"id": 101,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
},
{
"id": 102,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
},
{
"id": 103,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "contact"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 1.0,
"avg_image_position_segmentation_acc_small": 1.0,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 1.0,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": null,
"num_matches": 10,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.6485260770975055,
"avg_interaction_input_object_jaccard": 0.28571428571428564,
"avg_interaction_output_object_jaccard": 0.28571428571428564,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 21,
"num_unmatched_pred_interactions": 83,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 16,
"false_positives": 88,
"false_negatives": 0
},
"0.5": {
"true_positives": 12,
"false_positives": 92,
"false_negatives": 0
},
"0.75": {
"true_positives": 12,
"false_positives": 92,
"false_negatives": 0
},
"1.0": {
"true_positives": 11,
"false_positives": 93,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.15384615384615385,
"0.5": 0.11538461538461539,
"0.75": 0.11538461538461539,
"1.0": 0.10576923076923077
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.2666666666666667,
"0.5": 0.20689655172413793,
"0.75": 0.20689655172413793,
"1.0": 0.19130434782608693
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 18,
"false_positives": 86,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 104,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 104,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 104,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.17307692307692307,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.29508196721311475,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 18,
"false_positives": 86,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 104,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 104,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 104,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.17307692307692307,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.29508196721311475,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
}Prompt
Growing GT object-track prefill
At prefix step t, B3 saw frames 0..t and an assistant prefill containing GT object tracks only through t. The prefills are deterministically reconstructed with the exact oracle helper; only the final full-clip generation was persisted by inference.
Every persisted/reconstructed prefill step
[
{
"frame_index": 0,
"frames_visible": "0..0",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 1 [PX] 0 48 216 [OBJ] 1 \"grey stuffed raccoon\" 0 1 [PX] 0 107 427 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 1 [PX] 0 330 384 [OBJ] 3 \"dark grey metallic cake pan set\" 0 1 [PX] 0 341 228 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 1 [PX] 0 478 392 [OBJ] 5 \"metallic copper leather ballet flat\" 0 1 [PX] 0 751 689 [OBJ] 6 \"white ceramic beaded mug\" 0 1 [PX] 0 798 482 [OBJ] 7 \"black cardboard box of pads\" 0 1 [PX] 0 884 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 1 [PX] 0 990 505 [OBJ] 9 \"brown metallic can of herring fillets\" 0 1 [PX] 0 990 642 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 1,
"frames_visible": "0..1",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 2 [PX] 0 48 216 1 56 228 [OBJ] 1 \"grey stuffed raccoon\" 0 2 [PX] 0 107 427 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 2 [PX] 0 330 384 [OBJ] 3 \"dark grey metallic cake pan set\" 0 2 [PX] 0 341 228 1 322 240 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 2 [PX] 0 478 392 [OBJ] 5 \"metallic copper leather ballet flat\" 0 2 [PX] 0 751 689 1 759 701 [OBJ] 6 \"white ceramic beaded mug\" 0 2 [PX] 0 798 482 1 791 486 [OBJ] 7 \"black cardboard box of pads\" 0 2 [PX] 0 884 314 1 732 310 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 2 [PX] 0 990 505 [OBJ] 9 \"brown metallic can of herring fillets\" 0 2 [PX] 0 990 642 1 990 630 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 2,
"frames_visible": "0..2",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 3 [PX] 0 48 216 1 56 228 2 72 267 [OBJ] 1 \"grey stuffed raccoon\" 0 3 [PX] 0 107 427 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 3 [PX] 0 330 384 [OBJ] 3 \"dark grey metallic cake pan set\" 0 3 [PX] 0 341 228 1 322 240 2 302 263 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 3 [PX] 0 478 392 2 466 384 [OBJ] 5 \"metallic copper leather ballet flat\" 0 3 [PX] 0 751 689 1 759 701 2 755 708 [OBJ] 6 \"white ceramic beaded mug\" 0 3 [PX] 0 798 482 1 791 486 [OBJ] 7 \"black cardboard box of pads\" 0 3 [PX] 0 884 314 1 732 310 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 3 [PX] 0 990 505 [OBJ] 9 \"brown metallic can of herring fillets\" 0 3 [PX] 0 990 642 1 990 630 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 3,
"frames_visible": "0..3",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 4 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 [OBJ] 1 \"grey stuffed raccoon\" 0 4 [PX] 0 107 427 3 142 427 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 4 [PX] 0 330 384 3 337 380 [OBJ] 3 \"dark grey metallic cake pan set\" 0 4 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 4 [PX] 0 478 392 2 466 384 3 458 380 [OBJ] 5 \"metallic copper leather ballet flat\" 0 4 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 [OBJ] 6 \"white ceramic beaded mug\" 0 4 [PX] 0 798 482 1 791 486 3 783 498 [OBJ] 7 \"black cardboard box of pads\" 0 4 [PX] 0 884 314 1 732 310 3 861 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 4 [PX] 0 990 505 3 970 505 [OBJ] 9 \"brown metallic can of herring fillets\" 0 4 [PX] 0 990 642 1 990 630 3 986 654 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 4,
"frames_visible": "0..4",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 5 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 [OBJ] 1 \"grey stuffed raccoon\" 0 5 [PX] 0 107 427 3 142 427 4 64 435 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 5 [PX] 0 330 384 3 337 380 4 349 376 [OBJ] 3 \"dark grey metallic cake pan set\" 0 5 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 5 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 [OBJ] 5 \"metallic copper leather ballet flat\" 0 5 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 [OBJ] 6 \"white ceramic beaded mug\" 0 5 [PX] 0 798 482 1 791 486 3 783 498 [OBJ] 7 \"black cardboard box of pads\" 0 5 [PX] 0 884 314 1 732 310 3 861 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 5 [PX] 0 990 505 3 970 505 4 986 513 [OBJ] 9 \"brown metallic can of herring fillets\" 0 5 [PX] 0 990 642 1 990 630 3 986 654 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 5,
"frames_visible": "0..5",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 6 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 [OBJ] 1 \"grey stuffed raccoon\" 0 6 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 6 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 [OBJ] 3 \"dark grey metallic cake pan set\" 0 6 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 6 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 [OBJ] 5 \"metallic copper leather ballet flat\" 0 6 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 [OBJ] 6 \"white ceramic beaded mug\" 0 6 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 [OBJ] 7 \"black cardboard box of pads\" 0 6 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 6 [PX] 0 990 505 3 970 505 4 986 513 [OBJ] 9 \"brown metallic can of herring fillets\" 0 6 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 6,
"frames_visible": "0..6",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 7 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 [OBJ] 1 \"grey stuffed raccoon\" 0 7 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 7 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 [OBJ] 3 \"dark grey metallic cake pan set\" 0 7 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 7 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 [OBJ] 5 \"metallic copper leather ballet flat\" 0 7 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 [OBJ] 6 \"white ceramic beaded mug\" 0 7 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 [OBJ] 7 \"black cardboard box of pads\" 0 7 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 7 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 [OBJ] 9 \"brown metallic can of herring fillets\" 0 7 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 7,
"frames_visible": "0..7",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 8 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 [OBJ] 1 \"grey stuffed raccoon\" 0 8 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 8 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 [OBJ] 3 \"dark grey metallic cake pan set\" 0 8 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 8 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 [OBJ] 5 \"metallic copper leather ballet flat\" 0 8 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 [OBJ] 6 \"white ceramic beaded mug\" 0 8 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 [OBJ] 7 \"black cardboard box of pads\" 0 8 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 8 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 [OBJ] 9 \"brown metallic can of herring fillets\" 0 8 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 8,
"frames_visible": "0..8",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 9 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 [OBJ] 1 \"grey stuffed raccoon\" 0 9 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 9 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 [OBJ] 3 \"dark grey metallic cake pan set\" 0 9 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 9 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 [OBJ] 5 \"metallic copper leather ballet flat\" 0 9 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 [OBJ] 6 \"white ceramic beaded mug\" 0 9 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 [OBJ] 7 \"black cardboard box of pads\" 0 9 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 9 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 [OBJ] 9 \"brown metallic can of herring fillets\" 0 9 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 9,
"frames_visible": "0..9",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 10 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 [OBJ] 1 \"grey stuffed raccoon\" 0 10 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 10 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 [OBJ] 3 \"dark grey metallic cake pan set\" 0 10 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 10 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 [OBJ] 5 \"metallic copper leather ballet flat\" 0 10 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 [OBJ] 6 \"white ceramic beaded mug\" 0 10 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 [OBJ] 7 \"black cardboard box of pads\" 0 10 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 10 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 [OBJ] 9 \"brown metallic can of herring fillets\" 0 10 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 10,
"frames_visible": "0..10",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 11 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 [OBJ] 1 \"grey stuffed raccoon\" 0 11 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 11 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 [OBJ] 3 \"dark grey metallic cake pan set\" 0 11 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 11 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 [OBJ] 5 \"metallic copper leather ballet flat\" 0 11 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 [OBJ] 6 \"white ceramic beaded mug\" 0 11 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 [OBJ] 7 \"black cardboard box of pads\" 0 11 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 11 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 [OBJ] 9 \"brown metallic can of herring fillets\" 0 11 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 11,
"frames_visible": "0..11",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 12 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 [OBJ] 1 \"grey stuffed raccoon\" 0 12 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 12 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 [OBJ] 3 \"dark grey metallic cake pan set\" 0 12 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 12 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 [OBJ] 5 \"metallic copper leather ballet flat\" 0 12 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 [OBJ] 6 \"white ceramic beaded mug\" 0 12 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 [OBJ] 7 \"black cardboard box of pads\" 0 12 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 12 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 [OBJ] 9 \"brown metallic can of herring fillets\" 0 12 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 12,
"frames_visible": "0..12",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 13 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 [OBJ] 1 \"grey stuffed raccoon\" 0 13 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 13 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 [OBJ] 3 \"dark grey metallic cake pan set\" 0 13 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 13 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 [OBJ] 5 \"metallic copper leather ballet flat\" 0 13 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 [OBJ] 6 \"white ceramic beaded mug\" 0 13 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 [OBJ] 7 \"black cardboard box of pads\" 0 13 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 13 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 [OBJ] 9 \"brown metallic can of herring fillets\" 0 13 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 13,
"frames_visible": "0..13",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 14 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 [OBJ] 1 \"grey stuffed raccoon\" 0 14 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 14 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 [OBJ] 3 \"dark grey metallic cake pan set\" 0 14 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 14 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 [OBJ] 5 \"metallic copper leather ballet flat\" 0 14 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 [OBJ] 6 \"white ceramic beaded mug\" 0 14 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 [OBJ] 7 \"black cardboard box of pads\" 0 14 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 14 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 [OBJ] 9 \"brown metallic can of herring fillets\" 0 14 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 14,
"frames_visible": "0..14",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 15 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 14 298 392 [OBJ] 1 \"grey stuffed raccoon\" 0 15 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 14 123 419 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 15 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 [OBJ] 3 \"dark grey metallic cake pan set\" 0 15 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 14 251 498 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 15 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 14 513 353 [OBJ] 5 \"metallic copper leather ballet flat\" 0 15 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 [OBJ] 6 \"white ceramic beaded mug\" 0 15 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 14 763 548 [OBJ] 7 \"black cardboard box of pads\" 0 15 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 15 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 [OBJ] 9 \"brown metallic can of herring fillets\" 0 15 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 14 966 708 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 15,
"frames_visible": "0..15",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 16 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 14 298 392 15 314 396 [OBJ] 1 \"grey stuffed raccoon\" 0 16 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 14 123 419 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 16 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 15 396 337 [OBJ] 3 \"dark grey metallic cake pan set\" 0 16 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 14 251 498 15 103 505 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 16 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 14 513 353 15 478 341 [OBJ] 5 \"metallic copper leather ballet flat\" 0 16 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 15 693 791 [OBJ] 6 \"white ceramic beaded mug\" 0 16 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 14 763 548 [OBJ] 7 \"black cardboard box of pads\" 0 16 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 15 833 326 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 16 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 15 955 533 [OBJ] 9 \"brown metallic can of herring fillets\" 0 16 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 14 966 708 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 16,
"frames_visible": "0..16",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 17 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 14 298 392 15 314 396 16 326 392 [OBJ] 1 \"grey stuffed raccoon\" 0 17 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 14 123 419 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 17 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 15 396 337 [OBJ] 3 \"dark grey metallic cake pan set\" 0 17 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 14 251 498 15 103 505 16 193 541 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 17 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 14 513 353 15 478 341 16 490 341 [OBJ] 5 \"metallic copper leather ballet flat\" 0 17 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 15 693 791 16 697 798 [OBJ] 6 \"white ceramic beaded mug\" 0 17 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 14 763 548 16 755 552 [OBJ] 7 \"black cardboard box of pads\" 0 17 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 15 833 326 16 818 322 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 17 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 15 955 533 [OBJ] 9 \"brown metallic can of herring fillets\" 0 17 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 14 966 708 16 962 716 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 17,
"frames_visible": "0..17",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 18 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 14 298 392 15 314 396 16 326 392 17 337 392 [OBJ] 1 \"grey stuffed raccoon\" 0 18 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 14 123 419 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 18 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 15 396 337 17 263 330 [OBJ] 3 \"dark grey metallic cake pan set\" 0 18 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 14 251 498 15 103 505 16 193 541 17 189 556 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 18 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 14 513 353 15 478 341 16 490 341 17 482 337 [OBJ] 5 \"metallic copper leather ballet flat\" 0 18 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 15 693 791 16 697 798 [OBJ] 6 \"white ceramic beaded mug\" 0 18 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 14 763 548 16 755 552 [OBJ] 7 \"black cardboard box of pads\" 0 18 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 15 833 326 16 818 322 17 791 318 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 18 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 15 955 533 [OBJ] 9 \"brown metallic can of herring fillets\" 0 18 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 14 966 708 16 962 716 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 18,
"frames_visible": "0..18",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 19 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 14 298 392 15 314 396 16 326 392 17 337 392 [OBJ] 1 \"grey stuffed raccoon\" 0 19 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 14 123 419 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 19 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 15 396 337 17 263 330 [OBJ] 3 \"dark grey metallic cake pan set\" 0 19 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 14 251 498 15 103 505 16 193 541 17 189 556 18 173 572 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 19 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 14 513 353 15 478 341 16 490 341 17 482 337 [OBJ] 5 \"metallic copper leather ballet flat\" 0 19 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 15 693 791 16 697 798 18 701 814 [OBJ] 6 \"white ceramic beaded mug\" 0 19 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 14 763 548 16 755 552 18 767 556 [OBJ] 7 \"black cardboard box of pads\" 0 19 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 15 833 326 16 818 322 17 791 318 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 19 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 15 955 533 [OBJ] 9 \"brown metallic can of herring fillets\" 0 19 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 14 966 708 16 962 716 18 958 728 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 19,
"frames_visible": "0..19",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 20 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 14 298 392 15 314 396 16 326 392 17 337 392 19 357 392 [OBJ] 1 \"grey stuffed raccoon\" 0 20 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 14 123 419 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 20 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 15 396 337 17 263 330 19 275 337 [OBJ] 3 \"dark grey metallic cake pan set\" 0 20 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 14 251 498 15 103 505 16 193 541 17 189 556 18 173 572 19 240 568 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 20 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 14 513 353 15 478 341 16 490 341 17 482 337 19 513 337 [OBJ] 5 \"metallic copper leather ballet flat\" 0 20 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 15 693 791 16 697 798 18 701 814 [OBJ] 6 \"white ceramic beaded mug\" 0 20 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 14 763 548 16 755 552 18 767 556 [OBJ] 7 \"black cardboard box of pads\" 0 20 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 15 833 326 16 818 322 17 791 318 19 783 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 20 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 15 955 533 19 943 537 [OBJ] 9 \"brown metallic can of herring fillets\" 0 20 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 14 966 708 16 962 716 18 958 728 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 20,
"frames_visible": "0..20",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 21 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 14 298 392 15 314 396 16 326 392 17 337 392 19 357 392 20 365 396 [OBJ] 1 \"grey stuffed raccoon\" 0 21 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 14 123 419 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 21 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 15 396 337 17 263 330 19 275 337 [OBJ] 3 \"dark grey metallic cake pan set\" 0 21 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 14 251 498 15 103 505 16 193 541 17 189 556 18 173 572 19 240 568 20 216 591 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 21 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 14 513 353 15 478 341 16 490 341 17 482 337 19 513 337 20 505 333 [OBJ] 5 \"metallic copper leather ballet flat\" 0 21 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 15 693 791 16 697 798 18 701 814 20 701 826 [OBJ] 6 \"white ceramic beaded mug\" 0 21 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 14 763 548 16 755 552 18 767 556 20 755 564 [OBJ] 7 \"black cardboard box of pads\" 0 21 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 15 833 326 16 818 322 17 791 318 19 783 314 20 841 322 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 21 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 15 955 533 19 943 537 [OBJ] 9 \"brown metallic can of herring fillets\" 0 21 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 14 966 708 16 962 716 18 958 728 20 955 740 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 21,
"frames_visible": "0..21",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 22 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 14 298 392 15 314 396 16 326 392 17 337 392 19 357 392 20 365 396 21 373 400 [OBJ] 1 \"grey stuffed raccoon\" 0 22 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 14 123 419 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 22 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 15 396 337 17 263 330 19 275 337 21 294 337 [OBJ] 3 \"dark grey metallic cake pan set\" 0 22 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 14 251 498 15 103 505 16 193 541 17 189 556 18 173 572 19 240 568 20 216 591 21 224 587 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 22 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 14 513 353 15 478 341 16 490 341 17 482 337 19 513 337 20 505 333 [OBJ] 5 \"metallic copper leather ballet flat\" 0 22 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 15 693 791 16 697 798 18 701 814 20 701 826 21 669 818 [OBJ] 6 \"white ceramic beaded mug\" 0 22 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 14 763 548 16 755 552 18 767 556 20 755 564 [OBJ] 7 \"black cardboard box of pads\" 0 22 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 15 833 326 16 818 322 17 791 318 19 783 314 20 841 322 21 826 318 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 22 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 15 955 533 19 943 537 21 951 541 [OBJ] 9 \"brown metallic can of herring fillets\" 0 22 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 14 966 708 16 962 716 18 958 728 20 955 740 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 22,
"frames_visible": "0..22",
"provenance": "exact deterministic reconstruction; intermediate generation was not persisted",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 23 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 14 298 392 15 314 396 16 326 392 17 337 392 19 357 392 20 365 396 21 373 400 [OBJ] 1 \"grey stuffed raccoon\" 0 23 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 14 123 419 22 154 408 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 23 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 15 396 337 17 263 330 19 275 337 21 294 337 22 291 345 [OBJ] 3 \"dark grey metallic cake pan set\" 0 23 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 14 251 498 15 103 505 16 193 541 17 189 556 18 173 572 19 240 568 20 216 591 21 224 587 22 220 595 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 23 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 14 513 353 15 478 341 16 490 341 17 482 337 19 513 337 20 505 333 22 486 322 [OBJ] 5 \"metallic copper leather ballet flat\" 0 23 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 15 693 791 16 697 798 18 701 814 20 701 826 21 669 818 [OBJ] 6 \"white ceramic beaded mug\" 0 23 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 14 763 548 16 755 552 18 767 556 20 755 564 22 751 572 [OBJ] 7 \"black cardboard box of pads\" 0 23 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 15 833 326 16 818 322 17 791 318 19 783 314 20 841 322 21 826 318 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 23 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 15 955 533 19 943 537 21 951 541 [OBJ] 9 \"brown metallic can of herring fillets\" 0 23 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 14 966 708 16 962 716 18 958 728 20 955 740 22 947 748 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": null,
"model_output_at_step": null,
"intermediate_prediction_persisted": false
},
{
"frame_index": 23,
"frames_visible": "0..23",
"provenance": "exact persisted final-step prefill and generation",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 24 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 14 298 392 15 314 396 16 326 392 17 337 392 19 357 392 20 365 396 21 373 400 23 376 408 [OBJ] 1 \"grey stuffed raccoon\" 0 24 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 14 123 419 22 154 408 23 134 419 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 24 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 15 396 337 17 263 330 19 275 337 21 294 337 22 291 345 [OBJ] 3 \"dark grey metallic cake pan set\" 0 24 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 14 251 498 15 103 505 16 193 541 17 189 556 18 173 572 19 240 568 20 216 591 21 224 587 22 220 595 23 193 607 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 24 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 14 513 353 15 478 341 16 490 341 17 482 337 19 513 337 20 505 333 22 486 322 [OBJ] 5 \"metallic copper leather ballet flat\" 0 24 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 15 693 791 16 697 798 18 701 814 20 701 826 21 669 818 23 662 826 [OBJ] 6 \"white ceramic beaded mug\" 0 24 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 14 763 548 16 755 552 18 767 556 20 755 564 22 751 572 [OBJ] 7 \"black cardboard box of pads\" 0 24 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 15 833 326 16 818 322 17 791 318 19 783 314 20 841 322 21 826 318 23 814 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 24 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 15 955 533 19 943 537 21 951 541 [OBJ] 9 \"brown metallic can of herring fillets\" 0 24 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 14 966 708 16 962 716 18 958 728 20 955 740 22 947 748 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 0 \"contact\" 0 8 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 7 \"contact\" 0 20 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 8 \"contact\" 0 20 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 9 \"contact\" 0 20 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 10 \"contact\" 0 20 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 11 \"contact\" 0 20 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 12 \"contact\" 0 20 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 13 \"contact\" 0 20 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 1 \"collision\" 10 10 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"collision\" 13 13 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"collision\" 16 16 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"collision\" 18 18 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 \"collision\" 21 21 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 6 \"collision\" 23 23 [IN] 2 65535 [OUT] 2 65535 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 24 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 14 298 392 15 314 396 16 326 392 17 337 392 19 357 392 20 365 396 21 373 400 23 376 408 [OBJ] 1 \"grey stuffed raccoon\" 0 24 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 14 123 419 22 154 408 23 134 419 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 24 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 15 396 337 17 263 330 19 275 337 21 294 337 22 291 345 [OBJ] 3 \"dark grey metallic cake pan set\" 0 24 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 14 251 498 15 103 505 16 193 541 17 189 556 18 173 572 19 240 568 20 216 591 21 224 587 22 220 595 23 193 607 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 24 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 14 513 353 15 478 341 16 490 341 17 482 337 19 513 337 20 505 333 22 486 322 [OBJ] 5 \"metallic copper leather ballet flat\" 0 24 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 15 693 791 16 697 798 18 701 814 20 701 826 21 669 818 23 662 826 [OBJ] 6 \"white ceramic beaded mug\" 0 24 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 14 763 548 16 755 552 18 767 556 20 755 564 22 751 572 [OBJ] 7 \"black cardboard box of pads\" 0 24 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 15 833 326 16 818 322 17 791 318 19 783 314 20 841 322 21 826 318 23 814 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 24 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 15 955 533 19 943 537 21 951 541 [OBJ] 9 \"brown metallic can of herring fillets\" 0 24 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 14 966 708 16 962 716 18 958 728 20 955 740 22 947 748 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 8 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 7 \"contact\" 0 20 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 8 \"contact\" 0 20 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 9 \"contact\" 0 20 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 10 \"contact\" 0 20 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 11 \"contact\" 0 20 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 12 \"contact\" 0 20 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 13 \"contact\" 0 20 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 1 \"collision\" 10 10 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"collision\" 13 13 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"collision\" 16 16 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"collision\" 18 18 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 \"collision\" 21 21 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 6 \"collision\" 23 23 [IN] 2 65535 [OUT] 2 65535 [INTERACTIONS-END] [SCENE-END]",
"intermediate_prediction_persisted": true
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "black and grey high-top sneaker" 0 24 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 14 298 392 15 314 396 16 326 392 17 337 392 19 357 392 20 365 396 21 373 400 23 376 408 [OBJ] 1 "grey stuffed raccoon" 0 24 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 14 123 419 22 154 408 23 134 419 [OBJ] 2 "white plastic dietary supplement bottle" 0 24 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 15 396 337 17 263 330 19 275 337 21 294 337 22 291 345 [OBJ] 3 "dark grey metallic cake pan set" 0 24 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 14 251 498 15 103 505 16 193 541 17 189 556 18 173 572 19 240 568 20 216 591 21 224 587 22 220 595 23 193 607 [OBJ] 4 "plastic Nintendo 3DS game case" 0 24 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 14 513 353 15 478 341 16 490 341 17 482 337 19 513 337 20 505 333 22 486 322 [OBJ] 5 "metallic copper leather ballet flat" 0 24 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 15 693 791 16 697 798 18 701 814 20 701 826 21 669 818 23 662 826 [OBJ] 6 "white ceramic beaded mug" 0 24 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 14 763 548 16 755 552 18 767 556 20 755 564 22 751 572 [OBJ] 7 "black cardboard box of pads" 0 24 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 15 833 326 16 818 322 17 791 318 19 783 314 20 841 322 21 826 318 23 814 314 [OBJ] 8 "colorful wooden vehicle puzzle" 0 24 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 15 955 533 19 943 537 21 951 541 [OBJ] 9 "brown metallic can of herring fillets" 0 24 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 14 966 708 16 962 716 18 958 728 20 955 740 22 947 748 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 "contact" 0 8 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 7 "contact" 0 20 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 8 "contact" 0 20 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 9 "contact" 0 20 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 10 "contact" 0 20 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 11 "contact" 0 20 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 12 "contact" 0 20 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 13 "contact" 0 20 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 1 "collision" 10 10 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 "collision" 13 13 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 "collision" 16 16 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 "collision" 18 18 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 "collision" 21 21 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 6 "collision" 23 23 [IN] 2 65535 [OUT] 2 65535 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 48,
"y": 216
},
{
"t": 1,
"x": 56,
"y": 228
},
{
"t": 2,
"x": 72,
"y": 267
},
{
"t": 3,
"x": 72,
"y": 318
},
{
"t": 4,
"x": 111,
"y": 353
},
{
"t": 5,
"x": 115,
"y": 361
},
{
"t": 6,
"x": 130,
"y": 376
},
{
"t": 8,
"x": 134,
"y": 353
},
{
"t": 9,
"x": 162,
"y": 341
},
{
"t": 10,
"x": 376,
"y": 431
},
{
"t": 11,
"x": 337,
"y": 408
},
{
"t": 12,
"x": 310,
"y": 396
},
{
"t": 14,
"x": 298,
"y": 392
},
{
"t": 15,
"x": 314,
"y": 396
},
{
"t": 16,
"x": 326,
"y": 392
},
{
"t": 17,
"x": 337,
"y": 392
},
{
"t": 19,
"x": 357,
"y": 392
},
{
"t": 20,
"x": 365,
"y": 396
},
{
"t": 21,
"x": 373,
"y": 400
},
{
"t": 23,
"x": 376,
"y": 408
}
],
"birth": 0,
"death": 24,
"type": "black and grey high-top sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 107,
"y": 427
},
{
"t": 3,
"x": 142,
"y": 427
},
{
"t": 4,
"x": 64,
"y": 435
},
{
"t": 5,
"x": 52,
"y": 435
},
{
"t": 8,
"x": 72,
"y": 427
},
{
"t": 9,
"x": 83,
"y": 412
},
{
"t": 11,
"x": 91,
"y": 423
},
{
"t": 13,
"x": 115,
"y": 423
},
{
"t": 14,
"x": 123,
"y": 419
},
{
"t": 22,
"x": 154,
"y": 408
},
{
"t": 23,
"x": 134,
"y": 419
}
],
"birth": 0,
"death": 24,
"type": "grey stuffed raccoon"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 330,
"y": 384
},
{
"t": 3,
"x": 337,
"y": 380
},
{
"t": 4,
"x": 349,
"y": 376
},
{
"t": 5,
"x": 337,
"y": 376
},
{
"t": 6,
"x": 345,
"y": 373
},
{
"t": 7,
"x": 380,
"y": 369
},
{
"t": 9,
"x": 384,
"y": 361
},
{
"t": 10,
"x": 345,
"y": 353
},
{
"t": 11,
"x": 357,
"y": 349
},
{
"t": 12,
"x": 384,
"y": 353
},
{
"t": 13,
"x": 392,
"y": 345
},
{
"t": 15,
"x": 396,
"y": 337
},
{
"t": 17,
"x": 263,
"y": 330
},
{
"t": 19,
"x": 275,
"y": 337
},
{
"t": 21,
"x": 294,
"y": 337
},
{
"t": 22,
"x": 291,
"y": 345
}
],
"birth": 0,
"death": 24,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 341,
"y": 228
},
{
"t": 1,
"x": 322,
"y": 240
},
{
"t": 2,
"x": 302,
"y": 263
},
{
"t": 3,
"x": 283,
"y": 298
},
{
"t": 4,
"x": 267,
"y": 322
},
{
"t": 5,
"x": 255,
"y": 392
},
{
"t": 6,
"x": 244,
"y": 400
},
{
"t": 7,
"x": 232,
"y": 427
},
{
"t": 8,
"x": 236,
"y": 419
},
{
"t": 9,
"x": 224,
"y": 431
},
{
"t": 10,
"x": 220,
"y": 451
},
{
"t": 11,
"x": 232,
"y": 466
},
{
"t": 12,
"x": 236,
"y": 478
},
{
"t": 13,
"x": 255,
"y": 474
},
{
"t": 14,
"x": 251,
"y": 498
},
{
"t": 15,
"x": 103,
"y": 505
},
{
"t": 16,
"x": 193,
"y": 541
},
{
"t": 17,
"x": 189,
"y": 556
},
{
"t": 18,
"x": 173,
"y": 572
},
{
"t": 19,
"x": 240,
"y": 568
},
{
"t": 20,
"x": 216,
"y": 591
},
{
"t": 21,
"x": 224,
"y": 587
},
{
"t": 22,
"x": 220,
"y": 595
},
{
"t": 23,
"x": 193,
"y": 607
}
],
"birth": 0,
"death": 24,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 478,
"y": 392
},
{
"t": 2,
"x": 466,
"y": 384
},
{
"t": 3,
"x": 458,
"y": 380
},
{
"t": 4,
"x": 517,
"y": 384
},
{
"t": 5,
"x": 490,
"y": 376
},
{
"t": 6,
"x": 466,
"y": 369
},
{
"t": 8,
"x": 470,
"y": 361
},
{
"t": 9,
"x": 517,
"y": 369
},
{
"t": 10,
"x": 494,
"y": 361
},
{
"t": 11,
"x": 474,
"y": 353
},
{
"t": 13,
"x": 521,
"y": 357
},
{
"t": 14,
"x": 513,
"y": 353
},
{
"t": 15,
"x": 478,
"y": 341
},
{
"t": 16,
"x": 490,
"y": 341
},
{
"t": 17,
"x": 482,
"y": 337
},
{
"t": 19,
"x": 513,
"y": 337
},
{
"t": 20,
"x": 505,
"y": 333
},
{
"t": 22,
"x": 486,
"y": 322
}
],
"birth": 0,
"death": 24,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 751,
"y": 689
},
{
"t": 1,
"x": 759,
"y": 701
},
{
"t": 2,
"x": 755,
"y": 708
},
{
"t": 3,
"x": 751,
"y": 716
},
{
"t": 4,
"x": 748,
"y": 724
},
{
"t": 5,
"x": 744,
"y": 732
},
{
"t": 7,
"x": 740,
"y": 748
},
{
"t": 9,
"x": 740,
"y": 763
},
{
"t": 11,
"x": 740,
"y": 779
},
{
"t": 13,
"x": 701,
"y": 779
},
{
"t": 15,
"x": 693,
"y": 791
},
{
"t": 16,
"x": 697,
"y": 798
},
{
"t": 18,
"x": 701,
"y": 814
},
{
"t": 20,
"x": 701,
"y": 826
},
{
"t": 21,
"x": 669,
"y": 818
},
{
"t": 23,
"x": 662,
"y": 826
}
],
"birth": 0,
"death": 24,
"type": "metallic copper leather ballet flat"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 798,
"y": 482
},
{
"t": 1,
"x": 791,
"y": 486
},
{
"t": 3,
"x": 783,
"y": 498
},
{
"t": 5,
"x": 779,
"y": 509
},
{
"t": 7,
"x": 779,
"y": 521
},
{
"t": 10,
"x": 775,
"y": 533
},
{
"t": 12,
"x": 767,
"y": 541
},
{
"t": 14,
"x": 763,
"y": 548
},
{
"t": 16,
"x": 755,
"y": 552
},
{
"t": 18,
"x": 767,
"y": 556
},
{
"t": 20,
"x": 755,
"y": 564
},
{
"t": 22,
"x": 751,
"y": 572
}
],
"birth": 0,
"death": 24,
"type": "white ceramic beaded mug"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 884,
"y": 314
},
{
"t": 1,
"x": 732,
"y": 310
},
{
"t": 3,
"x": 861,
"y": 314
},
{
"t": 5,
"x": 869,
"y": 322
},
{
"t": 8,
"x": 861,
"y": 326
},
{
"t": 9,
"x": 849,
"y": 322
},
{
"t": 10,
"x": 857,
"y": 326
},
{
"t": 12,
"x": 845,
"y": 326
},
{
"t": 15,
"x": 833,
"y": 326
},
{
"t": 16,
"x": 818,
"y": 322
},
{
"t": 17,
"x": 791,
"y": 318
},
{
"t": 19,
"x": 783,
"y": 314
},
{
"t": 20,
"x": 841,
"y": 322
},
{
"t": 21,
"x": 826,
"y": 318
},
{
"t": 23,
"x": 814,
"y": 314
}
],
"birth": 0,
"death": 24,
"type": "black cardboard box of pads"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 990,
"y": 505
},
{
"t": 3,
"x": 970,
"y": 505
},
{
"t": 4,
"x": 986,
"y": 513
},
{
"t": 6,
"x": 966,
"y": 509
},
{
"t": 7,
"x": 982,
"y": 517
},
{
"t": 8,
"x": 970,
"y": 517
},
{
"t": 9,
"x": 978,
"y": 525
},
{
"t": 10,
"x": 966,
"y": 521
},
{
"t": 11,
"x": 974,
"y": 529
},
{
"t": 12,
"x": 962,
"y": 525
},
{
"t": 15,
"x": 955,
"y": 533
},
{
"t": 19,
"x": 943,
"y": 537
},
{
"t": 21,
"x": 951,
"y": 541
}
],
"birth": 0,
"death": 24,
"type": "colorful wooden vehicle puzzle"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 990,
"y": 642
},
{
"t": 1,
"x": 990,
"y": 630
},
{
"t": 3,
"x": 986,
"y": 654
},
{
"t": 5,
"x": 982,
"y": 669
},
{
"t": 6,
"x": 982,
"y": 658
},
{
"t": 8,
"x": 978,
"y": 677
},
{
"t": 10,
"x": 974,
"y": 689
},
{
"t": 12,
"x": 970,
"y": 701
},
{
"t": 14,
"x": 966,
"y": 708
},
{
"t": 16,
"x": 962,
"y": 716
},
{
"t": 18,
"x": 958,
"y": 728
},
{
"t": 20,
"x": 955,
"y": 740
},
{
"t": 22,
"x": 947,
"y": 748
}
],
"birth": 0,
"death": 24,
"type": "brown metallic can of herring fillets"
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 8,
"type": "contact"
},
{
"id": 7,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 20,
"type": "contact"
},
{
"id": 8,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 20,
"type": "contact"
},
{
"id": 9,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 20,
"type": "contact"
},
{
"id": 10,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 20,
"type": "contact"
},
{
"id": 11,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 20,
"type": "contact"
},
{
"id": 12,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 20,
"type": "contact"
},
{
"id": 13,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 20,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 3,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 16,
"ends_at": 16,
"type": "collision"
},
{
"id": 4,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 5,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 21,
"ends_at": 21,
"type": "collision"
},
{
"id": 6,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 1.0,
"avg_image_position_segmentation_acc_small": 1.0,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 1.0,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": null,
"num_matches": 10,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.42000835421888055,
"avg_interaction_input_object_jaccard": 0.6904761904761906,
"avg_interaction_output_object_jaccard": 0.6904761904761906,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 14,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 7,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 9,
"false_positives": 5,
"false_negatives": 7
},
"0.5": {
"true_positives": 8,
"false_positives": 6,
"false_negatives": 7
},
"0.75": {
"true_positives": 8,
"false_positives": 6,
"false_negatives": 7
},
"1.0": {
"true_positives": 1,
"false_positives": 13,
"false_negatives": 7
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.6428571428571429,
"0.5": 0.5714285714285714,
"0.75": 0.5714285714285714,
"1.0": 0.07142857142857142
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.5625,
"0.5": 0.5333333333333333,
"0.75": 0.5333333333333333,
"1.0": 0.125
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.6000000000000001,
"0.5": 0.5517241379310344,
"0.75": 0.5517241379310344,
"1.0": 0.09090909090909091
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 13,
"false_positives": 1,
"false_negatives": 7
},
"0.5": {
"true_positives": 8,
"false_positives": 6,
"false_negatives": 7
},
"0.75": {
"true_positives": 8,
"false_positives": 6,
"false_negatives": 7
},
"1.0": {
"true_positives": 8,
"false_positives": 6,
"false_negatives": 7
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.9285714285714286,
"0.5": 0.5714285714285714,
"0.75": 0.5714285714285714,
"1.0": 0.5714285714285714
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.65,
"0.5": 0.5333333333333333,
"0.75": 0.5333333333333333,
"1.0": 0.5333333333333333
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.7647058823529412,
"0.5": 0.5517241379310344,
"0.75": 0.5517241379310344,
"1.0": 0.5517241379310344
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 13,
"false_positives": 1,
"false_negatives": 7
},
"0.5": {
"true_positives": 8,
"false_positives": 6,
"false_negatives": 7
},
"0.75": {
"true_positives": 8,
"false_positives": 6,
"false_negatives": 7
},
"1.0": {
"true_positives": 8,
"false_positives": 6,
"false_negatives": 7
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.9285714285714286,
"0.5": 0.5714285714285714,
"0.75": 0.5714285714285714,
"1.0": 0.5714285714285714
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.65,
"0.5": 0.5333333333333333,
"0.75": 0.5333333333333333,
"1.0": 0.5333333333333333
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.7647058823529412,
"0.5": 0.5517241379310344,
"0.75": 0.5517241379310344,
"1.0": 0.5517241379310344
}
}
}Prompt
<video> Analyze the provided video and return ONLY a valid sentinel sequence in this format: [SCENE-START] [OBJS-START] [OBJ] id "type" birth death [PX] t px py ... [OBJ] ... [OBJS-END] [INTERACTIONS-START] [INTERACT] id "type" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ... [INTERACT] ... [INTERACTIONS-END] [SCENE-END] Constraints: - Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose). - Keep tags exactly as written: `[SCENE-START] [OBJS-START] [OBJ] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]` - Use quoted strings for `type` (double quotes). - `PX` uses repeated groups of 3 values in order: `t px py`. - `t` is the timestamp (frame number). - `px` and `py` are the pixel coordinates of the object in that frame, normalized to [0,1] relative to the frame dimensions, scaled by 1000 and rounded to the nearest integer. For example, `px` of 0.1234 would be represented as 123. - When an object is occluded or not visible in a frame, `PX` may use `t null null`. - `IN` and `OUT` contain whitespace-separated integer ids.
One full-clip GT object prefill
The E2E model saw all 24 frames once. Its assistant text was the exact GT object section through [INTERACTIONS-START], and the model generated only the interaction suffix shown here.
Every persisted/reconstructed prefill step
[
{
"frame_index": 23,
"frames_visible": "0..23",
"provenance": "exact persisted full-clip prefill and generation",
"prefill": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 24 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 14 298 392 15 314 396 16 326 392 17 337 392 19 357 392 20 365 396 21 373 400 23 376 408 [OBJ] 1 \"grey stuffed raccoon\" 0 24 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 14 123 419 22 154 408 23 134 419 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 24 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 15 396 337 17 263 330 19 275 337 21 294 337 22 291 345 [OBJ] 3 \"dark grey metallic cake pan set\" 0 24 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 14 251 498 15 103 505 16 193 541 17 189 556 18 173 572 19 240 568 20 216 591 21 224 587 22 220 595 23 193 607 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 24 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 14 513 353 15 478 341 16 490 341 17 482 337 19 513 337 20 505 333 22 486 322 [OBJ] 5 \"metallic copper leather ballet flat\" 0 24 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 15 693 791 16 697 798 18 701 814 20 701 826 21 669 818 23 662 826 [OBJ] 6 \"white ceramic beaded mug\" 0 24 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 14 763 548 16 755 552 18 767 556 20 755 564 22 751 572 [OBJ] 7 \"black cardboard box of pads\" 0 24 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 15 833 326 16 818 322 17 791 318 19 783 314 20 841 322 21 826 318 23 814 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 24 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 15 955 533 19 943 537 21 951 541 [OBJ] 9 \"brown metallic can of herring fillets\" 0 24 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 14 966 708 16 962 716 18 958 728 20 955 740 22 947 748 [OBJS-END] [INTERACTIONS-START]",
"generated_suffix": "[INTERACT] 7 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 9 \"contact\" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 13 \"contact\" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 14 \"contact\" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 15 \"contact\" 0 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 16 \"contact\" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 17 \"contact\" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 18 \"contact\" 0 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 5 \"collision\" 3 3 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"collision\" 4 4 [IN] 0 1 [OUT] 0 1 [INTERACT] 6 \"collision\" 6 6 [IN] 0 3 [OUT] 0 3 [INTERACT] 2 \"collision\" 7 7 [IN] 0 1 [OUT] 0 1 [INTERACT] 12 \"collision\" 7 7 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 0 \"collision\" 10 10 [IN] 0 1 [OUT] 0 1 [INTERACT] 8 \"collision\" 10 10 [IN] 2 3 [OUT] 2 3 [INTERACT] 10 \"collision\" 10 10 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 11 \"contact\" 11 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"collision\" 13 13 [IN] 0 3 [OUT] 0 3 [INTERACT] 4 \"contact\" 14 23 [IN] 0 3 [OUT] 0 3 [INTERACTIONS-END] [SCENE-END]",
"model_output_at_step": "[SCENE-START] [OBJS-START] [OBJ] 0 \"black and grey high-top sneaker\" 0 24 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 14 298 392 15 314 396 16 326 392 17 337 392 19 357 392 20 365 396 21 373 400 23 376 408 [OBJ] 1 \"grey stuffed raccoon\" 0 24 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 14 123 419 22 154 408 23 134 419 [OBJ] 2 \"white plastic dietary supplement bottle\" 0 24 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 15 396 337 17 263 330 19 275 337 21 294 337 22 291 345 [OBJ] 3 \"dark grey metallic cake pan set\" 0 24 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 14 251 498 15 103 505 16 193 541 17 189 556 18 173 572 19 240 568 20 216 591 21 224 587 22 220 595 23 193 607 [OBJ] 4 \"plastic Nintendo 3DS game case\" 0 24 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 14 513 353 15 478 341 16 490 341 17 482 337 19 513 337 20 505 333 22 486 322 [OBJ] 5 \"metallic copper leather ballet flat\" 0 24 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 15 693 791 16 697 798 18 701 814 20 701 826 21 669 818 23 662 826 [OBJ] 6 \"white ceramic beaded mug\" 0 24 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 14 763 548 16 755 552 18 767 556 20 755 564 22 751 572 [OBJ] 7 \"black cardboard box of pads\" 0 24 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 15 833 326 16 818 322 17 791 318 19 783 314 20 841 322 21 826 318 23 814 314 [OBJ] 8 \"colorful wooden vehicle puzzle\" 0 24 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 15 955 533 19 943 537 21 951 541 [OBJ] 9 \"brown metallic can of herring fillets\" 0 24 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 14 966 708 16 962 716 18 958 728 20 955 740 22 947 748 [OBJS-END] [INTERACTIONS-START] [INTERACT] 7 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 9 \"contact\" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 13 \"contact\" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 14 \"contact\" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 15 \"contact\" 0 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 16 \"contact\" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 17 \"contact\" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 18 \"contact\" 0 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 5 \"collision\" 3 3 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 \"collision\" 4 4 [IN] 0 1 [OUT] 0 1 [INTERACT] 6 \"collision\" 6 6 [IN] 0 3 [OUT] 0 3 [INTERACT] 2 \"collision\" 7 7 [IN] 0 1 [OUT] 0 1 [INTERACT] 12 \"collision\" 7 7 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 0 \"collision\" 10 10 [IN] 0 1 [OUT] 0 1 [INTERACT] 8 \"collision\" 10 10 [IN] 2 3 [OUT] 2 3 [INTERACT] 10 \"collision\" 10 10 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 11 \"contact\" 11 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"collision\" 13 13 [IN] 0 3 [OUT] 0 3 [INTERACT] 4 \"contact\" 14 23 [IN] 0 3 [OUT] 0 3 [INTERACTIONS-END] [SCENE-END]"
}
]Final prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "black and grey high-top sneaker" 0 24 [PX] 0 48 216 1 56 228 2 72 267 3 72 318 4 111 353 5 115 361 6 130 376 8 134 353 9 162 341 10 376 431 11 337 408 12 310 396 14 298 392 15 314 396 16 326 392 17 337 392 19 357 392 20 365 396 21 373 400 23 376 408 [OBJ] 1 "grey stuffed raccoon" 0 24 [PX] 0 107 427 3 142 427 4 64 435 5 52 435 8 72 427 9 83 412 11 91 423 13 115 423 14 123 419 22 154 408 23 134 419 [OBJ] 2 "white plastic dietary supplement bottle" 0 24 [PX] 0 330 384 3 337 380 4 349 376 5 337 376 6 345 373 7 380 369 9 384 361 10 345 353 11 357 349 12 384 353 13 392 345 15 396 337 17 263 330 19 275 337 21 294 337 22 291 345 [OBJ] 3 "dark grey metallic cake pan set" 0 24 [PX] 0 341 228 1 322 240 2 302 263 3 283 298 4 267 322 5 255 392 6 244 400 7 232 427 8 236 419 9 224 431 10 220 451 11 232 466 12 236 478 13 255 474 14 251 498 15 103 505 16 193 541 17 189 556 18 173 572 19 240 568 20 216 591 21 224 587 22 220 595 23 193 607 [OBJ] 4 "plastic Nintendo 3DS game case" 0 24 [PX] 0 478 392 2 466 384 3 458 380 4 517 384 5 490 376 6 466 369 8 470 361 9 517 369 10 494 361 11 474 353 13 521 357 14 513 353 15 478 341 16 490 341 17 482 337 19 513 337 20 505 333 22 486 322 [OBJ] 5 "metallic copper leather ballet flat" 0 24 [PX] 0 751 689 1 759 701 2 755 708 3 751 716 4 748 724 5 744 732 7 740 748 9 740 763 11 740 779 13 701 779 15 693 791 16 697 798 18 701 814 20 701 826 21 669 818 23 662 826 [OBJ] 6 "white ceramic beaded mug" 0 24 [PX] 0 798 482 1 791 486 3 783 498 5 779 509 7 779 521 10 775 533 12 767 541 14 763 548 16 755 552 18 767 556 20 755 564 22 751 572 [OBJ] 7 "black cardboard box of pads" 0 24 [PX] 0 884 314 1 732 310 3 861 314 5 869 322 8 861 326 9 849 322 10 857 326 12 845 326 15 833 326 16 818 322 17 791 318 19 783 314 20 841 322 21 826 318 23 814 314 [OBJ] 8 "colorful wooden vehicle puzzle" 0 24 [PX] 0 990 505 3 970 505 4 986 513 6 966 509 7 982 517 8 970 517 9 978 525 10 966 521 11 974 529 12 962 525 15 955 533 19 943 537 21 951 541 [OBJ] 9 "brown metallic can of herring fillets" 0 24 [PX] 0 990 642 1 990 630 3 986 654 5 982 669 6 982 658 8 978 677 10 974 689 12 970 701 14 966 708 16 962 716 18 958 728 20 955 740 22 947 748 [OBJS-END] [INTERACTIONS-START] [INTERACT] 7 "contact" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 9 "contact" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 13 "contact" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 14 "contact" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 15 "contact" 0 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 16 "contact" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 17 "contact" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 18 "contact" 0 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 5 "collision" 3 3 [IN] 0 3 [OUT] 0 3 [INTERACT] 1 "collision" 4 4 [IN] 0 1 [OUT] 0 1 [INTERACT] 6 "collision" 6 6 [IN] 0 3 [OUT] 0 3 [INTERACT] 2 "collision" 7 7 [IN] 0 1 [OUT] 0 1 [INTERACT] 12 "collision" 7 7 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 0 "collision" 10 10 [IN] 0 1 [OUT] 0 1 [INTERACT] 8 "collision" 10 10 [IN] 2 3 [OUT] 2 3 [INTERACT] 10 "collision" 10 10 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 11 "contact" 11 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 "collision" 13 13 [IN] 0 3 [OUT] 0 3 [INTERACT] 4 "contact" 14 23 [IN] 0 3 [OUT] 0 3 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"image_positions": [
{
"t": 0,
"x": 48,
"y": 216
},
{
"t": 1,
"x": 56,
"y": 228
},
{
"t": 2,
"x": 72,
"y": 267
},
{
"t": 3,
"x": 72,
"y": 318
},
{
"t": 4,
"x": 111,
"y": 353
},
{
"t": 5,
"x": 115,
"y": 361
},
{
"t": 6,
"x": 130,
"y": 376
},
{
"t": 8,
"x": 134,
"y": 353
},
{
"t": 9,
"x": 162,
"y": 341
},
{
"t": 10,
"x": 376,
"y": 431
},
{
"t": 11,
"x": 337,
"y": 408
},
{
"t": 12,
"x": 310,
"y": 396
},
{
"t": 14,
"x": 298,
"y": 392
},
{
"t": 15,
"x": 314,
"y": 396
},
{
"t": 16,
"x": 326,
"y": 392
},
{
"t": 17,
"x": 337,
"y": 392
},
{
"t": 19,
"x": 357,
"y": 392
},
{
"t": 20,
"x": 365,
"y": 396
},
{
"t": 21,
"x": 373,
"y": 400
},
{
"t": 23,
"x": 376,
"y": 408
}
],
"birth": 0,
"death": 24,
"type": "black and grey high-top sneaker"
},
{
"id": 1,
"image_positions": [
{
"t": 0,
"x": 107,
"y": 427
},
{
"t": 3,
"x": 142,
"y": 427
},
{
"t": 4,
"x": 64,
"y": 435
},
{
"t": 5,
"x": 52,
"y": 435
},
{
"t": 8,
"x": 72,
"y": 427
},
{
"t": 9,
"x": 83,
"y": 412
},
{
"t": 11,
"x": 91,
"y": 423
},
{
"t": 13,
"x": 115,
"y": 423
},
{
"t": 14,
"x": 123,
"y": 419
},
{
"t": 22,
"x": 154,
"y": 408
},
{
"t": 23,
"x": 134,
"y": 419
}
],
"birth": 0,
"death": 24,
"type": "grey stuffed raccoon"
},
{
"id": 2,
"image_positions": [
{
"t": 0,
"x": 330,
"y": 384
},
{
"t": 3,
"x": 337,
"y": 380
},
{
"t": 4,
"x": 349,
"y": 376
},
{
"t": 5,
"x": 337,
"y": 376
},
{
"t": 6,
"x": 345,
"y": 373
},
{
"t": 7,
"x": 380,
"y": 369
},
{
"t": 9,
"x": 384,
"y": 361
},
{
"t": 10,
"x": 345,
"y": 353
},
{
"t": 11,
"x": 357,
"y": 349
},
{
"t": 12,
"x": 384,
"y": 353
},
{
"t": 13,
"x": 392,
"y": 345
},
{
"t": 15,
"x": 396,
"y": 337
},
{
"t": 17,
"x": 263,
"y": 330
},
{
"t": 19,
"x": 275,
"y": 337
},
{
"t": 21,
"x": 294,
"y": 337
},
{
"t": 22,
"x": 291,
"y": 345
}
],
"birth": 0,
"death": 24,
"type": "white plastic dietary supplement bottle"
},
{
"id": 3,
"image_positions": [
{
"t": 0,
"x": 341,
"y": 228
},
{
"t": 1,
"x": 322,
"y": 240
},
{
"t": 2,
"x": 302,
"y": 263
},
{
"t": 3,
"x": 283,
"y": 298
},
{
"t": 4,
"x": 267,
"y": 322
},
{
"t": 5,
"x": 255,
"y": 392
},
{
"t": 6,
"x": 244,
"y": 400
},
{
"t": 7,
"x": 232,
"y": 427
},
{
"t": 8,
"x": 236,
"y": 419
},
{
"t": 9,
"x": 224,
"y": 431
},
{
"t": 10,
"x": 220,
"y": 451
},
{
"t": 11,
"x": 232,
"y": 466
},
{
"t": 12,
"x": 236,
"y": 478
},
{
"t": 13,
"x": 255,
"y": 474
},
{
"t": 14,
"x": 251,
"y": 498
},
{
"t": 15,
"x": 103,
"y": 505
},
{
"t": 16,
"x": 193,
"y": 541
},
{
"t": 17,
"x": 189,
"y": 556
},
{
"t": 18,
"x": 173,
"y": 572
},
{
"t": 19,
"x": 240,
"y": 568
},
{
"t": 20,
"x": 216,
"y": 591
},
{
"t": 21,
"x": 224,
"y": 587
},
{
"t": 22,
"x": 220,
"y": 595
},
{
"t": 23,
"x": 193,
"y": 607
}
],
"birth": 0,
"death": 24,
"type": "dark grey metallic cake pan set"
},
{
"id": 4,
"image_positions": [
{
"t": 0,
"x": 478,
"y": 392
},
{
"t": 2,
"x": 466,
"y": 384
},
{
"t": 3,
"x": 458,
"y": 380
},
{
"t": 4,
"x": 517,
"y": 384
},
{
"t": 5,
"x": 490,
"y": 376
},
{
"t": 6,
"x": 466,
"y": 369
},
{
"t": 8,
"x": 470,
"y": 361
},
{
"t": 9,
"x": 517,
"y": 369
},
{
"t": 10,
"x": 494,
"y": 361
},
{
"t": 11,
"x": 474,
"y": 353
},
{
"t": 13,
"x": 521,
"y": 357
},
{
"t": 14,
"x": 513,
"y": 353
},
{
"t": 15,
"x": 478,
"y": 341
},
{
"t": 16,
"x": 490,
"y": 341
},
{
"t": 17,
"x": 482,
"y": 337
},
{
"t": 19,
"x": 513,
"y": 337
},
{
"t": 20,
"x": 505,
"y": 333
},
{
"t": 22,
"x": 486,
"y": 322
}
],
"birth": 0,
"death": 24,
"type": "plastic Nintendo 3DS game case"
},
{
"id": 5,
"image_positions": [
{
"t": 0,
"x": 751,
"y": 689
},
{
"t": 1,
"x": 759,
"y": 701
},
{
"t": 2,
"x": 755,
"y": 708
},
{
"t": 3,
"x": 751,
"y": 716
},
{
"t": 4,
"x": 748,
"y": 724
},
{
"t": 5,
"x": 744,
"y": 732
},
{
"t": 7,
"x": 740,
"y": 748
},
{
"t": 9,
"x": 740,
"y": 763
},
{
"t": 11,
"x": 740,
"y": 779
},
{
"t": 13,
"x": 701,
"y": 779
},
{
"t": 15,
"x": 693,
"y": 791
},
{
"t": 16,
"x": 697,
"y": 798
},
{
"t": 18,
"x": 701,
"y": 814
},
{
"t": 20,
"x": 701,
"y": 826
},
{
"t": 21,
"x": 669,
"y": 818
},
{
"t": 23,
"x": 662,
"y": 826
}
],
"birth": 0,
"death": 24,
"type": "metallic copper leather ballet flat"
},
{
"id": 6,
"image_positions": [
{
"t": 0,
"x": 798,
"y": 482
},
{
"t": 1,
"x": 791,
"y": 486
},
{
"t": 3,
"x": 783,
"y": 498
},
{
"t": 5,
"x": 779,
"y": 509
},
{
"t": 7,
"x": 779,
"y": 521
},
{
"t": 10,
"x": 775,
"y": 533
},
{
"t": 12,
"x": 767,
"y": 541
},
{
"t": 14,
"x": 763,
"y": 548
},
{
"t": 16,
"x": 755,
"y": 552
},
{
"t": 18,
"x": 767,
"y": 556
},
{
"t": 20,
"x": 755,
"y": 564
},
{
"t": 22,
"x": 751,
"y": 572
}
],
"birth": 0,
"death": 24,
"type": "white ceramic beaded mug"
},
{
"id": 7,
"image_positions": [
{
"t": 0,
"x": 884,
"y": 314
},
{
"t": 1,
"x": 732,
"y": 310
},
{
"t": 3,
"x": 861,
"y": 314
},
{
"t": 5,
"x": 869,
"y": 322
},
{
"t": 8,
"x": 861,
"y": 326
},
{
"t": 9,
"x": 849,
"y": 322
},
{
"t": 10,
"x": 857,
"y": 326
},
{
"t": 12,
"x": 845,
"y": 326
},
{
"t": 15,
"x": 833,
"y": 326
},
{
"t": 16,
"x": 818,
"y": 322
},
{
"t": 17,
"x": 791,
"y": 318
},
{
"t": 19,
"x": 783,
"y": 314
},
{
"t": 20,
"x": 841,
"y": 322
},
{
"t": 21,
"x": 826,
"y": 318
},
{
"t": 23,
"x": 814,
"y": 314
}
],
"birth": 0,
"death": 24,
"type": "black cardboard box of pads"
},
{
"id": 8,
"image_positions": [
{
"t": 0,
"x": 990,
"y": 505
},
{
"t": 3,
"x": 970,
"y": 505
},
{
"t": 4,
"x": 986,
"y": 513
},
{
"t": 6,
"x": 966,
"y": 509
},
{
"t": 7,
"x": 982,
"y": 517
},
{
"t": 8,
"x": 970,
"y": 517
},
{
"t": 9,
"x": 978,
"y": 525
},
{
"t": 10,
"x": 966,
"y": 521
},
{
"t": 11,
"x": 974,
"y": 529
},
{
"t": 12,
"x": 962,
"y": 525
},
{
"t": 15,
"x": 955,
"y": 533
},
{
"t": 19,
"x": 943,
"y": 537
},
{
"t": 21,
"x": 951,
"y": 541
}
],
"birth": 0,
"death": 24,
"type": "colorful wooden vehicle puzzle"
},
{
"id": 9,
"image_positions": [
{
"t": 0,
"x": 990,
"y": 642
},
{
"t": 1,
"x": 990,
"y": 630
},
{
"t": 3,
"x": 986,
"y": 654
},
{
"t": 5,
"x": 982,
"y": 669
},
{
"t": 6,
"x": 982,
"y": 658
},
{
"t": 8,
"x": 978,
"y": 677
},
{
"t": 10,
"x": 974,
"y": 689
},
{
"t": 12,
"x": 970,
"y": 701
},
{
"t": 14,
"x": 966,
"y": 708
},
{
"t": 16,
"x": 962,
"y": 716
},
{
"t": 18,
"x": 958,
"y": 728
},
{
"t": 20,
"x": 955,
"y": 740
},
{
"t": 22,
"x": 947,
"y": 748
}
],
"birth": 0,
"death": 24,
"type": "brown metallic can of herring fillets"
}
],
"interactions": [
{
"id": 7,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 9,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 13,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 14,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 15,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 16,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 17,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 18,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 5,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 3,
"ends_at": 3,
"type": "collision"
},
{
"id": 1,
"inputs": [
0,
1
],
"outputs": [
0,
1
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 6,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 6,
"ends_at": 6,
"type": "collision"
},
{
"id": 2,
"inputs": [
0,
1
],
"outputs": [
0,
1
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 12,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 0,
"inputs": [
0,
1
],
"outputs": [
0,
1
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 8,
"inputs": [
2,
3
],
"outputs": [
2,
3
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 10,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 11,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 11,
"ends_at": 23,
"type": "contact"
},
{
"id": 3,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 4,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 14,
"ends_at": 23,
"type": "contact"
}
]
}Per-sample evaluator details
{
"objects": {
"avg_type_similarity": 1.0,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 0.0,
"avg_image_position_segmentation_acc": 1.0,
"avg_image_position_segmentation_acc_small": 1.0,
"avg_image_position_segmentation_acc_medium": 1.0,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": 1.0,
"avg_image_position_segmentation_visible_acc": 1.0,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": null,
"num_matches": 10,
"num_unmatched_pred": 0,
"num_unmatched_target": 0
},
"interactions": {
"avg_interaction_temporal_span_giou": 0.4938216754006228,
"avg_interaction_input_object_jaccard": 0.5087719298245614,
"avg_interaction_output_object_jaccard": 0.5087719298245614,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 19,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 2,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 12,
"false_positives": 7,
"false_negatives": 2
},
"0.5": {
"true_positives": 11,
"false_positives": 8,
"false_negatives": 2
},
"0.75": {
"true_positives": 11,
"false_positives": 8,
"false_negatives": 2
},
"1.0": {
"true_positives": 10,
"false_positives": 9,
"false_negatives": 2
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.631578947368421,
"0.5": 0.5789473684210527,
"0.75": 0.5789473684210527,
"1.0": 0.5263157894736842
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.8571428571428571,
"0.5": 0.8461538461538461,
"0.75": 0.8461538461538461,
"1.0": 0.8333333333333334
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.7272727272727273,
"0.5": 0.6875,
"0.75": 0.6875,
"1.0": 0.6451612903225806
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 17,
"false_positives": 2,
"false_negatives": 2
},
"0.5": {
"true_positives": 6,
"false_positives": 13,
"false_negatives": 2
},
"0.75": {
"true_positives": 6,
"false_positives": 13,
"false_negatives": 2
},
"1.0": {
"true_positives": 6,
"false_positives": 13,
"false_negatives": 2
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.8947368421052632,
"0.5": 0.3157894736842105,
"0.75": 0.3157894736842105,
"1.0": 0.3157894736842105
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.8947368421052632,
"0.5": 0.75,
"0.75": 0.75,
"1.0": 0.75
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.8947368421052632,
"0.5": 0.44444444444444436,
"0.75": 0.44444444444444436,
"1.0": 0.44444444444444436
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 17,
"false_positives": 2,
"false_negatives": 2
},
"0.5": {
"true_positives": 6,
"false_positives": 13,
"false_negatives": 2
},
"0.75": {
"true_positives": 6,
"false_positives": 13,
"false_negatives": 2
},
"1.0": {
"true_positives": 6,
"false_positives": 13,
"false_negatives": 2
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.8947368421052632,
"0.5": 0.3157894736842105,
"0.75": 0.3157894736842105,
"1.0": 0.3157894736842105
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.8947368421052632,
"0.5": 0.75,
"0.75": 0.75,
"1.0": 0.75
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.8947368421052632,
"0.5": 0.44444444444444436,
"0.75": 0.44444444444444436,
"1.0": 0.44444444444444436
}
}
}Prompt
user Analyze the provided video and return ONLY a valid sentinel sequence in this format: [SCENE-START] [OBJS-START] [OBJ] id "type" birth death [PX] t px py ... [OBJ] ... [OBJS-END] [INTERACTIONS-START] [INTERACT] id "type" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ... [INTERACT] ... [INTERACTIONS-END] [SCENE-END] Constraints: - Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose). - Keep tags exactly as written: `[SCENE-START] [OBJS-START] [OBJ] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]` - Use quoted strings for `type` (double quotes). - `PX` uses repeated groups of 3 values in order: `t px py`. - `t` is the timestamp (frame number). - `px` and `py` are the pixel coordinates of the object in that frame, normalized to [0,1] relative to the frame dimensions, scaled by 1000 and rounded to the nearest integer. For example, `px` of 0.1234 would be represented as 123. - When an object is occluded or not visible in a frame, `PX` may use `t null null`. - `IN` and `OUT` contain whitespace-separated integer ids. assistant