STRIVE · 08/28/2026
Failure 12: super_clevr_1115
Exact stored prediction, target, matching details, and video.
0.063963
Composite interaction mF1. Prediction parses successfully; this is a valid low-scoring case.
Composite calculation
{
"families": {
"temporal": {
"values": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"mean": 0.0
},
"input": {
"values": {
"0.25": 0.1694915254237288,
"0.5": 0.07142857142857142,
"0.75": 0.07142857142857142,
"1.0": 0.07142857142857142
},
"mean": 0.09594430992736078
},
"output": {
"values": {
"0.25": 0.1694915254237288,
"0.5": 0.07142857142857142,
"0.75": 0.07142857142857142,
"1.0": 0.07142857142857142
},
"mean": 0.09594430992736078
}
},
"composite": 0.06396287328490718
}Raw prediction
[SCENE-START] [OBJS-START] [OBJ] 0 "red plastic toy airplane" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 1 455 10 13 455 17 21 451 [OBJ] 1 "brown leather desk caddy" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 5 529 11 9 537 13 13 544 22 13 533 [OBJ] 2 "red and black plastic handheld gaming console" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 17 490 1 25 494 12 37 494 23 48 494 [OBJ] 3 "red and black plastic handheld gaming console" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 103 478 2 115 478 4 126 478 6 138 478 8 150 478 10 162 478 12 173 478 15 185 478 18 197 478 20 208 478 22 220 478 23 232 478 [OBJ] 4 "white cardboard ink cartridge box" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 107 447 10 119 447 16 130 447 17 142 447 18 119 443 20 130 443 22 142 443 23 123 443 [OBJ] 5 "white and blue cardboard stool softener box" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 126 455 2 138 455 4 150 455 6 162 455 9 130 451 12 142 451 14 154 451 17 166 451 19 177 451 21 150 447 23 162 447 [OBJ] 6 "white cardboard neck therapy box" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 138 478 1 146 474 3 158 474 5 169 474 7 181 474 10 193 474 11 181 478 12 193 474 14 205 474 16 216 474 18 228 474 20 240 474 22 251 474 23 240 478 [OBJ] 7 "red and yellow wooden toy airplane with pilot" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 251 998 1 240 994 2 224 990 3 232 986 4 244 982 5 255 978 6 244 978 7 255 974 8 267 970 9 255 966 10 267 962 11 255 958 12 271 955 13 259 955 14 275 951 15 287 947 16 275 943 17 291 939 18 279 939 19 291 935 20 283 931 21 294 927 22 287 923 23 298 923 [OBJ] 8 "white and red cardboard ink cartridge box" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 259 474 1 267 478 12 259 474 14 271 478 15 263 474 16 275 478 17 267 474 21 279 478 22 271 474 [OBJ] 9 "white and red cardboard ink cartridge box" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 333 396 1 341 400 3 357 404 4 345 400 5 353 404 11 365 408 12 353 404 13 361 408 19 369 412 20 357 408 22 365 412 [OBJ] 10 "grey and black basketball shoe" 0 24 [VIS] 0 true 1 false 10 true 11 false 12 true 14 false 15 true [IN-FRAME] 0 true [PX] 0 447 427 1 null null 10 455 431 11 null null 12 451 431 14 null null 15 455 435 [OBJ] 11 "red and yellow wooden toy airplane with pilot" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 587 134 1 580 138 3 572 142 4 580 138 5 564 146 6 576 142 7 560 150 8 572 146 9 556 154 10 568 150 11 552 158 12 564 154 13 548 162 14 560 158 15 544 166 16 556 162 17 541 169 18 552 166 19 537 173 20 548 169 21 533 177 22 544 173 23 529 181 [OBJ] 12 "grey plastic Nintendo 64 game cartridge" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 595 455 16 587 458 [OBJ] 13 "grey metallic cake pan" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 623 705 1 634 708 2 619 705 3 630 708 4 619 705 5 626 708 11 615 705 12 623 708 14 611 705 15 619 708 18 607 705 19 615 708 22 603 705 23 611 708 [OBJ] 14 "red and white cardboard ink cartridge box" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 759 1 1 771 5 2 763 1 3 771 5 6 763 1 7 771 9 11 767 1 12 771 17 15 767 1 16 771 21 21 767 1 22 771 25 [OBJ] 15 "white and red cardboard ink cartridge box" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 826 1 1 837 5 2 826 5 3 833 9 4 822 9 5 830 13 6 818 13 7 826 17 8 814 17 9 822 21 10 810 21 11 818 25 12 806 25 13 814 29 14 802 29 15 810 33 16 798 33 17 806 37 18 794 37 19 802 41 20 791 41 21 798 44 22 787 44 23 794 48 [OBJ] 16 "red leather boot" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 841 455 2 833 451 4 841 455 11 833 451 13 841 455 19 833 451 [OBJ] 17 "red leather boot" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 994 451 2 998 443 10 998 455 12 998 466 13 998 478 15 998 455 17 998 466 18 998 478 19 998 490 20 998 443 22 998 455 23 998 470 [OBJ] 18 "red and yellow wooden toy airplane with pilot" 1 24 [VIS] 0 false 1 true [IN-FRAME] 0 false 1 true [PX] 0 null null 1 998 111 2 982 103 3 966 91 4 943 80 5 916 72 6 888 72 7 861 80 8 837 87 9 810 95 10 791 99 11 771 107 12 751 115 13 732 119 14 712 123 15 693 126 16 673 130 17 654 134 18 634 138 19 615 142 20 595 146 21 576 150 22 556 154 23 541 158 [OBJ] 19 "red and yellow wooden toy airplane with pilot" 11 24 [VIS] 0 false 11 true [IN-FRAME] 0 false 11 true [PX] 0 null null 11 294 435 13 298 443 14 291 439 15 294 447 17 291 435 18 294 443 19 298 451 20 291 439 21 298 455 22 291 439 23 298 455 [OBJS-END] [INTERACTIONS-START] [INTERACT] 1 "contact" 0 0 [IN] 1 2 [OUT] 1 2 [INTERACT] 3 "contact" 0 1 [IN] 1 3 [OUT] 1 3 [INTERACT] 43 "contact" 0 3 [IN] 9 10 [OUT] 9 10 [INTERACT] 46 "contact" 0 6 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 22 "contact" 0 14 [IN] 2 6 [OUT] 2 6 [INTERACT] 24 "contact" 0 14 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 0 "contact" 0 23 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 "contact" 0 23 [IN] 1 19 [OUT] 1 19 [INTERACT] 2 "contact" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 27 "contact" 0 23 [IN] 3 6 [OUT] 3 6 [INTERACT] 28 "contact" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 29 "contact" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 30 "contact" 0 23 [IN] 5 6 [OUT] 5 6 [INTERACT] 31 "contact" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 32 "contact" 0 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 36 "contact" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 37 "contact" 0 23 [IN] 8 19 [OUT] 8 19 [INTERACT] 38 "contact" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 4 "contact" 0 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 5 "contact" 0 23 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 6 "contact" 0 23 [IN] 12 16 [OUT] 12 16 [INTERACT] 7 "contact" 0 23 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 8 "contact" 0 23 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 9 "contact" 0 23 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 10 "contact" 0 23 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 11 "contact" 0 23 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 12 "contact" 0 23 [IN] 17 65535 [OUT] 17 65535 [INTERACT] 44 "collision" 5 5 [IN] 9 10 [OUT] 9 10 [INTERACT] 45 "contact" 6 23 [IN] 9 10 [OUT] 9 10 [INTERACT] 42 "collision" 7 7 [IN] 8 9 [OUT] 8 9 [INTERACT] 17 "collision" 7 7 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 23 "collision" 7 8 [IN] 2 6 [OUT] 2 6 [INTERACT] 13 "collision" 10 10 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 39 "collision" 11 11 [IN] 8 9 [OUT] 8 9 [INTERACT] 40 "contact" 12 13 [IN] 8 9 [OUT] 8 9 [INTERACT] 14 "collision" 13 13 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 33 "collision" 14 14 [IN] 6 9 [OUT] 6 9 [INTERACT] 47 "collision" 14 14 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 15 "collision" 15 15 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 48 "contact" 15 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 16 "contact" 16 23 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 25 "collision" 17 17 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 34 "collision" 17 17 [IN] 6 9 [OUT] 6 9 [INTERACT] 20 "collision" 18 18 [IN] 19 65535 [OUT] 19 65535 [INTERACT] 35 "contact" 18 21 [IN] 6 9 [OUT] 6 9 [INTERACT] 26 "contact" 18 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 21 "contact" 19 23 [IN] 19 65535 [OUT] 19 65535 [INTERACT] 18 "collision" 20 20 [IN] 2 19 [OUT] 2 19 [INTERACT] 19 "contact" 21 23 [IN] 2 19 [OUT] 2 19 [INTERACT] 3 "collision" 22 22 [IN] 1 3 [OUT] 1 3 [INTERACT] 41 "collision" 22 22 [IN] 8 9 [OUT] 8 9 [INTERACT] 49 "collision" 22 22 [IN] 9 19 [OUT] 9 19 [INTERACT] 4 "contact" 23 23 [IN] 1 3 [OUT] 1 3 [INTERACT] 50 "contact" 23 23 [IN] 9 19 [OUT] 9 19 [INTERACTIONS-END] [SCENE-END]
Raw ground truth
[SCENE-START] [OBJS-START] [OBJ] 0 "red airliner" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 558 128 1 556 128 2 554 127 3 551 127 5 546 126 6 544 126 8 538 125 10 533 124 11 530 123 13 526 122 14 522 121 15 519 121 16 515 121 18 510 120 19 506 119 20 501 118 21 496 117 22 494 117 24 487 115 25 486 116 26 481 115 27 477 114 28 472 113 29 468 111 30 466 109 31 462 102 32 457 94 33 456 89 34 455 83 35 451 79 36 447 75 37 444 72 38 441 69 39 439 67 40 433 59 41 426 52 42 421 46 43 417 42 44 414 38 45 414 29 46 404 28 47 396 26 48 388 25 49 381 24 50 371 25 51 362 25 52 453 58 53 449 55 54 444 53 55 439 50 56 433 48 57 428 46 58 423 44 59 394 18 60 390 17 61 408 36 62 404 33 63 400 30 64 394 29 65 391 25 66 383 24 67 380 22 68 373 21 69 368 20 70 363 19 71 358 19 72 352 19 73 349 17 74 343 18 75 337 19 76 333 20 77 327 21 78 322 24 79 318 25 80 312 28 81 306 32 82 290 21 83 273 15 84 264 16 85 251 16 86 186 16 87 184 18 88 180 21 89 176 25 90 173 32 91 171 43 92 167 53 93 165 65 94 160 75 95 158 89 96 183 97 97 179 106 98 176 120 99 173 134 100 170 149 101 171 164 102 173 179 103 173 193 104 171 209 105 170 225 106 130 253 107 132 270 108 133 288 109 144 300 110 144 318 111 143 335 112 143 353 113 143 372 114 147 386 115 146 404 116 146 422 117 147 441 118 147 459 119 162 469 [OBJ] 1 "gray sedan" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 655 705 [OBJ] 2 "red fighter" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 977 51 1 976 56 2 953 59 3 940 60 4 977 54 5 973 49 6 968 42 7 953 43 8 936 45 9 919 48 10 903 50 11 887 53 12 872 55 13 855 58 14 841 59 15 825 63 16 811 65 17 795 68 18 781 70 19 766 72 20 753 74 21 739 76 22 726 78 23 712 79 24 699 81 25 686 83 26 673 85 27 661 86 28 648 90 29 636 91 30 626 91 31 619 86 32 610 85 33 601 81 34 593 78 35 583 77 36 575 75 37 565 73 38 555 71 39 543 75 40 534 80 41 524 88 42 514 95 43 505 101 44 495 107 45 486 115 46 476 122 47 467 128 48 458 134 49 449 142 50 441 149 51 430 158 52 422 166 53 414 172 54 405 179 55 398 185 56 390 194 57 381 199 58 374 206 59 366 215 60 358 221 61 351 229 62 344 238 63 337 246 64 330 253 65 324 261 66 317 270 67 311 279 68 305 288 69 299 297 70 294 307 71 288 317 72 283 327 73 278 336 74 273 346 75 269 357 76 264 368 77 259 376 78 255 388 79 251 399 80 246 409 82 246 414 83 246 419 84 247 422 85 246 427 86 245 432 87 244 439 88 242 446 89 239 454 90 236 463 91 233 472 92 230 480 93 227 476 94 226 472 95 223 468 96 221 466 97 218 464 98 215 460 100 212 457 102 209 456 103 206 454 104 205 453 105 202 452 106 200 450 107 196 450 108 169 463 109 162 468 111 186 449 112 183 450 113 182 448 114 180 448 116 176 448 117 176 451 118 119 472 119 112 473 [OBJ] 3 "cyan chopper" 2 120 [VIS] 0 false 2 true [IN-FRAME] 0 false 2 true [PX] 0 null null 2 203 998 3 208 991 4 225 988 5 229 981 6 232 976 7 228 971 8 231 966 9 234 965 10 237 949 11 241 944 12 244 930 13 248 925 14 251 914 15 242 960 16 245 950 17 248 940 18 251 928 19 254 920 20 256 911 21 258 902 22 261 894 23 264 885 24 266 876 25 269 869 26 271 861 27 273 852 28 276 846 29 277 839 30 280 830 31 281 825 32 283 818 33 286 811 34 287 804 35 289 800 36 291 793 37 293 786 38 294 781 39 296 773 40 298 772 41 299 766 42 301 759 43 308 743 44 309 738 45 305 745 46 312 727 47 313 724 48 315 719 49 311 727 50 317 710 52 319 703 53 320 699 54 322 695 55 323 691 56 323 688 57 324 684 58 325 681 59 326 677 60 327 673 61 328 671 62 329 668 63 330 664 64 330 660 65 332 655 66 333 652 67 333 650 68 334 647 69 335 645 70 336 641 71 337 638 72 337 634 73 338 632 74 339 629 75 340 627 76 341 624 77 341 622 78 342 620 79 342 617 80 343 614 81 344 611 83 345 606 84 345 617 85 346 603 86 348 594 87 347 607 88 349 588 90 349 603 91 349 600 92 349 597 93 351 577 94 351 594 96 352 580 97 352 588 99 353 584 100 355 548 101 355 580 103 355 577 105 356 573 107 357 569 109 358 567 111 359 561 113 359 527 114 360 557 115 360 525 117 361 522 118 362 551 [OBJS-END] [INTERACTIONS-START] [INTERACT] 2 "contact" 0 119 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 8 "contact" 0 119 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 0 "collision" 30 30 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 "collision" 40 40 [IN] 0 2 [OUT] 0 2 [INTERACT] 6 "collision" 81 82 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 7 "collision" 93 93 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 "collision" 109 109 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 "collision" 111 111 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 "collision" 119 119 [IN] 2 65535 [OUT] 2 65535 [INTERACTIONS-END] [SCENE-END]
Parsed prediction
{
"objects": [
{
"id": 0,
"type": "red plastic toy airplane",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 1,
"y": 455
},
{
"t": 10,
"x": 13,
"y": 455
},
{
"t": 17,
"x": 21,
"y": 451
}
],
"birth": 0,
"death": 24
},
{
"id": 1,
"type": "brown leather desk caddy",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 5,
"y": 529
},
{
"t": 11,
"x": 9,
"y": 537
},
{
"t": 13,
"x": 13,
"y": 544
},
{
"t": 22,
"x": 13,
"y": 533
}
],
"birth": 0,
"death": 24
},
{
"id": 2,
"type": "red and black plastic handheld gaming console",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 17,
"y": 490
},
{
"t": 1,
"x": 25,
"y": 494
},
{
"t": 12,
"x": 37,
"y": 494
},
{
"t": 23,
"x": 48,
"y": 494
}
],
"birth": 0,
"death": 24
},
{
"id": 3,
"type": "red and black plastic handheld gaming console",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 103,
"y": 478
},
{
"t": 2,
"x": 115,
"y": 478
},
{
"t": 4,
"x": 126,
"y": 478
},
{
"t": 6,
"x": 138,
"y": 478
},
{
"t": 8,
"x": 150,
"y": 478
},
{
"t": 10,
"x": 162,
"y": 478
},
{
"t": 12,
"x": 173,
"y": 478
},
{
"t": 15,
"x": 185,
"y": 478
},
{
"t": 18,
"x": 197,
"y": 478
},
{
"t": 20,
"x": 208,
"y": 478
},
{
"t": 22,
"x": 220,
"y": 478
},
{
"t": 23,
"x": 232,
"y": 478
}
],
"birth": 0,
"death": 24
},
{
"id": 4,
"type": "white cardboard ink cartridge box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 107,
"y": 447
},
{
"t": 10,
"x": 119,
"y": 447
},
{
"t": 16,
"x": 130,
"y": 447
},
{
"t": 17,
"x": 142,
"y": 447
},
{
"t": 18,
"x": 119,
"y": 443
},
{
"t": 20,
"x": 130,
"y": 443
},
{
"t": 22,
"x": 142,
"y": 443
},
{
"t": 23,
"x": 123,
"y": 443
}
],
"birth": 0,
"death": 24
},
{
"id": 5,
"type": "white and blue cardboard stool softener box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 126,
"y": 455
},
{
"t": 2,
"x": 138,
"y": 455
},
{
"t": 4,
"x": 150,
"y": 455
},
{
"t": 6,
"x": 162,
"y": 455
},
{
"t": 9,
"x": 130,
"y": 451
},
{
"t": 12,
"x": 142,
"y": 451
},
{
"t": 14,
"x": 154,
"y": 451
},
{
"t": 17,
"x": 166,
"y": 451
},
{
"t": 19,
"x": 177,
"y": 451
},
{
"t": 21,
"x": 150,
"y": 447
},
{
"t": 23,
"x": 162,
"y": 447
}
],
"birth": 0,
"death": 24
},
{
"id": 6,
"type": "white cardboard neck therapy box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 138,
"y": 478
},
{
"t": 1,
"x": 146,
"y": 474
},
{
"t": 3,
"x": 158,
"y": 474
},
{
"t": 5,
"x": 169,
"y": 474
},
{
"t": 7,
"x": 181,
"y": 474
},
{
"t": 10,
"x": 193,
"y": 474
},
{
"t": 11,
"x": 181,
"y": 478
},
{
"t": 12,
"x": 193,
"y": 474
},
{
"t": 14,
"x": 205,
"y": 474
},
{
"t": 16,
"x": 216,
"y": 474
},
{
"t": 18,
"x": 228,
"y": 474
},
{
"t": 20,
"x": 240,
"y": 474
},
{
"t": 22,
"x": 251,
"y": 474
},
{
"t": 23,
"x": 240,
"y": 478
}
],
"birth": 0,
"death": 24
},
{
"id": 7,
"type": "red and yellow wooden toy airplane with pilot",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 251,
"y": 998
},
{
"t": 1,
"x": 240,
"y": 994
},
{
"t": 2,
"x": 224,
"y": 990
},
{
"t": 3,
"x": 232,
"y": 986
},
{
"t": 4,
"x": 244,
"y": 982
},
{
"t": 5,
"x": 255,
"y": 978
},
{
"t": 6,
"x": 244,
"y": 978
},
{
"t": 7,
"x": 255,
"y": 974
},
{
"t": 8,
"x": 267,
"y": 970
},
{
"t": 9,
"x": 255,
"y": 966
},
{
"t": 10,
"x": 267,
"y": 962
},
{
"t": 11,
"x": 255,
"y": 958
},
{
"t": 12,
"x": 271,
"y": 955
},
{
"t": 13,
"x": 259,
"y": 955
},
{
"t": 14,
"x": 275,
"y": 951
},
{
"t": 15,
"x": 287,
"y": 947
},
{
"t": 16,
"x": 275,
"y": 943
},
{
"t": 17,
"x": 291,
"y": 939
},
{
"t": 18,
"x": 279,
"y": 939
},
{
"t": 19,
"x": 291,
"y": 935
},
{
"t": 20,
"x": 283,
"y": 931
},
{
"t": 21,
"x": 294,
"y": 927
},
{
"t": 22,
"x": 287,
"y": 923
},
{
"t": 23,
"x": 298,
"y": 923
}
],
"birth": 0,
"death": 24
},
{
"id": 8,
"type": "white and red cardboard ink cartridge box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 259,
"y": 474
},
{
"t": 1,
"x": 267,
"y": 478
},
{
"t": 12,
"x": 259,
"y": 474
},
{
"t": 14,
"x": 271,
"y": 478
},
{
"t": 15,
"x": 263,
"y": 474
},
{
"t": 16,
"x": 275,
"y": 478
},
{
"t": 17,
"x": 267,
"y": 474
},
{
"t": 21,
"x": 279,
"y": 478
},
{
"t": 22,
"x": 271,
"y": 474
}
],
"birth": 0,
"death": 24
},
{
"id": 9,
"type": "white and red cardboard ink cartridge box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 333,
"y": 396
},
{
"t": 1,
"x": 341,
"y": 400
},
{
"t": 3,
"x": 357,
"y": 404
},
{
"t": 4,
"x": 345,
"y": 400
},
{
"t": 5,
"x": 353,
"y": 404
},
{
"t": 11,
"x": 365,
"y": 408
},
{
"t": 12,
"x": 353,
"y": 404
},
{
"t": 13,
"x": 361,
"y": 408
},
{
"t": 19,
"x": 369,
"y": 412
},
{
"t": 20,
"x": 357,
"y": 408
},
{
"t": 22,
"x": 365,
"y": 412
}
],
"birth": 0,
"death": 24
},
{
"id": 10,
"type": "grey and black basketball shoe",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 1,
"v": false
},
{
"t": 10,
"v": true
},
{
"t": 11,
"v": false
},
{
"t": 12,
"v": true
},
{
"t": 14,
"v": false
},
{
"t": 15,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 447,
"y": 427
},
{
"t": 1,
"x": null,
"y": null
},
{
"t": 10,
"x": 455,
"y": 431
},
{
"t": 11,
"x": null,
"y": null
},
{
"t": 12,
"x": 451,
"y": 431
},
{
"t": 14,
"x": null,
"y": null
},
{
"t": 15,
"x": 455,
"y": 435
}
],
"birth": 0,
"death": 24
},
{
"id": 11,
"type": "red and yellow wooden toy airplane with pilot",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 587,
"y": 134
},
{
"t": 1,
"x": 580,
"y": 138
},
{
"t": 3,
"x": 572,
"y": 142
},
{
"t": 4,
"x": 580,
"y": 138
},
{
"t": 5,
"x": 564,
"y": 146
},
{
"t": 6,
"x": 576,
"y": 142
},
{
"t": 7,
"x": 560,
"y": 150
},
{
"t": 8,
"x": 572,
"y": 146
},
{
"t": 9,
"x": 556,
"y": 154
},
{
"t": 10,
"x": 568,
"y": 150
},
{
"t": 11,
"x": 552,
"y": 158
},
{
"t": 12,
"x": 564,
"y": 154
},
{
"t": 13,
"x": 548,
"y": 162
},
{
"t": 14,
"x": 560,
"y": 158
},
{
"t": 15,
"x": 544,
"y": 166
},
{
"t": 16,
"x": 556,
"y": 162
},
{
"t": 17,
"x": 541,
"y": 169
},
{
"t": 18,
"x": 552,
"y": 166
},
{
"t": 19,
"x": 537,
"y": 173
},
{
"t": 20,
"x": 548,
"y": 169
},
{
"t": 21,
"x": 533,
"y": 177
},
{
"t": 22,
"x": 544,
"y": 173
},
{
"t": 23,
"x": 529,
"y": 181
}
],
"birth": 0,
"death": 24
},
{
"id": 12,
"type": "grey plastic Nintendo 64 game cartridge",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 595,
"y": 455
},
{
"t": 16,
"x": 587,
"y": 458
}
],
"birth": 0,
"death": 24
},
{
"id": 13,
"type": "grey metallic cake pan",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 623,
"y": 705
},
{
"t": 1,
"x": 634,
"y": 708
},
{
"t": 2,
"x": 619,
"y": 705
},
{
"t": 3,
"x": 630,
"y": 708
},
{
"t": 4,
"x": 619,
"y": 705
},
{
"t": 5,
"x": 626,
"y": 708
},
{
"t": 11,
"x": 615,
"y": 705
},
{
"t": 12,
"x": 623,
"y": 708
},
{
"t": 14,
"x": 611,
"y": 705
},
{
"t": 15,
"x": 619,
"y": 708
},
{
"t": 18,
"x": 607,
"y": 705
},
{
"t": 19,
"x": 615,
"y": 708
},
{
"t": 22,
"x": 603,
"y": 705
},
{
"t": 23,
"x": 611,
"y": 708
}
],
"birth": 0,
"death": 24
},
{
"id": 14,
"type": "red and white cardboard ink cartridge box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 759,
"y": 1
},
{
"t": 1,
"x": 771,
"y": 5
},
{
"t": 2,
"x": 763,
"y": 1
},
{
"t": 3,
"x": 771,
"y": 5
},
{
"t": 6,
"x": 763,
"y": 1
},
{
"t": 7,
"x": 771,
"y": 9
},
{
"t": 11,
"x": 767,
"y": 1
},
{
"t": 12,
"x": 771,
"y": 17
},
{
"t": 15,
"x": 767,
"y": 1
},
{
"t": 16,
"x": 771,
"y": 21
},
{
"t": 21,
"x": 767,
"y": 1
},
{
"t": 22,
"x": 771,
"y": 25
}
],
"birth": 0,
"death": 24
},
{
"id": 15,
"type": "white and red cardboard ink cartridge box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 826,
"y": 1
},
{
"t": 1,
"x": 837,
"y": 5
},
{
"t": 2,
"x": 826,
"y": 5
},
{
"t": 3,
"x": 833,
"y": 9
},
{
"t": 4,
"x": 822,
"y": 9
},
{
"t": 5,
"x": 830,
"y": 13
},
{
"t": 6,
"x": 818,
"y": 13
},
{
"t": 7,
"x": 826,
"y": 17
},
{
"t": 8,
"x": 814,
"y": 17
},
{
"t": 9,
"x": 822,
"y": 21
},
{
"t": 10,
"x": 810,
"y": 21
},
{
"t": 11,
"x": 818,
"y": 25
},
{
"t": 12,
"x": 806,
"y": 25
},
{
"t": 13,
"x": 814,
"y": 29
},
{
"t": 14,
"x": 802,
"y": 29
},
{
"t": 15,
"x": 810,
"y": 33
},
{
"t": 16,
"x": 798,
"y": 33
},
{
"t": 17,
"x": 806,
"y": 37
},
{
"t": 18,
"x": 794,
"y": 37
},
{
"t": 19,
"x": 802,
"y": 41
},
{
"t": 20,
"x": 791,
"y": 41
},
{
"t": 21,
"x": 798,
"y": 44
},
{
"t": 22,
"x": 787,
"y": 44
},
{
"t": 23,
"x": 794,
"y": 48
}
],
"birth": 0,
"death": 24
},
{
"id": 16,
"type": "red leather boot",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 841,
"y": 455
},
{
"t": 2,
"x": 833,
"y": 451
},
{
"t": 4,
"x": 841,
"y": 455
},
{
"t": 11,
"x": 833,
"y": 451
},
{
"t": 13,
"x": 841,
"y": 455
},
{
"t": 19,
"x": 833,
"y": 451
}
],
"birth": 0,
"death": 24
},
{
"id": 17,
"type": "red leather boot",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 994,
"y": 451
},
{
"t": 2,
"x": 998,
"y": 443
},
{
"t": 10,
"x": 998,
"y": 455
},
{
"t": 12,
"x": 998,
"y": 466
},
{
"t": 13,
"x": 998,
"y": 478
},
{
"t": 15,
"x": 998,
"y": 455
},
{
"t": 17,
"x": 998,
"y": 466
},
{
"t": 18,
"x": 998,
"y": 478
},
{
"t": 19,
"x": 998,
"y": 490
},
{
"t": 20,
"x": 998,
"y": 443
},
{
"t": 22,
"x": 998,
"y": 455
},
{
"t": 23,
"x": 998,
"y": 470
}
],
"birth": 0,
"death": 24
},
{
"id": 18,
"type": "red and yellow wooden toy airplane with pilot",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 1,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": false
},
{
"t": 1,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 1,
"x": 998,
"y": 111
},
{
"t": 2,
"x": 982,
"y": 103
},
{
"t": 3,
"x": 966,
"y": 91
},
{
"t": 4,
"x": 943,
"y": 80
},
{
"t": 5,
"x": 916,
"y": 72
},
{
"t": 6,
"x": 888,
"y": 72
},
{
"t": 7,
"x": 861,
"y": 80
},
{
"t": 8,
"x": 837,
"y": 87
},
{
"t": 9,
"x": 810,
"y": 95
},
{
"t": 10,
"x": 791,
"y": 99
},
{
"t": 11,
"x": 771,
"y": 107
},
{
"t": 12,
"x": 751,
"y": 115
},
{
"t": 13,
"x": 732,
"y": 119
},
{
"t": 14,
"x": 712,
"y": 123
},
{
"t": 15,
"x": 693,
"y": 126
},
{
"t": 16,
"x": 673,
"y": 130
},
{
"t": 17,
"x": 654,
"y": 134
},
{
"t": 18,
"x": 634,
"y": 138
},
{
"t": 19,
"x": 615,
"y": 142
},
{
"t": 20,
"x": 595,
"y": 146
},
{
"t": 21,
"x": 576,
"y": 150
},
{
"t": 22,
"x": 556,
"y": 154
},
{
"t": 23,
"x": 541,
"y": 158
}
],
"birth": 1,
"death": 24
},
{
"id": 19,
"type": "red and yellow wooden toy airplane with pilot",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 11,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": false
},
{
"t": 11,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 11,
"x": 294,
"y": 435
},
{
"t": 13,
"x": 298,
"y": 443
},
{
"t": 14,
"x": 291,
"y": 439
},
{
"t": 15,
"x": 294,
"y": 447
},
{
"t": 17,
"x": 291,
"y": 435
},
{
"t": 18,
"x": 294,
"y": 443
},
{
"t": 19,
"x": 298,
"y": 451
},
{
"t": 20,
"x": 291,
"y": 439
},
{
"t": 21,
"x": 298,
"y": 455
},
{
"t": 22,
"x": 291,
"y": 439
},
{
"t": 23,
"x": 298,
"y": 455
}
],
"birth": 11,
"death": 24
}
],
"interactions": [
{
"id": 1,
"inputs": [
1,
2
],
"outputs": [
1,
2
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 3,
"inputs": [
1,
3
],
"outputs": [
1,
3
],
"begins_at": 0,
"ends_at": 1,
"type": "contact"
},
{
"id": 43,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 0,
"ends_at": 3,
"type": "contact"
},
{
"id": 46,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 6,
"type": "contact"
},
{
"id": 22,
"inputs": [
2,
6
],
"outputs": [
2,
6
],
"begins_at": 0,
"ends_at": 14,
"type": "contact"
},
{
"id": 24,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 14,
"type": "contact"
},
{
"id": 0,
"inputs": [
0,
2
],
"outputs": [
0,
2
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
19
],
"outputs": [
1,
19
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 27,
"inputs": [
3,
6
],
"outputs": [
3,
6
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 28,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 29,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 30,
"inputs": [
5,
6
],
"outputs": [
5,
6
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 31,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 32,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 36,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 37,
"inputs": [
8,
19
],
"outputs": [
8,
19
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 38,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 4,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 5,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 6,
"inputs": [
12,
16
],
"outputs": [
12,
16
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 7,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 8,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 9,
"inputs": [
14,
65535
],
"outputs": [
14,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 10,
"inputs": [
15,
65535
],
"outputs": [
15,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 11,
"inputs": [
16,
65535
],
"outputs": [
16,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 12,
"inputs": [
17,
65535
],
"outputs": [
17,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 44,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 45,
"inputs": [
9,
10
],
"outputs": [
9,
10
],
"begins_at": 6,
"ends_at": 23,
"type": "contact"
},
{
"id": 42,
"inputs": [
8,
9
],
"outputs": [
8,
9
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 17,
"inputs": [
18,
65535
],
"outputs": [
18,
65535
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 23,
"inputs": [
2,
6
],
"outputs": [
2,
6
],
"begins_at": 7,
"ends_at": 8,
"type": "collision"
},
{
"id": 13,
"inputs": [
18,
65535
],
"outputs": [
18,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 39,
"inputs": [
8,
9
],
"outputs": [
8,
9
],
"begins_at": 11,
"ends_at": 11,
"type": "collision"
},
{
"id": 40,
"inputs": [
8,
9
],
"outputs": [
8,
9
],
"begins_at": 12,
"ends_at": 13,
"type": "contact"
},
{
"id": 14,
"inputs": [
18,
65535
],
"outputs": [
18,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 33,
"inputs": [
6,
9
],
"outputs": [
6,
9
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 47,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 14,
"ends_at": 14,
"type": "collision"
},
{
"id": 15,
"inputs": [
18,
65535
],
"outputs": [
18,
65535
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 48,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 15,
"ends_at": 23,
"type": "contact"
},
{
"id": 16,
"inputs": [
18,
65535
],
"outputs": [
18,
65535
],
"begins_at": 16,
"ends_at": 23,
"type": "contact"
},
{
"id": 25,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 34,
"inputs": [
6,
9
],
"outputs": [
6,
9
],
"begins_at": 17,
"ends_at": 17,
"type": "collision"
},
{
"id": 20,
"inputs": [
19,
65535
],
"outputs": [
19,
65535
],
"begins_at": 18,
"ends_at": 18,
"type": "collision"
},
{
"id": 35,
"inputs": [
6,
9
],
"outputs": [
6,
9
],
"begins_at": 18,
"ends_at": 21,
"type": "contact"
},
{
"id": 26,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 18,
"ends_at": 23,
"type": "contact"
},
{
"id": 21,
"inputs": [
19,
65535
],
"outputs": [
19,
65535
],
"begins_at": 19,
"ends_at": 23,
"type": "contact"
},
{
"id": 18,
"inputs": [
2,
19
],
"outputs": [
2,
19
],
"begins_at": 20,
"ends_at": 20,
"type": "collision"
},
{
"id": 19,
"inputs": [
2,
19
],
"outputs": [
2,
19
],
"begins_at": 21,
"ends_at": 23,
"type": "contact"
},
{
"id": 3,
"inputs": [
1,
3
],
"outputs": [
1,
3
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 41,
"inputs": [
8,
9
],
"outputs": [
8,
9
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 49,
"inputs": [
9,
19
],
"outputs": [
9,
19
],
"begins_at": 22,
"ends_at": 22,
"type": "collision"
},
{
"id": 4,
"inputs": [
1,
3
],
"outputs": [
1,
3
],
"begins_at": 23,
"ends_at": 23,
"type": "contact"
},
{
"id": 50,
"inputs": [
9,
19
],
"outputs": [
9,
19
],
"begins_at": 23,
"ends_at": 23,
"type": "contact"
}
]
}Parsed ground truth
{
"objects": [
{
"id": 0,
"type": "red airliner",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 558,
"y": 128
},
{
"t": 1,
"x": 556,
"y": 128
},
{
"t": 2,
"x": 554,
"y": 127
},
{
"t": 3,
"x": 551,
"y": 127
},
{
"t": 5,
"x": 546,
"y": 126
},
{
"t": 6,
"x": 544,
"y": 126
},
{
"t": 8,
"x": 538,
"y": 125
},
{
"t": 10,
"x": 533,
"y": 124
},
{
"t": 11,
"x": 530,
"y": 123
},
{
"t": 13,
"x": 526,
"y": 122
},
{
"t": 14,
"x": 522,
"y": 121
},
{
"t": 15,
"x": 519,
"y": 121
},
{
"t": 16,
"x": 515,
"y": 121
},
{
"t": 18,
"x": 510,
"y": 120
},
{
"t": 19,
"x": 506,
"y": 119
},
{
"t": 20,
"x": 501,
"y": 118
},
{
"t": 21,
"x": 496,
"y": 117
},
{
"t": 22,
"x": 494,
"y": 117
},
{
"t": 24,
"x": 487,
"y": 115
},
{
"t": 25,
"x": 486,
"y": 116
},
{
"t": 26,
"x": 481,
"y": 115
},
{
"t": 27,
"x": 477,
"y": 114
},
{
"t": 28,
"x": 472,
"y": 113
},
{
"t": 29,
"x": 468,
"y": 111
},
{
"t": 30,
"x": 466,
"y": 109
},
{
"t": 31,
"x": 462,
"y": 102
},
{
"t": 32,
"x": 457,
"y": 94
},
{
"t": 33,
"x": 456,
"y": 89
},
{
"t": 34,
"x": 455,
"y": 83
},
{
"t": 35,
"x": 451,
"y": 79
},
{
"t": 36,
"x": 447,
"y": 75
},
{
"t": 37,
"x": 444,
"y": 72
},
{
"t": 38,
"x": 441,
"y": 69
},
{
"t": 39,
"x": 439,
"y": 67
},
{
"t": 40,
"x": 433,
"y": 59
},
{
"t": 41,
"x": 426,
"y": 52
},
{
"t": 42,
"x": 421,
"y": 46
},
{
"t": 43,
"x": 417,
"y": 42
},
{
"t": 44,
"x": 414,
"y": 38
},
{
"t": 45,
"x": 414,
"y": 29
},
{
"t": 46,
"x": 404,
"y": 28
},
{
"t": 47,
"x": 396,
"y": 26
},
{
"t": 48,
"x": 388,
"y": 25
},
{
"t": 49,
"x": 381,
"y": 24
},
{
"t": 50,
"x": 371,
"y": 25
},
{
"t": 51,
"x": 362,
"y": 25
},
{
"t": 52,
"x": 453,
"y": 58
},
{
"t": 53,
"x": 449,
"y": 55
},
{
"t": 54,
"x": 444,
"y": 53
},
{
"t": 55,
"x": 439,
"y": 50
},
{
"t": 56,
"x": 433,
"y": 48
},
{
"t": 57,
"x": 428,
"y": 46
},
{
"t": 58,
"x": 423,
"y": 44
},
{
"t": 59,
"x": 394,
"y": 18
},
{
"t": 60,
"x": 390,
"y": 17
},
{
"t": 61,
"x": 408,
"y": 36
},
{
"t": 62,
"x": 404,
"y": 33
},
{
"t": 63,
"x": 400,
"y": 30
},
{
"t": 64,
"x": 394,
"y": 29
},
{
"t": 65,
"x": 391,
"y": 25
},
{
"t": 66,
"x": 383,
"y": 24
},
{
"t": 67,
"x": 380,
"y": 22
},
{
"t": 68,
"x": 373,
"y": 21
},
{
"t": 69,
"x": 368,
"y": 20
},
{
"t": 70,
"x": 363,
"y": 19
},
{
"t": 71,
"x": 358,
"y": 19
},
{
"t": 72,
"x": 352,
"y": 19
},
{
"t": 73,
"x": 349,
"y": 17
},
{
"t": 74,
"x": 343,
"y": 18
},
{
"t": 75,
"x": 337,
"y": 19
},
{
"t": 76,
"x": 333,
"y": 20
},
{
"t": 77,
"x": 327,
"y": 21
},
{
"t": 78,
"x": 322,
"y": 24
},
{
"t": 79,
"x": 318,
"y": 25
},
{
"t": 80,
"x": 312,
"y": 28
},
{
"t": 81,
"x": 306,
"y": 32
},
{
"t": 82,
"x": 290,
"y": 21
},
{
"t": 83,
"x": 273,
"y": 15
},
{
"t": 84,
"x": 264,
"y": 16
},
{
"t": 85,
"x": 251,
"y": 16
},
{
"t": 86,
"x": 186,
"y": 16
},
{
"t": 87,
"x": 184,
"y": 18
},
{
"t": 88,
"x": 180,
"y": 21
},
{
"t": 89,
"x": 176,
"y": 25
},
{
"t": 90,
"x": 173,
"y": 32
},
{
"t": 91,
"x": 171,
"y": 43
},
{
"t": 92,
"x": 167,
"y": 53
},
{
"t": 93,
"x": 165,
"y": 65
},
{
"t": 94,
"x": 160,
"y": 75
},
{
"t": 95,
"x": 158,
"y": 89
},
{
"t": 96,
"x": 183,
"y": 97
},
{
"t": 97,
"x": 179,
"y": 106
},
{
"t": 98,
"x": 176,
"y": 120
},
{
"t": 99,
"x": 173,
"y": 134
},
{
"t": 100,
"x": 170,
"y": 149
},
{
"t": 101,
"x": 171,
"y": 164
},
{
"t": 102,
"x": 173,
"y": 179
},
{
"t": 103,
"x": 173,
"y": 193
},
{
"t": 104,
"x": 171,
"y": 209
},
{
"t": 105,
"x": 170,
"y": 225
},
{
"t": 106,
"x": 130,
"y": 253
},
{
"t": 107,
"x": 132,
"y": 270
},
{
"t": 108,
"x": 133,
"y": 288
},
{
"t": 109,
"x": 144,
"y": 300
},
{
"t": 110,
"x": 144,
"y": 318
},
{
"t": 111,
"x": 143,
"y": 335
},
{
"t": 112,
"x": 143,
"y": 353
},
{
"t": 113,
"x": 143,
"y": 372
},
{
"t": 114,
"x": 147,
"y": 386
},
{
"t": 115,
"x": 146,
"y": 404
},
{
"t": 116,
"x": 146,
"y": 422
},
{
"t": 117,
"x": 147,
"y": 441
},
{
"t": 118,
"x": 147,
"y": 459
},
{
"t": 119,
"x": 162,
"y": 469
}
],
"birth": 0,
"death": 120
},
{
"id": 1,
"type": "gray sedan",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 655,
"y": 705
}
],
"birth": 0,
"death": 120
},
{
"id": 2,
"type": "red fighter",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 977,
"y": 51
},
{
"t": 1,
"x": 976,
"y": 56
},
{
"t": 2,
"x": 953,
"y": 59
},
{
"t": 3,
"x": 940,
"y": 60
},
{
"t": 4,
"x": 977,
"y": 54
},
{
"t": 5,
"x": 973,
"y": 49
},
{
"t": 6,
"x": 968,
"y": 42
},
{
"t": 7,
"x": 953,
"y": 43
},
{
"t": 8,
"x": 936,
"y": 45
},
{
"t": 9,
"x": 919,
"y": 48
},
{
"t": 10,
"x": 903,
"y": 50
},
{
"t": 11,
"x": 887,
"y": 53
},
{
"t": 12,
"x": 872,
"y": 55
},
{
"t": 13,
"x": 855,
"y": 58
},
{
"t": 14,
"x": 841,
"y": 59
},
{
"t": 15,
"x": 825,
"y": 63
},
{
"t": 16,
"x": 811,
"y": 65
},
{
"t": 17,
"x": 795,
"y": 68
},
{
"t": 18,
"x": 781,
"y": 70
},
{
"t": 19,
"x": 766,
"y": 72
},
{
"t": 20,
"x": 753,
"y": 74
},
{
"t": 21,
"x": 739,
"y": 76
},
{
"t": 22,
"x": 726,
"y": 78
},
{
"t": 23,
"x": 712,
"y": 79
},
{
"t": 24,
"x": 699,
"y": 81
},
{
"t": 25,
"x": 686,
"y": 83
},
{
"t": 26,
"x": 673,
"y": 85
},
{
"t": 27,
"x": 661,
"y": 86
},
{
"t": 28,
"x": 648,
"y": 90
},
{
"t": 29,
"x": 636,
"y": 91
},
{
"t": 30,
"x": 626,
"y": 91
},
{
"t": 31,
"x": 619,
"y": 86
},
{
"t": 32,
"x": 610,
"y": 85
},
{
"t": 33,
"x": 601,
"y": 81
},
{
"t": 34,
"x": 593,
"y": 78
},
{
"t": 35,
"x": 583,
"y": 77
},
{
"t": 36,
"x": 575,
"y": 75
},
{
"t": 37,
"x": 565,
"y": 73
},
{
"t": 38,
"x": 555,
"y": 71
},
{
"t": 39,
"x": 543,
"y": 75
},
{
"t": 40,
"x": 534,
"y": 80
},
{
"t": 41,
"x": 524,
"y": 88
},
{
"t": 42,
"x": 514,
"y": 95
},
{
"t": 43,
"x": 505,
"y": 101
},
{
"t": 44,
"x": 495,
"y": 107
},
{
"t": 45,
"x": 486,
"y": 115
},
{
"t": 46,
"x": 476,
"y": 122
},
{
"t": 47,
"x": 467,
"y": 128
},
{
"t": 48,
"x": 458,
"y": 134
},
{
"t": 49,
"x": 449,
"y": 142
},
{
"t": 50,
"x": 441,
"y": 149
},
{
"t": 51,
"x": 430,
"y": 158
},
{
"t": 52,
"x": 422,
"y": 166
},
{
"t": 53,
"x": 414,
"y": 172
},
{
"t": 54,
"x": 405,
"y": 179
},
{
"t": 55,
"x": 398,
"y": 185
},
{
"t": 56,
"x": 390,
"y": 194
},
{
"t": 57,
"x": 381,
"y": 199
},
{
"t": 58,
"x": 374,
"y": 206
},
{
"t": 59,
"x": 366,
"y": 215
},
{
"t": 60,
"x": 358,
"y": 221
},
{
"t": 61,
"x": 351,
"y": 229
},
{
"t": 62,
"x": 344,
"y": 238
},
{
"t": 63,
"x": 337,
"y": 246
},
{
"t": 64,
"x": 330,
"y": 253
},
{
"t": 65,
"x": 324,
"y": 261
},
{
"t": 66,
"x": 317,
"y": 270
},
{
"t": 67,
"x": 311,
"y": 279
},
{
"t": 68,
"x": 305,
"y": 288
},
{
"t": 69,
"x": 299,
"y": 297
},
{
"t": 70,
"x": 294,
"y": 307
},
{
"t": 71,
"x": 288,
"y": 317
},
{
"t": 72,
"x": 283,
"y": 327
},
{
"t": 73,
"x": 278,
"y": 336
},
{
"t": 74,
"x": 273,
"y": 346
},
{
"t": 75,
"x": 269,
"y": 357
},
{
"t": 76,
"x": 264,
"y": 368
},
{
"t": 77,
"x": 259,
"y": 376
},
{
"t": 78,
"x": 255,
"y": 388
},
{
"t": 79,
"x": 251,
"y": 399
},
{
"t": 80,
"x": 246,
"y": 409
},
{
"t": 82,
"x": 246,
"y": 414
},
{
"t": 83,
"x": 246,
"y": 419
},
{
"t": 84,
"x": 247,
"y": 422
},
{
"t": 85,
"x": 246,
"y": 427
},
{
"t": 86,
"x": 245,
"y": 432
},
{
"t": 87,
"x": 244,
"y": 439
},
{
"t": 88,
"x": 242,
"y": 446
},
{
"t": 89,
"x": 239,
"y": 454
},
{
"t": 90,
"x": 236,
"y": 463
},
{
"t": 91,
"x": 233,
"y": 472
},
{
"t": 92,
"x": 230,
"y": 480
},
{
"t": 93,
"x": 227,
"y": 476
},
{
"t": 94,
"x": 226,
"y": 472
},
{
"t": 95,
"x": 223,
"y": 468
},
{
"t": 96,
"x": 221,
"y": 466
},
{
"t": 97,
"x": 218,
"y": 464
},
{
"t": 98,
"x": 215,
"y": 460
},
{
"t": 100,
"x": 212,
"y": 457
},
{
"t": 102,
"x": 209,
"y": 456
},
{
"t": 103,
"x": 206,
"y": 454
},
{
"t": 104,
"x": 205,
"y": 453
},
{
"t": 105,
"x": 202,
"y": 452
},
{
"t": 106,
"x": 200,
"y": 450
},
{
"t": 107,
"x": 196,
"y": 450
},
{
"t": 108,
"x": 169,
"y": 463
},
{
"t": 109,
"x": 162,
"y": 468
},
{
"t": 111,
"x": 186,
"y": 449
},
{
"t": 112,
"x": 183,
"y": 450
},
{
"t": 113,
"x": 182,
"y": 448
},
{
"t": 114,
"x": 180,
"y": 448
},
{
"t": 116,
"x": 176,
"y": 448
},
{
"t": 117,
"x": 176,
"y": 451
},
{
"t": 118,
"x": 119,
"y": 472
},
{
"t": 119,
"x": 112,
"y": 473
}
],
"birth": 0,
"death": 120
},
{
"id": 3,
"type": "cyan chopper",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 2,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": false
},
{
"t": 2,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 2,
"x": 203,
"y": 998
},
{
"t": 3,
"x": 208,
"y": 991
},
{
"t": 4,
"x": 225,
"y": 988
},
{
"t": 5,
"x": 229,
"y": 981
},
{
"t": 6,
"x": 232,
"y": 976
},
{
"t": 7,
"x": 228,
"y": 971
},
{
"t": 8,
"x": 231,
"y": 966
},
{
"t": 9,
"x": 234,
"y": 965
},
{
"t": 10,
"x": 237,
"y": 949
},
{
"t": 11,
"x": 241,
"y": 944
},
{
"t": 12,
"x": 244,
"y": 930
},
{
"t": 13,
"x": 248,
"y": 925
},
{
"t": 14,
"x": 251,
"y": 914
},
{
"t": 15,
"x": 242,
"y": 960
},
{
"t": 16,
"x": 245,
"y": 950
},
{
"t": 17,
"x": 248,
"y": 940
},
{
"t": 18,
"x": 251,
"y": 928
},
{
"t": 19,
"x": 254,
"y": 920
},
{
"t": 20,
"x": 256,
"y": 911
},
{
"t": 21,
"x": 258,
"y": 902
},
{
"t": 22,
"x": 261,
"y": 894
},
{
"t": 23,
"x": 264,
"y": 885
},
{
"t": 24,
"x": 266,
"y": 876
},
{
"t": 25,
"x": 269,
"y": 869
},
{
"t": 26,
"x": 271,
"y": 861
},
{
"t": 27,
"x": 273,
"y": 852
},
{
"t": 28,
"x": 276,
"y": 846
},
{
"t": 29,
"x": 277,
"y": 839
},
{
"t": 30,
"x": 280,
"y": 830
},
{
"t": 31,
"x": 281,
"y": 825
},
{
"t": 32,
"x": 283,
"y": 818
},
{
"t": 33,
"x": 286,
"y": 811
},
{
"t": 34,
"x": 287,
"y": 804
},
{
"t": 35,
"x": 289,
"y": 800
},
{
"t": 36,
"x": 291,
"y": 793
},
{
"t": 37,
"x": 293,
"y": 786
},
{
"t": 38,
"x": 294,
"y": 781
},
{
"t": 39,
"x": 296,
"y": 773
},
{
"t": 40,
"x": 298,
"y": 772
},
{
"t": 41,
"x": 299,
"y": 766
},
{
"t": 42,
"x": 301,
"y": 759
},
{
"t": 43,
"x": 308,
"y": 743
},
{
"t": 44,
"x": 309,
"y": 738
},
{
"t": 45,
"x": 305,
"y": 745
},
{
"t": 46,
"x": 312,
"y": 727
},
{
"t": 47,
"x": 313,
"y": 724
},
{
"t": 48,
"x": 315,
"y": 719
},
{
"t": 49,
"x": 311,
"y": 727
},
{
"t": 50,
"x": 317,
"y": 710
},
{
"t": 52,
"x": 319,
"y": 703
},
{
"t": 53,
"x": 320,
"y": 699
},
{
"t": 54,
"x": 322,
"y": 695
},
{
"t": 55,
"x": 323,
"y": 691
},
{
"t": 56,
"x": 323,
"y": 688
},
{
"t": 57,
"x": 324,
"y": 684
},
{
"t": 58,
"x": 325,
"y": 681
},
{
"t": 59,
"x": 326,
"y": 677
},
{
"t": 60,
"x": 327,
"y": 673
},
{
"t": 61,
"x": 328,
"y": 671
},
{
"t": 62,
"x": 329,
"y": 668
},
{
"t": 63,
"x": 330,
"y": 664
},
{
"t": 64,
"x": 330,
"y": 660
},
{
"t": 65,
"x": 332,
"y": 655
},
{
"t": 66,
"x": 333,
"y": 652
},
{
"t": 67,
"x": 333,
"y": 650
},
{
"t": 68,
"x": 334,
"y": 647
},
{
"t": 69,
"x": 335,
"y": 645
},
{
"t": 70,
"x": 336,
"y": 641
},
{
"t": 71,
"x": 337,
"y": 638
},
{
"t": 72,
"x": 337,
"y": 634
},
{
"t": 73,
"x": 338,
"y": 632
},
{
"t": 74,
"x": 339,
"y": 629
},
{
"t": 75,
"x": 340,
"y": 627
},
{
"t": 76,
"x": 341,
"y": 624
},
{
"t": 77,
"x": 341,
"y": 622
},
{
"t": 78,
"x": 342,
"y": 620
},
{
"t": 79,
"x": 342,
"y": 617
},
{
"t": 80,
"x": 343,
"y": 614
},
{
"t": 81,
"x": 344,
"y": 611
},
{
"t": 83,
"x": 345,
"y": 606
},
{
"t": 84,
"x": 345,
"y": 617
},
{
"t": 85,
"x": 346,
"y": 603
},
{
"t": 86,
"x": 348,
"y": 594
},
{
"t": 87,
"x": 347,
"y": 607
},
{
"t": 88,
"x": 349,
"y": 588
},
{
"t": 90,
"x": 349,
"y": 603
},
{
"t": 91,
"x": 349,
"y": 600
},
{
"t": 92,
"x": 349,
"y": 597
},
{
"t": 93,
"x": 351,
"y": 577
},
{
"t": 94,
"x": 351,
"y": 594
},
{
"t": 96,
"x": 352,
"y": 580
},
{
"t": 97,
"x": 352,
"y": 588
},
{
"t": 99,
"x": 353,
"y": 584
},
{
"t": 100,
"x": 355,
"y": 548
},
{
"t": 101,
"x": 355,
"y": 580
},
{
"t": 103,
"x": 355,
"y": 577
},
{
"t": 105,
"x": 356,
"y": 573
},
{
"t": 107,
"x": 357,
"y": 569
},
{
"t": 109,
"x": 358,
"y": 567
},
{
"t": 111,
"x": 359,
"y": 561
},
{
"t": 113,
"x": 359,
"y": 527
},
{
"t": 114,
"x": 360,
"y": 557
},
{
"t": 115,
"x": 360,
"y": 525
},
{
"t": 117,
"x": 361,
"y": 522
},
{
"t": 118,
"x": 362,
"y": 551
}
],
"birth": 2,
"death": 120
}
],
"interactions": [
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 119,
"type": "contact"
},
{
"id": 8,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 119,
"type": "contact"
},
{
"id": 0,
"inputs": [
0,
2
],
"outputs": [
0,
2
],
"begins_at": 30,
"ends_at": 30,
"type": "collision"
},
{
"id": 1,
"inputs": [
0,
2
],
"outputs": [
0,
2
],
"begins_at": 40,
"ends_at": 40,
"type": "collision"
},
{
"id": 6,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 81,
"ends_at": 82,
"type": "collision"
},
{
"id": 7,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 93,
"ends_at": 93,
"type": "collision"
},
{
"id": 3,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 109,
"ends_at": 109,
"type": "collision"
},
{
"id": 4,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 111,
"ends_at": 111,
"type": "collision"
},
{
"id": 5,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 119,
"ends_at": 119,
"type": "collision"
}
]
}Full per-sample metric report
{
"metrics": {
"avg_type_similarity": 0.4225822423164132,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 306.0097917837171,
"avg_image_position_segmentation_acc": 0.31684322033898304,
"avg_image_position_segmentation_acc_small": null,
"avg_image_position_segmentation_acc_medium": 0.0211864406779661,
"avg_image_position_segmentation_acc_large": 0.6125,
"avg_image_position_segmentation_acc_first_frame": 0.3333333333333333,
"avg_image_position_segmentation_visible_acc": 0.31684322033898304,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 0.9958333333333333,
"visibility_true_acc": 1.0,
"visibility_false_acc": 0.0,
"is_in_frame_acc": 0.9958333333333333,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 0.0,
"vis_acc_from_px": 0.9958333333333333,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 0.0,
"num_matches": 4,
"num_unmatched_pred": 16,
"num_unmatched_target": 0
},
"supports": {
"avg_type_similarity": 4,
"avg_size_diff": 0,
"avg_3d_iou": 0,
"avg_image_position_px_diff": 4,
"avg_image_position_segmentation_acc": 4,
"avg_image_position_segmentation_acc_small": 0,
"avg_image_position_segmentation_acc_medium": 2,
"avg_image_position_segmentation_acc_large": 2,
"avg_image_position_segmentation_acc_first_frame": 3,
"avg_image_position_segmentation_visible_acc": 4,
"avg_quaternion_geodesic_deg": 0,
"visibility_acc": 4,
"visibility_true_acc": 4,
"visibility_false_acc": 1,
"is_in_frame_acc": 4,
"is_in_frame_true_acc": 4,
"is_in_frame_false_acc": 1,
"vis_acc_from_px": 4,
"vis_acc_from_px_true_acc": 4,
"vis_acc_from_px_false_acc": 1
},
"matching": {
"matches": [
{
"target_index": 0,
"pred_index": 0,
"target_id": 0,
"pred_id": 0,
"cost": 1.0,
"cost_breakdown": [
{
"name": "mutual_type",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "same_seg",
"weight": 1.0,
"raw_cost": 1.0,
"weighted_cost": 1.0,
"used_missing_value": false
}
]
},
{
"target_index": 1,
"pred_index": 13,
"target_id": 1,
"pred_id": 13,
"cost": 0.5,
"cost_breakdown": [
{
"name": "mutual_type",
"weight": 1.0,
"raw_cost": 0.5,
"weighted_cost": 0.5,
"used_missing_value": false
},
{
"name": "same_seg",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
}
]
},
{
"target_index": 2,
"pred_index": 3,
"target_id": 2,
"pred_id": 3,
"cost": 1.275,
"cost_breakdown": [
{
"name": "mutual_type",
"weight": 1.0,
"raw_cost": 0.5,
"weighted_cost": 0.5,
"used_missing_value": false
},
{
"name": "same_seg",
"weight": 1.0,
"raw_cost": 0.775,
"weighted_cost": 0.775,
"used_missing_value": false
}
]
},
{
"target_index": 3,
"pred_index": 7,
"target_id": 3,
"pred_id": 7,
"cost": 1.957627118644068,
"cost_breakdown": [
{
"name": "mutual_type",
"weight": 1.0,
"raw_cost": 1.0,
"weighted_cost": 1.0,
"used_missing_value": false
},
{
"name": "same_seg",
"weight": 1.0,
"raw_cost": 0.9576271186440678,
"weighted_cost": 0.9576271186440678,
"used_missing_value": false
}
]
}
],
"unmatched_target_ids": [],
"unmatched_pred_ids": [
1,
2,
4,
5,
6,
8,
9,
10,
11,
12,
14,
15,
16,
17,
18,
19
],
"target_type_counts": {
"red airliner": 1,
"gray sedan": 1,
"red fighter": 1,
"cyan chopper": 1
},
"pred_type_counts": {
"red plastic toy airplane": 1,
"brown leather desk caddy": 1,
"red and black plastic handheld gaming console": 2,
"white cardboard ink cartridge box": 1,
"white and blue cardboard stool softener box": 1,
"white cardboard neck therapy box": 1,
"red and yellow wooden toy airplane with pilot": 4,
"white and red cardboard ink cartridge box": 3,
"grey and black basketball shoe": 1,
"grey plastic Nintendo 64 game cartridge": 1,
"grey metallic cake pan": 1,
"red and white cardboard ink cartridge box": 1,
"red leather boot": 2
},
"assignment_backend": "scipy_dense",
"cost_functions": [
"mutual_type",
"same_seg"
],
"cost_weights": {
"mutual_type": 1.0,
"same_seg": 1.0
},
"num_frames": 120
},
"scene_metrics": {
"thresholds": [
0.5,
1.0,
2.0,
3.0
],
"counts_by_threshold": {
"0.5": {
"true_positives": 3,
"false_positives": 1,
"false_negatives": 0
},
"1.0": {
"true_positives": 1,
"false_positives": 3,
"false_negatives": 0
},
"2.0": {
"true_positives": 0,
"false_positives": 4,
"false_negatives": 0
},
"3.0": {
"true_positives": 0,
"false_positives": 4,
"false_negatives": 0
}
},
"jaccard_by_threshold": {
"0.5": 0.75,
"1.0": 0.25,
"2.0": 0.0,
"3.0": 0.0
},
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 4,
"false_positives": 16,
"false_negatives": 0
},
"0.5": {
"true_positives": 4,
"false_positives": 16,
"false_negatives": 0
},
"0.75": {
"true_positives": 4,
"false_positives": 16,
"false_negatives": 0
},
"1.0": {
"true_positives": 3,
"false_positives": 17,
"false_negatives": 1
}
},
"visibility_precision_by_threshold": {
"0.25": 0.2,
"0.5": 0.2,
"0.75": 0.2,
"1.0": 0.15
},
"visibility_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 0.75
},
"visibility_f1_by_threshold": {
"0.25": 0.33333333333333337,
"0.5": 0.33333333333333337,
"0.75": 0.33333333333333337,
"1.0": 0.24999999999999997
},
"visibility_by_motion_group": {
"static": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 2,
"false_positives": 0,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 0,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 0,
"false_negatives": 0
},
"1.0": {
"true_positives": 1,
"false_positives": 1,
"false_negatives": 1
}
},
"visibility_precision_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 0.5
},
"visibility_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 0.5
},
"visibility_f1_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 0.5
}
},
"dynamic": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 2,
"false_positives": 0,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 0,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 0,
"false_negatives": 0
},
"1.0": {
"true_positives": 2,
"false_positives": 0,
"false_negatives": 0
}
},
"visibility_precision_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"visibility_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"visibility_f1_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
}
},
"unknown": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 16,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 16,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 16,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 16,
"false_negatives": 0
}
},
"visibility_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"segmentation_counts_by_threshold": {
"0.25": {
"true_positives": 1,
"false_positives": 19,
"false_negatives": 3
},
"0.5": {
"true_positives": 1,
"false_positives": 19,
"false_negatives": 3
},
"0.75": {
"true_positives": 1,
"false_positives": 19,
"false_negatives": 3
},
"1.0": {
"true_positives": 1,
"false_positives": 19,
"false_negatives": 3
}
},
"segmentation_precision_by_threshold": {
"0.25": 0.05,
"0.5": 0.05,
"0.75": 0.05,
"1.0": 0.05
},
"segmentation_recall_by_threshold": {
"0.25": 0.25,
"0.5": 0.25,
"0.75": 0.25,
"1.0": 0.25
},
"segmentation_f1_by_threshold": {
"0.25": 0.08333333333333334,
"0.5": 0.08333333333333334,
"0.75": 0.08333333333333334,
"1.0": 0.08333333333333334
},
"segmentation_frame_average_precision": 0.05,
"segmentation_frame_average_recall": 0.25,
"segmentation_frame_average_f1": 0.08333333333333334,
"segmentation_first_frame_counts": {
"true_positives": 1,
"false_positives": 19,
"false_negatives": 0
},
"segmentation_first_frame_precision": 0.05,
"segmentation_first_frame_recall": 1.0,
"segmentation_first_frame_f1": 0.09523809523809523,
"segmentation_by_motion_group": {
"static": {
"segmentation_counts_by_threshold": {
"0.25": {
"true_positives": 1,
"false_positives": 1,
"false_negatives": 1
},
"0.5": {
"true_positives": 1,
"false_positives": 1,
"false_negatives": 1
},
"0.75": {
"true_positives": 1,
"false_positives": 1,
"false_negatives": 1
},
"1.0": {
"true_positives": 1,
"false_positives": 1,
"false_negatives": 1
}
},
"segmentation_precision_by_threshold": {
"0.25": 0.5,
"0.5": 0.5,
"0.75": 0.5,
"1.0": 0.5
},
"segmentation_recall_by_threshold": {
"0.25": 0.5,
"0.5": 0.5,
"0.75": 0.5,
"1.0": 0.5
},
"segmentation_f1_by_threshold": {
"0.25": 0.5,
"0.5": 0.5,
"0.75": 0.5,
"1.0": 0.5
},
"segmentation_frame_average_precision": 0.5,
"segmentation_frame_average_recall": 0.5,
"segmentation_frame_average_f1": 0.5,
"segmentation_first_frame_counts": {
"true_positives": 1,
"false_positives": 1,
"false_negatives": 0
},
"segmentation_first_frame_precision": 0.5,
"segmentation_first_frame_recall": 1.0,
"segmentation_first_frame_f1": 0.6666666666666666
},
"dynamic": {
"segmentation_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 2
},
"0.5": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 2
},
"0.75": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 2
},
"1.0": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 2
}
},
"segmentation_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_frame_average_precision": 0.0,
"segmentation_frame_average_recall": 0.0,
"segmentation_frame_average_f1": 0.0,
"segmentation_first_frame_counts": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 0
},
"segmentation_first_frame_precision": 0.0,
"segmentation_first_frame_recall": 0.0,
"segmentation_first_frame_f1": 0.0
},
"unknown": {
"segmentation_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 16,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 16,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 16,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 16,
"false_negatives": 0
}
},
"segmentation_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_frame_average_precision": 0.0,
"segmentation_frame_average_recall": 0.0,
"segmentation_frame_average_f1": 0.0,
"segmentation_first_frame_counts": {
"true_positives": 0,
"false_positives": 16,
"false_negatives": 0
},
"segmentation_first_frame_precision": 0.0,
"segmentation_first_frame_recall": 0.0,
"segmentation_first_frame_f1": 0.0
}
}
},
"per_match_metrics": [
{
"target_id": 0,
"pred_id": 0,
"cost": 1.0,
"type_similarity": 0.6708318835402924,
"size_diff": null,
"3d_iou": null,
"image_position_px_diff": 555.3400081605616,
"image_position_segmentation_acc": 0.0,
"image_position_segmentation_acc_small": null,
"image_position_segmentation_acc_medium": 0.0,
"image_position_segmentation_acc_large": null,
"image_position_segmentation_acc_first_frame": 0.0,
"image_position_segmentation_visible_acc": 0.0,
"quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": null
},
{
"target_id": 1,
"pred_id": 13,
"cost": 0.5,
"type_similarity": 0.3821406552643119,
"size_diff": null,
"3d_iou": null,
"image_position_px_diff": 54.089716010432205,
"image_position_segmentation_acc": 1.0,
"image_position_segmentation_acc_small": null,
"image_position_segmentation_acc_medium": null,
"image_position_segmentation_acc_large": 1.0,
"image_position_segmentation_acc_first_frame": 1.0,
"image_position_segmentation_visible_acc": 1.0,
"quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": null
},
{
"target_id": 2,
"pred_id": 3,
"cost": 1.275,
"type_similarity": 0.37625847236797616,
"size_diff": null,
"3d_iou": null,
"image_position_px_diff": 399.262242246694,
"image_position_segmentation_acc": 0.225,
"image_position_segmentation_acc_small": null,
"image_position_segmentation_acc_medium": null,
"image_position_segmentation_acc_large": 0.225,
"image_position_segmentation_acc_first_frame": 0.0,
"image_position_segmentation_visible_acc": 0.225,
"quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": null
},
{
"target_id": 3,
"pred_id": 7,
"cost": 1.957627118644068,
"type_similarity": 0.26109795809307257,
"size_diff": null,
"3d_iou": null,
"image_position_px_diff": 215.34720071718073,
"image_position_segmentation_acc": 0.0423728813559322,
"image_position_segmentation_acc_small": null,
"image_position_segmentation_acc_medium": 0.0423728813559322,
"image_position_segmentation_acc_large": null,
"image_position_segmentation_acc_first_frame": null,
"image_position_segmentation_visible_acc": 0.0423728813559322,
"quaternion_geodesic_deg": null,
"visibility_acc": 0.9833333333333333,
"visibility_true_acc": 1.0,
"visibility_false_acc": 0.0,
"is_in_frame_acc": 0.9833333333333333,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 0.0,
"vis_acc_from_px": 0.9833333333333333,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 0.0
}
],
"interaction_metrics": {
"avg_interaction_temporal_span_giou": -0.6806594710776044,
"avg_interaction_input_object_jaccard": 0.3333333333333333,
"avg_interaction_output_object_jaccard": 0.3333333333333333,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 9,
"num_unmatched_pred_interactions": 45,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 54,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 54,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 54,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 54,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 5,
"false_positives": 49,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 52,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 52,
"false_negatives": 0
},
"1.0": {
"true_positives": 2,
"false_positives": 52,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.09259259259259259,
"0.5": 0.037037037037037035,
"0.75": 0.037037037037037035,
"1.0": 0.037037037037037035
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.1694915254237288,
"0.5": 0.07142857142857142,
"0.75": 0.07142857142857142,
"1.0": 0.07142857142857142
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 5,
"false_positives": 49,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 52,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 52,
"false_negatives": 0
},
"1.0": {
"true_positives": 2,
"false_positives": 52,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.09259259259259259,
"0.5": 0.037037037037037035,
"0.75": 0.037037037037037035,
"1.0": 0.037037037037037035
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.1694915254237288,
"0.5": 0.07142857142857142,
"0.75": 0.07142857142857142,
"1.0": 0.07142857142857142
}
},
"interaction_supports": {
"avg_interaction_temporal_span_giou": 9,
"avg_interaction_input_object_jaccard": 9,
"avg_interaction_output_object_jaccard": 9,
"avg_interaction_type_exact_match_acc": 9
},
"interaction_matching": {
"matches": [
{
"target_index": 0,
"pred_index": 44,
"target_id": 0,
"pred_id": 41,
"cost": 1.3888888888888888,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.8888888888888888,
"weighted_cost": 0.8888888888888888,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 1,
"pred_index": 5,
"target_id": 1,
"pred_id": 3,
"cost": 0.9473684210526316,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.9473684210526316,
"weighted_cost": 0.9473684210526316,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
}
]
},
{
"target_index": 2,
"pred_index": 11,
"target_id": 2,
"pred_id": 8,
"cost": 0.4,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.4,
"weighted_cost": 0.4,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
}
]
},
{
"target_index": 3,
"pred_index": 21,
"target_id": 3,
"pred_id": 18,
"cost": 1.488888888888889,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.9888888888888889,
"weighted_cost": 0.9888888888888889,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 4,
"pred_index": 23,
"target_id": 4,
"pred_id": 20,
"cost": 1.4893617021276595,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.9893617021276595,
"weighted_cost": 0.9893617021276595,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 5,
"pred_index": 28,
"target_id": 5,
"pred_id": 25,
"cost": 1.4902912621359223,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.9902912621359223,
"weighted_cost": 0.9902912621359223,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 6,
"pred_index": 52,
"target_id": 6,
"pred_id": 49,
"cost": 1.4754098360655736,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.9754098360655737,
"weighted_cost": 0.9754098360655737,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 7,
"pred_index": 26,
"target_id": 7,
"pred_id": 23,
"cost": 1.4827586206896552,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.9827586206896552,
"weighted_cost": 0.9827586206896552,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 8,
"pred_index": 39,
"target_id": 8,
"pred_id": 36,
"cost": 0.4,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.4,
"weighted_cost": 0.4,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
}
]
}
],
"unmatched_target_ids": [],
"unmatched_pred_ids": [
0,
1,
1,
2,
3,
4,
4,
5,
6,
7,
9,
10,
11,
12,
13,
14,
15,
16,
17,
19,
21,
22,
24,
26,
27,
28,
29,
30,
31,
32,
33,
34,
35,
37,
38,
39,
40,
42,
43,
44,
45,
46,
47,
48,
50
],
"target_type_counts": {
"collision": 7,
"contact": 2
},
"pred_type_counts": {
"contact": 37,
"collision": 17
},
"assignment_backend": "scipy_dense",
"cost_functions": [
"type_exact",
"temporal_span",
"input_object_set_mutual_jaccard",
"output_object_set_mutual_jaccard"
],
"cost_weights": {
"type_exact": 1.0,
"temporal_span": 1.0,
"input_object_set_mutual_jaccard": 0.5,
"output_object_set_mutual_jaccard": 0.5
}
},
"per_interaction_match_metrics": [
{
"target_index": 0,
"pred_index": 44,
"target_id": 0,
"pred_id": 41,
"target_type": "collision",
"pred_type": "collision",
"cost": 1.3888888888888888,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.7777777777777778,
"input_object_jaccard": 0.0,
"output_object_jaccard": 0.0,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 1,
"pred_index": 5,
"target_id": 1,
"pred_id": 3,
"target_type": "collision",
"pred_type": "collision",
"cost": 0.9473684210526316,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.8947368421052632,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 2,
"pred_index": 11,
"target_id": 2,
"pred_id": 8,
"target_type": "contact",
"pred_type": "contact",
"cost": 0.4,
"temporal_span_iou": 0.2,
"temporal_span_giou": 0.2,
"input_object_jaccard": 1.0,
"output_object_jaccard": 1.0,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 1.0,
"output_object_set_exact_match": 1.0
},
{
"target_index": 3,
"pred_index": 21,
"target_id": 3,
"pred_id": 18,
"target_type": "collision",
"pred_type": "collision",
"cost": 1.488888888888889,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.9777777777777777,
"input_object_jaccard": 0.0,
"output_object_jaccard": 0.0,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 4,
"pred_index": 23,
"target_id": 4,
"pred_id": 20,
"target_type": "collision",
"pred_type": "collision",
"cost": 1.4893617021276595,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.9787234042553191,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 5,
"pred_index": 28,
"target_id": 5,
"pred_id": 25,
"target_type": "collision",
"pred_type": "collision",
"cost": 1.4902912621359223,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.9805825242718447,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 6,
"pred_index": 52,
"target_id": 6,
"pred_id": 49,
"target_type": "collision",
"pred_type": "collision",
"cost": 1.4754098360655736,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.9508196721311475,
"input_object_jaccard": 0.0,
"output_object_jaccard": 0.0,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 7,
"pred_index": 26,
"target_id": 7,
"pred_id": 23,
"target_type": "collision",
"pred_type": "collision",
"cost": 1.4827586206896552,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.9655172413793104,
"input_object_jaccard": 0.0,
"output_object_jaccard": 0.0,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 8,
"pred_index": 39,
"target_id": 8,
"pred_id": 36,
"target_type": "contact",
"pred_type": "contact",
"cost": 0.4,
"temporal_span_iou": 0.2,
"temporal_span_giou": 0.2,
"input_object_jaccard": 1.0,
"output_object_jaccard": 1.0,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 1.0,
"output_object_set_exact_match": 1.0
}
],
"interaction_metrics_by_participants": {
"object_ground": {
"avg_interaction_temporal_span_giou": -0.6362029456879142,
"avg_interaction_input_object_jaccard": 0.38095238095238093,
"avg_interaction_output_object_jaccard": 0.38095238095238093,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 7,
"num_unmatched_pred_interactions": 24,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 31,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 31,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 31,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 31,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 4,
"false_positives": 27,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 29,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 29,
"false_negatives": 0
},
"1.0": {
"true_positives": 2,
"false_positives": 29,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.12903225806451613,
"0.5": 0.06451612903225806,
"0.75": 0.06451612903225806,
"1.0": 0.06451612903225806
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.2285714285714286,
"0.5": 0.12121212121212122,
"0.75": 0.12121212121212122,
"1.0": 0.12121212121212122
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 4,
"false_positives": 27,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 29,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 29,
"false_negatives": 0
},
"1.0": {
"true_positives": 2,
"false_positives": 29,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.12903225806451613,
"0.5": 0.06451612903225806,
"0.75": 0.06451612903225806,
"1.0": 0.06451612903225806
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.2285714285714286,
"0.5": 0.12121212121212122,
"0.75": 0.12121212121212122,
"1.0": 0.12121212121212122
}
},
"object_object": {
"avg_interaction_temporal_span_giou": -0.8362573099415205,
"avg_interaction_input_object_jaccard": 0.16666666666666666,
"avg_interaction_output_object_jaccard": 0.16666666666666666,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 2,
"num_unmatched_pred_interactions": 21,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 1,
"false_positives": 22,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.043478260869565216,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.08333333333333333,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 1,
"false_positives": 22,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.043478260869565216,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.08333333333333333,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"interaction_supports_by_participants": {
"object_ground": {
"avg_interaction_temporal_span_giou": 7,
"avg_interaction_input_object_jaccard": 7,
"avg_interaction_output_object_jaccard": 7,
"avg_interaction_type_exact_match_acc": 7
},
"object_object": {
"avg_interaction_temporal_span_giou": 2,
"avg_interaction_input_object_jaccard": 2,
"avg_interaction_output_object_jaccard": 2,
"avg_interaction_type_exact_match_acc": 2
}
},
"interaction_metrics_by_type": {
"collision": {
"avg_interaction_temporal_span_giou": -0.9322764628140628,
"avg_interaction_input_object_jaccard": 0.14285714285714285,
"avg_interaction_output_object_jaccard": 0.14285714285714285,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 7,
"num_unmatched_pred_interactions": 10,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 17,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 17,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 17,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 17,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 14,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 17,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 17,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 17,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.17647058823529413,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.3,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 14,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 17,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 17,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 17,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.17647058823529413,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.3,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"contact": {
"avg_interaction_temporal_span_giou": 0.2,
"avg_interaction_input_object_jaccard": 1.0,
"avg_interaction_output_object_jaccard": 1.0,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 2,
"num_unmatched_pred_interactions": 35,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 37,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 37,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 37,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 37,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 2,
"false_positives": 35,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 35,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 35,
"false_negatives": 0
},
"1.0": {
"true_positives": 2,
"false_positives": 35,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.05405405405405406,
"0.5": 0.05405405405405406,
"0.75": 0.05405405405405406,
"1.0": 0.05405405405405406
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.10256410256410257,
"0.5": 0.10256410256410257,
"0.75": 0.10256410256410257,
"1.0": 0.10256410256410257
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 2,
"false_positives": 35,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 35,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 35,
"false_negatives": 0
},
"1.0": {
"true_positives": 2,
"false_positives": 35,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.05405405405405406,
"0.5": 0.05405405405405406,
"0.75": 0.05405405405405406,
"1.0": 0.05405405405405406
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.10256410256410257,
"0.5": 0.10256410256410257,
"0.75": 0.10256410256410257,
"1.0": 0.10256410256410257
}
}
},
"interaction_supports_by_type": {
"collision": {
"avg_interaction_temporal_span_giou": 7,
"avg_interaction_input_object_jaccard": 7,
"avg_interaction_output_object_jaccard": 7,
"avg_interaction_type_exact_match_acc": 7
},
"contact": {
"avg_interaction_temporal_span_giou": 2,
"avg_interaction_input_object_jaccard": 2,
"avg_interaction_output_object_jaccard": 2,
"avg_interaction_type_exact_match_acc": 2
}
}
}Inference record
{
"prompt": "user\n\nAnalyze the provided video and return ONLY a valid sentinel sequence in this format:\n[SCENE-START] [OBJS-START]\n[OBJ] id \"type\" birth death [VIS] t vis ... [IN-FRAME] t is_in_frame ... [PX] t px py ...\n[OBJ] ...\n[OBJS-END]\n[INTERACTIONS-START]\n[INTERACT] id \"type\" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ...\n[INTERACT] ...\n[INTERACTIONS-END] [SCENE-END]\n\nConstraints:\n- Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose).\n- Keep tags exactly as written:\n `[SCENE-START] [OBJS-START] [OBJ] [VIS] [IN-FRAME] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]`\n- Use quoted strings for `type` (double quotes).\n- `VIS` uses repeated groups of 2 values in order:\n `t vis`.\n `vis` is a boolean value.\n- `IN-FRAME` uses repeated groups of 2 values in order:\n `t is_in_frame`.\n `is_in_frame` is a boolean value.\n- `PX` uses repeated groups of 3 values in order: `t px py`.\n- `px` and `py` are normalized pixel coordinates in the range `[0, 1]`,\n scaled by `1000` and then converted to integers by dropping the decimal part.\n- For occluded or out-of-frame frames under this setting, `PX` may use `t null null`.\n- `IN` and `OUT` contain whitespace-separated integer ids.\n- Use lowercase booleans (`true`/`false`) for `vis` and `is_in_frame`.\nassistant\n",
"predict": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red plastic toy airplane\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 1 455 10 13 455 17 21 451 [OBJ] 1 \"brown leather desk caddy\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 5 529 11 9 537 13 13 544 22 13 533 [OBJ] 2 \"red and black plastic handheld gaming console\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 17 490 1 25 494 12 37 494 23 48 494 [OBJ] 3 \"red and black plastic handheld gaming console\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 103 478 2 115 478 4 126 478 6 138 478 8 150 478 10 162 478 12 173 478 15 185 478 18 197 478 20 208 478 22 220 478 23 232 478 [OBJ] 4 \"white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 107 447 10 119 447 16 130 447 17 142 447 18 119 443 20 130 443 22 142 443 23 123 443 [OBJ] 5 \"white and blue cardboard stool softener box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 126 455 2 138 455 4 150 455 6 162 455 9 130 451 12 142 451 14 154 451 17 166 451 19 177 451 21 150 447 23 162 447 [OBJ] 6 \"white cardboard neck therapy box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 138 478 1 146 474 3 158 474 5 169 474 7 181 474 10 193 474 11 181 478 12 193 474 14 205 474 16 216 474 18 228 474 20 240 474 22 251 474 23 240 478 [OBJ] 7 \"red and yellow wooden toy airplane with pilot\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 251 998 1 240 994 2 224 990 3 232 986 4 244 982 5 255 978 6 244 978 7 255 974 8 267 970 9 255 966 10 267 962 11 255 958 12 271 955 13 259 955 14 275 951 15 287 947 16 275 943 17 291 939 18 279 939 19 291 935 20 283 931 21 294 927 22 287 923 23 298 923 [OBJ] 8 \"white and red cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 259 474 1 267 478 12 259 474 14 271 478 15 263 474 16 275 478 17 267 474 21 279 478 22 271 474 [OBJ] 9 \"white and red cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 333 396 1 341 400 3 357 404 4 345 400 5 353 404 11 365 408 12 353 404 13 361 408 19 369 412 20 357 408 22 365 412 [OBJ] 10 \"grey and black basketball shoe\" 0 24 [VIS] 0 true 1 false 10 true 11 false 12 true 14 false 15 true [IN-FRAME] 0 true [PX] 0 447 427 1 null null 10 455 431 11 null null 12 451 431 14 null null 15 455 435 [OBJ] 11 \"red and yellow wooden toy airplane with pilot\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 587 134 1 580 138 3 572 142 4 580 138 5 564 146 6 576 142 7 560 150 8 572 146 9 556 154 10 568 150 11 552 158 12 564 154 13 548 162 14 560 158 15 544 166 16 556 162 17 541 169 18 552 166 19 537 173 20 548 169 21 533 177 22 544 173 23 529 181 [OBJ] 12 \"grey plastic Nintendo 64 game cartridge\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 595 455 16 587 458 [OBJ] 13 \"grey metallic cake pan\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 623 705 1 634 708 2 619 705 3 630 708 4 619 705 5 626 708 11 615 705 12 623 708 14 611 705 15 619 708 18 607 705 19 615 708 22 603 705 23 611 708 [OBJ] 14 \"red and white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 759 1 1 771 5 2 763 1 3 771 5 6 763 1 7 771 9 11 767 1 12 771 17 15 767 1 16 771 21 21 767 1 22 771 25 [OBJ] 15 \"white and red cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 826 1 1 837 5 2 826 5 3 833 9 4 822 9 5 830 13 6 818 13 7 826 17 8 814 17 9 822 21 10 810 21 11 818 25 12 806 25 13 814 29 14 802 29 15 810 33 16 798 33 17 806 37 18 794 37 19 802 41 20 791 41 21 798 44 22 787 44 23 794 48 [OBJ] 16 \"red leather boot\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 841 455 2 833 451 4 841 455 11 833 451 13 841 455 19 833 451 [OBJ] 17 \"red leather boot\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 994 451 2 998 443 10 998 455 12 998 466 13 998 478 15 998 455 17 998 466 18 998 478 19 998 490 20 998 443 22 998 455 23 998 470 [OBJ] 18 \"red and yellow wooden toy airplane with pilot\" 1 24 [VIS] 0 false 1 true [IN-FRAME] 0 false 1 true [PX] 0 null null 1 998 111 2 982 103 3 966 91 4 943 80 5 916 72 6 888 72 7 861 80 8 837 87 9 810 95 10 791 99 11 771 107 12 751 115 13 732 119 14 712 123 15 693 126 16 673 130 17 654 134 18 634 138 19 615 142 20 595 146 21 576 150 22 556 154 23 541 158 [OBJ] 19 \"red and yellow wooden toy airplane with pilot\" 11 24 [VIS] 0 false 11 true [IN-FRAME] 0 false 11 true [PX] 0 null null 11 294 435 13 298 443 14 291 439 15 294 447 17 291 435 18 294 443 19 298 451 20 291 439 21 298 455 22 291 439 23 298 455 [OBJS-END] [INTERACTIONS-START] [INTERACT] 1 \"contact\" 0 0 [IN] 1 2 [OUT] 1 2 [INTERACT] 3 \"contact\" 0 1 [IN] 1 3 [OUT] 1 3 [INTERACT] 43 \"contact\" 0 3 [IN] 9 10 [OUT] 9 10 [INTERACT] 46 \"contact\" 0 6 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 22 \"contact\" 0 14 [IN] 2 6 [OUT] 2 6 [INTERACT] 24 \"contact\" 0 14 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 0 \"contact\" 0 23 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"contact\" 0 23 [IN] 1 19 [OUT] 1 19 [INTERACT] 2 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 27 \"contact\" 0 23 [IN] 3 6 [OUT] 3 6 [INTERACT] 28 \"contact\" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 29 \"contact\" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 30 \"contact\" 0 23 [IN] 5 6 [OUT] 5 6 [INTERACT] 31 \"contact\" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 32 \"contact\" 0 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 36 \"contact\" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 37 \"contact\" 0 23 [IN] 8 19 [OUT] 8 19 [INTERACT] 38 \"contact\" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 4 \"contact\" 0 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 5 \"contact\" 0 23 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 6 \"contact\" 0 23 [IN] 12 16 [OUT] 12 16 [INTERACT] 7 \"contact\" 0 23 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 8 \"contact\" 0 23 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 9 \"contact\" 0 23 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 10 \"contact\" 0 23 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 11 \"contact\" 0 23 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 12 \"contact\" 0 23 [IN] 17 65535 [OUT] 17 65535 [INTERACT] 44 \"collision\" 5 5 [IN] 9 10 [OUT] 9 10 [INTERACT] 45 \"contact\" 6 23 [IN] 9 10 [OUT] 9 10 [INTERACT] 42 \"collision\" 7 7 [IN] 8 9 [OUT] 8 9 [INTERACT] 17 \"collision\" 7 7 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 23 \"collision\" 7 8 [IN] 2 6 [OUT] 2 6 [INTERACT] 13 \"collision\" 10 10 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 39 \"collision\" 11 11 [IN] 8 9 [OUT] 8 9 [INTERACT] 40 \"contact\" 12 13 [IN] 8 9 [OUT] 8 9 [INTERACT] 14 \"collision\" 13 13 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 33 \"collision\" 14 14 [IN] 6 9 [OUT] 6 9 [INTERACT] 47 \"collision\" 14 14 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 15 \"collision\" 15 15 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 48 \"contact\" 15 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 16 \"contact\" 16 23 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 25 \"collision\" 17 17 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 34 \"collision\" 17 17 [IN] 6 9 [OUT] 6 9 [INTERACT] 20 \"collision\" 18 18 [IN] 19 65535 [OUT] 19 65535 [INTERACT] 35 \"contact\" 18 21 [IN] 6 9 [OUT] 6 9 [INTERACT] 26 \"contact\" 18 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 21 \"contact\" 19 23 [IN] 19 65535 [OUT] 19 65535 [INTERACT] 18 \"collision\" 20 20 [IN] 2 19 [OUT] 2 19 [INTERACT] 19 \"contact\" 21 23 [IN] 2 19 [OUT] 2 19 [INTERACT] 3 \"collision\" 22 22 [IN] 1 3 [OUT] 1 3 [INTERACT] 41 \"collision\" 22 22 [IN] 8 9 [OUT] 8 9 [INTERACT] 49 \"collision\" 22 22 [IN] 9 19 [OUT] 9 19 [INTERACT] 4 \"contact\" 23 23 [IN] 1 3 [OUT] 1 3 [INTERACT] 50 \"contact\" 23 23 [IN] 9 19 [OUT] 9 19 [INTERACTIONS-END] [SCENE-END]",
"label": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red airliner\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 558 128 1 556 128 2 554 127 3 551 127 5 546 126 6 544 126 8 538 125 10 533 124 11 530 123 13 526 122 14 522 121 15 519 121 16 515 121 18 510 120 19 506 119 20 501 118 21 496 117 22 494 117 24 487 115 25 486 116 26 481 115 27 477 114 28 472 113 29 468 111 30 466 109 31 462 102 32 457 94 33 456 89 34 455 83 35 451 79 36 447 75 37 444 72 38 441 69 39 439 67 40 433 59 41 426 52 42 421 46 43 417 42 44 414 38 45 414 29 46 404 28 47 396 26 48 388 25 49 381 24 50 371 25 51 362 25 52 453 58 53 449 55 54 444 53 55 439 50 56 433 48 57 428 46 58 423 44 59 394 18 60 390 17 61 408 36 62 404 33 63 400 30 64 394 29 65 391 25 66 383 24 67 380 22 68 373 21 69 368 20 70 363 19 71 358 19 72 352 19 73 349 17 74 343 18 75 337 19 76 333 20 77 327 21 78 322 24 79 318 25 80 312 28 81 306 32 82 290 21 83 273 15 84 264 16 85 251 16 86 186 16 87 184 18 88 180 21 89 176 25 90 173 32 91 171 43 92 167 53 93 165 65 94 160 75 95 158 89 96 183 97 97 179 106 98 176 120 99 173 134 100 170 149 101 171 164 102 173 179 103 173 193 104 171 209 105 170 225 106 130 253 107 132 270 108 133 288 109 144 300 110 144 318 111 143 335 112 143 353 113 143 372 114 147 386 115 146 404 116 146 422 117 147 441 118 147 459 119 162 469 [OBJ] 1 \"gray sedan\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 655 705 [OBJ] 2 \"red fighter\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 977 51 1 976 56 2 953 59 3 940 60 4 977 54 5 973 49 6 968 42 7 953 43 8 936 45 9 919 48 10 903 50 11 887 53 12 872 55 13 855 58 14 841 59 15 825 63 16 811 65 17 795 68 18 781 70 19 766 72 20 753 74 21 739 76 22 726 78 23 712 79 24 699 81 25 686 83 26 673 85 27 661 86 28 648 90 29 636 91 30 626 91 31 619 86 32 610 85 33 601 81 34 593 78 35 583 77 36 575 75 37 565 73 38 555 71 39 543 75 40 534 80 41 524 88 42 514 95 43 505 101 44 495 107 45 486 115 46 476 122 47 467 128 48 458 134 49 449 142 50 441 149 51 430 158 52 422 166 53 414 172 54 405 179 55 398 185 56 390 194 57 381 199 58 374 206 59 366 215 60 358 221 61 351 229 62 344 238 63 337 246 64 330 253 65 324 261 66 317 270 67 311 279 68 305 288 69 299 297 70 294 307 71 288 317 72 283 327 73 278 336 74 273 346 75 269 357 76 264 368 77 259 376 78 255 388 79 251 399 80 246 409 82 246 414 83 246 419 84 247 422 85 246 427 86 245 432 87 244 439 88 242 446 89 239 454 90 236 463 91 233 472 92 230 480 93 227 476 94 226 472 95 223 468 96 221 466 97 218 464 98 215 460 100 212 457 102 209 456 103 206 454 104 205 453 105 202 452 106 200 450 107 196 450 108 169 463 109 162 468 111 186 449 112 183 450 113 182 448 114 180 448 116 176 448 117 176 451 118 119 472 119 112 473 [OBJ] 3 \"cyan chopper\" 2 120 [VIS] 0 false 2 true [IN-FRAME] 0 false 2 true [PX] 0 null null 2 203 998 3 208 991 4 225 988 5 229 981 6 232 976 7 228 971 8 231 966 9 234 965 10 237 949 11 241 944 12 244 930 13 248 925 14 251 914 15 242 960 16 245 950 17 248 940 18 251 928 19 254 920 20 256 911 21 258 902 22 261 894 23 264 885 24 266 876 25 269 869 26 271 861 27 273 852 28 276 846 29 277 839 30 280 830 31 281 825 32 283 818 33 286 811 34 287 804 35 289 800 36 291 793 37 293 786 38 294 781 39 296 773 40 298 772 41 299 766 42 301 759 43 308 743 44 309 738 45 305 745 46 312 727 47 313 724 48 315 719 49 311 727 50 317 710 52 319 703 53 320 699 54 322 695 55 323 691 56 323 688 57 324 684 58 325 681 59 326 677 60 327 673 61 328 671 62 329 668 63 330 664 64 330 660 65 332 655 66 333 652 67 333 650 68 334 647 69 335 645 70 336 641 71 337 638 72 337 634 73 338 632 74 339 629 75 340 627 76 341 624 77 341 622 78 342 620 79 342 617 80 343 614 81 344 611 83 345 606 84 345 617 85 346 603 86 348 594 87 347 607 88 349 588 90 349 603 91 349 600 92 349 597 93 351 577 94 351 594 96 352 580 97 352 588 99 353 584 100 355 548 101 355 580 103 355 577 105 356 573 107 357 569 109 358 567 111 359 561 113 359 527 114 360 557 115 360 525 117 361 522 118 362 551 [OBJS-END] [INTERACTIONS-START] [INTERACT] 2 \"contact\" 0 119 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 8 \"contact\" 0 119 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 0 \"collision\" 30 30 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"collision\" 40 40 [IN] 0 2 [OUT] 0 2 [INTERACT] 6 \"collision\" 81 82 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 7 \"collision\" 93 93 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"collision\" 109 109 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"collision\" 111 111 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 5 \"collision\" 119 119 [IN] 2 65535 [OUT] 2 65535 [INTERACTIONS-END] [SCENE-END]\n"
}