STRIVE · 08/28/2026
Dyn generalization · test_24 · super_clevr_1132
Everything fed into evaluation and the full per-sample output it produced.
Dataset row: exact video + user prompt + assistant target
{
"messages": [
{
"role": "user",
"content": "<video>\nAnalyze the provided video and return ONLY a valid sentinel sequence in this format:\n[SCENE-START] [OBJS-START]\n[OBJ] id \"type\" birth death [VIS] t vis ... [IN-FRAME] t is_in_frame ... [PX] t px py ...\n[OBJ] ...\n[OBJS-END]\n[INTERACTIONS-START]\n[INTERACT] id \"type\" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ...\n[INTERACT] ...\n[INTERACTIONS-END] [SCENE-END]\n\nConstraints:\n- Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose).\n- Keep tags exactly as written:\n `[SCENE-START] [OBJS-START] [OBJ] [VIS] [IN-FRAME] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]`\n- Use quoted strings for `type` (double quotes).\n- `VIS` uses repeated groups of 2 values in order:\n `t vis`.\n `vis` is a boolean value.\n- `IN-FRAME` uses repeated groups of 2 values in order:\n `t is_in_frame`.\n `is_in_frame` is a boolean value.\n- `PX` uses repeated groups of 3 values in order: `t px py`.\n- `px` and `py` are normalized pixel coordinates in the range `[0, 1]`,\n scaled by `1000` and then converted to integers by dropping the decimal part.\n- For occluded or out-of-frame frames under this setting, `PX` may use `t null null`.\n- `IN` and `OUT` contain whitespace-separated integer ids.\n- Use lowercase booleans (`true`/`false`) for `vis` and `is_in_frame`."
},
{
"role": "assistant",
"content": "[SCENE-START] [OBJS-START] [OBJ] 0 \"cyan chopper\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 63 681 1 59 676 2 66 681 3 64 678 4 66 679 5 65 667 6 95 663 7 98 663 8 101 665 9 100 668 10 104 668 12 108 680 13 111 680 14 114 680 15 116 681 16 119 682 17 122 683 18 123 686 19 125 689 20 129 689 21 131 689 22 135 689 23 136 692 [OBJ] 1 \"green airliner\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 186 748 14 187 747 15 190 748 17 194 749 20 197 749 22 199 749 [OBJ] 2 \"brown jet\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 344 402 1 346 403 2 345 401 3 348 403 4 349 404 5 351 405 6 353 408 7 358 414 8 362 419 10 368 427 11 370 431 12 374 436 13 377 442 14 380 447 15 383 453 16 387 459 17 391 467 18 394 473 19 396 480 20 399 488 21 402 495 22 405 503 23 411 516 [OBJ] 3 \"purple double\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 783 776 1 772 773 2 763 771 3 791 776 4 742 765 5 730 760 6 721 758 7 710 755 8 700 752 9 691 749 10 680 746 11 669 742 12 659 740 13 650 736 14 641 734 15 630 730 16 622 728 17 612 725 18 603 723 19 594 720 20 583 717 21 576 715 22 593 720 23 558 709 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACTIONS-END] [SCENE-END]"
}
],
"videos": [
"/mmfs1/gscratch/krishna/suryadv/strive_dynsuperclevr/data/lf/videos/test_24/super_clevr_1132/frames.max_frames_24.mp4"
]
}Inference record: exact prompt + prediction + label + parse debug
{
"prompt": "user\n\nAnalyze the provided video and return ONLY a valid sentinel sequence in this format:\n[SCENE-START] [OBJS-START]\n[OBJ] id \"type\" birth death [VIS] t vis ... [IN-FRAME] t is_in_frame ... [PX] t px py ...\n[OBJ] ...\n[OBJS-END]\n[INTERACTIONS-START]\n[INTERACT] id \"type\" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ...\n[INTERACT] ...\n[INTERACTIONS-END] [SCENE-END]\n\nConstraints:\n- Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose).\n- Keep tags exactly as written:\n `[SCENE-START] [OBJS-START] [OBJ] [VIS] [IN-FRAME] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]`\n- Use quoted strings for `type` (double quotes).\n- `VIS` uses repeated groups of 2 values in order:\n `t vis`.\n `vis` is a boolean value.\n- `IN-FRAME` uses repeated groups of 2 values in order:\n `t is_in_frame`.\n `is_in_frame` is a boolean value.\n- `PX` uses repeated groups of 3 values in order: `t px py`.\n- `px` and `py` are normalized pixel coordinates in the range `[0, 1]`,\n scaled by `1000` and then converted to integers by dropping the decimal part.\n- For occluded or out-of-frame frames under this setting, `PX` may use `t null null`.\n- `IN` and `OUT` contain whitespace-separated integer ids.\n- Use lowercase booleans (`true`/`false`) for `vis` and `is_in_frame`.\nassistant\n",
"predict": "[SCENE-START] [OBJS-START] [OBJ] 0 \"green and orange plastic magnifying glass\" 0 13 [VIS] 0 true 10 false 11 true 12 false [IN-FRAME] 0 true 10 false 11 true 12 false [PX] 0 1 634 10 null null 11 1 630 12 null null [OBJ] 1 \"grey and white plastic shark figurine\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 17 599 [OBJ] 2 \"grey and white plastic shark figurine\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 29 470 8 33 482 [OBJ] 3 \"green and orange plastic magnifying glass\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 37 681 1 37 693 2 41 701 3 44 708 4 48 716 5 52 724 6 60 728 7 64 736 8 72 740 9 80 744 10 87 748 11 95 751 12 103 755 13 111 759 [OBJ] 4 \"grey and orange athletic shoe\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 76 677 1 83 681 2 87 689 4 95 693 6 103 701 7 111 705 9 119 712 11 126 720 13 134 728 [OBJ] 5 \"green wooden mushroom pounding toy\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 80 658 2 87 662 4 95 666 6 103 669 8 111 673 10 119 677 12 126 681 14 134 685 [OBJ] 6 \"green wooden toy train\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 91 666 1 99 673 2 107 677 3 115 681 4 111 669 5 123 681 6 130 685 7 138 689 9 150 693 11 162 697 12 158 689 13 169 697 [OBJ] 7 \"green wooden dollhouse bedroom furniture set\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 119 580 2 130 580 4 119 583 5 134 580 7 123 583 8 138 580 11 126 583 12 142 580 [OBJ] 8 \"green wooden toy train\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 126 630 2 134 626 4 126 634 6 138 634 7 130 638 9 142 638 10 134 642 12 146 642 13 138 646 [OBJ] 9 \"green wooden dollhouse bedroom furniture set\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 138 556 4 142 564 9 150 568 [OBJ] 10 \"green wooden toy train\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 142 576 2 150 580 9 158 583 11 169 587 12 162 583 13 173 587 [OBJ] 11 \"red and natural wooden dollhouse furniture set\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 240 544 1 279 544 2 240 541 3 283 541 4 240 541 6 287 541 7 244 541 10 291 541 11 248 541 13 291 541 14 251 544 [OBJ] 12 \"green fabric dish towel\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 322 544 3 333 544 4 318 541 7 330 541 8 318 541 10 333 541 11 322 537 [OBJ] 13 \"white and red cardboard ink cartridge multi-pack\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 423 544 10 419 537 [OBJ] 14 \"white and tan plastic unicorn figurine\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 458 541 10 466 537 [OBJ] 15 \"black and metallic dish drainer\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 474 548 6 482 544 10 474 548 11 482 541 12 470 548 13 482 541 [OBJ] 16 \"black cardboard motherboard box\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 525 533 11 529 541 [OBJ] 17 \"white and orange rubber slide sandal\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 556 541 6 568 541 7 556 544 11 568 544 12 556 548 [OBJ] 18 \"yellow and brown hard candy box\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 595 537 4 583 537 5 599 537 6 583 533 7 595 537 8 583 533 10 595 537 11 583 533 13 595 537 14 583 533 [OBJ] 19 \"dark brown leather boat shoe\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 654 541 12 646 537 [OBJ] 20 \"dark grey plastic network storage device\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 759 533 11 767 537 [OBJ] 21 \"blue and white high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 759 544 5 755 552 [OBJ] 22 \"dark grey cardboard motherboard box\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 830 552 11 833 560 [OBJ] 23 \"yellow plastic plant pot\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 916 548 5 919 560 6 916 548 10 916 560 11 912 548 [OBJ] 24 \"dark grey and pink running shoe\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 970 541 11 962 544 [OBJ] 25 \"pink and white fabric high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 994 583 5 994 595 6 990 583 11 990 595 12 986 587 [OBJ] 26 \"pink and white fabric high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 994 607 4 994 619 9 994 630 11 990 623 [OBJ] 27 \"pink and white fabric high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 994 638 5 994 650 8 994 662 10 990 654 13 990 666 [OBJ] 28 \"pink and white fabric high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 994 669 3 994 681 6 994 693 8 990 685 10 990 697 13 990 708 [OBJ] 29 \"pink and white fabric high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 994 705 2 994 716 4 994 728 6 994 740 8 990 748 10 990 759 12 990 771 13 986 763 [OBJ] 30 \"pink and white fabric high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 537 4 994 544 8 998 552 12 994 560 16 990 568 20 994 576 23 990 583 [OBJ] 31 \"pink cardboard gum car cup pack\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 677 2 998 689 5 998 701 7 998 712 9 998 724 11 998 736 13 998 748 [OBJ] 32 \"pink and white fabric high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 693 2 998 705 4 998 716 6 998 728 8 998 740 10 998 751 12 998 763 14 998 775 16 998 787 18 998 798 20 998 810 22 998 822 23 998 830 [OBJ] 33 \"pink and white fabric high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 701 3 998 712 5 998 724 7 998 736 9 998 748 11 998 759 13 998 771 [OBJ] 34 \"pink and white fabric high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 712 2 998 724 4 998 736 6 998 748 8 998 759 10 998 771 12 998 783 14 998 794 [OBJ] 35 \"pink and white fabric high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 720 3 998 732 6 998 744 9 998 755 11 998 767 13 998 779 [OBJ] 36 \"pink and white fabric high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 728 4 998 740 6 998 751 9 998 763 11 998 775 13 998 787 [OBJ] 37 \"pink and white fabric high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 736 4 998 748 7 998 759 10 998 771 13 998 783 [OBJ] 38 \"pink and white fabric high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 744 3 998 755 6 998 767 9 998 779 12 998 791 [OBJ] 39 \"pink and purple wooden toy castle\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 845 4 998 857 8 998 869 11 998 880 14 998 892 [OBJ] 40 \"pink and purple wooden toy castle\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 861 4 998 873 7 998 884 10 998 896 13 998 908 [OBJ] 41 \"pink and purple wooden toy castle\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 873 2 998 884 5 998 896 8 998 908 11 998 919 14 998 931 [OBJ] 42 \"purple probiotic supplement box\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 896 2 998 908 4 998 919 6 998 931 8 998 943 10 998 955 12 998 966 14 998 978 [OBJ] 43 \"pink and purple wooden toy castle\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 900 2 998 912 5 998 923 7 998 935 9 998 947 11 998 958 13 998 970 [OBJ] 44 \"pink and purple wooden toy castle\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 912 2 998 923 4 998 935 6 998 947 8 998 958 10 998 970 12 998 982 14 998 994 [OBJ] 45 \"pink and purple wooden toy castle\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 927 3 998 939 6 998 951 9 998 962 12 998 974 15 998 986 18 998 998 [OBJ] 46 \"pink and purple wooden toy castle\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 939 3 998 951 6 998 962 9 998 974 12 998 986 15 998 998 [OBJ] 47 \"pink and purple wooden toy castle\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 974 3 998 986 6 998 998 9 994 994 12 998 994 13 994 998 [OBJ] 48 \"pink and purple wooden toy castle\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 990 3 994 998 6 990 990 9 990 939 10 990 951 11 990 962 12 990 974 13 990 986 [OBJ] 49 \"pink and white fabric high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 994 384 1 990 392 4 990 380 5 986 388 11 978 384 12 982 376 13 978 384 [OBJ] 50 \"pink and white fabric high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 994 529 2 994 541 4 994 525 5 990 548 6 990 537 7 990 525 8 990 537 9 990 525 10 990 537 11 990 525 12 990 537 13 990 525 [OBJ] 51 \"pink and white fabric high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 994 541 2 994 552 3 994 541 7 994 529 8 990 556 10 990 544 12 990 533 13 990 544 [OBJ] 52 \"pink and white fabric high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 994 564 3 994 576 4 994 564 5 990 583 6 990 572 10 990 560 11 986 580 13 986 568 [OBJ] 53 \"pink and white fabric high-top sneaker\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 994 681 1 994 693 3 994 705 5 994 716 7 994 728 9 994 740 11 994 751 13 994 763 [OBJ] 54 \"pink and purple wooden toy castle\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 994 974 3 990 986 7 986 994 11 982 986 12 990 994 13 982 990 14 990 994 [OBJ] 55 \"pink and purple wooden toy castle\" 0 13 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 994 990 2 990 998 5 998 994 6 994 990 8 990 998 9 994 994 11 990 990 13 994 986 14 990 994 [OBJ] 56 \"yellow and burgundy sneaker\" 2 13 [VIS] 0 false 2 true [IN-FRAME] 0 false 2 true [PX] 0 null null 2 365 419 3 376 423 4 384 431 5 392 439 6 400 447 7 408 455 8 416 466 9 423 474 10 431 486 11 439 498 12 447 505 13 455 517 [OBJ] 57 \"pink cardboard gum car cup pack\" 2 13 [VIS] 0 false 2 true [IN-FRAME] 0 false 2 true [PX] 0 null null 2 998 388 3 998 376 4 994 388 5 994 376 6 990 388 7 990 376 8 986 388 9 986 376 10 982 388 11 982 376 12 978 388 13 978 376 [OBJ] 58 \"pink and white fabric high-top sneaker\" 4 13 [VIS] 0 false 4 true [IN-FRAME] 0 false 4 true [PX] 0 null null 4 357 431 5 365 435 6 373 439 7 380 443 8 388 447 9 396 451 10 404 458 11 412 462 12 419 466 13 427 470 [OBJ] 59 \"pink and purple wooden toy castle\" 7 13 [VIS] 0 false 7 true [IN-FRAME] 0 false 7 true [PX] 0 null null 7 998 388 9 998 373 11 994 384 13 994 373 [OBJ] 60 \"dark blue leather boat shoe\" 10 13 [VIS] 0 false 10 true [IN-FRAME] 0 false 10 true [PX] 0 null null 10 1 501 11 1 490 12 1 474 13 1 462 [OBJ] 61 \"yellow and green cardboard fingerpaint set\" 11 13 [VIS] 0 false 11 true [IN-FRAME] 0 false 11 true [PX] 0 null null 11 1 544 12 1 533 [OBJS-END] [INTERACTIONS-START] [INTERACT] 1 \"contact\" 0 4 [IN] 1 61 [OUT] 1 61 [INTERACT] 3 \"contact\" 0 10 [IN] 1 60 [OUT] 1 60 [INTERACT] 2 \"contact\" 0 12 [IN] 1 61 [OUT] 1 61 [INTERACT] 0 \"contact\" 0 13 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 12 \"contact\" 0 13 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 13 \"contact\" 0 13 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 14 \"contact\" 0 13 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 15 \"contact\" 0 13 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 16 \"contact\" 0 13 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 17 \"contact\" 0 13 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 18 \"contact\" 0 13 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 19 \"contact\" 0 13 [IN] 17 65535 [OUT] 17 65535 [INTERACT] 20 \"contact\" 0 13 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 21 \"contact\" 0 13 [IN] 19 65535 [OUT] 19 65535 [INTERACT] 22 \"contact\" 0 13 [IN] 20 65535 [OUT] 20 65535 [INTERACT] 23 \"contact\" 0 13 [IN] 21 65535 [OUT] 21 65535 [INTERACT] 24 \"contact\" 0 13 [IN] 22 65535 [OUT] 22 65535 [INTERACT] 25 \"contact\" 0 13 [IN] 23 65535 [OUT] 23 65535 [INTERACT] 26 \"contact\" 0 13 [IN] 24 65535 [OUT] 24 65535 [INTERACT] 27 \"contact\" 0 13 [IN] 25 65535 [OUT] 25 65535 [INTERACT] 28 \"contact\" 0 13 [IN] 26 65535 [OUT] 26 65535 [INTERACT] 29 \"contact\" 0 13 [IN] 27 65535 [OUT] 27 65535 [INTERACT] 30 \"contact\" 0 13 [IN] 28 65535 [OUT] 28 65535 [INTERACT] 31 \"contact\" 0 13 [IN] 29 65535 [OUT] 29 65535 [INTERACT] 32 \"contact\" 0 13 [IN] 30 65535 [OUT] 30 65535 [INTERACT] 33 \"contact\" 0 13 [IN] 31 65535 [OUT] 31 65535 [INTERACT] 34 \"contact\" 0 13 [IN] 32 65535 [OUT] 32 65535 [INTERACT] 35 \"contact\" 0 13 [IN] 33 65535 [OUT] 33 65535 [INTERACT] 36 \"contact\" 0 13 [IN] 34 65535 [OUT] 34 65535 [INTERACT] 37 \"contact\" 0 13 [IN] 35 65535 [OUT] 35 65535 [INTERACT] 38 \"contact\" 0 13 [IN] 36 65535 [OUT] 36 65535 [INTERACT] 39 \"contact\" 0 13 [IN] 37 65535 [OUT] 37 65535 [INTERACT] 40 \"contact\" 0 13 [IN] 38 65535 [OUT] 38 65535 [INTERACT] 41 \"contact\" 0 13 [IN] 39 65535 [OUT] 39 65535 [INTERACT] 42 \"contact\" 0 13 [IN] 40 65535 [OUT] 40 65535 [INTERACT] 43 \"contact\" 0 13 [IN] 41 65535 [OUT] 41 65535 [INTERACT] 44 \"contact\" 0 13 [IN] 42 65535 [OUT] 42 65535 [INTERACT] 45 \"contact\" 0 13 [IN] 43 65535 [OUT] 43 65535 [INTERACT] 46 \"contact\" 0 13 [IN] 44 65535 [OUT] 44 65535 [INTERACT] 47 \"contact\" 0 13 [IN] 45 65535 [OUT] 45 65535 [INTERACT] 48 \"contact\" 0 13 [IN] 46 65535 [OUT] 46 65535 [INTERACT] 49 \"contact\" 0 13 [IN] 47 65535 [OUT] 47 65535 [INTERACT] 50 \"contact\" 0 13 [IN] 48 65535 [OUT] 48 65535 [INTERACT] 51 \"contact\" 0 13 [IN] 50 65535 [OUT] 50 65535 [INTERACT] 52 \"contact\" 0 13 [IN] 51 65535 [OUT] 51 65535 [INTERACT] 53 \"contact\" 0 13 [IN] 52 65535 [OUT] 52 65535 [INTERACT] 54 \"contact\" 0 13 [IN] 53 65535 [OUT] 53 65535 [INTERACT] 55 \"contact\" 0 13 [IN] 54 65535 [OUT] 54 65535 [INTERACT] 56 \"contact\" 0 13 [IN] 55 65535 [OUT] 55 65535 [INTERACT] 57 \"contact\" 0 13 [IN] 56 65535 [OUT] 56 65535 [INTERACT] 58 \"contact\" 0 13 [IN] 57 65535 [OUT] 57 65535 [INTERACT] 59 \"contact\" 0 13 [IN] 59 65535 [OUT] 59 65535 [INTERACT] 60 \"contact\" 0 13 [IN] 61 65535 [OUT] 61 65535 [INTERACT] 61 \"collision\" 2 2 [IN] 62 65535 [OUT] 62 65535 [INTERACT] 62 \"collision\" 5 5 [IN] 62 65535 [OUT] 62 65535 [INTERACT] 63 \"contact\" 6 13 [IN] 62 65535 [OUT] 62 65535 [INTERACT] 6 \"collision\" 9 9 [IN] 1 61 [OUT] 1 61 [INTERACT] 7 \"collision\" 10 10 [IN] 1 65 [OUT] 1 65 [INTERACT] 10 \"collision\" 10 10 [IN] 10 12 [OUT] 10 12 [INTERACT] 8 \"contact\" 10 12 [IN] 1 61 [OUT] 1 61 [INTERACT] 11 \"contact\" 11 12 [IN] 10 12 [OUT] 10 12 [INTERACT] 9 \"collision\" 12 12 [IN] 1 65 [OUT] 1 65 [INTERACT] 3 \"collision\" 12 13 [IN] 1 60 [OUT] 1 60 [INTERACT] 4 \"collision\" 13 13 [IN] 1 61 [OUT] 1 61 [INTERACT] 5 \"contact\" 13 13 [IN] 1 65 [OUT] 1 65 [INTERACT] 12 \"collision\" 13 13 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 2 \"collision\" 13 13 [IN] 1 61 [OUT] 1 61 [INTERACT] 7 \"collision\" 13 13 [IN] 1 65 [OUT] 1 65 [INTERACT] 9 \"collision\" 13 13 [IN] 10 12 [OUT] 10 12 [INTERACTIONS-END] [SCENE-END]",
"label": "[SCENE-START] [OBJS-START] [OBJ] 0 \"cyan chopper\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 63 681 1 59 676 2 66 681 3 64 678 4 66 679 5 65 667 6 95 663 7 98 663 8 101 665 9 100 668 10 104 668 12 108 680 13 111 680 14 114 680 15 116 681 16 119 682 17 122 683 18 123 686 19 125 689 20 129 689 21 131 689 22 135 689 23 136 692 [OBJ] 1 \"green airliner\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 186 748 14 187 747 15 190 748 17 194 749 20 197 749 22 199 749 [OBJ] 2 \"brown jet\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 344 402 1 346 403 2 345 401 3 348 403 4 349 404 5 351 405 6 353 408 7 358 414 8 362 419 10 368 427 11 370 431 12 374 436 13 377 442 14 380 447 15 383 453 16 387 459 17 391 467 18 394 473 19 396 480 20 399 488 21 402 495 22 405 503 23 411 516 [OBJ] 3 \"purple double\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 783 776 1 772 773 2 763 771 3 791 776 4 742 765 5 730 760 6 721 758 7 710 755 8 700 752 9 691 749 10 680 746 11 669 742 12 659 740 13 650 736 14 641 734 15 630 730 16 622 728 17 612 725 18 603 723 19 594 720 20 583 717 21 576 715 22 593 720 23 558 709 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACTIONS-END] [SCENE-END]\n"
}Parsed prediction
{
"objects": [
{
"id": 0,
"type": "green and orange plastic magnifying glass",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 10,
"v": false
},
{
"t": 11,
"v": true
},
{
"t": 12,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
},
{
"t": 10,
"v": false
},
{
"t": 11,
"v": true
},
{
"t": 12,
"v": false
}
],
"image_positions": [
{
"t": 0,
"x": 1,
"y": 634
},
{
"t": 10,
"x": null,
"y": null
},
{
"t": 11,
"x": 1,
"y": 630
},
{
"t": 12,
"x": null,
"y": null
}
],
"birth": 0,
"death": 13
},
{
"id": 1,
"type": "grey and white plastic shark figurine",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 17,
"y": 599
}
],
"birth": 0,
"death": 13
},
{
"id": 2,
"type": "grey and white plastic shark figurine",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 29,
"y": 470
},
{
"t": 8,
"x": 33,
"y": 482
}
],
"birth": 0,
"death": 13
},
{
"id": 3,
"type": "green and orange plastic magnifying glass",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 37,
"y": 681
},
{
"t": 1,
"x": 37,
"y": 693
},
{
"t": 2,
"x": 41,
"y": 701
},
{
"t": 3,
"x": 44,
"y": 708
},
{
"t": 4,
"x": 48,
"y": 716
},
{
"t": 5,
"x": 52,
"y": 724
},
{
"t": 6,
"x": 60,
"y": 728
},
{
"t": 7,
"x": 64,
"y": 736
},
{
"t": 8,
"x": 72,
"y": 740
},
{
"t": 9,
"x": 80,
"y": 744
},
{
"t": 10,
"x": 87,
"y": 748
},
{
"t": 11,
"x": 95,
"y": 751
},
{
"t": 12,
"x": 103,
"y": 755
},
{
"t": 13,
"x": 111,
"y": 759
}
],
"birth": 0,
"death": 13
},
{
"id": 4,
"type": "grey and orange athletic shoe",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 76,
"y": 677
},
{
"t": 1,
"x": 83,
"y": 681
},
{
"t": 2,
"x": 87,
"y": 689
},
{
"t": 4,
"x": 95,
"y": 693
},
{
"t": 6,
"x": 103,
"y": 701
},
{
"t": 7,
"x": 111,
"y": 705
},
{
"t": 9,
"x": 119,
"y": 712
},
{
"t": 11,
"x": 126,
"y": 720
},
{
"t": 13,
"x": 134,
"y": 728
}
],
"birth": 0,
"death": 13
},
{
"id": 5,
"type": "green wooden mushroom pounding toy",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 80,
"y": 658
},
{
"t": 2,
"x": 87,
"y": 662
},
{
"t": 4,
"x": 95,
"y": 666
},
{
"t": 6,
"x": 103,
"y": 669
},
{
"t": 8,
"x": 111,
"y": 673
},
{
"t": 10,
"x": 119,
"y": 677
},
{
"t": 12,
"x": 126,
"y": 681
},
{
"t": 14,
"x": 134,
"y": 685
}
],
"birth": 0,
"death": 13
},
{
"id": 6,
"type": "green wooden toy train",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 91,
"y": 666
},
{
"t": 1,
"x": 99,
"y": 673
},
{
"t": 2,
"x": 107,
"y": 677
},
{
"t": 3,
"x": 115,
"y": 681
},
{
"t": 4,
"x": 111,
"y": 669
},
{
"t": 5,
"x": 123,
"y": 681
},
{
"t": 6,
"x": 130,
"y": 685
},
{
"t": 7,
"x": 138,
"y": 689
},
{
"t": 9,
"x": 150,
"y": 693
},
{
"t": 11,
"x": 162,
"y": 697
},
{
"t": 12,
"x": 158,
"y": 689
},
{
"t": 13,
"x": 169,
"y": 697
}
],
"birth": 0,
"death": 13
},
{
"id": 7,
"type": "green wooden dollhouse bedroom furniture set",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 119,
"y": 580
},
{
"t": 2,
"x": 130,
"y": 580
},
{
"t": 4,
"x": 119,
"y": 583
},
{
"t": 5,
"x": 134,
"y": 580
},
{
"t": 7,
"x": 123,
"y": 583
},
{
"t": 8,
"x": 138,
"y": 580
},
{
"t": 11,
"x": 126,
"y": 583
},
{
"t": 12,
"x": 142,
"y": 580
}
],
"birth": 0,
"death": 13
},
{
"id": 8,
"type": "green wooden toy train",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 126,
"y": 630
},
{
"t": 2,
"x": 134,
"y": 626
},
{
"t": 4,
"x": 126,
"y": 634
},
{
"t": 6,
"x": 138,
"y": 634
},
{
"t": 7,
"x": 130,
"y": 638
},
{
"t": 9,
"x": 142,
"y": 638
},
{
"t": 10,
"x": 134,
"y": 642
},
{
"t": 12,
"x": 146,
"y": 642
},
{
"t": 13,
"x": 138,
"y": 646
}
],
"birth": 0,
"death": 13
},
{
"id": 9,
"type": "green wooden dollhouse bedroom furniture set",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 138,
"y": 556
},
{
"t": 4,
"x": 142,
"y": 564
},
{
"t": 9,
"x": 150,
"y": 568
}
],
"birth": 0,
"death": 13
},
{
"id": 10,
"type": "green wooden toy train",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 142,
"y": 576
},
{
"t": 2,
"x": 150,
"y": 580
},
{
"t": 9,
"x": 158,
"y": 583
},
{
"t": 11,
"x": 169,
"y": 587
},
{
"t": 12,
"x": 162,
"y": 583
},
{
"t": 13,
"x": 173,
"y": 587
}
],
"birth": 0,
"death": 13
},
{
"id": 11,
"type": "red and natural wooden dollhouse furniture set",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 240,
"y": 544
},
{
"t": 1,
"x": 279,
"y": 544
},
{
"t": 2,
"x": 240,
"y": 541
},
{
"t": 3,
"x": 283,
"y": 541
},
{
"t": 4,
"x": 240,
"y": 541
},
{
"t": 6,
"x": 287,
"y": 541
},
{
"t": 7,
"x": 244,
"y": 541
},
{
"t": 10,
"x": 291,
"y": 541
},
{
"t": 11,
"x": 248,
"y": 541
},
{
"t": 13,
"x": 291,
"y": 541
},
{
"t": 14,
"x": 251,
"y": 544
}
],
"birth": 0,
"death": 13
},
{
"id": 12,
"type": "green fabric dish towel",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 322,
"y": 544
},
{
"t": 3,
"x": 333,
"y": 544
},
{
"t": 4,
"x": 318,
"y": 541
},
{
"t": 7,
"x": 330,
"y": 541
},
{
"t": 8,
"x": 318,
"y": 541
},
{
"t": 10,
"x": 333,
"y": 541
},
{
"t": 11,
"x": 322,
"y": 537
}
],
"birth": 0,
"death": 13
},
{
"id": 13,
"type": "white and red cardboard ink cartridge multi-pack",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 423,
"y": 544
},
{
"t": 10,
"x": 419,
"y": 537
}
],
"birth": 0,
"death": 13
},
{
"id": 14,
"type": "white and tan plastic unicorn figurine",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 458,
"y": 541
},
{
"t": 10,
"x": 466,
"y": 537
}
],
"birth": 0,
"death": 13
},
{
"id": 15,
"type": "black and metallic dish drainer",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 474,
"y": 548
},
{
"t": 6,
"x": 482,
"y": 544
},
{
"t": 10,
"x": 474,
"y": 548
},
{
"t": 11,
"x": 482,
"y": 541
},
{
"t": 12,
"x": 470,
"y": 548
},
{
"t": 13,
"x": 482,
"y": 541
}
],
"birth": 0,
"death": 13
},
{
"id": 16,
"type": "black cardboard motherboard box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 525,
"y": 533
},
{
"t": 11,
"x": 529,
"y": 541
}
],
"birth": 0,
"death": 13
},
{
"id": 17,
"type": "white and orange rubber slide sandal",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 556,
"y": 541
},
{
"t": 6,
"x": 568,
"y": 541
},
{
"t": 7,
"x": 556,
"y": 544
},
{
"t": 11,
"x": 568,
"y": 544
},
{
"t": 12,
"x": 556,
"y": 548
}
],
"birth": 0,
"death": 13
},
{
"id": 18,
"type": "yellow and brown hard candy box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 595,
"y": 537
},
{
"t": 4,
"x": 583,
"y": 537
},
{
"t": 5,
"x": 599,
"y": 537
},
{
"t": 6,
"x": 583,
"y": 533
},
{
"t": 7,
"x": 595,
"y": 537
},
{
"t": 8,
"x": 583,
"y": 533
},
{
"t": 10,
"x": 595,
"y": 537
},
{
"t": 11,
"x": 583,
"y": 533
},
{
"t": 13,
"x": 595,
"y": 537
},
{
"t": 14,
"x": 583,
"y": 533
}
],
"birth": 0,
"death": 13
},
{
"id": 19,
"type": "dark brown leather boat shoe",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 654,
"y": 541
},
{
"t": 12,
"x": 646,
"y": 537
}
],
"birth": 0,
"death": 13
},
{
"id": 20,
"type": "dark grey plastic network storage device",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 759,
"y": 533
},
{
"t": 11,
"x": 767,
"y": 537
}
],
"birth": 0,
"death": 13
},
{
"id": 21,
"type": "blue and white high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 759,
"y": 544
},
{
"t": 5,
"x": 755,
"y": 552
}
],
"birth": 0,
"death": 13
},
{
"id": 22,
"type": "dark grey cardboard motherboard box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 830,
"y": 552
},
{
"t": 11,
"x": 833,
"y": 560
}
],
"birth": 0,
"death": 13
},
{
"id": 23,
"type": "yellow plastic plant pot",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 916,
"y": 548
},
{
"t": 5,
"x": 919,
"y": 560
},
{
"t": 6,
"x": 916,
"y": 548
},
{
"t": 10,
"x": 916,
"y": 560
},
{
"t": 11,
"x": 912,
"y": 548
}
],
"birth": 0,
"death": 13
},
{
"id": 24,
"type": "dark grey and pink running shoe",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 970,
"y": 541
},
{
"t": 11,
"x": 962,
"y": 544
}
],
"birth": 0,
"death": 13
},
{
"id": 25,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 994,
"y": 583
},
{
"t": 5,
"x": 994,
"y": 595
},
{
"t": 6,
"x": 990,
"y": 583
},
{
"t": 11,
"x": 990,
"y": 595
},
{
"t": 12,
"x": 986,
"y": 587
}
],
"birth": 0,
"death": 13
},
{
"id": 26,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 994,
"y": 607
},
{
"t": 4,
"x": 994,
"y": 619
},
{
"t": 9,
"x": 994,
"y": 630
},
{
"t": 11,
"x": 990,
"y": 623
}
],
"birth": 0,
"death": 13
},
{
"id": 27,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 994,
"y": 638
},
{
"t": 5,
"x": 994,
"y": 650
},
{
"t": 8,
"x": 994,
"y": 662
},
{
"t": 10,
"x": 990,
"y": 654
},
{
"t": 13,
"x": 990,
"y": 666
}
],
"birth": 0,
"death": 13
},
{
"id": 28,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 994,
"y": 669
},
{
"t": 3,
"x": 994,
"y": 681
},
{
"t": 6,
"x": 994,
"y": 693
},
{
"t": 8,
"x": 990,
"y": 685
},
{
"t": 10,
"x": 990,
"y": 697
},
{
"t": 13,
"x": 990,
"y": 708
}
],
"birth": 0,
"death": 13
},
{
"id": 29,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 994,
"y": 705
},
{
"t": 2,
"x": 994,
"y": 716
},
{
"t": 4,
"x": 994,
"y": 728
},
{
"t": 6,
"x": 994,
"y": 740
},
{
"t": 8,
"x": 990,
"y": 748
},
{
"t": 10,
"x": 990,
"y": 759
},
{
"t": 12,
"x": 990,
"y": 771
},
{
"t": 13,
"x": 986,
"y": 763
}
],
"birth": 0,
"death": 13
},
{
"id": 30,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 537
},
{
"t": 4,
"x": 994,
"y": 544
},
{
"t": 8,
"x": 998,
"y": 552
},
{
"t": 12,
"x": 994,
"y": 560
},
{
"t": 16,
"x": 990,
"y": 568
},
{
"t": 20,
"x": 994,
"y": 576
},
{
"t": 23,
"x": 990,
"y": 583
}
],
"birth": 0,
"death": 13
},
{
"id": 31,
"type": "pink cardboard gum car cup pack",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 677
},
{
"t": 2,
"x": 998,
"y": 689
},
{
"t": 5,
"x": 998,
"y": 701
},
{
"t": 7,
"x": 998,
"y": 712
},
{
"t": 9,
"x": 998,
"y": 724
},
{
"t": 11,
"x": 998,
"y": 736
},
{
"t": 13,
"x": 998,
"y": 748
}
],
"birth": 0,
"death": 13
},
{
"id": 32,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 693
},
{
"t": 2,
"x": 998,
"y": 705
},
{
"t": 4,
"x": 998,
"y": 716
},
{
"t": 6,
"x": 998,
"y": 728
},
{
"t": 8,
"x": 998,
"y": 740
},
{
"t": 10,
"x": 998,
"y": 751
},
{
"t": 12,
"x": 998,
"y": 763
},
{
"t": 14,
"x": 998,
"y": 775
},
{
"t": 16,
"x": 998,
"y": 787
},
{
"t": 18,
"x": 998,
"y": 798
},
{
"t": 20,
"x": 998,
"y": 810
},
{
"t": 22,
"x": 998,
"y": 822
},
{
"t": 23,
"x": 998,
"y": 830
}
],
"birth": 0,
"death": 13
},
{
"id": 33,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 701
},
{
"t": 3,
"x": 998,
"y": 712
},
{
"t": 5,
"x": 998,
"y": 724
},
{
"t": 7,
"x": 998,
"y": 736
},
{
"t": 9,
"x": 998,
"y": 748
},
{
"t": 11,
"x": 998,
"y": 759
},
{
"t": 13,
"x": 998,
"y": 771
}
],
"birth": 0,
"death": 13
},
{
"id": 34,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 712
},
{
"t": 2,
"x": 998,
"y": 724
},
{
"t": 4,
"x": 998,
"y": 736
},
{
"t": 6,
"x": 998,
"y": 748
},
{
"t": 8,
"x": 998,
"y": 759
},
{
"t": 10,
"x": 998,
"y": 771
},
{
"t": 12,
"x": 998,
"y": 783
},
{
"t": 14,
"x": 998,
"y": 794
}
],
"birth": 0,
"death": 13
},
{
"id": 35,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 720
},
{
"t": 3,
"x": 998,
"y": 732
},
{
"t": 6,
"x": 998,
"y": 744
},
{
"t": 9,
"x": 998,
"y": 755
},
{
"t": 11,
"x": 998,
"y": 767
},
{
"t": 13,
"x": 998,
"y": 779
}
],
"birth": 0,
"death": 13
},
{
"id": 36,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 728
},
{
"t": 4,
"x": 998,
"y": 740
},
{
"t": 6,
"x": 998,
"y": 751
},
{
"t": 9,
"x": 998,
"y": 763
},
{
"t": 11,
"x": 998,
"y": 775
},
{
"t": 13,
"x": 998,
"y": 787
}
],
"birth": 0,
"death": 13
},
{
"id": 37,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 736
},
{
"t": 4,
"x": 998,
"y": 748
},
{
"t": 7,
"x": 998,
"y": 759
},
{
"t": 10,
"x": 998,
"y": 771
},
{
"t": 13,
"x": 998,
"y": 783
}
],
"birth": 0,
"death": 13
},
{
"id": 38,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 744
},
{
"t": 3,
"x": 998,
"y": 755
},
{
"t": 6,
"x": 998,
"y": 767
},
{
"t": 9,
"x": 998,
"y": 779
},
{
"t": 12,
"x": 998,
"y": 791
}
],
"birth": 0,
"death": 13
},
{
"id": 39,
"type": "pink and purple wooden toy castle",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 845
},
{
"t": 4,
"x": 998,
"y": 857
},
{
"t": 8,
"x": 998,
"y": 869
},
{
"t": 11,
"x": 998,
"y": 880
},
{
"t": 14,
"x": 998,
"y": 892
}
],
"birth": 0,
"death": 13
},
{
"id": 40,
"type": "pink and purple wooden toy castle",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 861
},
{
"t": 4,
"x": 998,
"y": 873
},
{
"t": 7,
"x": 998,
"y": 884
},
{
"t": 10,
"x": 998,
"y": 896
},
{
"t": 13,
"x": 998,
"y": 908
}
],
"birth": 0,
"death": 13
},
{
"id": 41,
"type": "pink and purple wooden toy castle",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 873
},
{
"t": 2,
"x": 998,
"y": 884
},
{
"t": 5,
"x": 998,
"y": 896
},
{
"t": 8,
"x": 998,
"y": 908
},
{
"t": 11,
"x": 998,
"y": 919
},
{
"t": 14,
"x": 998,
"y": 931
}
],
"birth": 0,
"death": 13
},
{
"id": 42,
"type": "purple probiotic supplement box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 896
},
{
"t": 2,
"x": 998,
"y": 908
},
{
"t": 4,
"x": 998,
"y": 919
},
{
"t": 6,
"x": 998,
"y": 931
},
{
"t": 8,
"x": 998,
"y": 943
},
{
"t": 10,
"x": 998,
"y": 955
},
{
"t": 12,
"x": 998,
"y": 966
},
{
"t": 14,
"x": 998,
"y": 978
}
],
"birth": 0,
"death": 13
},
{
"id": 43,
"type": "pink and purple wooden toy castle",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 900
},
{
"t": 2,
"x": 998,
"y": 912
},
{
"t": 5,
"x": 998,
"y": 923
},
{
"t": 7,
"x": 998,
"y": 935
},
{
"t": 9,
"x": 998,
"y": 947
},
{
"t": 11,
"x": 998,
"y": 958
},
{
"t": 13,
"x": 998,
"y": 970
}
],
"birth": 0,
"death": 13
},
{
"id": 44,
"type": "pink and purple wooden toy castle",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 912
},
{
"t": 2,
"x": 998,
"y": 923
},
{
"t": 4,
"x": 998,
"y": 935
},
{
"t": 6,
"x": 998,
"y": 947
},
{
"t": 8,
"x": 998,
"y": 958
},
{
"t": 10,
"x": 998,
"y": 970
},
{
"t": 12,
"x": 998,
"y": 982
},
{
"t": 14,
"x": 998,
"y": 994
}
],
"birth": 0,
"death": 13
},
{
"id": 45,
"type": "pink and purple wooden toy castle",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 927
},
{
"t": 3,
"x": 998,
"y": 939
},
{
"t": 6,
"x": 998,
"y": 951
},
{
"t": 9,
"x": 998,
"y": 962
},
{
"t": 12,
"x": 998,
"y": 974
},
{
"t": 15,
"x": 998,
"y": 986
},
{
"t": 18,
"x": 998,
"y": 998
}
],
"birth": 0,
"death": 13
},
{
"id": 46,
"type": "pink and purple wooden toy castle",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 939
},
{
"t": 3,
"x": 998,
"y": 951
},
{
"t": 6,
"x": 998,
"y": 962
},
{
"t": 9,
"x": 998,
"y": 974
},
{
"t": 12,
"x": 998,
"y": 986
},
{
"t": 15,
"x": 998,
"y": 998
}
],
"birth": 0,
"death": 13
},
{
"id": 47,
"type": "pink and purple wooden toy castle",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 974
},
{
"t": 3,
"x": 998,
"y": 986
},
{
"t": 6,
"x": 998,
"y": 998
},
{
"t": 9,
"x": 994,
"y": 994
},
{
"t": 12,
"x": 998,
"y": 994
},
{
"t": 13,
"x": 994,
"y": 998
}
],
"birth": 0,
"death": 13
},
{
"id": 48,
"type": "pink and purple wooden toy castle",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 998,
"y": 990
},
{
"t": 3,
"x": 994,
"y": 998
},
{
"t": 6,
"x": 990,
"y": 990
},
{
"t": 9,
"x": 990,
"y": 939
},
{
"t": 10,
"x": 990,
"y": 951
},
{
"t": 11,
"x": 990,
"y": 962
},
{
"t": 12,
"x": 990,
"y": 974
},
{
"t": 13,
"x": 990,
"y": 986
}
],
"birth": 0,
"death": 13
},
{
"id": 49,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 994,
"y": 384
},
{
"t": 1,
"x": 990,
"y": 392
},
{
"t": 4,
"x": 990,
"y": 380
},
{
"t": 5,
"x": 986,
"y": 388
},
{
"t": 11,
"x": 978,
"y": 384
},
{
"t": 12,
"x": 982,
"y": 376
},
{
"t": 13,
"x": 978,
"y": 384
}
],
"birth": 0,
"death": 13
},
{
"id": 50,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 994,
"y": 529
},
{
"t": 2,
"x": 994,
"y": 541
},
{
"t": 4,
"x": 994,
"y": 525
},
{
"t": 5,
"x": 990,
"y": 548
},
{
"t": 6,
"x": 990,
"y": 537
},
{
"t": 7,
"x": 990,
"y": 525
},
{
"t": 8,
"x": 990,
"y": 537
},
{
"t": 9,
"x": 990,
"y": 525
},
{
"t": 10,
"x": 990,
"y": 537
},
{
"t": 11,
"x": 990,
"y": 525
},
{
"t": 12,
"x": 990,
"y": 537
},
{
"t": 13,
"x": 990,
"y": 525
}
],
"birth": 0,
"death": 13
},
{
"id": 51,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 994,
"y": 541
},
{
"t": 2,
"x": 994,
"y": 552
},
{
"t": 3,
"x": 994,
"y": 541
},
{
"t": 7,
"x": 994,
"y": 529
},
{
"t": 8,
"x": 990,
"y": 556
},
{
"t": 10,
"x": 990,
"y": 544
},
{
"t": 12,
"x": 990,
"y": 533
},
{
"t": 13,
"x": 990,
"y": 544
}
],
"birth": 0,
"death": 13
},
{
"id": 52,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 994,
"y": 564
},
{
"t": 3,
"x": 994,
"y": 576
},
{
"t": 4,
"x": 994,
"y": 564
},
{
"t": 5,
"x": 990,
"y": 583
},
{
"t": 6,
"x": 990,
"y": 572
},
{
"t": 10,
"x": 990,
"y": 560
},
{
"t": 11,
"x": 986,
"y": 580
},
{
"t": 13,
"x": 986,
"y": 568
}
],
"birth": 0,
"death": 13
},
{
"id": 53,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 994,
"y": 681
},
{
"t": 1,
"x": 994,
"y": 693
},
{
"t": 3,
"x": 994,
"y": 705
},
{
"t": 5,
"x": 994,
"y": 716
},
{
"t": 7,
"x": 994,
"y": 728
},
{
"t": 9,
"x": 994,
"y": 740
},
{
"t": 11,
"x": 994,
"y": 751
},
{
"t": 13,
"x": 994,
"y": 763
}
],
"birth": 0,
"death": 13
},
{
"id": 54,
"type": "pink and purple wooden toy castle",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 994,
"y": 974
},
{
"t": 3,
"x": 990,
"y": 986
},
{
"t": 7,
"x": 986,
"y": 994
},
{
"t": 11,
"x": 982,
"y": 986
},
{
"t": 12,
"x": 990,
"y": 994
},
{
"t": 13,
"x": 982,
"y": 990
},
{
"t": 14,
"x": 990,
"y": 994
}
],
"birth": 0,
"death": 13
},
{
"id": 55,
"type": "pink and purple wooden toy castle",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 994,
"y": 990
},
{
"t": 2,
"x": 990,
"y": 998
},
{
"t": 5,
"x": 998,
"y": 994
},
{
"t": 6,
"x": 994,
"y": 990
},
{
"t": 8,
"x": 990,
"y": 998
},
{
"t": 9,
"x": 994,
"y": 994
},
{
"t": 11,
"x": 990,
"y": 990
},
{
"t": 13,
"x": 994,
"y": 986
},
{
"t": 14,
"x": 990,
"y": 994
}
],
"birth": 0,
"death": 13
},
{
"id": 56,
"type": "yellow and burgundy sneaker",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 2,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": false
},
{
"t": 2,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 2,
"x": 365,
"y": 419
},
{
"t": 3,
"x": 376,
"y": 423
},
{
"t": 4,
"x": 384,
"y": 431
},
{
"t": 5,
"x": 392,
"y": 439
},
{
"t": 6,
"x": 400,
"y": 447
},
{
"t": 7,
"x": 408,
"y": 455
},
{
"t": 8,
"x": 416,
"y": 466
},
{
"t": 9,
"x": 423,
"y": 474
},
{
"t": 10,
"x": 431,
"y": 486
},
{
"t": 11,
"x": 439,
"y": 498
},
{
"t": 12,
"x": 447,
"y": 505
},
{
"t": 13,
"x": 455,
"y": 517
}
],
"birth": 2,
"death": 13
},
{
"id": 57,
"type": "pink cardboard gum car cup pack",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 2,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": false
},
{
"t": 2,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 2,
"x": 998,
"y": 388
},
{
"t": 3,
"x": 998,
"y": 376
},
{
"t": 4,
"x": 994,
"y": 388
},
{
"t": 5,
"x": 994,
"y": 376
},
{
"t": 6,
"x": 990,
"y": 388
},
{
"t": 7,
"x": 990,
"y": 376
},
{
"t": 8,
"x": 986,
"y": 388
},
{
"t": 9,
"x": 986,
"y": 376
},
{
"t": 10,
"x": 982,
"y": 388
},
{
"t": 11,
"x": 982,
"y": 376
},
{
"t": 12,
"x": 978,
"y": 388
},
{
"t": 13,
"x": 978,
"y": 376
}
],
"birth": 2,
"death": 13
},
{
"id": 58,
"type": "pink and white fabric high-top sneaker",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 4,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": false
},
{
"t": 4,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 4,
"x": 357,
"y": 431
},
{
"t": 5,
"x": 365,
"y": 435
},
{
"t": 6,
"x": 373,
"y": 439
},
{
"t": 7,
"x": 380,
"y": 443
},
{
"t": 8,
"x": 388,
"y": 447
},
{
"t": 9,
"x": 396,
"y": 451
},
{
"t": 10,
"x": 404,
"y": 458
},
{
"t": 11,
"x": 412,
"y": 462
},
{
"t": 12,
"x": 419,
"y": 466
},
{
"t": 13,
"x": 427,
"y": 470
}
],
"birth": 4,
"death": 13
},
{
"id": 59,
"type": "pink and purple wooden toy castle",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 7,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": false
},
{
"t": 7,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 7,
"x": 998,
"y": 388
},
{
"t": 9,
"x": 998,
"y": 373
},
{
"t": 11,
"x": 994,
"y": 384
},
{
"t": 13,
"x": 994,
"y": 373
}
],
"birth": 7,
"death": 13
},
{
"id": 60,
"type": "dark blue leather boat shoe",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 10,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": false
},
{
"t": 10,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 10,
"x": 1,
"y": 501
},
{
"t": 11,
"x": 1,
"y": 490
},
{
"t": 12,
"x": 1,
"y": 474
},
{
"t": 13,
"x": 1,
"y": 462
}
],
"birth": 10,
"death": 13
},
{
"id": 61,
"type": "yellow and green cardboard fingerpaint set",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 11,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": false
},
{
"t": 11,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 11,
"x": 1,
"y": 544
},
{
"t": 12,
"x": 1,
"y": 533
}
],
"birth": 11,
"death": 13
}
],
"interactions": [
{
"id": 1,
"inputs": [
1,
61
],
"outputs": [
1,
61
],
"begins_at": 0,
"ends_at": 4,
"type": "contact"
},
{
"id": 3,
"inputs": [
1,
60
],
"outputs": [
1,
60
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
61
],
"outputs": [
1,
61
],
"begins_at": 0,
"ends_at": 12,
"type": "contact"
},
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 12,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 13,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 14,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 15,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 16,
"inputs": [
14,
65535
],
"outputs": [
14,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 17,
"inputs": [
15,
65535
],
"outputs": [
15,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 18,
"inputs": [
16,
65535
],
"outputs": [
16,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 19,
"inputs": [
17,
65535
],
"outputs": [
17,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 20,
"inputs": [
18,
65535
],
"outputs": [
18,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 21,
"inputs": [
19,
65535
],
"outputs": [
19,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 22,
"inputs": [
20,
65535
],
"outputs": [
20,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 23,
"inputs": [
21,
65535
],
"outputs": [
21,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 24,
"inputs": [
22,
65535
],
"outputs": [
22,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 25,
"inputs": [
23,
65535
],
"outputs": [
23,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 26,
"inputs": [
24,
65535
],
"outputs": [
24,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 27,
"inputs": [
25,
65535
],
"outputs": [
25,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 28,
"inputs": [
26,
65535
],
"outputs": [
26,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 29,
"inputs": [
27,
65535
],
"outputs": [
27,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 30,
"inputs": [
28,
65535
],
"outputs": [
28,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 31,
"inputs": [
29,
65535
],
"outputs": [
29,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 32,
"inputs": [
30,
65535
],
"outputs": [
30,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 33,
"inputs": [
31,
65535
],
"outputs": [
31,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 34,
"inputs": [
32,
65535
],
"outputs": [
32,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 35,
"inputs": [
33,
65535
],
"outputs": [
33,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 36,
"inputs": [
34,
65535
],
"outputs": [
34,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 37,
"inputs": [
35,
65535
],
"outputs": [
35,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 38,
"inputs": [
36,
65535
],
"outputs": [
36,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 39,
"inputs": [
37,
65535
],
"outputs": [
37,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 40,
"inputs": [
38,
65535
],
"outputs": [
38,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 41,
"inputs": [
39,
65535
],
"outputs": [
39,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 42,
"inputs": [
40,
65535
],
"outputs": [
40,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 43,
"inputs": [
41,
65535
],
"outputs": [
41,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 44,
"inputs": [
42,
65535
],
"outputs": [
42,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 45,
"inputs": [
43,
65535
],
"outputs": [
43,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 46,
"inputs": [
44,
65535
],
"outputs": [
44,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 47,
"inputs": [
45,
65535
],
"outputs": [
45,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 48,
"inputs": [
46,
65535
],
"outputs": [
46,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 49,
"inputs": [
47,
65535
],
"outputs": [
47,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 50,
"inputs": [
48,
65535
],
"outputs": [
48,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 51,
"inputs": [
50,
65535
],
"outputs": [
50,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 52,
"inputs": [
51,
65535
],
"outputs": [
51,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 53,
"inputs": [
52,
65535
],
"outputs": [
52,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 54,
"inputs": [
53,
65535
],
"outputs": [
53,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 55,
"inputs": [
54,
65535
],
"outputs": [
54,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 56,
"inputs": [
55,
65535
],
"outputs": [
55,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 57,
"inputs": [
56,
65535
],
"outputs": [
56,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 58,
"inputs": [
57,
65535
],
"outputs": [
57,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 59,
"inputs": [
59,
65535
],
"outputs": [
59,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 60,
"inputs": [
61,
65535
],
"outputs": [
61,
65535
],
"begins_at": 0,
"ends_at": 13,
"type": "contact"
},
{
"id": 61,
"inputs": [
62,
65535
],
"outputs": [
62,
65535
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 62,
"inputs": [
62,
65535
],
"outputs": [
62,
65535
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 63,
"inputs": [
62,
65535
],
"outputs": [
62,
65535
],
"begins_at": 6,
"ends_at": 13,
"type": "contact"
},
{
"id": 6,
"inputs": [
1,
61
],
"outputs": [
1,
61
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 7,
"inputs": [
1,
65
],
"outputs": [
1,
65
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 10,
"inputs": [
10,
12
],
"outputs": [
10,
12
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 8,
"inputs": [
1,
61
],
"outputs": [
1,
61
],
"begins_at": 10,
"ends_at": 12,
"type": "contact"
},
{
"id": 11,
"inputs": [
10,
12
],
"outputs": [
10,
12
],
"begins_at": 11,
"ends_at": 12,
"type": "contact"
},
{
"id": 9,
"inputs": [
1,
65
],
"outputs": [
1,
65
],
"begins_at": 12,
"ends_at": 12,
"type": "collision"
},
{
"id": 3,
"inputs": [
1,
60
],
"outputs": [
1,
60
],
"begins_at": 12,
"ends_at": 13,
"type": "collision"
},
{
"id": 4,
"inputs": [
1,
61
],
"outputs": [
1,
61
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 5,
"inputs": [
1,
65
],
"outputs": [
1,
65
],
"begins_at": 13,
"ends_at": 13,
"type": "contact"
},
{
"id": 12,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 2,
"inputs": [
1,
61
],
"outputs": [
1,
61
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 7,
"inputs": [
1,
65
],
"outputs": [
1,
65
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
},
{
"id": 9,
"inputs": [
10,
12
],
"outputs": [
10,
12
],
"begins_at": 13,
"ends_at": 13,
"type": "collision"
}
]
}Parsed ground truth
{
"objects": [
{
"id": 0,
"type": "cyan chopper",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 63,
"y": 681
},
{
"t": 1,
"x": 59,
"y": 676
},
{
"t": 2,
"x": 66,
"y": 681
},
{
"t": 3,
"x": 64,
"y": 678
},
{
"t": 4,
"x": 66,
"y": 679
},
{
"t": 5,
"x": 65,
"y": 667
},
{
"t": 6,
"x": 95,
"y": 663
},
{
"t": 7,
"x": 98,
"y": 663
},
{
"t": 8,
"x": 101,
"y": 665
},
{
"t": 9,
"x": 100,
"y": 668
},
{
"t": 10,
"x": 104,
"y": 668
},
{
"t": 12,
"x": 108,
"y": 680
},
{
"t": 13,
"x": 111,
"y": 680
},
{
"t": 14,
"x": 114,
"y": 680
},
{
"t": 15,
"x": 116,
"y": 681
},
{
"t": 16,
"x": 119,
"y": 682
},
{
"t": 17,
"x": 122,
"y": 683
},
{
"t": 18,
"x": 123,
"y": 686
},
{
"t": 19,
"x": 125,
"y": 689
},
{
"t": 20,
"x": 129,
"y": 689
},
{
"t": 21,
"x": 131,
"y": 689
},
{
"t": 22,
"x": 135,
"y": 689
},
{
"t": 23,
"x": 136,
"y": 692
}
],
"birth": 0,
"death": 24
},
{
"id": 1,
"type": "green airliner",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 186,
"y": 748
},
{
"t": 14,
"x": 187,
"y": 747
},
{
"t": 15,
"x": 190,
"y": 748
},
{
"t": 17,
"x": 194,
"y": 749
},
{
"t": 20,
"x": 197,
"y": 749
},
{
"t": 22,
"x": 199,
"y": 749
}
],
"birth": 0,
"death": 24
},
{
"id": 2,
"type": "brown jet",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 344,
"y": 402
},
{
"t": 1,
"x": 346,
"y": 403
},
{
"t": 2,
"x": 345,
"y": 401
},
{
"t": 3,
"x": 348,
"y": 403
},
{
"t": 4,
"x": 349,
"y": 404
},
{
"t": 5,
"x": 351,
"y": 405
},
{
"t": 6,
"x": 353,
"y": 408
},
{
"t": 7,
"x": 358,
"y": 414
},
{
"t": 8,
"x": 362,
"y": 419
},
{
"t": 10,
"x": 368,
"y": 427
},
{
"t": 11,
"x": 370,
"y": 431
},
{
"t": 12,
"x": 374,
"y": 436
},
{
"t": 13,
"x": 377,
"y": 442
},
{
"t": 14,
"x": 380,
"y": 447
},
{
"t": 15,
"x": 383,
"y": 453
},
{
"t": 16,
"x": 387,
"y": 459
},
{
"t": 17,
"x": 391,
"y": 467
},
{
"t": 18,
"x": 394,
"y": 473
},
{
"t": 19,
"x": 396,
"y": 480
},
{
"t": 20,
"x": 399,
"y": 488
},
{
"t": 21,
"x": 402,
"y": 495
},
{
"t": 22,
"x": 405,
"y": 503
},
{
"t": 23,
"x": 411,
"y": 516
}
],
"birth": 0,
"death": 24
},
{
"id": 3,
"type": "purple double",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 783,
"y": 776
},
{
"t": 1,
"x": 772,
"y": 773
},
{
"t": 2,
"x": 763,
"y": 771
},
{
"t": 3,
"x": 791,
"y": 776
},
{
"t": 4,
"x": 742,
"y": 765
},
{
"t": 5,
"x": 730,
"y": 760
},
{
"t": 6,
"x": 721,
"y": 758
},
{
"t": 7,
"x": 710,
"y": 755
},
{
"t": 8,
"x": 700,
"y": 752
},
{
"t": 9,
"x": 691,
"y": 749
},
{
"t": 10,
"x": 680,
"y": 746
},
{
"t": 11,
"x": 669,
"y": 742
},
{
"t": 12,
"x": 659,
"y": 740
},
{
"t": 13,
"x": 650,
"y": 736
},
{
"t": 14,
"x": 641,
"y": 734
},
{
"t": 15,
"x": 630,
"y": 730
},
{
"t": 16,
"x": 622,
"y": 728
},
{
"t": 17,
"x": 612,
"y": 725
},
{
"t": 18,
"x": 603,
"y": 723
},
{
"t": 19,
"x": 594,
"y": 720
},
{
"t": 20,
"x": 583,
"y": 717
},
{
"t": 21,
"x": 576,
"y": 715
},
{
"t": 22,
"x": 593,
"y": 720
},
{
"t": 23,
"x": 558,
"y": 709
}
],
"birth": 0,
"death": 24
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
}
]
}Complete per-sample evaluator report
{
"metrics": {
"avg_type_similarity": 0.3357983454179461,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 328.1480191293774,
"avg_image_position_segmentation_acc": 0.17708333333333334,
"avg_image_position_segmentation_acc_small": null,
"avg_image_position_segmentation_acc_medium": 0.3541666666666667,
"avg_image_position_segmentation_acc_large": 0.0,
"avg_image_position_segmentation_acc_first_frame": 0.0,
"avg_image_position_segmentation_visible_acc": 0.17708333333333334,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": null,
"num_matches": 4,
"num_unmatched_pred": 58,
"num_unmatched_target": 0
},
"supports": {
"avg_type_similarity": 4,
"avg_size_diff": 0,
"avg_3d_iou": 0,
"avg_image_position_px_diff": 4,
"avg_image_position_segmentation_acc": 4,
"avg_image_position_segmentation_acc_small": 0,
"avg_image_position_segmentation_acc_medium": 2,
"avg_image_position_segmentation_acc_large": 2,
"avg_image_position_segmentation_acc_first_frame": 4,
"avg_image_position_segmentation_visible_acc": 4,
"avg_quaternion_geodesic_deg": 0,
"visibility_acc": 4,
"visibility_true_acc": 4,
"visibility_false_acc": 0,
"is_in_frame_acc": 4,
"is_in_frame_true_acc": 4,
"is_in_frame_false_acc": 0,
"vis_acc_from_px": 4,
"vis_acc_from_px_true_acc": 4,
"vis_acc_from_px_false_acc": 0
},
"matching": {
"matches": [
{
"target_index": 0,
"pred_index": 5,
"target_id": 0,
"pred_id": 5,
"cost": 0.7916666666666667,
"cost_breakdown": [
{
"name": "mutual_type",
"weight": 1.0,
"raw_cost": 0.5,
"weighted_cost": 0.5,
"used_missing_value": false
},
{
"name": "same_seg",
"weight": 1.0,
"raw_cost": 0.2916666666666667,
"weighted_cost": 0.2916666666666667,
"used_missing_value": false
}
]
},
{
"target_index": 1,
"pred_index": 6,
"target_id": 1,
"pred_id": 6,
"cost": 1.0,
"cost_breakdown": [
{
"name": "mutual_type",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "same_seg",
"weight": 1.0,
"raw_cost": 1.0,
"weighted_cost": 1.0,
"used_missing_value": false
}
]
},
{
"target_index": 2,
"pred_index": 19,
"target_id": 2,
"pred_id": 19,
"cost": 1.0,
"cost_breakdown": [
{
"name": "mutual_type",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "same_seg",
"weight": 1.0,
"raw_cost": 1.0,
"weighted_cost": 1.0,
"used_missing_value": false
}
]
},
{
"target_index": 3,
"pred_index": 1,
"target_id": 3,
"pred_id": 1,
"cost": 1.5,
"cost_breakdown": [
{
"name": "mutual_type",
"weight": 1.0,
"raw_cost": 0.5,
"weighted_cost": 0.5,
"used_missing_value": false
},
{
"name": "same_seg",
"weight": 1.0,
"raw_cost": 1.0,
"weighted_cost": 1.0,
"used_missing_value": false
}
]
}
],
"unmatched_target_ids": [],
"unmatched_pred_ids": [
0,
2,
3,
4,
7,
8,
9,
10,
11,
12,
13,
14,
15,
16,
17,
18,
20,
21,
22,
23,
24,
25,
26,
27,
28,
29,
30,
31,
32,
33,
34,
35,
36,
37,
38,
39,
40,
41,
42,
43,
44,
45,
46,
47,
48,
49,
50,
51,
52,
53,
54,
55,
56,
57,
58,
59,
60,
61
],
"target_type_counts": {
"cyan chopper": 1,
"green airliner": 1,
"brown jet": 1,
"purple double": 1
},
"pred_type_counts": {
"green and orange plastic magnifying glass": 2,
"grey and white plastic shark figurine": 2,
"grey and orange athletic shoe": 1,
"green wooden mushroom pounding toy": 1,
"green wooden toy train": 3,
"green wooden dollhouse bedroom furniture set": 2,
"red and natural wooden dollhouse furniture set": 1,
"green fabric dish towel": 1,
"white and red cardboard ink cartridge multi-pack": 1,
"white and tan plastic unicorn figurine": 1,
"black and metallic dish drainer": 1,
"black cardboard motherboard box": 1,
"white and orange rubber slide sandal": 1,
"yellow and brown hard candy box": 1,
"dark brown leather boat shoe": 1,
"dark grey plastic network storage device": 1,
"blue and white high-top sneaker": 1,
"dark grey cardboard motherboard box": 1,
"yellow plastic plant pot": 1,
"dark grey and pink running shoe": 1,
"pink and white fabric high-top sneaker": 19,
"pink cardboard gum car cup pack": 2,
"pink and purple wooden toy castle": 12,
"purple probiotic supplement box": 1,
"yellow and burgundy sneaker": 1,
"dark blue leather boat shoe": 1,
"yellow and green cardboard fingerpaint set": 1
},
"assignment_backend": "scipy_dense",
"cost_functions": [
"mutual_type",
"same_seg"
],
"cost_weights": {
"mutual_type": 1.0,
"same_seg": 1.0
},
"num_frames": 24
},
"scene_metrics": {
"thresholds": [
0.5,
1.0,
2.0,
3.0
],
"counts_by_threshold": {
"0.5": {
"true_positives": 3,
"false_positives": 1,
"false_negatives": 0
},
"1.0": {
"true_positives": 1,
"false_positives": 3,
"false_negatives": 0
},
"2.0": {
"true_positives": 0,
"false_positives": 4,
"false_negatives": 0
},
"3.0": {
"true_positives": 0,
"false_positives": 4,
"false_negatives": 0
}
},
"jaccard_by_threshold": {
"0.5": 0.75,
"1.0": 0.25,
"2.0": 0.0,
"3.0": 0.0
},
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 4,
"false_positives": 58,
"false_negatives": 0
},
"0.5": {
"true_positives": 4,
"false_positives": 58,
"false_negatives": 0
},
"0.75": {
"true_positives": 4,
"false_positives": 58,
"false_negatives": 0
},
"1.0": {
"true_positives": 4,
"false_positives": 58,
"false_negatives": 0
}
},
"visibility_precision_by_threshold": {
"0.25": 0.06451612903225806,
"0.5": 0.06451612903225806,
"0.75": 0.06451612903225806,
"1.0": 0.06451612903225806
},
"visibility_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"visibility_f1_by_threshold": {
"0.25": 0.12121212121212122,
"0.5": 0.12121212121212122,
"0.75": 0.12121212121212122,
"1.0": 0.12121212121212122
},
"visibility_by_motion_group": {
"static": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 0,
"false_negatives": 0
},
"0.5": {
"true_positives": 3,
"false_positives": 0,
"false_negatives": 0
},
"0.75": {
"true_positives": 3,
"false_positives": 0,
"false_negatives": 0
},
"1.0": {
"true_positives": 3,
"false_positives": 0,
"false_negatives": 0
}
},
"visibility_precision_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"visibility_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"visibility_f1_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
}
},
"unknown": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 1,
"false_positives": 58,
"false_negatives": 0
},
"0.5": {
"true_positives": 1,
"false_positives": 58,
"false_negatives": 0
},
"0.75": {
"true_positives": 1,
"false_positives": 58,
"false_negatives": 0
},
"1.0": {
"true_positives": 1,
"false_positives": 58,
"false_negatives": 0
}
},
"visibility_precision_by_threshold": {
"0.25": 0.01694915254237288,
"0.5": 0.01694915254237288,
"0.75": 0.01694915254237288,
"1.0": 0.01694915254237288
},
"visibility_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"visibility_f1_by_threshold": {
"0.25": 0.03333333333333333,
"0.5": 0.03333333333333333,
"0.75": 0.03333333333333333,
"1.0": 0.03333333333333333
}
}
},
"segmentation_counts_by_threshold": {
"0.25": {
"true_positives": 1,
"false_positives": 61,
"false_negatives": 3
},
"0.5": {
"true_positives": 1,
"false_positives": 61,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 62,
"false_negatives": 4
},
"1.0": {
"true_positives": 0,
"false_positives": 62,
"false_negatives": 4
}
},
"segmentation_precision_by_threshold": {
"0.25": 0.016129032258064516,
"0.5": 0.016129032258064516,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_recall_by_threshold": {
"0.25": 0.25,
"0.5": 0.25,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_f1_by_threshold": {
"0.25": 0.030303030303030304,
"0.5": 0.030303030303030304,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_frame_average_precision": 0.008064516129032258,
"segmentation_frame_average_recall": 0.125,
"segmentation_frame_average_f1": 0.015151515151515152,
"segmentation_first_frame_counts": {
"true_positives": 0,
"false_positives": 62,
"false_negatives": 0
},
"segmentation_first_frame_precision": 0.0,
"segmentation_first_frame_recall": 0.0,
"segmentation_first_frame_f1": 0.0,
"segmentation_by_motion_group": {
"static": {
"segmentation_counts_by_threshold": {
"0.25": {
"true_positives": 1,
"false_positives": 2,
"false_negatives": 2
},
"0.5": {
"true_positives": 1,
"false_positives": 2,
"false_negatives": 2
},
"0.75": {
"true_positives": 0,
"false_positives": 3,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 3,
"false_negatives": 3
}
},
"segmentation_precision_by_threshold": {
"0.25": 0.3333333333333333,
"0.5": 0.3333333333333333,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_recall_by_threshold": {
"0.25": 0.3333333333333333,
"0.5": 0.3333333333333333,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_f1_by_threshold": {
"0.25": 0.3333333333333333,
"0.5": 0.3333333333333333,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_frame_average_precision": 0.16666666666666666,
"segmentation_frame_average_recall": 0.16666666666666666,
"segmentation_frame_average_f1": 0.16666666666666666,
"segmentation_first_frame_counts": {
"true_positives": 0,
"false_positives": 3,
"false_negatives": 0
},
"segmentation_first_frame_precision": 0.0,
"segmentation_first_frame_recall": 0.0,
"segmentation_first_frame_f1": 0.0
},
"unknown": {
"segmentation_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 59,
"false_negatives": 1
},
"0.5": {
"true_positives": 0,
"false_positives": 59,
"false_negatives": 1
},
"0.75": {
"true_positives": 0,
"false_positives": 59,
"false_negatives": 1
},
"1.0": {
"true_positives": 0,
"false_positives": 59,
"false_negatives": 1
}
},
"segmentation_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_frame_average_precision": 0.0,
"segmentation_frame_average_recall": 0.0,
"segmentation_frame_average_f1": 0.0,
"segmentation_first_frame_counts": {
"true_positives": 0,
"false_positives": 59,
"false_negatives": 0
},
"segmentation_first_frame_precision": 0.0,
"segmentation_first_frame_recall": 0.0,
"segmentation_first_frame_f1": 0.0
}
}
},
"per_match_metrics": [
{
"target_id": 0,
"pred_id": 5,
"cost": 0.7916666666666667,
"type_similarity": 0.2165148312056031,
"size_diff": null,
"3d_iou": null,
"image_position_px_diff": 19.79452145869212,
"image_position_segmentation_acc": 0.7083333333333334,
"image_position_segmentation_acc_small": null,
"image_position_segmentation_acc_medium": 0.7083333333333334,
"image_position_segmentation_acc_large": null,
"image_position_segmentation_acc_first_frame": 0.0,
"image_position_segmentation_visible_acc": 0.7083333333333334,
"quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": null
},
{
"target_id": 1,
"pred_id": 6,
"cost": 1.0,
"type_similarity": 0.41872055734858926,
"size_diff": null,
"3d_iou": null,
"image_position_px_diff": 79.40332327326819,
"image_position_segmentation_acc": 0.0,
"image_position_segmentation_acc_small": null,
"image_position_segmentation_acc_medium": null,
"image_position_segmentation_acc_large": 0.0,
"image_position_segmentation_acc_first_frame": 0.0,
"image_position_segmentation_visible_acc": 0.0,
"quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": null
},
{
"target_id": 2,
"pred_id": 19,
"cost": 1.0,
"type_similarity": 0.4209190057892422,
"size_diff": null,
"3d_iou": null,
"image_position_px_diff": 367.298495511442,
"image_position_segmentation_acc": 0.0,
"image_position_segmentation_acc_small": null,
"image_position_segmentation_acc_medium": 0.0,
"image_position_segmentation_acc_large": null,
"image_position_segmentation_acc_first_frame": 0.0,
"image_position_segmentation_visible_acc": 0.0,
"quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": null
},
{
"target_id": 3,
"pred_id": 1,
"cost": 1.5,
"type_similarity": 0.28703898732834987,
"size_diff": null,
"3d_iou": null,
"image_position_px_diff": 846.0957362741074,
"image_position_segmentation_acc": 0.0,
"image_position_segmentation_acc_small": null,
"image_position_segmentation_acc_medium": null,
"image_position_segmentation_acc_large": 0.0,
"image_position_segmentation_acc_first_frame": 0.0,
"image_position_segmentation_visible_acc": 0.0,
"quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": null
}
],
"interaction_metrics": {
"avg_interaction_temporal_span_giou": 0.5833333333333334,
"avg_interaction_input_object_jaccard": 0.3333333333333333,
"avg_interaction_output_object_jaccard": 0.3333333333333333,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 3,
"num_unmatched_pred_interactions": 66,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 66,
"false_negatives": 0
},
"0.5": {
"true_positives": 3,
"false_positives": 66,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 69,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 69,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.043478260869565216,
"0.5": 0.043478260869565216,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.08333333333333333,
"0.5": 0.08333333333333333,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 66,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 69,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 69,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 69,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.043478260869565216,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.08333333333333333,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 66,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 69,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 69,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 69,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.043478260869565216,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.08333333333333333,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"interaction_supports": {
"avg_interaction_temporal_span_giou": 3,
"avg_interaction_input_object_jaccard": 3,
"avg_interaction_output_object_jaccard": 3,
"avg_interaction_type_exact_match_acc": 3
},
"interaction_matching": {
"matches": [
{
"target_index": 0,
"pred_index": 0,
"target_id": 0,
"pred_id": 0,
"cost": 0.20833333333333326,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.20833333333333326,
"weighted_cost": 0.20833333333333326,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
}
]
},
{
"target_index": 1,
"pred_index": 16,
"target_id": 1,
"pred_id": 12,
"cost": 0.20833333333333326,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.20833333333333326,
"weighted_cost": 0.20833333333333326,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
}
]
},
{
"target_index": 2,
"pred_index": 18,
"target_id": 2,
"pred_id": 13,
"cost": 0.20833333333333326,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.20833333333333326,
"weighted_cost": 0.20833333333333326,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
}
]
}
],
"unmatched_target_ids": [],
"unmatched_pred_ids": [
1,
2,
2,
3,
3,
4,
5,
6,
7,
7,
8,
9,
9,
10,
11,
12,
14,
15,
16,
17,
18,
19,
20,
21,
22,
23,
24,
25,
26,
27,
28,
29,
30,
31,
32,
33,
34,
35,
36,
37,
38,
39,
40,
41,
42,
43,
44,
45,
46,
47,
48,
49,
50,
51,
52,
53,
54,
55,
56,
57,
58,
59,
60,
61,
62,
63
],
"target_type_counts": {
"contact": 3
},
"pred_type_counts": {
"contact": 57,
"collision": 12
},
"assignment_backend": "scipy_dense",
"cost_functions": [
"type_exact",
"temporal_span",
"input_object_set_mutual_jaccard",
"output_object_set_mutual_jaccard"
],
"cost_weights": {
"type_exact": 1.0,
"temporal_span": 1.0,
"input_object_set_mutual_jaccard": 0.5,
"output_object_set_mutual_jaccard": 0.5
}
},
"per_interaction_match_metrics": [
{
"target_index": 0,
"pred_index": 0,
"target_id": 0,
"pred_id": 0,
"target_type": "contact",
"pred_type": "contact",
"cost": 0.20833333333333326,
"temporal_span_iou": 0.5833333333333334,
"temporal_span_giou": 0.5833333333333334,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 1,
"pred_index": 16,
"target_id": 1,
"pred_id": 12,
"target_type": "contact",
"pred_type": "contact",
"cost": 0.20833333333333326,
"temporal_span_iou": 0.5833333333333334,
"temporal_span_giou": 0.5833333333333334,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 2,
"pred_index": 18,
"target_id": 2,
"pred_id": 13,
"target_type": "contact",
"pred_type": "contact",
"cost": 0.20833333333333326,
"temporal_span_iou": 0.5833333333333334,
"temporal_span_giou": 0.5833333333333334,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
}
],
"interaction_metrics_by_participants": {
"object_ground": {
"avg_interaction_temporal_span_giou": 0.5833333333333334,
"avg_interaction_input_object_jaccard": 0.3333333333333333,
"avg_interaction_output_object_jaccard": 0.3333333333333333,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 3,
"num_unmatched_pred_interactions": 51,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 51,
"false_negatives": 0
},
"0.5": {
"true_positives": 3,
"false_positives": 51,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 54,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 54,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.05555555555555555,
"0.5": 0.05555555555555555,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.10526315789473684,
"0.5": 0.10526315789473684,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 51,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 54,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 54,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 54,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.05555555555555555,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.10526315789473684,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 51,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 54,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 54,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 54,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.05555555555555555,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.10526315789473684,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"object_object": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 15,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 15,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 15,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 15,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 15,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 15,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 15,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 15,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 15,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 15,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 15,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 15,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 15,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"interaction_supports_by_participants": {
"object_ground": {
"avg_interaction_temporal_span_giou": 3,
"avg_interaction_input_object_jaccard": 3,
"avg_interaction_output_object_jaccard": 3,
"avg_interaction_type_exact_match_acc": 3
},
"object_object": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
}
},
"interaction_metrics_by_type": {
"collision": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 12,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 12,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 12,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 12,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 12,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 12,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 12,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 12,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 12,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 12,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 12,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 12,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 12,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"contact": {
"avg_interaction_temporal_span_giou": 0.5833333333333334,
"avg_interaction_input_object_jaccard": 0.3333333333333333,
"avg_interaction_output_object_jaccard": 0.3333333333333333,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 3,
"num_unmatched_pred_interactions": 54,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 54,
"false_negatives": 0
},
"0.5": {
"true_positives": 3,
"false_positives": 54,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 57,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 57,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.05263157894736842,
"0.5": 0.05263157894736842,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.1,
"0.5": 0.1,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 54,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 57,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 57,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 57,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.05263157894736842,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.1,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 54,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 57,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 57,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 57,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.05263157894736842,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.1,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"interaction_supports_by_type": {
"collision": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
},
"contact": {
"avg_interaction_temporal_span_giou": 3,
"avg_interaction_input_object_jaccard": 3,
"avg_interaction_output_object_jaccard": 3,
"avg_interaction_type_exact_match_acc": 3
}
}
}Exact evaluation configuration
{
"predictions_jsonl": "../inference_output.jsonl",
"dataset_json": "../test_data/movi_dump_sentinel_sharegpt.json",
"scene_root": "../test_data/movi_dump",
"output_json": "../evaluation_report.json",
"max_samples": null,
"num_workers": 1,
"show_progress": true,
"log_level": "INFO",
"visibility_filter_mode": "any_frame",
"pos2d_mode": "scaled_normalized",
"pos2d_scale": 1000.0,
"image_width": null,
"image_height": null,
"type_embed_model_name": "all-MiniLM-L6-v2",
"scene_similarity_thresholds": [
0.5,
1.0,
2.0,
3.0
],
"scene_segmentation_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"matching": {
"costs": [
{
"name": "mutual_type",
"weight": 1.0
},
{
"name": "same_seg",
"weight": 1.0,
"missing_value": 1.0,
"kwargs": {
"only_use_first_frame": false
}
}
]
},
"interaction_matching": {
"costs": [
{
"name": "type_exact",
"weight": 1.0
},
{
"name": "temporal_span",
"weight": 1.0
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5
}
]
},
"return_per_sample": true
}