STRIVE · 08/28/2026
Dyn generalization · val_120 · super_clevr_1077
Everything fed into evaluation and the full per-sample output it produced.
Dataset row: exact video + user prompt + assistant target
{
"messages": [
{
"role": "user",
"content": "<video>\nAnalyze the provided video and return ONLY a valid sentinel sequence in this format:\n[SCENE-START] [OBJS-START]\n[OBJ] id \"type\" birth death [VIS] t vis ... [IN-FRAME] t is_in_frame ... [PX] t px py ...\n[OBJ] ...\n[OBJS-END]\n[INTERACTIONS-START]\n[INTERACT] id \"type\" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ...\n[INTERACT] ...\n[INTERACTIONS-END] [SCENE-END]\n\nConstraints:\n- Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose).\n- Keep tags exactly as written:\n `[SCENE-START] [OBJS-START] [OBJ] [VIS] [IN-FRAME] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]`\n- Use quoted strings for `type` (double quotes).\n- `VIS` uses repeated groups of 2 values in order:\n `t vis`.\n `vis` is a boolean value.\n- `IN-FRAME` uses repeated groups of 2 values in order:\n `t is_in_frame`.\n `is_in_frame` is a boolean value.\n- `PX` uses repeated groups of 3 values in order: `t px py`.\n- `px` and `py` are normalized pixel coordinates in the range `[0, 1]`,\n scaled by `1000` and then converted to integers by dropping the decimal part.\n- For occluded or out-of-frame frames under this setting, `PX` may use `t null null`.\n- `IN` and `OUT` contain whitespace-separated integer ids.\n- Use lowercase booleans (`true`/`false`) for `vis` and `is_in_frame`."
},
{
"role": "assistant",
"content": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown tandem\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 336 642 3 337 644 5 342 641 6 341 646 7 333 613 8 344 641 10 333 624 12 335 626 13 348 648 14 347 657 16 348 658 17 341 623 18 340 632 19 351 659 20 350 663 21 344 629 23 347 629 24 354 668 25 346 636 26 347 640 27 349 636 28 349 642 30 352 641 31 354 642 32 353 647 33 355 649 34 356 648 35 368 688 36 369 691 37 359 655 38 361 656 39 365 654 40 363 659 41 366 661 42 367 664 43 377 674 44 380 677 45 372 669 46 389 695 47 391 696 48 386 717 49 395 702 50 388 721 51 391 722 52 387 692 53 405 716 54 395 732 55 394 703 56 396 707 58 399 713 59 412 719 60 415 724 61 400 745 62 408 731 63 422 732 64 412 730 65 426 736 66 429 739 67 419 736 68 433 744 69 424 742 70 441 765 71 441 753 72 431 751 73 449 774 74 429 784 75 439 765 76 441 764 77 433 760 78 446 767 79 448 767 80 451 763 81 453 763 82 455 768 83 458 764 84 459 767 85 462 764 86 427 798 88 424 798 89 450 785 90 423 800 91 444 773 92 468 774 95 467 776 97 440 789 98 469 779 99 436 788 100 469 780 101 433 788 104 426 785 105 429 788 107 426 788 108 424 786 111 423 788 112 419 788 116 391 779 117 419 780 118 416 786 119 421 782 [OBJ] 1 \"green mountain\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 799 786 21 783 767 29 799 786 37 783 767 39 800 786 108 784 768 109 798 786 111 801 786 118 784 768 [OBJ] 2 \"blue minivan\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 873 927 1 864 926 2 856 925 3 848 924 4 851 922 5 839 921 6 832 920 7 825 919 8 819 918 9 812 917 10 806 916 11 800 915 12 798 914 13 791 914 15 786 910 17 784 909 18 780 907 19 776 906 20 774 905 21 787 910 22 780 907 23 774 905 24 769 903 25 777 906 26 772 904 27 778 906 28 758 899 29 743 895 30 761 900 31 741 893 32 725 889 33 743 893 34 711 882 35 719 884 36 705 881 37 703 882 38 699 881 39 688 875 41 683 875 42 679 874 43 673 871 44 669 870 45 663 868 47 659 869 48 654 866 49 650 865 50 641 860 51 636 857 53 633 858 54 623 852 55 624 855 56 619 853 57 612 849 58 612 851 59 607 848 60 603 847 61 600 846 62 596 845 63 587 839 65 584 840 66 580 839 67 576 836 68 574 836 69 570 834 70 566 833 71 563 832 72 560 831 73 555 828 74 552 828 75 550 827 76 548 826 77 549 825 78 550 823 79 552 824 80 555 824 82 566 824 83 563 821 84 565 822 85 566 824 86 580 828 87 571 829 88 572 831 89 575 835 90 576 839 91 576 843 92 579 848 93 580 850 94 582 851 95 584 852 96 555 848 97 553 849 98 591 856 99 552 852 100 553 854 101 559 857 102 562 859 104 551 860 105 552 863 106 566 866 107 564 867 108 558 868 109 551 869 110 576 872 111 571 873 112 565 874 113 551 875 114 555 877 115 531 878 116 578 880 117 546 881 118 591 881 119 591 883 [OBJ] 3 \"cyan chopper\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 948 847 1 940 845 2 933 844 3 924 842 4 916 839 5 909 836 6 903 835 7 897 835 8 890 833 9 883 831 10 876 830 11 869 827 12 862 826 13 856 825 14 849 823 15 844 822 16 837 820 17 830 819 18 824 817 19 818 816 20 813 815 21 806 813 22 801 811 23 795 809 24 790 809 25 787 808 26 776 806 27 773 805 28 767 803 29 762 802 30 839 841 31 833 840 32 827 838 33 821 836 34 816 835 35 810 834 36 804 832 37 798 831 38 792 829 39 789 830 40 783 829 41 776 825 42 772 825 43 768 826 44 762 824 45 758 824 46 753 823 47 748 822 48 744 822 49 740 821 50 736 822 51 731 821 52 725 817 53 721 817 54 717 817 55 713 817 56 707 813 57 704 814 58 700 814 59 696 814 60 691 810 61 687 809 62 683 810 63 680 810 64 674 806 65 671 807 66 667 806 67 664 807 68 659 804 69 656 805 70 652 804 71 648 802 72 644 802 73 641 802 74 639 805 75 633 800 76 630 756 77 626 756 78 622 755 79 619 754 80 615 754 81 612 753 82 558 744 83 556 744 84 605 750 85 604 751 86 526 747 88 523 747 89 497 761 90 496 764 92 494 767 93 493 768 95 490 769 97 487 770 98 505 767 99 503 768 100 501 770 102 499 771 103 501 773 104 497 773 105 499 775 106 496 775 107 494 776 109 492 777 110 490 779 111 493 784 112 490 785 113 487 783 114 489 788 115 488 791 116 486 790 118 486 794 119 487 797 [OBJ] 4 \"blue jet\" 2 120 [VIS] 0 false 2 true 92 false [IN-FRAME] 0 false 2 true 92 false [PX] 0 null null 2 0 331 3 5 332 4 5 341 5 8 340 6 12 338 7 14 338 11 56 339 12 66 339 13 16 339 14 26 339 15 37 339 16 48 339 17 15 333 19 16 329 20 18 324 21 21 319 22 29 316 23 40 316 24 51 317 25 62 316 26 74 317 27 86 317 28 98 317 29 109 316 30 121 316 31 133 315 32 145 315 33 158 316 34 170 316 35 183 316 36 195 316 37 208 315 38 222 315 39 234 315 40 248 315 41 261 315 42 275 315 43 289 315 44 302 315 45 316 314 46 330 314 47 343 314 48 357 313 49 371 313 50 385 313 51 400 314 52 414 314 53 428 314 54 442 313 55 456 313 56 471 311 57 486 313 58 501 313 59 516 313 60 530 313 61 544 313 62 560 311 63 575 311 64 590 310 65 605 311 66 621 311 67 636 310 68 651 310 69 667 310 70 683 310 71 698 310 72 714 309 73 730 310 74 746 309 75 762 309 76 778 308 77 794 308 78 811 308 79 827 309 80 844 309 81 861 309 82 877 308 83 894 308 84 911 307 85 928 308 86 945 308 87 962 307 88 975 306 89 982 317 90 990 319 91 997 317 92 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 2 \"contact\" 0 57 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 9 \"contact\" 0 84 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 8 \"contact\" 0 119 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 12 \"contact\" 0 119 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"collision\" 59 59 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 4 \"collision\" 62 62 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 5 \"collision\" 64 64 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 6 \"collision\" 66 66 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 7 \"contact\" 67 119 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 0 \"collision\" 77 77 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"collision\" 83 83 [IN] 0 3 [OUT] 0 3 [INTERACT] 10 \"collision\" 86 86 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 11 \"contact\" 87 119 [IN] 2 65535 [OUT] 2 65535 [INTERACTIONS-END] [SCENE-END]"
}
],
"videos": [
"/mmfs1/gscratch/krishna/suryadv/strive_dynsuperclevr/data/lf/videos/val_full/super_clevr_1077/frames.mp4"
]
}Inference record: exact prompt + prediction + label + parse debug
{
"prompt": "user\n\nAnalyze the provided video and return ONLY a valid sentinel sequence in this format:\n[SCENE-START] [OBJS-START]\n[OBJ] id \"type\" birth death [VIS] t vis ... [IN-FRAME] t is_in_frame ... [PX] t px py ...\n[OBJ] ...\n[OBJS-END]\n[INTERACTIONS-START]\n[INTERACT] id \"type\" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ...\n[INTERACT] ...\n[INTERACTIONS-END] [SCENE-END]\n\nConstraints:\n- Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose).\n- Keep tags exactly as written:\n `[SCENE-START] [OBJS-START] [OBJ] [VIS] [IN-FRAME] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]`\n- Use quoted strings for `type` (double quotes).\n- `VIS` uses repeated groups of 2 values in order:\n `t vis`.\n `vis` is a boolean value.\n- `IN-FRAME` uses repeated groups of 2 values in order:\n `t is_in_frame`.\n `is_in_frame` is a boolean value.\n- `PX` uses repeated groups of 3 values in order: `t px py`.\n- `px` and `py` are normalized pixel coordinates in the range `[0, 1]`,\n scaled by `1000` and then converted to integers by dropping the decimal part.\n- For occluded or out-of-frame frames under this setting, `PX` may use `t null null`.\n- `IN` and `OUT` contain whitespace-separated integer ids.\n- Use lowercase booleans (`true`/`false`) for `vis` and `is_in_frame`.\nassistant\n",
"predict": "[SCENE-START] [OBJS-START] [OBJ] 0 \"white cardboard elderberry syrup box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 13 541 2 5 544 10 9 537 19 21 537 20 13 533 [OBJ] 1 \"white cardboard skincare collection box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 21 529 1 5 529 3 25 525 4 9 525 7 25 521 8 9 521 10 29 521 11 9 521 13 33 517 14 13 517 17 37 517 18 17 517 [OBJ] 2 \"white cardboard skincare collection box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 13 560 1 5 564 4 13 560 6 1 560 11 9 556 17 17 552 23 25 548 [OBJ] 3 \"green and white striped fabric dishtowel\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 13 583 12 21 580 23 33 580 [OBJ] 4 \"dark grey and light grey plastic monster action figure\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 111 541 2 123 541 3 111 544 10 123 544 12 134 544 13 119 544 15 130 544 16 119 548 22 130 548 [OBJ] 5 \"white cardboard dietary supplement box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 142 513 2 154 513 3 142 517 7 154 517 8 166 517 9 150 517 10 158 521 16 166 525 17 177 521 18 166 525 [OBJ] 6 \"black plastic gaming mouse\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 205 541 1 216 541 3 205 544 4 216 544 6 228 544 7 216 548 13 228 548 15 240 548 16 228 552 22 240 552 [OBJ] 7 \"brown and dark grey plastic dinosaur robot toy\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 337 619 4 345 626 8 353 634 12 361 642 17 369 650 21 376 654 23 384 666 24 388 677 25 392 697 26 400 712 27 404 724 28 408 732 29 412 740 30 416 748 31 423 755 32 427 763 33 435 775 34 443 787 35 451 794 36 458 802 37 466 810 38 470 818 40 482 826 42 494 833 44 505 837 46 513 841 48 521 845 50 529 849 52 537 853 54 544 857 56 552 861 58 560 865 60 568 869 62 576 873 64 583 876 66 591 880 69 603 884 71 611 888 74 619 892 77 626 896 80 634 900 83 642 904 86 650 908 89 658 912 92 666 916 95 673 919 98 681 923 101 689 927 104 697 931 107 705 935 110 712 939 113 720 943 116 728 947 119 736 951 [OBJ] 8 \"blue and white cardboard hair color box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 310 525 6 318 529 18 314 521 [OBJ] 9 \"blue and green snake print leather ballet flat\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 904 837 1 900 845 2 896 853 3 884 853 4 873 853 5 865 857 6 853 857 7 845 861 8 837 865 9 826 865 10 818 861 12 806 861 13 798 857 15 787 857 17 775 853 19 767 857 21 755 857 23 744 853 [OBJ] 10 \"blue wooden toy kitchen set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 962 845 1 978 853 2 974 861 3 974 873 4 970 880 5 966 888 6 966 861 7 958 869 8 951 873 9 939 873 10 931 876 11 923 880 12 912 880 13 904 884 14 892 884 15 884 888 16 873 888 17 861 888 18 853 892 19 845 896 20 833 896 22 818 896 23 810 900 [OBJ] 11 \"blue wooden toy kitchen set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 978 873 1 974 880 2 970 888 3 974 896 4 970 904 5 962 912 6 958 923 7 951 931 8 947 943 9 939 951 10 931 958 11 923 962 12 916 966 13 908 970 15 896 974 17 880 978 19 865 982 21 853 986 23 841 990 [OBJ] 12 \"blue wooden toy train\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 982 880 1 986 888 2 982 896 4 978 908 5 974 916 6 966 923 7 955 923 8 947 931 9 939 939 10 931 943 11 923 951 12 916 958 13 908 966 14 896 970 16 880 978 18 865 986 19 857 990 21 845 994 23 833 998 [OBJ] 13 \"blue wooden toy kitchen set\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 998 611 1 null null [OBJ] 14 \"blue and black plastic DVD set\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 998 990 1 null null [OBJ] 15 \"blue and black plastic DVD set\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 998 994 2 null null [OBJ] 16 \"blue and black plastic DVD set\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 998 998 2 null null [OBJ] 17 \"blue and black plastic screwdriver\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 998 998 1 null null [OBJ] 18 \"red and black plastic handheld gaming console\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 998 990 2 null null [OBJ] 19 \"blue and black plastic handheld gaming console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 998 994 1 null null [OBJ] 20 \"blue and black plastic screwdriver\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 998 998 2 null null [OBJ] 21 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 998 991 2 null null [OBJ] 22 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 998 994 2 null null [OBJ] 23 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 998 998 2 null null [OBJ] 24 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 998 990 2 null null [OBJ] 25 \"blue and black plastic handheld gaming console\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 998 994 2 null null [OBJ] 26 \"dark brown leather wingtip shoe with orange sole\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 998 998 2 null null [OBJ] 27 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 998 990 2 null null [OBJ] 28 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 998 994 2 null null [OBJ] 29 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 998 998 2 null null [OBJ] 30 \"red leather boot\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 998 990 2 null null [OBJ] 31 \"blue and black plastic screwdriver\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 998 994 2 null null [OBJ] 32 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 998 998 2 null null [OBJ] 33 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 994 994 2 null null [OBJ] 34 \"blue and red running shoe\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 990 994 2 null null [OBJ] 35 \"dark grey and light grey plastic monster action figure\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 990 998 2 null null [OBJ] 36 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 986 994 2 null null [OBJ] 37 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 982 998 2 null null [OBJ] 38 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 978 998 2 null null [OBJ] 39 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 970 998 2 null null [OBJ] 40 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 962 998 2 null null [OBJ] 41 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 955 998 2 null null [OBJ] 42 \"black plastic gaming mouse\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 943 998 2 null null [OBJ] 43 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 935 998 2 null null [OBJ] 44 \"black plastic gaming mouse\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 923 998 2 null null [OBJ] 45 \"dark brown leather boat shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 853 1 994 861 2 994 876 3 990 884 4 986 892 5 982 900 6 978 908 7 974 916 8 970 923 9 966 931 10 962 939 11 958 947 12 955 955 13 947 958 14 939 962 16 931 970 17 923 974 19 912 982 21 900 990 23 888 998 [OBJ] 46 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 998 994 1 null null [OBJ] 47 \"red plastic hair dryer\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 998 1 994 990 4 986 986 7 978 982 10 970 978 13 962 974 15 955 970 17 947 966 19 939 962 21 931 958 23 923 955 [OBJ] 48 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 998 998 1 null null [OBJ] 49 \"dark red and black plastic curling wand\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 919 2 994 931 3 994 912 5 990 923 6 986 939 7 986 916 9 982 923 11 978 931 12 978 912 14 974 919 16 970 927 17 966 916 19 962 923 20 958 912 22 955 919 23 951 908 [OBJ] 50 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 998 994 1 null null [OBJ] 51 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 998 998 1 null null [OBJ] 52 \"dark brown leather wingtip shoe with orange sole\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 994 998 1 null null [OBJ] 53 \"dark grey and light grey plastic monster action figure\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 990 998 1 null null [OBJ] 54 \"red plastic toy airplane\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 990 990 1 null null [OBJ] 55 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 986 994 1 null null [OBJ] 56 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 982 994 1 null null [OBJ] 57 \"blue gum variety pack\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 978 994 1 null null [OBJ] 58 \"blue wooden grandfather doll\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 970 994 1 null null [OBJ] 59 \"light grey canvas shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 962 994 1 null null [OBJ] 60 \"blue wooden grandfather doll\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 958 990 1 null null [OBJ] 61 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 951 994 1 null null [OBJ] 62 \"blue and white cardboard snack cake box\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 947 998 1 null null [OBJ] 63 \"blue and green cardboard candy bar box\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 939 998 1 null null [OBJ] 64 \"red and yellow running shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 931 998 1 null null [OBJ] 65 \"black plastic RCA cable\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 923 998 1 null null [OBJ] 66 \"dark brown leather boat shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 916 998 1 null null [OBJ] 67 \"dark red and black plastic curling wand\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 740 1 994 751 2 990 767 3 986 787 4 982 810 5 978 833 6 974 857 7 970 880 8 966 896 9 955 884 10 947 880 11 939 876 12 931 873 13 923 869 15 912 865 17 900 861 18 892 857 19 884 853 21 876 849 23 869 845 [OBJ] 68 \"dark brown leather wingtip shoe with orange sole\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 794 1 990 806 2 982 818 3 978 830 4 970 841 5 966 849 6 962 857 7 958 865 8 955 873 9 947 876 10 939 880 12 927 884 13 919 888 15 908 892 16 900 896 18 888 900 20 876 904 22 865 908 23 857 912 [OBJ] 69 \"blue wooden toy train\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 837 1 990 845 2 986 853 3 982 861 4 978 869 5 974 876 6 970 884 7 966 892 8 958 896 9 951 900 10 943 904 12 931 908 13 923 912 15 912 916 16 904 919 18 892 923 19 884 927 21 873 931 23 861 935 [OBJ] 70 \"blue wooden toy train\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 978 1 994 990 2 990 982 3 986 990 4 982 994 5 974 990 7 962 994 9 947 994 10 935 994 11 923 994 13 908 994 15 892 994 17 876 994 19 861 994 21 845 994 23 833 994 [OBJ] 71 \"blue and white cardboard hair color box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 904 2 994 912 3 990 919 4 990 908 5 986 916 6 986 904 7 982 912 10 974 916 13 966 919 16 958 923 19 947 923 21 935 923 23 923 923 [OBJ] 72 \"blue wooden toy train\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 935 2 994 943 4 990 951 6 986 958 8 978 962 10 970 966 12 962 970 14 955 974 16 947 978 18 939 982 20 927 982 22 916 982 24 904 982 [OBJ] 73 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 998 998 2 null null [OBJ] 74 \"dark grey and light grey plastic monster action figure\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 994 990 2 null null [OBJ] 75 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 990 994 2 null null [OBJ] 76 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 986 994 2 null null [OBJ] 77 \"dark brown leather wingtip shoe with orange sole\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 982 994 2 null null [OBJ] 78 \"blue wooden toy train\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 974 994 2 null null [OBJ] 79 \"black and blue plastic screwdriver\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 966 994 1 null null [OBJ] 80 \"black plastic RCA cable\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 958 998 1 null null [OBJ] 81 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 951 998 1 null null [OBJ] 82 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 943 998 1 null null [OBJ] 83 \"dark red and black plastic curling wand\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 333 607 1 337 615 5 345 623 7 349 630 9 353 638 11 357 646 14 361 654 16 365 662 18 369 669 20 373 677 22 376 685 23 380 693 [OBJ] 84 \"blue wooden toy train\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 998 919 1 null null [OBJ] 85 \"light brown wooden knife block set\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 998 990 1 null null [OBJ] 86 \"white and blue cardboard ink cartridge box\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 998 994 1 null null [OBJ] 87 \"blue and white cardboard snack cake box\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 994 990 1 null null [OBJ] 88 \"dark blue fabric high-top sneaker\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 994 994 1 null null [OBJ] 89 \"dark red and black plastic curling wand\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 337 607 2 341 615 5 349 623 7 353 630 10 357 638 12 361 646 15 365 654 17 369 662 19 373 669 21 376 677 23 380 685 [OBJ] 90 \"blue wooden toy train\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 990 998 1 null null [OBJ] 91 \"red plastic toy airplane\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 986 998 1 null null [OBJ] 92 \"blue wooden toy train\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 982 998 1 null null [OBJ] 93 \"black and grey athletic shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 978 998 1 null null [OBJ] 94 \"dark blue leather boat shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 974 998 1 null null [OBJ] 95 \"dark blue leather boat shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 966 998 1 null null [OBJ] 96 \"black and blue plastic screwdriver\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 958 998 1 null null [OBJ] 97 \"black and blue plastic screwdriver\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 951 994 1 null null [OBJ] 98 \"dark brown leather wingtip shoe with orange sole\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 943 998 1 null null [OBJ] 99 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 935 998 1 null null [OBJ] 100 \"white and yellow plastic supplement bottle\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 923 998 1 null null [OBJ] 101 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 912 998 1 null null [OBJ] 102 \"light grey fabric boat shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 904 994 1 null null [OBJ] 103 \"dark brown leather wingtip shoe with orange sole\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 892 998 1 null null [OBJ] 104 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 880 994 1 null null [OBJ] 105 \"blue wooden toy train\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 869 994 1 null null [OBJ] 106 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 857 994 1 null null [OBJ] 107 \"dark brown leather boat shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 849 994 1 null null [OBJ] 108 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 837 994 1 null null [OBJ] 109 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 826 994 1 null null [OBJ] 110 \"dark brown leather boat shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 814 994 1 null null [OBJ] 111 \"red plastic hair dryer\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 802 994 1 null null [OBJ] 112 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 791 994 1 null null [OBJ] 113 \"blue wooden toy train\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 783 994 1 null null [OBJ] 114 \"white and black athletic shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 775 994 1 null null [OBJ] 115 \"dark grey leather boot\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 763 994 1 null null [OBJ] 116 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 751 994 1 null null [OBJ] 117 \"white and blue track spike\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 740 994 1 null null [OBJ] 118 \"white cardboard ink cartridge box\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 732 994 1 null null [OBJ] 119 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 720 994 1 null null [OBJ] 120 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 708 994 1 null null [OBJ] 121 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 697 994 1 null null [OBJ] 122 \"white and green cardboard ink cartridge box\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 685 994 1 null null [OBJ] 123 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 673 994 1 null null [OBJ] 124 \"white and blue cardboard ink cartridge box\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 662 994 1 null null [OBJ] 125 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 650 994 1 null null [OBJ] 126 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 638 994 1 null null [OBJ] 127 \"white and blue athletic shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 623 994 1 null null [OBJ] 128 \"white and blue cardboard ink cartridge box\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 611 994 1 null null [OBJ] 129 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 599 994 1 null null [OBJ] 130 \"dark brown leather boat shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 587 994 1 null null [OBJ] 131 \"dark brown leather wingtip shoe with orange sole\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 580 990 1 null null [OBJ] 132 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 568 994 1 null null [OBJ] 133 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 556 994 1 null null [OBJ] 134 \"dark brown leather wingtip shoe with orange sole\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 544 994 1 null null [OBJ] 135 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 533 994 1 null null [OBJ] 136 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 525 994 1 null null [OBJ] 137 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 513 994 1 null null [OBJ] 138 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 505 994 1 null null [OBJ] 139 \"blue and black hiking shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 498 994 1 null null [OBJ] 140 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 486 994 1 null null [OBJ] 141 \"dark grey and pink running shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 474 994 1 null null [OBJ] 142 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 466 994 1 null null [OBJ] 143 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 455 994 1 null null [OBJ] 144 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 447 994 1 null null [OBJ] 145 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 435 994 1 null null [OBJ] 146 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 423 994 1 null null [OBJ] 147 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 416 994 1 null null [OBJ] 148 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 408 994 1 null null [OBJ] 149 \"dark grey and pink running shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 400 990 1 null null [OBJ] 150 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 396 990 1 null null [OBJ] 151 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 388 990 1 null null [OBJ] 152 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 376 990 1 null null [OBJ] 153 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 369 990 1 null null [OBJ] 154 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 361 986 1 null null [OBJ] 155 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 349 990 1 null null [OBJ] 156 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 337 990 1 null null [OBJ] 157 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 326 990 1 null null [OBJ] 158 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 314 990 1 null null [OBJ] 159 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 302 990 1 null null [OBJ] 160 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 294 990 1 null null [OBJ] 161 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 283 990 1 null null [OBJ] 162 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 271 990 1 null null [OBJ] 163 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 259 990 1 null null [OBJ] 164 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 248 990 1 null null [OBJ] 165 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 236 990 1 null null [OBJ] 166 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 224 990 1 null null [OBJ] 167 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 212 990 1 null null [OBJ] 168 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 201 990 1 null null [OBJ] 169 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 189 990 1 null null [OBJ] 170 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 177 990 1 null null [OBJ] 171 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 166 990 1 null null [OBJ] 172 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 154 990 1 null null [OBJ] 173 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 142 990 1 null null [OBJ] 174 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 130 990 1 null null [OBJ] 175 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 119 990 1 null null [OBJ] 176 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 107 990 1 null null [OBJ] 177 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 95 990 1 null null [OBJ] 178 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 83 990 1 null null [OBJ] 179 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 68 990 1 null null [OBJ] 180 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 56 990 1 null null [OBJ] 181 \"dark red and black plastic curling wand\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 5 994 11 1 990 19 1 978 [OBJ] 182 \"blue and black plastic screwdriver\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 1 998 14 1 986 20 1 974 23 1 962 [OBJ] 183 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 1 931 4 1 912 7 1 896 10 1 884 13 1 873 16 1 861 19 1 849 22 1 837 [OBJ] 184 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 1 904 4 1 888 8 1 876 12 1 865 16 1 853 20 1 841 23 1 830 [OBJ] 185 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 1 861 3 1 849 6 1 837 9 1 826 12 1 814 15 1 802 18 1 791 21 1 779 23 1 767 [OBJ] 186 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 1 830 4 1 818 8 1 806 12 1 794 15 1 783 19 1 771 22 1 759 [OBJ] 187 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 1 787 3 1 775 6 1 763 9 1 751 12 1 740 15 1 728 18 1 716 21 1 705 23 1 693 [OBJ] 188 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 1 740 3 1 724 6 1 712 9 1 701 12 1 689 15 1 677 18 1 666 21 1 654 23 1 642 [OBJ] 189 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 1 685 3 1 669 6 1 658 9 1 646 12 1 634 15 1 623 18 1 611 21 1 599 23 1 587 [OBJ] 190 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 1 630 3 1 615 6 1 603 9 1 591 12 1 580 15 1 568 18 1 556 21 1 544 23 1 533 [OBJ] 191 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 1 591 4 1 576 8 1 564 11 1 552 15 1 541 19 1 529 22 1 517 [OBJ] 192 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 1 560 5 1 544 9 1 533 13 1 521 17 1 509 20 1 498 23 1 486 [OBJ] 193 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 1 529 4 1 513 8 1 501 12 1 490 16 1 478 19 1 466 22 1 455 [OBJ] 194 \"red and black plastic handheld game console\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 1 498 5 1 482 9 1 470 13 1 458 17 1 447 21 1 435 24 1 423 27 1 412 31 1 400 34 1 388 38 1 376 41 1 365 44 1 353 48 1 341 52 1 330 56 1 318 60 1 306 64 1 294 68 1 283 72 1 271 76 1 259 80 1 248 83 1 236 87 1 224 91 1 212 95 1 201 99 1 189 103 1 177 107 1 166 111 1 154 115 1 142 119 1 130 \n \n[OBJS-END] [INTERACTIONS-START] [INTERACT] 1 \"contact\" 0 1 [IN] 1 5 [OUT] 1 5 [INTERACT] 11 \"contact\" 0 3 [IN] 109 115 [OUT] 109 115 [INTERACT] 23 \"contact\" 0 5 [IN] 14 89 [OUT] 14 89 [INTERACT] 36 \"contact\" 0 12 [IN] 24 65535 [OUT] 24 65535 [INTERACT] 0 \"contact\" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 4 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 75 \"contact\" 0 23 [IN] 51 65535 [OUT] 51 65535 [INTERACT] 76 \"contact\" 0 23 [IN] 52 65535 [OUT] 52 65535 [INTERACT] 77 \"contact\" 0 23 [IN] 53 65535 [OUT] 53 65535 [INTERACT] 78 \"contact\" 0 23 [IN] 54 65535 [OUT] 54 65535 [INTERACT] 79 \"contact\" 0 23 [IN] 55 65535 [OUT] 55 65535 [INTERACT] 80 \"contact\" 0 23 [IN] 56 65535 [OUT] 56 65535 [INTERACT] 81 \"contact\" 0 23 [IN] 57 65535 [OUT] 57 65535 [INTERACT] 82 \"contact\" 0 23 [IN] 58 65535 [OUT] 58 65535 [INTERACT] 83 \"contact\" 0 23 [IN] 59 65535 [OUT] 59 65535 [INTERACT] 84 \"contact\" 0 23 [IN] 60 65535 [OUT] 60 65535 [INTERACT] 85 \"contact\" 0 23 [IN] 61 65535 [OUT] 61 65535 [INTERACT] 86 \"contact\" 0 23 [IN] 62 65535 [OUT] 62 65535 [INTERACT] 87 \"contact\" 0 23 [IN] 63 65535 [OUT] 63 65535 [INTERACT] 88 \"contact\" 0 23 [IN] 64 65535 [OUT] 64 65535 [INTERACT] 89 \"contact\" 0 23 [IN] 65 65535 [OUT] 65 65535 [INTERACT] 90 \"contact\" 0 23 [IN] 66 65535 [OUT] 66 65535 [INTERACT] 91 \"contact\" 0 23 [IN] 67 65535 [OUT] 67 65535 [INTERACT] 92 \"contact\" 0 23 [IN] 68 65535 [OUT] 68 655",
"label": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown tandem\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 336 642 3 337 644 5 342 641 6 341 646 7 333 613 8 344 641 10 333 624 12 335 626 13 348 648 14 347 657 16 348 658 17 341 623 18 340 632 19 351 659 20 350 663 21 344 629 23 347 629 24 354 668 25 346 636 26 347 640 27 349 636 28 349 642 30 352 641 31 354 642 32 353 647 33 355 649 34 356 648 35 368 688 36 369 691 37 359 655 38 361 656 39 365 654 40 363 659 41 366 661 42 367 664 43 377 674 44 380 677 45 372 669 46 389 695 47 391 696 48 386 717 49 395 702 50 388 721 51 391 722 52 387 692 53 405 716 54 395 732 55 394 703 56 396 707 58 399 713 59 412 719 60 415 724 61 400 745 62 408 731 63 422 732 64 412 730 65 426 736 66 429 739 67 419 736 68 433 744 69 424 742 70 441 765 71 441 753 72 431 751 73 449 774 74 429 784 75 439 765 76 441 764 77 433 760 78 446 767 79 448 767 80 451 763 81 453 763 82 455 768 83 458 764 84 459 767 85 462 764 86 427 798 88 424 798 89 450 785 90 423 800 91 444 773 92 468 774 95 467 776 97 440 789 98 469 779 99 436 788 100 469 780 101 433 788 104 426 785 105 429 788 107 426 788 108 424 786 111 423 788 112 419 788 116 391 779 117 419 780 118 416 786 119 421 782 [OBJ] 1 \"green mountain\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 799 786 21 783 767 29 799 786 37 783 767 39 800 786 108 784 768 109 798 786 111 801 786 118 784 768 [OBJ] 2 \"blue minivan\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 873 927 1 864 926 2 856 925 3 848 924 4 851 922 5 839 921 6 832 920 7 825 919 8 819 918 9 812 917 10 806 916 11 800 915 12 798 914 13 791 914 15 786 910 17 784 909 18 780 907 19 776 906 20 774 905 21 787 910 22 780 907 23 774 905 24 769 903 25 777 906 26 772 904 27 778 906 28 758 899 29 743 895 30 761 900 31 741 893 32 725 889 33 743 893 34 711 882 35 719 884 36 705 881 37 703 882 38 699 881 39 688 875 41 683 875 42 679 874 43 673 871 44 669 870 45 663 868 47 659 869 48 654 866 49 650 865 50 641 860 51 636 857 53 633 858 54 623 852 55 624 855 56 619 853 57 612 849 58 612 851 59 607 848 60 603 847 61 600 846 62 596 845 63 587 839 65 584 840 66 580 839 67 576 836 68 574 836 69 570 834 70 566 833 71 563 832 72 560 831 73 555 828 74 552 828 75 550 827 76 548 826 77 549 825 78 550 823 79 552 824 80 555 824 82 566 824 83 563 821 84 565 822 85 566 824 86 580 828 87 571 829 88 572 831 89 575 835 90 576 839 91 576 843 92 579 848 93 580 850 94 582 851 95 584 852 96 555 848 97 553 849 98 591 856 99 552 852 100 553 854 101 559 857 102 562 859 104 551 860 105 552 863 106 566 866 107 564 867 108 558 868 109 551 869 110 576 872 111 571 873 112 565 874 113 551 875 114 555 877 115 531 878 116 578 880 117 546 881 118 591 881 119 591 883 [OBJ] 3 \"cyan chopper\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 948 847 1 940 845 2 933 844 3 924 842 4 916 839 5 909 836 6 903 835 7 897 835 8 890 833 9 883 831 10 876 830 11 869 827 12 862 826 13 856 825 14 849 823 15 844 822 16 837 820 17 830 819 18 824 817 19 818 816 20 813 815 21 806 813 22 801 811 23 795 809 24 790 809 25 787 808 26 776 806 27 773 805 28 767 803 29 762 802 30 839 841 31 833 840 32 827 838 33 821 836 34 816 835 35 810 834 36 804 832 37 798 831 38 792 829 39 789 830 40 783 829 41 776 825 42 772 825 43 768 826 44 762 824 45 758 824 46 753 823 47 748 822 48 744 822 49 740 821 50 736 822 51 731 821 52 725 817 53 721 817 54 717 817 55 713 817 56 707 813 57 704 814 58 700 814 59 696 814 60 691 810 61 687 809 62 683 810 63 680 810 64 674 806 65 671 807 66 667 806 67 664 807 68 659 804 69 656 805 70 652 804 71 648 802 72 644 802 73 641 802 74 639 805 75 633 800 76 630 756 77 626 756 78 622 755 79 619 754 80 615 754 81 612 753 82 558 744 83 556 744 84 605 750 85 604 751 86 526 747 88 523 747 89 497 761 90 496 764 92 494 767 93 493 768 95 490 769 97 487 770 98 505 767 99 503 768 100 501 770 102 499 771 103 501 773 104 497 773 105 499 775 106 496 775 107 494 776 109 492 777 110 490 779 111 493 784 112 490 785 113 487 783 114 489 788 115 488 791 116 486 790 118 486 794 119 487 797 [OBJ] 4 \"blue jet\" 2 120 [VIS] 0 false 2 true 92 false [IN-FRAME] 0 false 2 true 92 false [PX] 0 null null 2 0 331 3 5 332 4 5 341 5 8 340 6 12 338 7 14 338 11 56 339 12 66 339 13 16 339 14 26 339 15 37 339 16 48 339 17 15 333 19 16 329 20 18 324 21 21 319 22 29 316 23 40 316 24 51 317 25 62 316 26 74 317 27 86 317 28 98 317 29 109 316 30 121 316 31 133 315 32 145 315 33 158 316 34 170 316 35 183 316 36 195 316 37 208 315 38 222 315 39 234 315 40 248 315 41 261 315 42 275 315 43 289 315 44 302 315 45 316 314 46 330 314 47 343 314 48 357 313 49 371 313 50 385 313 51 400 314 52 414 314 53 428 314 54 442 313 55 456 313 56 471 311 57 486 313 58 501 313 59 516 313 60 530 313 61 544 313 62 560 311 63 575 311 64 590 310 65 605 311 66 621 311 67 636 310 68 651 310 69 667 310 70 683 310 71 698 310 72 714 309 73 730 310 74 746 309 75 762 309 76 778 308 77 794 308 78 811 308 79 827 309 80 844 309 81 861 309 82 877 308 83 894 308 84 911 307 85 928 308 86 945 308 87 962 307 88 975 306 89 982 317 90 990 319 91 997 317 92 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 2 \"contact\" 0 57 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 9 \"contact\" 0 84 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 8 \"contact\" 0 119 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 12 \"contact\" 0 119 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"collision\" 59 59 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 4 \"collision\" 62 62 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 5 \"collision\" 64 64 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 6 \"collision\" 66 66 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 7 \"contact\" 67 119 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 0 \"collision\" 77 77 [IN] 0 2 [OUT] 0 2 [INTERACT] 1 \"collision\" 83 83 [IN] 0 3 [OUT] 0 3 [INTERACT] 10 \"collision\" 86 86 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 11 \"contact\" 87 119 [IN] 2 65535 [OUT] 2 65535 [INTERACTIONS-END] [SCENE-END]\n",
"parse_debug": {
"pred_parse_valid": false,
"pred_parse_error": "Could not find [SCENE-END] after [SCENE-START].",
"pred_parse_error_type": "ValueError",
"guided_grammar_sha256": "dac80e533cdc467e6ed7e750f131c895bdb25be06b660e6ed92a7366e99f178e",
"guided_grammar_path": "strive_datasets/prep/kubric/scene_repr/profiles/grammars/selector_sentinel_no_3d.lark",
"debug_dir": "/gscratch/krishna/suryadv/strive_dynsuperclevr/runtime/36996080_inference_full/debug/val_full_shard_003/parse_failures/sample_000002",
"guided_grammar_debug_path": "/gscratch/krishna/suryadv/strive_dynsuperclevr/runtime/36996080_inference_full/debug/val_full_shard_003/parse_failures/sample_000002/grammar.ebnf.gz"
}
}Parsed prediction
{
"error": "ValueError: Could not find [SCENE-END] after [SCENE-START]."
}Parsed ground truth
{
"objects": [
{
"id": 0,
"type": "brown tandem",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 336,
"y": 642
},
{
"t": 3,
"x": 337,
"y": 644
},
{
"t": 5,
"x": 342,
"y": 641
},
{
"t": 6,
"x": 341,
"y": 646
},
{
"t": 7,
"x": 333,
"y": 613
},
{
"t": 8,
"x": 344,
"y": 641
},
{
"t": 10,
"x": 333,
"y": 624
},
{
"t": 12,
"x": 335,
"y": 626
},
{
"t": 13,
"x": 348,
"y": 648
},
{
"t": 14,
"x": 347,
"y": 657
},
{
"t": 16,
"x": 348,
"y": 658
},
{
"t": 17,
"x": 341,
"y": 623
},
{
"t": 18,
"x": 340,
"y": 632
},
{
"t": 19,
"x": 351,
"y": 659
},
{
"t": 20,
"x": 350,
"y": 663
},
{
"t": 21,
"x": 344,
"y": 629
},
{
"t": 23,
"x": 347,
"y": 629
},
{
"t": 24,
"x": 354,
"y": 668
},
{
"t": 25,
"x": 346,
"y": 636
},
{
"t": 26,
"x": 347,
"y": 640
},
{
"t": 27,
"x": 349,
"y": 636
},
{
"t": 28,
"x": 349,
"y": 642
},
{
"t": 30,
"x": 352,
"y": 641
},
{
"t": 31,
"x": 354,
"y": 642
},
{
"t": 32,
"x": 353,
"y": 647
},
{
"t": 33,
"x": 355,
"y": 649
},
{
"t": 34,
"x": 356,
"y": 648
},
{
"t": 35,
"x": 368,
"y": 688
},
{
"t": 36,
"x": 369,
"y": 691
},
{
"t": 37,
"x": 359,
"y": 655
},
{
"t": 38,
"x": 361,
"y": 656
},
{
"t": 39,
"x": 365,
"y": 654
},
{
"t": 40,
"x": 363,
"y": 659
},
{
"t": 41,
"x": 366,
"y": 661
},
{
"t": 42,
"x": 367,
"y": 664
},
{
"t": 43,
"x": 377,
"y": 674
},
{
"t": 44,
"x": 380,
"y": 677
},
{
"t": 45,
"x": 372,
"y": 669
},
{
"t": 46,
"x": 389,
"y": 695
},
{
"t": 47,
"x": 391,
"y": 696
},
{
"t": 48,
"x": 386,
"y": 717
},
{
"t": 49,
"x": 395,
"y": 702
},
{
"t": 50,
"x": 388,
"y": 721
},
{
"t": 51,
"x": 391,
"y": 722
},
{
"t": 52,
"x": 387,
"y": 692
},
{
"t": 53,
"x": 405,
"y": 716
},
{
"t": 54,
"x": 395,
"y": 732
},
{
"t": 55,
"x": 394,
"y": 703
},
{
"t": 56,
"x": 396,
"y": 707
},
{
"t": 58,
"x": 399,
"y": 713
},
{
"t": 59,
"x": 412,
"y": 719
},
{
"t": 60,
"x": 415,
"y": 724
},
{
"t": 61,
"x": 400,
"y": 745
},
{
"t": 62,
"x": 408,
"y": 731
},
{
"t": 63,
"x": 422,
"y": 732
},
{
"t": 64,
"x": 412,
"y": 730
},
{
"t": 65,
"x": 426,
"y": 736
},
{
"t": 66,
"x": 429,
"y": 739
},
{
"t": 67,
"x": 419,
"y": 736
},
{
"t": 68,
"x": 433,
"y": 744
},
{
"t": 69,
"x": 424,
"y": 742
},
{
"t": 70,
"x": 441,
"y": 765
},
{
"t": 71,
"x": 441,
"y": 753
},
{
"t": 72,
"x": 431,
"y": 751
},
{
"t": 73,
"x": 449,
"y": 774
},
{
"t": 74,
"x": 429,
"y": 784
},
{
"t": 75,
"x": 439,
"y": 765
},
{
"t": 76,
"x": 441,
"y": 764
},
{
"t": 77,
"x": 433,
"y": 760
},
{
"t": 78,
"x": 446,
"y": 767
},
{
"t": 79,
"x": 448,
"y": 767
},
{
"t": 80,
"x": 451,
"y": 763
},
{
"t": 81,
"x": 453,
"y": 763
},
{
"t": 82,
"x": 455,
"y": 768
},
{
"t": 83,
"x": 458,
"y": 764
},
{
"t": 84,
"x": 459,
"y": 767
},
{
"t": 85,
"x": 462,
"y": 764
},
{
"t": 86,
"x": 427,
"y": 798
},
{
"t": 88,
"x": 424,
"y": 798
},
{
"t": 89,
"x": 450,
"y": 785
},
{
"t": 90,
"x": 423,
"y": 800
},
{
"t": 91,
"x": 444,
"y": 773
},
{
"t": 92,
"x": 468,
"y": 774
},
{
"t": 95,
"x": 467,
"y": 776
},
{
"t": 97,
"x": 440,
"y": 789
},
{
"t": 98,
"x": 469,
"y": 779
},
{
"t": 99,
"x": 436,
"y": 788
},
{
"t": 100,
"x": 469,
"y": 780
},
{
"t": 101,
"x": 433,
"y": 788
},
{
"t": 104,
"x": 426,
"y": 785
},
{
"t": 105,
"x": 429,
"y": 788
},
{
"t": 107,
"x": 426,
"y": 788
},
{
"t": 108,
"x": 424,
"y": 786
},
{
"t": 111,
"x": 423,
"y": 788
},
{
"t": 112,
"x": 419,
"y": 788
},
{
"t": 116,
"x": 391,
"y": 779
},
{
"t": 117,
"x": 419,
"y": 780
},
{
"t": 118,
"x": 416,
"y": 786
},
{
"t": 119,
"x": 421,
"y": 782
}
],
"birth": 0,
"death": 120
},
{
"id": 1,
"type": "green mountain",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 799,
"y": 786
},
{
"t": 21,
"x": 783,
"y": 767
},
{
"t": 29,
"x": 799,
"y": 786
},
{
"t": 37,
"x": 783,
"y": 767
},
{
"t": 39,
"x": 800,
"y": 786
},
{
"t": 108,
"x": 784,
"y": 768
},
{
"t": 109,
"x": 798,
"y": 786
},
{
"t": 111,
"x": 801,
"y": 786
},
{
"t": 118,
"x": 784,
"y": 768
}
],
"birth": 0,
"death": 120
},
{
"id": 2,
"type": "blue minivan",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 873,
"y": 927
},
{
"t": 1,
"x": 864,
"y": 926
},
{
"t": 2,
"x": 856,
"y": 925
},
{
"t": 3,
"x": 848,
"y": 924
},
{
"t": 4,
"x": 851,
"y": 922
},
{
"t": 5,
"x": 839,
"y": 921
},
{
"t": 6,
"x": 832,
"y": 920
},
{
"t": 7,
"x": 825,
"y": 919
},
{
"t": 8,
"x": 819,
"y": 918
},
{
"t": 9,
"x": 812,
"y": 917
},
{
"t": 10,
"x": 806,
"y": 916
},
{
"t": 11,
"x": 800,
"y": 915
},
{
"t": 12,
"x": 798,
"y": 914
},
{
"t": 13,
"x": 791,
"y": 914
},
{
"t": 15,
"x": 786,
"y": 910
},
{
"t": 17,
"x": 784,
"y": 909
},
{
"t": 18,
"x": 780,
"y": 907
},
{
"t": 19,
"x": 776,
"y": 906
},
{
"t": 20,
"x": 774,
"y": 905
},
{
"t": 21,
"x": 787,
"y": 910
},
{
"t": 22,
"x": 780,
"y": 907
},
{
"t": 23,
"x": 774,
"y": 905
},
{
"t": 24,
"x": 769,
"y": 903
},
{
"t": 25,
"x": 777,
"y": 906
},
{
"t": 26,
"x": 772,
"y": 904
},
{
"t": 27,
"x": 778,
"y": 906
},
{
"t": 28,
"x": 758,
"y": 899
},
{
"t": 29,
"x": 743,
"y": 895
},
{
"t": 30,
"x": 761,
"y": 900
},
{
"t": 31,
"x": 741,
"y": 893
},
{
"t": 32,
"x": 725,
"y": 889
},
{
"t": 33,
"x": 743,
"y": 893
},
{
"t": 34,
"x": 711,
"y": 882
},
{
"t": 35,
"x": 719,
"y": 884
},
{
"t": 36,
"x": 705,
"y": 881
},
{
"t": 37,
"x": 703,
"y": 882
},
{
"t": 38,
"x": 699,
"y": 881
},
{
"t": 39,
"x": 688,
"y": 875
},
{
"t": 41,
"x": 683,
"y": 875
},
{
"t": 42,
"x": 679,
"y": 874
},
{
"t": 43,
"x": 673,
"y": 871
},
{
"t": 44,
"x": 669,
"y": 870
},
{
"t": 45,
"x": 663,
"y": 868
},
{
"t": 47,
"x": 659,
"y": 869
},
{
"t": 48,
"x": 654,
"y": 866
},
{
"t": 49,
"x": 650,
"y": 865
},
{
"t": 50,
"x": 641,
"y": 860
},
{
"t": 51,
"x": 636,
"y": 857
},
{
"t": 53,
"x": 633,
"y": 858
},
{
"t": 54,
"x": 623,
"y": 852
},
{
"t": 55,
"x": 624,
"y": 855
},
{
"t": 56,
"x": 619,
"y": 853
},
{
"t": 57,
"x": 612,
"y": 849
},
{
"t": 58,
"x": 612,
"y": 851
},
{
"t": 59,
"x": 607,
"y": 848
},
{
"t": 60,
"x": 603,
"y": 847
},
{
"t": 61,
"x": 600,
"y": 846
},
{
"t": 62,
"x": 596,
"y": 845
},
{
"t": 63,
"x": 587,
"y": 839
},
{
"t": 65,
"x": 584,
"y": 840
},
{
"t": 66,
"x": 580,
"y": 839
},
{
"t": 67,
"x": 576,
"y": 836
},
{
"t": 68,
"x": 574,
"y": 836
},
{
"t": 69,
"x": 570,
"y": 834
},
{
"t": 70,
"x": 566,
"y": 833
},
{
"t": 71,
"x": 563,
"y": 832
},
{
"t": 72,
"x": 560,
"y": 831
},
{
"t": 73,
"x": 555,
"y": 828
},
{
"t": 74,
"x": 552,
"y": 828
},
{
"t": 75,
"x": 550,
"y": 827
},
{
"t": 76,
"x": 548,
"y": 826
},
{
"t": 77,
"x": 549,
"y": 825
},
{
"t": 78,
"x": 550,
"y": 823
},
{
"t": 79,
"x": 552,
"y": 824
},
{
"t": 80,
"x": 555,
"y": 824
},
{
"t": 82,
"x": 566,
"y": 824
},
{
"t": 83,
"x": 563,
"y": 821
},
{
"t": 84,
"x": 565,
"y": 822
},
{
"t": 85,
"x": 566,
"y": 824
},
{
"t": 86,
"x": 580,
"y": 828
},
{
"t": 87,
"x": 571,
"y": 829
},
{
"t": 88,
"x": 572,
"y": 831
},
{
"t": 89,
"x": 575,
"y": 835
},
{
"t": 90,
"x": 576,
"y": 839
},
{
"t": 91,
"x": 576,
"y": 843
},
{
"t": 92,
"x": 579,
"y": 848
},
{
"t": 93,
"x": 580,
"y": 850
},
{
"t": 94,
"x": 582,
"y": 851
},
{
"t": 95,
"x": 584,
"y": 852
},
{
"t": 96,
"x": 555,
"y": 848
},
{
"t": 97,
"x": 553,
"y": 849
},
{
"t": 98,
"x": 591,
"y": 856
},
{
"t": 99,
"x": 552,
"y": 852
},
{
"t": 100,
"x": 553,
"y": 854
},
{
"t": 101,
"x": 559,
"y": 857
},
{
"t": 102,
"x": 562,
"y": 859
},
{
"t": 104,
"x": 551,
"y": 860
},
{
"t": 105,
"x": 552,
"y": 863
},
{
"t": 106,
"x": 566,
"y": 866
},
{
"t": 107,
"x": 564,
"y": 867
},
{
"t": 108,
"x": 558,
"y": 868
},
{
"t": 109,
"x": 551,
"y": 869
},
{
"t": 110,
"x": 576,
"y": 872
},
{
"t": 111,
"x": 571,
"y": 873
},
{
"t": 112,
"x": 565,
"y": 874
},
{
"t": 113,
"x": 551,
"y": 875
},
{
"t": 114,
"x": 555,
"y": 877
},
{
"t": 115,
"x": 531,
"y": 878
},
{
"t": 116,
"x": 578,
"y": 880
},
{
"t": 117,
"x": 546,
"y": 881
},
{
"t": 118,
"x": 591,
"y": 881
},
{
"t": 119,
"x": 591,
"y": 883
}
],
"birth": 0,
"death": 120
},
{
"id": 3,
"type": "cyan chopper",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 948,
"y": 847
},
{
"t": 1,
"x": 940,
"y": 845
},
{
"t": 2,
"x": 933,
"y": 844
},
{
"t": 3,
"x": 924,
"y": 842
},
{
"t": 4,
"x": 916,
"y": 839
},
{
"t": 5,
"x": 909,
"y": 836
},
{
"t": 6,
"x": 903,
"y": 835
},
{
"t": 7,
"x": 897,
"y": 835
},
{
"t": 8,
"x": 890,
"y": 833
},
{
"t": 9,
"x": 883,
"y": 831
},
{
"t": 10,
"x": 876,
"y": 830
},
{
"t": 11,
"x": 869,
"y": 827
},
{
"t": 12,
"x": 862,
"y": 826
},
{
"t": 13,
"x": 856,
"y": 825
},
{
"t": 14,
"x": 849,
"y": 823
},
{
"t": 15,
"x": 844,
"y": 822
},
{
"t": 16,
"x": 837,
"y": 820
},
{
"t": 17,
"x": 830,
"y": 819
},
{
"t": 18,
"x": 824,
"y": 817
},
{
"t": 19,
"x": 818,
"y": 816
},
{
"t": 20,
"x": 813,
"y": 815
},
{
"t": 21,
"x": 806,
"y": 813
},
{
"t": 22,
"x": 801,
"y": 811
},
{
"t": 23,
"x": 795,
"y": 809
},
{
"t": 24,
"x": 790,
"y": 809
},
{
"t": 25,
"x": 787,
"y": 808
},
{
"t": 26,
"x": 776,
"y": 806
},
{
"t": 27,
"x": 773,
"y": 805
},
{
"t": 28,
"x": 767,
"y": 803
},
{
"t": 29,
"x": 762,
"y": 802
},
{
"t": 30,
"x": 839,
"y": 841
},
{
"t": 31,
"x": 833,
"y": 840
},
{
"t": 32,
"x": 827,
"y": 838
},
{
"t": 33,
"x": 821,
"y": 836
},
{
"t": 34,
"x": 816,
"y": 835
},
{
"t": 35,
"x": 810,
"y": 834
},
{
"t": 36,
"x": 804,
"y": 832
},
{
"t": 37,
"x": 798,
"y": 831
},
{
"t": 38,
"x": 792,
"y": 829
},
{
"t": 39,
"x": 789,
"y": 830
},
{
"t": 40,
"x": 783,
"y": 829
},
{
"t": 41,
"x": 776,
"y": 825
},
{
"t": 42,
"x": 772,
"y": 825
},
{
"t": 43,
"x": 768,
"y": 826
},
{
"t": 44,
"x": 762,
"y": 824
},
{
"t": 45,
"x": 758,
"y": 824
},
{
"t": 46,
"x": 753,
"y": 823
},
{
"t": 47,
"x": 748,
"y": 822
},
{
"t": 48,
"x": 744,
"y": 822
},
{
"t": 49,
"x": 740,
"y": 821
},
{
"t": 50,
"x": 736,
"y": 822
},
{
"t": 51,
"x": 731,
"y": 821
},
{
"t": 52,
"x": 725,
"y": 817
},
{
"t": 53,
"x": 721,
"y": 817
},
{
"t": 54,
"x": 717,
"y": 817
},
{
"t": 55,
"x": 713,
"y": 817
},
{
"t": 56,
"x": 707,
"y": 813
},
{
"t": 57,
"x": 704,
"y": 814
},
{
"t": 58,
"x": 700,
"y": 814
},
{
"t": 59,
"x": 696,
"y": 814
},
{
"t": 60,
"x": 691,
"y": 810
},
{
"t": 61,
"x": 687,
"y": 809
},
{
"t": 62,
"x": 683,
"y": 810
},
{
"t": 63,
"x": 680,
"y": 810
},
{
"t": 64,
"x": 674,
"y": 806
},
{
"t": 65,
"x": 671,
"y": 807
},
{
"t": 66,
"x": 667,
"y": 806
},
{
"t": 67,
"x": 664,
"y": 807
},
{
"t": 68,
"x": 659,
"y": 804
},
{
"t": 69,
"x": 656,
"y": 805
},
{
"t": 70,
"x": 652,
"y": 804
},
{
"t": 71,
"x": 648,
"y": 802
},
{
"t": 72,
"x": 644,
"y": 802
},
{
"t": 73,
"x": 641,
"y": 802
},
{
"t": 74,
"x": 639,
"y": 805
},
{
"t": 75,
"x": 633,
"y": 800
},
{
"t": 76,
"x": 630,
"y": 756
},
{
"t": 77,
"x": 626,
"y": 756
},
{
"t": 78,
"x": 622,
"y": 755
},
{
"t": 79,
"x": 619,
"y": 754
},
{
"t": 80,
"x": 615,
"y": 754
},
{
"t": 81,
"x": 612,
"y": 753
},
{
"t": 82,
"x": 558,
"y": 744
},
{
"t": 83,
"x": 556,
"y": 744
},
{
"t": 84,
"x": 605,
"y": 750
},
{
"t": 85,
"x": 604,
"y": 751
},
{
"t": 86,
"x": 526,
"y": 747
},
{
"t": 88,
"x": 523,
"y": 747
},
{
"t": 89,
"x": 497,
"y": 761
},
{
"t": 90,
"x": 496,
"y": 764
},
{
"t": 92,
"x": 494,
"y": 767
},
{
"t": 93,
"x": 493,
"y": 768
},
{
"t": 95,
"x": 490,
"y": 769
},
{
"t": 97,
"x": 487,
"y": 770
},
{
"t": 98,
"x": 505,
"y": 767
},
{
"t": 99,
"x": 503,
"y": 768
},
{
"t": 100,
"x": 501,
"y": 770
},
{
"t": 102,
"x": 499,
"y": 771
},
{
"t": 103,
"x": 501,
"y": 773
},
{
"t": 104,
"x": 497,
"y": 773
},
{
"t": 105,
"x": 499,
"y": 775
},
{
"t": 106,
"x": 496,
"y": 775
},
{
"t": 107,
"x": 494,
"y": 776
},
{
"t": 109,
"x": 492,
"y": 777
},
{
"t": 110,
"x": 490,
"y": 779
},
{
"t": 111,
"x": 493,
"y": 784
},
{
"t": 112,
"x": 490,
"y": 785
},
{
"t": 113,
"x": 487,
"y": 783
},
{
"t": 114,
"x": 489,
"y": 788
},
{
"t": 115,
"x": 488,
"y": 791
},
{
"t": 116,
"x": 486,
"y": 790
},
{
"t": 118,
"x": 486,
"y": 794
},
{
"t": 119,
"x": 487,
"y": 797
}
],
"birth": 0,
"death": 120
},
{
"id": 4,
"type": "blue jet",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 2,
"v": true
},
{
"t": 92,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": false
},
{
"t": 2,
"v": true
},
{
"t": 92,
"v": false
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 2,
"x": 0,
"y": 331
},
{
"t": 3,
"x": 5,
"y": 332
},
{
"t": 4,
"x": 5,
"y": 341
},
{
"t": 5,
"x": 8,
"y": 340
},
{
"t": 6,
"x": 12,
"y": 338
},
{
"t": 7,
"x": 14,
"y": 338
},
{
"t": 11,
"x": 56,
"y": 339
},
{
"t": 12,
"x": 66,
"y": 339
},
{
"t": 13,
"x": 16,
"y": 339
},
{
"t": 14,
"x": 26,
"y": 339
},
{
"t": 15,
"x": 37,
"y": 339
},
{
"t": 16,
"x": 48,
"y": 339
},
{
"t": 17,
"x": 15,
"y": 333
},
{
"t": 19,
"x": 16,
"y": 329
},
{
"t": 20,
"x": 18,
"y": 324
},
{
"t": 21,
"x": 21,
"y": 319
},
{
"t": 22,
"x": 29,
"y": 316
},
{
"t": 23,
"x": 40,
"y": 316
},
{
"t": 24,
"x": 51,
"y": 317
},
{
"t": 25,
"x": 62,
"y": 316
},
{
"t": 26,
"x": 74,
"y": 317
},
{
"t": 27,
"x": 86,
"y": 317
},
{
"t": 28,
"x": 98,
"y": 317
},
{
"t": 29,
"x": 109,
"y": 316
},
{
"t": 30,
"x": 121,
"y": 316
},
{
"t": 31,
"x": 133,
"y": 315
},
{
"t": 32,
"x": 145,
"y": 315
},
{
"t": 33,
"x": 158,
"y": 316
},
{
"t": 34,
"x": 170,
"y": 316
},
{
"t": 35,
"x": 183,
"y": 316
},
{
"t": 36,
"x": 195,
"y": 316
},
{
"t": 37,
"x": 208,
"y": 315
},
{
"t": 38,
"x": 222,
"y": 315
},
{
"t": 39,
"x": 234,
"y": 315
},
{
"t": 40,
"x": 248,
"y": 315
},
{
"t": 41,
"x": 261,
"y": 315
},
{
"t": 42,
"x": 275,
"y": 315
},
{
"t": 43,
"x": 289,
"y": 315
},
{
"t": 44,
"x": 302,
"y": 315
},
{
"t": 45,
"x": 316,
"y": 314
},
{
"t": 46,
"x": 330,
"y": 314
},
{
"t": 47,
"x": 343,
"y": 314
},
{
"t": 48,
"x": 357,
"y": 313
},
{
"t": 49,
"x": 371,
"y": 313
},
{
"t": 50,
"x": 385,
"y": 313
},
{
"t": 51,
"x": 400,
"y": 314
},
{
"t": 52,
"x": 414,
"y": 314
},
{
"t": 53,
"x": 428,
"y": 314
},
{
"t": 54,
"x": 442,
"y": 313
},
{
"t": 55,
"x": 456,
"y": 313
},
{
"t": 56,
"x": 471,
"y": 311
},
{
"t": 57,
"x": 486,
"y": 313
},
{
"t": 58,
"x": 501,
"y": 313
},
{
"t": 59,
"x": 516,
"y": 313
},
{
"t": 60,
"x": 530,
"y": 313
},
{
"t": 61,
"x": 544,
"y": 313
},
{
"t": 62,
"x": 560,
"y": 311
},
{
"t": 63,
"x": 575,
"y": 311
},
{
"t": 64,
"x": 590,
"y": 310
},
{
"t": 65,
"x": 605,
"y": 311
},
{
"t": 66,
"x": 621,
"y": 311
},
{
"t": 67,
"x": 636,
"y": 310
},
{
"t": 68,
"x": 651,
"y": 310
},
{
"t": 69,
"x": 667,
"y": 310
},
{
"t": 70,
"x": 683,
"y": 310
},
{
"t": 71,
"x": 698,
"y": 310
},
{
"t": 72,
"x": 714,
"y": 309
},
{
"t": 73,
"x": 730,
"y": 310
},
{
"t": 74,
"x": 746,
"y": 309
},
{
"t": 75,
"x": 762,
"y": 309
},
{
"t": 76,
"x": 778,
"y": 308
},
{
"t": 77,
"x": 794,
"y": 308
},
{
"t": 78,
"x": 811,
"y": 308
},
{
"t": 79,
"x": 827,
"y": 309
},
{
"t": 80,
"x": 844,
"y": 309
},
{
"t": 81,
"x": 861,
"y": 309
},
{
"t": 82,
"x": 877,
"y": 308
},
{
"t": 83,
"x": 894,
"y": 308
},
{
"t": 84,
"x": 911,
"y": 307
},
{
"t": 85,
"x": 928,
"y": 308
},
{
"t": 86,
"x": 945,
"y": 308
},
{
"t": 87,
"x": 962,
"y": 307
},
{
"t": 88,
"x": 975,
"y": 306
},
{
"t": 89,
"x": 982,
"y": 317
},
{
"t": 90,
"x": 990,
"y": 319
},
{
"t": 91,
"x": 997,
"y": 317
},
{
"t": 92,
"x": null,
"y": null
}
],
"birth": 2,
"death": 120
}
],
"interactions": [
{
"id": 2,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 57,
"type": "contact"
},
{
"id": 9,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 84,
"type": "contact"
},
{
"id": 8,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 119,
"type": "contact"
},
{
"id": 12,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 119,
"type": "contact"
},
{
"id": 3,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 59,
"ends_at": 59,
"type": "collision"
},
{
"id": 4,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 62,
"ends_at": 62,
"type": "collision"
},
{
"id": 5,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 64,
"ends_at": 64,
"type": "collision"
},
{
"id": 6,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 66,
"ends_at": 66,
"type": "collision"
},
{
"id": 7,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 67,
"ends_at": 119,
"type": "contact"
},
{
"id": 0,
"inputs": [
0,
2
],
"outputs": [
0,
2
],
"begins_at": 77,
"ends_at": 77,
"type": "collision"
},
{
"id": 1,
"inputs": [
0,
3
],
"outputs": [
0,
3
],
"begins_at": 83,
"ends_at": 83,
"type": "collision"
},
{
"id": 10,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 86,
"ends_at": 86,
"type": "collision"
},
{
"id": 11,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 87,
"ends_at": 119,
"type": "contact"
}
]
}Complete per-sample evaluator report
{
"metrics": {
"avg_type_similarity": null,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": null,
"avg_image_position_segmentation_acc": null,
"avg_image_position_segmentation_acc_small": null,
"avg_image_position_segmentation_acc_medium": null,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": null,
"avg_image_position_segmentation_visible_acc": null,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": null,
"visibility_true_acc": null,
"visibility_false_acc": null,
"is_in_frame_acc": null,
"is_in_frame_true_acc": null,
"is_in_frame_false_acc": null,
"vis_acc_from_px": null,
"vis_acc_from_px_true_acc": null,
"vis_acc_from_px_false_acc": null,
"num_matches": 0,
"num_unmatched_pred": 0,
"num_unmatched_target": 5
},
"supports": {
"avg_type_similarity": 0,
"avg_size_diff": 0,
"avg_3d_iou": 0,
"avg_image_position_px_diff": 0,
"avg_image_position_segmentation_acc": 0,
"avg_image_position_segmentation_acc_small": 0,
"avg_image_position_segmentation_acc_medium": 0,
"avg_image_position_segmentation_acc_large": 0,
"avg_image_position_segmentation_acc_first_frame": 0,
"avg_image_position_segmentation_visible_acc": 0,
"avg_quaternion_geodesic_deg": 0,
"visibility_acc": 0,
"visibility_true_acc": 0,
"visibility_false_acc": 0,
"is_in_frame_acc": 0,
"is_in_frame_true_acc": 0,
"is_in_frame_false_acc": 0,
"vis_acc_from_px": 0,
"vis_acc_from_px_true_acc": 0,
"vis_acc_from_px_false_acc": 0
},
"matching": {
"matches": [],
"unmatched_target_ids": [
0,
1,
2,
3,
4
],
"unmatched_pred_ids": [],
"target_type_counts": {
"brown tandem": 1,
"green mountain": 1,
"blue minivan": 1,
"cyan chopper": 1,
"blue jet": 1
},
"pred_type_counts": {},
"assignment_backend": "scipy_dense",
"cost_functions": [
"mutual_type",
"same_seg"
],
"cost_weights": {
"mutual_type": 1.0,
"same_seg": 1.0
},
"num_frames": 120
},
"scene_metrics": {
"thresholds": [
0.5,
1.0,
2.0,
3.0
],
"counts_by_threshold": {
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"2.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"3.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
}
},
"jaccard_by_threshold": {
"0.5": 0.0,
"1.0": 0.0,
"2.0": 0.0,
"3.0": 0.0
},
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
}
},
"visibility_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_by_motion_group": {
"static": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
}
},
"visibility_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"dynamic": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
}
},
"visibility_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"unknown": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
}
},
"visibility_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"segmentation_counts_by_threshold": {},
"segmentation_precision_by_threshold": {},
"segmentation_recall_by_threshold": {},
"segmentation_f1_by_threshold": {},
"segmentation_frame_average_precision": null,
"segmentation_frame_average_recall": null,
"segmentation_frame_average_f1": null,
"segmentation_first_frame_counts": {},
"segmentation_first_frame_precision": null,
"segmentation_first_frame_recall": null,
"segmentation_first_frame_f1": null,
"segmentation_by_motion_group": {}
},
"per_match_metrics": [],
"interaction_metrics": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 13,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 13
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 13
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 13
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 13
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 13
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 13
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 13
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 13
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 13
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 13
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 13
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 13
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"interaction_supports": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
},
"interaction_matching": {
"matches": [],
"unmatched_target_ids": [
0,
1,
2,
3,
4,
5,
6,
7,
8,
9,
10,
11,
12
],
"unmatched_pred_ids": [],
"target_type_counts": {
"collision": 7,
"contact": 6
},
"pred_type_counts": {},
"assignment_backend": "scipy_dense",
"cost_functions": [
"type_exact",
"temporal_span",
"input_object_set_mutual_jaccard",
"output_object_set_mutual_jaccard"
],
"cost_weights": {
"type_exact": 1.0,
"temporal_span": 1.0,
"input_object_set_mutual_jaccard": 0.5,
"output_object_set_mutual_jaccard": 0.5
}
},
"per_interaction_match_metrics": [],
"interaction_metrics_by_participants": {
"object_ground": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 11,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 11
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 11
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 11
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 11
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 11
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 11
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 11
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 11
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 11
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 11
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 11
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 11
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"object_object": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 2,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 2
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 2
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 2
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 2
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 2
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 2
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 2
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 2
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 2
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 2
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 2
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 2
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"interaction_supports_by_participants": {
"object_ground": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
},
"object_object": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
}
},
"interaction_metrics_by_type": {
"collision": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 7,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"contact": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 6,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"interaction_supports_by_type": {
"collision": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
},
"contact": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
}
}
}Exact evaluation configuration
{
"predictions_jsonl": "../inference_output.jsonl",
"dataset_json": "../test_data/movi_dump_sentinel_sharegpt.json",
"scene_root": "../test_data/movi_dump",
"output_json": "../evaluation_report.json",
"max_samples": null,
"num_workers": 1,
"show_progress": true,
"log_level": "INFO",
"visibility_filter_mode": "any_frame",
"pos2d_mode": "scaled_normalized",
"pos2d_scale": 1000.0,
"image_width": null,
"image_height": null,
"type_embed_model_name": "all-MiniLM-L6-v2",
"scene_similarity_thresholds": [
0.5,
1.0,
2.0,
3.0
],
"scene_segmentation_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"matching": {
"costs": [
{
"name": "mutual_type",
"weight": 1.0
},
{
"name": "same_seg",
"weight": 1.0,
"missing_value": 1.0,
"kwargs": {
"only_use_first_frame": false
}
}
]
},
"interaction_matching": {
"costs": [
{
"name": "type_exact",
"weight": 1.0
},
{
"name": "temporal_span",
"weight": 1.0
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5
}
]
},
"return_per_sample": true
}