STRIVE · 08/28/2026
Dyn generalization · test_24 · super_clevr_1142
Everything fed into evaluation and the full per-sample output it produced.
Dataset row: exact video + user prompt + assistant target
{
"messages": [
{
"role": "user",
"content": "<video>\nAnalyze the provided video and return ONLY a valid sentinel sequence in this format:\n[SCENE-START] [OBJS-START]\n[OBJ] id \"type\" birth death [VIS] t vis ... [IN-FRAME] t is_in_frame ... [PX] t px py ...\n[OBJ] ...\n[OBJS-END]\n[INTERACTIONS-START]\n[INTERACT] id \"type\" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ...\n[INTERACT] ...\n[INTERACTIONS-END] [SCENE-END]\n\nConstraints:\n- Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose).\n- Keep tags exactly as written:\n `[SCENE-START] [OBJS-START] [OBJ] [VIS] [IN-FRAME] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]`\n- Use quoted strings for `type` (double quotes).\n- `VIS` uses repeated groups of 2 values in order:\n `t vis`.\n `vis` is a boolean value.\n- `IN-FRAME` uses repeated groups of 2 values in order:\n `t is_in_frame`.\n `is_in_frame` is a boolean value.\n- `PX` uses repeated groups of 3 values in order: `t px py`.\n- `px` and `py` are normalized pixel coordinates in the range `[0, 1]`,\n scaled by `1000` and then converted to integers by dropping the decimal part.\n- For occluded or out-of-frame frames under this setting, `PX` may use `t null null`.\n- `IN` and `OUT` contain whitespace-separated integer ids.\n- Use lowercase booleans (`true`/`false`) for `vis` and `is_in_frame`."
},
{
"role": "assistant",
"content": "[SCENE-START] [OBJS-START] [OBJ] 0 \"cyan fighter\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 75 444 1 78 444 2 81 445 3 84 445 4 87 445 5 90 445 6 94 446 7 97 446 8 101 446 9 104 446 10 107 446 11 110 447 12 115 447 13 119 447 14 122 447 15 126 447 16 130 447 17 133 448 18 137 448 19 141 448 20 145 448 21 150 449 22 154 449 23 158 449 [OBJ] 1 \"blue tandem\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 421 581 1 419 583 2 426 561 3 416 585 4 415 586 5 413 590 7 410 593 8 418 570 9 417 565 10 405 598 11 403 600 12 406 578 13 412 574 14 398 605 15 408 577 16 394 607 17 401 602 18 391 613 19 401 584 20 386 617 21 398 589 22 381 619 23 394 593 [OBJ] 2 \"red mountain\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 558 668 3 550 654 4 557 668 8 555 666 9 555 669 10 554 667 11 555 669 15 553 670 17 551 669 19 551 671 22 548 671 [OBJ] 3 \"red scooter\" 1 24 [VIS] 0 false 1 true [IN-FRAME] 0 false 1 true [PX] 0 null null 1 998 719 2 994 715 3 991 700 4 987 699 5 982 695 6 973 696 7 965 696 8 956 697 9 948 697 10 984 709 11 980 711 12 973 710 13 966 709 14 956 711 15 947 714 16 938 714 17 930 714 18 923 714 19 913 715 20 904 717 21 894 718 22 887 717 23 877 719 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACTIONS-END] [SCENE-END]"
}
],
"videos": [
"/mmfs1/gscratch/krishna/suryadv/strive_dynsuperclevr/data/lf/videos/test_24/super_clevr_1142/frames.max_frames_24.mp4"
]
}Inference record: exact prompt + prediction + label + parse debug
{
"prompt": "user\n\nAnalyze the provided video and return ONLY a valid sentinel sequence in this format:\n[SCENE-START] [OBJS-START]\n[OBJ] id \"type\" birth death [VIS] t vis ... [IN-FRAME] t is_in_frame ... [PX] t px py ...\n[OBJ] ...\n[OBJS-END]\n[INTERACTIONS-START]\n[INTERACT] id \"type\" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ...\n[INTERACT] ...\n[INTERACTIONS-END] [SCENE-END]\n\nConstraints:\n- Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose).\n- Keep tags exactly as written:\n `[SCENE-START] [OBJS-START] [OBJ] [VIS] [IN-FRAME] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]`\n- Use quoted strings for `type` (double quotes).\n- `VIS` uses repeated groups of 2 values in order:\n `t vis`.\n `vis` is a boolean value.\n- `IN-FRAME` uses repeated groups of 2 values in order:\n `t is_in_frame`.\n `is_in_frame` is a boolean value.\n- `PX` uses repeated groups of 3 values in order: `t px py`.\n- `px` and `py` are normalized pixel coordinates in the range `[0, 1]`,\n scaled by `1000` and then converted to integers by dropping the decimal part.\n- For occluded or out-of-frame frames under this setting, `PX` may use `t null null`.\n- `IN` and `OUT` contain whitespace-separated integer ids.\n- Use lowercase booleans (`true`/`false`) for `vis` and `is_in_frame`.\nassistant\n",
"predict": "[SCENE-START] [OBJS-START] [OBJ] 0 \"teal fabric mermaid backpack\" 0 10 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 1 419 1 null null [OBJ] 1 \"teal and lime running shoe\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 13 427 2 21 431 3 37 435 4 17 435 6 21 443 7 33 443 8 21 447 10 29 451 12 41 451 13 29 455 15 41 455 16 52 455 17 37 458 19 48 458 20 60 458 21 44 462 23 56 462 [OBJ] 2 \"grey and orange plastic raccoon action figure\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 21 470 1 37 470 3 52 470 4 68 470 5 83 470 6 95 470 7 107 470 8 119 470 9 130 470 10 142 470 11 154 470 12 166 470 13 177 470 14 189 470 15 201 470 16 212 470 17 224 470 18 236 470 19 248 470 20 259 470 21 271 470 22 283 470 23 294 470 [OBJ] 3 \"grey and white plastic shark figurine\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 240 419 2 255 423 4 267 423 6 279 423 8 291 423 10 302 423 12 314 423 14 326 423 16 333 427 18 345 427 20 357 427 22 365 431 23 376 427 [OBJ] 4 \"blue and orange plastic Therizinosaurus figurine\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 427 548 1 423 556 4 412 560 7 404 564 10 392 568 13 384 572 16 380 580 19 373 583 22 365 587 23 376 583 [OBJ] 5 \"red and yellow wooden toy airplane with pilot\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 544 666 4 537 669 8 533 677 13 525 681 18 521 689 23 513 693 [OBJ] 6 \"red and dark grey plastic flashlight\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 666 1 998 677 2 994 689 3 990 701 4 986 712 5 978 720 6 974 728 7 966 732 8 958 740 9 951 744 10 943 748 11 935 751 12 927 755 14 912 759 15 904 763 16 896 767 18 880 771 19 873 775 21 857 779 23 845 783 [OBJ] 7 \"black and blue plastic screwdriver\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 615 1 994 623 2 990 630 3 986 638 4 982 646 5 978 654 6 974 662 7 966 666 8 958 669 9 951 673 10 943 677 11 935 681 12 927 685 14 916 689 15 908 693 17 892 693 18 884 697 20 873 701 22 861 705 23 853 708 [OBJ] 8 \"red and black plastic handheld gaming console\" 0 10 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 998 724 1 994 732 2 990 744 3 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 10 [IN] 0 1 [OUT] 0 1 [INTERACT] 1 \"contact\" 0 10 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 10 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 3 \"contact\" 0 10 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 4 \"contact\" 0 10 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"contact\" 0 10 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 0 10 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 7 \"contact\" 0 10 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 8 \"contact\" 0 10 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 9 \"contact\" 0 10 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 10 \"collision\" 5 5 [IN] 8 9 [OUT] 8 9 [INTERACT] 11 \"collision\" 8 8 [IN] 8 9 [OUT] 8 9 [INTERACT] 12 \"contact\" 9 10 [IN] 8 9 [OUT] 8 9 [INTERACT] 13 \"collision\" 10 10 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 14 \"contact\" 10 11 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 15 \"collision\" 10 11 [IN] 9 6 [OUT] 9 6 [INTERACT] 16 \"collision\" 13 13 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 17 \"contact\" 14 21 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 18 \"collision\" 15 15 [IN] 9 6 [OUT] 9 6 [INTERACT] 19 \"collision\" 17 17 [IN] 9 6 [OUT] 9 6 [INTERACT] 20 \"contact\" 18 20 [IN] 9 6 [OUT] 9 6 [INTERACT] 21 \"collision\" 20 20 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 22 \"contact\" 21 22 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 23 \"collision\" 22 22 [IN] 9 6 [OUT] 9 6 [INTERACT] 24 \"contact\" 23 24 [IN] 9 6 [OUT] 9 6 [INTERACT] 25 \"collision\" 24 24 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 26 \"contact\" 25 26 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 27 \"collision\" 28 28 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 28 \"contact\" 29 31 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 29 \"collision\" 30 30 [IN] 9 6 [OUT] 9 6 [INTERACT] 30 \"contact\" 31 32 [IN] 9 6 [OUT] 9 6 [INTERACT] 31 \"collision\" 32 32 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 32 \"contact\" 33 34 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 33 \"collision\" 36 36 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 34 \"contact\" 37 38 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 35 \"collision\" 39 39 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 36 \"contact\" 40 21 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 37 \"collision\" 42 42 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 38 \"contact\" 43 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 45 45 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 40 \"contact\" 46 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 41 \"collision\" 48 48 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 42 \"contact\" 49 50 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 43 \"collision\" 50 50 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 44 \"contact\" 51 52 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 45 \"collision\" 52 52 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 46 \"contact\" 53 54 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 47 \"collision\" 54 54 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 48 \"contact\" 55 56 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 49 \"collision\" 58 58 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 50 \"contact\" 59 61 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 51 \"collision\" 60 60 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 52 \"contact\" 61 62 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 53 \"collision\" 62 62 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 54 \"contact\" 63 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 0 \"collision\" 64 64 [IN] 0 1 [OUT] 0 1 [INTERACT] 1 \"collision\" 64 64 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 5 \"collision\" 64 64 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 6 \"contact\" 65 67 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 2 \"collision\" 66 66 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 3 \"collision\" 66 66 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 39 \"collision\" 66 66 [IN] 9 6 [OUT] 9 6 [INTERACT] 4 \"contact\" 67 68 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 7 \"collision\" 68 68 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 39 \"collision\" 68 68 [IN] 9 6 [OUT] 9 6 [INTERACT] 40 \"contact\" 69 70 [IN] 9 6 [OUT] 9 6 [INTERACT] 8 \"contact\" 69 70 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 9 \"collision\" 70 70 [IN] 7 8 [OUT] 7 8 [INTERACT] 39 \"collision\" 70 70 [IN] 9 6 [OUT] 9 6 [INTERACT] 13 \"collision\" 70 70 [IN] 9 10 [OUT] 9 10 [INTERACT] 14 \"contact\" 71 72 [IN] 9 10 [OUT] 9 10 [INTERACT] 10 \"collision\" 72 72 [IN] 7 9 [OUT] 7 9 [INTERACT] 39 \"collision\" 72 72 [IN] 9 6 [OUT] 9 6 [INTERACT] 39 \"collision\" 72 72 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 15 \"collision\" 72 72 [IN] 9 6 [OUT] 9 6 [INTERACT] 39 \"collision\" 72 72 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 4 \"collision\" 73 73 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 39 \"collision\" 73 73 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 41 \"collision\" 73 73 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 73 73 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 73 73 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 43 \"collision\" 73 73 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 44 \"collision\" 73 73 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 46 \"collision\" 73 73 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 55 \"collision\" 73 73 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 45 \"contact\" 74 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 75 75 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 75 75 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 56 \"collision\" 75 75 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 57 \"contact\" 76 78 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 77 77 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 47 \"collision\" 77 77 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 48 \"contact\" 78 79 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 49 \"collision\" 79 79 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 42 \"collision\" 79 79 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 40 \"collision\" 79 79 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 16 \"collision\" 79 79 [IN] 9 6 [OUT] 9 6 [INTERACT] 50 \"collision\" 80 80 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 58 \"collision\" 80 80 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 79 81 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 51 \"collision\" 81 81 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 59 \"collision\" 81 81 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 52 \"collision\" 81 81 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 17 \"collision\" 81 81 [IN] 9 6 [OUT] 9 6 [INTERACT] 18 \"collision\" 81 81 [IN] 9 10 [OUT] 9 10 [INTERACT] 39 \"collision\" 81 81 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 53 \"collision\" 81 81 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 54 \"collision\" 81 81 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 52 \"contact\" 82 83 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 60 \"contact\" 82 83 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 4 \"collision\" 83 83 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 19 \"collision\" 83 83 [IN] 9 6 [OUT] 9 6 [INTERACT] 39 \"collision\" 83 83 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 83 83 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 11 \"collision\" 83 84 [IN] 8 9 [OUT] 8 9 [INTERACT] 39 \"collision\" 83 84 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 84 84 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 84 85 [IN] 9 6 [OUT] 9 6 [INTERACT] 39 \"collision\" 84 85 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 5 \"collision\" 85 85 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 61 \"collision\" 85 85 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"collision\" 86 86 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 62 \"contact\" 86 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 87 88 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 89 89 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 91 91 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"collision\" 92 92 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 39 \"collision\" 93 94 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 95 95 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 5 \"collision\" 96 96 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 39 \"collision\" 97 98 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 99 99 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 0 \"collision\" 100 100 [IN] 0 1 [OUT] 0 1 [INTERACT] 39 \"collision\" 100 100 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 3 \"collision\" 100 100 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 5 \"collision\" 100 100 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 63 \"collision\" 100 100 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 1 \"contact\" 101 102 [IN] 0 1 [OUT] 0 1 [INTERACT] 64 \"contact\" 101 102 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 6 \"collision\" 102 102 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 65 \"collision\" 102 102 [IN] 9 7 [OUT] 9 7 [INTERACT] 39 \"collision\" 102 102 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 102 102 [IN] 9 6 [OUT] 9 6 [INTERACT] 39 \"collision\" 102 102 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 102 102 [IN] 9 6 [OUT] 9 6 [INTERACT] 66 \"contact\" 103 104 [IN] 9 7 [OUT] 9 7 [INTERACT] 39 \"collision\" 104 104 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 104 104 [IN] 9 6 [OUT] 9 6 [INTERACT] 7 \"collision\" 104 104 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 67 \"collision\" 104 104 [IN] 9 8 [OUT] 9 8 [INTERACT] 39 \"collision\" 104 104 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 68 \"contact\" 105 106 [IN] 9 8 [OUT] 9 8 [INTERACT] 39 \"collision\" 106 106 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 106 106 [IN] 9 6 [OUT] 9 6 [INTERACT] 8 \"collision\" 106 106 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 39 \"collision\" 106 106 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 69 \"collision\" 106 106 [IN] 9 8 [OUT] 9 8 [INTERACT] 39 \"collision\" 108 108 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 70 \"contact\" 107 111 [IN] 9 8 [OUT] 9 8 [INTERACT] 39 \"collision\" 109 110 [IN] 9 6 [OUT] 9 6 [INTERACT] 9 \"collision\" 109 110 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 39 \"collision\" 111 111 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 71 \"collision\" 111 111 [IN] 9 8 [OUT] 9 8 [INTERACT] 72 \"contact\" 112 113 [IN] 9 8 [OUT] 9 8 [INTERACT] 39 \"collision\" 113 114 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 113 114 [IN] 9 6 [OUT] 9 6 [INTERACT] 73 \"collision\" 114 114 [IN] 9 8 [OUT] 9 8 [INTERACT] 74 \"contact\" 115 126 [IN] 9 8 [OUT] 9 8 [INTERACT] 39 \"collision\" 119 120 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 75 \"collision\" 119 119 [IN] 9 8 [OUT] 9 8 [INTERACT] 39 \"collision\" 121 122 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 76 \"collision\" 121 122 [IN] 9 8 [OUT] 9 8 [INTERACT] 77 \"collision\" 122 122 [IN] 9 9 [OUT] 9 9 [INTERACT] 39 \"collision\" 126 127 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 78 \"collision\" 126 127 [IN] 9 9 [OUT] 9 9 [INTERACT] 79 \"collision\" 129 129 [IN] 9 9 [OUT] 9 9 [INTERACT] 39 \"collision\" 133 134 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 80 \"collision\" 133 134 [IN] 9 9 [OUT] 9 9 [INTERACT] 81 \"collision\" 137 138 [IN] 9 9 [OUT] 9 9 [INTERACT] 39 \"collision\" 140 141 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 82 \"collision\" 144 145 [IN] 9 9 [OUT] 9 9 [INTERACT] 39 \"collision\" 148 149 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 83 \"collision\" 152 153 [IN] 9 9 [OUT] 9 9 [INTERACT] 39 \"collision\" 156 157 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 84 \"collision\" 156 157 [IN] 9 9 [OUT] 9 9 [INTERACT] 85 \"collision\" 160 162 [IN] 9 9 [OUT] 9 9 [INTERACT] 39 \"collision\" 164 166 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 86 \"collision\" 164 166 [IN] 9 9 [OUT] 9 9 [INTERACT] 87 \"collision\" 168 169 [IN] 9 9 [OUT] 9 9 [INTERACT] 39 \"collision\" 172 173 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 88 \"collision\" 176 177 [IN] 9 9 [OUT] 9 9 [INTERACT] 39 \"collision\" 181 181 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 89 \"collision\" 181 181 [IN] 9 9 [OUT] 9 9 [INTERACT] 8 \"collision\" 181 181 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 90 \"collision\" 185 189 [IN] 9 9 [OUT] 9 9 [INTERACT] 4 \"collision\" 189 193 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 39 \"collision\" 189 193 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 91 \"collision\" 189 193 [IN] 9 9 [OUT] 9 9 [INTERACT] 39 \"collision\" 189 193 [IN] 9 6 [OUT] 9 6 [INTERACT] 92 \"collision\" 189 193 [IN] 9 911 [OUT] 9 911 [INTERACT] 93 \"collision\" 193 197 [IN] 9 911 [OUT] 9 911 [INTERACT] 39 \"collision\" 197 198 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 94 \"collision\" 197 198 [IN] 9 911 [OUT] 9 911 [INTERACT] 95 \"collision\" 197 198 [IN] 9 990 [OUT] 9 990 [INTERACT] 96 \"collision\" 197 198 [IN] 9 911 [OUT] 9 911 [INTERACT] 97 \"collision\" 201 201 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 205 205 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 98 \"collision\" 205 205 [IN] 9 911 [OUT] 9 911 [INTERACT] 99 \"collision\" 205 205 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 205 205 [IN] 9 911 [OUT] 9 911 [INTERACT] 4 \"collision\" 209 208 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 39 \"collision\" 212 212 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 100 \"collision\" 212 212 [IN] 9 990 [OUT] 9 990 [INTERACT] 5 \"collision\" 216 216 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 101 \"collision\" 216 216 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 216 216 [IN] 9 911 [OUT] 9 911 [INTERACT] 39 \"collision\" 220 224 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 102 \"collision\" 220 224 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 224 228 [IN] 9 911 [OUT] 9 911 [INTERACT] 6 \"collision\" 228 224 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 103 \"collision\" 228 228 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 228 220 [IN] 9 911 [OUT] 9 911 [INTERACT] 39 \"collision\" 228 224 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 232 228 [IN] 9 911 [OUT] 9 911 [INTERACT] 39 \"collision\" 232 224 [IN] 9 911 [OUT] 9 911 [INTERACT] 39 \"collision\" 236 224 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 104 \"collision\" 236 228 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 240 228 [IN] 9 911 [OUT] 9 911 [INTERACT] 7 \"collision\" 244 228 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 39 \"collision\" 244 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 105 \"collision\" 244 228 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 248 228 [IN] 9 911 [OUT] 9 911 [INTERACT] 39 \"collision\" 248 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 251 228 [IN] 9 911 [OUT] 9 911 [INTERACT] 106 \"collision\" 251 228 [IN] 9 990 [OUT] 9 990 [INTERACT] 7 \"contact\" 232 232 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 39 \"collision\" 259 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 107 \"collision\" 259 228 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 263 228 [IN] 9 911 [OUT] 9 911 [INTERACT] 0 \"collision\" 271 228 [IN] 0 1 [OUT] 0 1 [INTERACT] 39 \"collision\" 275 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 108 \"collision\" 275 228 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 279 224 [IN] 9 911 [OUT] 9 911 [INTERACT] 39 \"collision\" 283 228 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 109 \"collision\" 283 220 [IN] 9 990 [OUT] 9 990 [INTERACT] 1 \"collision\" 291 224 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 39 \"collision\" 291 220 [IN] 9 911 [OUT] 9 911 [INTERACT] 39 \"collision\" 294 224 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 110 \"collision\" 294 216 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 298 220 [IN] 9 911 [OUT] 9 911 [INTERACT] 39 \"collision\" 302 228 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 111 \"collision\" 302 216 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 310 224 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 112 \"collision\" 310 216 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 318 224 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 113 \"collision\" 318 212 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 326 220 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 114 \"collision\" 326 212 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 333 220 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 115 \"collision\" 333 212 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 341 220 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 116 \"collision\" 341 212 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 349 220 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 117 \"collision\" 349 212 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 357 224 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 118 \"collision\" 357 216 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 365 224 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 119 \"collision\" 365 216 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 373 228 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 120 \"collision\" 373 220 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 380 224 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 121 \"collision\" 380 220 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 388 228 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 122 \"collision\" 388 220 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 396 228 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 123 \"collision\" 396 220 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 404 228 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 124 \"collision\" 404 220 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 412 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 125 \"collision\" 412 220 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 419 228 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 126 \"collision\" 419 220 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 427 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 127 \"collision\" 427 220 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 435 228 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 128 \"collision\" 435 216 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 443 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 129 \"collision\" 443 220 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 451 228 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 130 \"collision\" 451 220 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 458 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 131 \"collision\" 458 220 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 466 228 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 132 \"collision\" 466 220 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 474 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 133 \"collision\" 474 220 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 482 228 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 134 \"collision\" 482 216 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 490 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 135 \"collision\" 490 216 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 501 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 136 \"collision\" 501 216 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 509 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 137 \"collision\" 513 216 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 521 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 138 \"collision\" 521 220 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 529 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 139 \"collision\" 533 216 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 541 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 140 \"collision\" 544 220 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 552 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 141 \"collision\" 552 220 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 560 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 142 \"collision\" 564 216 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 572 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 143 \"collision\" 572 220 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 580 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 144 \"collision\" 583 216 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 591 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 145 \"collision\" 595 216 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 599 228 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 603 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 146 \"collision\" 603 216 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 611 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 147 \"collision\" 615 212 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 623 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 148 \"collision\" 623 212 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 630 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 149 \"collision\" 634 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 642 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 150 \"collision\" 646 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 654 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 151 \"collision\" 658 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 669 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 152 \"collision\" 673 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 685 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 153 \"collision\" 689 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 697 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 154 \"collision\" 701 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 708 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 155 \"collision\" 712 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 720 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 156 \"collision\" 724 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 732 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 157 \"collision\" 736 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 744 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 158 \"collision\" 748 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 755 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 159 \"collision\" 759 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 767 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 160 \"collision\" 771 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 779 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 161 \"collision\" 783 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 791 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 162 \"collision\" 794 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 802 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 163 \"collision\" 806 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 814 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 164 \"collision\" 818 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 826 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 165 \"collision\" 830 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 837 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 166 \"collision\" 841 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 849 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 167 \"collision\" 853 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 861 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 168 \"collision\" 865 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 873 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 169 \"collision\" 876 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 884 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 170 \"collision\" 888 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 896 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 171 \"collision\" 900 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 908 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 172 \"collision\" 912 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 919 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 173 \"collision\" 919 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 927 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 174 \"collision\" 931 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 939 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 175 \"collision\" 943 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 951 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 176 \"collision\" 955 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 966 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 177 \"collision\" 970 208 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 978 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 178 \"collision\" 978 224 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 986 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 179 \"collision\" 986 224 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 994 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 180 \"collision\" 998 236 [IN] 9 990 [OUT] 9 990 [INTERACT] 39 \"collision\" 998 248 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 998 232 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 181 \"collision\" 998 248 [IN] 9 990 [OUT] 9 990 [INTERACT] 6 \"collision\" 1 2 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"collision\" 6 6 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 4 \"contact\" 7 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"collision\" 11 11 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 182 \"collision\" 12 12 [IN] 9 990 [OUT] 9 990 [INTERACT] 183 \"contact\" 13 15 [IN] 9 990 [OUT] 9 990 [INTERACT] 2 \"collision\" 14 14 [IN] 1 65535 [OUT] 1 65535",
"label": "[SCENE-START] [OBJS-START] [OBJ] 0 \"cyan fighter\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 75 444 1 78 444 2 81 445 3 84 445 4 87 445 5 90 445 6 94 446 7 97 446 8 101 446 9 104 446 10 107 446 11 110 447 12 115 447 13 119 447 14 122 447 15 126 447 16 130 447 17 133 448 18 137 448 19 141 448 20 145 448 21 150 449 22 154 449 23 158 449 [OBJ] 1 \"blue tandem\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 421 581 1 419 583 2 426 561 3 416 585 4 415 586 5 413 590 7 410 593 8 418 570 9 417 565 10 405 598 11 403 600 12 406 578 13 412 574 14 398 605 15 408 577 16 394 607 17 401 602 18 391 613 19 401 584 20 386 617 21 398 589 22 381 619 23 394 593 [OBJ] 2 \"red mountain\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 558 668 3 550 654 4 557 668 8 555 666 9 555 669 10 554 667 11 555 669 15 553 670 17 551 669 19 551 671 22 548 671 [OBJ] 3 \"red scooter\" 1 24 [VIS] 0 false 1 true [IN-FRAME] 0 false 1 true [PX] 0 null null 1 998 719 2 994 715 3 991 700 4 987 699 5 982 695 6 973 696 7 965 696 8 956 697 9 948 697 10 984 709 11 980 711 12 973 710 13 966 709 14 956 711 15 947 714 16 938 714 17 930 714 18 923 714 19 913 715 20 904 717 21 894 718 22 887 717 23 877 719 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"contact\" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACTIONS-END] [SCENE-END]\n",
"parse_debug": {
"pred_parse_valid": false,
"pred_parse_error": "Could not find [SCENE-END] after [SCENE-START].",
"pred_parse_error_type": "ValueError",
"guided_grammar_sha256": "501d31b980c1f9495be86a80917e58d24972e52c4d442eafe69e5c4fc7522dc6",
"guided_grammar_path": "strive_datasets/prep/kubric/scene_repr/profiles/grammars/selector_sentinel_no_3d.lark",
"debug_dir": "/gscratch/krishna/suryadv/strive_dynsuperclevr/runtime/36996079_inference_24/debug/test_24_shard_001/parse_failures/sample_000018",
"guided_grammar_debug_path": "/gscratch/krishna/suryadv/strive_dynsuperclevr/runtime/36996079_inference_24/debug/test_24_shard_001/parse_failures/sample_000018/grammar.ebnf.gz"
}
}Parsed prediction
{
"error": "ValueError: Could not find [SCENE-END] after [SCENE-START]."
}Parsed ground truth
{
"objects": [
{
"id": 0,
"type": "cyan fighter",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 75,
"y": 444
},
{
"t": 1,
"x": 78,
"y": 444
},
{
"t": 2,
"x": 81,
"y": 445
},
{
"t": 3,
"x": 84,
"y": 445
},
{
"t": 4,
"x": 87,
"y": 445
},
{
"t": 5,
"x": 90,
"y": 445
},
{
"t": 6,
"x": 94,
"y": 446
},
{
"t": 7,
"x": 97,
"y": 446
},
{
"t": 8,
"x": 101,
"y": 446
},
{
"t": 9,
"x": 104,
"y": 446
},
{
"t": 10,
"x": 107,
"y": 446
},
{
"t": 11,
"x": 110,
"y": 447
},
{
"t": 12,
"x": 115,
"y": 447
},
{
"t": 13,
"x": 119,
"y": 447
},
{
"t": 14,
"x": 122,
"y": 447
},
{
"t": 15,
"x": 126,
"y": 447
},
{
"t": 16,
"x": 130,
"y": 447
},
{
"t": 17,
"x": 133,
"y": 448
},
{
"t": 18,
"x": 137,
"y": 448
},
{
"t": 19,
"x": 141,
"y": 448
},
{
"t": 20,
"x": 145,
"y": 448
},
{
"t": 21,
"x": 150,
"y": 449
},
{
"t": 22,
"x": 154,
"y": 449
},
{
"t": 23,
"x": 158,
"y": 449
}
],
"birth": 0,
"death": 24
},
{
"id": 1,
"type": "blue tandem",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 421,
"y": 581
},
{
"t": 1,
"x": 419,
"y": 583
},
{
"t": 2,
"x": 426,
"y": 561
},
{
"t": 3,
"x": 416,
"y": 585
},
{
"t": 4,
"x": 415,
"y": 586
},
{
"t": 5,
"x": 413,
"y": 590
},
{
"t": 7,
"x": 410,
"y": 593
},
{
"t": 8,
"x": 418,
"y": 570
},
{
"t": 9,
"x": 417,
"y": 565
},
{
"t": 10,
"x": 405,
"y": 598
},
{
"t": 11,
"x": 403,
"y": 600
},
{
"t": 12,
"x": 406,
"y": 578
},
{
"t": 13,
"x": 412,
"y": 574
},
{
"t": 14,
"x": 398,
"y": 605
},
{
"t": 15,
"x": 408,
"y": 577
},
{
"t": 16,
"x": 394,
"y": 607
},
{
"t": 17,
"x": 401,
"y": 602
},
{
"t": 18,
"x": 391,
"y": 613
},
{
"t": 19,
"x": 401,
"y": 584
},
{
"t": 20,
"x": 386,
"y": 617
},
{
"t": 21,
"x": 398,
"y": 589
},
{
"t": 22,
"x": 381,
"y": 619
},
{
"t": 23,
"x": 394,
"y": 593
}
],
"birth": 0,
"death": 24
},
{
"id": 2,
"type": "red mountain",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 558,
"y": 668
},
{
"t": 3,
"x": 550,
"y": 654
},
{
"t": 4,
"x": 557,
"y": 668
},
{
"t": 8,
"x": 555,
"y": 666
},
{
"t": 9,
"x": 555,
"y": 669
},
{
"t": 10,
"x": 554,
"y": 667
},
{
"t": 11,
"x": 555,
"y": 669
},
{
"t": 15,
"x": 553,
"y": 670
},
{
"t": 17,
"x": 551,
"y": 669
},
{
"t": 19,
"x": 551,
"y": 671
},
{
"t": 22,
"x": 548,
"y": 671
}
],
"birth": 0,
"death": 24
},
{
"id": 3,
"type": "red scooter",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 1,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": false
},
{
"t": 1,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 1,
"x": 998,
"y": 719
},
{
"t": 2,
"x": 994,
"y": 715
},
{
"t": 3,
"x": 991,
"y": 700
},
{
"t": 4,
"x": 987,
"y": 699
},
{
"t": 5,
"x": 982,
"y": 695
},
{
"t": 6,
"x": 973,
"y": 696
},
{
"t": 7,
"x": 965,
"y": 696
},
{
"t": 8,
"x": 956,
"y": 697
},
{
"t": 9,
"x": 948,
"y": 697
},
{
"t": 10,
"x": 984,
"y": 709
},
{
"t": 11,
"x": 980,
"y": 711
},
{
"t": 12,
"x": 973,
"y": 710
},
{
"t": 13,
"x": 966,
"y": 709
},
{
"t": 14,
"x": 956,
"y": 711
},
{
"t": 15,
"x": 947,
"y": 714
},
{
"t": 16,
"x": 938,
"y": 714
},
{
"t": 17,
"x": 930,
"y": 714
},
{
"t": 18,
"x": 923,
"y": 714
},
{
"t": 19,
"x": 913,
"y": 715
},
{
"t": 20,
"x": 904,
"y": 717
},
{
"t": 21,
"x": 894,
"y": 718
},
{
"t": 22,
"x": 887,
"y": 717
},
{
"t": 23,
"x": 877,
"y": 719
}
],
"birth": 1,
"death": 24
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 1,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
}
]
}Complete per-sample evaluator report
{
"metrics": {
"avg_type_similarity": null,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": null,
"avg_image_position_segmentation_acc": null,
"avg_image_position_segmentation_acc_small": null,
"avg_image_position_segmentation_acc_medium": null,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": null,
"avg_image_position_segmentation_visible_acc": null,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": null,
"visibility_true_acc": null,
"visibility_false_acc": null,
"is_in_frame_acc": null,
"is_in_frame_true_acc": null,
"is_in_frame_false_acc": null,
"vis_acc_from_px": null,
"vis_acc_from_px_true_acc": null,
"vis_acc_from_px_false_acc": null,
"num_matches": 0,
"num_unmatched_pred": 0,
"num_unmatched_target": 4
},
"supports": {
"avg_type_similarity": 0,
"avg_size_diff": 0,
"avg_3d_iou": 0,
"avg_image_position_px_diff": 0,
"avg_image_position_segmentation_acc": 0,
"avg_image_position_segmentation_acc_small": 0,
"avg_image_position_segmentation_acc_medium": 0,
"avg_image_position_segmentation_acc_large": 0,
"avg_image_position_segmentation_acc_first_frame": 0,
"avg_image_position_segmentation_visible_acc": 0,
"avg_quaternion_geodesic_deg": 0,
"visibility_acc": 0,
"visibility_true_acc": 0,
"visibility_false_acc": 0,
"is_in_frame_acc": 0,
"is_in_frame_true_acc": 0,
"is_in_frame_false_acc": 0,
"vis_acc_from_px": 0,
"vis_acc_from_px_true_acc": 0,
"vis_acc_from_px_false_acc": 0
},
"matching": {
"matches": [],
"unmatched_target_ids": [
0,
1,
2,
3
],
"unmatched_pred_ids": [],
"target_type_counts": {
"cyan fighter": 1,
"blue tandem": 1,
"red mountain": 1,
"red scooter": 1
},
"pred_type_counts": {},
"assignment_backend": "scipy_dense",
"cost_functions": [
"mutual_type",
"same_seg"
],
"cost_weights": {
"mutual_type": 1.0,
"same_seg": 1.0
},
"num_frames": 24
},
"scene_metrics": {
"thresholds": [
0.5,
1.0,
2.0,
3.0
],
"counts_by_threshold": {
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"2.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"3.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
}
},
"jaccard_by_threshold": {
"0.5": 0.0,
"1.0": 0.0,
"2.0": 0.0,
"3.0": 0.0
},
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
}
},
"visibility_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_by_motion_group": {
"static": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
}
},
"visibility_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"unknown": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
}
},
"visibility_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"segmentation_counts_by_threshold": {},
"segmentation_precision_by_threshold": {},
"segmentation_recall_by_threshold": {},
"segmentation_f1_by_threshold": {},
"segmentation_frame_average_precision": null,
"segmentation_frame_average_recall": null,
"segmentation_frame_average_f1": null,
"segmentation_first_frame_counts": {},
"segmentation_first_frame_precision": null,
"segmentation_first_frame_recall": null,
"segmentation_first_frame_f1": null,
"segmentation_by_motion_group": {}
},
"per_match_metrics": [],
"interaction_metrics": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 3,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"interaction_supports": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
},
"interaction_matching": {
"matches": [],
"unmatched_target_ids": [
0,
1,
2
],
"unmatched_pred_ids": [],
"target_type_counts": {
"contact": 3
},
"pred_type_counts": {},
"assignment_backend": "scipy_dense",
"cost_functions": [
"type_exact",
"temporal_span",
"input_object_set_mutual_jaccard",
"output_object_set_mutual_jaccard"
],
"cost_weights": {
"type_exact": 1.0,
"temporal_span": 1.0,
"input_object_set_mutual_jaccard": 0.5,
"output_object_set_mutual_jaccard": 0.5
}
},
"per_interaction_match_metrics": [],
"interaction_metrics_by_participants": {
"object_ground": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 3,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"interaction_supports_by_participants": {
"object_ground": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
}
},
"interaction_metrics_by_type": {
"contact": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 3,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"interaction_supports_by_type": {
"contact": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
}
}
}Exact evaluation configuration
{
"predictions_jsonl": "../inference_output.jsonl",
"dataset_json": "../test_data/movi_dump_sentinel_sharegpt.json",
"scene_root": "../test_data/movi_dump",
"output_json": "../evaluation_report.json",
"max_samples": null,
"num_workers": 1,
"show_progress": true,
"log_level": "INFO",
"visibility_filter_mode": "any_frame",
"pos2d_mode": "scaled_normalized",
"pos2d_scale": 1000.0,
"image_width": null,
"image_height": null,
"type_embed_model_name": "all-MiniLM-L6-v2",
"scene_similarity_thresholds": [
0.5,
1.0,
2.0,
3.0
],
"scene_segmentation_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"matching": {
"costs": [
{
"name": "mutual_type",
"weight": 1.0
},
{
"name": "same_seg",
"weight": 1.0,
"missing_value": 1.0,
"kwargs": {
"only_use_first_frame": false
}
}
]
},
"interaction_matching": {
"costs": [
{
"name": "type_exact",
"weight": 1.0
},
{
"name": "temporal_span",
"weight": 1.0
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5
}
]
},
"return_per_sample": true
}