STRIVE · 08/28/2026
Dyn generalization · val_24 · super_clevr_1001
Everything fed into evaluation and the full per-sample output it produced.
Dataset row: exact video + user prompt + assistant target
{
"messages": [
{
"role": "user",
"content": "<video>\nAnalyze the provided video and return ONLY a valid sentinel sequence in this format:\n[SCENE-START] [OBJS-START]\n[OBJ] id \"type\" birth death [VIS] t vis ... [IN-FRAME] t is_in_frame ... [PX] t px py ...\n[OBJ] ...\n[OBJS-END]\n[INTERACTIONS-START]\n[INTERACT] id \"type\" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ...\n[INTERACT] ...\n[INTERACTIONS-END] [SCENE-END]\n\nConstraints:\n- Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose).\n- Keep tags exactly as written:\n `[SCENE-START] [OBJS-START] [OBJ] [VIS] [IN-FRAME] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]`\n- Use quoted strings for `type` (double quotes).\n- `VIS` uses repeated groups of 2 values in order:\n `t vis`.\n `vis` is a boolean value.\n- `IN-FRAME` uses repeated groups of 2 values in order:\n `t is_in_frame`.\n `is_in_frame` is a boolean value.\n- `PX` uses repeated groups of 3 values in order: `t px py`.\n- `px` and `py` are normalized pixel coordinates in the range `[0, 1]`,\n scaled by `1000` and then converted to integers by dropping the decimal part.\n- For occluded or out-of-frame frames under this setting, `PX` may use `t null null`.\n- `IN` and `OUT` contain whitespace-separated integer ids.\n- Use lowercase booleans (`true`/`false`) for `vis` and `is_in_frame`."
},
{
"role": "assistant",
"content": "[SCENE-START] [OBJS-START] [OBJ] 0 \"purple tandem\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 6 768 1 112 766 2 20 766 3 125 764 4 133 761 5 139 760 6 146 759 7 153 758 8 160 756 9 166 756 10 173 755 11 181 753 12 188 752 13 195 751 14 202 750 15 209 749 16 216 748 17 224 747 18 231 746 19 240 744 20 246 743 21 253 742 22 261 741 23 269 740 [OBJ] 1 \"gray dirtbike\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 180 715 10 202 684 [OBJ] 2 \"cyan airliner\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 483 242 2 480 241 5 474 241 7 473 240 9 470 240 11 468 239 14 465 239 17 462 239 18 466 239 19 461 238 20 458 238 [OBJ] 3 \"yellow mountain\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 494 533 1 493 535 2 492 538 4 490 539 5 489 542 6 487 543 7 485 544 8 483 547 10 479 549 12 477 551 13 476 552 14 473 554 16 470 558 18 467 558 19 466 561 20 464 565 21 462 563 22 460 568 [OBJ] 4 \"purple wagon\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 707 593 1 700 595 2 694 597 3 689 598 4 684 599 5 677 601 6 673 601 7 666 603 8 661 604 9 653 606 10 648 607 11 642 608 12 637 609 13 629 613 14 620 616 15 614 617 16 609 617 17 601 619 18 594 621 19 587 623 20 581 623 21 573 625 22 582 621 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACTIONS-END] [SCENE-END]"
}
],
"videos": [
"/mmfs1/gscratch/krishna/suryadv/strive_dynsuperclevr/data/lf/videos/val_24/super_clevr_1001/frames.max_frames_24.mp4"
]
}Inference record: exact prompt + prediction + label + parse debug
{
"prompt": "user\n\nAnalyze the provided video and return ONLY a valid sentinel sequence in this format:\n[SCENE-START] [OBJS-START]\n[OBJ] id \"type\" birth death [VIS] t vis ... [IN-FRAME] t is_in_frame ... [PX] t px py ...\n[OBJ] ...\n[OBJS-END]\n[INTERACTIONS-START]\n[INTERACT] id \"type\" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ...\n[INTERACT] ...\n[INTERACTIONS-END] [SCENE-END]\n\nConstraints:\n- Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose).\n- Keep tags exactly as written:\n `[SCENE-START] [OBJS-START] [OBJ] [VIS] [IN-FRAME] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]`\n- Use quoted strings for `type` (double quotes).\n- `VIS` uses repeated groups of 2 values in order:\n `t vis`.\n `vis` is a boolean value.\n- `IN-FRAME` uses repeated groups of 2 values in order:\n `t is_in_frame`.\n `is_in_frame` is a boolean value.\n- `PX` uses repeated groups of 3 values in order: `t px py`.\n- `px` and `py` are normalized pixel coordinates in the range `[0, 1]`,\n scaled by `1000` and then converted to integers by dropping the decimal part.\n- For occluded or out-of-frame frames under this setting, `PX` may use `t null null`.\n- `IN` and `OUT` contain whitespace-separated integer ids.\n- Use lowercase booleans (`true`/`false`) for `vis` and `is_in_frame`.\nassistant\n",
"predict": "[SCENE-START] [OBJS-START] [OBJ] 0 \"purple and beige wooden dollhouse lamp\" 0 10 [VIS] 0 true 5 false [IN-FRAME] 0 true 5 false [PX] 0 1 767 1 1 783 2 1 798 3 1 814 5 null null [OBJ] 1 \"purple and black cardboard Nintendo 3DS game box\" 0 10 [VIS] 0 true 5 false [IN-FRAME] 0 true 5 false [PX] 0 1 837 1 5 845 2 9 853 3 13 865 4 17 873 5 null null [OBJ] 2 \"purple plastic board game with sleeping figure\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 37 794 1 44 798 2 52 802 3 60 806 4 68 810 5 76 814 6 83 818 7 91 822 8 99 826 9 107 830 10 115 833 11 123 837 12 130 841 13 138 845 14 146 849 15 154 853 16 162 857 17 169 861 18 177 865 19 185 869 20 193 873 21 201 876 22 208 880 23 216 884 [OBJ] 3 \"white and black athletic shoe\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 134 712 3 142 716 5 150 720 8 158 724 11 166 728 13 173 732 15 181 736 17 189 740 20 197 744 22 205 748 23 212 744 [OBJ] 4 \"white and black athletic shoe\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 150 724 3 158 728 5 166 732 8 173 736 11 181 740 14 189 744 16 197 748 19 205 751 22 212 755 23 220 751 [OBJ] 5 \"white and black athletic shoe\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 166 693 4 173 689 8 185 689 12 193 685 15 205 685 19 212 681 22 220 685 23 224 677 [OBJ] 6 \"white and brown leather golf shoe\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 169 705 4 177 701 7 185 705 10 193 708 13 201 712 15 208 716 19 216 712 22 228 716 23 220 708 [OBJ] 7 \"white and brown leather golf shoe\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 177 681 4 185 677 8 193 673 12 205 673 16 212 669 20 224 669 23 232 666 [OBJ] 8 \"white and brown leather golf shoe\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 189 666 3 197 662 7 208 662 11 216 658 15 224 654 19 236 654 22 244 650 [OBJ] 9 \"white and black athletic shoe\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 205 720 1 205 732 2 208 720 3 208 736 4 212 724 5 216 736 6 220 728 7 224 736 8 228 728 9 232 736 10 236 728 11 240 736 12 244 728 13 248 736 14 251 728 15 255 736 16 259 728 17 263 736 18 267 728 19 271 736 20 275 728 21 279 736 22 283 728 23 287 736 [OBJ] 10 \"grey and orange plastic raccoon action figure\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 216 658 3 224 654 7 232 650 10 240 646 13 248 642 16 255 638 19 263 634 22 271 630 23 279 634 [OBJ] 11 \"yellow wooden toy construction vehicle set\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 220 669 3 228 666 6 236 662 9 244 658 12 251 654 15 259 650 18 267 646 21 275 642 23 283 638 [OBJ] 12 \"white and blue athletic shoe\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 228 705 2 236 701 6 248 701 8 251 693 12 263 693 14 267 685 18 279 685 21 287 681 23 294 677 [OBJ] 13 \"yellow plastic candy bar\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 255 677 3 263 673 7 271 669 10 279 666 14 287 662 18 294 658 21 302 654 22 291 654 23 306 650 [OBJ] 14 \"yellow plastic candy bar\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 259 666 4 267 662 8 275 658 12 287 654 16 294 650 19 302 646 22 310 642 [OBJ] 15 \"yellow plastic candy bar\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 287 681 4 294 677 8 306 677 11 314 673 15 322 669 18 330 666 21 337 662 23 345 658 [OBJ] 16 \"yellow plastic candy bar\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 404 650 3 412 646 6 419 642 9 427 638 12 435 634 15 443 630 18 451 626 21 458 623 23 466 619 [OBJ] 17 \"yellow plastic candy bar\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 458 662 4 466 658 7 474 654 10 482 650 13 490 646 16 498 642 19 505 638 22 513 634 23 521 630 [OBJ] 18 \"yellow plastic candy bar\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 486 669 3 494 666 6 501 662 9 509 658 12 517 654 15 525 650 18 533 646 21 541 642 22 548 638 23 541 642 [OBJ] 19 \"teal and lime running shoe\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 505 244 2 498 248 5 494 240 8 482 244 11 478 251 12 470 248 15 466 255 18 458 259 21 455 267 22 447 263 23 451 271 [OBJ] 20 \"purple and light brown wooden toy bathroom set\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 595 673 1 599 666 3 607 662 5 615 658 7 623 654 9 630 650 11 638 646 13 646 642 15 654 638 17 662 634 19 669 630 21 677 626 23 685 623 [OBJ] 21 \"pink and purple soccer cleat\" 0 10 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 634 998 3 null null [OBJ] 22 \"pink and purple plastic package of overnight pads\" 0 10 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 701 998 1 null null [OBJ] 23 \"pink and purple plastic package of overnight pads\" 0 10 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 724 998 1 null null [OBJ] 24 \"purple and light brown wooden toy bathroom set\" 0 10 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 740 998 1 null null [OBJ] 25 \"purple cardboard Operation board game\" 0 10 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 744 994 1 null null [OBJ] 26 \"purple cardboard Operation board game\" 0 10 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 755 998 1 null null [OBJ] 27 \"purple cardboard Operation board game\" 0 10 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 822 998 1 null null [OBJ] 28 \"purple and black cardboard Nintendo 3DS game box\" 0 10 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 978 998 1 null null [OBJS-END] [INTERACTIONS-START] [INTERACT] 30 \"contact\" 0 2 [IN] 26 28 [OUT] 26 28 [INTERACT] 0 \"contact\" 0 10 [IN] 0 1 [OUT] 0 1 [INTERACT] 1 \"contact\" 0 10 [IN] 0 14 [OUT] 0 14 [INTERACT] 2 \"contact\" 0 10 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 3 \"contact\" 0 10 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 28 \"contact\" 0 10 [IN] 23 65535 [OUT] 23 65535 [INTERACT] 29 \"contact\" 0 10 [IN] 24 65535 [OUT] 24 65535 [INTERACT] 31 \"contact\" 0 10 [IN] 27 65535 [OUT] 27 65535 [INTERACT] 32 \"contact\" 0 10 [IN] 28 65535 [OUT] 28 65535 [INTERACT] 13 \"contact\" 0 11 [IN] 17 65535 [OUT] 17 65535 [INTERACT] 14 \"contact\" 0 11 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 15 \"contact\" 0 11 [IN] 19 65535 [OUT] 19 65535 [INTERACT] 16 \"contact\" 0 11 [IN] 20 65535 [OUT] 20 65535 [INTERACT] 17 \"contact\" 0 11 [IN] 21 65535 [OUT] 21 65535 [INTERACT] 18 \"contact\" 0 11 [IN] 22 65535 [OUT] 22 65535 [INTERACT] 8 \"contact\" 0 11 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 9 \"contact\" 0 11 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 10 \"contact\" 0 11 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 11 \"contact\" 0 11 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 12 \"contact\" 0 11 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 19 \"contact\" 0 11 [IN] 23 24 [OUT] 23 24 [INTERACT] 20 \"contact\" 0 11 [IN] 23 25 [OUT] 23 25 [INTERACT] 21 \"contact\" 0 11 [IN] 23 65535 [OUT] 23 65535 [INTERACT] 25 \"contact\" 0 11 [IN] 25 65535 [OUT] 25 65535 [INTERACT] 26 \"contact\" 0 11 [IN] 26 65535 [OUT] 26 65535 [INTERACT] 27 \"contact\" 0 11 [IN] 27 28 [OUT] 27 28 [INTERACT] 4 \"collision\" 3 3 [IN] 1 7 [OUT] 1 7 [INTERACT] 5 \"contact\" 4 5 [IN] 1 7 [OUT] 1 7 [INTERACT] 6 \"collision\" 7 7 [IN] 1 7 [OUT] 1 7 [INTERACT] 7 \"contact\" 8 10 [IN] 1 7 [OUT] 1 7 [INTERACT] 22 \"collision\" 9 9 [IN] 24 65535 [OUT] 24 65535 [INTERACT] 23 \"collision\" 10 10 [IN] 24 65535 [OUT] 24 65535 [INTERACT] 24 \"contact\" 11 12 [IN] 24 65535 [OUT] 24 65535 [INTERACT] 33 \"collision\" 12 12 [IN] 3 6 [OUT] 3 6 [INTERACT] 34 \"contact\" 12 13 [IN] 3 6 [OUT] 3 6 [INTERACT] 35 \"collision\" 13 13 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 36 \"contact\" 14 15 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 37 \"collision\" 17 17 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 38 \"contact\" 18 20 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 20 20 [IN] 4 6 [OUT] 4 6 [INTERACT] 40 \"collision\" 20 20 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 41 \"contact\" 21 22 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 3 \"collision\" 22 22 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 42 \"collision\" 22 22 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 43 \"collision\" 22 22 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 44 \"contact\" 23 24 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 45 \"collision\" 24 24 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 46 \"collision\" 24 24 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 47 \"contact\" 25 26 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 48 \"collision\" 26 26 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 49 \"contact\" 27 28 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 4 \"collision\" 28 28 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 50 \"collision\" 28 28 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 51 \"contact\" 29 30 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 52 \"collision\" 29 29 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 53 \"contact\" 30 10 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 1 \"collision\" 31 31 [IN] 0 14 [OUT] 0 14 [INTERACT] 54 \"collision\" 31 31 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 55 \"contact\" 32 10 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 32 33 [IN] 0 14 [OUT] 0 14 [INTERACT] 39 \"collision\" 33 33 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 56 \"collision\" 33 33 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 1 \"collision\" 35 35 [IN] 0 14 [OUT] 0 14 [INTERACT] 57 \"collision\" 35 35 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 58 \"contact\" 36 10 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 37 37 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"collision\" 38 38 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 1 \"collision\" 39 39 [IN] 0 14 [OUT] 0 14 [INTERACT] 40 \"collision\" 39 39 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 45 \"collision\" 39 39 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 6 \"contact\" 39 10 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 46 \"collision\" 40 40 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 2 \"contact\" 40 41 [IN] 0 14 [OUT] 0 14 [INTERACT] 39 \"collision\" 41 41 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 47 \"collision\" 41 41 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 43 \"collision\" 42 42 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 41 \"collision\" 43 43 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 48 \"collision\" 43 43 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 39 \"collision\" 43 44 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 49 \"collision\" 44 44 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 44 \"contact\" 43 65535 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 42 \"contact\" 44 65535 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 59 \"collision\" 45 45 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 35 \"collision\" 46 46 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 60 \"contact\" 46 65535 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 47 47 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 7 \"collision\" 48 48 [IN] 1 7 [OUT] 1 7 [INTERACT] 36 \"collision\" 48 48 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"contact\" 48 65535 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 5 \"collision\" 49 49 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 7 \"contact\" 49 50 [IN] 1 7 [OUT] 1 7 [INTERACT] 40 \"collision\" 49 50 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 39 \"collision\" 49 50 [IN] 3 9 [OUT] 3 9 [INTERACT] 1 \"collision\" 50 50 [IN] 0 14 [OUT] 0 14 [INTERACT] 51 \"collision\" 51 51 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 52 52 [IN] 3 9 [OUT] 3 9 [INTERACT] 1 \"contact\" 52 65535 [IN] 0 14 [OUT] 0 14 [INTERACT] 52 \"contact\" 52 65535 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 53 \"collision\" 53 53 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 54 54 [IN] 3 9 [OUT] 3 9 [INTERACT] 54 \"contact\" 54 65535 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 51 \"collision\" 56 56 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 56 57 [IN] 3 9 [OUT] 3 9 [INTERACT] 39 \"collision\" 57 57 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 58 58 [IN] 3 8 [OUT] 3 8 [INTERACT] 52 \"collision\" 58 58 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 59 59 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"contact\" 60 65535 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 61 62 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 65 65 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 68 68 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 69 69 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 71 72 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 74 74 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 76 76 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 79 79 [IN] 3 8 [OUT] 3 8 [INTERACT] 4 \"collision\" 83 83 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 39 \"collision\" 83 84 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 8 \"collision\" 84 84 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 11 \"collision\" 84 84 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 12 \"collision\" 84 84 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 13 \"collision\" 84 84 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 14 \"collision\" 84 84 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 15 \"collision\" 84 84 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 16 \"collision\" 84 84 [IN] 17 65535 [OUT] 17 65535 [INTERACT] 17 \"collision\" 84 84 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 18 \"collision\" 84 84 [IN] 19 65535 [OUT] 19 65535 [INTERACT] 19 \"collision\" 84 84 [IN] 20 65535 [OUT] 20 65535 [INTERACT] 20 \"collision\" 84 84 [IN] 21 65535 [OUT] 21 65535 [INTERACT] 21 \"collision\" 84 84 [IN] 22 65535 [OUT] 22 65535 [INTERACT] 9 \"collision\" 84 84 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 4 \"contact\" 84 86 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 41 \"collision\" 85 86 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 45 \"collision\" 86 86 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 46 \"collision\" 86 86 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 39 \"collision\" 88 89 [IN] 3 8 [OUT] 3 8 [INTERACT] 47 \"collision\" 89 89 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 45 \"collision\" 90 90 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 48 \"collision\" 90 90 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 91 91 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 49 \"collision\" 91 91 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 43 \"collision\" 92 92 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 46 \"collision\" 92 92 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 42 \"collision\" 92 93 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 5 \"collision\" 93 93 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 39 \"collision\" 93 93 [IN] 3 8 [OUT] 3 8 [INTERACT] 44 \"contact\" 93 99 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 50 \"collision\" 93 99 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 39 \"collision\" 94 96 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"contact\" 94 103 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 39 \"collision\" 98 98 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"contact\" 99 101 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 101 102 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 104 104 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 106 107 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 109 111 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 114 115 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 119 119 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 123 123 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 126 126 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 130 130 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 133 133 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 137 138 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 141 142 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 145 146 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 149 150 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 154 154 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 158 158 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 162 162 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 166 166 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 169 169 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 173 173 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 177 177 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 181 181 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 185 189 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 189 193 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 193 197 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 201 201 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 205 208 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 212 212 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 216 216 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 220 224 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 228 228 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 232 236 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 240 244 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 244 248 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 251 255 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 255 259 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 263 263 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 271 271 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 275 279 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 283 283 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 291 291 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 298 298 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 306 302 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 314 314 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 322 322 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 330 330 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 337 341 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 345 345 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 353 353 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 361 361 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 369 369 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 376 373 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 384 380 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 392 384 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 396 392 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 404 396 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 412 400 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 419 404 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 427 408 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 435 412 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 443 416 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 451 419 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 458 423 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 466 427 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 474 431 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 482 435 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 490 439 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 498 443 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 505 447 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 513 451 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 521 455 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 529 458 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 537 462 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 544 466 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 552 470 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 560 474 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 568 478 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 576 482 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 583 486 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 591 490 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 599 494 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 607 498 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 615 501 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 623 505 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 630 509 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 638 513 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 646 517 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 654 521 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 662 525 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 669 529 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 677 533 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 685 537 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 693 541 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 701 544 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 708 548 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 716 552 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 724 556 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 732 560 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 740 564 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 748 568 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 755 572 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 763 576 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 771 580 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 779 583 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 787 587 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 794 591 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 802 595 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 810 599 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 818 603 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 826 607 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 833 611 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 841 615 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 849 619 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 857 623 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 865 626 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 873 630 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 880 634 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 888 638 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 896 642 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 904 646 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 912 650 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 919 654 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 927 658 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 935 662 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 943 666 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 951 669 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 958 673 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 1 \"collision\" 101 102 [IN] 0 14 [OUT] 0 14 [INTERACT] 39 \"collision\" 105 102 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 109 106 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 1 \"contact\" 103 104 [IN] 0 14 [OUT] 0 14 [INTERACT] 39 \"collision\" 111 107 [IN] 3 8 [OUT] 3 8 [INTERACT] 1 \"collision\" 115 111 [IN] 0 14 [OUT] 0 14 [INTERACT] 39 \"collision\" 115 119 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 119 111 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 123 115 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 1 \"contact\" 116 123 [IN] 0 14 [OUT] 0 14 [INTERACT] 39 \"collision\" 130 123 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 134 126 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 138 130 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 142 134 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 146 142 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 150 146 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 154 150 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 158 158 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 162 162 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 166 169 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 169 173 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 173 177 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 177 181 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 181 185 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 185 189 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 189 193 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 193 197 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 197 201 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 201 208 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 205 205 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 212 212 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 220 220 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 228 228 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 236 236 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 244 244 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 251 251 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 259 259 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 267 267 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 275 275 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 283 283 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 291 291 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 298 298 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 306 306 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 314 314 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 322 322 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 330 330 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 337 337 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 345 345 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 353 353 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 361 361 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 369 369 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 376 376 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 384 384 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 392 392 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 400 400 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 408 408 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 416 416 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 423 423 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 431 431 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 439 439 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 447 447 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 455 455 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 462 462 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 470 470 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 478 478 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 486 486 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 494 494 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 501 501 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 509 509 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 517 517 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 525 525 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 533 533 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 541 541 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 548 548 [IN] 3 8 [OUT] 3 8 [INTERACT] 39 \"collision\" 556 556 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 564 564 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 39 \"collision\" 572 572 [IN] 3 8 [",
"label": "[SCENE-START] [OBJS-START] [OBJ] 0 \"purple tandem\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 6 768 1 112 766 2 20 766 3 125 764 4 133 761 5 139 760 6 146 759 7 153 758 8 160 756 9 166 756 10 173 755 11 181 753 12 188 752 13 195 751 14 202 750 15 209 749 16 216 748 17 224 747 18 231 746 19 240 744 20 246 743 21 253 742 22 261 741 23 269 740 [OBJ] 1 \"gray dirtbike\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 180 715 10 202 684 [OBJ] 2 \"cyan airliner\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 483 242 2 480 241 5 474 241 7 473 240 9 470 240 11 468 239 14 465 239 17 462 239 18 466 239 19 461 238 20 458 238 [OBJ] 3 \"yellow mountain\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 494 533 1 493 535 2 492 538 4 490 539 5 489 542 6 487 543 7 485 544 8 483 547 10 479 549 12 477 551 13 476 552 14 473 554 16 470 558 18 467 558 19 466 561 20 464 565 21 462 563 22 460 568 [OBJ] 4 \"purple wagon\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 707 593 1 700 595 2 694 597 3 689 598 4 684 599 5 677 601 6 673 601 7 666 603 8 661 604 9 653 606 10 648 607 11 642 608 12 637 609 13 629 613 14 620 616 15 614 617 16 609 617 17 601 619 18 594 621 19 587 623 20 581 623 21 573 625 22 582 621 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACTIONS-END] [SCENE-END]\n",
"parse_debug": {
"pred_parse_valid": false,
"pred_parse_error": "Could not find [SCENE-END] after [SCENE-START].",
"pred_parse_error_type": "ValueError",
"guided_grammar_sha256": "501d31b980c1f9495be86a80917e58d24972e52c4d442eafe69e5c4fc7522dc6",
"guided_grammar_path": "strive_datasets/prep/kubric/scene_repr/profiles/grammars/selector_sentinel_no_3d.lark",
"debug_dir": "/gscratch/krishna/suryadv/strive_dynsuperclevr/runtime/36996079_inference_24/debug/val_24_shard_000/parse_failures/sample_000000",
"guided_grammar_debug_path": "/gscratch/krishna/suryadv/strive_dynsuperclevr/runtime/36996079_inference_24/debug/val_24_shard_000/parse_failures/sample_000000/grammar.ebnf.gz"
}
}Parsed prediction
{
"error": "ValueError: Could not find [SCENE-END] after [SCENE-START]."
}Parsed ground truth
{
"objects": [
{
"id": 0,
"type": "purple tandem",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 6,
"y": 768
},
{
"t": 1,
"x": 112,
"y": 766
},
{
"t": 2,
"x": 20,
"y": 766
},
{
"t": 3,
"x": 125,
"y": 764
},
{
"t": 4,
"x": 133,
"y": 761
},
{
"t": 5,
"x": 139,
"y": 760
},
{
"t": 6,
"x": 146,
"y": 759
},
{
"t": 7,
"x": 153,
"y": 758
},
{
"t": 8,
"x": 160,
"y": 756
},
{
"t": 9,
"x": 166,
"y": 756
},
{
"t": 10,
"x": 173,
"y": 755
},
{
"t": 11,
"x": 181,
"y": 753
},
{
"t": 12,
"x": 188,
"y": 752
},
{
"t": 13,
"x": 195,
"y": 751
},
{
"t": 14,
"x": 202,
"y": 750
},
{
"t": 15,
"x": 209,
"y": 749
},
{
"t": 16,
"x": 216,
"y": 748
},
{
"t": 17,
"x": 224,
"y": 747
},
{
"t": 18,
"x": 231,
"y": 746
},
{
"t": 19,
"x": 240,
"y": 744
},
{
"t": 20,
"x": 246,
"y": 743
},
{
"t": 21,
"x": 253,
"y": 742
},
{
"t": 22,
"x": 261,
"y": 741
},
{
"t": 23,
"x": 269,
"y": 740
}
],
"birth": 0,
"death": 24
},
{
"id": 1,
"type": "gray dirtbike",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 180,
"y": 715
},
{
"t": 10,
"x": 202,
"y": 684
}
],
"birth": 0,
"death": 24
},
{
"id": 2,
"type": "cyan airliner",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 483,
"y": 242
},
{
"t": 2,
"x": 480,
"y": 241
},
{
"t": 5,
"x": 474,
"y": 241
},
{
"t": 7,
"x": 473,
"y": 240
},
{
"t": 9,
"x": 470,
"y": 240
},
{
"t": 11,
"x": 468,
"y": 239
},
{
"t": 14,
"x": 465,
"y": 239
},
{
"t": 17,
"x": 462,
"y": 239
},
{
"t": 18,
"x": 466,
"y": 239
},
{
"t": 19,
"x": 461,
"y": 238
},
{
"t": 20,
"x": 458,
"y": 238
}
],
"birth": 0,
"death": 24
},
{
"id": 3,
"type": "yellow mountain",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 494,
"y": 533
},
{
"t": 1,
"x": 493,
"y": 535
},
{
"t": 2,
"x": 492,
"y": 538
},
{
"t": 4,
"x": 490,
"y": 539
},
{
"t": 5,
"x": 489,
"y": 542
},
{
"t": 6,
"x": 487,
"y": 543
},
{
"t": 7,
"x": 485,
"y": 544
},
{
"t": 8,
"x": 483,
"y": 547
},
{
"t": 10,
"x": 479,
"y": 549
},
{
"t": 12,
"x": 477,
"y": 551
},
{
"t": 13,
"x": 476,
"y": 552
},
{
"t": 14,
"x": 473,
"y": 554
},
{
"t": 16,
"x": 470,
"y": 558
},
{
"t": 18,
"x": 467,
"y": 558
},
{
"t": 19,
"x": 466,
"y": 561
},
{
"t": 20,
"x": 464,
"y": 565
},
{
"t": 21,
"x": 462,
"y": 563
},
{
"t": 22,
"x": 460,
"y": 568
}
],
"birth": 0,
"death": 24
},
{
"id": 4,
"type": "purple wagon",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 707,
"y": 593
},
{
"t": 1,
"x": 700,
"y": 595
},
{
"t": 2,
"x": 694,
"y": 597
},
{
"t": 3,
"x": 689,
"y": 598
},
{
"t": 4,
"x": 684,
"y": 599
},
{
"t": 5,
"x": 677,
"y": 601
},
{
"t": 6,
"x": 673,
"y": 601
},
{
"t": 7,
"x": 666,
"y": 603
},
{
"t": 8,
"x": 661,
"y": 604
},
{
"t": 9,
"x": 653,
"y": 606
},
{
"t": 10,
"x": 648,
"y": 607
},
{
"t": 11,
"x": 642,
"y": 608
},
{
"t": 12,
"x": 637,
"y": 609
},
{
"t": 13,
"x": 629,
"y": 613
},
{
"t": 14,
"x": 620,
"y": 616
},
{
"t": 15,
"x": 614,
"y": 617
},
{
"t": 16,
"x": 609,
"y": 617
},
{
"t": 17,
"x": 601,
"y": 619
},
{
"t": 18,
"x": 594,
"y": 621
},
{
"t": 19,
"x": 587,
"y": 623
},
{
"t": 20,
"x": 581,
"y": 623
},
{
"t": 21,
"x": 573,
"y": 625
},
{
"t": 22,
"x": 582,
"y": 621
}
],
"birth": 0,
"death": 24
}
],
"interactions": [
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
}
]
}Complete per-sample evaluator report
{
"metrics": {
"avg_type_similarity": null,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": null,
"avg_image_position_segmentation_acc": null,
"avg_image_position_segmentation_acc_small": null,
"avg_image_position_segmentation_acc_medium": null,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": null,
"avg_image_position_segmentation_visible_acc": null,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": null,
"visibility_true_acc": null,
"visibility_false_acc": null,
"is_in_frame_acc": null,
"is_in_frame_true_acc": null,
"is_in_frame_false_acc": null,
"vis_acc_from_px": null,
"vis_acc_from_px_true_acc": null,
"vis_acc_from_px_false_acc": null,
"num_matches": 0,
"num_unmatched_pred": 0,
"num_unmatched_target": 5
},
"supports": {
"avg_type_similarity": 0,
"avg_size_diff": 0,
"avg_3d_iou": 0,
"avg_image_position_px_diff": 0,
"avg_image_position_segmentation_acc": 0,
"avg_image_position_segmentation_acc_small": 0,
"avg_image_position_segmentation_acc_medium": 0,
"avg_image_position_segmentation_acc_large": 0,
"avg_image_position_segmentation_acc_first_frame": 0,
"avg_image_position_segmentation_visible_acc": 0,
"avg_quaternion_geodesic_deg": 0,
"visibility_acc": 0,
"visibility_true_acc": 0,
"visibility_false_acc": 0,
"is_in_frame_acc": 0,
"is_in_frame_true_acc": 0,
"is_in_frame_false_acc": 0,
"vis_acc_from_px": 0,
"vis_acc_from_px_true_acc": 0,
"vis_acc_from_px_false_acc": 0
},
"matching": {
"matches": [],
"unmatched_target_ids": [
0,
1,
2,
3,
4
],
"unmatched_pred_ids": [],
"target_type_counts": {
"purple tandem": 1,
"gray dirtbike": 1,
"cyan airliner": 1,
"yellow mountain": 1,
"purple wagon": 1
},
"pred_type_counts": {},
"assignment_backend": "scipy_dense",
"cost_functions": [
"mutual_type",
"same_seg"
],
"cost_weights": {
"mutual_type": 1.0,
"same_seg": 1.0
},
"num_frames": 24
},
"scene_metrics": {
"thresholds": [
0.5,
1.0,
2.0,
3.0
],
"counts_by_threshold": {
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"2.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"3.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
}
},
"jaccard_by_threshold": {
"0.5": 0.0,
"1.0": 0.0,
"2.0": 0.0,
"3.0": 0.0
},
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
}
},
"visibility_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_by_motion_group": {
"static": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
}
},
"visibility_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"unknown": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
}
},
"visibility_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"segmentation_counts_by_threshold": {},
"segmentation_precision_by_threshold": {},
"segmentation_recall_by_threshold": {},
"segmentation_f1_by_threshold": {},
"segmentation_frame_average_precision": null,
"segmentation_frame_average_recall": null,
"segmentation_frame_average_f1": null,
"segmentation_first_frame_counts": {},
"segmentation_first_frame_precision": null,
"segmentation_first_frame_recall": null,
"segmentation_first_frame_f1": null,
"segmentation_by_motion_group": {}
},
"per_match_metrics": [],
"interaction_metrics": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 4,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"interaction_supports": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
},
"interaction_matching": {
"matches": [],
"unmatched_target_ids": [
0,
1,
2,
3
],
"unmatched_pred_ids": [],
"target_type_counts": {
"contact": 4
},
"pred_type_counts": {},
"assignment_backend": "scipy_dense",
"cost_functions": [
"type_exact",
"temporal_span",
"input_object_set_mutual_jaccard",
"output_object_set_mutual_jaccard"
],
"cost_weights": {
"type_exact": 1.0,
"temporal_span": 1.0,
"input_object_set_mutual_jaccard": 0.5,
"output_object_set_mutual_jaccard": 0.5
}
},
"per_interaction_match_metrics": [],
"interaction_metrics_by_participants": {
"object_ground": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 4,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"interaction_supports_by_participants": {
"object_ground": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
}
},
"interaction_metrics_by_type": {
"contact": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 4,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"interaction_supports_by_type": {
"contact": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
}
}
}Exact evaluation configuration
{
"predictions_jsonl": "../inference_output.jsonl",
"dataset_json": "../test_data/movi_dump_sentinel_sharegpt.json",
"scene_root": "../test_data/movi_dump",
"output_json": "../evaluation_report.json",
"max_samples": null,
"num_workers": 1,
"show_progress": true,
"log_level": "INFO",
"visibility_filter_mode": "any_frame",
"pos2d_mode": "scaled_normalized",
"pos2d_scale": 1000.0,
"image_width": null,
"image_height": null,
"type_embed_model_name": "all-MiniLM-L6-v2",
"scene_similarity_thresholds": [
0.5,
1.0,
2.0,
3.0
],
"scene_segmentation_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"matching": {
"costs": [
{
"name": "mutual_type",
"weight": 1.0
},
{
"name": "same_seg",
"weight": 1.0,
"missing_value": 1.0,
"kwargs": {
"only_use_first_frame": false
}
}
]
},
"interaction_matching": {
"costs": [
{
"name": "type_exact",
"weight": 1.0
},
{
"name": "temporal_span",
"weight": 1.0
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5
}
]
},
"return_per_sample": true
}