STRIVE · 08/28/2026
Dyn generalization · val_24 · super_clevr_1055
Everything fed into evaluation and the full per-sample output it produced.
Dataset row: exact video + user prompt + assistant target
{
"messages": [
{
"role": "user",
"content": "<video>\nAnalyze the provided video and return ONLY a valid sentinel sequence in this format:\n[SCENE-START] [OBJS-START]\n[OBJ] id \"type\" birth death [VIS] t vis ... [IN-FRAME] t is_in_frame ... [PX] t px py ...\n[OBJ] ...\n[OBJS-END]\n[INTERACTIONS-START]\n[INTERACT] id \"type\" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ...\n[INTERACT] ...\n[INTERACTIONS-END] [SCENE-END]\n\nConstraints:\n- Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose).\n- Keep tags exactly as written:\n `[SCENE-START] [OBJS-START] [OBJ] [VIS] [IN-FRAME] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]`\n- Use quoted strings for `type` (double quotes).\n- `VIS` uses repeated groups of 2 values in order:\n `t vis`.\n `vis` is a boolean value.\n- `IN-FRAME` uses repeated groups of 2 values in order:\n `t is_in_frame`.\n `is_in_frame` is a boolean value.\n- `PX` uses repeated groups of 3 values in order: `t px py`.\n- `px` and `py` are normalized pixel coordinates in the range `[0, 1]`,\n scaled by `1000` and then converted to integers by dropping the decimal part.\n- For occluded or out-of-frame frames under this setting, `PX` may use `t null null`.\n- `IN` and `OUT` contain whitespace-separated integer ids.\n- Use lowercase booleans (`true`/`false`) for `vis` and `is_in_frame`."
},
{
"role": "assistant",
"content": "[SCENE-START] [OBJS-START] [OBJ] 0 \"yellow fighter\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 97 34 1 107 36 2 30 40 3 37 46 4 55 49 5 68 51 6 75 52 7 83 53 8 96 55 9 104 56 10 117 58 11 125 59 12 138 61 13 149 64 14 163 70 15 176 75 16 190 80 17 202 85 18 216 91 19 227 96 20 238 100 21 251 105 22 261 109 23 273 115 [OBJ] 1 \"purple jet\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 446 103 1 445 106 2 445 109 3 444 113 5 448 83 6 444 121 7 448 89 9 442 129 10 447 96 11 442 134 12 447 101 13 442 139 14 448 104 15 448 109 16 443 145 17 448 117 19 444 150 21 448 155 22 444 159 23 444 161 [OBJ] 2 \"brown minivan\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 460 616 2 462 617 4 463 619 5 465 620 7 466 622 9 469 623 11 471 625 12 473 626 14 476 628 16 477 630 18 479 632 19 481 633 21 483 635 23 486 638 [OBJ] 3 \"blue truck\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 643 710 [OBJ] 4 \"brown sedan\" 1 24 [VIS] 0 false 1 true [IN-FRAME] 0 false 1 true [PX] 0 null null 1 5 861 2 11 853 3 18 854 4 24 857 5 36 857 6 30 858 7 33 860 8 48 858 9 61 856 10 33 848 11 36 844 12 38 841 13 40 840 15 48 836 16 54 835 17 61 834 18 91 829 19 42 846 20 53 846 21 67 842 22 80 840 23 91 838 [OBJS-END] [INTERACTIONS-START] [INTERACT] 1 \"contact\" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 0 \"collision\" 1 1 [IN] 0 1 [OUT] 0 1 [INTERACTIONS-END] [SCENE-END]"
}
],
"videos": [
"/mmfs1/gscratch/krishna/suryadv/strive_dynsuperclevr/data/lf/videos/val_24/super_clevr_1055/frames.max_frames_24.mp4"
]
}Inference record: exact prompt + prediction + label + parse debug
{
"prompt": "user\n\nAnalyze the provided video and return ONLY a valid sentinel sequence in this format:\n[SCENE-START] [OBJS-START]\n[OBJ] id \"type\" birth death [VIS] t vis ... [IN-FRAME] t is_in_frame ... [PX] t px py ...\n[OBJ] ...\n[OBJS-END]\n[INTERACTIONS-START]\n[INTERACT] id \"type\" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ...\n[INTERACT] ...\n[INTERACTIONS-END] [SCENE-END]\n\nConstraints:\n- Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose).\n- Keep tags exactly as written:\n `[SCENE-START] [OBJS-START] [OBJ] [VIS] [IN-FRAME] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]`\n- Use quoted strings for `type` (double quotes).\n- `VIS` uses repeated groups of 2 values in order:\n `t vis`.\n `vis` is a boolean value.\n- `IN-FRAME` uses repeated groups of 2 values in order:\n `t is_in_frame`.\n `is_in_frame` is a boolean value.\n- `PX` uses repeated groups of 3 values in order: `t px py`.\n- `px` and `py` are normalized pixel coordinates in the range `[0, 1]`,\n scaled by `1000` and then converted to integers by dropping the decimal part.\n- For occluded or out-of-frame frames under this setting, `PX` may use `t null null`.\n- `IN` and `OUT` contain whitespace-separated integer ids.\n- Use lowercase booleans (`true`/`false`) for `vis` and `is_in_frame`.\nassistant\n",
"predict": "[SCENE-START] [OBJS-START] [OBJ] 0 \"pink and purple soccer cleat\" 0 1 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 1 849 1 9 888 2 17 896 3 null null [OBJ] 1 \"yellow cardboard curl cream box\" 0 1 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 1 876 1 5 904 2 null null [OBJ] 2 \"yellow cardboard curl cream box\" 0 1 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 9 91 1 1 83 2 1 95 3 null null [OBJ] 3 \"yellow cardboard curl cream box\" 0 1 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 9 962 1 5 982 2 null null [OBJ] 4 \"yellow cardboard curl cream box\" 0 2 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 13 982 1 21 990 3 null null [OBJ] 5 \"yellow cardboard curl cream box\" 0 10 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 17 994 1 25 990 3 null null [OBJ] 6 \"yellow cardboard curl cream box\" 0 11 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 17 978 2 13 994 3 null null [OBJ] 7 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 17 990 1 25 994 2 21 982 3 null null [OBJ] 8 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 17 994 3 null null [OBJ] 9 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 21 978 2 13 994 3 null null [OBJ] 10 \"wooden toy vegetable cutting set\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 25 849 1 21 861 2 13 869 3 null null [OBJ] 11 \"yellow1 metallic session coffee can\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 25 994 1 33 998 3 null null [OBJ] 12 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 29 990 2 25 998 3 null null [OBJ] 13 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 41 994 1 48 998 3 null null [OBJ] 14 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 48 994 1 56 998 3 null null [OBJ] 15 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 49 998 1 52 845 2 48 853 3 null null [OBJ] 16 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 52 998 2 44 994 3 null null [OBJ] 17 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 60 994 2 52 998 3 null null [OBJ] 18 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 68 994 2 60 998 3 null null [OBJ] 19 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 80 994 2 72 998 3 null null [OBJ] 20 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 83 990 2 76 994 3 null null [OBJ] 21 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 91 994 2 83 998 3 null null [OBJ] 22 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 95 998 1 103 994 3 null null [OBJ] 23 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 99 994 2 91 998 3 null null [OBJ] 24 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 107 998 1 115 994 3 null null [OBJ] 25 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 115 994 2 107 998 3 null null [OBJ] 26 \"yellow plastic plant pot\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 130 994 2 123 998 3 null null [OBJ] 27 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 142 994 2 134 998 3 null null [OBJ] 28 \"yellow plastic plant pot\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 150 998 2 142 994 3 null null [OBJ] 29 \"yellow plastic plant pot\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 158 994 2 150 998 3 null null [OBJ] 30 \"yellow plastic plant pot\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 162 990 2 154 994 3 null null [OBJ] 31 \"yellow plastic plant pot\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 173 994 2 162 994 3 null null [OBJ] 32 \"yellow plastic plant pot\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 185 994 2 177 998 3 null null [OBJ] 33 \"yellow plastic toy school bus\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 201 994 2 189 994 3 null null [OBJ] 34 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 216 994 2 208 998 3 null null [OBJ] 35 \"yellow cardboard curl cream box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 224 994 2 216 998 3 null null [OBJ] 36 \"yellow plastic plant pot\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 232 994 2 224 998 3 null null [OBJ] 37 \"yellow plastic plant pot\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 244 994 2 236 998 3 null null [OBJ] 38 \"yellow plastic Game Boy cartridge\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 251 994 2 244 998 3 null null [OBJ] 39 \"yellow plastic plant pot\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 255 998 2 248 994 3 null null [OBJ] 40 \"yellow plastic plant pot\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 271 994 2 263 998 3 null null [OBJ] 41 \"yellow plastic Game Boy cartridge\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 279 994 2 271 998 3 null null [OBJ] 42 \"yellow plastic Game Boy cartridge\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 291 994 2 283 998 3 null null [OBJ] 43 \"yellow plastic Game Boy cartridge\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 302 994 2 294 998 3 null null [OBJ] 44 \"yellow plastic Game Boy cartridge\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 314 994 2 306 998 3 null null [OBJ] 45 \"blue and yellow basketball shoe\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 330 994 2 322 998 3 null null [OBJ] 46 \"blue and white athletic shoe\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 345 994 2 337 998 3 null null [OBJ] 47 \"blue and black plastic DVD set\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 361 994 2 353 998 3 null null [OBJ] 48 \"blue and white striped fabric dishtowel\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 373 994 2 365 998 3 null null [OBJ] 49 \"grey and white plastic shark figurine\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 392 994 2 384 998 3 null null [OBJ] 50 \"black and grey athletic shoe\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 400 994 3 null null [OBJ] 51 \"blue and black plastic DVD set\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 416 994 2 408 998 3 null null [OBJ] 52 \"orange vitamin D3 liquid box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 431 994 3 null null [OBJ] 53 \"yellow plastic toy school bus\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 462 623 2 470 634 4 478 642 5 478 630 7 482 638 8 490 650 10 494 642 11 501 654 12 505 662 13 505 650 14 509 658 15 513 666 16 513 650 17 517 658 18 521 666 19 521 654 20 525 662 21 529 669 22 529 654 23 533 662 [OBJ] 54 \"light blue plastic conditioner tube\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 474 994 3 null null [OBJ] 55 \"blue and green cardboard candy bar box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 517 994 3 null null [OBJ] 56 \"blue and green plastic snack cup\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 525 994 3 null null [OBJ] 57 \"blue and green plastic snack cup\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 544 994 3 null null [OBJ] 58 \"light blue plastic conditioner tube\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 556 994 3 null null [OBJ] 59 \"purple and pink athletic shoe\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 564 994 3 null null [OBJ] 60 \"blue and green cardboard candy bar box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 583 994 3 null null [OBJ] 61 \"light blue plastic conditioner tube\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 591 994 3 null null [OBJ] 62 \"light blue plastic conditioner tube\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 603 994 3 null null [OBJ] 63 \"light blue plastic conditioner tube\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 611 990 3 null null [OBJ] 64 \"blue wooden toy kitchen set\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 630 990 3 null null [OBJ] 65 \"white cardboard ink cartridge box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 638 990 2 630 994 3 null null [OBJ] 66 \"light blue plastic conditioner tube\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 646 994 3 null null [OBJ] 67 \"blue and red running shoe\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 669 990 3 null null [OBJ] 68 \"purple and black cardboard Nintendo 3DS game box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 685 990 3 null null [OBJ] 69 \"blue wooden toy kitchen set\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 701 990 3 null null [OBJ] 70 \"blue and red running shoe\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 720 990 2 712 994 3 null null [OBJ] 71 \"blue and white cardboard snack cake box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 728 986 3 null null [OBJ] 72 \"blue and green cardboard candy bar box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 833 560 3 null null [OBJ] 73 \"blue and green cardboard candy bar box\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 865 564 3 null null [OBJ] 74 \"pink and purple wooden toy castle\" 0 12 [VIS] 0 true 3 false [IN-FRAME] 0 true 3 false [PX] 0 998 580 3 null null [OBJ] 75 \"black and yellow rubber mallet\" 0 12 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 998 994 1 null null [OBJ] 76 \"black plastic keyboard\" 0 12 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 998 998 1 null null [OBJ] 77 \"yellow cardboard curl cream box\" 1 12 [VIS] 0 false 1 true 4 false [IN-FRAME] 0 false 1 true 4 false [PX] 0 null null 1 5 849 2 1 837 4 null null [OBJ] 78 \"yellow plastic plant pot\" 1 12 [VIS] 0 false 1 true 4 false [IN-FRAME] 0 false 1 true 4 false [PX] 0 null null 1 5 13 2 9 25 3 17 41 4 null null [OBJ] 79 \"yellow cardboard curl cream box\" 2 12 [VIS] 0 false 2 true 5 false [IN-FRAME] 0 false 2 true 5 false [PX] 0 null null 2 1 873 3 1 861 5 null null [OBJ] 80 \"yellow cardboard curl cream box\" 3 12 [VIS] 0 false 3 true 5 false [IN-FRAME] 0 false 3 true 5 false [PX] 0 null null 3 1 884 4 1 873 5 null null [OBJ] 81 \"yellow plastic plant pot\" 5 12 [VIS] 0 false 5 true 6 false [IN-FRAME] 0 false 5 true 6 false [PX] 0 null null 5 1 998 6 null null [OBJ] 82 \"yellow plastic plant pot\" 6 12 [VIS] 0 false 6 true 9 false [IN-FRAME] 0 false 6 true 9 false [PX] 0 null null 6 1 998 8 1 986 9 null null [OBJ] 83 \"yellow plastic plant pot\" 7 12 [VIS] 0 false 7 true 9 false [IN-FRAME] 0 false 7 true 9 false [PX] 0 null null 7 1 998 9 null null [OBJ] 84 \"yellow plastic plant pot\" 9 12 [VIS] 0 false 9 true 10 false [IN-FRAME] 0 false 9 true 10 false [PX] 0 null null 9 1 998 10 null null [OBJ] 85 \"yellow plastic plant pot\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 1 998 12 null null [OBJ] 86 \"yellow plastic plant pot\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 1 994 12 null null [OBJ] 87 \"yellow cardboard curl cream box\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 1 998 12 null null [OBJ] 88 \"yellow plastic plant pot\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 1 830 12 null null [OBJ] 89 \"yellow plastic plant pot\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 1 845 12 null null [OBJ] 90 \"yellow plastic plant pot\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 1 994 12 null null [OBJ] 91 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 5 998 12 null null [OBJ] 92 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 13 888 12 null null [OBJ] 93 \"yellow plastic plant pot\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 17 998 12 null null [OBJ] 94 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 29 998 12 null null [OBJ] 95 \"yellow plastic plant pot\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 37 994 12 null null [OBJ] 96 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 48 994 12 null null [OBJ] 97 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 56 994 12 null null [OBJ] 98 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 64 990 12 null null [OBJ] 99 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 72 990 12 null null [OBJ] 100 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 80 994 12 null null [OBJ] 101 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 91 990 12 null null [OBJ] 102 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 99 994 12 null null [OBJ] 103 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 111 990 12 null null [OBJ] 104 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 119 990 12 null null [OBJ] 105 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 126 994 12 null null [OBJ] 106 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 134 994 12 null null [OBJ] 107 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 146 990 12 null null [OBJ] 108 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 154 986 12 null null [OBJ] 109 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 162 982 12 null null [OBJ] 110 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 173 978 12 null null [OBJ] 111 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 181 974 12 null null [OBJ] 112 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 193 974 12 null null [OBJ] 113 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 205 970 12 null null [OBJ] 114 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 212 966 12 null null [OBJ] 115 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 224 962 12 null null [OBJ] 116 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 232 958 12 null null [OBJ] 117 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 244 955 12 null null [OBJ] 118 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 255 951 12 null null [OBJ] 119 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 263 947 12 null null [OBJ] 120 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 275 943 12 null null [OBJ] 121 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 283 939 12 null null [OBJ] 122 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 294 935 12 null null [OBJ] 123 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 306 931 12 null null [OBJ] 124 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 318 927 12 null null [OBJ] 125 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 330 923 12 null null [OBJ] 126 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 341 919 12 null null [OBJ] 127 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 353 916 12 null null [OBJ] 128 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 365 912 12 null null [OBJ] 129 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 373 908 12 null null [OBJ] 130 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 384 904 12 null null [OBJ] 131 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 392 896 12 null null [OBJ] 132 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 400 888 12 null null [OBJ] 133 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 412 884 12 null null [OBJ] 134 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 419 876 12 null null [OBJ] 135 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 431 873 12 null null [OBJ] 136 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 439 865 12 null null [OBJ] 137 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 451 861 12 null null [OBJ] 138 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 458 853 12 null null [OBJ] 139 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 470 849 12 null null [OBJ] 140 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 478 841 12 null null [OBJ] 141 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 486 837 12 null null [OBJ] 142 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 494 833 12 null null [OBJ] 143 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 501 826 12 null null [OBJ] 144 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 509 822 12 null null [OBJ] 145 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 517 818 12 null null [OBJ] 146 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 525 814 12 null null [OBJ] 147 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 533 810 12 null null [OBJ] 148 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 541 806 12 null null [OBJ] 149 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 548 798 12 null null [OBJ] 150 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 556 794 12 null null [OBJ] 151 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 564 791 12 null null [OBJ] 152 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 572 787 12 null null [OBJ] 153 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 580 783 12 null null [OBJ] 154 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 587 779 12 null null [OBJ] 155 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 595 775 12 null null [OBJ] 156 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 603 771 12 null null [OBJ] 157 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 611 767 12 null null [OBJ] 158 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 619 763 12 null null [OBJ] 159 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 626 759 12 null null [OBJ] 160 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 634 755 12 null null [OBJ] 161 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 642 751 12 null null [OBJ] 162 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 650 748 12 null null [OBJ] 163 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 658 744 12 null null [OBJ] 164 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 666 740 12 null null [OBJ] 165 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 673 736 12 null null [OBJ] 166 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 681 732 12 null null [OBJ] 167 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 689 728 12 null null [OBJ] 168 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 697 724 12 null null [OBJ] 169 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 705 720 12 null null [OBJ] 170 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 712 716 12 null null [OBJ] 171 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 720 712 12 null null [OBJ] 172 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 728 708 12 null null [OBJ] 173 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 736 705 12 null null [OBJ] 174 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 744 697 12 null null [OBJ] 175 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 751 693 12 null null [OBJ] 176 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 759 689 12 null null [OBJ] 177 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 767 685 12 null null [OBJ] 178 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 775 681 12 null null [OBJ] 179 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 783 677 12 null null [OBJ] 180 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 791 673 12 null null [OBJ] 181 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 798 669 12 null null [OBJ] 182 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 806 666 12 null null [OBJ] 183 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 814 662 12 null null [OBJ] 184 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 822 658 12 null null [OBJ] 185 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 830 654 12 null null [OBJ] 186 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 837 650 12 null null [OBJ] 187 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 845 646 12 null null [OBJ] 188 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 853 642 12 null null [OBJ] 189 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 861 638 12 null null [OBJ] 190 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 869 634 12 null null [OBJ] 191 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 876 630 12 null null [OBJ] 192 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 884 626 12 null null [OBJ] 193 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 892 623 12 null null [OBJ] 194 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 900 619 12 null null [OBJ] 195 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 908 615 12 null null [OBJ] 196 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 916 611 12 null null [OBJ] 197 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 923 607 12 null null [OBJ] 198 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 931 603 12 null null [OBJ] 199 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 939 599 12 null null [OBJ] 200 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 947 595 12 null null [OBJ] 201 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 955 591 12 null null [OBJ] 202 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 962 587 12 null null [OBJ] 203 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 970 583 12 null null [OBJ] 204 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 11 978 580 12 null null [OBJ] 205 \"yellow plastic Game Boy cartridge\" 11 12 [VIS] 0 false 11 true 12 false [IN-FRAME] 0 false 11 true 12 false [PX] 0 null null 12 990 576 13 null null [OBJ] 206 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 994 994 13 null null [OBJ] 207 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 998 990 13 null null [OBJ] 208 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 998 998 13 null null [OBJ] 209 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 998 990 13 null null [OBJ] 210 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 998 998 13 null null [OBJ] 211 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 998 986 13 null null [OBJ] 212 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 998 994 13 null null [OBJ] 213 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 998 982 13 null null [OBJ] 214 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 998 998 13 null null [OBJ] 215 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 998 990 13 null null [OBJ] 216 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 994 994 13 null null [OBJ] 217 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 994 982 13 null null [OBJ] 218 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 994 994 13 null null [OBJ] 219 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 990 998 13 null null [OBJ] 220 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 990 990 13 null null [OBJ] 221 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 986 994 13 null null [OBJ] 222 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 986 986 13 null null [OBJ] 223 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 982 994 13 null null [OBJ] 224 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 978 998 13 null null [OBJ] 225 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 974 990 13 null null [OBJ] 226 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 970 994 13 null null [OBJ] 227 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 966 998 13 null null [OBJ] 228 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 962 990 13 null null [OBJ] 229 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 958 998 13 null null [OBJ] 230 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN-FRAME] 0 false 12 true 13 false [PX] 0 null null 12 955 994 13 null null [OBJ] 231 \"yellow plastic Game Boy cartridge\" 12 12 [VIS] 0 false 12 true 13 false [IN",
"label": "[SCENE-START] [OBJS-START] [OBJ] 0 \"yellow fighter\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 97 34 1 107 36 2 30 40 3 37 46 4 55 49 5 68 51 6 75 52 7 83 53 8 96 55 9 104 56 10 117 58 11 125 59 12 138 61 13 149 64 14 163 70 15 176 75 16 190 80 17 202 85 18 216 91 19 227 96 20 238 100 21 251 105 22 261 109 23 273 115 [OBJ] 1 \"purple jet\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 446 103 1 445 106 2 445 109 3 444 113 5 448 83 6 444 121 7 448 89 9 442 129 10 447 96 11 442 134 12 447 101 13 442 139 14 448 104 15 448 109 16 443 145 17 448 117 19 444 150 21 448 155 22 444 159 23 444 161 [OBJ] 2 \"brown minivan\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 460 616 2 462 617 4 463 619 5 465 620 7 466 622 9 469 623 11 471 625 12 473 626 14 476 628 16 477 630 18 479 632 19 481 633 21 483 635 23 486 638 [OBJ] 3 \"blue truck\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 643 710 [OBJ] 4 \"brown sedan\" 1 24 [VIS] 0 false 1 true [IN-FRAME] 0 false 1 true [PX] 0 null null 1 5 861 2 11 853 3 18 854 4 24 857 5 36 857 6 30 858 7 33 860 8 48 858 9 61 856 10 33 848 11 36 844 12 38 841 13 40 840 15 48 836 16 54 835 17 61 834 18 91 829 19 42 846 20 53 846 21 67 842 22 80 840 23 91 838 [OBJS-END] [INTERACTIONS-START] [INTERACT] 1 \"contact\" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 2 \"contact\" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 3 \"contact\" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 0 \"collision\" 1 1 [IN] 0 1 [OUT] 0 1 [INTERACTIONS-END] [SCENE-END]\n",
"parse_debug": {
"pred_parse_valid": false,
"pred_parse_error": "Could not find [SCENE-END] after [SCENE-START].",
"pred_parse_error_type": "ValueError",
"guided_grammar_sha256": "501d31b980c1f9495be86a80917e58d24972e52c4d442eafe69e5c4fc7522dc6",
"guided_grammar_path": "strive_datasets/prep/kubric/scene_repr/profiles/grammars/selector_sentinel_no_3d.lark",
"debug_dir": "/gscratch/krishna/suryadv/strive_dynsuperclevr/runtime/36996079_inference_24/debug/val_24_shard_002/parse_failures/sample_000005",
"guided_grammar_debug_path": "/gscratch/krishna/suryadv/strive_dynsuperclevr/runtime/36996079_inference_24/debug/val_24_shard_002/parse_failures/sample_000005/grammar.ebnf.gz"
}
}Parsed prediction
{
"error": "ValueError: Could not find [SCENE-END] after [SCENE-START]."
}Parsed ground truth
{
"objects": [
{
"id": 0,
"type": "yellow fighter",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 97,
"y": 34
},
{
"t": 1,
"x": 107,
"y": 36
},
{
"t": 2,
"x": 30,
"y": 40
},
{
"t": 3,
"x": 37,
"y": 46
},
{
"t": 4,
"x": 55,
"y": 49
},
{
"t": 5,
"x": 68,
"y": 51
},
{
"t": 6,
"x": 75,
"y": 52
},
{
"t": 7,
"x": 83,
"y": 53
},
{
"t": 8,
"x": 96,
"y": 55
},
{
"t": 9,
"x": 104,
"y": 56
},
{
"t": 10,
"x": 117,
"y": 58
},
{
"t": 11,
"x": 125,
"y": 59
},
{
"t": 12,
"x": 138,
"y": 61
},
{
"t": 13,
"x": 149,
"y": 64
},
{
"t": 14,
"x": 163,
"y": 70
},
{
"t": 15,
"x": 176,
"y": 75
},
{
"t": 16,
"x": 190,
"y": 80
},
{
"t": 17,
"x": 202,
"y": 85
},
{
"t": 18,
"x": 216,
"y": 91
},
{
"t": 19,
"x": 227,
"y": 96
},
{
"t": 20,
"x": 238,
"y": 100
},
{
"t": 21,
"x": 251,
"y": 105
},
{
"t": 22,
"x": 261,
"y": 109
},
{
"t": 23,
"x": 273,
"y": 115
}
],
"birth": 0,
"death": 24
},
{
"id": 1,
"type": "purple jet",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 446,
"y": 103
},
{
"t": 1,
"x": 445,
"y": 106
},
{
"t": 2,
"x": 445,
"y": 109
},
{
"t": 3,
"x": 444,
"y": 113
},
{
"t": 5,
"x": 448,
"y": 83
},
{
"t": 6,
"x": 444,
"y": 121
},
{
"t": 7,
"x": 448,
"y": 89
},
{
"t": 9,
"x": 442,
"y": 129
},
{
"t": 10,
"x": 447,
"y": 96
},
{
"t": 11,
"x": 442,
"y": 134
},
{
"t": 12,
"x": 447,
"y": 101
},
{
"t": 13,
"x": 442,
"y": 139
},
{
"t": 14,
"x": 448,
"y": 104
},
{
"t": 15,
"x": 448,
"y": 109
},
{
"t": 16,
"x": 443,
"y": 145
},
{
"t": 17,
"x": 448,
"y": 117
},
{
"t": 19,
"x": 444,
"y": 150
},
{
"t": 21,
"x": 448,
"y": 155
},
{
"t": 22,
"x": 444,
"y": 159
},
{
"t": 23,
"x": 444,
"y": 161
}
],
"birth": 0,
"death": 24
},
{
"id": 2,
"type": "brown minivan",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 460,
"y": 616
},
{
"t": 2,
"x": 462,
"y": 617
},
{
"t": 4,
"x": 463,
"y": 619
},
{
"t": 5,
"x": 465,
"y": 620
},
{
"t": 7,
"x": 466,
"y": 622
},
{
"t": 9,
"x": 469,
"y": 623
},
{
"t": 11,
"x": 471,
"y": 625
},
{
"t": 12,
"x": 473,
"y": 626
},
{
"t": 14,
"x": 476,
"y": 628
},
{
"t": 16,
"x": 477,
"y": 630
},
{
"t": 18,
"x": 479,
"y": 632
},
{
"t": 19,
"x": 481,
"y": 633
},
{
"t": 21,
"x": 483,
"y": 635
},
{
"t": 23,
"x": 486,
"y": 638
}
],
"birth": 0,
"death": 24
},
{
"id": 3,
"type": "blue truck",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 643,
"y": 710
}
],
"birth": 0,
"death": 24
},
{
"id": 4,
"type": "brown sedan",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 1,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": false
},
{
"t": 1,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 1,
"x": 5,
"y": 861
},
{
"t": 2,
"x": 11,
"y": 853
},
{
"t": 3,
"x": 18,
"y": 854
},
{
"t": 4,
"x": 24,
"y": 857
},
{
"t": 5,
"x": 36,
"y": 857
},
{
"t": 6,
"x": 30,
"y": 858
},
{
"t": 7,
"x": 33,
"y": 860
},
{
"t": 8,
"x": 48,
"y": 858
},
{
"t": 9,
"x": 61,
"y": 856
},
{
"t": 10,
"x": 33,
"y": 848
},
{
"t": 11,
"x": 36,
"y": 844
},
{
"t": 12,
"x": 38,
"y": 841
},
{
"t": 13,
"x": 40,
"y": 840
},
{
"t": 15,
"x": 48,
"y": 836
},
{
"t": 16,
"x": 54,
"y": 835
},
{
"t": 17,
"x": 61,
"y": 834
},
{
"t": 18,
"x": 91,
"y": 829
},
{
"t": 19,
"x": 42,
"y": 846
},
{
"t": 20,
"x": 53,
"y": 846
},
{
"t": 21,
"x": 67,
"y": 842
},
{
"t": 22,
"x": 80,
"y": 840
},
{
"t": 23,
"x": 91,
"y": 838
}
],
"birth": 1,
"death": 24
}
],
"interactions": [
{
"id": 1,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 2,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 3,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 0,
"inputs": [
0,
1
],
"outputs": [
0,
1
],
"begins_at": 1,
"ends_at": 1,
"type": "collision"
}
]
}Complete per-sample evaluator report
{
"metrics": {
"avg_type_similarity": null,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": null,
"avg_image_position_segmentation_acc": null,
"avg_image_position_segmentation_acc_small": null,
"avg_image_position_segmentation_acc_medium": null,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": null,
"avg_image_position_segmentation_visible_acc": null,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": null,
"visibility_true_acc": null,
"visibility_false_acc": null,
"is_in_frame_acc": null,
"is_in_frame_true_acc": null,
"is_in_frame_false_acc": null,
"vis_acc_from_px": null,
"vis_acc_from_px_true_acc": null,
"vis_acc_from_px_false_acc": null,
"num_matches": 0,
"num_unmatched_pred": 0,
"num_unmatched_target": 5
},
"supports": {
"avg_type_similarity": 0,
"avg_size_diff": 0,
"avg_3d_iou": 0,
"avg_image_position_px_diff": 0,
"avg_image_position_segmentation_acc": 0,
"avg_image_position_segmentation_acc_small": 0,
"avg_image_position_segmentation_acc_medium": 0,
"avg_image_position_segmentation_acc_large": 0,
"avg_image_position_segmentation_acc_first_frame": 0,
"avg_image_position_segmentation_visible_acc": 0,
"avg_quaternion_geodesic_deg": 0,
"visibility_acc": 0,
"visibility_true_acc": 0,
"visibility_false_acc": 0,
"is_in_frame_acc": 0,
"is_in_frame_true_acc": 0,
"is_in_frame_false_acc": 0,
"vis_acc_from_px": 0,
"vis_acc_from_px_true_acc": 0,
"vis_acc_from_px_false_acc": 0
},
"matching": {
"matches": [],
"unmatched_target_ids": [
0,
1,
2,
3,
4
],
"unmatched_pred_ids": [],
"target_type_counts": {
"yellow fighter": 1,
"purple jet": 1,
"brown minivan": 1,
"blue truck": 1,
"brown sedan": 1
},
"pred_type_counts": {},
"assignment_backend": "scipy_dense",
"cost_functions": [
"mutual_type",
"same_seg"
],
"cost_weights": {
"mutual_type": 1.0,
"same_seg": 1.0
},
"num_frames": 24
},
"scene_metrics": {
"thresholds": [
0.5,
1.0,
2.0,
3.0
],
"counts_by_threshold": {
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"2.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"3.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
}
},
"jaccard_by_threshold": {
"0.5": 0.0,
"1.0": 0.0,
"2.0": 0.0,
"3.0": 0.0
},
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
}
},
"visibility_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_by_motion_group": {
"static": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
}
},
"visibility_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"dynamic": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 2
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 2
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 2
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 2
}
},
"visibility_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"segmentation_counts_by_threshold": {},
"segmentation_precision_by_threshold": {},
"segmentation_recall_by_threshold": {},
"segmentation_f1_by_threshold": {},
"segmentation_frame_average_precision": null,
"segmentation_frame_average_recall": null,
"segmentation_frame_average_f1": null,
"segmentation_first_frame_counts": {},
"segmentation_first_frame_precision": null,
"segmentation_first_frame_recall": null,
"segmentation_first_frame_f1": null,
"segmentation_by_motion_group": {}
},
"per_match_metrics": [],
"interaction_metrics": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 4,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"interaction_supports": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
},
"interaction_matching": {
"matches": [],
"unmatched_target_ids": [
0,
1,
2,
3
],
"unmatched_pred_ids": [],
"target_type_counts": {
"collision": 1,
"contact": 3
},
"pred_type_counts": {},
"assignment_backend": "scipy_dense",
"cost_functions": [
"type_exact",
"temporal_span",
"input_object_set_mutual_jaccard",
"output_object_set_mutual_jaccard"
],
"cost_weights": {
"type_exact": 1.0,
"temporal_span": 1.0,
"input_object_set_mutual_jaccard": 0.5,
"output_object_set_mutual_jaccard": 0.5
}
},
"per_interaction_match_metrics": [],
"interaction_metrics_by_participants": {
"object_ground": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 3,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"object_object": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 1,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"interaction_supports_by_participants": {
"object_ground": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
},
"object_object": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
}
},
"interaction_metrics_by_type": {
"collision": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 1,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"contact": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 3,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 3
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"interaction_supports_by_type": {
"collision": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
},
"contact": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
}
}
}Exact evaluation configuration
{
"predictions_jsonl": "../inference_output.jsonl",
"dataset_json": "../test_data/movi_dump_sentinel_sharegpt.json",
"scene_root": "../test_data/movi_dump",
"output_json": "../evaluation_report.json",
"max_samples": null,
"num_workers": 1,
"show_progress": true,
"log_level": "INFO",
"visibility_filter_mode": "any_frame",
"pos2d_mode": "scaled_normalized",
"pos2d_scale": 1000.0,
"image_width": null,
"image_height": null,
"type_embed_model_name": "all-MiniLM-L6-v2",
"scene_similarity_thresholds": [
0.5,
1.0,
2.0,
3.0
],
"scene_segmentation_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"matching": {
"costs": [
{
"name": "mutual_type",
"weight": 1.0
},
{
"name": "same_seg",
"weight": 1.0,
"missing_value": 1.0,
"kwargs": {
"only_use_first_frame": false
}
}
]
},
"interaction_matching": {
"costs": [
{
"name": "type_exact",
"weight": 1.0
},
{
"name": "temporal_span",
"weight": 1.0
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5
}
]
},
"return_per_sample": true
}