STRIVE · 08/28/2026
Dyn generalization · val_24 · super_clevr_1012
Everything fed into evaluation and the full per-sample output it produced.
Dataset row: exact video + user prompt + assistant target
{
"messages": [
{
"role": "user",
"content": "<video>\nAnalyze the provided video and return ONLY a valid sentinel sequence in this format:\n[SCENE-START] [OBJS-START]\n[OBJ] id \"type\" birth death [VIS] t vis ... [IN-FRAME] t is_in_frame ... [PX] t px py ...\n[OBJ] ...\n[OBJS-END]\n[INTERACTIONS-START]\n[INTERACT] id \"type\" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ...\n[INTERACT] ...\n[INTERACTIONS-END] [SCENE-END]\n\nConstraints:\n- Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose).\n- Keep tags exactly as written:\n `[SCENE-START] [OBJS-START] [OBJ] [VIS] [IN-FRAME] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]`\n- Use quoted strings for `type` (double quotes).\n- `VIS` uses repeated groups of 2 values in order:\n `t vis`.\n `vis` is a boolean value.\n- `IN-FRAME` uses repeated groups of 2 values in order:\n `t is_in_frame`.\n `is_in_frame` is a boolean value.\n- `PX` uses repeated groups of 3 values in order: `t px py`.\n- `px` and `py` are normalized pixel coordinates in the range `[0, 1]`,\n scaled by `1000` and then converted to integers by dropping the decimal part.\n- For occluded or out-of-frame frames under this setting, `PX` may use `t null null`.\n- `IN` and `OUT` contain whitespace-separated integer ids.\n- Use lowercase booleans (`true`/`false`) for `vis` and `is_in_frame`."
},
{
"role": "assistant",
"content": "[SCENE-START] [OBJS-START] [OBJ] 0 \"purple airliner\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 260 532 1 258 527 2 258 522 3 257 518 4 256 513 5 255 508 6 255 504 7 254 499 8 253 495 9 252 492 10 251 488 11 251 485 12 250 474 13 249 469 14 248 467 15 248 463 16 248 465 18 247 456 19 246 451 20 246 454 21 245 449 22 245 446 [OBJ] 1 \"cyan jet\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 323 813 9 325 814 18 326 816 [OBJ] 2 \"cyan wagon\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 580 980 1 573 976 2 568 972 3 566 968 4 566 964 5 557 959 6 551 956 7 547 952 8 545 949 9 546 945 10 537 942 11 543 939 12 538 935 13 535 932 14 537 929 15 541 926 16 544 924 17 547 921 18 547 918 19 546 914 20 547 917 21 544 909 22 539 898 23 536 895 [OBJ] 3 \"blue chopper\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 592 832 2 583 818 4 581 816 5 582 818 6 591 833 7 581 818 8 580 816 11 580 818 12 578 816 13 586 832 14 576 816 15 583 827 16 573 814 18 571 814 20 569 810 21 564 800 22 563 798 23 588 832 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 1 \"collision\" 23 23 [IN] 2 3 [OUT] 2 3 [INTERACTIONS-END] [SCENE-END]"
}
],
"videos": [
"/mmfs1/gscratch/krishna/suryadv/strive_dynsuperclevr/data/lf/videos/val_24/super_clevr_1012/frames.max_frames_24.mp4"
]
}Inference record: exact prompt + prediction + label + parse debug
{
"prompt": "user\n\nAnalyze the provided video and return ONLY a valid sentinel sequence in this format:\n[SCENE-START] [OBJS-START]\n[OBJ] id \"type\" birth death [VIS] t vis ... [IN-FRAME] t is_in_frame ... [PX] t px py ...\n[OBJ] ...\n[OBJS-END]\n[INTERACTIONS-START]\n[INTERACT] id \"type\" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ...\n[INTERACT] ...\n[INTERACTIONS-END] [SCENE-END]\n\nConstraints:\n- Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose).\n- Keep tags exactly as written:\n `[SCENE-START] [OBJS-START] [OBJ] [VIS] [IN-FRAME] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]`\n- Use quoted strings for `type` (double quotes).\n- `VIS` uses repeated groups of 2 values in order:\n `t vis`.\n `vis` is a boolean value.\n- `IN-FRAME` uses repeated groups of 2 values in order:\n `t is_in_frame`.\n `is_in_frame` is a boolean value.\n- `PX` uses repeated groups of 3 values in order: `t px py`.\n- `px` and `py` are normalized pixel coordinates in the range `[0, 1]`,\n scaled by `1000` and then converted to integers by dropping the decimal part.\n- For occluded or out-of-frame frames under this setting, `PX` may use `t null null`.\n- `IN` and `OUT` contain whitespace-separated integer ids.\n- Use lowercase booleans (`true`/`false`) for `vis` and `is_in_frame`.\nassistant\n",
"predict": "[SCENE-START] [OBJS-START] [OBJ] 0 \"purple and pink athletic shoe\" 0 10 [VIS] 0 false 7 true [IN-FRAME] 0 true [PX] 0 null null 7 169 478 8 169 494 9 169 509 10 169 525 11 166 498 12 166 513 13 166 529 14 162 501 15 162 513 16 162 529 17 162 544 18 158 513 19 158 525 20 158 541 21 158 556 22 154 525 23 154 537 [OBJ] 1 \"dark grey and light grey plastic monster action figure\" 0 10 [VIS] 0 false 5 true [IN-FRAME] 0 true [PX] 0 null null 5 201 544 6 205 537 11 208 544 14 201 548 16 193 552 19 185 556 22 177 560 [OBJ] 2 \"white and purple plastic supplement bottle\" 0 10 [VIS] 0 false 6 true [IN-FRAME] 0 true [PX] 0 null null 6 244 525 7 240 533 8 240 521 9 236 533 10 232 541 11 232 529 12 228 537 13 228 525 14 224 537 15 224 525 16 220 537 17 220 525 18 216 537 19 216 525 20 212 537 21 212 525 22 208 537 23 208 525 [OBJ] 3 \"purple and pink athletic shoe\" 0 10 [VIS] 0 false 9 true 10 false 11 true [IN-FRAME] 0 true [PX] 0 null null 9 240 548 10 null null 11 240 548 12 236 541 15 228 544 18 220 548 21 212 552 23 205 556 [OBJ] 4 \"white and gold plastic winged unicorn figurine\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 232 544 1 244 544 2 255 544 3 267 544 4 283 544 5 294 544 6 310 544 7 326 544 8 341 544 9 357 544 10 369 544 11 384 544 12 396 544 13 408 544 14 423 544 15 435 544 16 447 544 17 458 544 18 470 544 19 482 544 20 494 544 21 505 544 22 517 544 23 529 544 [OBJ] 5 \"white and gold plastic winged unicorn figurine\" 0 10 [VIS] 0 false 6 true [IN-FRAME] 0 true [PX] 0 null null 6 279 552 7 291 552 8 306 552 9 322 552 10 337 552 11 349 552 12 365 552 13 376 552 14 388 552 15 400 552 16 412 552 17 423 552 18 435 552 19 447 552 20 458 552 21 470 552 22 482 552 23 494 552 [OBJ] 6 \"pink and purple wooden toy castle\" 0 10 [VIS] 0 false 1 true 12 false 14 true [IN-FRAME] 0 true [PX] 0 null null 1 275 560 3 287 560 5 298 560 7 314 560 9 330 560 11 345 560 12 null null 14 384 560 16 396 560 18 412 560 20 427 560 22 439 560 23 451 560 [OBJ] 7 \"pink and purple wooden toy castle\" 0 10 [VIS] 0 false 1 true 12 false 14 true [IN-FRAME] 0 true [PX] 0 null null 1 279 568 2 291 568 4 302 568 6 314 568 7 322 564 8 330 568 10 341 568 12 null null 14 369 568 16 384 568 18 396 568 20 408 568 22 419 568 23 431 568 [OBJ] 8 \"light grey and black sneaker\" 0 10 [VIS] 0 false 1 true [IN-FRAME] 0 true [PX] 0 null null 1 287 576 2 294 580 4 306 580 6 314 576 8 326 576 10 337 576 12 345 572 14 357 572 16 365 568 18 373 564 20 384 564 22 396 564 23 404 568 [OBJ] 9 \"pink and purple wooden toy castle\" 0 10 [VIS] 0 false 1 true 12 false 14 true [IN-FRAME] 0 true [PX] 0 null null 1 298 580 2 306 583 5 318 583 7 330 583 10 341 583 11 349 587 12 null null 14 373 580 17 388 580 19 396 583 21 408 583 23 419 583 [OBJ] 10 \"teal fabric mermaid backpack\" 0 10 [VIS] 0 true 5 false [IN-FRAME] 0 true [PX] 0 294 599 1 302 603 4 310 611 5 null null [OBJ] 11 \"wooden toy juicer set\" 0 10 [VIS] 0 true 3 false [IN-FRAME] 0 true [PX] 0 306 560 3 null null [OBJ] 12 \"teal fabric mermaid backpack\" 0 10 [VIS] 0 true 3 false [IN-FRAME] 0 true [PX] 0 314 591 1 322 595 2 330 599 3 null null [OBJ] 13 \"light brown wooden fruit and vegetable domino set\" 0 10 [VIS] 0 true 3 false [IN-FRAME] 0 true [PX] 0 330 544 1 337 548 2 345 552 3 null null [OBJ] 14 \"wooden toy juicer set\" 0 10 [VIS] 0 true 3 false [IN-FRAME] 0 true [PX] 0 333 556 1 341 560 2 353 564 3 null null [OBJ] 15 \"teal fabric mermaid backpack\" 0 10 [VIS] 0 true 3 false [IN-FRAME] 0 true [PX] 0 341 544 1 353 548 3 null null [OBJ] 16 \"dark grey and pink running shoe\" 0 10 [VIS] 0 true 5 false [IN-FRAME] 0 true [PX] 0 349 564 2 361 564 3 373 568 5 null null [OBJ] 17 \"teal fabric mermaid backpack\" 0 10 [VIS] 0 true 3 false [IN-FRAME] 0 true [PX] 0 361 548 1 369 552 3 null null [OBJ] 18 \"blue and red running shoe\" 0 10 [VIS] 0 true 5 false [IN-FRAME] 0 true [PX] 0 365 560 2 376 564 5 null null [OBJ] 19 \"wooden toy juicer set\" 0 10 [VIS] 0 true 5 false [IN-FRAME] 0 true [PX] 0 380 564 3 396 568 5 null null [OBJ] 20 \"teal fabric mermaid backpack\" 0 10 [VIS] 0 true 5 false [IN-FRAME] 0 true [PX] 0 431 564 2 447 564 3 458 568 5 null null [OBJ] 21 \"dark grey and pink running shoe\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 501 568 4 null null [OBJ] 22 \"teal and lime running shoe\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 533 978 1 525 974 3 513 970 4 505 962 6 498 955 7 494 943 8 490 931 9 486 919 10 482 908 11 478 896 12 474 884 13 470 873 14 466 861 15 462 853 16 458 841 17 455 833 18 451 826 19 447 818 20 443 810 21 439 802 22 435 794 23 431 787 [OBJ] 23 \"dark red and black plastic curling wand\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 556 576 4 null null [OBJ] 24 \"dark grey cardboard motherboard box\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 560 580 4 null null [OBJ] 25 \"dark grey cardboard motherboard box\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 572 583 4 null null [OBJ] 26 \"dark grey cardboard motherboard box\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 583 587 4 null null [OBJ] 27 \"white and blue cardboard ink cartridge box\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 591 587 4 null null [OBJ] 28 \"dark blue leather boat shoe\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 599 591 4 null null [OBJ] 29 \"white cardboard box of personal blender jars\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 603 595 4 null null [OBJ] 30 \"black and yellow rubber mallet\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 611 595 4 null null [OBJ] 31 \"grey, purple, and mint green high-top sneaker\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 619 599 4 null null [OBJ] 32 \"dark grey plastic supplement bottle with orange cap\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 626 599 4 null null [OBJ] 33 \"grey and white plastic shark figurine\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 630 603 4 null null [OBJ] 34 \"dark brown fabric loafer\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 634 611 4 null null [OBJ] 35 \"grey and white plush shark\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 638 615 4 null null [OBJ] 36 \"blue and white cardboard snack cake box\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 642 619 4 null null [OBJ] 37 \"white and tan plastic unicorn figurine\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 654 591 4 null null [OBJ] 38 \"blue and black plastic DVD set\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 666 587 4 null null [OBJ] 39 \"dark grey cardboard motherboard box\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 669 591 4 null null [OBJ] 40 \"blue and white cardboard snack cake box\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 681 587 4 null null [OBJ] 41 \"blue and black plastic DVD set\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 689 583 4 null null [OBJ] 42 \"white and tan leather boat shoe\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 697 583 4 null null [OBJ] 43 \"black and grey high-top sneaker\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 701 587 4 null null [OBJ] 44 \"white and orange cardboard serum box\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 705 591 4 null null [OBJ] 45 \"black and yellow rubber mallet\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 716 587 4 null null [OBJ] 46 \"black and yellow rubber mallet\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 724 583 4 null null [OBJ] 47 \"blue and black hiking shoe\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 732 583 4 null null [OBJ] 48 \"grey and white plastic shark figurine\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 736 587 4 null null [OBJ] 49 \"dark grey and light grey plastic monster action figure\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 744 583 4 null null [OBJ] 50 \"grey and black basketball shoe\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 755 583 4 null null [OBJ] 51 \"blue and green cardboard candy bar box\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 767 583 4 null null [OBJ] 52 \"blue and green cardboard retail box for inflatable neck rest\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 775 583 4 null null [OBJ] 53 \"dark grey plastic supplement bottle\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 783 583 4 null null [OBJ] 54 \"dark brown fabric loafer\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 791 583 4 null null [OBJ] 55 \"light blue cardboard argan oil treatment box\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 810 583 4 null null [OBJ] 56 \"blue and white athletic shoe\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 830 583 4 null null [OBJ] 57 \"dark grey plastic supplement bottle\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 845 583 4 null null [OBJ] 58 \"grey and white plastic shark figurine\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 857 583 4 null null [OBJ] 59 \"blue and black hiking shoe\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 865 583 4 null null [OBJ] 60 \"white cardboard ink cartridge box\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 873 583 4 null null [OBJ] 61 \"black and blue fabric boat shoe\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 880 583 4 null null [OBJ] 62 \"white plastic Pop-O-Matic game\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 896 583 4 null null [OBJ] 63 \"white and green cardboard ink cartridge box\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 908 583 4 null null [OBJ] 64 \"dark grey plastic supplement bottle with orange cap\" 0 10 [VIS] 0 true 4 false [IN-FRAME] 0 true [PX] 0 919 583 4 null null [OBJ] 65 \"teal fabric mermaid backpack\" 0 10 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 994 623 1 994 611 2 994 599 3 994 587 4 994 576 5 994 564 6 990 615 7 990 599 8 990 587 9 990 576 10 990 564 11 990 552 12 990 541 13 990 529 14 990 517 15 986 568 16 986 556 17 986 544 18 986 533 19 986 521 20 986 509 21 986 498 22 986 486 23 986 474 [OBJS-END] [INTERACTIONS-START] [INTERACT] 32 \"contact\" 0 0 [IN] 2 3 [OUT] 2 3 [INTERACT] 38 \"contact\" 0 0 [IN] 2 6 [OUT] 2 6 [INTERACT] 22 \"contact\" 0 1 [IN] 15 16 [OUT] 15 16 [INTERACT] 29 \"contact\" 0 2 [IN] 17 65535 [OUT] 17 65535 [INTERACT] 0 \"contact\" 0 3 [IN] 0 1 [OUT] 0 1 [INTERACT] 1 \"contact\" 0 10 [IN] 0 14 [OUT] 0 14 [INTERACT] 2 \"contact\" 0 10 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 3 \"contact\" 0 10 [IN] 1 11 [OUT] 1 11 [INTERACT] 11 \"contact\" 0 10 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 41 \"contact\" 0 10 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 50 \"contact\" 0 10 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 51 \"contact\" 0 10 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 52 \"contact\" 0 10 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 53 \"contact\" 0 10 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 54 \"contact\" 0 10 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 55 \"contact\" 0 10 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 56 \"contact\" 0 10 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 14 \"contact\" 0 10 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 15 \"contact\" 0 10 [IN] 11 14 [OUT] 11 14 [INTERACT] 16 \"contact\" 0 10 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 17 \"contact\" 0 10 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 18 \"contact\" 0 10 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 19 \"contact\" 0 10 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 20 \"contact\" 0 10 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 21 \"contact\" 0 10 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 35 \"contact\" 0 10 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 36 \"contact\" 0 10 [IN] 19 65535 [OUT] 19 65535 [INTERACT] 37 \"contact\" 0 10 [IN] 20 65535 [OUT] 20 65535 [INTERACT] 39 \"contact\" 0 10 [IN] 21 65535 [OUT] 21 65535 [INTERACT] 40 \"contact\" 0 10 [IN] 22 65535 [OUT] 22 65535 [INTERACT] 42 \"contact\" 0 10 [IN] 23 65535 [OUT] 23 65535 [INTERACT] 43 \"contact\" 0 10 [IN] 24 65535 [OUT] 24 65535 [INTERACT] 44 \"contact\" 0 10 [IN] 25 65535 [OUT] 25 65535 [INTERACT] 45 \"contact\" 0 10 [IN] 26 65535 [OUT] 26 65535 [INTERACT] 46 \"contact\" 0 10 [IN] 27 65535 [OUT] 27 65535 [INTERACT] 47 \"contact\" 0 10 [IN] 28 65535 [OUT] 28 65535 [INTERACT] 48 \"contact\" 0 10 [IN] 29 65535 [OUT] 29 65535 [INTERACT] 49 \"contact\" 0 10 [IN] 31 65535 [OUT] 31 65535 [INTERACT] 5 \"contact\" 0 10 [IN] 10 16 [OUT] 10 16 [INTERACT] 6 \"contact\" 0 10 [IN] 10 20 [OUT] 10 20 [INTERACT] 7 \"contact\" 0 10 [IN] 10 22 [OUT] 10 22 [INTERACT] 8 \"contact\" 0 10 [IN] 10 25 [OUT] 10 25 [INTERACT] 9 \"contact\" 0 10 [IN] 10 26 [OUT] 10 26 [INTERACT] 10 \"contact\" 0 10 [IN] 10 30 [OUT] 10 30 [INTERACT] 30 \"contact\" 0 10 [IN] 17 65535 [OUT] 17 65535 [INTERACT] 33 \"contact\" 0 10 [IN] 2 3 [OUT] 2 3 [INTERACT] 31 \"collision\" 2 2 [IN] 17 65535 [OUT] 17 65535 [INTERACT] 34 \"collision\" 4 4 [IN] 2 13 [OUT] 2 13 [INTERACT] 12 \"collision\" 5 5 [IN] 10 16 [OUT] 10 16 [INTERACT] 13 \"contact\" 6 10 [IN] 10 16 [OUT] 10 16 [INTERACT] 23 \"collision\" 7 7 [IN] 15 16 [OUT] 15 16 [INTERACT] 24 \"contact\" 8 9 [IN] 15 16 [OUT] 15 16 [INTERACT] 25 \"collision\" 9 9 [IN] 15 20 [OUT] 15 20 [INTERACT] 26 \"collision\" 9 9 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 27 \"collision\" 9 9 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 28 \"collision\" 9 10 [IN] 17 20 [OUT] 17 20 [INTERACT] 4 \"collision\" 10 10 [IN] 1 11 [OUT] 1 11 [INTERACT] 22 \"collision\" 10 10 [IN] 15 16 [OUT] 15 16 [INTERACT] 3 \"collision\" 10 11 [IN] 1 10 [OUT] 1 10 [INTERACT] 41 \"collision\" 10 11 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 42 \"collision\" 10 10 [IN] 3 13 [OUT] 3 13 [INTERACT] 43 \"collision\" 10 10 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 45 \"collision\" 10 10 [IN] 3 18 [OUT] 3 18 [INTERACT] 46 \"collision\" 10 10 [IN] 3 22 [OUT] 3 22 [INTERACT] 49 \"collision\" 10 10 [IN] 32 65535 [OUT] 32 65535 [INTERACT] 40 \"collision\" 10 10 [IN] 23 32 [OUT] 23 32 [INTERACT] 1 \"collision\" 10 11 [IN] 0 14 [OUT] 0 14 [INTERACT] 26 \"collision\" 10 11 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 41 \"collision\" 10 11 [IN] 24 65535 [OUT] 24 65535 [INTERACT] 44 \"collision\" 10 11 [IN] 3 16 [OUT] 3 16 [INTERACT] 11 \"collision\" 10 11 [IN] 10 15 [OUT] 10 15 [INTERACTIONS-END] [SCENE-END]",
"label": "[SCENE-START] [OBJS-START] [OBJ] 0 \"purple airliner\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 260 532 1 258 527 2 258 522 3 257 518 4 256 513 5 255 508 6 255 504 7 254 499 8 253 495 9 252 492 10 251 488 11 251 485 12 250 474 13 249 469 14 248 467 15 248 463 16 248 465 18 247 456 19 246 451 20 246 454 21 245 449 22 245 446 [OBJ] 1 \"cyan jet\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 323 813 9 325 814 18 326 816 [OBJ] 2 \"cyan wagon\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 580 980 1 573 976 2 568 972 3 566 968 4 566 964 5 557 959 6 551 956 7 547 952 8 545 949 9 546 945 10 537 942 11 543 939 12 538 935 13 535 932 14 537 929 15 541 926 16 544 924 17 547 921 18 547 918 19 546 914 20 547 917 21 544 909 22 539 898 23 536 895 [OBJ] 3 \"blue chopper\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 592 832 2 583 818 4 581 816 5 582 818 6 591 833 7 581 818 8 580 816 11 580 818 12 578 816 13 586 832 14 576 816 15 583 827 16 573 814 18 571 814 20 569 810 21 564 800 22 563 798 23 588 832 [OBJS-END] [INTERACTIONS-START] [INTERACT] 0 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"contact\" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 3 \"contact\" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 1 \"collision\" 23 23 [IN] 2 3 [OUT] 2 3 [INTERACTIONS-END] [SCENE-END]\n"
}Parsed prediction
{
"objects": [
{
"id": 0,
"type": "purple and pink athletic shoe",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 7,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 7,
"x": 169,
"y": 478
},
{
"t": 8,
"x": 169,
"y": 494
},
{
"t": 9,
"x": 169,
"y": 509
},
{
"t": 10,
"x": 169,
"y": 525
},
{
"t": 11,
"x": 166,
"y": 498
},
{
"t": 12,
"x": 166,
"y": 513
},
{
"t": 13,
"x": 166,
"y": 529
},
{
"t": 14,
"x": 162,
"y": 501
},
{
"t": 15,
"x": 162,
"y": 513
},
{
"t": 16,
"x": 162,
"y": 529
},
{
"t": 17,
"x": 162,
"y": 544
},
{
"t": 18,
"x": 158,
"y": 513
},
{
"t": 19,
"x": 158,
"y": 525
},
{
"t": 20,
"x": 158,
"y": 541
},
{
"t": 21,
"x": 158,
"y": 556
},
{
"t": 22,
"x": 154,
"y": 525
},
{
"t": 23,
"x": 154,
"y": 537
}
],
"birth": 0,
"death": 10
},
{
"id": 1,
"type": "dark grey and light grey plastic monster action figure",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 5,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 5,
"x": 201,
"y": 544
},
{
"t": 6,
"x": 205,
"y": 537
},
{
"t": 11,
"x": 208,
"y": 544
},
{
"t": 14,
"x": 201,
"y": 548
},
{
"t": 16,
"x": 193,
"y": 552
},
{
"t": 19,
"x": 185,
"y": 556
},
{
"t": 22,
"x": 177,
"y": 560
}
],
"birth": 0,
"death": 10
},
{
"id": 2,
"type": "white and purple plastic supplement bottle",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 6,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 6,
"x": 244,
"y": 525
},
{
"t": 7,
"x": 240,
"y": 533
},
{
"t": 8,
"x": 240,
"y": 521
},
{
"t": 9,
"x": 236,
"y": 533
},
{
"t": 10,
"x": 232,
"y": 541
},
{
"t": 11,
"x": 232,
"y": 529
},
{
"t": 12,
"x": 228,
"y": 537
},
{
"t": 13,
"x": 228,
"y": 525
},
{
"t": 14,
"x": 224,
"y": 537
},
{
"t": 15,
"x": 224,
"y": 525
},
{
"t": 16,
"x": 220,
"y": 537
},
{
"t": 17,
"x": 220,
"y": 525
},
{
"t": 18,
"x": 216,
"y": 537
},
{
"t": 19,
"x": 216,
"y": 525
},
{
"t": 20,
"x": 212,
"y": 537
},
{
"t": 21,
"x": 212,
"y": 525
},
{
"t": 22,
"x": 208,
"y": 537
},
{
"t": 23,
"x": 208,
"y": 525
}
],
"birth": 0,
"death": 10
},
{
"id": 3,
"type": "purple and pink athletic shoe",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 9,
"v": true
},
{
"t": 10,
"v": false
},
{
"t": 11,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 9,
"x": 240,
"y": 548
},
{
"t": 10,
"x": null,
"y": null
},
{
"t": 11,
"x": 240,
"y": 548
},
{
"t": 12,
"x": 236,
"y": 541
},
{
"t": 15,
"x": 228,
"y": 544
},
{
"t": 18,
"x": 220,
"y": 548
},
{
"t": 21,
"x": 212,
"y": 552
},
{
"t": 23,
"x": 205,
"y": 556
}
],
"birth": 0,
"death": 10
},
{
"id": 4,
"type": "white and gold plastic winged unicorn figurine",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 232,
"y": 544
},
{
"t": 1,
"x": 244,
"y": 544
},
{
"t": 2,
"x": 255,
"y": 544
},
{
"t": 3,
"x": 267,
"y": 544
},
{
"t": 4,
"x": 283,
"y": 544
},
{
"t": 5,
"x": 294,
"y": 544
},
{
"t": 6,
"x": 310,
"y": 544
},
{
"t": 7,
"x": 326,
"y": 544
},
{
"t": 8,
"x": 341,
"y": 544
},
{
"t": 9,
"x": 357,
"y": 544
},
{
"t": 10,
"x": 369,
"y": 544
},
{
"t": 11,
"x": 384,
"y": 544
},
{
"t": 12,
"x": 396,
"y": 544
},
{
"t": 13,
"x": 408,
"y": 544
},
{
"t": 14,
"x": 423,
"y": 544
},
{
"t": 15,
"x": 435,
"y": 544
},
{
"t": 16,
"x": 447,
"y": 544
},
{
"t": 17,
"x": 458,
"y": 544
},
{
"t": 18,
"x": 470,
"y": 544
},
{
"t": 19,
"x": 482,
"y": 544
},
{
"t": 20,
"x": 494,
"y": 544
},
{
"t": 21,
"x": 505,
"y": 544
},
{
"t": 22,
"x": 517,
"y": 544
},
{
"t": 23,
"x": 529,
"y": 544
}
],
"birth": 0,
"death": 10
},
{
"id": 5,
"type": "white and gold plastic winged unicorn figurine",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 6,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 6,
"x": 279,
"y": 552
},
{
"t": 7,
"x": 291,
"y": 552
},
{
"t": 8,
"x": 306,
"y": 552
},
{
"t": 9,
"x": 322,
"y": 552
},
{
"t": 10,
"x": 337,
"y": 552
},
{
"t": 11,
"x": 349,
"y": 552
},
{
"t": 12,
"x": 365,
"y": 552
},
{
"t": 13,
"x": 376,
"y": 552
},
{
"t": 14,
"x": 388,
"y": 552
},
{
"t": 15,
"x": 400,
"y": 552
},
{
"t": 16,
"x": 412,
"y": 552
},
{
"t": 17,
"x": 423,
"y": 552
},
{
"t": 18,
"x": 435,
"y": 552
},
{
"t": 19,
"x": 447,
"y": 552
},
{
"t": 20,
"x": 458,
"y": 552
},
{
"t": 21,
"x": 470,
"y": 552
},
{
"t": 22,
"x": 482,
"y": 552
},
{
"t": 23,
"x": 494,
"y": 552
}
],
"birth": 0,
"death": 10
},
{
"id": 6,
"type": "pink and purple wooden toy castle",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 1,
"v": true
},
{
"t": 12,
"v": false
},
{
"t": 14,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 1,
"x": 275,
"y": 560
},
{
"t": 3,
"x": 287,
"y": 560
},
{
"t": 5,
"x": 298,
"y": 560
},
{
"t": 7,
"x": 314,
"y": 560
},
{
"t": 9,
"x": 330,
"y": 560
},
{
"t": 11,
"x": 345,
"y": 560
},
{
"t": 12,
"x": null,
"y": null
},
{
"t": 14,
"x": 384,
"y": 560
},
{
"t": 16,
"x": 396,
"y": 560
},
{
"t": 18,
"x": 412,
"y": 560
},
{
"t": 20,
"x": 427,
"y": 560
},
{
"t": 22,
"x": 439,
"y": 560
},
{
"t": 23,
"x": 451,
"y": 560
}
],
"birth": 0,
"death": 10
},
{
"id": 7,
"type": "pink and purple wooden toy castle",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 1,
"v": true
},
{
"t": 12,
"v": false
},
{
"t": 14,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 1,
"x": 279,
"y": 568
},
{
"t": 2,
"x": 291,
"y": 568
},
{
"t": 4,
"x": 302,
"y": 568
},
{
"t": 6,
"x": 314,
"y": 568
},
{
"t": 7,
"x": 322,
"y": 564
},
{
"t": 8,
"x": 330,
"y": 568
},
{
"t": 10,
"x": 341,
"y": 568
},
{
"t": 12,
"x": null,
"y": null
},
{
"t": 14,
"x": 369,
"y": 568
},
{
"t": 16,
"x": 384,
"y": 568
},
{
"t": 18,
"x": 396,
"y": 568
},
{
"t": 20,
"x": 408,
"y": 568
},
{
"t": 22,
"x": 419,
"y": 568
},
{
"t": 23,
"x": 431,
"y": 568
}
],
"birth": 0,
"death": 10
},
{
"id": 8,
"type": "light grey and black sneaker",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 1,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 1,
"x": 287,
"y": 576
},
{
"t": 2,
"x": 294,
"y": 580
},
{
"t": 4,
"x": 306,
"y": 580
},
{
"t": 6,
"x": 314,
"y": 576
},
{
"t": 8,
"x": 326,
"y": 576
},
{
"t": 10,
"x": 337,
"y": 576
},
{
"t": 12,
"x": 345,
"y": 572
},
{
"t": 14,
"x": 357,
"y": 572
},
{
"t": 16,
"x": 365,
"y": 568
},
{
"t": 18,
"x": 373,
"y": 564
},
{
"t": 20,
"x": 384,
"y": 564
},
{
"t": 22,
"x": 396,
"y": 564
},
{
"t": 23,
"x": 404,
"y": 568
}
],
"birth": 0,
"death": 10
},
{
"id": 9,
"type": "pink and purple wooden toy castle",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 1,
"v": true
},
{
"t": 12,
"v": false
},
{
"t": 14,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 1,
"x": 298,
"y": 580
},
{
"t": 2,
"x": 306,
"y": 583
},
{
"t": 5,
"x": 318,
"y": 583
},
{
"t": 7,
"x": 330,
"y": 583
},
{
"t": 10,
"x": 341,
"y": 583
},
{
"t": 11,
"x": 349,
"y": 587
},
{
"t": 12,
"x": null,
"y": null
},
{
"t": 14,
"x": 373,
"y": 580
},
{
"t": 17,
"x": 388,
"y": 580
},
{
"t": 19,
"x": 396,
"y": 583
},
{
"t": 21,
"x": 408,
"y": 583
},
{
"t": 23,
"x": 419,
"y": 583
}
],
"birth": 0,
"death": 10
},
{
"id": 10,
"type": "teal fabric mermaid backpack",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 5,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 294,
"y": 599
},
{
"t": 1,
"x": 302,
"y": 603
},
{
"t": 4,
"x": 310,
"y": 611
},
{
"t": 5,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 11,
"type": "wooden toy juicer set",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 3,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 306,
"y": 560
},
{
"t": 3,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 12,
"type": "teal fabric mermaid backpack",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 3,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 314,
"y": 591
},
{
"t": 1,
"x": 322,
"y": 595
},
{
"t": 2,
"x": 330,
"y": 599
},
{
"t": 3,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 13,
"type": "light brown wooden fruit and vegetable domino set",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 3,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 330,
"y": 544
},
{
"t": 1,
"x": 337,
"y": 548
},
{
"t": 2,
"x": 345,
"y": 552
},
{
"t": 3,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 14,
"type": "wooden toy juicer set",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 3,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 333,
"y": 556
},
{
"t": 1,
"x": 341,
"y": 560
},
{
"t": 2,
"x": 353,
"y": 564
},
{
"t": 3,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 15,
"type": "teal fabric mermaid backpack",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 3,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 341,
"y": 544
},
{
"t": 1,
"x": 353,
"y": 548
},
{
"t": 3,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 16,
"type": "dark grey and pink running shoe",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 5,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 349,
"y": 564
},
{
"t": 2,
"x": 361,
"y": 564
},
{
"t": 3,
"x": 373,
"y": 568
},
{
"t": 5,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 17,
"type": "teal fabric mermaid backpack",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 3,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 361,
"y": 548
},
{
"t": 1,
"x": 369,
"y": 552
},
{
"t": 3,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 18,
"type": "blue and red running shoe",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 5,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 365,
"y": 560
},
{
"t": 2,
"x": 376,
"y": 564
},
{
"t": 5,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 19,
"type": "wooden toy juicer set",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 5,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 380,
"y": 564
},
{
"t": 3,
"x": 396,
"y": 568
},
{
"t": 5,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 20,
"type": "teal fabric mermaid backpack",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 5,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 431,
"y": 564
},
{
"t": 2,
"x": 447,
"y": 564
},
{
"t": 3,
"x": 458,
"y": 568
},
{
"t": 5,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 21,
"type": "dark grey and pink running shoe",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 501,
"y": 568
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 22,
"type": "teal and lime running shoe",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 533,
"y": 978
},
{
"t": 1,
"x": 525,
"y": 974
},
{
"t": 3,
"x": 513,
"y": 970
},
{
"t": 4,
"x": 505,
"y": 962
},
{
"t": 6,
"x": 498,
"y": 955
},
{
"t": 7,
"x": 494,
"y": 943
},
{
"t": 8,
"x": 490,
"y": 931
},
{
"t": 9,
"x": 486,
"y": 919
},
{
"t": 10,
"x": 482,
"y": 908
},
{
"t": 11,
"x": 478,
"y": 896
},
{
"t": 12,
"x": 474,
"y": 884
},
{
"t": 13,
"x": 470,
"y": 873
},
{
"t": 14,
"x": 466,
"y": 861
},
{
"t": 15,
"x": 462,
"y": 853
},
{
"t": 16,
"x": 458,
"y": 841
},
{
"t": 17,
"x": 455,
"y": 833
},
{
"t": 18,
"x": 451,
"y": 826
},
{
"t": 19,
"x": 447,
"y": 818
},
{
"t": 20,
"x": 443,
"y": 810
},
{
"t": 21,
"x": 439,
"y": 802
},
{
"t": 22,
"x": 435,
"y": 794
},
{
"t": 23,
"x": 431,
"y": 787
}
],
"birth": 0,
"death": 10
},
{
"id": 23,
"type": "dark red and black plastic curling wand",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 556,
"y": 576
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 24,
"type": "dark grey cardboard motherboard box",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 560,
"y": 580
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 25,
"type": "dark grey cardboard motherboard box",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 572,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 26,
"type": "dark grey cardboard motherboard box",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 583,
"y": 587
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 27,
"type": "white and blue cardboard ink cartridge box",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 591,
"y": 587
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 28,
"type": "dark blue leather boat shoe",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 599,
"y": 591
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 29,
"type": "white cardboard box of personal blender jars",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 603,
"y": 595
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 30,
"type": "black and yellow rubber mallet",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 611,
"y": 595
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 31,
"type": "grey, purple, and mint green high-top sneaker",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 619,
"y": 599
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 32,
"type": "dark grey plastic supplement bottle with orange cap",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 626,
"y": 599
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 33,
"type": "grey and white plastic shark figurine",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 630,
"y": 603
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 34,
"type": "dark brown fabric loafer",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 634,
"y": 611
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 35,
"type": "grey and white plush shark",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 638,
"y": 615
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 36,
"type": "blue and white cardboard snack cake box",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 642,
"y": 619
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 37,
"type": "white and tan plastic unicorn figurine",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 654,
"y": 591
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 38,
"type": "blue and black plastic DVD set",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 666,
"y": 587
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 39,
"type": "dark grey cardboard motherboard box",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 669,
"y": 591
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 40,
"type": "blue and white cardboard snack cake box",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 681,
"y": 587
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 41,
"type": "blue and black plastic DVD set",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 689,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 42,
"type": "white and tan leather boat shoe",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 697,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 43,
"type": "black and grey high-top sneaker",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 701,
"y": 587
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 44,
"type": "white and orange cardboard serum box",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 705,
"y": 591
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 45,
"type": "black and yellow rubber mallet",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 716,
"y": 587
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 46,
"type": "black and yellow rubber mallet",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 724,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 47,
"type": "blue and black hiking shoe",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 732,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 48,
"type": "grey and white plastic shark figurine",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 736,
"y": 587
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 49,
"type": "dark grey and light grey plastic monster action figure",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 744,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 50,
"type": "grey and black basketball shoe",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 755,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 51,
"type": "blue and green cardboard candy bar box",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 767,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 52,
"type": "blue and green cardboard retail box for inflatable neck rest",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 775,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 53,
"type": "dark grey plastic supplement bottle",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 783,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 54,
"type": "dark brown fabric loafer",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 791,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 55,
"type": "light blue cardboard argan oil treatment box",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 810,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 56,
"type": "blue and white athletic shoe",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 830,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 57,
"type": "dark grey plastic supplement bottle",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 845,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 58,
"type": "grey and white plastic shark figurine",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 857,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 59,
"type": "blue and black hiking shoe",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 865,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 60,
"type": "white cardboard ink cartridge box",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 873,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 61,
"type": "black and blue fabric boat shoe",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 880,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 62,
"type": "white plastic Pop-O-Matic game",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 896,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 63,
"type": "white and green cardboard ink cartridge box",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 908,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 64,
"type": "dark grey plastic supplement bottle with orange cap",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 4,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 919,
"y": 583
},
{
"t": 4,
"x": null,
"y": null
}
],
"birth": 0,
"death": 10
},
{
"id": 65,
"type": "teal fabric mermaid backpack",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 994,
"y": 623
},
{
"t": 1,
"x": 994,
"y": 611
},
{
"t": 2,
"x": 994,
"y": 599
},
{
"t": 3,
"x": 994,
"y": 587
},
{
"t": 4,
"x": 994,
"y": 576
},
{
"t": 5,
"x": 994,
"y": 564
},
{
"t": 6,
"x": 990,
"y": 615
},
{
"t": 7,
"x": 990,
"y": 599
},
{
"t": 8,
"x": 990,
"y": 587
},
{
"t": 9,
"x": 990,
"y": 576
},
{
"t": 10,
"x": 990,
"y": 564
},
{
"t": 11,
"x": 990,
"y": 552
},
{
"t": 12,
"x": 990,
"y": 541
},
{
"t": 13,
"x": 990,
"y": 529
},
{
"t": 14,
"x": 990,
"y": 517
},
{
"t": 15,
"x": 986,
"y": 568
},
{
"t": 16,
"x": 986,
"y": 556
},
{
"t": 17,
"x": 986,
"y": 544
},
{
"t": 18,
"x": 986,
"y": 533
},
{
"t": 19,
"x": 986,
"y": 521
},
{
"t": 20,
"x": 986,
"y": 509
},
{
"t": 21,
"x": 986,
"y": 498
},
{
"t": 22,
"x": 986,
"y": 486
},
{
"t": 23,
"x": 986,
"y": 474
}
],
"birth": 0,
"death": 10
}
],
"interactions": [
{
"id": 32,
"inputs": [
2,
3
],
"outputs": [
2,
3
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 38,
"inputs": [
2,
6
],
"outputs": [
2,
6
],
"begins_at": 0,
"ends_at": 0,
"type": "contact"
},
{
"id": 22,
"inputs": [
15,
16
],
"outputs": [
15,
16
],
"begins_at": 0,
"ends_at": 1,
"type": "contact"
},
{
"id": 29,
"inputs": [
17,
65535
],
"outputs": [
17,
65535
],
"begins_at": 0,
"ends_at": 2,
"type": "contact"
},
{
"id": 0,
"inputs": [
0,
1
],
"outputs": [
0,
1
],
"begins_at": 0,
"ends_at": 3,
"type": "contact"
},
{
"id": 1,
"inputs": [
0,
14
],
"outputs": [
0,
14
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 2,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 3,
"inputs": [
1,
11
],
"outputs": [
1,
11
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 11,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 41,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 50,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 51,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 52,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 53,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 54,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 55,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 56,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 14,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 15,
"inputs": [
11,
14
],
"outputs": [
11,
14
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 16,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 17,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 18,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 19,
"inputs": [
14,
65535
],
"outputs": [
14,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 20,
"inputs": [
15,
65535
],
"outputs": [
15,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 21,
"inputs": [
16,
65535
],
"outputs": [
16,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 35,
"inputs": [
18,
65535
],
"outputs": [
18,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 36,
"inputs": [
19,
65535
],
"outputs": [
19,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 37,
"inputs": [
20,
65535
],
"outputs": [
20,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 39,
"inputs": [
21,
65535
],
"outputs": [
21,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 40,
"inputs": [
22,
65535
],
"outputs": [
22,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 42,
"inputs": [
23,
65535
],
"outputs": [
23,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 43,
"inputs": [
24,
65535
],
"outputs": [
24,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 44,
"inputs": [
25,
65535
],
"outputs": [
25,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 45,
"inputs": [
26,
65535
],
"outputs": [
26,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 46,
"inputs": [
27,
65535
],
"outputs": [
27,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 47,
"inputs": [
28,
65535
],
"outputs": [
28,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 48,
"inputs": [
29,
65535
],
"outputs": [
29,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 49,
"inputs": [
31,
65535
],
"outputs": [
31,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 5,
"inputs": [
10,
16
],
"outputs": [
10,
16
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 6,
"inputs": [
10,
20
],
"outputs": [
10,
20
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 7,
"inputs": [
10,
22
],
"outputs": [
10,
22
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 8,
"inputs": [
10,
25
],
"outputs": [
10,
25
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 9,
"inputs": [
10,
26
],
"outputs": [
10,
26
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 10,
"inputs": [
10,
30
],
"outputs": [
10,
30
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 30,
"inputs": [
17,
65535
],
"outputs": [
17,
65535
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 33,
"inputs": [
2,
3
],
"outputs": [
2,
3
],
"begins_at": 0,
"ends_at": 10,
"type": "contact"
},
{
"id": 31,
"inputs": [
17,
65535
],
"outputs": [
17,
65535
],
"begins_at": 2,
"ends_at": 2,
"type": "collision"
},
{
"id": 34,
"inputs": [
2,
13
],
"outputs": [
2,
13
],
"begins_at": 4,
"ends_at": 4,
"type": "collision"
},
{
"id": 12,
"inputs": [
10,
16
],
"outputs": [
10,
16
],
"begins_at": 5,
"ends_at": 5,
"type": "collision"
},
{
"id": 13,
"inputs": [
10,
16
],
"outputs": [
10,
16
],
"begins_at": 6,
"ends_at": 10,
"type": "contact"
},
{
"id": 23,
"inputs": [
15,
16
],
"outputs": [
15,
16
],
"begins_at": 7,
"ends_at": 7,
"type": "collision"
},
{
"id": 24,
"inputs": [
15,
16
],
"outputs": [
15,
16
],
"begins_at": 8,
"ends_at": 9,
"type": "contact"
},
{
"id": 25,
"inputs": [
15,
20
],
"outputs": [
15,
20
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 26,
"inputs": [
15,
65535
],
"outputs": [
15,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 27,
"inputs": [
16,
65535
],
"outputs": [
16,
65535
],
"begins_at": 9,
"ends_at": 9,
"type": "collision"
},
{
"id": 28,
"inputs": [
17,
20
],
"outputs": [
17,
20
],
"begins_at": 9,
"ends_at": 10,
"type": "collision"
},
{
"id": 4,
"inputs": [
1,
11
],
"outputs": [
1,
11
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 22,
"inputs": [
15,
16
],
"outputs": [
15,
16
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 3,
"inputs": [
1,
10
],
"outputs": [
1,
10
],
"begins_at": 10,
"ends_at": 11,
"type": "collision"
},
{
"id": 41,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 10,
"ends_at": 11,
"type": "collision"
},
{
"id": 42,
"inputs": [
3,
13
],
"outputs": [
3,
13
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 43,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 45,
"inputs": [
3,
18
],
"outputs": [
3,
18
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 46,
"inputs": [
3,
22
],
"outputs": [
3,
22
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 49,
"inputs": [
32,
65535
],
"outputs": [
32,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 40,
"inputs": [
23,
32
],
"outputs": [
23,
32
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 1,
"inputs": [
0,
14
],
"outputs": [
0,
14
],
"begins_at": 10,
"ends_at": 11,
"type": "collision"
},
{
"id": 26,
"inputs": [
16,
65535
],
"outputs": [
16,
65535
],
"begins_at": 10,
"ends_at": 11,
"type": "collision"
},
{
"id": 41,
"inputs": [
24,
65535
],
"outputs": [
24,
65535
],
"begins_at": 10,
"ends_at": 11,
"type": "collision"
},
{
"id": 44,
"inputs": [
3,
16
],
"outputs": [
3,
16
],
"begins_at": 10,
"ends_at": 11,
"type": "collision"
},
{
"id": 11,
"inputs": [
10,
15
],
"outputs": [
10,
15
],
"begins_at": 10,
"ends_at": 11,
"type": "collision"
}
]
}Parsed ground truth
{
"objects": [
{
"id": 0,
"type": "purple airliner",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 260,
"y": 532
},
{
"t": 1,
"x": 258,
"y": 527
},
{
"t": 2,
"x": 258,
"y": 522
},
{
"t": 3,
"x": 257,
"y": 518
},
{
"t": 4,
"x": 256,
"y": 513
},
{
"t": 5,
"x": 255,
"y": 508
},
{
"t": 6,
"x": 255,
"y": 504
},
{
"t": 7,
"x": 254,
"y": 499
},
{
"t": 8,
"x": 253,
"y": 495
},
{
"t": 9,
"x": 252,
"y": 492
},
{
"t": 10,
"x": 251,
"y": 488
},
{
"t": 11,
"x": 251,
"y": 485
},
{
"t": 12,
"x": 250,
"y": 474
},
{
"t": 13,
"x": 249,
"y": 469
},
{
"t": 14,
"x": 248,
"y": 467
},
{
"t": 15,
"x": 248,
"y": 463
},
{
"t": 16,
"x": 248,
"y": 465
},
{
"t": 18,
"x": 247,
"y": 456
},
{
"t": 19,
"x": 246,
"y": 451
},
{
"t": 20,
"x": 246,
"y": 454
},
{
"t": 21,
"x": 245,
"y": 449
},
{
"t": 22,
"x": 245,
"y": 446
}
],
"birth": 0,
"death": 24
},
{
"id": 1,
"type": "cyan jet",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 323,
"y": 813
},
{
"t": 9,
"x": 325,
"y": 814
},
{
"t": 18,
"x": 326,
"y": 816
}
],
"birth": 0,
"death": 24
},
{
"id": 2,
"type": "cyan wagon",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 580,
"y": 980
},
{
"t": 1,
"x": 573,
"y": 976
},
{
"t": 2,
"x": 568,
"y": 972
},
{
"t": 3,
"x": 566,
"y": 968
},
{
"t": 4,
"x": 566,
"y": 964
},
{
"t": 5,
"x": 557,
"y": 959
},
{
"t": 6,
"x": 551,
"y": 956
},
{
"t": 7,
"x": 547,
"y": 952
},
{
"t": 8,
"x": 545,
"y": 949
},
{
"t": 9,
"x": 546,
"y": 945
},
{
"t": 10,
"x": 537,
"y": 942
},
{
"t": 11,
"x": 543,
"y": 939
},
{
"t": 12,
"x": 538,
"y": 935
},
{
"t": 13,
"x": 535,
"y": 932
},
{
"t": 14,
"x": 537,
"y": 929
},
{
"t": 15,
"x": 541,
"y": 926
},
{
"t": 16,
"x": 544,
"y": 924
},
{
"t": 17,
"x": 547,
"y": 921
},
{
"t": 18,
"x": 547,
"y": 918
},
{
"t": 19,
"x": 546,
"y": 914
},
{
"t": 20,
"x": 547,
"y": 917
},
{
"t": 21,
"x": 544,
"y": 909
},
{
"t": 22,
"x": 539,
"y": 898
},
{
"t": 23,
"x": 536,
"y": 895
}
],
"birth": 0,
"death": 24
},
{
"id": 3,
"type": "blue chopper",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 592,
"y": 832
},
{
"t": 2,
"x": 583,
"y": 818
},
{
"t": 4,
"x": 581,
"y": 816
},
{
"t": 5,
"x": 582,
"y": 818
},
{
"t": 6,
"x": 591,
"y": 833
},
{
"t": 7,
"x": 581,
"y": 818
},
{
"t": 8,
"x": 580,
"y": 816
},
{
"t": 11,
"x": 580,
"y": 818
},
{
"t": 12,
"x": 578,
"y": 816
},
{
"t": 13,
"x": 586,
"y": 832
},
{
"t": 14,
"x": 576,
"y": 816
},
{
"t": 15,
"x": 583,
"y": 827
},
{
"t": 16,
"x": 573,
"y": 814
},
{
"t": 18,
"x": 571,
"y": 814
},
{
"t": 20,
"x": 569,
"y": 810
},
{
"t": 21,
"x": 564,
"y": 800
},
{
"t": 22,
"x": 563,
"y": 798
},
{
"t": 23,
"x": 588,
"y": 832
}
],
"birth": 0,
"death": 24
}
],
"interactions": [
{
"id": 0,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 2,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 3,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 1,
"inputs": [
2,
3
],
"outputs": [
2,
3
],
"begins_at": 23,
"ends_at": 23,
"type": "collision"
}
]
}Complete per-sample evaluator report
{
"metrics": {
"avg_type_similarity": 0.34958211676395423,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 265.5538050261382,
"avg_image_position_segmentation_acc": 0.052083333333333336,
"avg_image_position_segmentation_acc_small": null,
"avg_image_position_segmentation_acc_medium": 0.0,
"avg_image_position_segmentation_acc_large": 0.06944444444444445,
"avg_image_position_segmentation_acc_first_frame": 0.0,
"avg_image_position_segmentation_visible_acc": 0.052083333333333336,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 0.5833333333333334,
"visibility_true_acc": 0.5833333333333334,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 0.5833333333333334,
"vis_acc_from_px_true_acc": 0.5833333333333334,
"vis_acc_from_px_false_acc": null,
"num_matches": 4,
"num_unmatched_pred": 62,
"num_unmatched_target": 0
},
"supports": {
"avg_type_similarity": 4,
"avg_size_diff": 0,
"avg_3d_iou": 0,
"avg_image_position_px_diff": 4,
"avg_image_position_segmentation_acc": 4,
"avg_image_position_segmentation_acc_small": 0,
"avg_image_position_segmentation_acc_medium": 1,
"avg_image_position_segmentation_acc_large": 3,
"avg_image_position_segmentation_acc_first_frame": 4,
"avg_image_position_segmentation_visible_acc": 4,
"avg_quaternion_geodesic_deg": 0,
"visibility_acc": 4,
"visibility_true_acc": 4,
"visibility_false_acc": 0,
"is_in_frame_acc": 4,
"is_in_frame_true_acc": 4,
"is_in_frame_false_acc": 0,
"vis_acc_from_px": 4,
"vis_acc_from_px_true_acc": 4,
"vis_acc_from_px_false_acc": 0
},
"matching": {
"matches": [
{
"target_index": 0,
"pred_index": 0,
"target_id": 0,
"pred_id": 0,
"cost": 0.7916666666666666,
"cost_breakdown": [
{
"name": "mutual_type",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "same_seg",
"weight": 1.0,
"raw_cost": 0.7916666666666666,
"weighted_cost": 0.7916666666666666,
"used_missing_value": false
}
]
},
{
"target_index": 1,
"pred_index": 3,
"target_id": 1,
"pred_id": 3,
"cost": 1.5,
"cost_breakdown": [
{
"name": "mutual_type",
"weight": 1.0,
"raw_cost": 0.5,
"weighted_cost": 0.5,
"used_missing_value": false
},
{
"name": "same_seg",
"weight": 1.0,
"raw_cost": 1.0,
"weighted_cost": 1.0,
"used_missing_value": false
}
]
},
{
"target_index": 2,
"pred_index": 6,
"target_id": 2,
"pred_id": 6,
"cost": 1.5,
"cost_breakdown": [
{
"name": "mutual_type",
"weight": 1.0,
"raw_cost": 0.5,
"weighted_cost": 0.5,
"used_missing_value": false
},
{
"name": "same_seg",
"weight": 1.0,
"raw_cost": 1.0,
"weighted_cost": 1.0,
"used_missing_value": false
}
]
},
{
"target_index": 3,
"pred_index": 36,
"target_id": 3,
"pred_id": 36,
"cost": 1.0,
"cost_breakdown": [
{
"name": "mutual_type",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "same_seg",
"weight": 1.0,
"raw_cost": 1.0,
"weighted_cost": 1.0,
"used_missing_value": false
}
]
}
],
"unmatched_target_ids": [],
"unmatched_pred_ids": [
1,
2,
4,
5,
7,
8,
9,
10,
11,
12,
13,
14,
15,
16,
17,
18,
19,
20,
21,
22,
23,
24,
25,
26,
27,
28,
29,
30,
31,
32,
33,
34,
35,
37,
38,
39,
40,
41,
42,
43,
44,
45,
46,
47,
48,
49,
50,
51,
52,
53,
54,
55,
56,
57,
58,
59,
60,
61,
62,
63,
64,
65
],
"target_type_counts": {
"purple airliner": 1,
"cyan jet": 1,
"cyan wagon": 1,
"blue chopper": 1
},
"pred_type_counts": {
"purple and pink athletic shoe": 2,
"dark grey and light grey plastic monster action figure": 2,
"white and purple plastic supplement bottle": 1,
"white and gold plastic winged unicorn figurine": 2,
"pink and purple wooden toy castle": 3,
"light grey and black sneaker": 1,
"teal fabric mermaid backpack": 6,
"wooden toy juicer set": 3,
"light brown wooden fruit and vegetable domino set": 1,
"dark grey and pink running shoe": 2,
"blue and red running shoe": 1,
"teal and lime running shoe": 1,
"dark red and black plastic curling wand": 1,
"dark grey cardboard motherboard box": 4,
"white and blue cardboard ink cartridge box": 1,
"dark blue leather boat shoe": 1,
"white cardboard box of personal blender jars": 1,
"black and yellow rubber mallet": 3,
"grey, purple, and mint green high-top sneaker": 1,
"dark grey plastic supplement bottle with orange cap": 2,
"grey and white plastic shark figurine": 3,
"dark brown fabric loafer": 2,
"grey and white plush shark": 1,
"blue and white cardboard snack cake box": 2,
"white and tan plastic unicorn figurine": 1,
"blue and black plastic DVD set": 2,
"white and tan leather boat shoe": 1,
"black and grey high-top sneaker": 1,
"white and orange cardboard serum box": 1,
"blue and black hiking shoe": 2,
"grey and black basketball shoe": 1,
"blue and green cardboard candy bar box": 1,
"blue and green cardboard retail box for inflatable neck rest": 1,
"dark grey plastic supplement bottle": 2,
"light blue cardboard argan oil treatment box": 1,
"blue and white athletic shoe": 1,
"white cardboard ink cartridge box": 1,
"black and blue fabric boat shoe": 1,
"white plastic Pop-O-Matic game": 1,
"white and green cardboard ink cartridge box": 1
},
"assignment_backend": "scipy_dense",
"cost_functions": [
"mutual_type",
"same_seg"
],
"cost_weights": {
"mutual_type": 1.0,
"same_seg": 1.0
},
"num_frames": 24
},
"scene_metrics": {
"thresholds": [
0.5,
1.0,
2.0,
3.0
],
"counts_by_threshold": {
"0.5": {
"true_positives": 2,
"false_positives": 2,
"false_negatives": 0
},
"1.0": {
"true_positives": 1,
"false_positives": 3,
"false_negatives": 0
},
"2.0": {
"true_positives": 0,
"false_positives": 4,
"false_negatives": 0
},
"3.0": {
"true_positives": 0,
"false_positives": 4,
"false_negatives": 0
}
},
"jaccard_by_threshold": {
"0.5": 0.5,
"1.0": 0.25,
"2.0": 0.0,
"3.0": 0.0
},
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 63,
"false_negatives": 1
},
"0.5": {
"true_positives": 3,
"false_positives": 63,
"false_negatives": 1
},
"0.75": {
"true_positives": 1,
"false_positives": 65,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 66,
"false_negatives": 4
}
},
"visibility_precision_by_threshold": {
"0.25": 0.045454545454545456,
"0.5": 0.045454545454545456,
"0.75": 0.015151515151515152,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.75,
"0.5": 0.75,
"0.75": 0.25,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.08571428571428572,
"0.5": 0.08571428571428572,
"0.75": 0.028571428571428574,
"1.0": 0.0
},
"visibility_by_motion_group": {
"static": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 1,
"false_positives": 0,
"false_negatives": 0
},
"0.5": {
"true_positives": 1,
"false_positives": 0,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 1,
"false_negatives": 1
},
"1.0": {
"true_positives": 0,
"false_positives": 1,
"false_negatives": 1
}
},
"visibility_precision_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"dynamic": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 1,
"false_positives": 1,
"false_negatives": 1
},
"0.5": {
"true_positives": 1,
"false_positives": 1,
"false_negatives": 1
},
"0.75": {
"true_positives": 1,
"false_positives": 1,
"false_negatives": 1
},
"1.0": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 2
}
},
"visibility_precision_by_threshold": {
"0.25": 0.5,
"0.5": 0.5,
"0.75": 0.5,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.5,
"0.5": 0.5,
"0.75": 0.5,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.5,
"0.5": 0.5,
"0.75": 0.5,
"1.0": 0.0
}
},
"unknown": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 1,
"false_positives": 62,
"false_negatives": 0
},
"0.5": {
"true_positives": 1,
"false_positives": 62,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 63,
"false_negatives": 1
},
"1.0": {
"true_positives": 0,
"false_positives": 63,
"false_negatives": 1
}
},
"visibility_precision_by_threshold": {
"0.25": 0.015873015873015872,
"0.5": 0.015873015873015872,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.03125,
"0.5": 0.03125,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"segmentation_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 66,
"false_negatives": 4
},
"0.5": {
"true_positives": 0,
"false_positives": 66,
"false_negatives": 4
},
"0.75": {
"true_positives": 0,
"false_positives": 66,
"false_negatives": 4
},
"1.0": {
"true_positives": 0,
"false_positives": 66,
"false_negatives": 4
}
},
"segmentation_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_frame_average_precision": 0.0,
"segmentation_frame_average_recall": 0.0,
"segmentation_frame_average_f1": 0.0,
"segmentation_first_frame_counts": {
"true_positives": 0,
"false_positives": 66,
"false_negatives": 0
},
"segmentation_first_frame_precision": 0.0,
"segmentation_first_frame_recall": 0.0,
"segmentation_first_frame_f1": 0.0,
"segmentation_by_motion_group": {
"static": {
"segmentation_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 1,
"false_negatives": 1
},
"0.5": {
"true_positives": 0,
"false_positives": 1,
"false_negatives": 1
},
"0.75": {
"true_positives": 0,
"false_positives": 1,
"false_negatives": 1
},
"1.0": {
"true_positives": 0,
"false_positives": 1,
"false_negatives": 1
}
},
"segmentation_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_frame_average_precision": 0.0,
"segmentation_frame_average_recall": 0.0,
"segmentation_frame_average_f1": 0.0,
"segmentation_first_frame_counts": {
"true_positives": 0,
"false_positives": 1,
"false_negatives": 0
},
"segmentation_first_frame_precision": 0.0,
"segmentation_first_frame_recall": 0.0,
"segmentation_first_frame_f1": 0.0
},
"dynamic": {
"segmentation_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 2
},
"0.5": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 2
},
"0.75": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 2
},
"1.0": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 2
}
},
"segmentation_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_frame_average_precision": 0.0,
"segmentation_frame_average_recall": 0.0,
"segmentation_frame_average_f1": 0.0,
"segmentation_first_frame_counts": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 0
},
"segmentation_first_frame_precision": 0.0,
"segmentation_first_frame_recall": 0.0,
"segmentation_first_frame_f1": 0.0
},
"unknown": {
"segmentation_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 63,
"false_negatives": 1
},
"0.5": {
"true_positives": 0,
"false_positives": 63,
"false_negatives": 1
},
"0.75": {
"true_positives": 0,
"false_positives": 63,
"false_negatives": 1
},
"1.0": {
"true_positives": 0,
"false_positives": 63,
"false_negatives": 1
}
},
"segmentation_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_frame_average_precision": 0.0,
"segmentation_frame_average_recall": 0.0,
"segmentation_frame_average_f1": 0.0,
"segmentation_first_frame_counts": {
"true_positives": 0,
"false_positives": 63,
"false_negatives": 0
},
"segmentation_first_frame_precision": 0.0,
"segmentation_first_frame_recall": 0.0,
"segmentation_first_frame_f1": 0.0
}
}
},
"per_match_metrics": [
{
"target_id": 0,
"pred_id": 0,
"cost": 0.7916666666666666,
"type_similarity": 0.5249543618009758,
"size_diff": null,
"3d_iou": null,
"image_position_px_diff": 124.084896503173,
"image_position_segmentation_acc": 0.20833333333333334,
"image_position_segmentation_acc_small": null,
"image_position_segmentation_acc_medium": null,
"image_position_segmentation_acc_large": 0.20833333333333334,
"image_position_segmentation_acc_first_frame": 0.0,
"image_position_segmentation_visible_acc": 0.20833333333333334,
"quaternion_geodesic_deg": null,
"visibility_acc": 0.7083333333333334,
"visibility_true_acc": 0.7083333333333334,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 0.7083333333333334,
"vis_acc_from_px_true_acc": 0.7083333333333334,
"vis_acc_from_px_false_acc": null
},
{
"target_id": 1,
"pred_id": 3,
"cost": 1.5,
"type_similarity": 0.27431471140427294,
"size_diff": null,
"3d_iou": null,
"image_position_px_diff": 287.27893218865006,
"image_position_segmentation_acc": 0.0,
"image_position_segmentation_acc_small": null,
"image_position_segmentation_acc_medium": null,
"image_position_segmentation_acc_large": 0.0,
"image_position_segmentation_acc_first_frame": 0.0,
"image_position_segmentation_visible_acc": 0.0,
"quaternion_geodesic_deg": null,
"visibility_acc": 0.5833333333333334,
"visibility_true_acc": 0.5833333333333334,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 0.5833333333333334,
"vis_acc_from_px_true_acc": 0.5833333333333334,
"vis_acc_from_px_false_acc": null
},
{
"target_id": 2,
"pred_id": 6,
"cost": 1.5,
"type_similarity": 0.2577230193236791,
"size_diff": null,
"3d_iou": null,
"image_position_px_diff": 441.2203824307737,
"image_position_segmentation_acc": 0.0,
"image_position_segmentation_acc_small": null,
"image_position_segmentation_acc_medium": null,
"image_position_segmentation_acc_large": 0.0,
"image_position_segmentation_acc_first_frame": 0.0,
"image_position_segmentation_visible_acc": 0.0,
"quaternion_geodesic_deg": null,
"visibility_acc": 0.875,
"visibility_true_acc": 0.875,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 0.875,
"vis_acc_from_px_true_acc": 0.875,
"vis_acc_from_px_false_acc": null
},
{
"target_id": 3,
"pred_id": 36,
"cost": 1.0,
"type_similarity": 0.34133637452688925,
"size_diff": null,
"3d_iou": null,
"image_position_px_diff": 209.63100898195594,
"image_position_segmentation_acc": 0.0,
"image_position_segmentation_acc_small": null,
"image_position_segmentation_acc_medium": 0.0,
"image_position_segmentation_acc_large": null,
"image_position_segmentation_acc_first_frame": 0.0,
"image_position_segmentation_visible_acc": 0.0,
"quaternion_geodesic_deg": null,
"visibility_acc": 0.16666666666666666,
"visibility_true_acc": 0.16666666666666666,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 0.16666666666666666,
"vis_acc_from_px_true_acc": 0.16666666666666666,
"vis_acc_from_px_false_acc": null
}
],
"interaction_metrics": {
"avg_interaction_temporal_span_giou": 0.14732142857142855,
"avg_interaction_input_object_jaccard": 0.5833333333333334,
"avg_interaction_output_object_jaccard": 0.5833333333333334,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 4,
"num_unmatched_pred_interactions": 67,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 68,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 71,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 71,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 71,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.04225352112676056,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.08108108108108109,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 68,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 69,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 69,
"false_negatives": 0
},
"1.0": {
"true_positives": 2,
"false_positives": 69,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.04225352112676056,
"0.5": 0.028169014084507043,
"0.75": 0.028169014084507043,
"1.0": 0.028169014084507043
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.08108108108108109,
"0.5": 0.05479452054794521,
"0.75": 0.05479452054794521,
"1.0": 0.05479452054794521
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 68,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 69,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 69,
"false_negatives": 0
},
"1.0": {
"true_positives": 2,
"false_positives": 69,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.04225352112676056,
"0.5": 0.028169014084507043,
"0.75": 0.028169014084507043,
"1.0": 0.028169014084507043
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.08108108108108109,
"0.5": 0.05479452054794521,
"0.75": 0.05479452054794521,
"1.0": 0.05479452054794521
}
},
"interaction_supports": {
"avg_interaction_temporal_span_giou": 4,
"avg_interaction_input_object_jaccard": 4,
"avg_interaction_output_object_jaccard": 4,
"avg_interaction_type_exact_match_acc": 4
},
"interaction_matching": {
"matches": [
{
"target_index": 0,
"pred_index": 64,
"target_id": 0,
"pred_id": 50,
"cost": 0.27083333333333337,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.27083333333333337,
"weighted_cost": 0.27083333333333337,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
}
]
},
{
"target_index": 1,
"pred_index": 2,
"target_id": 1,
"pred_id": 1,
"cost": 1.3928571428571428,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.8928571428571428,
"weighted_cost": 0.8928571428571428,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 2,
"pred_index": 67,
"target_id": 2,
"pred_id": 53,
"cost": 0.27083333333333337,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.27083333333333337,
"weighted_cost": 0.27083333333333337,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
}
]
},
{
"target_index": 3,
"pred_index": 3,
"target_id": 3,
"pred_id": 2,
"cost": 0.27083333333333337,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.27083333333333337,
"weighted_cost": 0.27083333333333337,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
}
]
}
],
"unmatched_target_ids": [],
"unmatched_pred_ids": [
0,
1,
3,
3,
4,
5,
6,
7,
8,
9,
10,
11,
11,
12,
13,
14,
15,
16,
17,
18,
19,
20,
21,
22,
22,
23,
24,
25,
26,
26,
27,
28,
29,
30,
31,
32,
33,
34,
35,
36,
37,
38,
39,
40,
40,
41,
41,
41,
42,
42,
43,
43,
44,
44,
45,
45,
46,
46,
47,
48,
49,
49,
51,
52,
54,
55,
56
],
"target_type_counts": {
"contact": 3,
"collision": 1
},
"pred_type_counts": {
"contact": 48,
"collision": 23
},
"assignment_backend": "scipy_dense",
"cost_functions": [
"type_exact",
"temporal_span",
"input_object_set_mutual_jaccard",
"output_object_set_mutual_jaccard"
],
"cost_weights": {
"type_exact": 1.0,
"temporal_span": 1.0,
"input_object_set_mutual_jaccard": 0.5,
"output_object_set_mutual_jaccard": 0.5
}
},
"per_interaction_match_metrics": [
{
"target_index": 0,
"pred_index": 64,
"target_id": 0,
"pred_id": 50,
"target_type": "contact",
"pred_type": "contact",
"cost": 0.27083333333333337,
"temporal_span_iou": 0.4583333333333333,
"temporal_span_giou": 0.4583333333333333,
"input_object_jaccard": 1.0,
"output_object_jaccard": 1.0,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 1.0,
"output_object_set_exact_match": 1.0
},
{
"target_index": 1,
"pred_index": 2,
"target_id": 1,
"pred_id": 1,
"target_type": "collision",
"pred_type": "collision",
"cost": 1.3928571428571428,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.7857142857142857,
"input_object_jaccard": 0.0,
"output_object_jaccard": 0.0,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 2,
"pred_index": 67,
"target_id": 2,
"pred_id": 53,
"target_type": "contact",
"pred_type": "contact",
"cost": 0.27083333333333337,
"temporal_span_iou": 0.4583333333333333,
"temporal_span_giou": 0.4583333333333333,
"input_object_jaccard": 1.0,
"output_object_jaccard": 1.0,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 1.0,
"output_object_set_exact_match": 1.0
},
{
"target_index": 3,
"pred_index": 3,
"target_id": 3,
"pred_id": 2,
"target_type": "contact",
"pred_type": "contact",
"cost": 0.27083333333333337,
"temporal_span_iou": 0.4583333333333333,
"temporal_span_giou": 0.4583333333333333,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
}
],
"interaction_metrics_by_participants": {
"object_ground": {
"avg_interaction_temporal_span_giou": 0.4583333333333333,
"avg_interaction_input_object_jaccard": 0.7777777777777778,
"avg_interaction_output_object_jaccard": 0.7777777777777778,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 3,
"num_unmatched_pred_interactions": 37,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 37,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 40,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 40,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 40,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.075,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.13953488372093023,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 37,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 38,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 38,
"false_negatives": 0
},
"1.0": {
"true_positives": 2,
"false_positives": 38,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.075,
"0.5": 0.05,
"0.75": 0.05,
"1.0": 0.05
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.13953488372093023,
"0.5": 0.09523809523809523,
"0.75": 0.09523809523809523,
"1.0": 0.09523809523809523
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 37,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 38,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 38,
"false_negatives": 0
},
"1.0": {
"true_positives": 2,
"false_positives": 38,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.075,
"0.5": 0.05,
"0.75": 0.05,
"1.0": 0.05
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.13953488372093023,
"0.5": 0.09523809523809523,
"0.75": 0.09523809523809523,
"1.0": 0.09523809523809523
}
},
"object_object": {
"avg_interaction_temporal_span_giou": -0.7857142857142857,
"avg_interaction_input_object_jaccard": 0.0,
"avg_interaction_output_object_jaccard": 0.0,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 1,
"num_unmatched_pred_interactions": 30,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 31,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 31,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 31,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 31,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 31,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 31,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 31,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 31,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 31,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 31,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 31,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 31,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"interaction_supports_by_participants": {
"object_ground": {
"avg_interaction_temporal_span_giou": 3,
"avg_interaction_input_object_jaccard": 3,
"avg_interaction_output_object_jaccard": 3,
"avg_interaction_type_exact_match_acc": 3
},
"object_object": {
"avg_interaction_temporal_span_giou": 1,
"avg_interaction_input_object_jaccard": 1,
"avg_interaction_output_object_jaccard": 1,
"avg_interaction_type_exact_match_acc": 1
}
},
"interaction_metrics_by_type": {
"collision": {
"avg_interaction_temporal_span_giou": -0.7857142857142857,
"avg_interaction_input_object_jaccard": 0.0,
"avg_interaction_output_object_jaccard": 0.0,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 1,
"num_unmatched_pred_interactions": 22,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 23,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"contact": {
"avg_interaction_temporal_span_giou": 0.4583333333333333,
"avg_interaction_input_object_jaccard": 0.7777777777777778,
"avg_interaction_output_object_jaccard": 0.7777777777777778,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 3,
"num_unmatched_pred_interactions": 45,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 45,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 48,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 48,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 48,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0625,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.11764705882352941,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 45,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 46,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 46,
"false_negatives": 0
},
"1.0": {
"true_positives": 2,
"false_positives": 46,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0625,
"0.5": 0.041666666666666664,
"0.75": 0.041666666666666664,
"1.0": 0.041666666666666664
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.11764705882352941,
"0.5": 0.07999999999999999,
"0.75": 0.07999999999999999,
"1.0": 0.07999999999999999
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 3,
"false_positives": 45,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 46,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 46,
"false_negatives": 0
},
"1.0": {
"true_positives": 2,
"false_positives": 46,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0625,
"0.5": 0.041666666666666664,
"0.75": 0.041666666666666664,
"1.0": 0.041666666666666664
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.11764705882352941,
"0.5": 0.07999999999999999,
"0.75": 0.07999999999999999,
"1.0": 0.07999999999999999
}
}
},
"interaction_supports_by_type": {
"collision": {
"avg_interaction_temporal_span_giou": 1,
"avg_interaction_input_object_jaccard": 1,
"avg_interaction_output_object_jaccard": 1,
"avg_interaction_type_exact_match_acc": 1
},
"contact": {
"avg_interaction_temporal_span_giou": 3,
"avg_interaction_input_object_jaccard": 3,
"avg_interaction_output_object_jaccard": 3,
"avg_interaction_type_exact_match_acc": 3
}
}
}Exact evaluation configuration
{
"predictions_jsonl": "../inference_output.jsonl",
"dataset_json": "../test_data/movi_dump_sentinel_sharegpt.json",
"scene_root": "../test_data/movi_dump",
"output_json": "../evaluation_report.json",
"max_samples": null,
"num_workers": 1,
"show_progress": true,
"log_level": "INFO",
"visibility_filter_mode": "any_frame",
"pos2d_mode": "scaled_normalized",
"pos2d_scale": 1000.0,
"image_width": null,
"image_height": null,
"type_embed_model_name": "all-MiniLM-L6-v2",
"scene_similarity_thresholds": [
0.5,
1.0,
2.0,
3.0
],
"scene_segmentation_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"matching": {
"costs": [
{
"name": "mutual_type",
"weight": 1.0
},
{
"name": "same_seg",
"weight": 1.0,
"missing_value": 1.0,
"kwargs": {
"only_use_first_frame": false
}
}
]
},
"interaction_matching": {
"costs": [
{
"name": "type_exact",
"weight": 1.0
},
{
"name": "temporal_span",
"weight": 1.0
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5
}
]
},
"return_per_sample": true
}