STRIVE · 08/28/2026
Dyn generalization · val_120 · super_clevr_1023
Everything fed into evaluation and the full per-sample output it produced.
Dataset row: exact video + user prompt + assistant target
{
"messages": [
{
"role": "user",
"content": "<video>\nAnalyze the provided video and return ONLY a valid sentinel sequence in this format:\n[SCENE-START] [OBJS-START]\n[OBJ] id \"type\" birth death [VIS] t vis ... [IN-FRAME] t is_in_frame ... [PX] t px py ...\n[OBJ] ...\n[OBJS-END]\n[INTERACTIONS-START]\n[INTERACT] id \"type\" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ...\n[INTERACT] ...\n[INTERACTIONS-END] [SCENE-END]\n\nConstraints:\n- Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose).\n- Keep tags exactly as written:\n `[SCENE-START] [OBJS-START] [OBJ] [VIS] [IN-FRAME] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]`\n- Use quoted strings for `type` (double quotes).\n- `VIS` uses repeated groups of 2 values in order:\n `t vis`.\n `vis` is a boolean value.\n- `IN-FRAME` uses repeated groups of 2 values in order:\n `t is_in_frame`.\n `is_in_frame` is a boolean value.\n- `PX` uses repeated groups of 3 values in order: `t px py`.\n- `px` and `py` are normalized pixel coordinates in the range `[0, 1]`,\n scaled by `1000` and then converted to integers by dropping the decimal part.\n- For occluded or out-of-frame frames under this setting, `PX` may use `t null null`.\n- `IN` and `OUT` contain whitespace-separated integer ids.\n- Use lowercase booleans (`true`/`false`) for `vis` and `is_in_frame`."
},
{
"role": "assistant",
"content": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown utility\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 0 669 1 2 669 2 2 659 3 2 655 4 5 654 5 2 651 7 5 652 8 8 654 9 16 654 10 18 653 11 23 653 12 26 654 13 33 655 14 36 654 15 5 678 16 47 656 17 11 676 18 55 656 19 21 679 20 24 678 21 28 679 22 34 680 23 35 678 24 40 679 25 44 680 26 87 658 27 92 658 28 95 658 29 60 680 30 64 680 31 108 659 32 112 659 33 116 659 34 119 660 35 124 659 36 63 653 37 133 660 38 136 661 39 141 661 40 144 660 41 148 663 42 152 664 43 156 663 44 161 663 45 166 663 46 169 664 47 173 665 48 177 666 49 182 666 50 185 668 51 189 669 52 194 671 53 198 672 54 152 641 55 166 692 56 162 646 57 166 649 58 169 652 59 173 656 60 177 660 61 186 696 62 185 670 63 190 673 64 192 672 65 196 674 66 199 675 67 202 676 68 205 677 69 209 678 70 211 679 71 215 680 72 218 680 73 221 681 74 223 682 75 227 683 76 230 684 77 234 685 78 237 686 79 241 694 80 243 688 81 247 690 82 251 692 83 253 692 84 256 693 85 258 693 86 262 693 87 266 694 88 268 694 89 271 694 90 274 694 91 276 694 92 280 694 93 282 693 94 285 693 95 288 693 96 291 692 97 294 693 98 298 693 99 298 691 100 301 691 101 304 691 102 307 691 103 308 690 104 312 692 106 331 701 107 312 698 108 361 684 109 360 690 110 366 684 111 369 684 112 330 688 113 333 688 114 335 686 115 337 684 116 339 683 117 341 682 118 342 680 119 344 679 [OBJ] 1 \"gray jet\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 365 246 1 366 248 2 369 250 3 370 253 4 372 257 5 374 263 6 376 268 7 378 275 8 380 281 9 381 289 10 383 297 11 385 306 12 387 316 13 388 325 14 391 335 15 392 347 16 393 358 17 393 369 18 394 381 19 396 395 20 397 408 21 411 418 22 412 430 23 408 449 24 411 461 25 410 478 26 410 497 27 412 513 28 413 528 29 414 545 30 416 560 31 417 577 32 418 595 33 419 613 34 421 630 35 422 648 36 423 661 37 424 680 38 425 698 39 426 716 40 428 734 41 429 753 42 430 772 43 430 791 44 431 810 45 432 829 46 433 838 47 434 834 48 435 830 49 436 822 50 436 814 51 437 805 52 437 799 53 437 792 54 437 786 55 438 781 56 438 776 57 438 772 58 439 768 59 440 764 61 441 758 63 441 755 65 442 753 69 444 755 72 444 757 74 445 760 76 446 765 77 447 767 81 448 763 82 448 759 84 448 756 85 449 753 87 449 750 89 450 746 91 450 742 93 451 739 96 451 734 98 451 732 101 452 730 102 453 728 104 453 725 107 454 723 112 455 720 115 456 718 118 458 717 [OBJ] 2 \"red cruiser\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 556 655 13 552 657 22 556 655 28 558 654 34 555 655 35 561 663 36 569 670 37 557 642 38 557 650 39 555 655 52 553 654 56 551 655 64 549 656 66 551 656 68 553 658 69 551 659 71 551 661 72 551 664 74 552 667 75 551 669 76 526 673 77 529 673 78 548 668 80 526 672 81 548 667 82 591 666 84 546 668 85 526 674 88 523 671 99 524 674 115 526 674 117 527 672 119 580 660 [OBJ] 3 \"purple minivan\" 23 120 [VIS] 0 false 23 true [IN-FRAME] 0 false 23 true [PX] 0 null null 23 0 644 24 3 647 25 5 649 26 7 633 27 9 633 28 12 634 29 13 633 30 16 633 31 18 633 32 19 632 33 22 632 34 24 632 35 26 632 36 29 632 37 30 631 38 33 632 39 34 633 42 35 631 45 44 631 46 41 631 47 38 631 48 65 630 49 62 630 51 65 630 52 83 629 54 90 629 55 81 630 56 106 628 57 98 629 58 105 628 59 114 628 60 130 626 62 176 624 63 172 624 65 179 624 66 187 624 67 194 623 68 207 623 69 217 622 71 226 622 72 240 620 74 229 622 75 247 620 76 244 621 77 288 618 78 293 618 79 295 618 80 310 617 83 333 616 86 335 616 87 343 616 88 356 615 90 364 615 91 378 614 93 384 614 94 372 615 95 401 613 96 405 613 97 392 614 98 424 610 99 406 614 100 412 613 101 419 613 102 448 609 103 432 613 104 438 611 105 445 611 106 451 611 107 475 608 108 464 610 109 470 610 111 484 608 112 489 609 113 494 608 115 498 607 116 548 603 117 550 604 [OBJS-END] [INTERACTIONS-START] [INTERACT] 1 \"contact\" 0 63 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 14 \"contact\" 0 79 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 18 \"contact\" 0 119 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"collision\" 46 46 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 7 \"collision\" 49 49 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"collision\" 67 67 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 3 \"contact\" 68 119 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 8 \"collision\" 70 70 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 9 \"collision\" 75 75 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 10 \"collision\" 77 77 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 11 \"contact\" 78 79 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 12 \"collision\" 81 81 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 13 \"contact\" 82 113 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 15 \"collision\" 83 83 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 16 \"collision\" 85 85 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 17 \"contact\" 86 119 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 0 \"collision\" 114 114 [IN] 0 1 [OUT] 0 1 [INTERACT] 4 \"collision\" 115 115 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 \"contact\" 116 119 [IN] 1 65535 [OUT] 1 65535 [INTERACTIONS-END] [SCENE-END]"
}
],
"videos": [
"/mmfs1/gscratch/krishna/suryadv/strive_dynsuperclevr/data/lf/videos/val_full/super_clevr_1023/frames.mp4"
]
}Inference record: exact prompt + prediction + label + parse debug
{
"prompt": "user\n\nAnalyze the provided video and return ONLY a valid sentinel sequence in this format:\n[SCENE-START] [OBJS-START]\n[OBJ] id \"type\" birth death [VIS] t vis ... [IN-FRAME] t is_in_frame ... [PX] t px py ...\n[OBJ] ...\n[OBJS-END]\n[INTERACTIONS-START]\n[INTERACT] id \"type\" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ...\n[INTERACT] ...\n[INTERACTIONS-END] [SCENE-END]\n\nConstraints:\n- Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose).\n- Keep tags exactly as written:\n `[SCENE-START] [OBJS-START] [OBJ] [VIS] [IN-FRAME] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]`\n- Use quoted strings for `type` (double quotes).\n- `VIS` uses repeated groups of 2 values in order:\n `t vis`.\n `vis` is a boolean value.\n- `IN-FRAME` uses repeated groups of 2 values in order:\n `t is_in_frame`.\n `is_in_frame` is a boolean value.\n- `PX` uses repeated groups of 3 values in order: `t px py`.\n- `px` and `py` are normalized pixel coordinates in the range `[0, 1]`,\n scaled by `1000` and then converted to integers by dropping the decimal part.\n- For occluded or out-of-frame frames under this setting, `PX` may use `t null null`.\n- `IN` and `OUT` contain whitespace-separated integer ids.\n- Use lowercase booleans (`true`/`false`) for `vis` and `is_in_frame`.\nassistant\n",
"predict": "[SCENE-START] [OBJS-START] [OBJ] 0 \"red and brown leather camp shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 1 669 1 5 677 2 9 685 3 13 693 4 13 673 5 17 681 7 25 689 9 33 697 11 41 701 13 48 705 14 56 708 16 64 712 18 72 716 20 80 720 22 87 724 23 95 728 [OBJ] 1 \"purple plastic medicine bottle\" 0 24 [VIS] 0 false 13 true [IN-FRAME] 0 true [PX] 0 null null 13 111 658 14 103 662 15 95 666 16 87 669 17 80 673 18 72 677 20 60 685 22 48 693 23 41 697 [OBJ] 2 \"purple plastic medicine bottle\" 0 24 [VIS] 0 false 13 true [IN-FRAME] 0 true [PX] 0 null null 13 134 658 14 126 662 16 115 669 18 103 677 19 95 681 21 83 689 23 72 697 [OBJ] 3 \"purple plastic medicine bottle\" 0 24 [VIS] 0 false 13 true [IN-FRAME] 0 true [PX] 0 null null 13 169 669 14 162 673 15 154 677 16 146 681 18 138 685 19 130 689 20 123 693 22 115 697 23 107 701 [OBJ] 4 \"purple plastic medicine bottle\" 0 24 [VIS] 0 false 13 true [IN-FRAME] 0 true [PX] 0 null null 13 201 673 14 193 677 15 185 681 17 173 689 18 166 693 20 154 697 21 146 701 23 134 705 [OBJ] 5 \"pink and purple plastic package of overnight pads\" 0 24 [VIS] 0 false 13 true [IN-FRAME] 0 true [PX] 0 null null 13 185 634 14 173 638 16 162 642 18 150 646 20 142 650 22 134 654 [OBJ] 6 \"purple plastic medicine bottle\" 0 24 [VIS] 0 false 13 true [IN-FRAME] 0 true [PX] 0 null null 13 248 658 14 240 662 16 232 666 18 224 669 20 216 673 22 208 677 23 201 681 [OBJ] 7 \"dark red and black plastic curling wand\" 0 24 [VIS] 0 false 13 true [IN-FRAME] 0 true [PX] 0 null null 13 263 666 15 255 669 18 248 673 20 240 677 23 232 681 [OBJ] 8 \"purple and white high-top sneaker\" 0 24 [VIS] 0 false 13 true [IN-FRAME] 0 true [PX] 0 null null 13 275 654 14 267 658 16 259 662 18 251 666 20 244 669 23 236 673 [OBJ] 9 \"purple plastic medicine bottle\" 0 24 [VIS] 0 false 13 true [IN-FRAME] 0 true [PX] 0 null null 13 298 662 14 291 666 17 283 669 20 275 673 23 267 677 [OBJ] 10 \"red plastic hair dryer\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 365 298 1 369 306 2 373 314 3 376 322 4 380 330 5 384 337 6 388 345 7 392 353 8 396 361 9 400 373 10 404 384 11 408 400 12 412 416 13 416 431 14 419 447 15 423 466 16 431 494 17 439 525 18 443 556 19 447 587 20 455 611 21 462 623 22 470 630 23 474 638 [OBJ] 11 \"red and white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 369 263 1 373 271 2 376 279 3 380 287 4 384 294 5 388 302 6 392 310 7 396 318 8 400 326 9 404 337 10 408 345 11 412 357 12 416 365 13 419 376 14 423 392 15 427 404 16 431 416 17 435 435 18 439 455 19 443 474 20 447 501 21 451 529 22 455 552 23 458 572 [OBJ] 12 \"red and white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 412 275 1 419 287 2 423 294 3 427 302 4 431 310 5 435 318 6 439 326 7 443 333 8 447 341 9 451 349 10 455 357 11 458 365 12 462 373 13 466 380 14 470 388 15 474 400 16 478 412 17 482 419 18 486 431 19 490 443 20 494 451 21 498 458 22 501 466 23 505 474 [OBJ] 13 \"grey and white plastic shark figurine\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 470 447 2 462 451 4 455 455 6 451 462 8 458 466 9 443 470 12 435 474 14 427 478 16 439 478 17 419 482 18 435 482 19 419 486 20 431 486 21 416 490 22 427 490 23 412 494 [OBJ] 14 \"red and white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 474 451 3 466 455 7 458 458 10 451 462 14 443 466 17 435 470 21 427 474 [OBJ] 15 \"red and yellow running shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 482 642 4 474 638 12 466 642 18 455 642 20 447 646 23 439 650 [OBJ] 16 \"red and white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 525 451 1 517 447 2 525 451 6 513 451 11 505 455 17 498 458 22 490 462 [OBJ] 17 \"grey and black fabric running shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 533 439 1 521 439 4 509 439 6 521 443 7 505 443 10 494 443 13 505 447 14 486 447 17 474 447 20 486 451 21 466 451 [OBJ] 18 \"red and white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 537 451 2 525 451 5 513 451 9 505 455 13 494 455 17 486 458 21 478 462 [OBJ] 19 \"red and white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 541 447 3 533 451 7 525 455 11 517 458 15 509 462 19 501 466 23 494 470 [OBJ] 20 \"red and white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 552 451 4 541 451 8 533 455 12 521 455 16 513 458 20 501 458 [OBJ] 21 \"red and white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 564 447 2 556 451 6 548 455 10 541 458 14 533 462 18 525 466 22 517 470 [OBJ] 22 \"red and yellow running shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 576 458 4 568 462 9 560 466 14 552 470 20 544 474 [OBJ] 23 \"red and yellow running shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 607 458 5 599 462 10 591 466 15 583 470 19 576 474 [OBJ] 24 \"red and yellow running shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 611 455 4 603 458 8 595 462 13 587 466 18 580 470 23 572 474 [OBJ] 25 \"red and yellow running shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 619 451 3 611 455 6 603 458 10 595 462 14 587 466 18 580 470 22 572 474 [OBJ] 26 \"grey and white plastic shark figurine\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 623 462 1 611 462 2 623 462 4 611 462 5 619 458 6 607 462 12 595 462 16 583 462 21 572 462 [OBJ] 27 \"red and yellow running shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 630 654 1 619 654 4 611 650 6 619 654 7 607 650 11 619 658 12 603 654 15 595 650 16 603 654 17 591 650 18 599 654 19 587 650 20 595 654 21 583 650 22 591 654 23 576 650 [OBJ] 28 \"purple wooden dollhouse table\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 748 466 13 736 466 18 728 470 [OBJ] 29 \"pink rubber teething toy\" 12 24 [VIS] 0 false 12 true [IN-FRAME] 0 false 12 true [PX] 0 null null 12 1 634 14 9 642 15 9 654 16 13 662 18 13 677 20 13 689 22 13 701 23 9 693 [OBJS-END] [INTERACTIONS-START] [INTERACT] 34 \"contact\" 0 1 [IN] 29 65535 [OUT] 29 65535 [INTERACT] 1 \"contact\" 0 23 [IN] 1 2 [OUT] 1 2 [INTERACT] 0 \"contact\" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 2 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 24 \"contact\" 0 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 25 \"contact\" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 26 \"contact\" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 27 \"contact\" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 28 \"contact\" 0 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 29 \"contact\" 0 23 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 30 \"contact\" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 31 \"contact\" 0 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 5 \"contact\" 0 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 6 \"contact\" 0 23 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 7 \"contact\" 0 23 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 8 \"contact\" 0 23 [IN] 13 65535 [OUT] 13 65535 [INTERACT] 9 \"contact\" 0 23 [IN] 14 65535 [OUT] 14 65535 [INTERACT] 10 \"contact\" 0 23 [IN] 15 65535 [OUT] 15 65535 [INTERACT] 11 \"contact\" 0 23 [IN] 16 65535 [OUT] 16 65535 [INTERACT] 12 \"contact\" 0 23 [IN] 17 65535 [OUT] 17 65535 [INTERACT] 13 \"contact\" 0 23 [IN] 18 65535 [OUT] 18 65535 [INTERACT] 14 \"contact\" 0 23 [IN] 19 65535 [OUT] 19 65535 [INTERACT] 15 \"contact\" 0 23 [IN] 20 65535 [OUT] 20 65535 [INTERACT] 16 \"contact\" 0 23 [IN] 21 65535 [OUT] 21 65535 [INTERACT] 17 \"contact\" 0 23 [IN] 22 65535 [OUT] 22 65535 [INTERACT] 18 \"contact\" 0 23 [IN] 23 65535 [OUT] 23 65535 [INTERACT] 19 \"contact\" 0 23 [IN] 24 65535 [OUT] 24 65535 [INTERACT] 20 \"contact\" 0 23 [IN] 25 65535 [OUT] 25 65535 [INTERACT] 21 \"contact\" 0 23 [IN] 26 65535 [OUT] 26 65535 [INTERACT] 22 \"contact\" 0 23 [IN] 27 65535 [OUT] 27 65535 [INTERACT] 23 \"contact\" 0 23 [IN] 28 65535 [OUT] 28 65535 [INTERACT] 33 \"contact\" 0 23 [IN] 29 65535 [OUT] 29 65535 [INTERACT] 32 \"collision\" 10 10 [IN] 29 65535 [OUT] 29 65535 [INTERACT] 3 \"collision\" 15 15 [IN] 10 11 [OUT] 10 11 [INTERACT] 4 \"contact\" 16 23 [IN] 10 11 [OUT] 10 11 [INTERACTIONS-END] [SCENE-END]",
"label": "[SCENE-START] [OBJS-START] [OBJ] 0 \"brown utility\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 0 669 1 2 669 2 2 659 3 2 655 4 5 654 5 2 651 7 5 652 8 8 654 9 16 654 10 18 653 11 23 653 12 26 654 13 33 655 14 36 654 15 5 678 16 47 656 17 11 676 18 55 656 19 21 679 20 24 678 21 28 679 22 34 680 23 35 678 24 40 679 25 44 680 26 87 658 27 92 658 28 95 658 29 60 680 30 64 680 31 108 659 32 112 659 33 116 659 34 119 660 35 124 659 36 63 653 37 133 660 38 136 661 39 141 661 40 144 660 41 148 663 42 152 664 43 156 663 44 161 663 45 166 663 46 169 664 47 173 665 48 177 666 49 182 666 50 185 668 51 189 669 52 194 671 53 198 672 54 152 641 55 166 692 56 162 646 57 166 649 58 169 652 59 173 656 60 177 660 61 186 696 62 185 670 63 190 673 64 192 672 65 196 674 66 199 675 67 202 676 68 205 677 69 209 678 70 211 679 71 215 680 72 218 680 73 221 681 74 223 682 75 227 683 76 230 684 77 234 685 78 237 686 79 241 694 80 243 688 81 247 690 82 251 692 83 253 692 84 256 693 85 258 693 86 262 693 87 266 694 88 268 694 89 271 694 90 274 694 91 276 694 92 280 694 93 282 693 94 285 693 95 288 693 96 291 692 97 294 693 98 298 693 99 298 691 100 301 691 101 304 691 102 307 691 103 308 690 104 312 692 106 331 701 107 312 698 108 361 684 109 360 690 110 366 684 111 369 684 112 330 688 113 333 688 114 335 686 115 337 684 116 339 683 117 341 682 118 342 680 119 344 679 [OBJ] 1 \"gray jet\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 365 246 1 366 248 2 369 250 3 370 253 4 372 257 5 374 263 6 376 268 7 378 275 8 380 281 9 381 289 10 383 297 11 385 306 12 387 316 13 388 325 14 391 335 15 392 347 16 393 358 17 393 369 18 394 381 19 396 395 20 397 408 21 411 418 22 412 430 23 408 449 24 411 461 25 410 478 26 410 497 27 412 513 28 413 528 29 414 545 30 416 560 31 417 577 32 418 595 33 419 613 34 421 630 35 422 648 36 423 661 37 424 680 38 425 698 39 426 716 40 428 734 41 429 753 42 430 772 43 430 791 44 431 810 45 432 829 46 433 838 47 434 834 48 435 830 49 436 822 50 436 814 51 437 805 52 437 799 53 437 792 54 437 786 55 438 781 56 438 776 57 438 772 58 439 768 59 440 764 61 441 758 63 441 755 65 442 753 69 444 755 72 444 757 74 445 760 76 446 765 77 447 767 81 448 763 82 448 759 84 448 756 85 449 753 87 449 750 89 450 746 91 450 742 93 451 739 96 451 734 98 451 732 101 452 730 102 453 728 104 453 725 107 454 723 112 455 720 115 456 718 118 458 717 [OBJ] 2 \"red cruiser\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 556 655 13 552 657 22 556 655 28 558 654 34 555 655 35 561 663 36 569 670 37 557 642 38 557 650 39 555 655 52 553 654 56 551 655 64 549 656 66 551 656 68 553 658 69 551 659 71 551 661 72 551 664 74 552 667 75 551 669 76 526 673 77 529 673 78 548 668 80 526 672 81 548 667 82 591 666 84 546 668 85 526 674 88 523 671 99 524 674 115 526 674 117 527 672 119 580 660 [OBJ] 3 \"purple minivan\" 23 120 [VIS] 0 false 23 true [IN-FRAME] 0 false 23 true [PX] 0 null null 23 0 644 24 3 647 25 5 649 26 7 633 27 9 633 28 12 634 29 13 633 30 16 633 31 18 633 32 19 632 33 22 632 34 24 632 35 26 632 36 29 632 37 30 631 38 33 632 39 34 633 42 35 631 45 44 631 46 41 631 47 38 631 48 65 630 49 62 630 51 65 630 52 83 629 54 90 629 55 81 630 56 106 628 57 98 629 58 105 628 59 114 628 60 130 626 62 176 624 63 172 624 65 179 624 66 187 624 67 194 623 68 207 623 69 217 622 71 226 622 72 240 620 74 229 622 75 247 620 76 244 621 77 288 618 78 293 618 79 295 618 80 310 617 83 333 616 86 335 616 87 343 616 88 356 615 90 364 615 91 378 614 93 384 614 94 372 615 95 401 613 96 405 613 97 392 614 98 424 610 99 406 614 100 412 613 101 419 613 102 448 609 103 432 613 104 438 611 105 445 611 106 451 611 107 475 608 108 464 610 109 470 610 111 484 608 112 489 609 113 494 608 115 498 607 116 548 603 117 550 604 [OBJS-END] [INTERACTIONS-START] [INTERACT] 1 \"contact\" 0 63 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 14 \"contact\" 0 79 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 18 \"contact\" 0 119 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 6 \"collision\" 46 46 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 7 \"collision\" 49 49 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 2 \"collision\" 67 67 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 3 \"contact\" 68 119 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 8 \"collision\" 70 70 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 9 \"collision\" 75 75 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 10 \"collision\" 77 77 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 11 \"contact\" 78 79 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 12 \"collision\" 81 81 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 13 \"contact\" 82 113 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 15 \"collision\" 83 83 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 16 \"collision\" 85 85 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 17 \"contact\" 86 119 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 0 \"collision\" 114 114 [IN] 0 1 [OUT] 0 1 [INTERACT] 4 \"collision\" 115 115 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 5 \"contact\" 116 119 [IN] 1 65535 [OUT] 1 65535 [INTERACTIONS-END] [SCENE-END]\n"
}Parsed prediction
{
"objects": [
{
"id": 0,
"type": "red and brown leather camp shoe",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 1,
"y": 669
},
{
"t": 1,
"x": 5,
"y": 677
},
{
"t": 2,
"x": 9,
"y": 685
},
{
"t": 3,
"x": 13,
"y": 693
},
{
"t": 4,
"x": 13,
"y": 673
},
{
"t": 5,
"x": 17,
"y": 681
},
{
"t": 7,
"x": 25,
"y": 689
},
{
"t": 9,
"x": 33,
"y": 697
},
{
"t": 11,
"x": 41,
"y": 701
},
{
"t": 13,
"x": 48,
"y": 705
},
{
"t": 14,
"x": 56,
"y": 708
},
{
"t": 16,
"x": 64,
"y": 712
},
{
"t": 18,
"x": 72,
"y": 716
},
{
"t": 20,
"x": 80,
"y": 720
},
{
"t": 22,
"x": 87,
"y": 724
},
{
"t": 23,
"x": 95,
"y": 728
}
],
"birth": 0,
"death": 24
},
{
"id": 1,
"type": "purple plastic medicine bottle",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 13,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 13,
"x": 111,
"y": 658
},
{
"t": 14,
"x": 103,
"y": 662
},
{
"t": 15,
"x": 95,
"y": 666
},
{
"t": 16,
"x": 87,
"y": 669
},
{
"t": 17,
"x": 80,
"y": 673
},
{
"t": 18,
"x": 72,
"y": 677
},
{
"t": 20,
"x": 60,
"y": 685
},
{
"t": 22,
"x": 48,
"y": 693
},
{
"t": 23,
"x": 41,
"y": 697
}
],
"birth": 0,
"death": 24
},
{
"id": 2,
"type": "purple plastic medicine bottle",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 13,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 13,
"x": 134,
"y": 658
},
{
"t": 14,
"x": 126,
"y": 662
},
{
"t": 16,
"x": 115,
"y": 669
},
{
"t": 18,
"x": 103,
"y": 677
},
{
"t": 19,
"x": 95,
"y": 681
},
{
"t": 21,
"x": 83,
"y": 689
},
{
"t": 23,
"x": 72,
"y": 697
}
],
"birth": 0,
"death": 24
},
{
"id": 3,
"type": "purple plastic medicine bottle",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 13,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 13,
"x": 169,
"y": 669
},
{
"t": 14,
"x": 162,
"y": 673
},
{
"t": 15,
"x": 154,
"y": 677
},
{
"t": 16,
"x": 146,
"y": 681
},
{
"t": 18,
"x": 138,
"y": 685
},
{
"t": 19,
"x": 130,
"y": 689
},
{
"t": 20,
"x": 123,
"y": 693
},
{
"t": 22,
"x": 115,
"y": 697
},
{
"t": 23,
"x": 107,
"y": 701
}
],
"birth": 0,
"death": 24
},
{
"id": 4,
"type": "purple plastic medicine bottle",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 13,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 13,
"x": 201,
"y": 673
},
{
"t": 14,
"x": 193,
"y": 677
},
{
"t": 15,
"x": 185,
"y": 681
},
{
"t": 17,
"x": 173,
"y": 689
},
{
"t": 18,
"x": 166,
"y": 693
},
{
"t": 20,
"x": 154,
"y": 697
},
{
"t": 21,
"x": 146,
"y": 701
},
{
"t": 23,
"x": 134,
"y": 705
}
],
"birth": 0,
"death": 24
},
{
"id": 5,
"type": "pink and purple plastic package of overnight pads",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 13,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 13,
"x": 185,
"y": 634
},
{
"t": 14,
"x": 173,
"y": 638
},
{
"t": 16,
"x": 162,
"y": 642
},
{
"t": 18,
"x": 150,
"y": 646
},
{
"t": 20,
"x": 142,
"y": 650
},
{
"t": 22,
"x": 134,
"y": 654
}
],
"birth": 0,
"death": 24
},
{
"id": 6,
"type": "purple plastic medicine bottle",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 13,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 13,
"x": 248,
"y": 658
},
{
"t": 14,
"x": 240,
"y": 662
},
{
"t": 16,
"x": 232,
"y": 666
},
{
"t": 18,
"x": 224,
"y": 669
},
{
"t": 20,
"x": 216,
"y": 673
},
{
"t": 22,
"x": 208,
"y": 677
},
{
"t": 23,
"x": 201,
"y": 681
}
],
"birth": 0,
"death": 24
},
{
"id": 7,
"type": "dark red and black plastic curling wand",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 13,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 13,
"x": 263,
"y": 666
},
{
"t": 15,
"x": 255,
"y": 669
},
{
"t": 18,
"x": 248,
"y": 673
},
{
"t": 20,
"x": 240,
"y": 677
},
{
"t": 23,
"x": 232,
"y": 681
}
],
"birth": 0,
"death": 24
},
{
"id": 8,
"type": "purple and white high-top sneaker",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 13,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 13,
"x": 275,
"y": 654
},
{
"t": 14,
"x": 267,
"y": 658
},
{
"t": 16,
"x": 259,
"y": 662
},
{
"t": 18,
"x": 251,
"y": 666
},
{
"t": 20,
"x": 244,
"y": 669
},
{
"t": 23,
"x": 236,
"y": 673
}
],
"birth": 0,
"death": 24
},
{
"id": 9,
"type": "purple plastic medicine bottle",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 13,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 13,
"x": 298,
"y": 662
},
{
"t": 14,
"x": 291,
"y": 666
},
{
"t": 17,
"x": 283,
"y": 669
},
{
"t": 20,
"x": 275,
"y": 673
},
{
"t": 23,
"x": 267,
"y": 677
}
],
"birth": 0,
"death": 24
},
{
"id": 10,
"type": "red plastic hair dryer",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 365,
"y": 298
},
{
"t": 1,
"x": 369,
"y": 306
},
{
"t": 2,
"x": 373,
"y": 314
},
{
"t": 3,
"x": 376,
"y": 322
},
{
"t": 4,
"x": 380,
"y": 330
},
{
"t": 5,
"x": 384,
"y": 337
},
{
"t": 6,
"x": 388,
"y": 345
},
{
"t": 7,
"x": 392,
"y": 353
},
{
"t": 8,
"x": 396,
"y": 361
},
{
"t": 9,
"x": 400,
"y": 373
},
{
"t": 10,
"x": 404,
"y": 384
},
{
"t": 11,
"x": 408,
"y": 400
},
{
"t": 12,
"x": 412,
"y": 416
},
{
"t": 13,
"x": 416,
"y": 431
},
{
"t": 14,
"x": 419,
"y": 447
},
{
"t": 15,
"x": 423,
"y": 466
},
{
"t": 16,
"x": 431,
"y": 494
},
{
"t": 17,
"x": 439,
"y": 525
},
{
"t": 18,
"x": 443,
"y": 556
},
{
"t": 19,
"x": 447,
"y": 587
},
{
"t": 20,
"x": 455,
"y": 611
},
{
"t": 21,
"x": 462,
"y": 623
},
{
"t": 22,
"x": 470,
"y": 630
},
{
"t": 23,
"x": 474,
"y": 638
}
],
"birth": 0,
"death": 24
},
{
"id": 11,
"type": "red and white cardboard ink cartridge box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 369,
"y": 263
},
{
"t": 1,
"x": 373,
"y": 271
},
{
"t": 2,
"x": 376,
"y": 279
},
{
"t": 3,
"x": 380,
"y": 287
},
{
"t": 4,
"x": 384,
"y": 294
},
{
"t": 5,
"x": 388,
"y": 302
},
{
"t": 6,
"x": 392,
"y": 310
},
{
"t": 7,
"x": 396,
"y": 318
},
{
"t": 8,
"x": 400,
"y": 326
},
{
"t": 9,
"x": 404,
"y": 337
},
{
"t": 10,
"x": 408,
"y": 345
},
{
"t": 11,
"x": 412,
"y": 357
},
{
"t": 12,
"x": 416,
"y": 365
},
{
"t": 13,
"x": 419,
"y": 376
},
{
"t": 14,
"x": 423,
"y": 392
},
{
"t": 15,
"x": 427,
"y": 404
},
{
"t": 16,
"x": 431,
"y": 416
},
{
"t": 17,
"x": 435,
"y": 435
},
{
"t": 18,
"x": 439,
"y": 455
},
{
"t": 19,
"x": 443,
"y": 474
},
{
"t": 20,
"x": 447,
"y": 501
},
{
"t": 21,
"x": 451,
"y": 529
},
{
"t": 22,
"x": 455,
"y": 552
},
{
"t": 23,
"x": 458,
"y": 572
}
],
"birth": 0,
"death": 24
},
{
"id": 12,
"type": "red and white cardboard ink cartridge box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 412,
"y": 275
},
{
"t": 1,
"x": 419,
"y": 287
},
{
"t": 2,
"x": 423,
"y": 294
},
{
"t": 3,
"x": 427,
"y": 302
},
{
"t": 4,
"x": 431,
"y": 310
},
{
"t": 5,
"x": 435,
"y": 318
},
{
"t": 6,
"x": 439,
"y": 326
},
{
"t": 7,
"x": 443,
"y": 333
},
{
"t": 8,
"x": 447,
"y": 341
},
{
"t": 9,
"x": 451,
"y": 349
},
{
"t": 10,
"x": 455,
"y": 357
},
{
"t": 11,
"x": 458,
"y": 365
},
{
"t": 12,
"x": 462,
"y": 373
},
{
"t": 13,
"x": 466,
"y": 380
},
{
"t": 14,
"x": 470,
"y": 388
},
{
"t": 15,
"x": 474,
"y": 400
},
{
"t": 16,
"x": 478,
"y": 412
},
{
"t": 17,
"x": 482,
"y": 419
},
{
"t": 18,
"x": 486,
"y": 431
},
{
"t": 19,
"x": 490,
"y": 443
},
{
"t": 20,
"x": 494,
"y": 451
},
{
"t": 21,
"x": 498,
"y": 458
},
{
"t": 22,
"x": 501,
"y": 466
},
{
"t": 23,
"x": 505,
"y": 474
}
],
"birth": 0,
"death": 24
},
{
"id": 13,
"type": "grey and white plastic shark figurine",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 470,
"y": 447
},
{
"t": 2,
"x": 462,
"y": 451
},
{
"t": 4,
"x": 455,
"y": 455
},
{
"t": 6,
"x": 451,
"y": 462
},
{
"t": 8,
"x": 458,
"y": 466
},
{
"t": 9,
"x": 443,
"y": 470
},
{
"t": 12,
"x": 435,
"y": 474
},
{
"t": 14,
"x": 427,
"y": 478
},
{
"t": 16,
"x": 439,
"y": 478
},
{
"t": 17,
"x": 419,
"y": 482
},
{
"t": 18,
"x": 435,
"y": 482
},
{
"t": 19,
"x": 419,
"y": 486
},
{
"t": 20,
"x": 431,
"y": 486
},
{
"t": 21,
"x": 416,
"y": 490
},
{
"t": 22,
"x": 427,
"y": 490
},
{
"t": 23,
"x": 412,
"y": 494
}
],
"birth": 0,
"death": 24
},
{
"id": 14,
"type": "red and white cardboard ink cartridge box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 474,
"y": 451
},
{
"t": 3,
"x": 466,
"y": 455
},
{
"t": 7,
"x": 458,
"y": 458
},
{
"t": 10,
"x": 451,
"y": 462
},
{
"t": 14,
"x": 443,
"y": 466
},
{
"t": 17,
"x": 435,
"y": 470
},
{
"t": 21,
"x": 427,
"y": 474
}
],
"birth": 0,
"death": 24
},
{
"id": 15,
"type": "red and yellow running shoe",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 482,
"y": 642
},
{
"t": 4,
"x": 474,
"y": 638
},
{
"t": 12,
"x": 466,
"y": 642
},
{
"t": 18,
"x": 455,
"y": 642
},
{
"t": 20,
"x": 447,
"y": 646
},
{
"t": 23,
"x": 439,
"y": 650
}
],
"birth": 0,
"death": 24
},
{
"id": 16,
"type": "red and white cardboard ink cartridge box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 525,
"y": 451
},
{
"t": 1,
"x": 517,
"y": 447
},
{
"t": 2,
"x": 525,
"y": 451
},
{
"t": 6,
"x": 513,
"y": 451
},
{
"t": 11,
"x": 505,
"y": 455
},
{
"t": 17,
"x": 498,
"y": 458
},
{
"t": 22,
"x": 490,
"y": 462
}
],
"birth": 0,
"death": 24
},
{
"id": 17,
"type": "grey and black fabric running shoe",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 533,
"y": 439
},
{
"t": 1,
"x": 521,
"y": 439
},
{
"t": 4,
"x": 509,
"y": 439
},
{
"t": 6,
"x": 521,
"y": 443
},
{
"t": 7,
"x": 505,
"y": 443
},
{
"t": 10,
"x": 494,
"y": 443
},
{
"t": 13,
"x": 505,
"y": 447
},
{
"t": 14,
"x": 486,
"y": 447
},
{
"t": 17,
"x": 474,
"y": 447
},
{
"t": 20,
"x": 486,
"y": 451
},
{
"t": 21,
"x": 466,
"y": 451
}
],
"birth": 0,
"death": 24
},
{
"id": 18,
"type": "red and white cardboard ink cartridge box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 537,
"y": 451
},
{
"t": 2,
"x": 525,
"y": 451
},
{
"t": 5,
"x": 513,
"y": 451
},
{
"t": 9,
"x": 505,
"y": 455
},
{
"t": 13,
"x": 494,
"y": 455
},
{
"t": 17,
"x": 486,
"y": 458
},
{
"t": 21,
"x": 478,
"y": 462
}
],
"birth": 0,
"death": 24
},
{
"id": 19,
"type": "red and white cardboard ink cartridge box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 541,
"y": 447
},
{
"t": 3,
"x": 533,
"y": 451
},
{
"t": 7,
"x": 525,
"y": 455
},
{
"t": 11,
"x": 517,
"y": 458
},
{
"t": 15,
"x": 509,
"y": 462
},
{
"t": 19,
"x": 501,
"y": 466
},
{
"t": 23,
"x": 494,
"y": 470
}
],
"birth": 0,
"death": 24
},
{
"id": 20,
"type": "red and white cardboard ink cartridge box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 552,
"y": 451
},
{
"t": 4,
"x": 541,
"y": 451
},
{
"t": 8,
"x": 533,
"y": 455
},
{
"t": 12,
"x": 521,
"y": 455
},
{
"t": 16,
"x": 513,
"y": 458
},
{
"t": 20,
"x": 501,
"y": 458
}
],
"birth": 0,
"death": 24
},
{
"id": 21,
"type": "red and white cardboard ink cartridge box",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 564,
"y": 447
},
{
"t": 2,
"x": 556,
"y": 451
},
{
"t": 6,
"x": 548,
"y": 455
},
{
"t": 10,
"x": 541,
"y": 458
},
{
"t": 14,
"x": 533,
"y": 462
},
{
"t": 18,
"x": 525,
"y": 466
},
{
"t": 22,
"x": 517,
"y": 470
}
],
"birth": 0,
"death": 24
},
{
"id": 22,
"type": "red and yellow running shoe",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 576,
"y": 458
},
{
"t": 4,
"x": 568,
"y": 462
},
{
"t": 9,
"x": 560,
"y": 466
},
{
"t": 14,
"x": 552,
"y": 470
},
{
"t": 20,
"x": 544,
"y": 474
}
],
"birth": 0,
"death": 24
},
{
"id": 23,
"type": "red and yellow running shoe",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 607,
"y": 458
},
{
"t": 5,
"x": 599,
"y": 462
},
{
"t": 10,
"x": 591,
"y": 466
},
{
"t": 15,
"x": 583,
"y": 470
},
{
"t": 19,
"x": 576,
"y": 474
}
],
"birth": 0,
"death": 24
},
{
"id": 24,
"type": "red and yellow running shoe",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 611,
"y": 455
},
{
"t": 4,
"x": 603,
"y": 458
},
{
"t": 8,
"x": 595,
"y": 462
},
{
"t": 13,
"x": 587,
"y": 466
},
{
"t": 18,
"x": 580,
"y": 470
},
{
"t": 23,
"x": 572,
"y": 474
}
],
"birth": 0,
"death": 24
},
{
"id": 25,
"type": "red and yellow running shoe",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 619,
"y": 451
},
{
"t": 3,
"x": 611,
"y": 455
},
{
"t": 6,
"x": 603,
"y": 458
},
{
"t": 10,
"x": 595,
"y": 462
},
{
"t": 14,
"x": 587,
"y": 466
},
{
"t": 18,
"x": 580,
"y": 470
},
{
"t": 22,
"x": 572,
"y": 474
}
],
"birth": 0,
"death": 24
},
{
"id": 26,
"type": "grey and white plastic shark figurine",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 623,
"y": 462
},
{
"t": 1,
"x": 611,
"y": 462
},
{
"t": 2,
"x": 623,
"y": 462
},
{
"t": 4,
"x": 611,
"y": 462
},
{
"t": 5,
"x": 619,
"y": 458
},
{
"t": 6,
"x": 607,
"y": 462
},
{
"t": 12,
"x": 595,
"y": 462
},
{
"t": 16,
"x": 583,
"y": 462
},
{
"t": 21,
"x": 572,
"y": 462
}
],
"birth": 0,
"death": 24
},
{
"id": 27,
"type": "red and yellow running shoe",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 630,
"y": 654
},
{
"t": 1,
"x": 619,
"y": 654
},
{
"t": 4,
"x": 611,
"y": 650
},
{
"t": 6,
"x": 619,
"y": 654
},
{
"t": 7,
"x": 607,
"y": 650
},
{
"t": 11,
"x": 619,
"y": 658
},
{
"t": 12,
"x": 603,
"y": 654
},
{
"t": 15,
"x": 595,
"y": 650
},
{
"t": 16,
"x": 603,
"y": 654
},
{
"t": 17,
"x": 591,
"y": 650
},
{
"t": 18,
"x": 599,
"y": 654
},
{
"t": 19,
"x": 587,
"y": 650
},
{
"t": 20,
"x": 595,
"y": 654
},
{
"t": 21,
"x": 583,
"y": 650
},
{
"t": 22,
"x": 591,
"y": 654
},
{
"t": 23,
"x": 576,
"y": 650
}
],
"birth": 0,
"death": 24
},
{
"id": 28,
"type": "purple wooden dollhouse table",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 748,
"y": 466
},
{
"t": 13,
"x": 736,
"y": 466
},
{
"t": 18,
"x": 728,
"y": 470
}
],
"birth": 0,
"death": 24
},
{
"id": 29,
"type": "pink rubber teething toy",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 12,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": false
},
{
"t": 12,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 12,
"x": 1,
"y": 634
},
{
"t": 14,
"x": 9,
"y": 642
},
{
"t": 15,
"x": 9,
"y": 654
},
{
"t": 16,
"x": 13,
"y": 662
},
{
"t": 18,
"x": 13,
"y": 677
},
{
"t": 20,
"x": 13,
"y": 689
},
{
"t": 22,
"x": 13,
"y": 701
},
{
"t": 23,
"x": 9,
"y": 693
}
],
"birth": 12,
"death": 24
}
],
"interactions": [
{
"id": 34,
"inputs": [
29,
65535
],
"outputs": [
29,
65535
],
"begins_at": 0,
"ends_at": 1,
"type": "contact"
},
{
"id": 1,
"inputs": [
1,
2
],
"outputs": [
1,
2
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 0,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 2,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 24,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 25,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 26,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 27,
"inputs": [
5,
65535
],
"outputs": [
5,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 28,
"inputs": [
6,
65535
],
"outputs": [
6,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 29,
"inputs": [
7,
65535
],
"outputs": [
7,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 30,
"inputs": [
8,
65535
],
"outputs": [
8,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 31,
"inputs": [
9,
65535
],
"outputs": [
9,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 5,
"inputs": [
10,
65535
],
"outputs": [
10,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 6,
"inputs": [
11,
65535
],
"outputs": [
11,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 7,
"inputs": [
12,
65535
],
"outputs": [
12,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 8,
"inputs": [
13,
65535
],
"outputs": [
13,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 9,
"inputs": [
14,
65535
],
"outputs": [
14,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 10,
"inputs": [
15,
65535
],
"outputs": [
15,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 11,
"inputs": [
16,
65535
],
"outputs": [
16,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 12,
"inputs": [
17,
65535
],
"outputs": [
17,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 13,
"inputs": [
18,
65535
],
"outputs": [
18,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 14,
"inputs": [
19,
65535
],
"outputs": [
19,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 15,
"inputs": [
20,
65535
],
"outputs": [
20,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 16,
"inputs": [
21,
65535
],
"outputs": [
21,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 17,
"inputs": [
22,
65535
],
"outputs": [
22,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 18,
"inputs": [
23,
65535
],
"outputs": [
23,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 19,
"inputs": [
24,
65535
],
"outputs": [
24,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 20,
"inputs": [
25,
65535
],
"outputs": [
25,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 21,
"inputs": [
26,
65535
],
"outputs": [
26,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 22,
"inputs": [
27,
65535
],
"outputs": [
27,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 23,
"inputs": [
28,
65535
],
"outputs": [
28,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 33,
"inputs": [
29,
65535
],
"outputs": [
29,
65535
],
"begins_at": 0,
"ends_at": 23,
"type": "contact"
},
{
"id": 32,
"inputs": [
29,
65535
],
"outputs": [
29,
65535
],
"begins_at": 10,
"ends_at": 10,
"type": "collision"
},
{
"id": 3,
"inputs": [
10,
11
],
"outputs": [
10,
11
],
"begins_at": 15,
"ends_at": 15,
"type": "collision"
},
{
"id": 4,
"inputs": [
10,
11
],
"outputs": [
10,
11
],
"begins_at": 16,
"ends_at": 23,
"type": "contact"
}
]
}Parsed ground truth
{
"objects": [
{
"id": 0,
"type": "brown utility",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 0,
"y": 669
},
{
"t": 1,
"x": 2,
"y": 669
},
{
"t": 2,
"x": 2,
"y": 659
},
{
"t": 3,
"x": 2,
"y": 655
},
{
"t": 4,
"x": 5,
"y": 654
},
{
"t": 5,
"x": 2,
"y": 651
},
{
"t": 7,
"x": 5,
"y": 652
},
{
"t": 8,
"x": 8,
"y": 654
},
{
"t": 9,
"x": 16,
"y": 654
},
{
"t": 10,
"x": 18,
"y": 653
},
{
"t": 11,
"x": 23,
"y": 653
},
{
"t": 12,
"x": 26,
"y": 654
},
{
"t": 13,
"x": 33,
"y": 655
},
{
"t": 14,
"x": 36,
"y": 654
},
{
"t": 15,
"x": 5,
"y": 678
},
{
"t": 16,
"x": 47,
"y": 656
},
{
"t": 17,
"x": 11,
"y": 676
},
{
"t": 18,
"x": 55,
"y": 656
},
{
"t": 19,
"x": 21,
"y": 679
},
{
"t": 20,
"x": 24,
"y": 678
},
{
"t": 21,
"x": 28,
"y": 679
},
{
"t": 22,
"x": 34,
"y": 680
},
{
"t": 23,
"x": 35,
"y": 678
},
{
"t": 24,
"x": 40,
"y": 679
},
{
"t": 25,
"x": 44,
"y": 680
},
{
"t": 26,
"x": 87,
"y": 658
},
{
"t": 27,
"x": 92,
"y": 658
},
{
"t": 28,
"x": 95,
"y": 658
},
{
"t": 29,
"x": 60,
"y": 680
},
{
"t": 30,
"x": 64,
"y": 680
},
{
"t": 31,
"x": 108,
"y": 659
},
{
"t": 32,
"x": 112,
"y": 659
},
{
"t": 33,
"x": 116,
"y": 659
},
{
"t": 34,
"x": 119,
"y": 660
},
{
"t": 35,
"x": 124,
"y": 659
},
{
"t": 36,
"x": 63,
"y": 653
},
{
"t": 37,
"x": 133,
"y": 660
},
{
"t": 38,
"x": 136,
"y": 661
},
{
"t": 39,
"x": 141,
"y": 661
},
{
"t": 40,
"x": 144,
"y": 660
},
{
"t": 41,
"x": 148,
"y": 663
},
{
"t": 42,
"x": 152,
"y": 664
},
{
"t": 43,
"x": 156,
"y": 663
},
{
"t": 44,
"x": 161,
"y": 663
},
{
"t": 45,
"x": 166,
"y": 663
},
{
"t": 46,
"x": 169,
"y": 664
},
{
"t": 47,
"x": 173,
"y": 665
},
{
"t": 48,
"x": 177,
"y": 666
},
{
"t": 49,
"x": 182,
"y": 666
},
{
"t": 50,
"x": 185,
"y": 668
},
{
"t": 51,
"x": 189,
"y": 669
},
{
"t": 52,
"x": 194,
"y": 671
},
{
"t": 53,
"x": 198,
"y": 672
},
{
"t": 54,
"x": 152,
"y": 641
},
{
"t": 55,
"x": 166,
"y": 692
},
{
"t": 56,
"x": 162,
"y": 646
},
{
"t": 57,
"x": 166,
"y": 649
},
{
"t": 58,
"x": 169,
"y": 652
},
{
"t": 59,
"x": 173,
"y": 656
},
{
"t": 60,
"x": 177,
"y": 660
},
{
"t": 61,
"x": 186,
"y": 696
},
{
"t": 62,
"x": 185,
"y": 670
},
{
"t": 63,
"x": 190,
"y": 673
},
{
"t": 64,
"x": 192,
"y": 672
},
{
"t": 65,
"x": 196,
"y": 674
},
{
"t": 66,
"x": 199,
"y": 675
},
{
"t": 67,
"x": 202,
"y": 676
},
{
"t": 68,
"x": 205,
"y": 677
},
{
"t": 69,
"x": 209,
"y": 678
},
{
"t": 70,
"x": 211,
"y": 679
},
{
"t": 71,
"x": 215,
"y": 680
},
{
"t": 72,
"x": 218,
"y": 680
},
{
"t": 73,
"x": 221,
"y": 681
},
{
"t": 74,
"x": 223,
"y": 682
},
{
"t": 75,
"x": 227,
"y": 683
},
{
"t": 76,
"x": 230,
"y": 684
},
{
"t": 77,
"x": 234,
"y": 685
},
{
"t": 78,
"x": 237,
"y": 686
},
{
"t": 79,
"x": 241,
"y": 694
},
{
"t": 80,
"x": 243,
"y": 688
},
{
"t": 81,
"x": 247,
"y": 690
},
{
"t": 82,
"x": 251,
"y": 692
},
{
"t": 83,
"x": 253,
"y": 692
},
{
"t": 84,
"x": 256,
"y": 693
},
{
"t": 85,
"x": 258,
"y": 693
},
{
"t": 86,
"x": 262,
"y": 693
},
{
"t": 87,
"x": 266,
"y": 694
},
{
"t": 88,
"x": 268,
"y": 694
},
{
"t": 89,
"x": 271,
"y": 694
},
{
"t": 90,
"x": 274,
"y": 694
},
{
"t": 91,
"x": 276,
"y": 694
},
{
"t": 92,
"x": 280,
"y": 694
},
{
"t": 93,
"x": 282,
"y": 693
},
{
"t": 94,
"x": 285,
"y": 693
},
{
"t": 95,
"x": 288,
"y": 693
},
{
"t": 96,
"x": 291,
"y": 692
},
{
"t": 97,
"x": 294,
"y": 693
},
{
"t": 98,
"x": 298,
"y": 693
},
{
"t": 99,
"x": 298,
"y": 691
},
{
"t": 100,
"x": 301,
"y": 691
},
{
"t": 101,
"x": 304,
"y": 691
},
{
"t": 102,
"x": 307,
"y": 691
},
{
"t": 103,
"x": 308,
"y": 690
},
{
"t": 104,
"x": 312,
"y": 692
},
{
"t": 106,
"x": 331,
"y": 701
},
{
"t": 107,
"x": 312,
"y": 698
},
{
"t": 108,
"x": 361,
"y": 684
},
{
"t": 109,
"x": 360,
"y": 690
},
{
"t": 110,
"x": 366,
"y": 684
},
{
"t": 111,
"x": 369,
"y": 684
},
{
"t": 112,
"x": 330,
"y": 688
},
{
"t": 113,
"x": 333,
"y": 688
},
{
"t": 114,
"x": 335,
"y": 686
},
{
"t": 115,
"x": 337,
"y": 684
},
{
"t": 116,
"x": 339,
"y": 683
},
{
"t": 117,
"x": 341,
"y": 682
},
{
"t": 118,
"x": 342,
"y": 680
},
{
"t": 119,
"x": 344,
"y": 679
}
],
"birth": 0,
"death": 120
},
{
"id": 1,
"type": "gray jet",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 365,
"y": 246
},
{
"t": 1,
"x": 366,
"y": 248
},
{
"t": 2,
"x": 369,
"y": 250
},
{
"t": 3,
"x": 370,
"y": 253
},
{
"t": 4,
"x": 372,
"y": 257
},
{
"t": 5,
"x": 374,
"y": 263
},
{
"t": 6,
"x": 376,
"y": 268
},
{
"t": 7,
"x": 378,
"y": 275
},
{
"t": 8,
"x": 380,
"y": 281
},
{
"t": 9,
"x": 381,
"y": 289
},
{
"t": 10,
"x": 383,
"y": 297
},
{
"t": 11,
"x": 385,
"y": 306
},
{
"t": 12,
"x": 387,
"y": 316
},
{
"t": 13,
"x": 388,
"y": 325
},
{
"t": 14,
"x": 391,
"y": 335
},
{
"t": 15,
"x": 392,
"y": 347
},
{
"t": 16,
"x": 393,
"y": 358
},
{
"t": 17,
"x": 393,
"y": 369
},
{
"t": 18,
"x": 394,
"y": 381
},
{
"t": 19,
"x": 396,
"y": 395
},
{
"t": 20,
"x": 397,
"y": 408
},
{
"t": 21,
"x": 411,
"y": 418
},
{
"t": 22,
"x": 412,
"y": 430
},
{
"t": 23,
"x": 408,
"y": 449
},
{
"t": 24,
"x": 411,
"y": 461
},
{
"t": 25,
"x": 410,
"y": 478
},
{
"t": 26,
"x": 410,
"y": 497
},
{
"t": 27,
"x": 412,
"y": 513
},
{
"t": 28,
"x": 413,
"y": 528
},
{
"t": 29,
"x": 414,
"y": 545
},
{
"t": 30,
"x": 416,
"y": 560
},
{
"t": 31,
"x": 417,
"y": 577
},
{
"t": 32,
"x": 418,
"y": 595
},
{
"t": 33,
"x": 419,
"y": 613
},
{
"t": 34,
"x": 421,
"y": 630
},
{
"t": 35,
"x": 422,
"y": 648
},
{
"t": 36,
"x": 423,
"y": 661
},
{
"t": 37,
"x": 424,
"y": 680
},
{
"t": 38,
"x": 425,
"y": 698
},
{
"t": 39,
"x": 426,
"y": 716
},
{
"t": 40,
"x": 428,
"y": 734
},
{
"t": 41,
"x": 429,
"y": 753
},
{
"t": 42,
"x": 430,
"y": 772
},
{
"t": 43,
"x": 430,
"y": 791
},
{
"t": 44,
"x": 431,
"y": 810
},
{
"t": 45,
"x": 432,
"y": 829
},
{
"t": 46,
"x": 433,
"y": 838
},
{
"t": 47,
"x": 434,
"y": 834
},
{
"t": 48,
"x": 435,
"y": 830
},
{
"t": 49,
"x": 436,
"y": 822
},
{
"t": 50,
"x": 436,
"y": 814
},
{
"t": 51,
"x": 437,
"y": 805
},
{
"t": 52,
"x": 437,
"y": 799
},
{
"t": 53,
"x": 437,
"y": 792
},
{
"t": 54,
"x": 437,
"y": 786
},
{
"t": 55,
"x": 438,
"y": 781
},
{
"t": 56,
"x": 438,
"y": 776
},
{
"t": 57,
"x": 438,
"y": 772
},
{
"t": 58,
"x": 439,
"y": 768
},
{
"t": 59,
"x": 440,
"y": 764
},
{
"t": 61,
"x": 441,
"y": 758
},
{
"t": 63,
"x": 441,
"y": 755
},
{
"t": 65,
"x": 442,
"y": 753
},
{
"t": 69,
"x": 444,
"y": 755
},
{
"t": 72,
"x": 444,
"y": 757
},
{
"t": 74,
"x": 445,
"y": 760
},
{
"t": 76,
"x": 446,
"y": 765
},
{
"t": 77,
"x": 447,
"y": 767
},
{
"t": 81,
"x": 448,
"y": 763
},
{
"t": 82,
"x": 448,
"y": 759
},
{
"t": 84,
"x": 448,
"y": 756
},
{
"t": 85,
"x": 449,
"y": 753
},
{
"t": 87,
"x": 449,
"y": 750
},
{
"t": 89,
"x": 450,
"y": 746
},
{
"t": 91,
"x": 450,
"y": 742
},
{
"t": 93,
"x": 451,
"y": 739
},
{
"t": 96,
"x": 451,
"y": 734
},
{
"t": 98,
"x": 451,
"y": 732
},
{
"t": 101,
"x": 452,
"y": 730
},
{
"t": 102,
"x": 453,
"y": 728
},
{
"t": 104,
"x": 453,
"y": 725
},
{
"t": 107,
"x": 454,
"y": 723
},
{
"t": 112,
"x": 455,
"y": 720
},
{
"t": 115,
"x": 456,
"y": 718
},
{
"t": 118,
"x": 458,
"y": 717
}
],
"birth": 0,
"death": 120
},
{
"id": 2,
"type": "red cruiser",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 556,
"y": 655
},
{
"t": 13,
"x": 552,
"y": 657
},
{
"t": 22,
"x": 556,
"y": 655
},
{
"t": 28,
"x": 558,
"y": 654
},
{
"t": 34,
"x": 555,
"y": 655
},
{
"t": 35,
"x": 561,
"y": 663
},
{
"t": 36,
"x": 569,
"y": 670
},
{
"t": 37,
"x": 557,
"y": 642
},
{
"t": 38,
"x": 557,
"y": 650
},
{
"t": 39,
"x": 555,
"y": 655
},
{
"t": 52,
"x": 553,
"y": 654
},
{
"t": 56,
"x": 551,
"y": 655
},
{
"t": 64,
"x": 549,
"y": 656
},
{
"t": 66,
"x": 551,
"y": 656
},
{
"t": 68,
"x": 553,
"y": 658
},
{
"t": 69,
"x": 551,
"y": 659
},
{
"t": 71,
"x": 551,
"y": 661
},
{
"t": 72,
"x": 551,
"y": 664
},
{
"t": 74,
"x": 552,
"y": 667
},
{
"t": 75,
"x": 551,
"y": 669
},
{
"t": 76,
"x": 526,
"y": 673
},
{
"t": 77,
"x": 529,
"y": 673
},
{
"t": 78,
"x": 548,
"y": 668
},
{
"t": 80,
"x": 526,
"y": 672
},
{
"t": 81,
"x": 548,
"y": 667
},
{
"t": 82,
"x": 591,
"y": 666
},
{
"t": 84,
"x": 546,
"y": 668
},
{
"t": 85,
"x": 526,
"y": 674
},
{
"t": 88,
"x": 523,
"y": 671
},
{
"t": 99,
"x": 524,
"y": 674
},
{
"t": 115,
"x": 526,
"y": 674
},
{
"t": 117,
"x": 527,
"y": 672
},
{
"t": 119,
"x": 580,
"y": 660
}
],
"birth": 0,
"death": 120
},
{
"id": 3,
"type": "purple minivan",
"vis": [
{
"t": 0,
"v": false
},
{
"t": 23,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": false
},
{
"t": 23,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": null,
"y": null
},
{
"t": 23,
"x": 0,
"y": 644
},
{
"t": 24,
"x": 3,
"y": 647
},
{
"t": 25,
"x": 5,
"y": 649
},
{
"t": 26,
"x": 7,
"y": 633
},
{
"t": 27,
"x": 9,
"y": 633
},
{
"t": 28,
"x": 12,
"y": 634
},
{
"t": 29,
"x": 13,
"y": 633
},
{
"t": 30,
"x": 16,
"y": 633
},
{
"t": 31,
"x": 18,
"y": 633
},
{
"t": 32,
"x": 19,
"y": 632
},
{
"t": 33,
"x": 22,
"y": 632
},
{
"t": 34,
"x": 24,
"y": 632
},
{
"t": 35,
"x": 26,
"y": 632
},
{
"t": 36,
"x": 29,
"y": 632
},
{
"t": 37,
"x": 30,
"y": 631
},
{
"t": 38,
"x": 33,
"y": 632
},
{
"t": 39,
"x": 34,
"y": 633
},
{
"t": 42,
"x": 35,
"y": 631
},
{
"t": 45,
"x": 44,
"y": 631
},
{
"t": 46,
"x": 41,
"y": 631
},
{
"t": 47,
"x": 38,
"y": 631
},
{
"t": 48,
"x": 65,
"y": 630
},
{
"t": 49,
"x": 62,
"y": 630
},
{
"t": 51,
"x": 65,
"y": 630
},
{
"t": 52,
"x": 83,
"y": 629
},
{
"t": 54,
"x": 90,
"y": 629
},
{
"t": 55,
"x": 81,
"y": 630
},
{
"t": 56,
"x": 106,
"y": 628
},
{
"t": 57,
"x": 98,
"y": 629
},
{
"t": 58,
"x": 105,
"y": 628
},
{
"t": 59,
"x": 114,
"y": 628
},
{
"t": 60,
"x": 130,
"y": 626
},
{
"t": 62,
"x": 176,
"y": 624
},
{
"t": 63,
"x": 172,
"y": 624
},
{
"t": 65,
"x": 179,
"y": 624
},
{
"t": 66,
"x": 187,
"y": 624
},
{
"t": 67,
"x": 194,
"y": 623
},
{
"t": 68,
"x": 207,
"y": 623
},
{
"t": 69,
"x": 217,
"y": 622
},
{
"t": 71,
"x": 226,
"y": 622
},
{
"t": 72,
"x": 240,
"y": 620
},
{
"t": 74,
"x": 229,
"y": 622
},
{
"t": 75,
"x": 247,
"y": 620
},
{
"t": 76,
"x": 244,
"y": 621
},
{
"t": 77,
"x": 288,
"y": 618
},
{
"t": 78,
"x": 293,
"y": 618
},
{
"t": 79,
"x": 295,
"y": 618
},
{
"t": 80,
"x": 310,
"y": 617
},
{
"t": 83,
"x": 333,
"y": 616
},
{
"t": 86,
"x": 335,
"y": 616
},
{
"t": 87,
"x": 343,
"y": 616
},
{
"t": 88,
"x": 356,
"y": 615
},
{
"t": 90,
"x": 364,
"y": 615
},
{
"t": 91,
"x": 378,
"y": 614
},
{
"t": 93,
"x": 384,
"y": 614
},
{
"t": 94,
"x": 372,
"y": 615
},
{
"t": 95,
"x": 401,
"y": 613
},
{
"t": 96,
"x": 405,
"y": 613
},
{
"t": 97,
"x": 392,
"y": 614
},
{
"t": 98,
"x": 424,
"y": 610
},
{
"t": 99,
"x": 406,
"y": 614
},
{
"t": 100,
"x": 412,
"y": 613
},
{
"t": 101,
"x": 419,
"y": 613
},
{
"t": 102,
"x": 448,
"y": 609
},
{
"t": 103,
"x": 432,
"y": 613
},
{
"t": 104,
"x": 438,
"y": 611
},
{
"t": 105,
"x": 445,
"y": 611
},
{
"t": 106,
"x": 451,
"y": 611
},
{
"t": 107,
"x": 475,
"y": 608
},
{
"t": 108,
"x": 464,
"y": 610
},
{
"t": 109,
"x": 470,
"y": 610
},
{
"t": 111,
"x": 484,
"y": 608
},
{
"t": 112,
"x": 489,
"y": 609
},
{
"t": 113,
"x": 494,
"y": 608
},
{
"t": 115,
"x": 498,
"y": 607
},
{
"t": 116,
"x": 548,
"y": 603
},
{
"t": 117,
"x": 550,
"y": 604
}
],
"birth": 23,
"death": 120
}
],
"interactions": [
{
"id": 1,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 63,
"type": "contact"
},
{
"id": 14,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 79,
"type": "contact"
},
{
"id": 18,
"inputs": [
3,
65535
],
"outputs": [
3,
65535
],
"begins_at": 0,
"ends_at": 119,
"type": "contact"
},
{
"id": 6,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 46,
"ends_at": 46,
"type": "collision"
},
{
"id": 7,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 49,
"ends_at": 49,
"type": "collision"
},
{
"id": 2,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 67,
"ends_at": 67,
"type": "collision"
},
{
"id": 3,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 68,
"ends_at": 119,
"type": "contact"
},
{
"id": 8,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 70,
"ends_at": 70,
"type": "collision"
},
{
"id": 9,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 75,
"ends_at": 75,
"type": "collision"
},
{
"id": 10,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 77,
"ends_at": 77,
"type": "collision"
},
{
"id": 11,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 78,
"ends_at": 79,
"type": "contact"
},
{
"id": 12,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 81,
"ends_at": 81,
"type": "collision"
},
{
"id": 13,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 82,
"ends_at": 113,
"type": "contact"
},
{
"id": 15,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 83,
"ends_at": 83,
"type": "collision"
},
{
"id": 16,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 85,
"ends_at": 85,
"type": "collision"
},
{
"id": 17,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 86,
"ends_at": 119,
"type": "contact"
},
{
"id": 0,
"inputs": [
0,
1
],
"outputs": [
0,
1
],
"begins_at": 114,
"ends_at": 114,
"type": "collision"
},
{
"id": 4,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 115,
"ends_at": 115,
"type": "collision"
},
{
"id": 5,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 116,
"ends_at": 119,
"type": "contact"
}
]
}Complete per-sample evaluator report
{
"metrics": {
"avg_type_similarity": 0.39851442132717196,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": 166.67486053486147,
"avg_image_position_segmentation_acc": 0.2686426116838488,
"avg_image_position_segmentation_acc_small": null,
"avg_image_position_segmentation_acc_medium": 0.5041666666666667,
"avg_image_position_segmentation_acc_large": 0.03311855670103093,
"avg_image_position_segmentation_acc_first_frame": 0.0,
"avg_image_position_segmentation_visible_acc": 0.2686426116838488,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": 0.9791666666666666,
"visibility_true_acc": 1.0,
"visibility_false_acc": 0.5652173913043478,
"is_in_frame_acc": 0.9520833333333334,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 0.0,
"vis_acc_from_px": 0.9791666666666666,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 0.5652173913043478,
"num_matches": 4,
"num_unmatched_pred": 26,
"num_unmatched_target": 0
},
"supports": {
"avg_type_similarity": 4,
"avg_size_diff": 0,
"avg_3d_iou": 0,
"avg_image_position_px_diff": 4,
"avg_image_position_segmentation_acc": 4,
"avg_image_position_segmentation_acc_small": 0,
"avg_image_position_segmentation_acc_medium": 2,
"avg_image_position_segmentation_acc_large": 2,
"avg_image_position_segmentation_acc_first_frame": 3,
"avg_image_position_segmentation_visible_acc": 4,
"avg_quaternion_geodesic_deg": 0,
"visibility_acc": 4,
"visibility_true_acc": 4,
"visibility_false_acc": 1,
"is_in_frame_acc": 4,
"is_in_frame_true_acc": 4,
"is_in_frame_false_acc": 1,
"vis_acc_from_px": 4,
"vis_acc_from_px_true_acc": 4,
"vis_acc_from_px_false_acc": 1
},
"matching": {
"matches": [
{
"target_index": 0,
"pred_index": 0,
"target_id": 0,
"pred_id": 0,
"cost": 1.4416666666666667,
"cost_breakdown": [
{
"name": "mutual_type",
"weight": 1.0,
"raw_cost": 0.5,
"weighted_cost": 0.5,
"used_missing_value": false
},
{
"name": "same_seg",
"weight": 1.0,
"raw_cost": 0.9416666666666667,
"weighted_cost": 0.9416666666666667,
"used_missing_value": false
}
]
},
{
"target_index": 1,
"pred_index": 17,
"target_id": 1,
"pred_id": 17,
"cost": 0.975,
"cost_breakdown": [
{
"name": "mutual_type",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "same_seg",
"weight": 1.0,
"raw_cost": 0.975,
"weighted_cost": 0.975,
"used_missing_value": false
}
]
},
{
"target_index": 2,
"pred_index": 27,
"target_id": 2,
"pred_id": 27,
"cost": 0.05,
"cost_breakdown": [
{
"name": "mutual_type",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "same_seg",
"weight": 1.0,
"raw_cost": 0.05,
"weighted_cost": 0.05,
"used_missing_value": false
}
]
},
{
"target_index": 3,
"pred_index": 8,
"target_id": 3,
"pred_id": 8,
"cost": 0.9587628865979382,
"cost_breakdown": [
{
"name": "mutual_type",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "same_seg",
"weight": 1.0,
"raw_cost": 0.9587628865979382,
"weighted_cost": 0.9587628865979382,
"used_missing_value": false
}
]
}
],
"unmatched_target_ids": [],
"unmatched_pred_ids": [
1,
2,
3,
4,
5,
6,
7,
9,
10,
11,
12,
13,
14,
15,
16,
18,
19,
20,
21,
22,
23,
24,
25,
26,
28,
29
],
"target_type_counts": {
"brown utility": 1,
"gray jet": 1,
"red cruiser": 1,
"purple minivan": 1
},
"pred_type_counts": {
"red and brown leather camp shoe": 1,
"purple plastic medicine bottle": 6,
"pink and purple plastic package of overnight pads": 1,
"dark red and black plastic curling wand": 1,
"purple and white high-top sneaker": 1,
"red plastic hair dryer": 1,
"red and white cardboard ink cartridge box": 8,
"grey and white plastic shark figurine": 2,
"red and yellow running shoe": 6,
"grey and black fabric running shoe": 1,
"purple wooden dollhouse table": 1,
"pink rubber teething toy": 1
},
"assignment_backend": "scipy_dense",
"cost_functions": [
"mutual_type",
"same_seg"
],
"cost_weights": {
"mutual_type": 1.0,
"same_seg": 1.0
},
"num_frames": 120
},
"scene_metrics": {
"thresholds": [
0.5,
1.0,
2.0,
3.0
],
"counts_by_threshold": {
"0.5": {
"true_positives": 4,
"false_positives": 0,
"false_negatives": 0
},
"1.0": {
"true_positives": 3,
"false_positives": 1,
"false_negatives": 0
},
"2.0": {
"true_positives": 0,
"false_positives": 4,
"false_negatives": 0
},
"3.0": {
"true_positives": 0,
"false_positives": 4,
"false_negatives": 0
}
},
"jaccard_by_threshold": {
"0.5": 1.0,
"1.0": 0.75,
"2.0": 0.0,
"3.0": 0.0
},
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 4,
"false_positives": 26,
"false_negatives": 0
},
"0.5": {
"true_positives": 4,
"false_positives": 26,
"false_negatives": 0
},
"0.75": {
"true_positives": 4,
"false_positives": 26,
"false_negatives": 0
},
"1.0": {
"true_positives": 3,
"false_positives": 27,
"false_negatives": 1
}
},
"visibility_precision_by_threshold": {
"0.25": 0.13333333333333333,
"0.5": 0.13333333333333333,
"0.75": 0.13333333333333333,
"1.0": 0.1
},
"visibility_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 0.75
},
"visibility_f1_by_threshold": {
"0.25": 0.23529411764705882,
"0.5": 0.23529411764705882,
"0.75": 0.23529411764705882,
"1.0": 0.17647058823529416
},
"visibility_by_motion_group": {
"static": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 2,
"false_positives": 0,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 0,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 0,
"false_negatives": 0
},
"1.0": {
"true_positives": 1,
"false_positives": 1,
"false_negatives": 1
}
},
"visibility_precision_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 0.5
},
"visibility_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 0.5
},
"visibility_f1_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 0.5
}
},
"dynamic": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 2,
"false_positives": 0,
"false_negatives": 0
},
"0.5": {
"true_positives": 2,
"false_positives": 0,
"false_negatives": 0
},
"0.75": {
"true_positives": 2,
"false_positives": 0,
"false_negatives": 0
},
"1.0": {
"true_positives": 2,
"false_positives": 0,
"false_negatives": 0
}
},
"visibility_precision_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"visibility_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"visibility_f1_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
}
},
"unknown": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 26,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 26,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 26,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 26,
"false_negatives": 0
}
},
"visibility_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"segmentation_counts_by_threshold": {
"0.25": {
"true_positives": 1,
"false_positives": 29,
"false_negatives": 3
},
"0.5": {
"true_positives": 1,
"false_positives": 29,
"false_negatives": 3
},
"0.75": {
"true_positives": 1,
"false_positives": 29,
"false_negatives": 3
},
"1.0": {
"true_positives": 0,
"false_positives": 30,
"false_negatives": 4
}
},
"segmentation_precision_by_threshold": {
"0.25": 0.03333333333333333,
"0.5": 0.03333333333333333,
"0.75": 0.03333333333333333,
"1.0": 0.0
},
"segmentation_recall_by_threshold": {
"0.25": 0.25,
"0.5": 0.25,
"0.75": 0.25,
"1.0": 0.0
},
"segmentation_f1_by_threshold": {
"0.25": 0.058823529411764705,
"0.5": 0.058823529411764705,
"0.75": 0.058823529411764705,
"1.0": 0.0
},
"segmentation_frame_average_precision": 0.025,
"segmentation_frame_average_recall": 0.1875,
"segmentation_frame_average_f1": 0.044117647058823525,
"segmentation_first_frame_counts": {
"true_positives": 0,
"false_positives": 30,
"false_negatives": 0
},
"segmentation_first_frame_precision": 0.0,
"segmentation_first_frame_recall": 0.0,
"segmentation_first_frame_f1": 0.0,
"segmentation_by_motion_group": {
"static": {
"segmentation_counts_by_threshold": {
"0.25": {
"true_positives": 1,
"false_positives": 1,
"false_negatives": 1
},
"0.5": {
"true_positives": 1,
"false_positives": 1,
"false_negatives": 1
},
"0.75": {
"true_positives": 1,
"false_positives": 1,
"false_negatives": 1
},
"1.0": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 2
}
},
"segmentation_precision_by_threshold": {
"0.25": 0.5,
"0.5": 0.5,
"0.75": 0.5,
"1.0": 0.0
},
"segmentation_recall_by_threshold": {
"0.25": 0.5,
"0.5": 0.5,
"0.75": 0.5,
"1.0": 0.0
},
"segmentation_f1_by_threshold": {
"0.25": 0.5,
"0.5": 0.5,
"0.75": 0.5,
"1.0": 0.0
},
"segmentation_frame_average_precision": 0.375,
"segmentation_frame_average_recall": 0.375,
"segmentation_frame_average_f1": 0.375,
"segmentation_first_frame_counts": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 0
},
"segmentation_first_frame_precision": 0.0,
"segmentation_first_frame_recall": 0.0,
"segmentation_first_frame_f1": 0.0
},
"dynamic": {
"segmentation_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 2
},
"0.5": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 2
},
"0.75": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 2
},
"1.0": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 2
}
},
"segmentation_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_frame_average_precision": 0.0,
"segmentation_frame_average_recall": 0.0,
"segmentation_frame_average_f1": 0.0,
"segmentation_first_frame_counts": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 0
},
"segmentation_first_frame_precision": 0.0,
"segmentation_first_frame_recall": 0.0,
"segmentation_first_frame_f1": 0.0
},
"unknown": {
"segmentation_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 26,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 26,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 26,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 26,
"false_negatives": 0
}
},
"segmentation_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"segmentation_frame_average_precision": 0.0,
"segmentation_frame_average_recall": 0.0,
"segmentation_frame_average_f1": 0.0,
"segmentation_first_frame_counts": {
"true_positives": 0,
"false_positives": 26,
"false_negatives": 0
},
"segmentation_first_frame_precision": 0.0,
"segmentation_first_frame_recall": 0.0,
"segmentation_first_frame_f1": 0.0
}
}
},
"per_match_metrics": [
{
"target_id": 0,
"pred_id": 0,
"cost": 1.4416666666666667,
"type_similarity": 0.32199305246260335,
"size_diff": null,
"3d_iou": null,
"image_position_px_diff": 154.10451824641945,
"image_position_segmentation_acc": 0.058333333333333334,
"image_position_segmentation_acc_small": null,
"image_position_segmentation_acc_medium": 0.058333333333333334,
"image_position_segmentation_acc_large": null,
"image_position_segmentation_acc_first_frame": 0.0,
"image_position_segmentation_visible_acc": 0.058333333333333334,
"quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": null
},
{
"target_id": 1,
"pred_id": 17,
"cost": 0.975,
"type_similarity": 0.4226103799636084,
"size_diff": null,
"3d_iou": null,
"image_position_px_diff": 252.4819590080018,
"image_position_segmentation_acc": 0.025,
"image_position_segmentation_acc_small": null,
"image_position_segmentation_acc_medium": null,
"image_position_segmentation_acc_large": 0.025,
"image_position_segmentation_acc_first_frame": 0.0,
"image_position_segmentation_visible_acc": 0.025,
"quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": null
},
{
"target_id": 2,
"pred_id": 27,
"cost": 0.05,
"type_similarity": 0.4167119782040567,
"size_diff": null,
"3d_iou": null,
"image_position_px_diff": 48.60794774540897,
"image_position_segmentation_acc": 0.95,
"image_position_segmentation_acc_small": null,
"image_position_segmentation_acc_medium": 0.95,
"image_position_segmentation_acc_large": null,
"image_position_segmentation_acc_first_frame": 0.0,
"image_position_segmentation_visible_acc": 0.95,
"quaternion_geodesic_deg": null,
"visibility_acc": 1.0,
"visibility_true_acc": 1.0,
"visibility_false_acc": null,
"is_in_frame_acc": 1.0,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": null,
"vis_acc_from_px": 1.0,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": null
},
{
"target_id": 3,
"pred_id": 8,
"cost": 0.9587628865979382,
"type_similarity": 0.43274227467841936,
"size_diff": null,
"3d_iou": null,
"image_position_px_diff": 211.5050171396156,
"image_position_segmentation_acc": 0.041237113402061855,
"image_position_segmentation_acc_small": null,
"image_position_segmentation_acc_medium": null,
"image_position_segmentation_acc_large": 0.041237113402061855,
"image_position_segmentation_acc_first_frame": null,
"image_position_segmentation_visible_acc": 0.041237113402061855,
"quaternion_geodesic_deg": null,
"visibility_acc": 0.9166666666666666,
"visibility_true_acc": 1.0,
"visibility_false_acc": 0.5652173913043478,
"is_in_frame_acc": 0.8083333333333333,
"is_in_frame_true_acc": 1.0,
"is_in_frame_false_acc": 0.0,
"vis_acc_from_px": 0.9166666666666666,
"vis_acc_from_px_true_acc": 1.0,
"vis_acc_from_px_false_acc": 0.5652173913043478
}
],
"interaction_metrics": {
"avg_interaction_temporal_span_giou": -0.5066091798445979,
"avg_interaction_input_object_jaccard": 0.4385964912280701,
"avg_interaction_output_object_jaccard": 0.4385964912280701,
"avg_interaction_type_exact_match_acc": 0.5263157894736842,
"num_interaction_matches": 19,
"num_unmatched_pred_interactions": 16,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 2,
"false_positives": 33,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 35,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 35,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 35,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.05714285714285714,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.1081081081081081,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 17,
"false_positives": 18,
"false_negatives": 0
},
"0.5": {
"true_positives": 4,
"false_positives": 31,
"false_negatives": 0
},
"0.75": {
"true_positives": 4,
"false_positives": 31,
"false_negatives": 0
},
"1.0": {
"true_positives": 4,
"false_positives": 31,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.4857142857142857,
"0.5": 0.11428571428571428,
"0.75": 0.11428571428571428,
"1.0": 0.11428571428571428
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.6538461538461539,
"0.5": 0.20512820512820512,
"0.75": 0.20512820512820512,
"1.0": 0.20512820512820512
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 17,
"false_positives": 18,
"false_negatives": 0
},
"0.5": {
"true_positives": 4,
"false_positives": 31,
"false_negatives": 0
},
"0.75": {
"true_positives": 4,
"false_positives": 31,
"false_negatives": 0
},
"1.0": {
"true_positives": 4,
"false_positives": 31,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.4857142857142857,
"0.5": 0.11428571428571428,
"0.75": 0.11428571428571428,
"1.0": 0.11428571428571428
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.6538461538461539,
"0.5": 0.20512820512820512,
"0.75": 0.20512820512820512,
"1.0": 0.20512820512820512
}
},
"interaction_supports": {
"avg_interaction_temporal_span_giou": 19,
"avg_interaction_input_object_jaccard": 19,
"avg_interaction_output_object_jaccard": 19,
"avg_interaction_type_exact_match_acc": 19
},
"interaction_matching": {
"matches": [
{
"target_index": 0,
"pred_index": 3,
"target_id": 0,
"pred_id": 3,
"cost": 1.49,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.99,
"weighted_cost": 0.99,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 1,
"pred_index": 5,
"target_id": 1,
"pred_id": 5,
"cost": 0.8125,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.3125,
"weighted_cost": 0.3125,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 2,
"pred_index": 0,
"target_id": 2,
"pred_id": 0,
"cost": 1.8161764705882353,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 1.0,
"weighted_cost": 1.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.8161764705882353,
"weighted_cost": 0.8161764705882353,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
}
]
},
{
"target_index": 3,
"pred_index": 1,
"target_id": 3,
"pred_id": 1,
"cost": 1.1833333333333333,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.6833333333333333,
"weighted_cost": 0.6833333333333333,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 4,
"pred_index": 32,
"target_id": 4,
"pred_id": 32,
"cost": 1.490566037735849,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.9905660377358491,
"weighted_cost": 0.9905660377358491,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 5,
"pred_index": 12,
"target_id": 5,
"pred_id": 12,
"cost": 0.8833333333333333,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.8833333333333333,
"weighted_cost": 0.8833333333333333,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
}
]
},
{
"target_index": 6,
"pred_index": 2,
"target_id": 6,
"pred_id": 2,
"cost": 2.2340425531914896,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 1.0,
"weighted_cost": 1.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.7340425531914894,
"weighted_cost": 0.7340425531914894,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 7,
"pred_index": 6,
"target_id": 7,
"pred_id": 6,
"cost": 2.25,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 1.0,
"weighted_cost": 1.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.75,
"weighted_cost": 0.75,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 8,
"pred_index": 7,
"target_id": 8,
"pred_id": 7,
"cost": 2.323943661971831,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 1.0,
"weighted_cost": 1.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.823943661971831,
"weighted_cost": 0.823943661971831,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 9,
"pred_index": 8,
"target_id": 9,
"pred_id": 8,
"cost": 2.3355263157894735,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 1.0,
"weighted_cost": 1.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.8355263157894737,
"weighted_cost": 0.8355263157894737,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 10,
"pred_index": 9,
"target_id": 10,
"pred_id": 9,
"cost": 2.33974358974359,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 1.0,
"weighted_cost": 1.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.8397435897435898,
"weighted_cost": 0.8397435897435898,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 11,
"pred_index": 10,
"target_id": 11,
"pred_id": 10,
"cost": 1.3375,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.8375,
"weighted_cost": 0.8375,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 12,
"pred_index": 11,
"target_id": 12,
"pred_id": 11,
"cost": 2.347560975609756,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 1.0,
"weighted_cost": 1.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.8475609756097561,
"weighted_cost": 0.8475609756097561,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 13,
"pred_index": 13,
"target_id": 13,
"pred_id": 13,
"cost": 1.2543859649122808,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.7543859649122807,
"weighted_cost": 0.7543859649122807,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 14,
"pred_index": 22,
"target_id": 14,
"pred_id": 22,
"cost": 0.35,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.35,
"weighted_cost": 0.35,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
}
]
},
{
"target_index": 15,
"pred_index": 14,
"target_id": 15,
"pred_id": 14,
"cost": 2.3511904761904763,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 1.0,
"weighted_cost": 1.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.8511904761904762,
"weighted_cost": 0.8511904761904762,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 16,
"pred_index": 15,
"target_id": 16,
"pred_id": 15,
"cost": 2.354651162790698,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 1.0,
"weighted_cost": 1.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.8546511627906976,
"weighted_cost": 0.8546511627906976,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 17,
"pred_index": 16,
"target_id": 17,
"pred_id": 16,
"cost": 1.2583333333333333,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.7583333333333333,
"weighted_cost": 0.7583333333333333,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.5,
"weighted_cost": 0.25,
"used_missing_value": false
}
]
},
{
"target_index": 18,
"pred_index": 30,
"target_id": 18,
"pred_id": 30,
"cost": 0.4,
"cost_breakdown": [
{
"name": "type_exact",
"weight": 1.0,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "temporal_span",
"weight": 1.0,
"raw_cost": 0.4,
"weighted_cost": 0.4,
"used_missing_value": false
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5,
"raw_cost": 0.0,
"weighted_cost": 0.0,
"used_missing_value": false
}
]
}
],
"unmatched_target_ids": [],
"unmatched_pred_ids": [
4,
17,
18,
19,
20,
21,
23,
24,
25,
26,
27,
28,
29,
31,
33,
34
],
"target_type_counts": {
"collision": 11,
"contact": 8
},
"pred_type_counts": {
"contact": 33,
"collision": 2
},
"assignment_backend": "scipy_dense",
"cost_functions": [
"type_exact",
"temporal_span",
"input_object_set_mutual_jaccard",
"output_object_set_mutual_jaccard"
],
"cost_weights": {
"type_exact": 1.0,
"temporal_span": 1.0,
"input_object_set_mutual_jaccard": 0.5,
"output_object_set_mutual_jaccard": 0.5
}
},
"per_interaction_match_metrics": [
{
"target_index": 0,
"pred_index": 3,
"target_id": 0,
"pred_id": 3,
"target_type": "collision",
"pred_type": "collision",
"cost": 1.49,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.98,
"input_object_jaccard": 0.0,
"output_object_jaccard": 0.0,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 1,
"pred_index": 5,
"target_id": 1,
"pred_id": 5,
"target_type": "contact",
"pred_type": "contact",
"cost": 0.8125,
"temporal_span_iou": 0.375,
"temporal_span_giou": 0.375,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 2,
"pred_index": 0,
"target_id": 2,
"pred_id": 0,
"target_type": "collision",
"pred_type": "contact",
"cost": 1.8161764705882353,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.6323529411764706,
"input_object_jaccard": 1.0,
"output_object_jaccard": 1.0,
"type_exact_match": 0.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 1.0,
"output_object_set_exact_match": 1.0
},
{
"target_index": 3,
"pred_index": 1,
"target_id": 3,
"pred_id": 1,
"target_type": "contact",
"pred_type": "contact",
"cost": 1.1833333333333333,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.36666666666666664,
"input_object_jaccard": 0.0,
"output_object_jaccard": 0.0,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 4,
"pred_index": 32,
"target_id": 4,
"pred_id": 32,
"target_type": "collision",
"pred_type": "collision",
"cost": 1.490566037735849,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.9811320754716981,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 5,
"pred_index": 12,
"target_id": 5,
"pred_id": 12,
"target_type": "contact",
"pred_type": "contact",
"cost": 0.8833333333333333,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.7666666666666667,
"input_object_jaccard": 1.0,
"output_object_jaccard": 1.0,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 1.0,
"output_object_set_exact_match": 1.0
},
{
"target_index": 6,
"pred_index": 2,
"target_id": 6,
"pred_id": 2,
"target_type": "collision",
"pred_type": "contact",
"cost": 2.2340425531914896,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.46808510638297873,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 0.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 7,
"pred_index": 6,
"target_id": 7,
"pred_id": 6,
"target_type": "collision",
"pred_type": "contact",
"cost": 2.25,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.5,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 0.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 8,
"pred_index": 7,
"target_id": 8,
"pred_id": 7,
"target_type": "collision",
"pred_type": "contact",
"cost": 2.323943661971831,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.647887323943662,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 0.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 9,
"pred_index": 8,
"target_id": 9,
"pred_id": 8,
"target_type": "collision",
"pred_type": "contact",
"cost": 2.3355263157894735,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.6710526315789473,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 0.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 10,
"pred_index": 9,
"target_id": 10,
"pred_id": 9,
"target_type": "collision",
"pred_type": "contact",
"cost": 2.33974358974359,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.6794871794871795,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 0.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 11,
"pred_index": 10,
"target_id": 11,
"pred_id": 10,
"target_type": "contact",
"pred_type": "contact",
"cost": 1.3375,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.675,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 12,
"pred_index": 11,
"target_id": 12,
"pred_id": 11,
"target_type": "collision",
"pred_type": "contact",
"cost": 2.347560975609756,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.6951219512195121,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 0.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 13,
"pred_index": 13,
"target_id": 13,
"pred_id": 13,
"target_type": "contact",
"pred_type": "contact",
"cost": 1.2543859649122808,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.5087719298245614,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 14,
"pred_index": 22,
"target_id": 14,
"pred_id": 22,
"target_type": "contact",
"pred_type": "contact",
"cost": 0.35,
"temporal_span_iou": 0.3,
"temporal_span_giou": 0.3,
"input_object_jaccard": 1.0,
"output_object_jaccard": 1.0,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 1.0,
"output_object_set_exact_match": 1.0
},
{
"target_index": 15,
"pred_index": 14,
"target_id": 15,
"pred_id": 14,
"target_type": "collision",
"pred_type": "contact",
"cost": 2.3511904761904763,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.7023809523809523,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 0.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 16,
"pred_index": 15,
"target_id": 16,
"pred_id": 15,
"target_type": "collision",
"pred_type": "contact",
"cost": 2.354651162790698,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.7093023255813954,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 0.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 17,
"pred_index": 16,
"target_id": 17,
"pred_id": 16,
"target_type": "contact",
"pred_type": "contact",
"cost": 1.2583333333333333,
"temporal_span_iou": 0.0,
"temporal_span_giou": -0.5166666666666667,
"input_object_jaccard": 0.3333333333333333,
"output_object_jaccard": 0.3333333333333333,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 0.0,
"output_object_set_exact_match": 0.0
},
{
"target_index": 18,
"pred_index": 30,
"target_id": 18,
"pred_id": 30,
"target_type": "contact",
"pred_type": "contact",
"cost": 0.4,
"temporal_span_iou": 0.2,
"temporal_span_giou": 0.2,
"input_object_jaccard": 1.0,
"output_object_jaccard": 1.0,
"type_exact_match": 1.0,
"temporal_span_exact_match": 0.0,
"input_object_set_exact_match": 1.0,
"output_object_set_exact_match": 1.0
}
],
"interaction_metrics_by_participants": {
"object_ground": {
"avg_interaction_temporal_span_giou": -0.48030968983596445,
"avg_interaction_input_object_jaccard": 0.4629629629629629,
"avg_interaction_output_object_jaccard": 0.4629629629629629,
"avg_interaction_type_exact_match_acc": 0.5,
"num_interaction_matches": 18,
"num_unmatched_pred_interactions": 15,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 2,
"false_positives": 31,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 33,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 33,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 33,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.06060606060606061,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.1142857142857143,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 17,
"false_positives": 16,
"false_negatives": 0
},
"0.5": {
"true_positives": 4,
"false_positives": 29,
"false_negatives": 0
},
"0.75": {
"true_positives": 4,
"false_positives": 29,
"false_negatives": 0
},
"1.0": {
"true_positives": 4,
"false_positives": 29,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.5151515151515151,
"0.5": 0.12121212121212122,
"0.75": 0.12121212121212122,
"1.0": 0.12121212121212122
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.6799999999999999,
"0.5": 0.21621621621621626,
"0.75": 0.21621621621621626,
"1.0": 0.21621621621621626
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 17,
"false_positives": 16,
"false_negatives": 0
},
"0.5": {
"true_positives": 4,
"false_positives": 29,
"false_negatives": 0
},
"0.75": {
"true_positives": 4,
"false_positives": 29,
"false_negatives": 0
},
"1.0": {
"true_positives": 4,
"false_positives": 29,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.5151515151515151,
"0.5": 0.12121212121212122,
"0.75": 0.12121212121212122,
"1.0": 0.12121212121212122
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.6799999999999999,
"0.5": 0.21621621621621626,
"0.75": 0.21621621621621626,
"1.0": 0.21621621621621626
}
},
"object_object": {
"avg_interaction_temporal_span_giou": -0.98,
"avg_interaction_input_object_jaccard": 0.0,
"avg_interaction_output_object_jaccard": 0.0,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 1,
"num_unmatched_pred_interactions": 1,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 2,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"interaction_supports_by_participants": {
"object_ground": {
"avg_interaction_temporal_span_giou": 18,
"avg_interaction_input_object_jaccard": 18,
"avg_interaction_output_object_jaccard": 18,
"avg_interaction_type_exact_match_acc": 18
},
"object_object": {
"avg_interaction_temporal_span_giou": 1,
"avg_interaction_input_object_jaccard": 1,
"avg_interaction_output_object_jaccard": 1,
"avg_interaction_type_exact_match_acc": 1
}
},
"interaction_metrics_by_type": {
"collision": {
"avg_interaction_temporal_span_giou": -0.6969820442929815,
"avg_interaction_input_object_jaccard": 0.36363636363636365,
"avg_interaction_output_object_jaccard": 0.36363636363636365,
"avg_interaction_type_exact_match_acc": 0.18181818181818182,
"num_interaction_matches": 11,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 11,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 11,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 11,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 11,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 10,
"false_positives": 1,
"false_negatives": 0
},
"0.5": {
"true_positives": 1,
"false_positives": 10,
"false_negatives": 0
},
"0.75": {
"true_positives": 1,
"false_positives": 10,
"false_negatives": 0
},
"1.0": {
"true_positives": 1,
"false_positives": 10,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.9090909090909091,
"0.5": 0.09090909090909091,
"0.75": 0.09090909090909091,
"1.0": 0.09090909090909091
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.9523809523809523,
"0.5": 0.16666666666666669,
"0.75": 0.16666666666666669,
"1.0": 0.16666666666666669
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 10,
"false_positives": 1,
"false_negatives": 0
},
"0.5": {
"true_positives": 1,
"false_positives": 10,
"false_negatives": 0
},
"0.75": {
"true_positives": 1,
"false_positives": 10,
"false_negatives": 0
},
"1.0": {
"true_positives": 1,
"false_positives": 10,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.9090909090909091,
"0.5": 0.09090909090909091,
"0.75": 0.09090909090909091,
"1.0": 0.09090909090909091
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.9523809523809523,
"0.5": 0.16666666666666669,
"0.75": 0.16666666666666669,
"1.0": 0.16666666666666669
}
},
"contact": {
"avg_interaction_temporal_span_giou": -0.2448464912280702,
"avg_interaction_input_object_jaccard": 0.5416666666666667,
"avg_interaction_output_object_jaccard": 0.5416666666666667,
"avg_interaction_type_exact_match_acc": 1.0,
"num_interaction_matches": 8,
"num_unmatched_pred_interactions": 16,
"num_unmatched_target_interactions": 0,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 2,
"false_positives": 22,
"false_negatives": 0
},
"0.5": {
"true_positives": 0,
"false_positives": 24,
"false_negatives": 0
},
"0.75": {
"true_positives": 0,
"false_positives": 24,
"false_negatives": 0
},
"1.0": {
"true_positives": 0,
"false_positives": 24,
"false_negatives": 0
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.08333333333333333,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 1.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.15384615384615385,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 7,
"false_positives": 17,
"false_negatives": 0
},
"0.5": {
"true_positives": 3,
"false_positives": 21,
"false_negatives": 0
},
"0.75": {
"true_positives": 3,
"false_positives": 21,
"false_negatives": 0
},
"1.0": {
"true_positives": 3,
"false_positives": 21,
"false_negatives": 0
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.2916666666666667,
"0.5": 0.125,
"0.75": 0.125,
"1.0": 0.125
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.45161290322580644,
"0.5": 0.2222222222222222,
"0.75": 0.2222222222222222,
"1.0": 0.2222222222222222
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 7,
"false_positives": 17,
"false_negatives": 0
},
"0.5": {
"true_positives": 3,
"false_positives": 21,
"false_negatives": 0
},
"0.75": {
"true_positives": 3,
"false_positives": 21,
"false_negatives": 0
},
"1.0": {
"true_positives": 3,
"false_positives": 21,
"false_negatives": 0
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.2916666666666667,
"0.5": 0.125,
"0.75": 0.125,
"1.0": 0.125
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 1.0,
"0.5": 1.0,
"0.75": 1.0,
"1.0": 1.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.45161290322580644,
"0.5": 0.2222222222222222,
"0.75": 0.2222222222222222,
"1.0": 0.2222222222222222
}
}
},
"interaction_supports_by_type": {
"collision": {
"avg_interaction_temporal_span_giou": 11,
"avg_interaction_input_object_jaccard": 11,
"avg_interaction_output_object_jaccard": 11,
"avg_interaction_type_exact_match_acc": 11
},
"contact": {
"avg_interaction_temporal_span_giou": 8,
"avg_interaction_input_object_jaccard": 8,
"avg_interaction_output_object_jaccard": 8,
"avg_interaction_type_exact_match_acc": 8
}
}
}Exact evaluation configuration
{
"predictions_jsonl": "../inference_output.jsonl",
"dataset_json": "../test_data/movi_dump_sentinel_sharegpt.json",
"scene_root": "../test_data/movi_dump",
"output_json": "../evaluation_report.json",
"max_samples": null,
"num_workers": 1,
"show_progress": true,
"log_level": "INFO",
"visibility_filter_mode": "any_frame",
"pos2d_mode": "scaled_normalized",
"pos2d_scale": 1000.0,
"image_width": null,
"image_height": null,
"type_embed_model_name": "all-MiniLM-L6-v2",
"scene_similarity_thresholds": [
0.5,
1.0,
2.0,
3.0
],
"scene_segmentation_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"matching": {
"costs": [
{
"name": "mutual_type",
"weight": 1.0
},
{
"name": "same_seg",
"weight": 1.0,
"missing_value": 1.0,
"kwargs": {
"only_use_first_frame": false
}
}
]
},
"interaction_matching": {
"costs": [
{
"name": "type_exact",
"weight": 1.0
},
{
"name": "temporal_span",
"weight": 1.0
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5
}
]
},
"return_per_sample": true
}