STRIVE · 08/28/2026
Dyn generalization · test_120 · super_clevr_1111
Everything fed into evaluation and the full per-sample output it produced.
Dataset row: exact video + user prompt + assistant target
{
"messages": [
{
"role": "user",
"content": "<video>\nAnalyze the provided video and return ONLY a valid sentinel sequence in this format:\n[SCENE-START] [OBJS-START]\n[OBJ] id \"type\" birth death [VIS] t vis ... [IN-FRAME] t is_in_frame ... [PX] t px py ...\n[OBJ] ...\n[OBJS-END]\n[INTERACTIONS-START]\n[INTERACT] id \"type\" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ...\n[INTERACT] ...\n[INTERACTIONS-END] [SCENE-END]\n\nConstraints:\n- Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose).\n- Keep tags exactly as written:\n `[SCENE-START] [OBJS-START] [OBJ] [VIS] [IN-FRAME] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]`\n- Use quoted strings for `type` (double quotes).\n- `VIS` uses repeated groups of 2 values in order:\n `t vis`.\n `vis` is a boolean value.\n- `IN-FRAME` uses repeated groups of 2 values in order:\n `t is_in_frame`.\n `is_in_frame` is a boolean value.\n- `PX` uses repeated groups of 3 values in order: `t px py`.\n- `px` and `py` are normalized pixel coordinates in the range `[0, 1]`,\n scaled by `1000` and then converted to integers by dropping the decimal part.\n- For occluded or out-of-frame frames under this setting, `PX` may use `t null null`.\n- `IN` and `OUT` contain whitespace-separated integer ids.\n- Use lowercase booleans (`true`/`false`) for `vis` and `is_in_frame`."
},
{
"role": "assistant",
"content": "[SCENE-START] [OBJS-START] [OBJ] 0 \"yellow cruiser\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 154 681 2 161 680 3 172 680 5 179 679 6 185 678 7 192 678 8 198 678 9 205 677 10 212 677 11 218 675 12 225 676 13 231 675 14 239 675 15 246 674 16 252 674 17 260 673 18 266 673 19 273 673 20 280 672 21 287 672 22 296 671 23 303 671 24 310 671 25 318 670 26 325 670 27 332 668 28 340 669 29 347 667 30 355 667 31 363 667 32 371 666 33 379 666 34 387 666 35 394 665 36 400 664 37 405 663 38 409 661 39 416 660 40 421 660 41 428 659 42 434 659 43 440 658 44 447 659 45 451 658 46 455 658 47 462 656 48 467 656 49 462 685 50 470 683 51 481 656 52 485 656 53 489 660 54 494 663 55 498 667 56 502 670 57 506 673 58 508 672 59 507 670 60 509 674 61 510 677 62 516 684 63 519 688 64 521 685 65 526 686 66 526 684 67 509 673 68 514 674 69 527 681 70 526 680 72 529 681 74 531 681 75 534 682 78 548 686 79 541 683 80 538 681 81 540 682 85 543 682 88 545 682 90 548 683 93 550 683 97 553 683 102 555 683 105 557 684 109 559 684 115 562 684 118 565 684 [OBJ] 1 \"gray wagon\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 208 550 1 217 551 2 213 554 3 221 555 4 217 557 5 226 559 6 223 561 7 233 564 8 229 566 9 227 568 10 236 570 11 233 572 12 244 574 13 243 576 14 240 578 15 251 580 16 250 582 17 248 584 18 248 588 19 259 589 20 258 592 22 265 597 23 270 598 24 272 597 26 280 597 27 287 599 28 276 595 29 281 596 30 266 603 31 269 606 32 273 610 33 277 614 34 283 616 35 286 620 36 289 624 37 293 627 38 302 642 39 306 642 40 310 643 41 314 646 42 318 649 43 320 651 44 324 654 45 326 656 46 333 658 47 332 661 48 334 664 49 337 666 50 340 669 51 347 671 52 348 673 53 348 676 54 351 679 55 353 681 56 356 684 57 358 686 58 362 690 59 365 692 60 368 695 61 371 698 62 373 700 63 376 702 64 380 707 65 382 709 66 384 710 67 388 717 68 391 718 69 393 720 70 397 725 71 399 727 72 401 728 73 404 730 74 408 735 75 410 738 76 412 739 77 416 744 78 419 746 79 423 751 80 425 752 81 428 755 82 430 756 83 434 761 84 437 764 85 441 769 86 443 770 87 447 775 88 450 778 89 452 779 90 456 784 91 458 785 92 462 788 93 466 793 94 468 794 95 472 799 96 475 801 97 479 806 98 481 807 99 485 813 100 488 815 101 492 820 102 494 821 103 499 827 104 502 830 105 505 832 106 509 838 107 512 840 108 516 842 109 519 847 110 523 851 111 526 853 112 530 858 113 534 863 114 537 865 115 541 870 116 545 874 117 548 867 118 551 869 119 555 874 [OBJ] 2 \"green school\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 473 564 37 472 570 38 471 573 39 470 575 41 472 570 42 473 566 43 475 564 44 474 561 45 473 560 46 477 559 47 476 560 49 474 564 51 473 567 52 471 570 54 469 575 55 468 577 57 469 575 92 469 572 [OBJ] 3 \"cyan airliner\" 0 120 [VIS] 0 true 97 false [IN-FRAME] 0 true 97 false [PX] 0 483 295 1 486 296 4 491 297 6 494 297 7 499 300 8 497 298 10 523 306 11 501 299 12 505 300 14 516 304 15 510 301 17 517 304 18 516 302 19 518 302 20 523 305 21 530 307 22 526 304 23 531 307 24 530 305 25 536 308 27 548 311 29 544 308 30 550 311 31 579 319 32 566 316 33 563 315 35 567 316 36 580 319 39 610 326 40 598 323 43 629 330 44 615 327 46 651 335 47 633 331 48 655 338 49 668 340 50 647 334 51 673 341 52 679 342 53 665 339 54 691 345 55 682 343 56 706 349 57 714 351 58 720 352 59 728 354 60 735 355 61 699 349 62 706 350 63 714 352 64 723 355 65 732 357 66 742 360 67 751 363 68 762 366 69 771 368 70 783 371 71 794 375 72 806 378 73 819 382 74 831 385 75 844 389 76 859 394 77 875 398 78 888 401 79 907 407 80 925 413 81 943 417 82 956 417 83 962 410 84 908 361 85 924 364 86 941 367 87 958 369 88 969 372 89 978 376 90 987 380 91 937 465 92 948 471 93 957 477 94 977 485 95 995 494 96 993 374 97 null null [OBJ] 4 \"red minivan\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 501 665 36 506 664 37 508 665 38 512 665 39 516 664 40 519 664 41 525 663 42 528 663 43 533 661 44 537 660 45 541 659 47 543 658 48 545 658 49 548 651 50 547 671 51 550 671 52 553 674 53 558 679 54 563 678 55 567 690 56 576 659 57 578 657 58 587 689 59 593 689 60 598 682 61 603 682 62 605 661 63 609 667 64 616 673 65 622 674 66 632 678 67 640 679 68 649 682 69 658 683 70 668 686 71 677 686 72 687 690 73 696 691 74 705 692 75 715 694 76 723 694 77 733 696 78 732 689 79 724 681 80 715 676 81 730 679 82 742 681 83 726 675 84 735 676 85 748 678 86 761 680 87 774 682 88 737 673 89 744 674 90 748 674 92 763 676 93 751 674 94 758 675 95 766 676 96 773 677 97 777 677 98 784 678 99 792 679 100 799 680 101 805 680 102 791 679 103 794 680 104 828 683 105 840 684 106 815 683 107 822 684 108 829 685 109 836 686 110 844 688 111 851 689 112 858 690 113 855 690 114 871 691 115 880 692 116 877 693 117 908 693 118 902 695 119 923 695 [OBJS-END] [INTERACTIONS-START] [INTERACT] 8 \"contact\" 0 64 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 11 \"contact\" 0 119 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 12 \"contact\" 0 119 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 13 \"contact\" 0 119 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 2 \"collision\" 36 36 [IN] 0 4 [OUT] 0 4 [INTERACT] 1 \"collision\" 41 41 [IN] 0 2 [OUT] 0 2 [INTERACT] 0 \"collision\" 42 42 [IN] 0 1 [OUT] 0 1 [INTERACT] 3 \"collision\" 42 42 [IN] 0 4 [OUT] 0 4 [INTERACT] 4 \"collision\" 47 47 [IN] 0 4 [OUT] 0 4 [INTERACT] 5 \"contact\" 48 63 [IN] 0 4 [OUT] 0 4 [INTERACT] 6 \"collision\" 69 69 [IN] 0 4 [OUT] 0 4 [INTERACT] 9 \"collision\" 69 69 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 7 \"contact\" 70 83 [IN] 0 4 [OUT] 0 4 [INTERACT] 10 \"contact\" 70 119 [IN] 0 65535 [OUT] 0 65535 [INTERACTIONS-END] [SCENE-END]"
}
],
"videos": [
"/mmfs1/gscratch/krishna/suryadv/strive_dynsuperclevr/data/lf/videos/test_full/super_clevr_1111/frames.mp4"
]
}Inference record: exact prompt + prediction + label + parse debug
{
"prompt": "user\n\nAnalyze the provided video and return ONLY a valid sentinel sequence in this format:\n[SCENE-START] [OBJS-START]\n[OBJ] id \"type\" birth death [VIS] t vis ... [IN-FRAME] t is_in_frame ... [PX] t px py ...\n[OBJ] ...\n[OBJS-END]\n[INTERACTIONS-START]\n[INTERACT] id \"type\" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ...\n[INTERACT] ...\n[INTERACTIONS-END] [SCENE-END]\n\nConstraints:\n- Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose).\n- Keep tags exactly as written:\n `[SCENE-START] [OBJS-START] [OBJ] [VIS] [IN-FRAME] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]`\n- Use quoted strings for `type` (double quotes).\n- `VIS` uses repeated groups of 2 values in order:\n `t vis`.\n `vis` is a boolean value.\n- `IN-FRAME` uses repeated groups of 2 values in order:\n `t is_in_frame`.\n `is_in_frame` is a boolean value.\n- `PX` uses repeated groups of 3 values in order: `t px py`.\n- `px` and `py` are normalized pixel coordinates in the range `[0, 1]`,\n scaled by `1000` and then converted to integers by dropping the decimal part.\n- For occluded or out-of-frame frames under this setting, `PX` may use `t null null`.\n- `IN` and `OUT` contain whitespace-separated integer ids.\n- Use lowercase booleans (`true`/`false`) for `vis` and `is_in_frame`.\nassistant\n",
"predict": "[SCENE-START] [OBJS-START] [OBJ] 0 \"yellow plastic toy school bus\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 419 650 15 412 654 17 416 646 19 419 634 21 427 626 [OBJ] 1 \"grey and black basketball shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 431 361 11 443 365 15 451 369 19 458 373 23 466 376 [OBJ] 2 \"green wooden dollhouse bedroom furniture set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 466 552 2 470 560 3 466 552 4 470 560 10 470 572 11 466 560 12 470 572 13 466 560 14 470 572 15 466 564 17 462 556 18 466 564 19 462 556 20 466 564 21 462 556 22 458 548 [OBJ] 3 \"red fabric storage cube\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 505 669 2 509 662 3 501 669 4 509 662 5 501 666 6 509 658 7 501 662 8 509 654 9 501 658 10 509 650 11 501 654 12 509 646 13 501 650 14 509 642 15 501 646 16 509 638 17 501 642 18 509 634 19 501 638 20 509 630 21 513 623 22 517 615 23 525 607 [OBJ] 4 \"wooden toy juicer set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 509 603 15 505 595 16 509 587 20 513 576 21 513 595 22 517 572 23 513 595 [OBJ] 5 \"red and yellow running shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 513 681 2 517 673 11 521 662 13 525 654 15 529 646 19 533 638 20 529 646 21 533 638 22 537 630 [OBJ] 6 \"red plastic hair dryer\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 548 689 3 556 685 6 564 681 10 572 677 13 580 673 16 587 669 18 595 666 21 603 662 24 615 658 [OBJ] 7 \"dark grey and purple plastic Shredder action figure\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 587 681 1 591 673 5 595 666 9 599 658 13 607 650 16 611 642 20 615 634 23 623 626 [OBJ] 8 \"dark grey and purple plastic Shredder action figure\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 595 666 3 599 658 6 603 650 9 607 642 12 611 634 15 615 626 18 619 619 21 623 611 24 626 603 [OBJ] 9 \"red plastic hair dryer\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 615 673 4 623 669 9 626 662 13 634 658 18 638 650 23 642 642 [OBJ] 10 \"dark grey cardboard motherboard box\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true 2 false [PX] 0 615 998 2 null null [OBJ] 11 \"dark grey cardboard motherboard box\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 623 0 1 null null [OBJ] 12 \"yellow cardboard ink cartridge box\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 646 0 1 null null [OBJ] 13 \"white and black athletic shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 681 423 4 689 419 10 693 431 11 693 419 13 697 427 15 697 416 16 701 427 18 701 416 20 705 423 22 705 412 [OBJ] 14 \"grey and black basketball shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 212 552 3 224 560 4 232 568 5 240 576 6 248 583 7 251 591 8 259 599 10 267 603 12 275 607 14 283 615 16 291 623 17 298 630 18 306 634 19 314 642 20 322 646 21 330 654 22 337 658 23 345 662 [OBJ] 15 \"dark grey and yellow running shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 220 685 1 228 689 2 236 693 4 251 693 6 267 693 8 279 693 10 294 693 12 310 693 14 326 693 15 333 689 16 345 689 17 357 689 18 365 685 19 376 685 20 388 685 21 400 685 22 412 681 23 423 681 [OBJ] 16 \"yellow tennis shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 431 677 1 439 673 4 447 669 8 455 666 10 458 658 13 466 654 16 474 650 18 478 642 20 486 638 23 494 634 [OBJ] 17 \"teal and lime running shoe\" 0 24 [VIS] 0 true 1 false 2 true 3 false 4 true 5 false [IN-FRAME] 0 true [PX] 0 435 693 1 null null 2 435 693 3 null null 4 439 689 5 null null [OBJ] 18 \"teal and lime running shoe\" 0 24 [VIS] 0 true 3 false 4 true [IN-FRAME] 0 true [PX] 0 478 689 1 482 681 2 482 693 3 null null 4 486 681 5 490 673 6 494 666 10 501 662 14 509 658 17 517 654 21 525 650 23 529 642 [OBJ] 19 \"teal and lime running shoe\" 0 24 [VIS] 0 true 2 false [IN-FRAME] 0 true [PX] 0 509 685 1 513 693 2 null null [OBJ] 20 \"teal and lime running shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 541 689 1 null null [OBJ] 21 \"light grey fabric chukka boot\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 583 626 3 583 615 8 587 607 12 587 595 15 591 587 19 591 576 21 595 568 23 599 560 [OBJ] 22 \"light grey fabric boat shoe\" 0 24 [VIS] 0 true 1 false [IN-FRAME] 0 true 1 false [PX] 0 583 998 1 null null [OBJ] 23 \"dark grey and purple plastic Shredder action figure\" 0 24 [VIS] 0 true 1 false 2 true 4 false [IN-FRAME] 0 true 1 false 2 true 4 false [PX] 0 603 0 1 null null 2 607 1 3 615 5 4 null null [OBJ] 24 \"dark grey and purple plastic Shredder action figure\" 0 24 [VIS] 0 true 1 false 2 true [IN-FRAME] 0 true 1 false 2 true [PX] 0 607 1 1 null null 2 611 5 4 619 9 6 626 13 8 634 17 10 642 21 11 650 25 12 642 17 14 650 21 16 658 25 17 666 29 18 658 21 19 666 25 21 673 29 22 681 33 23 673 29 [OBJ] 25 \"red plastic hair dryer\" 0 24 [VIS] 0 true 1 false 2 true [IN-FRAME] 0 true 1 false 2 true [PX] 0 607 5 1 null null 2 611 9 3 619 13 5 626 21 6 634 25 7 642 29 9 650 37 11 658 48 12 666 52 14 673 64 16 681 72 18 689 83 19 693 91 20 697 99 21 701 107 23 708 119 [OBJ] 26 \"white plastic supplement bottle\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 615 423 1 607 427 5 619 427 6 611 431 10 619 435 11 611 439 15 619 443 16 611 447 20 615 455 21 607 458 [OBJ] 27 \"teal and lime running shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 623 373 1 623 361 2 626 369 3 623 357 4 626 365 5 623 353 6 626 361 7 623 349 10 626 341 11 630 349 12 626 337 14 630 330 15 634 337 16 630 326 18 634 318 20 638 310 22 642 302 23 646 310 [OBJ] 28 \"blue and green snake print leather ballet flat\" 0 24 [VIS] 0 true 2 false 5 true 10 false 13 true [IN-FRAME] 0 true [PX] 0 634 423 2 null null 5 638 423 10 null null 13 642 423 16 646 431 19 650 439 23 654 447 [OBJ] 29 \"white and brown sneaker\" 0 24 [VIS] 0 true 5 false 6 true 10 false 12 true [IN-FRAME] 0 true [PX] 0 638 419 5 null null 6 642 423 10 null null 12 646 427 17 650 435 21 654 443 [OBJ] 30 \"white and yellow plastic supplement bottle\" 0 24 [VIS] 0 true 5 false 10 true [IN-FRAME] 0 true [PX] 0 646 416 5 null null 10 650 419 14 654 412 15 650 419 17 654 412 21 654 423 22 650 416 [OBJ] 31 \"yellow and green cardboard crayon box\" 0 24 [VIS] 0 true 1 false 10 true 15 false [IN-FRAME] 0 true 1 false 10 true 15 false [PX] 0 650 0 1 null null 10 662 1 15 null null [OBJ] 32 \"red and white cardboard ink cartridge box\" 0 24 [VIS] 0 true 5 false [IN-FRAME] 0 true 5 false [PX] 0 658 998 5 null null [OBJ] 33 \"yellow and blue plastic soccer cleat\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 677 423 4 685 427 11 689 435 16 693 443 21 701 447 [OBJ] 34 \"white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 681 416 5 685 423 10 693 427 15 697 435 20 701 443 [OBJ] 35 \"white and brown leather golf shoe\" 0 24 [VIS] 0 true 6 false [IN-FRAME] 0 true 6 false [PX] 0 728 0 2 744 1 3 755 1 4 763 1 5 775 1 6 null null [OBJ] 36 \"light blue and yellow high-top sneaker\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 736 435 5 732 443 10 740 447 14 736 455 18 744 458 22 740 466 [OBJ] 37 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 748 435 5 751 443 10 755 451 15 759 458 20 763 466 [OBJ] 38 \"teal and lime running shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 751 408 4 755 416 8 759 423 13 763 431 17 767 439 22 771 447 [OBJ] 39 \"light grey fabric chukka boot\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 767 423 4 771 431 8 775 439 13 779 447 18 783 455 23 787 462 [OBJ] 40 \"red plastic hair dryer\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 787 435 4 791 443 9 794 451 14 798 458 19 802 466 [OBJ] 41 \"white cardboard ink cartridge box\" 0 24 [VIS] 0 true 22 false [IN-FRAME] 0 true 22 false [PX] 0 791 412 2 794 419 5 794 431 8 794 443 10 798 435 11 798 447 14 798 458 17 798 470 20 798 482 22 null null [OBJ] 42 \"black plastic wireless speaker\" 0 24 [VIS] 0 true 1 false 3 true 15 false [IN-FRAME] 0 true 1 false 3 true 15 false [PX] 0 830 0 1 null null 3 833 1 5 841 5 8 849 9 11 857 13 14 869 13 15 null null [OBJ] 43 \"grey athletic cleat\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 974 427 3 974 439 6 974 451 10 974 462 15 974 474 19 974 486 23 974 498 [OBJ] 44 \"white and grey cardboard desktop hard drive box\" 0 24 [VIS] 0 true 1 false 3 true [IN-FRAME] 0 true 1 false 3 true [PX] 0 986 443 1 null null 3 986 451 5 986 462 9 986 474 10 982 482 11 986 474 12 982 482 13 986 474 14 982 482 15 986 474 16 982 482 17 986 474 18 982 482 19 986 474 20 982 482 21 986 474 22 982 482 23 978 490 [OBJ] 45 \"yellow and blue plastic soccer cleat\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 990 462 4 986 470 11 982 478 15 978 486 19 974 494 23 970 501 [OBJ] 46 \"teal and lime sneaker\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 994 439 1 994 451 2 994 439 4 994 455 5 994 443 8 994 455 9 990 470 10 990 458 12 990 470 13 986 478 14 986 466 16 986 478 17 982 486 18 982 474 20 982 486 21 978 494 22 978 482 23 978 494 [OBJ] 47 \"red plastic board game with sleeping figure\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 482 4 998 494 8 998 505 12 998 517 16 998 529 19 994 537 23 990 544 [OBJ] 48 \"red plastic hair dryer\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 501 3 998 513 6 998 525 9 998 537 12 998 548 15 998 560 18 998 572 21 998 583 23 994 591 [OBJ] 49 \"red and white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 490 3 998 501 6 998 513 10 998 525 14 998 537 17 998 548 21 998 560 [OBJ] 50 \"white and black athletic shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 568 1 998 556 2 998 544 4 998 533 6 998 521 7 994 541 8 994 529 9 994 517 10 994 505 12 990 521 13 990 509 14 990 498 15 986 513 16 986 501 17 986 490 18 982 505 19 982 494 20 982 482 21 978 494 22 978 482 23 974 494 [OBJ] 51 \"white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 583 3 998 595 6 998 607 8 998 619 10 998 630 12 998 642 14 998 654 16 998 666 18 998 677 20 998 689 22 998 701 23 994 708 [OBJ] 52 \"white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 607 3 998 619 5 998 630 7 998 642 9 998 654 11 998 666 13 998 677 15 998 689 17 998 701 19 998 712 21 998 724 23 998 736 [OBJ] 53 \"yellow hoodie dollhouse boy\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 611 1 994 619 3 990 630 5 986 638 7 982 650 9 978 658 11 974 666 13 970 677 15 966 685 17 962 693 19 958 701 21 955 708 23 951 716 [OBJ] 54 \"yellow and green cardboard fingerpaint set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 623 2 994 634 4 994 646 6 990 658 8 990 669 10 986 681 12 986 693 14 982 705 16 982 716 18 978 728 20 978 740 22 974 751 [OBJ] 55 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 650 3 994 666 6 994 677 8 990 689 10 990 701 12 986 712 14 986 724 16 982 736 18 982 748 20 978 759 22 974 771 23 970 779 [OBJ] 56 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true 5 false 6 true [IN-FRAME] 0 true [PX] 0 998 666 1 998 677 2 998 689 3 998 701 4 998 712 5 null null 6 994 732 7 994 744 9 990 755 11 986 771 13 982 787 15 978 802 17 974 818 19 970 833 21 966 849 23 962 865 [OBJ] 57 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true 5 false 6 true [IN-FRAME] 0 true [PX] 0 998 669 2 998 685 4 998 697 5 null null 6 994 712 8 994 728 10 990 744 12 990 755 14 986 771 16 982 787 18 978 802 20 974 818 22 970 833 [OBJ] 58 \"yellow hoodie dollhouse boy\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 720 3 994 744 5 994 732 6 994 744 7 994 755 8 994 767 10 990 791 11 990 779 12 990 791 14 986 814 16 986 826 17 982 845 19 978 865 21 974 884 23 970 904 [OBJ] 59 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true 5 false 6 true [IN-FRAME] 0 true [PX] 0 998 755 5 null null 6 994 775 8 994 787 11 990 806 13 990 818 15 986 833 17 982 853 19 982 865 21 978 880 23 974 896 [OBJ] 60 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true 5 false 6 true [IN-FRAME] 0 true [PX] 0 998 767 5 null null 6 994 794 8 994 806 10 990 822 12 990 833 14 986 849 16 986 861 18 982 876 20 978 892 22 974 908 23 970 923 [OBJ] 61 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true 5 false 6 true [IN-FRAME] 0 true [PX] 0 998 775 5 null null 6 994 806 8 994 818 10 994 830 12 990 849 14 990 861 16 986 880 18 982 900 20 978 919 21 974 939 22 970 955 [OBJ] 62 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true 5 false 6 true [IN-FRAME] 0 true [PX] 0 998 783 5 null null 6 994 818 8 994 830 10 990 849 12 990 861 14 986 884 16 986 896 18 982 919 20 978 943 22 974 966 [OBJ] 63 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true 5 false 6 true [IN-FRAME] 0 true [PX] 0 998 791 5 null null 6 994 833 8 994 845 10 990 869 12 990 880 14 986 908 16 986 919 18 982 943 20 978 970 22 974 990 [OBJ] 64 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true 5 false 6 true [IN-FRAME] 0 true [PX] 0 998 806 5 null null 6 994 845 8 994 857 10 994 869 12 990 892 14 990 904 16 990 916 18 986 939 20 982 962 22 978 982 23 974 994 [OBJ] 65 \"white and blue cardboard stool softener box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 814 2 998 826 4 998 837 6 998 849 8 998 861 10 998 873 12 998 884 14 998 896 16 998 908 18 998 919 20 994 939 22 994 951 23 990 966 [OBJ] 66 \"white and blue track spike\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 833 3 998 845 5 998 857 7 998 869 9 998 880 11 998 892 13 998 904 15 998 916 17 998 927 19 998 939 21 994 962 23 990 978 [OBJ] 67 \"white and black athletic shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 845 2 998 857 4 998 869 6 998 880 8 998 892 10 998 904 12 998 916 14 998 927 16 998 939 18 998 951 20 998 962 22 998 974 23 994 990 [OBJ] 68 \"white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 861 2 998 873 4 998 884 6 998 896 8 998 908 10 998 919 12 998 931 14 998 943 16 998 955 18 994 974 20 990 990 21 986 998 22 982 990 23 978 998 [OBJ] 69 \"white and blue cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 876 3 998 888 5 998 900 7 998 912 9 998 923 11 998 935 13 998 947 15 998 958 17 998 970 19 994 986 21 990 994 22 986 998 [OBJ] 70 \"yellow cardboard curl cream box\" 0 24 [VIS] 0 true 4 false [IN-FRAME] 0 true 4 false [PX] 0 998 900 4 null null [OBJ] 71 \"white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 912 2 998 923 4 998 935 6 998 947 8 998 958 10 998 970 12 994 986 14 990 994 15 986 986 17 982 994 18 978 990 19 974 994 20 966 990 21 958 990 22 951 990 23 943 994 [OBJ] 72 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true 4 false [IN-FRAME] 0 true 4 false [PX] 0 998 923 4 null null [OBJ] 73 \"white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 998 947 2 998 958 4 994 974 6 990 986 8 986 994 9 982 986 11 978 994 12 974 998 13 970 990 15 966 998 16 962 990 18 958 998 19 955 990 21 951 998 22 947 990 24 943 998 [OBJ] 74 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true 10 false [IN-FRAME] 0 true 10 false [PX] 0 998 986 1 994 994 3 990 986 5 986 994 6 982 986 7 982 998 9 978 990 10 null null [OBJ] 75 \"white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 994 408 4 994 419 9 994 431 14 994 443 19 994 455 22 990 462 [OBJ] 76 \"white and blue cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 990 431 4 990 443 9 990 455 14 990 466 18 986 474 23 986 486 [OBJ] 77 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 990 466 3 986 474 8 986 486 12 986 498 15 982 505 19 978 517 23 978 529 [OBJ] 78 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 986 419 5 982 431 9 982 443 12 978 451 17 974 458 22 970 470 [OBJ] 79 \"white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 982 470 3 982 482 7 982 494 10 978 501 14 978 513 18 974 521 22 974 533 [OBJ] 80 \"white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 978 439 5 978 451 10 974 458 14 970 466 18 966 474 22 962 482 [OBJ] 81 \"white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 974 474 3 970 482 8 966 494 12 962 501 16 958 509 20 955 517 23 951 525 [OBJ] 82 \"white and blue cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 966 435 4 962 443 9 958 451 14 955 458 18 951 466 23 947 474 [OBJ] 83 \"white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 958 451 4 951 455 8 943 458 12 935 462 16 927 466 20 919 470 23 912 474 [OBJ] 84 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 943 443 3 939 451 7 931 455 10 927 462 14 919 466 18 912 470 22 908 478 [OBJ] 85 \"white and blue cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 939 439 3 935 447 6 931 455 10 923 458 14 919 466 18 916 474 22 912 482 [OBJ] 86 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 927 439 3 919 443 6 912 447 10 904 451 13 900 458 17 892 462 20 884 466 23 876 470 [OBJ] 87 \"white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 919 443 4 912 447 8 904 451 11 896 455 15 888 458 19 880 462 22 873 466 [OBJ] 88 \"dark grey and light grey plastic monster action figure\" 0 24 [VIS] 0 true 10 false [IN-FRAME] 0 true 10 false [PX] 0 912 412 3 904 416 5 900 423 8 892 427 10 null null [OBJ] 89 \"white and black athletic shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 904 447 4 896 451 7 888 455 11 880 458 14 873 462 17 865 466 20 857 470 23 849 474 [OBJ] 90 \"white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 900 439 4 892 443 7 884 447 10 876 451 13 869 455 16 861 458 19 853 462 22 845 466 [OBJ] 91 \"dark blue leather boat shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 888 455 4 880 458 7 873 462 10 865 466 13 857 470 16 849 474 19 841 478 22 833 482 [OBJ] 92 \"white and blue cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 876 451 4 869 455 7 861 458 10 853 462 13 845 466 16 837 470 19 830 474 22 822 478 [OBJ] 93 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 873 458 4 865 462 8 857 466 11 849 470 14 841 474 17 833 478 20 826 482 23 818 486 [OBJ] 94 \"dark grey and light grey plastic monster action figure\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 857 455 4 849 458 7 841 462 10 833 466 13 826 470 16 818 474 19 810 478 22 802 482 [OBJ] 95 \"red and yellow wooden toy airplane with pilot\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 490 298 1 494 306 4 501 310 6 509 314 8 517 318 10 525 322 12 533 326 14 541 330 16 548 333 18 556 337 20 564 341 22 572 345 23 580 349 [OBJ] 96 \"teal and lime running shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 494 271 1 498 279 4 509 283 6 517 287 8 525 291 10 533 294 12 541 298 14 548 302 16 556 306 18 564 310 20 572 314 22 580 318 23 587 322 [OBJ] 97 \"red leather boot\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 541 611 3 548 607 4 541 611 5 548 607 10 552 599 13 560 595 17 564 587 20 572 583 23 564 580 [OBJ] 98 \"blue and yellow basketball shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 544 638 1 541 630 2 544 638 4 541 630 5 544 638 6 541 630 7 544 638 8 541 630 9 544 638 10 541 630 11 544 638 12 541 630 13 544 638 14 541 630 15 544 638 16 541 630 17 544 638 18 541 630 19 544 638 20 541 630 21 544 638 22 541 630 23 544 638 [OBJ] 99 \"blue and yellow basketball shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 548 650 1 544 642 3 552 650 4 548 642 7 544 634 8 552 642 9 548 634 12 552 642 13 548 634 16 544 626 19 548 634 20 544 626 23 541 619 [OBJ] 100 \"blue and yellow basketball shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 552 666 4 556 658 9 560 650 14 564 642 18 568 634 22 572 626 [OBJ] 101 \"blue and yellow basketball shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 560 673 4 560 662 9 564 654 13 568 646 17 572 638 21 576 630 [OBJ] 102 \"red wooden toy fire truck\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 607 685 4 607 673 8 611 666 12 615 658 16 615 646 20 619 638 23 623 630 [OBJ] 103 \"red wooden toy boat with orange figure\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 615 681 3 619 673 7 623 666 11 626 658 15 630 650 19 634 642 23 638 634 [OBJ] 104 \"blue and yellow basketball shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 626 689 3 630 681 7 634 673 10 638 666 14 642 658 18 646 650 22 650 642 [OBJ] 105 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 634 685 2 638 677 5 638 666 7 634 658 11 634 646 15 634 634 19 634 623 23 634 611 [OBJ] 106 \"blue and yellow basketball shoe\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 642 689 3 646 681 7 646 669 11 650 662 15 654 654 19 654 642 23 658 634 [OBJ] 107 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 646 693 3 646 681 7 646 669 10 646 658 13 646 646 16 646 634 19 646 623 22 646 611 [OBJ] 108 \"white cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 658 693 3 658 681 7 658 669 10 658 658 14 658 646 17 658 634 20 658 623 23 658 611 [OBJ] 109 \"white and blue cardboard ink cartridge box\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 662 697 3 662 685 6 662 673 9 662 662 12 662 650 15 662 638 18 662 626 21 662 615 23 662 603 [OBJ] 110 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 666 697 2 666 685 6 666 669 10 666 658 14 666 646 17 666 634 20 666 623 23 666 611 [OBJ] 111 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 677 697 4 677 681 8 677 669 12 677 658 16 677 646 19 677 634 22 677 623 [OBJ] 112 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 685 697 4 685 685 8 685 673 12 685 662 16 685 650 19 685 638 22 685 626 [OBJ] 113 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 693 701 3 693 689 7 693 677 10 693 666 13 693 654 16 693 642 19 693 630 22 693 619 [OBJ] 114 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 701 697 3 701 685 6 701 673 9 701 662 12 701 650 15 701 638 18 701 626 21 701 615 23 701 603 [OBJ] 115 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 705 701 3 705 689 7 705 677 10 705 666 13 705 654 16 705 642 19 705 630 22 705 619 [OBJ] 116 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 716 701 4 716 689 7 716 677 10 716 666 13 716 654 16 716 642 19 716 630 22 716 619 [OBJ] 117 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 724 697 3 724 685 6 724 673 9 724 662 12 724 650 15 724 638 18 724 626 21 724 615 23 724 603 [OBJ] 118 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 728 701 3 728 689 6 728 677 9 728 666 12 728 654 15 728 642 18 728 630 21 728 619 23 728 607 [OBJ] 119 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 740 701 3 740 689 6 740 677 9 740 666 12 740 654 15 740 642 18 740 630 21 740 619 23 740 607 [OBJ] 120 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 744 708 4 744 697 7 744 685 10 744 673 13 744 662 16 744 650 19 744 638 22 744 626 [OBJ] 121 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 748 712 3 748 697 6 748 685 9 748 673 12 748 662 15 748 650 18 748 638 21 748 626 [OBJ] 122 \"yellow and blue plastic Spongebob toy set\" 0 24 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 751 720 4 751 708 7 751 697 10 751 685 13 751 673 16 751 66",
"label": "[SCENE-START] [OBJS-START] [OBJ] 0 \"yellow cruiser\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 154 681 2 161 680 3 172 680 5 179 679 6 185 678 7 192 678 8 198 678 9 205 677 10 212 677 11 218 675 12 225 676 13 231 675 14 239 675 15 246 674 16 252 674 17 260 673 18 266 673 19 273 673 20 280 672 21 287 672 22 296 671 23 303 671 24 310 671 25 318 670 26 325 670 27 332 668 28 340 669 29 347 667 30 355 667 31 363 667 32 371 666 33 379 666 34 387 666 35 394 665 36 400 664 37 405 663 38 409 661 39 416 660 40 421 660 41 428 659 42 434 659 43 440 658 44 447 659 45 451 658 46 455 658 47 462 656 48 467 656 49 462 685 50 470 683 51 481 656 52 485 656 53 489 660 54 494 663 55 498 667 56 502 670 57 506 673 58 508 672 59 507 670 60 509 674 61 510 677 62 516 684 63 519 688 64 521 685 65 526 686 66 526 684 67 509 673 68 514 674 69 527 681 70 526 680 72 529 681 74 531 681 75 534 682 78 548 686 79 541 683 80 538 681 81 540 682 85 543 682 88 545 682 90 548 683 93 550 683 97 553 683 102 555 683 105 557 684 109 559 684 115 562 684 118 565 684 [OBJ] 1 \"gray wagon\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 208 550 1 217 551 2 213 554 3 221 555 4 217 557 5 226 559 6 223 561 7 233 564 8 229 566 9 227 568 10 236 570 11 233 572 12 244 574 13 243 576 14 240 578 15 251 580 16 250 582 17 248 584 18 248 588 19 259 589 20 258 592 22 265 597 23 270 598 24 272 597 26 280 597 27 287 599 28 276 595 29 281 596 30 266 603 31 269 606 32 273 610 33 277 614 34 283 616 35 286 620 36 289 624 37 293 627 38 302 642 39 306 642 40 310 643 41 314 646 42 318 649 43 320 651 44 324 654 45 326 656 46 333 658 47 332 661 48 334 664 49 337 666 50 340 669 51 347 671 52 348 673 53 348 676 54 351 679 55 353 681 56 356 684 57 358 686 58 362 690 59 365 692 60 368 695 61 371 698 62 373 700 63 376 702 64 380 707 65 382 709 66 384 710 67 388 717 68 391 718 69 393 720 70 397 725 71 399 727 72 401 728 73 404 730 74 408 735 75 410 738 76 412 739 77 416 744 78 419 746 79 423 751 80 425 752 81 428 755 82 430 756 83 434 761 84 437 764 85 441 769 86 443 770 87 447 775 88 450 778 89 452 779 90 456 784 91 458 785 92 462 788 93 466 793 94 468 794 95 472 799 96 475 801 97 479 806 98 481 807 99 485 813 100 488 815 101 492 820 102 494 821 103 499 827 104 502 830 105 505 832 106 509 838 107 512 840 108 516 842 109 519 847 110 523 851 111 526 853 112 530 858 113 534 863 114 537 865 115 541 870 116 545 874 117 548 867 118 551 869 119 555 874 [OBJ] 2 \"green school\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 473 564 37 472 570 38 471 573 39 470 575 41 472 570 42 473 566 43 475 564 44 474 561 45 473 560 46 477 559 47 476 560 49 474 564 51 473 567 52 471 570 54 469 575 55 468 577 57 469 575 92 469 572 [OBJ] 3 \"cyan airliner\" 0 120 [VIS] 0 true 97 false [IN-FRAME] 0 true 97 false [PX] 0 483 295 1 486 296 4 491 297 6 494 297 7 499 300 8 497 298 10 523 306 11 501 299 12 505 300 14 516 304 15 510 301 17 517 304 18 516 302 19 518 302 20 523 305 21 530 307 22 526 304 23 531 307 24 530 305 25 536 308 27 548 311 29 544 308 30 550 311 31 579 319 32 566 316 33 563 315 35 567 316 36 580 319 39 610 326 40 598 323 43 629 330 44 615 327 46 651 335 47 633 331 48 655 338 49 668 340 50 647 334 51 673 341 52 679 342 53 665 339 54 691 345 55 682 343 56 706 349 57 714 351 58 720 352 59 728 354 60 735 355 61 699 349 62 706 350 63 714 352 64 723 355 65 732 357 66 742 360 67 751 363 68 762 366 69 771 368 70 783 371 71 794 375 72 806 378 73 819 382 74 831 385 75 844 389 76 859 394 77 875 398 78 888 401 79 907 407 80 925 413 81 943 417 82 956 417 83 962 410 84 908 361 85 924 364 86 941 367 87 958 369 88 969 372 89 978 376 90 987 380 91 937 465 92 948 471 93 957 477 94 977 485 95 995 494 96 993 374 97 null null [OBJ] 4 \"red minivan\" 0 120 [VIS] 0 true [IN-FRAME] 0 true [PX] 0 501 665 36 506 664 37 508 665 38 512 665 39 516 664 40 519 664 41 525 663 42 528 663 43 533 661 44 537 660 45 541 659 47 543 658 48 545 658 49 548 651 50 547 671 51 550 671 52 553 674 53 558 679 54 563 678 55 567 690 56 576 659 57 578 657 58 587 689 59 593 689 60 598 682 61 603 682 62 605 661 63 609 667 64 616 673 65 622 674 66 632 678 67 640 679 68 649 682 69 658 683 70 668 686 71 677 686 72 687 690 73 696 691 74 705 692 75 715 694 76 723 694 77 733 696 78 732 689 79 724 681 80 715 676 81 730 679 82 742 681 83 726 675 84 735 676 85 748 678 86 761 680 87 774 682 88 737 673 89 744 674 90 748 674 92 763 676 93 751 674 94 758 675 95 766 676 96 773 677 97 777 677 98 784 678 99 792 679 100 799 680 101 805 680 102 791 679 103 794 680 104 828 683 105 840 684 106 815 683 107 822 684 108 829 685 109 836 686 110 844 688 111 851 689 112 858 690 113 855 690 114 871 691 115 880 692 116 877 693 117 908 693 118 902 695 119 923 695 [OBJS-END] [INTERACTIONS-START] [INTERACT] 8 \"contact\" 0 64 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 11 \"contact\" 0 119 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 12 \"contact\" 0 119 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 13 \"contact\" 0 119 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 2 \"collision\" 36 36 [IN] 0 4 [OUT] 0 4 [INTERACT] 1 \"collision\" 41 41 [IN] 0 2 [OUT] 0 2 [INTERACT] 0 \"collision\" 42 42 [IN] 0 1 [OUT] 0 1 [INTERACT] 3 \"collision\" 42 42 [IN] 0 4 [OUT] 0 4 [INTERACT] 4 \"collision\" 47 47 [IN] 0 4 [OUT] 0 4 [INTERACT] 5 \"contact\" 48 63 [IN] 0 4 [OUT] 0 4 [INTERACT] 6 \"collision\" 69 69 [IN] 0 4 [OUT] 0 4 [INTERACT] 9 \"collision\" 69 69 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 7 \"contact\" 70 83 [IN] 0 4 [OUT] 0 4 [INTERACT] 10 \"contact\" 70 119 [IN] 0 65535 [OUT] 0 65535 [INTERACTIONS-END] [SCENE-END]\n",
"parse_debug": {
"pred_parse_valid": false,
"pred_parse_error": "Could not find [SCENE-END] after [SCENE-START].",
"pred_parse_error_type": "ValueError",
"guided_grammar_sha256": "dac80e533cdc467e6ed7e750f131c895bdb25be06b660e6ed92a7366e99f178e",
"guided_grammar_path": "strive_datasets/prep/kubric/scene_repr/profiles/grammars/selector_sentinel_no_3d.lark",
"debug_dir": "/gscratch/krishna/suryadv/strive_dynsuperclevr/runtime/36996080_inference_full/debug/test_full_shard_000/parse_failures/sample_000011",
"guided_grammar_debug_path": "/gscratch/krishna/suryadv/strive_dynsuperclevr/runtime/36996080_inference_full/debug/test_full_shard_000/parse_failures/sample_000011/grammar.ebnf.gz"
}
}Parsed prediction
{
"error": "ValueError: Could not find [SCENE-END] after [SCENE-START]."
}Parsed ground truth
{
"objects": [
{
"id": 0,
"type": "yellow cruiser",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 154,
"y": 681
},
{
"t": 2,
"x": 161,
"y": 680
},
{
"t": 3,
"x": 172,
"y": 680
},
{
"t": 5,
"x": 179,
"y": 679
},
{
"t": 6,
"x": 185,
"y": 678
},
{
"t": 7,
"x": 192,
"y": 678
},
{
"t": 8,
"x": 198,
"y": 678
},
{
"t": 9,
"x": 205,
"y": 677
},
{
"t": 10,
"x": 212,
"y": 677
},
{
"t": 11,
"x": 218,
"y": 675
},
{
"t": 12,
"x": 225,
"y": 676
},
{
"t": 13,
"x": 231,
"y": 675
},
{
"t": 14,
"x": 239,
"y": 675
},
{
"t": 15,
"x": 246,
"y": 674
},
{
"t": 16,
"x": 252,
"y": 674
},
{
"t": 17,
"x": 260,
"y": 673
},
{
"t": 18,
"x": 266,
"y": 673
},
{
"t": 19,
"x": 273,
"y": 673
},
{
"t": 20,
"x": 280,
"y": 672
},
{
"t": 21,
"x": 287,
"y": 672
},
{
"t": 22,
"x": 296,
"y": 671
},
{
"t": 23,
"x": 303,
"y": 671
},
{
"t": 24,
"x": 310,
"y": 671
},
{
"t": 25,
"x": 318,
"y": 670
},
{
"t": 26,
"x": 325,
"y": 670
},
{
"t": 27,
"x": 332,
"y": 668
},
{
"t": 28,
"x": 340,
"y": 669
},
{
"t": 29,
"x": 347,
"y": 667
},
{
"t": 30,
"x": 355,
"y": 667
},
{
"t": 31,
"x": 363,
"y": 667
},
{
"t": 32,
"x": 371,
"y": 666
},
{
"t": 33,
"x": 379,
"y": 666
},
{
"t": 34,
"x": 387,
"y": 666
},
{
"t": 35,
"x": 394,
"y": 665
},
{
"t": 36,
"x": 400,
"y": 664
},
{
"t": 37,
"x": 405,
"y": 663
},
{
"t": 38,
"x": 409,
"y": 661
},
{
"t": 39,
"x": 416,
"y": 660
},
{
"t": 40,
"x": 421,
"y": 660
},
{
"t": 41,
"x": 428,
"y": 659
},
{
"t": 42,
"x": 434,
"y": 659
},
{
"t": 43,
"x": 440,
"y": 658
},
{
"t": 44,
"x": 447,
"y": 659
},
{
"t": 45,
"x": 451,
"y": 658
},
{
"t": 46,
"x": 455,
"y": 658
},
{
"t": 47,
"x": 462,
"y": 656
},
{
"t": 48,
"x": 467,
"y": 656
},
{
"t": 49,
"x": 462,
"y": 685
},
{
"t": 50,
"x": 470,
"y": 683
},
{
"t": 51,
"x": 481,
"y": 656
},
{
"t": 52,
"x": 485,
"y": 656
},
{
"t": 53,
"x": 489,
"y": 660
},
{
"t": 54,
"x": 494,
"y": 663
},
{
"t": 55,
"x": 498,
"y": 667
},
{
"t": 56,
"x": 502,
"y": 670
},
{
"t": 57,
"x": 506,
"y": 673
},
{
"t": 58,
"x": 508,
"y": 672
},
{
"t": 59,
"x": 507,
"y": 670
},
{
"t": 60,
"x": 509,
"y": 674
},
{
"t": 61,
"x": 510,
"y": 677
},
{
"t": 62,
"x": 516,
"y": 684
},
{
"t": 63,
"x": 519,
"y": 688
},
{
"t": 64,
"x": 521,
"y": 685
},
{
"t": 65,
"x": 526,
"y": 686
},
{
"t": 66,
"x": 526,
"y": 684
},
{
"t": 67,
"x": 509,
"y": 673
},
{
"t": 68,
"x": 514,
"y": 674
},
{
"t": 69,
"x": 527,
"y": 681
},
{
"t": 70,
"x": 526,
"y": 680
},
{
"t": 72,
"x": 529,
"y": 681
},
{
"t": 74,
"x": 531,
"y": 681
},
{
"t": 75,
"x": 534,
"y": 682
},
{
"t": 78,
"x": 548,
"y": 686
},
{
"t": 79,
"x": 541,
"y": 683
},
{
"t": 80,
"x": 538,
"y": 681
},
{
"t": 81,
"x": 540,
"y": 682
},
{
"t": 85,
"x": 543,
"y": 682
},
{
"t": 88,
"x": 545,
"y": 682
},
{
"t": 90,
"x": 548,
"y": 683
},
{
"t": 93,
"x": 550,
"y": 683
},
{
"t": 97,
"x": 553,
"y": 683
},
{
"t": 102,
"x": 555,
"y": 683
},
{
"t": 105,
"x": 557,
"y": 684
},
{
"t": 109,
"x": 559,
"y": 684
},
{
"t": 115,
"x": 562,
"y": 684
},
{
"t": 118,
"x": 565,
"y": 684
}
],
"birth": 0,
"death": 120
},
{
"id": 1,
"type": "gray wagon",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 208,
"y": 550
},
{
"t": 1,
"x": 217,
"y": 551
},
{
"t": 2,
"x": 213,
"y": 554
},
{
"t": 3,
"x": 221,
"y": 555
},
{
"t": 4,
"x": 217,
"y": 557
},
{
"t": 5,
"x": 226,
"y": 559
},
{
"t": 6,
"x": 223,
"y": 561
},
{
"t": 7,
"x": 233,
"y": 564
},
{
"t": 8,
"x": 229,
"y": 566
},
{
"t": 9,
"x": 227,
"y": 568
},
{
"t": 10,
"x": 236,
"y": 570
},
{
"t": 11,
"x": 233,
"y": 572
},
{
"t": 12,
"x": 244,
"y": 574
},
{
"t": 13,
"x": 243,
"y": 576
},
{
"t": 14,
"x": 240,
"y": 578
},
{
"t": 15,
"x": 251,
"y": 580
},
{
"t": 16,
"x": 250,
"y": 582
},
{
"t": 17,
"x": 248,
"y": 584
},
{
"t": 18,
"x": 248,
"y": 588
},
{
"t": 19,
"x": 259,
"y": 589
},
{
"t": 20,
"x": 258,
"y": 592
},
{
"t": 22,
"x": 265,
"y": 597
},
{
"t": 23,
"x": 270,
"y": 598
},
{
"t": 24,
"x": 272,
"y": 597
},
{
"t": 26,
"x": 280,
"y": 597
},
{
"t": 27,
"x": 287,
"y": 599
},
{
"t": 28,
"x": 276,
"y": 595
},
{
"t": 29,
"x": 281,
"y": 596
},
{
"t": 30,
"x": 266,
"y": 603
},
{
"t": 31,
"x": 269,
"y": 606
},
{
"t": 32,
"x": 273,
"y": 610
},
{
"t": 33,
"x": 277,
"y": 614
},
{
"t": 34,
"x": 283,
"y": 616
},
{
"t": 35,
"x": 286,
"y": 620
},
{
"t": 36,
"x": 289,
"y": 624
},
{
"t": 37,
"x": 293,
"y": 627
},
{
"t": 38,
"x": 302,
"y": 642
},
{
"t": 39,
"x": 306,
"y": 642
},
{
"t": 40,
"x": 310,
"y": 643
},
{
"t": 41,
"x": 314,
"y": 646
},
{
"t": 42,
"x": 318,
"y": 649
},
{
"t": 43,
"x": 320,
"y": 651
},
{
"t": 44,
"x": 324,
"y": 654
},
{
"t": 45,
"x": 326,
"y": 656
},
{
"t": 46,
"x": 333,
"y": 658
},
{
"t": 47,
"x": 332,
"y": 661
},
{
"t": 48,
"x": 334,
"y": 664
},
{
"t": 49,
"x": 337,
"y": 666
},
{
"t": 50,
"x": 340,
"y": 669
},
{
"t": 51,
"x": 347,
"y": 671
},
{
"t": 52,
"x": 348,
"y": 673
},
{
"t": 53,
"x": 348,
"y": 676
},
{
"t": 54,
"x": 351,
"y": 679
},
{
"t": 55,
"x": 353,
"y": 681
},
{
"t": 56,
"x": 356,
"y": 684
},
{
"t": 57,
"x": 358,
"y": 686
},
{
"t": 58,
"x": 362,
"y": 690
},
{
"t": 59,
"x": 365,
"y": 692
},
{
"t": 60,
"x": 368,
"y": 695
},
{
"t": 61,
"x": 371,
"y": 698
},
{
"t": 62,
"x": 373,
"y": 700
},
{
"t": 63,
"x": 376,
"y": 702
},
{
"t": 64,
"x": 380,
"y": 707
},
{
"t": 65,
"x": 382,
"y": 709
},
{
"t": 66,
"x": 384,
"y": 710
},
{
"t": 67,
"x": 388,
"y": 717
},
{
"t": 68,
"x": 391,
"y": 718
},
{
"t": 69,
"x": 393,
"y": 720
},
{
"t": 70,
"x": 397,
"y": 725
},
{
"t": 71,
"x": 399,
"y": 727
},
{
"t": 72,
"x": 401,
"y": 728
},
{
"t": 73,
"x": 404,
"y": 730
},
{
"t": 74,
"x": 408,
"y": 735
},
{
"t": 75,
"x": 410,
"y": 738
},
{
"t": 76,
"x": 412,
"y": 739
},
{
"t": 77,
"x": 416,
"y": 744
},
{
"t": 78,
"x": 419,
"y": 746
},
{
"t": 79,
"x": 423,
"y": 751
},
{
"t": 80,
"x": 425,
"y": 752
},
{
"t": 81,
"x": 428,
"y": 755
},
{
"t": 82,
"x": 430,
"y": 756
},
{
"t": 83,
"x": 434,
"y": 761
},
{
"t": 84,
"x": 437,
"y": 764
},
{
"t": 85,
"x": 441,
"y": 769
},
{
"t": 86,
"x": 443,
"y": 770
},
{
"t": 87,
"x": 447,
"y": 775
},
{
"t": 88,
"x": 450,
"y": 778
},
{
"t": 89,
"x": 452,
"y": 779
},
{
"t": 90,
"x": 456,
"y": 784
},
{
"t": 91,
"x": 458,
"y": 785
},
{
"t": 92,
"x": 462,
"y": 788
},
{
"t": 93,
"x": 466,
"y": 793
},
{
"t": 94,
"x": 468,
"y": 794
},
{
"t": 95,
"x": 472,
"y": 799
},
{
"t": 96,
"x": 475,
"y": 801
},
{
"t": 97,
"x": 479,
"y": 806
},
{
"t": 98,
"x": 481,
"y": 807
},
{
"t": 99,
"x": 485,
"y": 813
},
{
"t": 100,
"x": 488,
"y": 815
},
{
"t": 101,
"x": 492,
"y": 820
},
{
"t": 102,
"x": 494,
"y": 821
},
{
"t": 103,
"x": 499,
"y": 827
},
{
"t": 104,
"x": 502,
"y": 830
},
{
"t": 105,
"x": 505,
"y": 832
},
{
"t": 106,
"x": 509,
"y": 838
},
{
"t": 107,
"x": 512,
"y": 840
},
{
"t": 108,
"x": 516,
"y": 842
},
{
"t": 109,
"x": 519,
"y": 847
},
{
"t": 110,
"x": 523,
"y": 851
},
{
"t": 111,
"x": 526,
"y": 853
},
{
"t": 112,
"x": 530,
"y": 858
},
{
"t": 113,
"x": 534,
"y": 863
},
{
"t": 114,
"x": 537,
"y": 865
},
{
"t": 115,
"x": 541,
"y": 870
},
{
"t": 116,
"x": 545,
"y": 874
},
{
"t": 117,
"x": 548,
"y": 867
},
{
"t": 118,
"x": 551,
"y": 869
},
{
"t": 119,
"x": 555,
"y": 874
}
],
"birth": 0,
"death": 120
},
{
"id": 2,
"type": "green school",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 473,
"y": 564
},
{
"t": 37,
"x": 472,
"y": 570
},
{
"t": 38,
"x": 471,
"y": 573
},
{
"t": 39,
"x": 470,
"y": 575
},
{
"t": 41,
"x": 472,
"y": 570
},
{
"t": 42,
"x": 473,
"y": 566
},
{
"t": 43,
"x": 475,
"y": 564
},
{
"t": 44,
"x": 474,
"y": 561
},
{
"t": 45,
"x": 473,
"y": 560
},
{
"t": 46,
"x": 477,
"y": 559
},
{
"t": 47,
"x": 476,
"y": 560
},
{
"t": 49,
"x": 474,
"y": 564
},
{
"t": 51,
"x": 473,
"y": 567
},
{
"t": 52,
"x": 471,
"y": 570
},
{
"t": 54,
"x": 469,
"y": 575
},
{
"t": 55,
"x": 468,
"y": 577
},
{
"t": 57,
"x": 469,
"y": 575
},
{
"t": 92,
"x": 469,
"y": 572
}
],
"birth": 0,
"death": 120
},
{
"id": 3,
"type": "cyan airliner",
"vis": [
{
"t": 0,
"v": true
},
{
"t": 97,
"v": false
}
],
"is_in_frame": [
{
"t": 0,
"v": true
},
{
"t": 97,
"v": false
}
],
"image_positions": [
{
"t": 0,
"x": 483,
"y": 295
},
{
"t": 1,
"x": 486,
"y": 296
},
{
"t": 4,
"x": 491,
"y": 297
},
{
"t": 6,
"x": 494,
"y": 297
},
{
"t": 7,
"x": 499,
"y": 300
},
{
"t": 8,
"x": 497,
"y": 298
},
{
"t": 10,
"x": 523,
"y": 306
},
{
"t": 11,
"x": 501,
"y": 299
},
{
"t": 12,
"x": 505,
"y": 300
},
{
"t": 14,
"x": 516,
"y": 304
},
{
"t": 15,
"x": 510,
"y": 301
},
{
"t": 17,
"x": 517,
"y": 304
},
{
"t": 18,
"x": 516,
"y": 302
},
{
"t": 19,
"x": 518,
"y": 302
},
{
"t": 20,
"x": 523,
"y": 305
},
{
"t": 21,
"x": 530,
"y": 307
},
{
"t": 22,
"x": 526,
"y": 304
},
{
"t": 23,
"x": 531,
"y": 307
},
{
"t": 24,
"x": 530,
"y": 305
},
{
"t": 25,
"x": 536,
"y": 308
},
{
"t": 27,
"x": 548,
"y": 311
},
{
"t": 29,
"x": 544,
"y": 308
},
{
"t": 30,
"x": 550,
"y": 311
},
{
"t": 31,
"x": 579,
"y": 319
},
{
"t": 32,
"x": 566,
"y": 316
},
{
"t": 33,
"x": 563,
"y": 315
},
{
"t": 35,
"x": 567,
"y": 316
},
{
"t": 36,
"x": 580,
"y": 319
},
{
"t": 39,
"x": 610,
"y": 326
},
{
"t": 40,
"x": 598,
"y": 323
},
{
"t": 43,
"x": 629,
"y": 330
},
{
"t": 44,
"x": 615,
"y": 327
},
{
"t": 46,
"x": 651,
"y": 335
},
{
"t": 47,
"x": 633,
"y": 331
},
{
"t": 48,
"x": 655,
"y": 338
},
{
"t": 49,
"x": 668,
"y": 340
},
{
"t": 50,
"x": 647,
"y": 334
},
{
"t": 51,
"x": 673,
"y": 341
},
{
"t": 52,
"x": 679,
"y": 342
},
{
"t": 53,
"x": 665,
"y": 339
},
{
"t": 54,
"x": 691,
"y": 345
},
{
"t": 55,
"x": 682,
"y": 343
},
{
"t": 56,
"x": 706,
"y": 349
},
{
"t": 57,
"x": 714,
"y": 351
},
{
"t": 58,
"x": 720,
"y": 352
},
{
"t": 59,
"x": 728,
"y": 354
},
{
"t": 60,
"x": 735,
"y": 355
},
{
"t": 61,
"x": 699,
"y": 349
},
{
"t": 62,
"x": 706,
"y": 350
},
{
"t": 63,
"x": 714,
"y": 352
},
{
"t": 64,
"x": 723,
"y": 355
},
{
"t": 65,
"x": 732,
"y": 357
},
{
"t": 66,
"x": 742,
"y": 360
},
{
"t": 67,
"x": 751,
"y": 363
},
{
"t": 68,
"x": 762,
"y": 366
},
{
"t": 69,
"x": 771,
"y": 368
},
{
"t": 70,
"x": 783,
"y": 371
},
{
"t": 71,
"x": 794,
"y": 375
},
{
"t": 72,
"x": 806,
"y": 378
},
{
"t": 73,
"x": 819,
"y": 382
},
{
"t": 74,
"x": 831,
"y": 385
},
{
"t": 75,
"x": 844,
"y": 389
},
{
"t": 76,
"x": 859,
"y": 394
},
{
"t": 77,
"x": 875,
"y": 398
},
{
"t": 78,
"x": 888,
"y": 401
},
{
"t": 79,
"x": 907,
"y": 407
},
{
"t": 80,
"x": 925,
"y": 413
},
{
"t": 81,
"x": 943,
"y": 417
},
{
"t": 82,
"x": 956,
"y": 417
},
{
"t": 83,
"x": 962,
"y": 410
},
{
"t": 84,
"x": 908,
"y": 361
},
{
"t": 85,
"x": 924,
"y": 364
},
{
"t": 86,
"x": 941,
"y": 367
},
{
"t": 87,
"x": 958,
"y": 369
},
{
"t": 88,
"x": 969,
"y": 372
},
{
"t": 89,
"x": 978,
"y": 376
},
{
"t": 90,
"x": 987,
"y": 380
},
{
"t": 91,
"x": 937,
"y": 465
},
{
"t": 92,
"x": 948,
"y": 471
},
{
"t": 93,
"x": 957,
"y": 477
},
{
"t": 94,
"x": 977,
"y": 485
},
{
"t": 95,
"x": 995,
"y": 494
},
{
"t": 96,
"x": 993,
"y": 374
},
{
"t": 97,
"x": null,
"y": null
}
],
"birth": 0,
"death": 120
},
{
"id": 4,
"type": "red minivan",
"vis": [
{
"t": 0,
"v": true
}
],
"is_in_frame": [
{
"t": 0,
"v": true
}
],
"image_positions": [
{
"t": 0,
"x": 501,
"y": 665
},
{
"t": 36,
"x": 506,
"y": 664
},
{
"t": 37,
"x": 508,
"y": 665
},
{
"t": 38,
"x": 512,
"y": 665
},
{
"t": 39,
"x": 516,
"y": 664
},
{
"t": 40,
"x": 519,
"y": 664
},
{
"t": 41,
"x": 525,
"y": 663
},
{
"t": 42,
"x": 528,
"y": 663
},
{
"t": 43,
"x": 533,
"y": 661
},
{
"t": 44,
"x": 537,
"y": 660
},
{
"t": 45,
"x": 541,
"y": 659
},
{
"t": 47,
"x": 543,
"y": 658
},
{
"t": 48,
"x": 545,
"y": 658
},
{
"t": 49,
"x": 548,
"y": 651
},
{
"t": 50,
"x": 547,
"y": 671
},
{
"t": 51,
"x": 550,
"y": 671
},
{
"t": 52,
"x": 553,
"y": 674
},
{
"t": 53,
"x": 558,
"y": 679
},
{
"t": 54,
"x": 563,
"y": 678
},
{
"t": 55,
"x": 567,
"y": 690
},
{
"t": 56,
"x": 576,
"y": 659
},
{
"t": 57,
"x": 578,
"y": 657
},
{
"t": 58,
"x": 587,
"y": 689
},
{
"t": 59,
"x": 593,
"y": 689
},
{
"t": 60,
"x": 598,
"y": 682
},
{
"t": 61,
"x": 603,
"y": 682
},
{
"t": 62,
"x": 605,
"y": 661
},
{
"t": 63,
"x": 609,
"y": 667
},
{
"t": 64,
"x": 616,
"y": 673
},
{
"t": 65,
"x": 622,
"y": 674
},
{
"t": 66,
"x": 632,
"y": 678
},
{
"t": 67,
"x": 640,
"y": 679
},
{
"t": 68,
"x": 649,
"y": 682
},
{
"t": 69,
"x": 658,
"y": 683
},
{
"t": 70,
"x": 668,
"y": 686
},
{
"t": 71,
"x": 677,
"y": 686
},
{
"t": 72,
"x": 687,
"y": 690
},
{
"t": 73,
"x": 696,
"y": 691
},
{
"t": 74,
"x": 705,
"y": 692
},
{
"t": 75,
"x": 715,
"y": 694
},
{
"t": 76,
"x": 723,
"y": 694
},
{
"t": 77,
"x": 733,
"y": 696
},
{
"t": 78,
"x": 732,
"y": 689
},
{
"t": 79,
"x": 724,
"y": 681
},
{
"t": 80,
"x": 715,
"y": 676
},
{
"t": 81,
"x": 730,
"y": 679
},
{
"t": 82,
"x": 742,
"y": 681
},
{
"t": 83,
"x": 726,
"y": 675
},
{
"t": 84,
"x": 735,
"y": 676
},
{
"t": 85,
"x": 748,
"y": 678
},
{
"t": 86,
"x": 761,
"y": 680
},
{
"t": 87,
"x": 774,
"y": 682
},
{
"t": 88,
"x": 737,
"y": 673
},
{
"t": 89,
"x": 744,
"y": 674
},
{
"t": 90,
"x": 748,
"y": 674
},
{
"t": 92,
"x": 763,
"y": 676
},
{
"t": 93,
"x": 751,
"y": 674
},
{
"t": 94,
"x": 758,
"y": 675
},
{
"t": 95,
"x": 766,
"y": 676
},
{
"t": 96,
"x": 773,
"y": 677
},
{
"t": 97,
"x": 777,
"y": 677
},
{
"t": 98,
"x": 784,
"y": 678
},
{
"t": 99,
"x": 792,
"y": 679
},
{
"t": 100,
"x": 799,
"y": 680
},
{
"t": 101,
"x": 805,
"y": 680
},
{
"t": 102,
"x": 791,
"y": 679
},
{
"t": 103,
"x": 794,
"y": 680
},
{
"t": 104,
"x": 828,
"y": 683
},
{
"t": 105,
"x": 840,
"y": 684
},
{
"t": 106,
"x": 815,
"y": 683
},
{
"t": 107,
"x": 822,
"y": 684
},
{
"t": 108,
"x": 829,
"y": 685
},
{
"t": 109,
"x": 836,
"y": 686
},
{
"t": 110,
"x": 844,
"y": 688
},
{
"t": 111,
"x": 851,
"y": 689
},
{
"t": 112,
"x": 858,
"y": 690
},
{
"t": 113,
"x": 855,
"y": 690
},
{
"t": 114,
"x": 871,
"y": 691
},
{
"t": 115,
"x": 880,
"y": 692
},
{
"t": 116,
"x": 877,
"y": 693
},
{
"t": 117,
"x": 908,
"y": 693
},
{
"t": 118,
"x": 902,
"y": 695
},
{
"t": 119,
"x": 923,
"y": 695
}
],
"birth": 0,
"death": 120
}
],
"interactions": [
{
"id": 8,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 0,
"ends_at": 64,
"type": "contact"
},
{
"id": 11,
"inputs": [
1,
65535
],
"outputs": [
1,
65535
],
"begins_at": 0,
"ends_at": 119,
"type": "contact"
},
{
"id": 12,
"inputs": [
2,
65535
],
"outputs": [
2,
65535
],
"begins_at": 0,
"ends_at": 119,
"type": "contact"
},
{
"id": 13,
"inputs": [
4,
65535
],
"outputs": [
4,
65535
],
"begins_at": 0,
"ends_at": 119,
"type": "contact"
},
{
"id": 2,
"inputs": [
0,
4
],
"outputs": [
0,
4
],
"begins_at": 36,
"ends_at": 36,
"type": "collision"
},
{
"id": 1,
"inputs": [
0,
2
],
"outputs": [
0,
2
],
"begins_at": 41,
"ends_at": 41,
"type": "collision"
},
{
"id": 0,
"inputs": [
0,
1
],
"outputs": [
0,
1
],
"begins_at": 42,
"ends_at": 42,
"type": "collision"
},
{
"id": 3,
"inputs": [
0,
4
],
"outputs": [
0,
4
],
"begins_at": 42,
"ends_at": 42,
"type": "collision"
},
{
"id": 4,
"inputs": [
0,
4
],
"outputs": [
0,
4
],
"begins_at": 47,
"ends_at": 47,
"type": "collision"
},
{
"id": 5,
"inputs": [
0,
4
],
"outputs": [
0,
4
],
"begins_at": 48,
"ends_at": 63,
"type": "contact"
},
{
"id": 6,
"inputs": [
0,
4
],
"outputs": [
0,
4
],
"begins_at": 69,
"ends_at": 69,
"type": "collision"
},
{
"id": 9,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 69,
"ends_at": 69,
"type": "collision"
},
{
"id": 7,
"inputs": [
0,
4
],
"outputs": [
0,
4
],
"begins_at": 70,
"ends_at": 83,
"type": "contact"
},
{
"id": 10,
"inputs": [
0,
65535
],
"outputs": [
0,
65535
],
"begins_at": 70,
"ends_at": 119,
"type": "contact"
}
]
}Complete per-sample evaluator report
{
"metrics": {
"avg_type_similarity": null,
"avg_size_diff": null,
"avg_3d_iou": null,
"avg_image_position_px_diff": null,
"avg_image_position_segmentation_acc": null,
"avg_image_position_segmentation_acc_small": null,
"avg_image_position_segmentation_acc_medium": null,
"avg_image_position_segmentation_acc_large": null,
"avg_image_position_segmentation_acc_first_frame": null,
"avg_image_position_segmentation_visible_acc": null,
"avg_quaternion_geodesic_deg": null,
"visibility_acc": null,
"visibility_true_acc": null,
"visibility_false_acc": null,
"is_in_frame_acc": null,
"is_in_frame_true_acc": null,
"is_in_frame_false_acc": null,
"vis_acc_from_px": null,
"vis_acc_from_px_true_acc": null,
"vis_acc_from_px_false_acc": null,
"num_matches": 0,
"num_unmatched_pred": 0,
"num_unmatched_target": 5
},
"supports": {
"avg_type_similarity": 0,
"avg_size_diff": 0,
"avg_3d_iou": 0,
"avg_image_position_px_diff": 0,
"avg_image_position_segmentation_acc": 0,
"avg_image_position_segmentation_acc_small": 0,
"avg_image_position_segmentation_acc_medium": 0,
"avg_image_position_segmentation_acc_large": 0,
"avg_image_position_segmentation_acc_first_frame": 0,
"avg_image_position_segmentation_visible_acc": 0,
"avg_quaternion_geodesic_deg": 0,
"visibility_acc": 0,
"visibility_true_acc": 0,
"visibility_false_acc": 0,
"is_in_frame_acc": 0,
"is_in_frame_true_acc": 0,
"is_in_frame_false_acc": 0,
"vis_acc_from_px": 0,
"vis_acc_from_px_true_acc": 0,
"vis_acc_from_px_false_acc": 0
},
"matching": {
"matches": [],
"unmatched_target_ids": [
0,
1,
2,
3,
4
],
"unmatched_pred_ids": [],
"target_type_counts": {
"yellow cruiser": 1,
"gray wagon": 1,
"green school": 1,
"cyan airliner": 1,
"red minivan": 1
},
"pred_type_counts": {},
"assignment_backend": "scipy_dense",
"cost_functions": [
"mutual_type",
"same_seg"
],
"cost_weights": {
"mutual_type": 1.0,
"same_seg": 1.0
},
"num_frames": 120
},
"scene_metrics": {
"thresholds": [
0.5,
1.0,
2.0,
3.0
],
"counts_by_threshold": {
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"2.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"3.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
}
},
"jaccard_by_threshold": {
"0.5": 0.0,
"1.0": 0.0,
"2.0": 0.0,
"3.0": 0.0
},
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 5
}
},
"visibility_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_by_motion_group": {
"dynamic": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 4
}
},
"visibility_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"unknown": {
"visibility_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 1
}
},
"visibility_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"visibility_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"segmentation_counts_by_threshold": {},
"segmentation_precision_by_threshold": {},
"segmentation_recall_by_threshold": {},
"segmentation_f1_by_threshold": {},
"segmentation_frame_average_precision": null,
"segmentation_frame_average_recall": null,
"segmentation_frame_average_f1": null,
"segmentation_first_frame_counts": {},
"segmentation_first_frame_precision": null,
"segmentation_first_frame_recall": null,
"segmentation_first_frame_f1": null,
"segmentation_by_motion_group": {}
},
"per_match_metrics": [],
"interaction_metrics": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 14,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 14
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 14
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 14
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 14
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 14
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 14
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 14
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 14
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 14
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 14
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 14
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 14
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"interaction_supports": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
},
"interaction_matching": {
"matches": [],
"unmatched_target_ids": [
0,
1,
2,
3,
4,
5,
6,
7,
8,
9,
10,
11,
12,
13
],
"unmatched_pred_ids": [],
"target_type_counts": {
"collision": 7,
"contact": 7
},
"pred_type_counts": {},
"assignment_backend": "scipy_dense",
"cost_functions": [
"type_exact",
"temporal_span",
"input_object_set_mutual_jaccard",
"output_object_set_mutual_jaccard"
],
"cost_weights": {
"type_exact": 1.0,
"temporal_span": 1.0,
"input_object_set_mutual_jaccard": 0.5,
"output_object_set_mutual_jaccard": 0.5
}
},
"per_interaction_match_metrics": [],
"interaction_metrics_by_participants": {
"object_ground": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 6,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 6
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"object_object": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 8,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 8
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 8
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 8
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 8
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 8
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 8
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 8
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 8
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 8
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 8
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 8
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 8
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"interaction_supports_by_participants": {
"object_ground": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
},
"object_object": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
}
},
"interaction_metrics_by_type": {
"collision": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 7,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
},
"contact": {
"avg_interaction_temporal_span_giou": null,
"avg_interaction_input_object_jaccard": null,
"avg_interaction_output_object_jaccard": null,
"avg_interaction_type_exact_match_acc": null,
"num_interaction_matches": 0,
"num_unmatched_pred_interactions": 0,
"num_unmatched_target_interactions": 7,
"interaction_temporal_iou_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_object_jaccard_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"interaction_temporal_iou_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
}
},
"interaction_temporal_iou_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_temporal_iou_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
}
},
"interaction_input_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_input_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_counts_by_threshold": {
"0.25": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"0.5": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"0.75": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
},
"1.0": {
"true_positives": 0,
"false_positives": 0,
"false_negatives": 7
}
},
"interaction_output_object_jaccard_precision_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_recall_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
},
"interaction_output_object_jaccard_f1_by_threshold": {
"0.25": 0.0,
"0.5": 0.0,
"0.75": 0.0,
"1.0": 0.0
}
}
},
"interaction_supports_by_type": {
"collision": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
},
"contact": {
"avg_interaction_temporal_span_giou": 0,
"avg_interaction_input_object_jaccard": 0,
"avg_interaction_output_object_jaccard": 0,
"avg_interaction_type_exact_match_acc": 0
}
}
}Exact evaluation configuration
{
"predictions_jsonl": "../inference_output.jsonl",
"dataset_json": "../test_data/movi_dump_sentinel_sharegpt.json",
"scene_root": "../test_data/movi_dump",
"output_json": "../evaluation_report.json",
"max_samples": null,
"num_workers": 1,
"show_progress": true,
"log_level": "INFO",
"visibility_filter_mode": "any_frame",
"pos2d_mode": "scaled_normalized",
"pos2d_scale": 1000.0,
"image_width": null,
"image_height": null,
"type_embed_model_name": "all-MiniLM-L6-v2",
"scene_similarity_thresholds": [
0.5,
1.0,
2.0,
3.0
],
"scene_segmentation_thresholds": [
0.25,
0.5,
0.75,
1.0
],
"matching": {
"costs": [
{
"name": "mutual_type",
"weight": 1.0
},
{
"name": "same_seg",
"weight": 1.0,
"missing_value": 1.0,
"kwargs": {
"only_use_first_frame": false
}
}
]
},
"interaction_matching": {
"costs": [
{
"name": "type_exact",
"weight": 1.0
},
{
"name": "temporal_span",
"weight": 1.0
},
{
"name": "input_object_set_mutual_jaccard",
"weight": 0.5
},
{
"name": "output_object_set_mutual_jaccard",
"weight": 0.5
}
]
},
"return_per_sample": true
}