Standard MOVi-E · 0000

{
  "messages": [
    {
      "role": "user",
      "content": "<video>\nAnalyze the provided video and return ONLY a valid sentinel sequence in this format:\n[SCENE-START] [OBJS-START]\n[OBJ] id \"type\" birth death [PX] t px py ...\n[OBJ] ...\n[OBJS-END]\n[INTERACTIONS-START]\n[INTERACT] id \"type\" begins_at ends_at [IN] in0 in1 ... [OUT] out0 out1 ...\n[INTERACT] ...\n[INTERACTIONS-END] [SCENE-END]\n\nConstraints:\n- Return only the sentinel text (no JSON, XML, markdown, comments, or extra prose).\n- Keep tags exactly as written:\n  `[SCENE-START] [OBJS-START] [OBJ] [PX] [OBJS-END] [INTERACTIONS-START] [INTERACT] [IN] [OUT] [INTERACTIONS-END] [SCENE-END]`\n- Use quoted strings for `type` (double quotes).\n- `PX` uses repeated groups of 3 values in order: `t px py`.\n  - `t` is the timestamp (frame number).\n  - `px` and `py` are the pixel coordinates of the object in that frame, normalized to [0,1] relative to the frame dimensions, scaled by 1000 and rounded to the nearest integer. For example, `px` of 0.1234 would be represented as 123.\n- When an object is occluded or not visible in a frame, `PX` may use `t null null`.\n- `IN` and `OUT` contain whitespace-separated integer ids."
    },
    {
      "role": "assistant",
      "content": "[SCENE-START] [OBJS-START] [OBJ] 0 \"dark blue fabric chukka boot\" 0 24 [PX] 0 5 376 2 5 365 3 9 380 5 9 369 7 13 380 9 13 369 10 17 388 12 17 376 14 21 388 16 21 376 18 25 388 20 25 376 22 29 388 [OBJ] 1 \"red wooden toy fire engine\" 0 24 [PX] 0 48 447 7 56 443 14 68 443 21 80 443 [OBJ] 2 \"light brown wooden alphabet tile set\" 0 24 [PX] 0 72 185 1 119 173 2 189 193 3 232 224 4 267 263 5 302 310 6 337 373 7 369 431 8 384 455 9 404 458 10 427 466 11 439 478 12 513 482 13 521 486 14 544 490 15 556 486 16 583 494 17 603 498 18 623 498 19 638 494 20 650 490 22 736 490 23 662 482 [OBJ] 3 \"wooden garden swing with blue striped cushions\" 0 24 [PX] 0 154 337 4 166 341 8 138 345 9 166 353 10 150 345 11 169 357 13 162 353 14 177 357 15 166 357 16 181 361 17 169 361 18 185 365 19 173 365 20 189 369 21 177 369 22 193 373 23 181 373 [OBJ] 4 \"orange plastic Android robot figurine\" 0 24 [PX] 0 208 240 1 224 248 2 null null 5 212 255 6 236 263 8 244 271 11 251 279 13 255 287 15 263 294 17 271 302 20 275 310 23 279 318 [OBJ] 5 \"wooden rainbow stacking toy\" 0 24 [PX] 0 212 302 3 212 326 4 197 326 5 205 302 6 224 318 11 232 326 15 240 333 17 244 341 22 251 349 [OBJ] 6 \"green and yellow cardboard ink cartridge box\" 0 24 [PX] 0 388 400 1 423 435 3 533 400 4 521 396 5 509 384 6 498 380 7 509 376 8 490 337 9 486 357 11 470 361 12 435 373 13 470 357 14 458 353 15 455 345 16 443 345 19 431 353 22 416 361 23 439 353 [OBJ] 7 \"orange leather chukka boot\" 0 24 [PX] 0 494 322 1 462 302 2 435 302 3 412 298 4 423 330 5 439 142 6 419 193 7 384 251 8 392 283 9 380 275 13 388 283 16 392 267 18 388 275 21 380 283 [OBJ] 8 \"black plastic gaming mouse\" 0 24 [PX] 0 null null 1 552 275 2 544 287 3 529 294 4 517 294 6 529 302 9 525 310 10 548 318 11 533 314 13 541 318 14 552 326 17 541 333 18 552 337 20 544 341 22 541 349 [OBJ] 9 \"white canvas boat shoe\" 0 24 [PX] 0 677 255 2 685 259 5 685 271 7 689 279 10 689 291 13 693 298 14 701 302 18 701 314 21 701 326 23 708 330 [OBJ] 10 \"white-lined woven storage basket\" 0 24 [PX] 0 736 771 3 728 763 5 724 755 8 720 748 10 712 740 11 708 732 14 705 724 16 701 708 18 693 705 20 689 697 22 685 689 [OBJ] 11 \"blue and white Phillips caplets box\" 0 24 [PX] 0 912 263 1 927 267 2 908 267 4 912 275 8 912 287 10 916 294 13 927 306 14 943 310 15 916 310 19 919 322 22 919 333 23 927 337 [OBJ] 12 \"dark fabric boat shoe\" 0 24 [PX] 0 974 548 15 974 537 20 974 525 [OBJS-END] [INTERACTIONS-START] [INTERACT] 10 \"contact\" 0 4 [IN] 4 5 [OUT] 4 5 [INTERACT] 13 \"contact\" 0 4 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 0 \"contact\" 0 23 [IN] 0 65535 [OUT] 0 65535 [INTERACT] 1 \"contact\" 0 23 [IN] 1 65535 [OUT] 1 65535 [INTERACT] 9 \"contact\" 0 23 [IN] 3 65535 [OUT] 3 65535 [INTERACT] 11 \"contact\" 0 23 [IN] 4 65535 [OUT] 4 65535 [INTERACT] 12 \"contact\" 0 23 [IN] 5 65535 [OUT] 5 65535 [INTERACT] 24 \"contact\" 0 23 [IN] 8 65535 [OUT] 8 65535 [INTERACT] 25 \"contact\" 0 23 [IN] 9 65535 [OUT] 9 65535 [INTERACT] 2 \"contact\" 0 23 [IN] 10 65535 [OUT] 10 65535 [INTERACT] 3 \"contact\" 0 23 [IN] 11 65535 [OUT] 11 65535 [INTERACT] 4 \"contact\" 0 23 [IN] 12 65535 [OUT] 12 65535 [INTERACT] 8 \"collision\" 3 3 [IN] 2 7 [OUT] 2 7 [INTERACT] 19 \"collision\" 4 4 [IN] 6 7 [OUT] 6 7 [INTERACT] 14 \"collision\" 6 6 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 15 \"contact\" 7 23 [IN] 6 65535 [OUT] 6 65535 [INTERACT] 7 \"collision\" 8 9 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 20 \"collision\" 9 9 [IN] 6 7 [OUT] 6 7 [INTERACT] 5 \"collision\" 11 11 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 16 \"collision\" 12 12 [IN] 6 7 [OUT] 6 7 [INTERACT] 6 \"contact\" 12 23 [IN] 2 65535 [OUT] 2 65535 [INTERACT] 17 \"contact\" 13 14 [IN] 6 7 [OUT] 6 7 [INTERACT] 21 \"collision\" 14 14 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 18 \"collision\" 19 19 [IN] 6 7 [OUT] 6 7 [INTERACT] 22 \"collision\" 19 19 [IN] 7 65535 [OUT] 7 65535 [INTERACT] 23 \"contact\" 20 23 [IN] 7 65535 [OUT] 7 65535 [INTERACTIONS-END] [SCENE-END]"
    }
  ],
  "videos": [
    "/mmfs1/gscratch/krishna/suryadv/strive_fullvideo_reference_v2/data/kubric_strive/movi_e_drop_never_visible_scaled_no_3d_vis_in_frame_occ_null/videos/0000/frames.mp4"
  ]
}