whatisgithub

What is remot?

tony-create1/remot — explained in plain English

Analysis updated 2026-05-18

25PythonAudience · researcherComplexity · 4/5Setup · hard

In one sentence

The dataset, model, and evaluation code for a CVPR 2026 research paper on teaching AI to understand motion between images.

Mindmap

A visual breakdown will appear here once this repo is fully enriched.

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Reproduce the benchmark results from the ReMoT CVPR 2026 paper.

USE CASE 2

Evaluate a vision-language model's ability to detect motion between image frames, such as robot gripper state changes.

USE CASE 3

Test a model on general visual reasoning tasks like object counting, detection, and relative position.

USE CASE 4

Resume an interrupted multi-GPU evaluation run from a saved checkpoint.

What is it built with?

PythonCUDA

How does it compare?

tony-create1/remotalexrosbach/replibookarlandaren/proagents
Stars252525
LanguagePythonPythonPython
Setup difficultyhardeasyeasy
Complexity4/52/51/5
Audienceresearcherops devopsvibe coder

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1day+

Requires multiple GPUs, a pre-trained model, and manual tracing of image files since only JSONL annotations are open-sourced.

So what is it?

ReMoT is the code, dataset, and trained model released alongside a research paper accepted as a Highlight at the CVPR 2026 computer vision conference. The paper is about teaching AI vision systems to understand motion in images, specifically by training them on sets of three related images at a time, called triplets, so the model learns to notice what changed between frames rather than just what is present in a single picture. The dataset is made up of question and answer pairs stored in a simple text format called JSONL, where each entry includes a set of images, a written question, and the correct answer. Many of the examples come from robotics footage, asking the model to figure out whether a robot's gripper opened or closed between frames, or whether a camera's viewpoint shifted between shots. Other examples cover more general visual reasoning tasks, like counting objects, detecting objects, or judging their relative position in a scene. Because only the text files are shared publicly and not the original images themselves, the README explains how to trace each entry back to its source image using patterns in the file names. The repository includes scripts for evaluating a trained model against these datasets. One script evaluates a single dataset across multiple graphics cards at once, another runs the full set of benchmark datasets in one go, and a third script gathers all the results into a summary report. The evaluation measures how often the model's answer exactly matches the correct answer, as well as partial credit for getting some characters right. If an evaluation run gets interrupted partway through, the scripts can resume from where they left off using saved checkpoint files. This project is aimed at researchers working in computer vision and robotics who want to reproduce the paper's results or evaluate their own models against the same benchmarks. Running it requires access to powerful graphics hardware and a machine learning model already prepared to be tested, since the scripts are built around evaluating an existing model rather than teaching how to build one from scratch.

Copy-paste prompts

Prompt 1
Help me understand the JSONL data format used by the ReMoT dataset.
Prompt 2
Show me how to run index_eval.py to evaluate a model on a single ReMoT dataset.
Prompt 3
Explain how to use infer_remot_bench.py to evaluate all ReMoT benchmark datasets at once.
Prompt 4
Walk me through how to resume an interrupted ReMoT evaluation using the checkpoint file.

Frequently asked questions

What is remot?

The dataset, model, and evaluation code for a CVPR 2026 research paper on teaching AI to understand motion between images.

What language is remot written in?

Mainly Python. The stack also includes Python, CUDA.

How hard is remot to set up?

Setup difficulty is rated hard, with roughly 1day+ to a first successful run.

Who is remot for?

Mainly researcher.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.