Vedant commited on
Commit
cbd287e
1 Parent(s): 3539ab8

Readme was updated to improve model card

Browse files
Files changed (1) hide show
  1. README.md +84 -4
README.md CHANGED
@@ -1,7 +1,87 @@
1
  ---
2
  license: apache-2.0
3
  language:
4
- - en
5
- base_model:
6
- - Lightricks/LTX-Video
7
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
  language:
4
+ - en
5
+ arxiv: 2607.21580
6
+ tags:
7
+ - video-generation
8
+ - image-to-video
9
+ - controllable-generation
10
+ - graph-conditioning
11
+ - computer-vision
12
+ ---
13
+
14
+ # GraphVid: Interactive Graph-Controllable Video Generation
15
+
16
+ **Vedant Shah, Onkar Susladkar, Tushar Prakash, Kiet A. Nguyen, Tianjiao Yu, Adheesh Juvekar, Muntasir Wahed, Ismini Lourentzou**
17
+
18
+ ### 馃帀 Accepted to ECCV 2026
19
+
20
+ [馃搫 Paper](https://arxiv.org/pdf/2607.21580) 路 [馃寪 Project Page](https://plan-lab.github.io/projects/graphvid/) 路 [馃捇 Code](https://github.com/PLAN-Lab/GraphVid) 路 [馃 GraphVid-Bench](https://huggingface.co/PLAN-Lab/GraphVid/blob/main/GraphVid_Bench.tar.zst)
21
+
22
+ ---
23
+
24
+ ## Overview
25
+
26
+ **GraphVid** is an interactive graph-conditioned framework for controllable image-to-video generation.
27
+
28
+ Rather than requiring users to specify exact motion trajectories, GraphVid captures **semantic interaction intent** using structured interaction graphs. Users interact directly with objects in an input image, and these interactions are translated into graph-based conditioning that guides video generation.
29
+
30
+ > **GraphVid turns semantic interaction intent into video through structured interaction graphs.**
31
+
32
+ <p align="center">
33
+ <img src="https://eccv.ecva.net/media/PosterPDFs/ECCV%202026/4972.png?t=1788363514.4090796" width="100%">
34
+ </p>
35
+
36
+ ---
37
+
38
+ ## Key Idea
39
+
40
+ GraphVid represents a scene using an **interaction graph**, where objects are represented as nodes and relationships or intended interactions are represented through edges.
41
+
42
+ User interactions are performed directly on the input image rather than on the graph itself. These interactions are interpreted and translated into an updated graph representation that captures the user's intended action.
43
+
44
+ The resulting graph provides structured conditioning to the video generation model:
45
+
46
+ **the graph specifies what should happen, while the pretrained video backbone determines how the generated video should look and move.**
47
+
48
+ ---
49
+
50
+ ## Highlights
51
+
52
+ * **Semantic interaction control:** Represents intended object interactions explicitly rather than treating control solely as geometric motion.
53
+
54
+ * **Interaction graphs:** Uses structured graph representations to encode entities, relationships, and intended dynamics.
55
+
56
+ * **Image-based user interaction:** Users interact directly with objects in the input image; the underlying graph is constructed and updated automatically.
57
+
58
+ * **Single- and multi-object control:** Supports interactions involving individual objects as well as relationships between multiple objects.
59
+
60
+ * **GraphVid-Bench:** Provides an interaction-focused video benchmark with structured relational annotations.
61
+
62
+ * **Lightweight conditioning:** Introduces graph-based control while leveraging a pretrained video generation backbone.
63
+
64
+ ---
65
+
66
+ ## Resources
67
+
68
+ * **Paper:** [GraphVid: Interactive Graph-Controllable Video Generation](https://arxiv.org/pdf/2607.21580)
69
+ * **Project Page:** [plan-lab.github.io/projects/graphvid](https://plan-lab.github.io/projects/graphvid/)
70
+ * **Code:** [github.com/PLAN-Lab/GraphVid](https://github.com/PLAN-Lab/GraphVid)
71
+ * **GraphVid-Bench:** [Download from Hugging Face](https://huggingface.co/PLAN-Lab/GraphVid/blob/main/GraphVid_Bench.tar.zst)
72
+ * **ECCV 2026 Poster:** [View Poster](https://eccv.ecva.net/media/PosterPDFs/ECCV%202026/4972.png?t=1788363514.4090796)
73
+
74
+ ---
75
+
76
+ ## Citation
77
+
78
+ If you find GraphVid useful in your research, please consider citing our work:
79
+
80
+ ```bibtex
81
+ @article{shah2026graphvid,
82
+ title={GraphVid: Interactive Graph-Controllable Video Generation},
83
+ author={Shah, Vedant and Susladkar, Onkar and Prakash, Tushar and Nguyen, Kiet A. and Yu, Tianjiao and Juvekar, Adheesh and Wahed, Muntasir and Lourentzou, Ismini},
84
+ journal={arXiv preprint arXiv:2607.21580},
85
+ year={2026}
86
+ }
87
+ ```