MiniMax H3
comfyui
video
steering
dials
matlod commited on
Commit
8adbaae
·
verified ·
1 Parent(s): 000460e

Add four example dials on a time curve: impact frame, aura, ink wash, colour drain

Browse files

Hook dials with their prompt pairs, suggested strengths per pipeline (in each file's dial_info and the pair files), labelled baseline | constant | curve clips, and a README section. Gallery: https://matlowai.github.io/ComfyUI-Dials/curves.html

.gitattributes CHANGED
@@ -47,3 +47,7 @@ examples/pika_dread_derope/labeled/01_h3_base_25steps_no_derope_labeled.mp4 filt
47
  examples/pika_dread_derope/labeled/02_pika_motion0.5_dread0_derope_labeled.mp4 filter=lfs diff=lfs merge=lfs -text
48
  examples/pika_dread_derope/labeled/03_pika_motion0.5_dread0.5_derope_labeled.mp4 filter=lfs diff=lfs merge=lfs -text
49
  examples/pika_dread_derope/labeled/04_pika_motion0.5_dread1_derope_labeled.mp4 filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
47
  examples/pika_dread_derope/labeled/02_pika_motion0.5_dread0_derope_labeled.mp4 filter=lfs diff=lfs merge=lfs -text
48
  examples/pika_dread_derope/labeled/03_pika_motion0.5_dread0.5_derope_labeled.mp4 filter=lfs diff=lfs merge=lfs -text
49
  examples/pika_dread_derope/labeled/04_pika_motion0.5_dread1_derope_labeled.mp4 filter=lfs diff=lfs merge=lfs -text
50
+ assets/impact_frame_curve_compare.mp4 filter=lfs diff=lfs merge=lfs -text
51
+ assets/aura_curve_compare.mp4 filter=lfs diff=lfs merge=lfs -text
52
+ assets/ink_wash_curve_compare.mp4 filter=lfs diff=lfs merge=lfs -text
53
+ assets/colour_drain_curve_compare.mp4 filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -91,6 +91,39 @@ included as an experimental workflow. At 1280x704, a de-roped Pika clip takes ab
91
  *These two videos were rendered with an earlier wording of the example prompt, before the magical-girl rewrite.
92
  Re-renders with the current wording are coming.*
93
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
94
  ## Experimental dials (lab)
95
 
96
  Ten hook dials from a night of odd contrasts, made with
 
91
  *These two videos were rendered with an earlier wording of the example prompt, before the magical-girl rewrite.
92
  Re-renders with the current wording are coming.*
93
 
94
+ ## Four anime dials on a time curve
95
+
96
+ Four hook dials made with [ComfyUI-MAINodes](https://github.com/matlowai/ComfyUI-MAINodes) **Make Dial**, one prompt
97
+ pair each over eight adult subjects (debias on), and tested on the time curve each one is for in the **Dial Rack**.
98
+ **See every strength we rendered, in sync with its baseline and with sound:
99
+ [Dials on a Curve](https://matlowai.github.io/ComfyUI-Dials/curves.html).** Pairs and suggested strengths are in
100
+ `example_pairs/<name>.txt` (`{subject}` expands over `subjects_adults_places.txt`), and each file carries its own
101
+ description, labels and strengths (⚙ in the Dial Rack). All on Pika H3 Flex (6 steps, lcm, manual sigmas, cfg 1),
102
+ one scene and seed per dial, time-curve rows with blend steps **k = 6** and **audio: protect**.
103
+
104
+ | file | curve | text to video | with a reference picture | notes |
105
+ |---|---|---|---|---|
106
+ | `dials/h3_impact_frame_hook.safetensors` | a 0.5 s pulse at the hit | **pulse 4.5**; constant 3 for a whole-clip ink look | pulse 6 (an ink burst over the contact, not full-frame) | the anime hit flash: ~6 frames of black silhouettes on white in an ink starburst, then the shot comes back. Held constant it replaces the shot. 8 on the pulse drew less than 6 |
107
+ | `dials/h3_aura_hook.safetensors` | ramp and hold | ramp 2 (costume and hair drift; 3 bursts from frame 0) | **ramp 2.5** (2 softer) | a halo ring, energy spikes and dust. ⚠️ The dial also pushes the camera in to a close-up, and the face drifts there. The soundtrack got ~18 LU louder (a wind roar) even with audio: protect |
108
+ | `dials/h3_ink_wash_hook.safetensors` | best held constant | **constant 1.5 to 2**; seep in/out 2 at k = 6 | draws nothing (tried up to 6) | a flowing black ink-wash painting on paper. Best as a constant look on text to video. On a curve it follows, but the scene re-composes as it washes in and out (k = 2 smears the look over the clip) |
109
+ | `dials/h3_colour_drain_hook.safetensors` | a snap (step) | greys at 4 to 5 but restages the set into masked mannequins | **snap 4** (3 draws nothing) | full colour to flat grey and back with the same characters. Starts ~0.3 s before the key |
110
+
111
+ Each clip: baseline, the dial held for the whole clip, the dial on its curve; the curve and the measured change from
112
+ the baseline are drawn underneath. Sound from the curve take.
113
+
114
+ <video controls autoplay loop muted src="https://huggingface.co/MATLOWAI/H3-Dials/resolve/main/assets/impact_frame_curve_compare.mp4"></video>
115
+
116
+ <video controls autoplay loop muted src="https://huggingface.co/MATLOWAI/H3-Dials/resolve/main/assets/aura_curve_compare.mp4"></video>
117
+
118
+ <video controls autoplay loop muted src="https://huggingface.co/MATLOWAI/H3-Dials/resolve/main/assets/ink_wash_curve_compare.mp4"></video>
119
+
120
+ <video controls autoplay loop muted src="https://huggingface.co/MATLOWAI/H3-Dials/resolve/main/assets/colour_drain_curve_compare.mp4"></video>
121
+
122
+ **What changes with a reference picture:** it holds the style, so the useful strength depends on the pipeline (ink wash
123
+ drew nothing with one; colour drain needed 4; impact frame 6 instead of 4.5). With a reference picture, aura and colour
124
+ drain followed their curves at k = 2 as well as k = 6; without one, ink wash needed k = 6. Start look dials on curves at
125
+ k = 6.
126
+
127
  ## Experimental dials (lab)
128
 
129
  Ten hook dials from a night of odd contrasts, made with
assets/aura_curve_compare.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55bbe0191b22fdd66c08c8f845af6048c03d1cd89aff2760f6acec3d4a8989be
3
+ size 747247
assets/colour_drain_curve_compare.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6112e8715cab47e119c448662be6bca8d11685c6d1af8b992c580013971259e
3
+ size 864462
assets/impact_frame_curve_compare.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:278727285c8f026b8866e2f302b4394c8076c27eaa64cf6e914a1ce743660f08
3
+ size 1105399
assets/ink_wash_curve_compare.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d99bc418c779e1250019abb2adbe79215da2bd0fe32823f294e48b18f302cd6a
3
+ size 1432472
dials/h3_aura_hook.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e751cde54966969fe2e7437f239deb31d4bdc2bf73b4937dd136c904cfdabebb
3
+ size 13968
dials/h3_colour_drain_hook.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad09499f755692091fd1aeac17edf3ff68a865765f53d5f101a814808a9407a6
3
+ size 13608
dials/h3_impact_frame_hook.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd6393537258d1e64a863da0234574b8287740e1cb1860744cc785c44686ae8d
3
+ size 14152
dials/h3_ink_wash_hook.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4dcb6dca1e92b0955880a7675b34733dacb1a0ef6889bded25cc668458a395e
3
+ size 13720
example_pairs/aura.txt ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ # Aura dial (h3_aura_hook): A = no glow around the body, B = a blazing aura of glowing energy. Expanded over subjects_adults_places.txt (8 subjects x 1 line = 8 pairs). Debias on, hook after the text refiner.
2
+ # Suggested strengths (Pika H3 Flex 6 steps, lcm, manual sigmas, cfg 1; time-curve rows with blend steps k = 6 and audio: protect): with a reference picture 2.5 on a ramp-and-hold curve (2 a softer fallback); text to video 2 (3 bursts from frame 0 and changes the costume).
3
+ # Clips at every strength we rendered: https://matlowai.github.io/ComfyUI-Dials/curves.html
4
+ {subject}, with no glow or light around the body. ||| {subject}, with a blazing aura of glowing energy flaring up around the body.
example_pairs/colour_drain.txt ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ # Colour drain dial (h3_colour_drain_hook): A = full, rich natural colour, B = flat grey monochrome. Expanded over subjects_adults_places.txt (8 subjects x 1 line = 8 pairs). Debias on, hook after the text refiner.
2
+ # Suggested strengths (Pika H3 Flex 6 steps, lcm, manual sigmas, cfg 1; time-curve rows with blend steps k = 6 and audio: protect): with a reference picture 4 on a step (snap) curve, 3 draws nothing; text to video greys at 4 to 5 but turns the characters into masked mannequins and restages the set.
3
+ # Clips at every strength we rendered: https://matlowai.github.io/ComfyUI-Dials/curves.html
4
+ {subject}, in full, rich natural colour. ||| {subject}, in flat grey monochrome with every colour drained away.
example_pairs/impact_frame.txt ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ # Impact frame dial (h3_impact_frame_hook): A = normal colours and soft shading, B = a stark black-and-white inverted impact frame. Expanded over subjects_adults_places.txt (8 subjects x 1 line = 8 pairs). Debias on, hook after the text refiner.
2
+ # Suggested strengths (Pika H3 Flex 6 steps, lcm, manual sigmas, cfg 1; time-curve rows with blend steps k = 6 and audio: protect): text to video 4.5 on a 0.5 s pulse at the hit; with a reference picture 6 on the pulse (a burst over the contact; 8 drew less); held constant on text to video, 3 turns the whole clip into ink.
3
+ # Clips at every strength we rendered: https://matlowai.github.io/ComfyUI-Dials/curves.html
4
+ {subject}, drawn with normal colours and soft shading. ||| {subject}, drawn as a stark black-and-white inverted impact frame with heavy ink lines.
example_pairs/ink_wash.txt ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ # Ink wash dial (h3_ink_wash_hook): A = clean cel-shaded anime colour, B = a flowing black ink-wash painting on paper. Expanded over subjects_adults_places.txt (8 subjects x 1 line = 8 pairs). Debias on, hook after the text refiner.
2
+ # Suggested strengths (Pika H3 Flex 6 steps, lcm, manual sigmas, cfg 1; time-curve rows with blend steps k = 6 and audio: protect): text to video only: held constant 1.5 to 2 (the recommended use); 2 on a seep-in-and-out curve at k = 6 (the scene re-composes as it washes in and out); with a reference picture it draws nothing up to 6.
3
+ # Clips at every strength we rendered: https://matlowai.github.io/ComfyUI-Dials/curves.html
4
+ {subject}, drawn in clean cel-shaded anime colours. ||| {subject}, painted as a flowing black ink-wash painting on paper.
example_pairs/subjects_adults_places.txt ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ A young woman in a long coat on a stone rooftop
2
+ An old man in a grey robe in a library
3
+ A knight in plate armour in a castle courtyard
4
+ A woman in a forest clearing
5
+ A man in a jacket on a city street at night
6
+ A traveller in a cloak on a desert dune
7
+ A monk on a mountain temple terrace
8
+ A woman in an apron in a small kitchen