Add four example dials on a time curve: impact frame, aura, ink wash, colour drain
Browse filesHook dials with their prompt pairs, suggested strengths per pipeline (in each file's dial_info and the pair files), labelled baseline | constant | curve clips, and a README section. Gallery: https://matlowai.github.io/ComfyUI-Dials/curves.html
- .gitattributes +4 -0
- README.md +33 -0
- assets/aura_curve_compare.mp4 +3 -0
- assets/colour_drain_curve_compare.mp4 +3 -0
- assets/impact_frame_curve_compare.mp4 +3 -0
- assets/ink_wash_curve_compare.mp4 +3 -0
- dials/h3_aura_hook.safetensors +3 -0
- dials/h3_colour_drain_hook.safetensors +3 -0
- dials/h3_impact_frame_hook.safetensors +3 -0
- dials/h3_ink_wash_hook.safetensors +3 -0
- example_pairs/aura.txt +4 -0
- example_pairs/colour_drain.txt +4 -0
- example_pairs/impact_frame.txt +4 -0
- example_pairs/ink_wash.txt +4 -0
- example_pairs/subjects_adults_places.txt +8 -0
.gitattributes
CHANGED
|
@@ -47,3 +47,7 @@ examples/pika_dread_derope/labeled/01_h3_base_25steps_no_derope_labeled.mp4 filt
|
|
| 47 |
examples/pika_dread_derope/labeled/02_pika_motion0.5_dread0_derope_labeled.mp4 filter=lfs diff=lfs merge=lfs -text
|
| 48 |
examples/pika_dread_derope/labeled/03_pika_motion0.5_dread0.5_derope_labeled.mp4 filter=lfs diff=lfs merge=lfs -text
|
| 49 |
examples/pika_dread_derope/labeled/04_pika_motion0.5_dread1_derope_labeled.mp4 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 47 |
examples/pika_dread_derope/labeled/02_pika_motion0.5_dread0_derope_labeled.mp4 filter=lfs diff=lfs merge=lfs -text
|
| 48 |
examples/pika_dread_derope/labeled/03_pika_motion0.5_dread0.5_derope_labeled.mp4 filter=lfs diff=lfs merge=lfs -text
|
| 49 |
examples/pika_dread_derope/labeled/04_pika_motion0.5_dread1_derope_labeled.mp4 filter=lfs diff=lfs merge=lfs -text
|
| 50 |
+
assets/impact_frame_curve_compare.mp4 filter=lfs diff=lfs merge=lfs -text
|
| 51 |
+
assets/aura_curve_compare.mp4 filter=lfs diff=lfs merge=lfs -text
|
| 52 |
+
assets/ink_wash_curve_compare.mp4 filter=lfs diff=lfs merge=lfs -text
|
| 53 |
+
assets/colour_drain_curve_compare.mp4 filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -91,6 +91,39 @@ included as an experimental workflow. At 1280x704, a de-roped Pika clip takes ab
|
|
| 91 |
*These two videos were rendered with an earlier wording of the example prompt, before the magical-girl rewrite.
|
| 92 |
Re-renders with the current wording are coming.*
|
| 93 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 94 |
## Experimental dials (lab)
|
| 95 |
|
| 96 |
Ten hook dials from a night of odd contrasts, made with
|
|
|
|
| 91 |
*These two videos were rendered with an earlier wording of the example prompt, before the magical-girl rewrite.
|
| 92 |
Re-renders with the current wording are coming.*
|
| 93 |
|
| 94 |
+
## Four anime dials on a time curve
|
| 95 |
+
|
| 96 |
+
Four hook dials made with [ComfyUI-MAINodes](https://github.com/matlowai/ComfyUI-MAINodes) **Make Dial**, one prompt
|
| 97 |
+
pair each over eight adult subjects (debias on), and tested on the time curve each one is for in the **Dial Rack**.
|
| 98 |
+
**See every strength we rendered, in sync with its baseline and with sound:
|
| 99 |
+
[Dials on a Curve](https://matlowai.github.io/ComfyUI-Dials/curves.html).** Pairs and suggested strengths are in
|
| 100 |
+
`example_pairs/<name>.txt` (`{subject}` expands over `subjects_adults_places.txt`), and each file carries its own
|
| 101 |
+
description, labels and strengths (⚙ in the Dial Rack). All on Pika H3 Flex (6 steps, lcm, manual sigmas, cfg 1),
|
| 102 |
+
one scene and seed per dial, time-curve rows with blend steps **k = 6** and **audio: protect**.
|
| 103 |
+
|
| 104 |
+
| file | curve | text to video | with a reference picture | notes |
|
| 105 |
+
|---|---|---|---|---|
|
| 106 |
+
| `dials/h3_impact_frame_hook.safetensors` | a 0.5 s pulse at the hit | **pulse 4.5**; constant 3 for a whole-clip ink look | pulse 6 (an ink burst over the contact, not full-frame) | the anime hit flash: ~6 frames of black silhouettes on white in an ink starburst, then the shot comes back. Held constant it replaces the shot. 8 on the pulse drew less than 6 |
|
| 107 |
+
| `dials/h3_aura_hook.safetensors` | ramp and hold | ramp 2 (costume and hair drift; 3 bursts from frame 0) | **ramp 2.5** (2 softer) | a halo ring, energy spikes and dust. ⚠️ The dial also pushes the camera in to a close-up, and the face drifts there. The soundtrack got ~18 LU louder (a wind roar) even with audio: protect |
|
| 108 |
+
| `dials/h3_ink_wash_hook.safetensors` | best held constant | **constant 1.5 to 2**; seep in/out 2 at k = 6 | draws nothing (tried up to 6) | a flowing black ink-wash painting on paper. Best as a constant look on text to video. On a curve it follows, but the scene re-composes as it washes in and out (k = 2 smears the look over the clip) |
|
| 109 |
+
| `dials/h3_colour_drain_hook.safetensors` | a snap (step) | greys at 4 to 5 but restages the set into masked mannequins | **snap 4** (3 draws nothing) | full colour to flat grey and back with the same characters. Starts ~0.3 s before the key |
|
| 110 |
+
|
| 111 |
+
Each clip: baseline, the dial held for the whole clip, the dial on its curve; the curve and the measured change from
|
| 112 |
+
the baseline are drawn underneath. Sound from the curve take.
|
| 113 |
+
|
| 114 |
+
<video controls autoplay loop muted src="https://huggingface.co/MATLOWAI/H3-Dials/resolve/main/assets/impact_frame_curve_compare.mp4"></video>
|
| 115 |
+
|
| 116 |
+
<video controls autoplay loop muted src="https://huggingface.co/MATLOWAI/H3-Dials/resolve/main/assets/aura_curve_compare.mp4"></video>
|
| 117 |
+
|
| 118 |
+
<video controls autoplay loop muted src="https://huggingface.co/MATLOWAI/H3-Dials/resolve/main/assets/ink_wash_curve_compare.mp4"></video>
|
| 119 |
+
|
| 120 |
+
<video controls autoplay loop muted src="https://huggingface.co/MATLOWAI/H3-Dials/resolve/main/assets/colour_drain_curve_compare.mp4"></video>
|
| 121 |
+
|
| 122 |
+
**What changes with a reference picture:** it holds the style, so the useful strength depends on the pipeline (ink wash
|
| 123 |
+
drew nothing with one; colour drain needed 4; impact frame 6 instead of 4.5). With a reference picture, aura and colour
|
| 124 |
+
drain followed their curves at k = 2 as well as k = 6; without one, ink wash needed k = 6. Start look dials on curves at
|
| 125 |
+
k = 6.
|
| 126 |
+
|
| 127 |
## Experimental dials (lab)
|
| 128 |
|
| 129 |
Ten hook dials from a night of odd contrasts, made with
|
assets/aura_curve_compare.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:55bbe0191b22fdd66c08c8f845af6048c03d1cd89aff2760f6acec3d4a8989be
|
| 3 |
+
size 747247
|
assets/colour_drain_curve_compare.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f6112e8715cab47e119c448662be6bca8d11685c6d1af8b992c580013971259e
|
| 3 |
+
size 864462
|
assets/impact_frame_curve_compare.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:278727285c8f026b8866e2f302b4394c8076c27eaa64cf6e914a1ce743660f08
|
| 3 |
+
size 1105399
|
assets/ink_wash_curve_compare.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d99bc418c779e1250019abb2adbe79215da2bd0fe32823f294e48b18f302cd6a
|
| 3 |
+
size 1432472
|
dials/h3_aura_hook.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e751cde54966969fe2e7437f239deb31d4bdc2bf73b4937dd136c904cfdabebb
|
| 3 |
+
size 13968
|
dials/h3_colour_drain_hook.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ad09499f755692091fd1aeac17edf3ff68a865765f53d5f101a814808a9407a6
|
| 3 |
+
size 13608
|
dials/h3_impact_frame_hook.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bd6393537258d1e64a863da0234574b8287740e1cb1860744cc785c44686ae8d
|
| 3 |
+
size 14152
|
dials/h3_ink_wash_hook.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d4dcb6dca1e92b0955880a7675b34733dacb1a0ef6889bded25cc668458a395e
|
| 3 |
+
size 13720
|
example_pairs/aura.txt
ADDED
|
@@ -0,0 +1,4 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Aura dial (h3_aura_hook): A = no glow around the body, B = a blazing aura of glowing energy. Expanded over subjects_adults_places.txt (8 subjects x 1 line = 8 pairs). Debias on, hook after the text refiner.
|
| 2 |
+
# Suggested strengths (Pika H3 Flex 6 steps, lcm, manual sigmas, cfg 1; time-curve rows with blend steps k = 6 and audio: protect): with a reference picture 2.5 on a ramp-and-hold curve (2 a softer fallback); text to video 2 (3 bursts from frame 0 and changes the costume).
|
| 3 |
+
# Clips at every strength we rendered: https://matlowai.github.io/ComfyUI-Dials/curves.html
|
| 4 |
+
{subject}, with no glow or light around the body. ||| {subject}, with a blazing aura of glowing energy flaring up around the body.
|
example_pairs/colour_drain.txt
ADDED
|
@@ -0,0 +1,4 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Colour drain dial (h3_colour_drain_hook): A = full, rich natural colour, B = flat grey monochrome. Expanded over subjects_adults_places.txt (8 subjects x 1 line = 8 pairs). Debias on, hook after the text refiner.
|
| 2 |
+
# Suggested strengths (Pika H3 Flex 6 steps, lcm, manual sigmas, cfg 1; time-curve rows with blend steps k = 6 and audio: protect): with a reference picture 4 on a step (snap) curve, 3 draws nothing; text to video greys at 4 to 5 but turns the characters into masked mannequins and restages the set.
|
| 3 |
+
# Clips at every strength we rendered: https://matlowai.github.io/ComfyUI-Dials/curves.html
|
| 4 |
+
{subject}, in full, rich natural colour. ||| {subject}, in flat grey monochrome with every colour drained away.
|
example_pairs/impact_frame.txt
ADDED
|
@@ -0,0 +1,4 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Impact frame dial (h3_impact_frame_hook): A = normal colours and soft shading, B = a stark black-and-white inverted impact frame. Expanded over subjects_adults_places.txt (8 subjects x 1 line = 8 pairs). Debias on, hook after the text refiner.
|
| 2 |
+
# Suggested strengths (Pika H3 Flex 6 steps, lcm, manual sigmas, cfg 1; time-curve rows with blend steps k = 6 and audio: protect): text to video 4.5 on a 0.5 s pulse at the hit; with a reference picture 6 on the pulse (a burst over the contact; 8 drew less); held constant on text to video, 3 turns the whole clip into ink.
|
| 3 |
+
# Clips at every strength we rendered: https://matlowai.github.io/ComfyUI-Dials/curves.html
|
| 4 |
+
{subject}, drawn with normal colours and soft shading. ||| {subject}, drawn as a stark black-and-white inverted impact frame with heavy ink lines.
|
example_pairs/ink_wash.txt
ADDED
|
@@ -0,0 +1,4 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Ink wash dial (h3_ink_wash_hook): A = clean cel-shaded anime colour, B = a flowing black ink-wash painting on paper. Expanded over subjects_adults_places.txt (8 subjects x 1 line = 8 pairs). Debias on, hook after the text refiner.
|
| 2 |
+
# Suggested strengths (Pika H3 Flex 6 steps, lcm, manual sigmas, cfg 1; time-curve rows with blend steps k = 6 and audio: protect): text to video only: held constant 1.5 to 2 (the recommended use); 2 on a seep-in-and-out curve at k = 6 (the scene re-composes as it washes in and out); with a reference picture it draws nothing up to 6.
|
| 3 |
+
# Clips at every strength we rendered: https://matlowai.github.io/ComfyUI-Dials/curves.html
|
| 4 |
+
{subject}, drawn in clean cel-shaded anime colours. ||| {subject}, painted as a flowing black ink-wash painting on paper.
|
example_pairs/subjects_adults_places.txt
ADDED
|
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
A young woman in a long coat on a stone rooftop
|
| 2 |
+
An old man in a grey robe in a library
|
| 3 |
+
A knight in plate armour in a castle courtyard
|
| 4 |
+
A woman in a forest clearing
|
| 5 |
+
A man in a jacket on a city street at night
|
| 6 |
+
A traveller in a cloak on a desert dune
|
| 7 |
+
A monk on a mountain temple terrace
|
| 8 |
+
A woman in an apron in a small kitchen
|