video-edit

Video Edit — Pro Pack on RunComfy

runcomfy.com · Wan 2.7 Edit-Video · Kling Motion-Control Pro · Lucy Edit Restyle · GitHub

Video edit, intent-routed. This skill doesn't lock you to one model — it picks the right video-edit model in the RunComfy catalog based on what the user actually wants: general restyle, motion transfer from a reference clip, or lightweight identity-stable outfit / background swap.

npx skills add agentspace-so/runcomfy-skills --skill video-edit -g

Pick the right model for the user's intent

| User intent | Model | Why | |---|---|---| | Restyle a talking-head video — preserve face / pose / lip movement | Wan 2.7 Edit-Video | Strong identity + motion preservation; supports up to 1080p | | Swap product background, keep camera motion | Wan 2.7 Edit-Video | Camera motion preserved; one-direction edit honored | | Replace packaging design using a reference image | Wan 2.7 Edit-Video + reference_image | Reference-conditioned design transfer | | Apply cinematic color grade / commercial polish | Wan 2.7 Edit-Video | Good at single-direction global look changes | | Transfer precise motion from a reference video to a target character | Kling 2.6 Pro Motion Control | Designed for motion mapping with identity hold | | Lip-sync motion of a target character to source video's lip movement | Kling 2.6 Pro Motion Control | Built for tight temporal coherence | | Lightweight outfit / costume swap with identity preservation | Lucy Edit Restyle | Core strength is localized identity-stable edits | | Identity-stable restyle ("astronaut in desert", "warm golden-hour lighting") | Lucy Edit Restyle | Specializes in temporal consistency for restyle | | Default if unspecified | Wan 2.7 Edit-Video | Most versatile, highest resolution |

The agent reads this table, classifies the user's intent, and picks the matching subsection below.

Prerequisites

1. RunComfy CLI — npm i -g @runcomfy/cli
2. RunComfy account — runcomfy login.
3. CI / containers — set RUNCOMFY_TOKEN=<token>.
4. A source video URL — formats and limits depend on the chosen route.

Route 1: Wan 2.7 Edit-Video — default for restyle / background / packaging

Model: wan-ai/wan-2-7/edit-video

Schema

| Field | Type | Required | Default | Notes | |---|---|---|---|---| | prompt | string | yes | — | Lead with preservation. One edit direction per call. | | video | string | yes | — | MP4/MOV URL, 2–10s, ≤100MB. | | reference_image | string | no | — | URL — use for direct design / appearance transfer only. | | resolution | enum | no | (input) | 720p or 1080p. | | aspect_ratio | enum | no | (input) | W:H. Defaults to input. | | duration | int | no | 0 | 0 = match input; 2–10 = truncate from start. | | audio_setting | enum | no | auto | auto or origin (preserve source audio). | | seed | int | no | — | Reproducibility. |

Invoke

Background swap, identity preserved, audio kept:

runcomfy run wan-ai/wan-2-7/edit-video \
  --input '{
    "prompt": "Preserve the speaker'\''s face, pose, and lip movement; change the background to a modern office with neutral lighting.",
    "video": "https://.../speaker.mp4",
    "audio_setting": "origin"
  }' \
  --output-dir <absolute/path>

Packaging swap with reference image:

runcomfy run wan-ai/wan-2-7/edit-video \
  --input '{
    "prompt": "Maintain the original framing and hand movement; replace the packaging design using the reference image.",
    "video": "https://.../hand-holding-package.mp4",
    "reference_image": "https://.../new-packaging.png",
    "audio_setting": "origin"
  }' \
  --output-dir <absolute/path>

Prompting tips

• Preservation goals first: "Preserve [face / pose / motion / framing / lip movement]; [then state the change]".
• One edit direction per call. Compound edits drift on motion.
• reference_image only when justified (packaging swap, costume swap with target visual). Don't pass refs for general restyle.
• audio_setting: "origin" for talking-head where you don't want soundtrack regenerated.
• Source video constraints: 2–10s, ≤100MB.

Route 2: Kling 2.6 Pro Motion Control — when motion FROM a reference clip is the point

Model: kling/kling-2-6/motion-control-pro

Use when the user wants to transfer the motion of a reference video onto a target character (driven by an image OR another video). This isn't restyle — it's motion mapping with identity hold.

Schema

| Field | Type | Required | Notes | |---|---|---|---| | prompt | string | yes | Describe target motion / style. | | image | string | yes (image orientation) | Reference for character / background consistency. | | video | string | yes | Motion reference. 10–30s depending on orientation. | | keep_original_sound | bool | no | Preserve audio from reference video. | | character_orientation | enum | yes | image (max 10s output) or video (max 30s output). |

Invoke

runcomfy run kling/kling-2-6/motion-control-pro \
  --input '{
    "prompt": "A young american woman dancing",
    "image": "https://.../target-character.jpg",
    "video": "https://.../motion-reference-dance.mp4",
    "character_orientation": "image",
    "keep_original_sound": true
  }' \
  --output-dir <absolute/path>

Prompting tips

• Subject must be > 5% of frame in the image reference for clean identity hold.
• Spatial constraints help: "character on left side, background motion right".
• Simplify if results drift between iterations — drop adjectives, keep core motion description.
• character_orientation: "image" caps output at 10s; "video" allows 30s.

Route 3: Lucy Edit Restyle — lightweight identity-stable restyle / outfit swap

Model: decart/lucy-edit/restyle

Use when the edit is localized style modification — outfit swap, scene relight, atmospheric restyle — and identity preservation is critical. Lighter-weight than Wan 2.7 Edit; capped at 720p.

Schema

| Field | Type | Required | Default | Notes | |---|---|---|---|---| | prompt | string | yes | — | Natural-language edit instruction. | | video_url | string | yes | — | MP4/MOV/WEBM/GIF. | | resolution | enum | no | 720p | 720p only on this tier. |

Invoke

Outfit swap:

runcomfy run decart/lucy-edit/restyle \
  --input '{
    "prompt": "Change outfit to professional business attire; preserve face and motion.",
    "video_url": "https://.../subject-walking.mp4"
  }' \
  --output-dir <absolute/path>

Atmospheric restyle:

runcomfy run decart/lucy-edit/restyle \
  --input '{
    "prompt": "Make lighting warm and golden hour; preserve face, pose, and motion.",
    "video_url": "https://.../subject-portrait.mp4"
  }' \
  --output-dir <absolute/path>

Prompting tips

• Localized change phrasing wins. "Outfit", "lighting", "background" — pick one bucket.
• Preserve identity goals — "preserve face and motion" is enough; don't over-specify.
• Avoid total replacement ("astronaut in space" works; "swap subject for a different person" doesn't). Lucy is built for localized style mods, not full character swap.
• No aspect ratio control — output matches input. Cropping happens server-side if you don't pre-match.

Limitations

• Each route inherits its model's limits. Wan 2.7 Edit: 2–10s, 1080p ceiling. Kling: 10s (image orientation) or 30s (video orientation). Lucy: 720p ceiling, no aspect control.
• No multi-route blending. This skill picks one model per call.
• Brand-specific overrides — if the user named a specific model, route to the corresponding brand skill (wan-2-7) for fuller treatment.

Exit codes

| code | meaning | |---|---| | 0 | success | | 64 | bad CLI args | | 65 | bad input JSON / schema mismatch | | 69 | upstream 5xx | | 75 | retryable: timeout / 429 | | 77 | not signed in or token rejected |

Full reference: docs.runcomfy.com/cli/troubleshooting.

How it works

The skill picks one of Wan 2.7 Edit-Video / Kling 2.6 Pro Motion Control / Lucy Edit Restyle based on user intent and invokes runcomfy run <model_id> with the matching JSON body. The CLI POSTs to the Model API, polls the request, fetches the result, and downloads any .runcomfy.net/.runcomfy.com URL into --output-dir. Ctrl-C cancels the remote request before exit.

Security & Privacy

• Token storage: runcomfy login writes the API token to ~/.config/runcomfy/token.json with mode 0600 (owner-only read/write). Set RUNCOMFY_TOKEN env var to bypass the file entirely in CI / containers.
• Input boundary: the user prompt is passed as a JSON string to the CLI via --input. The CLI does NOT shell-expand the prompt; it transmits the JSON body directly to the Model API over HTTPS. No shell injection surface from prompt content.
• Third-party content: image / mask / video URLs you pass are fetched by the RunComfy model server, not by the CLI on your machine. Treat external URLs as untrusted; image-based prompt injection is a known risk for any image-edit / video-edit model.
• Outbound endpoints: only model-api.runcomfy.net (request submission) and *.runcomfy.net / *.runcomfy.com (download whitelist for generated outputs). No telemetry, no callbacks.
• Generated-file size cap: the CLI aborts any single download > 2 GiB to prevent disk-fill from a malicious or runaway model output.