Instructions to use MAGREF-Video/MAGREF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use MAGREF-Video/MAGREF with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("MAGREF-Video/MAGREF", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Commit History
-
Add comprehensive model card for MAGREF with metadata and usage
Verified signatureThis PR significantly enhances the model card for `MAGREF: Masked Guidance for Any-Reference Video Generation with Subject Disentanglement`. Key additions include: - Metadata tags: `pipeline_tag: image-to-video`, `library_name: diffusers`, and `license: mit`. - Direct links to the paper, project page, and GitHub repository. - A detailed description of the model, including its abstract, features, and recent news, extracted from the paper and GitHub README. - A demo video from the GitHub README to showcase model capabilities. - Comprehensive installation instructions and a "Quick Start" guide for inference (single and multi-GPU), including explicit code snippets from the GitHub README. - Acknowledgements, ethics concerns, and citation information. These improvements will make the model more discoverable and easier to use for the community, providing all necessary information in one place. Please review and merge if everything looks good!8cdb3e8
-
Upload xlm-roberta-large/tokenizer_config.json with huggingface_hub
Verified signature5e519b1 -
Upload xlm-roberta-large/tokenizer.json with huggingface_hub
Verified signature17c116a -
Upload xlm-roberta-large/special_tokens_map.json with huggingface_hub
Verified signaturee040592 -
Upload xlm-roberta-large/sentencepiece.bpe.model with huggingface_hub
Verified signature50d446f -
Upload google/umt5-xxl/tokenizer_config.json with huggingface_hub
Verified signature6d70e7b -
Upload google/umt5-xxl/tokenizer.json with huggingface_hub
Verified signature250b016 -
Upload google/umt5-xxl/spiece.model with huggingface_hub
Verified signature7d1317e -
Upload google/umt5-xxl/special_tokens_map.json with huggingface_hub
Verified signature6ab5fac -
Upload models_t5_umt5-xxl-enc-bf16.pth with huggingface_hub
Verified signature9e340d6 -
Upload models_clip_open-clip-xlm-roberta-large-vit-huge-14.pth with huggingface_hub
Verified signatured6d0a47 -
Upload diffusion_pytorch_model.safetensors.index.json with huggingface_hub
Verified signature729889a -
Upload diffusion_pytorch_model-00007-of-00007.safetensors with huggingface_hub
Verified signature5ff52a7 -
Upload diffusion_pytorch_model-00006-of-00007.safetensors with huggingface_hub
Verified signature075dc46 -
Upload diffusion_pytorch_model-00005-of-00007.safetensors with huggingface_hub
Verified signaturec2721a7 -
Upload diffusion_pytorch_model-00004-of-00007.safetensors with huggingface_hub
Verified signaturec80d659 -
Upload diffusion_pytorch_model-00003-of-00007.safetensors with huggingface_hub
Verified signature4ca994c -
Upload diffusion_pytorch_model-00002-of-00007.safetensors with huggingface_hub
Verified signature2727c82 -
Upload diffusion_pytorch_model-00001-of-00007.safetensors with huggingface_hub
Verified signatured34a646 -
Upload config.json with huggingface_hub
Verified signature03d647f -
Upload Wan2.1_VAE.pth with huggingface_hub
Verified signature58bb2e9 -
initial commit
Verified signature128b5f7