-
clone the huggingface repo because in this repo have the pretrained vae weight.
git clone https://huggingface.co/ProgramerSalar/vae_model_ckptput the
duffusion_pytorch_model.safetensorsfile in thePATH/vae_ckptfolder -
clone this repo:
git clone https://github.com/ProgramerSalar/vae_fineTune.git -
install the
req.txtfilecd vae_fineTune pip install -r req.txt -
make sure mount the drive file to
colab Notebook
from google.colab import drive
drive.mount('/content/drive')
- Download the Dataset file
cd vae_fineTune/Data
hf download ProgramerSalar/clip_video clip_video_part_2.zip --repo-type dataset --local-dir .
unzip clip_video_part_2.zip
rm -rf clip_video_part_2.zip
- run the
scriptsh scripts/train_causal_video_vae.sh