Video Reference / IC-LoRA-Union-Control

#23
by Jadawin84 - opened

First of all, thank you for all the work on the workflows, I already used the LTX2 versions, which worked outstanding.

Are there any plans for integration of the IC-LoRA-Union-Control Lora?
Or is that not possible for the workflows based on the LTX 2.3 Kijai's models?

Its possible ;-) No limitation due to running Kijai's models. The end result is the same, its the same LTX-2.3 ;-)
And yes, have IC-Lora on the list of coming ones ;-)
hopefully soon

I tried it yesterday, using the official LTX-2.3_ICLoRA_Union_Control_Distilled.json, replacing with the Kijai's LTX-2.3-22B-distilled_transformer_only_fp8_scaled and other models and loader nodes, but unfortunately RAM 48GB + RTX 5070 12GB didn't run up, it crashed, so I can't see the result.

yes the extra weight of the control video input can be quite a lot on the pc.
They do have the option to run the control input half and third size to help a bit. I think the default is half size.
You can try render shorter videos if you ran out of memory, but yes, it is a bit heavy on the computer.

I tried the official workflow again today, the input video was resized to 854*480 10s, it was still OOM, stopped at the DepthCrafter node.
Looking forward to runexx's magic workflow 😀

Nice to hear! I´m trying to modify the workflow for Fist and last frames adding the IC lora union (depth video), but without sucess :( you have some idea? itsispossible?

Sign up or log in to comment