Artificial intelligence Stable Diffusion

My ComfyUI, AnimateDiff, ControlNets Workflow

Note: Draft, not sure when I’ll come back to continue this.

Goal

To create a tutorial for myself so I can come back to.

I have a passion for dancing and I’d want to make AI instagram video of myself dancing.

Preprocessing video

Softwares Needed

  1. Handbrake
  2. DaVinci Resolve

Steps

Credit: ComfyUI + AnimateDiff + ControlNets Workflow by House of Dim

  1. Get a Video you want to AI
  2. If it’s Iphone you need 1. Qubii; to back up into sd 2. a SD card reader to read from laptop.
  3. Get HandBrake; use this to convert your iphone video to mp4, so DaVinci Resolve can actually read the codec. Window cannot read Apple’s MOV video.
  4. Get DaVinci Resolve (free)
  5. In DaVinci Resolve go to Project Settings menu (File -> Project Settings). From here make sure the resolution is 1080 x 1920 HD (for instagram reel). Make sure to check the checkbox for ‘Use vertical resolution’ for portrait mode. Make sure the ‘Playback frame rate’ option is at ‘24’ frames per second.
  6. Go to the ‘Edit’ tab. The tab menu are at the bottom.
  7. From here locate the ‘Master’ panel. Right click on the ‘Master’ panel to get a drop down menu. Select the option ‘Import Media…’ from the right click drop down menu. Select the video you want to AI Drag and drop this video into the timeline panel

To trim the video: On the timeline panel left side move the verticle red line forward to where you want your video to start. Then to trim the left side you do shortcut key ‘Ctrl + Shift + [’ For the right side, ending trim, same thing but the short cut key is ‘Ctrl + Shift + ]’ 9. top right panel ‘inspector’ 10. bottom tab deliver set format to ‘JPEG’

© 2009 - 2025 Anthony Quoc Anh Doan - Ramblings of a Happy Scientist

Desiderata by Max Ehrmann

Go placidly amid the noise and the haste, and remember what peace there may be in silence. As far as possible without surrender be on good terms with all persons. Speak your truth quietly and clearly; and listen to others, even to the dull and the ignorant, they too have their story. Avoid loud and aggressive persons, they are vexations to the spirit.

If you compare yourself with others, you may become vain or bitter; for always there will be greater and lesser persons than yourself. Enjoy your achievements as well as your plans. Keep interested in your own career, however humble; it is a real possession in the changing fortunes of time.

Exercise caution in your business affairs, for the world is full of trickery. But let not this blind you to what virtue there is; many persons strive for high ideals, and everywhere life is full of heroism. Be yourself. Especially do not feign affection. Neither be cynical about love; for in the face of all aridity and disenchantment it is as perennial as the grass. Take kindly the counsel of the years, gracefully surrendering the things of youth.

Nurture strength of spirit to shield you in sudden misfortune. But do not distress yourself with dark imaginings. Many fears are born of fatigue and loneliness. Beyond a wholesome discipline, be gentle with yourself. You are a child of the universe, no less than the trees and the stars; you have a right to be here. And whether or not it is clear to you, no doubt the universe is unfolding as it should.

Therefore, be at peace with God, whatever you conceive Him to be. And whatever your labors and aspirations in the noisy confusion of life, keep peace in your soul. With all its sham, drudgery and broken dreams; it is still a beautiful world. Be cheerful.

Strive to be happy.

Built with Hugo
Theme Stack designed by Jimmy