Build Your Own AI Video Editor
Create your own AI-powered video editing workflow using Claude Code and five open-source tools. Learn how to install the tools, analyze editing styles, and produce professional Instagram Reels.
Before You Start
Before setting up your editor, make sure you have everything needed to complete the process.
- Install the Claude desktop application.
- Open Claude Code inside the desktop app.
- Use a Claude plan that provides Claude Code access. A paid plan may be required.
- Install Node.js version 22 or newer.
- Collect 3 to 5 reference videos with editing styles you like.
- Prepare at least one raw video for editing.
Create Your Project Folder
Start by organizing your video editing workspace. A clear folder structure makes it easier for Claude Code to locate files and save your finished videos.
Step 1: Create a folder named AI Video Editor on your computer.
Step 2: Create three subfolders inside it.
Step 3: Open the Claude desktop application.
Step 4: Start Claude Code in Local mode and select your project folder.
Raw Footage
Store all original video clips that need editing.
References
Keep examples of editing styles and visual inspiration.
Exports
Save completed videos and final deliverables.
Install the Five AI Video Tools
You will use five tools to build the editing workflow. Each tool handles a specific part of video production, including animations, transcription, downloading references, and exporting videos.
1. Remotion
Video AnimationCreate programmatic videos with React. Useful for animated captions, transitions, motion graphics, and custom video layouts.
View Remotion on GitHub ↗2. HyperFrames
HTML to VideoAn open-source framework for generating videos from HTML and web-based animation workflows.
View HyperFrames on GitHub ↗3. FFmpeg
Video ProcessingProcess audio and video, trim clips, combine tracks, convert formats, and export finished videos.
View FFmpeg on GitHub ↗4. Whisper.cpp
Speech to TextGenerate transcripts from recorded speech. The transcription output can help create synchronized subtitles and captions.
View Whisper.cpp on GitHub ↗5. yt-dlp
Reference DownloadsDownload supported online video content where you have permission and where the platform allows downloading.
View yt-dlp on GitHub ↗Prompt 1: Install and Test the Tools
Open Claude Code and paste the following prompt. Review installation commands before approving them.
I want you to act as my AI video editing setup assistant. Help me install and test these tools: 1. Remotion https://github.com/remotion-dev/remotion 2. HyperFrames https://github.com/heygen-com/hyperframes 3. FFmpeg https://github.com/FFmpeg/FFmpeg 4. Whisper.cpp https://github.com/ggml-org/whisper.cpp 5. yt-dlp https://github.com/yt-dlp/yt-dlp Before installation: - Check my operating system. - Verify that Node.js 22 or newer is installed. - Use official documentation and repositories. - Explain any commands that need elevated permissions. - Ask for approval before making system changes. - Check for compatibility or dependency issues. After installation: - Test each tool with a simple example. - Report which tools are working. - Explain any failed installation. - Do not claim a tool is ready unless it has been successfully tested. When everything works, confirm that the AI video editing environment is ready.
Teach Claude Your Editing Style
You can guide Claude Code to create videos with a consistent visual identity by giving it examples of editing styles that you like.
Select 3 to 5 reference videos with similar visual characteristics. Look for consistent typography, motion graphics, pacing, transitions, and subtitle styles.
What Should Claude Analyze?
Prompt 2: Analyze My Editing Style
Learn the editing style from these videos: [PASTE INSTAGRAM LINK 1] [PASTE INSTAGRAM LINK 2] [PASTE INSTAGRAM LINK 3] Follow these instructions: 1. Download the videos into my References folder only if access and permissions allow it. 2. If downloading is unavailable, ask me to provide reference files. 3. Study the common editing elements: - Fonts and typography - Color palette - Caption placement and styling - Scene cuts and transitions - Zoom effects - Editing speed and pacing - Motion graphics - Background music - Sound effects 4. Identify the editing patterns that appear consistently. 5. Create an original brand style guide inspired by these references. 6. Include recommendations for: - Typography - Primary and secondary colors - Subtitle animation - Transitions - Motion graphics - Video dimensions - Visual hierarchy - Pacing and sound design 7. Save the style guide in my project folder. 8. Show the complete brand sheet for my review. Do not copy any reference video frame by frame. Wait for my approval before using the style guide for future edits.
Edit Your Instagram Reel
Now that your editing tools and style guide are ready, you can start producing videos.
Step 1: Record or prepare your original video.
Step 2: Move the video into the Raw Footage folder.
Step 3: Open Claude Code inside your editing project.
Step 4: Paste the video editing prompt below.
Step 5: Review and approve the storyboard.
Step 6: Export the final video into the Exports folder.
Prompt 3: Edit My Instagram Reel
Edit my new video into a professional
Instagram Reel.
Video file:
[FILE NAME]
Location:
Raw Footage folder
Editing requirements:
1. Use my approved brand style guide.
2. Remove unnecessary silent pauses,
including pauses longer than
0.1 seconds where the cut feels
natural and does not damage speech.
3. Generate accurate subtitles.
4. Synchronize captions with the
spoken words as precisely as possible.
5. Use professional motion graphics
that support the spoken content.
6. Apply smooth transitions and
purposeful camera movements.
7. Add background music and sound
effects only when properly licensed
or provided by me.
8. Use a clean visual hierarchy.
9. Keep important subtitles and graphics
inside Instagram-safe areas.
10. Export in vertical 9:16 format,
preferably 1080 x 1920 pixels.
11. Maintain clear audio levels.
12. Avoid unnecessary visual effects
that make the video distracting.
Before rendering:
- Analyze the footage.
- Propose the editing structure.
- Show me a scene-by-scene storyboard.
- Explain the planned transitions,
subtitles, and animations.
- Ask for my approval.
After approval:
- Produce the video.
- Check subtitle timing.
- Check audio synchronization.
- Check the final output.
- Export the MP4 file into the
Exports folder.
Use H.264 video encoding and AAC audio
where supported.
Do not claim the final video is ready
until the exported file has been checked.
Refine Your Editing Results
Your first video does not have to be perfect. Claude Code can revise the animation, caption styling, pacing, and transitions based on your feedback.
Here are some examples of instructions you can use:
Tips for Better Results
- Use 3 to 5 high-quality reference videos with a similar editing style.
- Keep your source footage organized in the Raw Footage folder.
- Review the brand sheet before approving it.
- Check the storyboard before generating the final video.
- Give specific feedback instead of vague editing instructions.
- Verify subtitle accuracy and word timing.
- Use original or properly licensed music and graphics.
- Keep text readable on small mobile screens.
- Use animations that improve storytelling instead of distracting viewers.
- Watch the exported video completely before publishing.



