Back to browse

Hey Aio – Video Editing Assistant You Can Talk To

by misellu·Apr 2, 2026·4 points·0 comments

AI Analysis

●●SolidShip ItBig Brain

On-device multimodal embedding retrieval for video clips when Descript and Runway require uploads.

Strengths
  • On-device embedding and retrieval preserves privacy and avoids GPU-heavy cloud processing
  • Compositional models balance semantic alignment, diversity, and temporal structure for clip selection
  • Talk-to interface reduces friction compared to timeline-based video editors
Weaknesses
  • AI video editing space well-funded with Descript, Runway, and CapCut already established
  • Limited details on output quality and editing control compared to professional tools
Category
Target Audience

Content creators and marketers wanting quick automated video production

Similar To

Descript · Runway · CapCut

Post Description

We’re building Hey Aio, an AI assistant that takes footage from your camera roll and turns it into a voiceover or music video in a few minutes, just by talking.

Under the hood, the system combines LLMs for script and lyric writing, custom on-device multimodal embedding models for retrieving candidate clips, and compositional models that select and arrange clips to illustrate the narrative. This involves balancing local and global factors like semantic alignment, diversity, and temporal structure.

We also run embedding and retrieval on-device, so there’s no need to upload your footage, reducing friction, preserving privacy, and avoiding GPU-heavy processing.

Demo for making a voiceover video https://www.youtube.com/shorts/KFobJ_3az9E

Demo for making a music video https://www.youtube.com/shorts/uakZG3rcP_M

We’ve been using it across a range of professional and personal use cases, from realtor home tours and product demos to family videos and storytelling. https://www.heyaio.com/examples

If you’re interested, you can try Hey Aio here (iOS, free): https://apps.apple.com/us/app/hey-aio/id6739266610

We’d love to hear what you think!

Similar Projects