Can’t pop-lock or Lindy Hop to save your life? Don’t worry — AI could soon make it look like you’re a dance superstar. UC Berkeley researchers have developed a deep learning system that translates dance moves from a source video to less-than-experienced subjects.
One algorithm creates a virtual skeleton to map poses, while two more algorithms square off against each other to both create the full picture and create a more realistic face for subjects as their virtual bodies twirl around. You do need the test subject to move around for a short while to get reference material, but the result is realistic enough to give an amateur the deftness of a ballet dancer.
There’s still work to be done before it’s truly ready. You’ll notice the occasional jittering, blurry details and even missing body pieces. The scientists sometimes needed subjects to move in specific ways to help the AI create the indented effect. Moreover, the dances you see here are relatively easy to translate given the standing position and obvious movements. It might be harder to replicate breakdancing or other routines where you might not even be right-side up, let alone standing.