How to synchronize animatronics with audio and video files using Bluetooth

Hi.

I’m planning to build a full size animatronic character inspired by the ones at Chuck E. Cheese back in the 80’s and 90’s but this Character will be all servos but how will I easily synchronize servos with audio and videos thru bluetooth receiver right off any bluetooth device such as iPad, iPhone, computer, FireTablet, etc.?

I figured I needed help learning how

synchronise means at very well defined points of time relative to the start of the audi-file/video-file you have to send positioning-commands

You would have to find an app that runs on all these devices.
The reason is: you will have to add all the movement-commands to the audio-file / video-file.

If your imagination was play back any audio-file / video-file and the animatronic character shall do movements in sync with the audio
just by playing back. Ask yourself: where does the positioning-information for the servos come from??

If you would like to have your animatronic flip around in a random way this will be be quite easy to do.
But movements in sync needs preparing of the audio-file with all the positioning commands

So what do you really want to do?

best regards Stefan

1 Like

Bluetooth - may - address your communications needs, but your greatest challenge is timing.

If you can get the idea working with a wired serial link, then swap in the BT link later.

What you have to explore first is a heartbeat, timing stream to communicate the ‘key frames’ or motions needed by the animatronics.

Keyframes are pre defined motion points the receiver goes to on a cue, while motions are actions which define specific motions that can be sequenced together to simulate the motions you’re looking for.

1 Like

Good

Any thoughts on the Arduino servo keyframe coding to that, even lipsync?

I was thinking of like up to 3 characters

It’s got little to do with lip sync.

You record keyframes for each motion ‘extent’ then play the timing stream that tells the receiver when to move.

The lip sync only happens once when you pre-record the timing stream at the transmitter, and replay it to the receiver when needed.

Remember no BT until you get this running !

No need for byte count until you know what and how many cues you’re dealing with.

A thought- maybe DMX would work for this.

1 Like

You have to specify if you want this animation-control for one particular audio-file
or
for any and all audio-files

As far as I understand what you want to do is:

Take ANY smartphone, tablet, amazon fire-stick
do the pairing between that smartphone, tablet etc. etc. with my arduino

Tap "play"
and the animatronic starts moving in sync to whatever audio-file was chosen.

this does NOT work!!!

Inside that standard audiostream there is no "how to move the animatronic data"

Inside that standard audiostream there is only the mp3 tag artist, album and the audio.

But there is no move animatronic data

Do you understand that?

This topic was automatically closed 180 days after the last reply. New replies are no longer allowed.