Giving people a voice through Javascript Robotics for the 2016 US Presidential Election

2 Contributions Made
1 Milestones
9 Participating Countries
This project is on ICE!
Heat this project up by pinging the project leader to make a new post and get things moving!
Anton VoltchokSoftware Engineer & Design Lead at Collaborizm
Utsav Tripathi
Mahi GoMiz
Yash Ranjan
Sponsor This Project

Project Overview:

We love javascript, robotics, and we’re huge fans of how much potential for comedy there is around the 2016 US presidential election.

This project will also be leveraged in the future to make fun of any celebrity.

We’re makers at heart, so we decided to make a web app and actual robots to poke fun at Donald Trump & Hillary Clinton (if we have time). This isn’t all just for laughs, at the end of the day, we’re hoping this acts as a reminder for people to get out there and VOTE!

A big thank you to all of you who contributed great ideas and helped us get to this current iteration of the project concept

This project represents no preference of political candidate. It just so happens Trump looks funnier than Hillary.


Where we’re at:

Picked out Tone.js for an audio interface (still have to implement in React)

Successfully implemented face-tracking Open-CV based algorithm with a face detection machine learning based classifier in React. (made it so other classifiers could easily be plugged in to detect other things besides faces, like colors, shapes, etc…)

Implemented some math for ratios being used as an interface between face-tracking coordinates stream and parts of the virtual head.

Implemented canvas render of the video with a hit box to follow a users face under the virtual head (to help tweak ratios while in development)

Finishing up implementing a direct connection with Johnny Five and Socket.io for real time data stream to the hardware.


Where we’re going:

Main issues to tackle are currently figuring out audio, finding clips, finding tools, illustrations / concept art / inspiration illustration images, web interface.

Please see next section for task details

Please reply to tasks to let me know what you want to work on. I’m making a Road Map with short task summaries and assigning people there so we have a permanent place to organize.

Technology Pillars: Web App / Robots:


Implementing a Open CV based solution with addition of machine learning classifiers into a React.js web application. The candidates faces would move / change based on the face data. I’ve managed to hack this prototype together of an orange “Trump” head, with eyes following the user around and neck turning using 3D transforms for the “neck turning”

You can find the GitHub repository here:



( or simpler abstraction over the api )

Using the face tracking data stream, depending on where a person is in the frame while looking at the camera, Trump/Hillary will scream out different bits of hilarious audio.



( Javascript Robotics )

The final step of the project is to create some type of moving robot with the web app. Some ideas are either:

  1. A mask over a lightweight frame for the head on a servo, the servo would rotate based head tracking data streaming from camera. This would be mounted on a remote controlled base with wheels/motors so Election Bots can chase people in the streets
  2. LCD touchscreen with the web app on it, a really funny big trump wig on top of it, so the screen would be all orange face. Same thing as option 1 with remote controlled wheels/motors combo.

Teammates & Contributors I’m Looking For

=> #javascript
=> #research
=> #robotics
=> #mechanicalDesign
=> #automation
=> #ai
=> -finding options for API’s
=> -finding sound clips
=> -finding tools
=> #web-development
=> #user-interface-design
=> #api-development
=> #react / #react-native

Tech Stack

#react.js (declarative & functional style user interface building)
#webrtc (browser & android camera access)
#node.js (backend server / data streaming to hardware)
#socket.io (real time data to hardware)
#johnny-five (Javascript to Firmata protocol bridge for Arduino / Pi)



This is outside the scope that’s possible before the election, however ping me if anyone is interested a project based on flying drones and helium balloons , as a possible side project.

Here’s a very basic concept, just a a piece of paper that I drew Trump on to get a feel for the bots flying, but imagine large baloons of the candidates heads in the distance, most of the time not needing battery and staying airborne for up to an hour+

Discuss Election-Bots

Start a discussion...
Chat with us!
Write something before you submit it!
Photo updated
Request Sent!
Copied to Clipboard