Category: Hardware


Added REM detection and the stairway to heaven that indicates how many eye movements have been counted. The algorithm runs on the chip of the smart camera itself, independently from the phone it is connected to, but also streams the motion and eye-movement data over Bluetooth in real time.

android_rem_detection

Open in Google PlayView LSDBase Entries | View Code Changes

inspecwifi

The inspec can now be configured to connect to a WiFi network or broadcast its own access point. This allows real-time video streaming to connected mobile devices.

Also added camera settings that can be controlled via the Bluetooth connection.

Open in Google PlayView LSDBase Entries | INSPEC Source Code

InspecBluetooth

The night-vision smart-camera with the on-board rem-detection algorithm can now connect to the Lucid Scribe App via Bluetooth! I cut out a few frames as the rem-detection data lags when the image is transferred, but can make that happen in parallel as the image bytes are already sent over multiple packets, just need to sneak them in between. The camera capture is more for getting the camera positioned and focused correctly, after that it sends new images infrequently and only needs to stream the movement data and images captured when eye movement patterns are detected.

Open in Google PlayView LSDBase Entries | INSPEC Source Code

Lined up my prototype devices a la March of Progress with some old headbands for scale, as the previous photo shoot looked a bit shopped!

INSPEC_evolution

View LSDBase Entries

A wild herd of INSPECs appeared! To keep moving forward while waiting for new chips, I’ve dusted off some old chips (with only 1 MB of memory vs. 32 MB in the new chips), and hope to get some out for testing soon.

INSPEC_HERD

WILD_INSPEC

View LSDBase Entries | View code changes

Updated the firmware with the pixel diff part of the halovision algorithm running fast as lightning in C. My trusty lab partner helping with a quick calibration test.

INSPEC22

View LSDBase Entries | View code changes

Some small updates to the INSPEC design – it now has a built-in battery and a flex cable as the proximity of the LEDs was interfering with the image quality.

View LSDBase Entries

The latest version of the Halovision device; code-named INSPEC. A standalone infrared camera with a processor powerful enough to run the latest machine vision algorithms that flash LEDs when eye-movement patterns are detected after a long enough still phase. The camera case is 3D printed and installed on a flexible tripod to get a good angle. It records GIFs along with BMP stills that can be viewed the next morning via micro-USB cable.

View LSDBase Entries

I have been getting better results with a different night-vision camera with built-in infrared lights and zoom:


View LSDBase Entries

Finally have the standalone version ready for some test runs on my beautiful wife!

View LSDBase Entries