A current project is centred on investigating new kinds of camera for new kinds of imaging. Using volumetric imaging from a Kinect 3d sensor driven by openKinect wrapped in C++ openframeworks.
Currently the system creates a live 3d mesh with fore and back clipping, allowing for isolation of elements based on depth, allows painting the mesh from the inbuilt RGB camera, records and plays back painted meshes and allow 3d viewing of the mesh. the OpenCV computer vision library is partially incorporated giving simple blob and object detection.
In progress is:
- battery power modification of the Kinect to allow portability, particularly for street photography.
- Inclusion of an additional DSLR (Canon 5d mkII) above the kinect, to allow high resolution RGB frames to be painted onto the mesh.
- Addition of functionality to record both long exposure and timelapse imaging
- Improved CV functions for face detection and flow detection
- Incorporation of image recognition functions to ‘learn’ to label objects
- EXIF meta data with GPS tagging, timestamping, capture settings etc
- A/R style data overlay scraped from web sources
- wifi and radio spectrum signal data sensing
partially built out of the ofxKinect libraries from openFrameworks (http://openframeworks.cc/documentation/ofxKinect/ofxKinect/) and using the Kinect Mesh recorder demo from Pelayo Mendez
(forked source code is here https://github.com/danbz/ofxKinectMeshRecorder)
The work on DepthKit, an RGBD (RGB and Depth) video project using Kinect and linked DSLR has been useful reading, the approach is geared more toward 3d video/motion capture for immersive video experiences the work is complex and now being commercialised. However I have a fork of the original open source material here https://github.com/danbz/ofxRGBDepth.
Early Volumetric Camera recording tests with unpainted point cloud in mp4.
The parts are assembled with stainless steel nuts and bolts and have a Manfrotto style camera quickrelease mount on top for ease of use.
Underneath the unit has a standard mount to connect to tripods, gimbals and other photographic equipment.
The mount until will be extended to house the hacked Kinect battery pack, and new portable mini pc (possibly raspberry pi).
3d printed parts for volumetric camera mount with Canon EOS-M mirrorless camera for RGB image collection