This post would be a continuation of my previous post on getting started with NVIDIA Jetson TK1 for machine learning and image analysis works and connecting FLIR Lepton camera to Jetson TK1.In this post, I will discuss analyzing and visualizing the thermal data which is fetched from FLIR Lepton IR camera. In my last post, about connecting lepton camera to NVIDIA Jetson board, I have concluded the discussion by providing some sample camera data frames and images generated from Lepton module.In this post, I will discuss the tools and technics which I have used for analyzing and visualizing the data.This post will mostly cover the areas of preprocessing the data before applying any statistical learning methods on the sample data.Since we need to have a good understanding of the data and its behaviors before we jump into machine learning or playing with the data.Unless we don’t have a good understanding of the data which we are dealing with in all dimensions, It would be unfair to expect something magic done by machine on behalf of us.So all this is about understanding our data.
It’s great to see that technology is improving in great pace in both areas of GPU computing and thermal imaging. By the time I have published my last post and now, NVIDIA has released its next generation Jetson development board Jetson TX2(on Tuesday, March 7, 2017)
NVIDIA Jetson TX2
and also FLIR has announced the Lepton 3.0 release(On April 12, 2017) to the OEM market. So all these improvements in thermal imaging and high-performance single board computing contribute to opening new possibilities in thermal image analysis and application of thermal image processing in machine learning.
FLIR Lepton camera
Lepton Thermal Data Capturing and Processing
As I discussed in my previous post I’m using PyLepton library to capture data frames from lepton camera.To start exploring the data captured from Lepton camera, Since at this stage, we don’t use any learning task or CPU/GPU intensive task, I wrote a data service client using python to simply transfer the lepton data frames from Jetson TK1 to the desktop computer.
Interactive 3D Plot
We can use the Matplotlib library to plot the 3D and 2D graph from the lepton data frame, But Plotly has a more interactive feature than Matplotlib when it comes to plotting 3D graphs.Below is the output from Matplotlib 2D and 3D plot, here I have used the
In this post, I simply want to discuss about the tools and techniques which we can use to see the data in different angle and get more in-depth idea of the thermal data which we getting from lepton camera, And also after looking at the data in this way, it seems that even though Lepton having very fewer pixel count(60×80) compared to sophisticated visible range cameras we have today, It have a very large pixel depth giving even slightest changes in temperature variation in its field of view.So we could use this highly detailed information to identify the objects around us.In an upcoming blog post, I will be discussing such methods of identifying heat emitting objects such as movements of humans from the data captured from lepton camera.
You can find the source codes from all the above plotting algorithms in this GitHub repo.
 : http://me.knnect.com/blog/getting-started-with-nvidia-jetson-tk1/
 : http://me.knnect.com/blog/how-to-connect-flir-lepton-module-to-nvidia-jetson-tk1/
 : http://nvidianews.nvidia.com/news/nvidia-jetson-tx2-enables-ai-at-the-edge
 : https://github.com/tmkasun/PyLepton_With_Jetson