CNNProcessor Class Reference

#include <CNNProcessor.h>

Inheritance diagram for CNNProcessor:

Collaboration diagram for CNNProcessor:

Public Member Functions
Scene	ProcessScene (Scene s)
	CNNProcessor (CNNProcessorSettings s)
cv::Mat	MakeBlob (Scene scene)
Public Member Functions inherited from SchedulableLink
void	NextScene (Scene s)
virtual Scene	ProcessScene (Scene s)=0
void	Start ()
void	Stop ()
bool	Available ()
Public Member Functions inherited from PipelineLink
void	RegisterCallback (SceneCallback *scb)
virtual void	NextScene (Scene next)=0

Protected Member Functions
void	LoadModel (std::string modelPath)
Protected Member Functions inherited from SchedulableLink
void	Enqueue (Scene s)
void	Run ()
void	NextScene (Scene scene)

Protected Attributes
CNNProcessorSettings	settings
cv::dnn::Net	net
Protected Attributes inherited from SchedulableLink
BlockingQueue< Scene >	scheduleQueue
bool	isOn = true
std::thread	scheduleWorker
Protected Attributes inherited from PipelineLink
SceneCallback *	sceneCallback = nullptr

Detailed Description

Schedulable Pipeline Link which performs network inference on each Scene, populating the results field.

Definition at line 20 of file CNNProcessor.h.

Constructor & Destructor Documentation

CNNProcessor()

CNNProcessor::CNNProcessor

(

CNNProcessorSettings

s

)

Constructor, inits settings and loads model

Parameters

s

Definition at line 15 of file CNNProcessor.cpp.

                                                 : settings(s) {
    LoadModel(settings.ModelPath);
}

Member Function Documentation

LoadModel()

void CNNProcessor::LoadModel ( std::string  modelPath )

protected

Loads neural network from location on disk

Parameters

modelPath

Definition at line 7 of file CNNProcessor.cpp.

                                               {
    net = cv::dnn::readNetFromTensorflow(modelPath);
}

MakeBlob()

cv::Mat CNNProcessor::MakeBlob

(

Scene

scene

)

Makes OpenCV image "blob" from the region of interest in the frame. Blob format is required for inference.

Parameters

scene

Returns

matrix image blob, ready for inference

Definition at line 25 of file CNNProcessor.cpp.

                                       {
    int x  = scene.regionOfInterest.UpperLeft.x; int y = scene.regionOfInterest.UpperLeft.y;
    int width = scene.regionOfInterest.LowerRight.x - x;
    int height = scene.regionOfInterest.LowerRight.y - y;
    cv::Mat roi = scene.frame(cv::Range(y, y+height), cv::Range(x, x+width));
    cv::Mat small;
    cv::resize(roi, small, cv::Size(settings.InputDim_x,settings.InputDim_y));
    cv::Mat blob;
    cv::dnn::blobFromImage(small, blob, (1.0 / 255.0));
    return blob;
}

ProcessScene()

Scene CNNProcessor::ProcessScene ( Scene  scene )

virtual

Executed network inference on given scene, populates the scene with results.

Parameters

scene

input scene

Returns

output processed scene

Implements SchedulableLink.

Definition at line 42 of file CNNProcessor.cpp.

                                           {
    if(scene.frame.empty()) return scene;
    cv::Mat blob = MakeBlob(scene);
    net.setInput(blob);
    cv::Mat prob = net.forward();
    cv::Point classIdPoint;
    double confidence;
    minMaxLoc(prob.reshape(1, 1), 0, &confidence, 0, &classIdPoint);
    int classId = classIdPoint.x;
    scene.result = SignapseUtils::getLetterFromDigit(classId);
    return scene;
}

Member Data Documentation

net

cv::dnn::Net CNNProcessor::net

protected

Definition at line 29 of file CNNProcessor.h.

settings

CNNProcessorSettings CNNProcessor::settings

protected

Definition at line 27 of file CNNProcessor.h.

---

The documentation for this class was generated from the following files:

• src/CNNProcessor.h
• src/CNNProcessor.cpp