pvl

README

Using the Intel Photography Vision Library

The Intel Photography Vision Library (PVL) is a set of extensions to OpenCV that is installed with the Intel CV SDK. It uses computer vision and imaging algorithms developed at Intel.

GoCV support for the PVL can be found here in the "gocv.io/x/gocv/pvl" package.

How to use

package main

import (
	"fmt"
	"image/color"

	"gocv.io/x/gocv"
	"gocv.io/x/gocv/pvl"
)

func main() {
	deviceID := 0

	// open webcam
	webcam, err := gocv.VideoCaptureDevice(int(deviceID))
	if err != nil {
		fmt.Printf("error opening video capture device: %v\n", deviceID)
		return
	}	
	defer webcam.Close()

	// open display window
	window := gocv.NewWindow("PVL")

	// prepare input image matrix
	img := gocv.NewMat()
	defer img.Close()

	// prepare grayscale image matrix
	imgGray := gocv.NewMat()
	defer imgGray.Close()
	
	// color to draw the rect for detected faces
	blue := color.RGBA(0, 0, 255, 0)

	// load PVL FaceDetector to recognize faces
	fd := pvl.NewFaceDetector()
	defer fd.Close()

	// enable tracking mode for more efficient tracking of video source
	fd.SetTrackingModeEnabled(true)

	fmt.Printf("start reading camera device: %v\n", deviceID)
	for {
		if ok := webcam.Read(img); !ok {
			fmt.Printf("cannot read device %d\n", deviceID)
			return
		}
		if img.Empty() {
			continue
		}

		// convert image to grayscale for detection
		gocv.CvtColor(img, imgGray, gocv.ColorBGR2GRAY);
	
		// detect faces
		faces := fd.DetectFaceRect(imgGray)
		fmt.Printf("found %d faces\n", len(faces))

		// draw a rectangle around each face on the original image
		for _, face := range faces {
			gocv.Rectangle(img, face.Rectangle(), blue, 3)
		}

		// show the image in the window, and wait 1 millisecond
		window.IMShow(img)
		gocv.WaitKey(1)
	}
}

Some PVL examples are in the cmd/pvl directory of this repo, in the form of some useful commands such as the smile detector.

How to install the Intel CV SDK

You can download the Intel CV SDK from here:

https://software.intel.com/en-us/computer-vision-sdk

How to build/run code

Setup main Intel SDK env:

source /opt/intel/computer_vision_sdk_2017.0.113/bin/setupvars.sh

Then set the needed other exports:

export CGO_CPPFLAGS="-I${INTEL_CVSDK_DIR}/opencv/include" CGO_LDFLAGS="-L${INTEL_CVSDK_DIR}/opencv/lib -lopencv_core -lopencv_videoio -lopencv_imgproc -lopencv_highgui -lopencv_pvl -lopencv_imgcodecs -lopencv_objdetect -lopencv_calib3d -lopencv_video"

Run the version command example to make sure you are compiling/linking against the Intel CV SDK:

$ go run ./cmd/showinfo/main.go 
go-gocv version: 0.2.0
opencv lib version: 3.3.0-cvsdk.604

Documentation

Overview

Package pvl is the GoCV wrapper around the Intel Computer Vision (CV) SDK's Photography Vision Library (PVL).

For further details, please see: https://software.intel.com/en-us/cvsdk-devguide-advanced-face-capabilities-in-intels-opencv

Index

• type Face
  • func NewFace() Face
  • func (f *Face) Close() error
  • func (f *Face) IsLeftEyeClosed() bool
  • func (f *Face) IsRightEyeClosed() bool
  • func (f *Face) IsSmiling() bool
  • func (f *Face) LeftEyePosition() image.Point
  • func (f *Face) MouthPosition() image.Point
  • func (f *Face) Ptr() C.Face
  • func (f *Face) RIPAngle() int
  • func (f *Face) ROPAngle() int
  • func (f *Face) Rectangle() image.Rectangle
  • func (f *Face) RightEyePosition() image.Point
• type FaceDetector
  • func NewFaceDetector() FaceDetector
  • func (f *FaceDetector) Close() error
  • func (f *FaceDetector) DetectBlink(img gocv.Mat, face Face)
  • func (f *FaceDetector) DetectEye(img gocv.Mat, face Face)
  • func (f *FaceDetector) DetectFaceRect(img gocv.Mat) []Face
  • func (f *FaceDetector) DetectMouth(img gocv.Mat, face Face)
  • func (f *FaceDetector) DetectSmile(img gocv.Mat, face Face)
  • func (f *FaceDetector) SetTrackingModeEnabled(enabled bool)

Types

type Face

type Face struct {
	// contains filtered or unexported fields
}

Face is a wrapper around cv::pvl::Face.

func NewFace

func NewFace() Face

NewFace returns a new PVL Face.

func (*Face) Close

func (f *Face) Close() error

Close Face.

func (*Face) IsLeftEyeClosed

func (f *Face) IsLeftEyeClosed() bool

IsLeftEyeClosed checks if the right sys is closed or not.

func (*Face) IsRightEyeClosed

func (f *Face) IsRightEyeClosed() bool

IsRightEyeClosed checks if the right sys is closed or not.

func (*Face) IsSmiling

func (f *Face) IsSmiling() bool

IsSmiling Face? :) You must call FaceDetector's DetectEye() and DetectSmile() with this Face first, or this function will throw an exception.

func (*Face) LeftEyePosition

func (f *Face) LeftEyePosition() image.Point

LeftEyePosition of Face.

func (*Face) MouthPosition

func (f *Face) MouthPosition() image.Point

MouthPosition of Face.

func (*Face) Ptr

func (f *Face) Ptr() C.Face

Ptr returns the Face's underlying object pointer.

func (*Face) RIPAngle

func (f *Face) RIPAngle() int

RIPAngle of Face.

func (*Face) ROPAngle

func (f *Face) ROPAngle() int

ROPAngle of Face.

func (*Face) Rectangle

func (f *Face) Rectangle() image.Rectangle

Rectangle returns the image.Rectangle for this Face.

func (*Face) RightEyePosition

func (f *Face) RightEyePosition() image.Point

RightEyePosition of Face.

type FaceDetector

type FaceDetector struct {
	// contains filtered or unexported fields
}

FaceDetector is a wrapper around the cv::pvl::FaceDetector.

func NewFaceDetector

func NewFaceDetector() FaceDetector

NewFaceDetector returns a new PVL FaceDetector.

func (*FaceDetector) Close

func (f *FaceDetector) Close() error

Close FaceDetector.

func (*FaceDetector) DetectBlink

func (f *FaceDetector) DetectBlink(img gocv.Mat, face Face)

DetectBlink uses PVL FaceDetector to detect blink on a Face.

func (*FaceDetector) DetectEye

func (f *FaceDetector) DetectEye(img gocv.Mat, face Face)

DetectEye uses PVL FaceDetector to detect eyes on a Face.

func (*FaceDetector) DetectFaceRect

func (f *FaceDetector) DetectFaceRect(img gocv.Mat) []Face

DetectFaceRect tries to detect Faces from the image Mat passed in as the param. The Mat must be a grayed image that has only one channel and 8-bit depth.

func (*FaceDetector) DetectMouth

func (f *FaceDetector) DetectMouth(img gocv.Mat, face Face)

DetectMouth uses PVL FaceDetector to detect mouth on a Face.

func (*FaceDetector) DetectSmile

func (f *FaceDetector) DetectSmile(img gocv.Mat, face Face)

DetectSmile uses PVL FaceDetector to detect smile on a Face.

func (*FaceDetector) SetTrackingModeEnabled

func (f *FaceDetector) SetTrackingModeEnabled(enabled bool)

SetTrackingModeEnabled sets if the PVL FaceDetector tracking mode is enabled.