openvision

README

Openvision Golang binding

vision detection/estimation/transformation based on deep learning

Prerequest

• ncnn Install
• openmp
• vulkan(optional)

Install

git clone github.com/bububa/openvision.git
cd build
cmake -DCMAKE_CXX_COMPILER=clang++ -DCMAKE_C_COMPILER=clang -DNCNN_VULKAN=ON # -DNCNN_VULKAN is optional
make -j 4
# modify go.mod replace github.com/bububa/openvision/go path

Build tags

• vulkan build with vulkan

Features & models

• face
  • aligner (for face keypoints alignment)
  • detecter (for face location and keypoints detection)
    • mtcnn Google Drive
    • centerface Google Drive
    • retainface Google Drive
    • yoloface Google Drive
    • scrfd Google Drive
    • anticonv (for mask detection) Google Drive
  • recognizer (face feature extration for classification)
    • mobilenet Google Drive
  • landmarker (for face landmarkers extraction)
    • insightface Google Drive
    • zq Google Drive
    • scrfd Google Drive
  • tracker (for face IOU calculation bettween frames)
  • hopenet (for head pose detection) Google Drive
  • hair (for hair segmentation) Google Drive
  • eye
    • lenet (eye status detector) Google Drive
• pose
  • detector (for pose detection/estimation)
    • ultralight Google Drive
    • openpose Google Drive
  • estimator (for pose estimation)
    • ultralight Google Drive
    • movenet Google Drive
  • segmentor (for pose segmentation)
    • deeplabv3plus Google Drive
    • erdnet Google Drive
    • rvm (RobustVideoMatting) Google Drive
• hand
  • detector (for hand detect)
    • yolox Google Drive
    • nanodet Google Drive
  • pose (for hand pose estimation)
    • handnet Google Drive
• styletransfer
  • animegan2 Google Drive
• tracker
  • lighttrack Google Drive
• counter
  • p2pnet Google Drive

Documentation

Overview

Package openvision libopenvision golang binding

Index

• Variables
• type Error
  • func (e Error) Error() string

Variables

var (
	LoadModelError = func(code int) Error {
		return Error{
			Code:    code,
			Message: "load model failed",
		}
	}
	DetectFaceError = func(code int) Error {
		return Error{
			Code:    code,
			Message: "detect face failed",
		}
	}
	FaceLandmarkError = func(code int) Error {
		return Error{
			Code:    code,
			Message: "face landmark failed",
		}
	}
	RecognizeFaceError = func(code int) Error {
		return Error{
			Code:    code,
			Message: "recognize face failed",
		}
	}
	AlignFaceError = func(code int) Error {
		return Error{
			Code:    code,
			Message: "align face failed",
		}
	}
	TrackFaceError = func(code int) Error {
		return Error{
			Code:    code,
			Message: "track face failed",
		}
	}
	DetectHeadPoseError = func(code int) Error {
		return Error{
			Code:    code,
			Message: "detect head pose failed",
		}
	}
	HairMattingError = func(code int) Error {
		return Error{
			Code:    code,
			Message: "hair matting failed",
		}
	}
	DetectHandError = func(code int) Error {
		return Error{
			Code:    code,
			Message: "detect hand failed",
		}
	}
	DetectPoseError = func(code int) Error {
		return Error{
			Code:    code,
			Message: "detect pose failed",
		}
	}
	TrackerError = func(code int) Error {
		return Error{
			Code:    code,
			Message: "object tracker error",
		}
	}
	CounterError = func(code int) Error {
		return Error{
			Code:    code,
			Message: "object counter error",
		}
	}
	RealsrError = func(code int) Error {
		return Error{
			Code:    code,
			Message: "super-resolution process error",
		}
	}
	TrainingError = func(code int) Error {
		return Error{
			Code:    code,
			Message: "training process failed",
		}
	}
	ClassifyError = func(code int) Error {
		return Error{
			Code:    code,
			Message: "classify process failed",
		}
	}
)

Types

type Error

type Error struct {
	// Code .
	Code int
	// Message .
	Message string
}

Error customed error

func (Error) Error

func (e Error) Error() string

Error represents error interface