Participate in Reproducible Research General Image Processing OpenCV (C/C++ code, BSD lic) Image manipulation, matrix manipulation, transforms Torch3Vision (C/C++ code, BSD lic) Basic image processing, matrix manipulation and feature extraction algorithms: rotation, flip, photometric normalisations (Histogram Equalization, Multiscale Retinex, Self-Quotient Image or Gross-Brajovic), edge detection, 2D DCT, 2D FFT, 2D Gabor, PCA to do Eigen-Faces, LDA to do Fisher-Faces. Various metrics (Euclidean, Mahanalobis, ChiSquare, NormalizeCorrelation, TangentDistance, ...) ImLab (C/C++ code, MIT lic) A Free Experimental System for Image Processing (loading, transforms, filters, histogram, morphology, ...) CIMG (C/C++ code, GPL and LGPL lic) CImg Library is an open source C++ toolkit for image processing Generic Image Library (GIL) - boost integration (C/C++ code, MIT lic) Adobe open source C++ Generic Image Library (GIL) SimpleCV a kinder, gentler machine vision library (python code, MIT lic) SimpleCV is a Python interface to several powerful open source computer vision libraries in a single convenient package PCL, The Point Cloud Library (C/C++ code, BSD lic) The Point Cloud Library (or PCL) is a large scale, open project for point cloud processing. The PCL framework contains numerous state-of-the art algorithms including filtering, feature estimation, surface reconstruction, registration, model fitting and segmentation. Population, imaging library in C++ for processing, analysing, modelling and visualising (C/C++ code, CeCill lic) Population is an open-source imaging library in C++ for processing, analysing, modelling and visualising including more than 200 algorithms designed by V. Tariel. qcv (C/C++ code, LGPL 3) A computer vision framework based on Qt and OpenCV that provides an easy to use interface to display, analyze and run computer vision algorithms. The library is provided with multiple application examples including stereo, SURF, Sobel and and Hough transform. Machine Vision Toolbox (MATLAB/C, LGPL lic) image processing, segmentation, blob/line/point features, multiview geometry, camera models, colorimetry. BoofCV (Java code, Apache lic) BoofCV is an open source Java library for real-time computer vision and robotics applications. BoofCV is organized into several packages: image processing, features, geometric vision, calibration, visualize, and IO. Simd (C++ code, MIT lic) Simd is free open source library in C++. It includes high performance image processing algorithms. The algorithms are optimized with using of SIMD CPU extensions such as SSE2, SSSE3, SSE4.2 and AVX2. Free but not open source - ArrayFire (formely LibJacket) is a matrix library for CUDA (CUDA/C++, free lic) ArrayFire offers hundreds of general matrix and image processing functions, all running on the GPU. The syntax is very Matlab-like, with the goal of offering easy porting of Matlab code to C++/ArrayFire.
Image Acquisition, Decoding & encoding FFMPEG (C/C++ code, LGPL or GPL lic) Record, convert and stream audio and video (lot of codec) OpenCV (C/C++ code, BSD lic) PNG, JPEG,... images, avi video files, USB webcam,... Torch3Vision (C/C++ code, BSD lic) Video file decoding/encoding (ffmpeg integration), image capture from a frame grabber or from USB, Sony pan/tilt/zoom camera control using VISCA interface lib VLC (C/C++ code, GPL lic) Used by VLC player: record, convert and stream audio and video Live555 (C/C++ code, LGPL lic) RTSP streams ImageMagick (C/C++ code, GPL lic) Loading & saving DPX, EXR, GIF, JPEG, JPEG-2000, PDF, PhotoCD, PNG, Postscript, SVG, TIFF, and more DevIL (C/C++ code, LGPL lic) Loading & saving various image format FreeImage (C/C++ code, GPL & FPL lic) PNG, BMP, JPEG, TIFF loading VideoMan (C/C++ code, LGPL lic) VideoMan is trying to make the image capturing process from cameras, video files or image sequences easier.
Segmentation OpenCV (C/C++ code, BSD lic) Pyramid image segmentation Branch-and-Mincut (C/C++ code, Microsoft Research Lic) Branch-and-Mincut Algorithm for Image Segmentation Efficiently solving multi-label MRFs ( Readme) (C/C++ code) Segmentation, object category labelling, stereo
Machine Learning Torch (C/C++ code, BSD lic) Gradient machines ( multi-layered perceptrons, radial basis functions, mixtures of experts, convolutional networks and even time-delay neural networks), Support vector machines, Ensemble models (bagging, adaboost), Non-parametric models (K-nearest-neighbors, Parzen regression and Parzen density estimator), distributions (Kmeans, Gaussian mixture models, hidden Markov models, input-output hidden Markov models, and Bayes classifier), speech recognition tools
Object Detection OpenCV (C/C++ code, BSD lic) Viola-jones face detection (Haar features) Torch3Vision (C/C++ code, BSD lic) MLP & cascade of Haar-like classifiers face detection Hough Forests (C/C++ code, Microsoft Research Lic) Class-Specific Hough Forests for Object Detection Efficient Subwindow Object Detection (C/C++ code, Apache Lic) Christoph Lampert "Efficient Subwindow" algorithms for Object Detection INRIA Object Detection and Localization Toolkit (C/C++ code, Custom Lic) Histograms of Oriented Gradients library for Object Detection
Re-identification Context-Aware Object Search and Retrieval (Matlab) A multi-camera object search and retrieval algorithm using matlab
Object Category Labelling Efficiently solving multi-label MRFs ( Readme) (C/C++ code) Segmentation, object category labelling, stereo Multi-label optimization (C/C++/MATLAB code) The gco-v3.0 library is for optimizing multi-label energies. It supports energies with any combination of unary, pairwise, and label cost terms.
Optical flow OpenCV (C/C++ code, BSD lic) Horn & Schunck algorithm, Lucas & Kanade algorithm, Lucas-Kanade optical flow in pyramids, block matching. GPU-KLT+FLOW (C/C++/OpenGL/Cg code, LGPL) Gain-Adaptive KLT Tracking and TV-L1 optical flow on the GPU. RLOF (C/C++/Matlab code, Custom Lic.) The RLOF library provides GPU / CPU implementation of Optical Flow and Feature Tracking method.
Features Extraction & Matching SIFT by R. Hess (C/C++ code, GPL lic) SIFT feature extraction & RANSAC matching OpenSURF (C/C++ code) SURF feature extraction algorihtm (kind of fast SIFT) ASIFT (from IPOL) (C/C++ code, Ecole Polytechnique and ENS Cachan for commercial Lic) Affine SIFT (ASIFT) VLFeat (formely Sift++) (C/C++ code) SIFT, MSER, k-means, hierarchical k-means, agglomerative information bottleneck, and quick shift SiftGPU A GPU Implementation of Scale Invariant Feature Transform (SIFT) Groupsac (C/C++ code, GPL lic) An enhance version of RANSAC that considers the correlation between data points
Nearest Neighbors matching FLANN (C/C++ code, BSD lic) Approximate Nearest Neighbors ( Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration) ANN (C/C++ code, LGPL lic) Approximate Nearest Neighbor Searching
Tracking OpenCV (C/C++ code, BSD lic) Kalman, Condensation, CAMSHIFT, Mean shift, Snakes KLT: An Implementation of the Kanade-Lucas-Tomasi Feature Tracker (C/C++ code, public domain) Kanade-Lucas-Tomasi Feature Tracker GPU_KLT (C/C++/OpenGL/Cg code, ) A GPU-based Implementation of the Kanade-Lucas-Tomasi Feature Tracker GPU-KLT+FLOW (C/C++/OpenGL/Cg code, LGPL) Gain-Adaptive KLT Tracking and TV-L1 optical flow on the GPU On-line boosting trackers (C/C++, LGPL) On-line boosting tracker, semi-supervised tracker, beyond semi-supervised tracker Single Camera background subtraction tracking (C/C++, LGPL) Background subtraction based tracking algorithm using OpenCV. Multi-camera tracking (C/C++, LGPL) Multi-camera particle filter tracking algorithm using OpenCv and intel IPP.
Simultaneous localization and mapping Real-Time SLAM - SceneLib (C/C++ code, LGPL lic) Real-time vision-based SLAM with a single camera PTAM (C/C++ code, Isis Innovation Limited lic) Parallel Tracking and Mapping for Small AR Workspaces GTSAM (C/C++ code, BSD lic) GTSAM is a library of C++ classes that implement smoothing and mapping (SAM) in robotics and vision, using factor graphs and Bayes networks as the underlying computing paradigm rather than sparse matrices
Camera Calibration & constraint OpenCV (C/C++ code, BSD lic) Chessboard calibration, calibration with rig or pattern Geometric camera constraint - Minimal Problems in Computer Vision Minimal problems in computer vision arise when computing geometrical models from image data. They often lead to solving systems of algebraic equations. Camera Calibration Toolbox for Matlab (Matlab toolbox) Camera Calibration Toolbox for Matlab by Jean-Yves Bouguet (C implementation in OpenCV)
Multi-View Reconstruction Bundle Adjustment - SBA (C/C++ code, GPL lic) A Generic Sparse Bundle Adjustment Package Based on the Levenberg-Marquardt Algorithm Bundle Adjustment - SSBA (C/C++ code, LGPL lic) Simple Sparse Bundle Adjustment (SSBA)
Stereo Efficiently solving multi-label MRFs ( Readme) (C/C++ code) Segmentation, object category labelling, stereo LIBELAS: Library for Efficient LArge-scale Stereo Matching (C/C++ code) Disparity maps, stereo
Structure from motion Bundler (C/C++ code, GPL lic) A structure-from-motion system for unordered image collections Patch-based Multi-view Stereo Software ( Windows version) (C/C++ code, GPL lic) A multi-view stereo software that takes a set of images and camera parameters, then reconstructs 3D structure of an object or a scene visible in the images libmv - work in progress (C/C++ code, MIT lic) A structure from motion library Multicore Bundle Adjustment (C/C++/GPU code, GPL3 lic) Design and implementation of new inexact Newton type Bundle Adjustment algorithms that exploit hardware parallelism for efficiently solving large scale 3D scene reconstruction problems. openMVG (C/C++/GPU code, MPL2 lic) OpenMVG (Multiple View Geometry) "open Multiple View Geometry" is a library for computer-vision scientists and especially targeted to the Multiple View Geometry community. It is desig
