Abstract

Freehand sketching is an inherently sequential process. Yet, most approaches for hand-drawn sketch recognition either ignore this sequential aspect or exploit it in an ad-hoc manner. In our work, we propose a recurrent neural network architecture for sketch object recognition which exploits the long-term sequential and structural regularities in stroke data in a scalable manner. Specifically, we introduce a Gated Recurrent Unit based framework which leverages deep sketch features and weighted per-timestep loss to achieve state-of-the-art results on a large database of freehand object sketches across a large number of object categories. The inherently online nature of our framework is especially suited for on-the-fly recognition of objects as they are being drawn. Thus, our framework can enable interesting applications such as camera-equipped robots playing the popular party game Pictionary with human players and generating sparsified yet recognizable sketches of objects.

Abstract

Traditional architectures for solving computer vision problems and the degree of success they enjoyed have been heavily reliant on hand-crafted features. However, of late, deep learning techniques have offered a compelling alternative -- that of automatically learning problem-specific features. With this new paradigm, every problem in computer vision is now being re-examined from a deep learning perspective. Therefore, it has become important to understand what kind of deep networks are suitable for a given problem. Although general surveys of this fast-moving paradigm (i.e. deep-networks) exist, a survey specific to computer vision is missing. We specifically consider one form of deep networks widely used in computer vision - convolutional neural networks (CNNs). We start with "AlexNet'' as our base CNN and then examine the broad variations proposed over time to suit different applications. We hope that our recipe-style survey will serve as a guide, particularly for novice practitioners intending to use deep-learning techniques for computer vision.

Abstract

Automated classification of glaucoma is of interest in early detection and treatment. Existing methods employ featureswhich are either image-based or derived from Optic Disc(OD) and Cup (OC) segmentation. While the latter suffers from segmentation inaccuracies, the image-based features tend to overf it in limited availability of training data. We propose a solution to overcome these issues and present a classification framework that fuses both type of features within a co-training based semi-supervised setting to over-come the paucity of labelled data. A novel set of features is proposed to represent the segmented OD-OC regions. Additionally, features based on Texture of projections and color Bag of Visual Words have been designed to be sensitive to the sector-wise deformations in OD. The proposed method was trained on 386 labelled and 717 unlabelled images. It outperformed existing methods with an accuracy and AUC of73.28%,0.79on a private test set of 696 unseen images and76.77%,0.78when cross-tested on DRISHTI-GS1 dataset

Abstract

A variety of imaging modalities have been used for developing diagnostic aids for glaucoma assessment. Structural imaging modalities such as colour fundus imaging and optical coherence tomography (OCT) have been investigated for automatically estimating key parameters for glaucoma assessment such as cup to disc diameter ratio and thickness of there tinal nerve fibre layer (RNFL). OCT-based angiography or OCTA is a new modality which provides structural and angiographic information about the retinal layers. We present a method for glaucoma detection using OCTA images. Specifically, the capillary density at various layers and thickness of RNFL are estimated and used to classify a given OCTA volume as glaucamatous or not. RNFL thickness is estimated using polynomial fitting to intensity profiles of OCT slices. The capillary density is estimated from the angio flow images using morphological processing to extract the optic nerve head(ONH) and vessel detection in a region of interest define daround the ONH. A system trained on these two features was evaluated on a dataset of 67 eyes (49 normal and 18 glaucomatous) and found to have a sensitivity of 94.44%and specificity of 91.67%. This demonstrates the potential of the new modality for glaucoma assessment.

Abstract

The variations in the intensity scale in Magnetic Resonance Images pose a problem for many tasks and Intensity Standardization (IS) aims to solve this problem. Existing methods generally use landmark values of the image histogram and match it to a standard scale. The landmarks are often chosen to be percentiles from different segmented tissues. We propose a method for IS in which tissue information (via segmentation) is needed during training but not during testing by using landmark propagation. A KL divergence-based technique is employed for identifying volumes from the training set, which are similar to a given non-standardized testing volume. The landmarks from the similar volumes are then propagated to the given test volume. Evaluation of the proposed method on 24 MRI volumes from 3 different scanners shows that the IS results are better than L4 and at par with a method which uses prior segmentation, to get percentile-based land-marks. The proposed method aids speeding up and expanding the scope of IS to volumes with no tissue information

Abstract

Cardiac motion analysis from B-mode ultrasound sequence is a key task in assessing the health of the heart. The paper proposes a new methodology for cardiac motion analysis based on the temporal behaviour of points of interest on the myocardium. We define a new signal called the Temporal Flow Graph(TFG) which depicts the movement of a point of interest over time. It is a graphical representation derived from a flow field and describes the temporal evolution of a point. We prove that TFG for an object undergoing periodic motion is also periodic. This principle can be utilized to derive both global and local information from a given sequence. We demonstrate this for detecting motion irregularities at the sequence, as well as regional levels on real and synthetic data. A coarse localisation of anatomical landmarks such as centres of left/right cavities and valve points is also demonstrated using TFGs.

Abstract

Color fundus photographs of 2252 eyes from1126 subjects were collected from 2 centers: Aravind Eye Hospital,Madurai and Coimbatore, India. The images of 1926 eyes (963 subjects) were used to train an automated image analysis-based system,which was developed to provide a decision on a given fundus image.A total of 163 subjects were clinically examined by 2 ophthalmologists independently and their diagnostic decisions were recorded. The consensus decision was defined to be the clinical reference (gold standard). Fundus images of eyes with disagreement in diagnosis were excluded from the study. The fundus images of the remaining 314eyes (157 subjects) were presented to 4 graders and their diagnostic decisions on the same were collected. The performance of the system was evaluated on the 314 images, using the reference standard. The sensitivity and specificity of the system and 4 independent graders were determined against the clinical reference standard

Abstract

Circular arc Radon (CAR) transforms associate to a function, its integrals along arcs of circles. The inversion of such transforms is of natural interest in several imaging modalities such as thermoacoustic and photoacoustic tomography, ultrasound, and intravascular imaging. Unlike the full circle counterpart—the circular Radon transform—which has attracted significant attention in recent years, the CAR transforms are scarcely studied objects.In this paper, we present an efficient algorithm for the numerical inversion of the CAR transform with fixed angular span, for the cases in which the support of the function lies entirely inside or outside the acquisition circle. The numerical algorithm is noniterative and is very efficient as the entire scheme, once processed,can be stored and used repeatedly for reconstruction of images. A modified numerical inversion algorithm is also presented to reduce the artifacts in the reconstructed image which are induced due to the limited angular span.

Abstract

3D imaging modalities are becoming increasingly popular and relevant in retinal imaging owing to their effectiveness in highlighting structures in sub-retinal layers. OCT is one such modality which has great importance in the context of analysis of cystoid structures in subretinal layers. Signal to noise ratio(SNR) of the images obtained from OCT is less and hence automated and accurate determination of cystoid structures from OCT is a challenging task. We propose an auto-mated method for detecting/segmenting cysts in 3D OCT volumes. The proposed method is biologically inspired and fast aided by the domain-knowledge about the cystoid structures. An ensemble learning method-Random forests is learnt for classification of detected region into cyst region. The method achieves detection and segmentation in a unified set-ting. We believe the proposed approach with further improvements can be a promising starting point for more robust approach. This methodis validated against the training set achieves a mean dice coefficient of0.3893 with a standard deviation of 0.2987

Abstract

Saliency computation is widely studied in computer vision but not in medical imaging. Existing computational saliency models have been developed for general (natural) images and hence may not be suitable for medical images. This is due to the variety of imaging modalities and the requirement of the models to capture not only normal but also deviations from normal anatomy. We present a biologically inspired model for colour fundus images and illustrate it for the case of diabetic retinopathy. The proposed model uses spatially-varying morphological operations to enhance lesions locally and combines an ensemble of results, of such operations, to generate the saliency map. The model is validated against an average Human Gaze map of 15 experts and found to have 10% higher recall (at 100% precision) than four leading saliency models proposed for natural images. The F-score for match with manual lesion markings by 5 experts was0.4 (as opposed to 0.532 for gaze map) for our model and very poor for existing models. The model’s utility is shown via a novel enhancement method which employs saliency to selectively enhance the abnormal regions and this was found to boost their contrast to noise ratio by∼30%