Abstract

Autism spectrum disorder (ASD) is a neurodevelopmental disorder predominantly found in children. The current behavior-based diagnosis of ASD is arduous and requires expertise. Therefore, it is appealing to develop an accurate computer-aided tool for diagnosing ASD. Although resting-state functional magnetic resonance imaging (rsfMRI) has proven to be successful in capturing the neural organization of the brain, automated detection of ASD using rsfMRI scans is a challenging task due to heterogeneity in the dataset and limited sample size. This paper proposes a Multilayer Perceptron (MLP) based classification model with auto encoder pretraining for classifying ASD from Typically Developing (TD) using rsfMRI scans obtained from the ABIDE-1 dataset. Our model achieves new state-of-the-art performance on the ABIDE-1 dataset with a 10-fold cross-validation accuracy of 74.82%. Further, we use the Integrated Gradients (IG) and DeepLIFT techniques to identify the correlations between brain regions that contribute most to the classification task. Our analysis identifies the following regions, Left Lingual Gyrus, Right Insula Lobe, Right Cuneus, Right Middle Frontal Gyrus, Left Superior Temporal Gyrus to be associated with ASD. Interestingly, these regions in the brain are primarily responsible for social cognition, language, attention, decision making and visual processing, which are known to be altered in ASD.

Abstract

An active area of research in cognitive science is characterizing the relationship between brain structure and the observed functional activations. Recent graph diffusion models have had great success in mapping whole-brain, resting-state dy- namics measured using functional Magnetic Resonance Imaging (fMRI) to the brain structure derived using diffusion and T1 brain imaging. Here we test the application of one such graph diffusion method called the Multiple Kernel Learning (MKL) model. MKL model, formulated as a reaction-diffusion system using Wilson-Cowan equations, combines multiple diffusion ker- nels at different scales to predict functional connectome (FC) arising from a fixed structural connectome (SC). Our simulation results demonstrate that the MKL model successfully mapped the relationship between SC and FC from five different Electroen- cephalogram (EEG) bands (delta, theta, alpha, beta, and gamma). We used simultaneously acquired EEG-fMRI and NODDI dataset of 17 participants. The correlation between predicted FC and ground truth FC was higher for EEG bands than for fMRI data. The prediction accuracy peaked for the alpha band, and the highest frequency band, gamma had the lowest prediction accuracy. To the best of our knowledge, this is the first such end- to-end application of multiple kernel graph diffusion framework for modeling EEG data. One of the important features of MKL model is its ability to incorporate structural connectivity features into the generative model that predicts the EEG functional connectivity.

Abstract

Over the last decade, there has been growing interest in learning the mapping from structural connectivity (SC) to functional connectivity (FC) of the brain. The spontaneous brain activity fluctuations during the resting-state as captured by func- tional MRI (rsfMRI) contain rich non-stationary dynamics over a relatively fixed structural connectome. Among the modeling approaches, graph diffusion-based methods with single and mul- tiple diffusion kernels approximating static or dynamic functional connectivity have shown promise in predicting the FC given the SC. However, these methods are computationally expensive, not scalable, and fail to capture the complex dynamics underlying the whole process. Recently, deep learning methods such as GraphHeat networks along with graph diffusion have been shown to handle complex relational structures while preserving global information. In this paper, we propose multiple GraphHeat networks (M-GHN), a novel approach for mapping SC-FC. M- GHN enables us to model multiple heat kernel diffusion over the brain graph for approximating the complex Reaction Diffusion phenomenon. We argue that the proposed deep learning method overcomes the scalability and computational inefficiency issues but can still learn the SC-FC mapping successfully. Training and testing were done using the rsfMRI data of 100 participants from the human connectome project (HCP), and the results establish the viability of the proposed model. On the HCP dataset of 100 participants, the M-GHN achieves a high Pearson correlation

Abstract

Several popular Transformer based language models have been found to be successful for text-driven brain encoding. However, existing literature leverages only pretrained text Transformer models and has not explored the efficacy of task-specific learned Transformer representations. In this work, we explore transfer learning from representations learned for ten popular natural language processing tasks (two syntactic and eight semantic) for predicting brain responses from two diverse datasets: Pereira (subjects reading sentences from paragraphs) and Narratives (subjects listening to the spoken stories). Encoding models based on task features are used to predict activity in different regions across the whole brain. Features from coreference resolution, NER, and shallow syntax parsing explain greater variance for the reading activity. On the other hand, for the listening activity, tasks such as paraphrase generation, summarization, and natural language inference show better encoding performance. Experiments across all 10 task representations provide the following cognitive insights: (i) language left hemisphere has higher predictive brain activity versus language right hemisphere, (ii) posterior medial cortex, temporoparieto-occipital junction, dorsal frontal lobe have higher correlation versus early auditory and auditory association cortex, (iii) syntactic and semantic tasks display a good predictive performance across brain region

Abstract

How the brain captures the meaning of linguistic stimuli across multiple views is still a critical open question in neuroscience. Consider three different views of the concept apartment: (1) picture (WP) presented with the target word label, (2) sentence (S) using the target word, and (3) word cloud (WC) containing the target word along with other semantically related words. Unlike previous efforts, which focus only on single view analysis, in this paper, we study the effectiveness of brain decoding in a zero-shot cross-view learning setup. Further, we propose brain decoding in the novel context of cross-view-translation tasks like image captioning (IC), image tagging (IT), keyword extraction (KE), and sentence formation (SF). Using extensive experiments, we demonstrate that cross-view zero-shot brain decoding is practical leading to ∼0.68 average pairwise accuracy across view pairs. Also, the decoded representations are sufficiently detailed to enable high accuracy for cross-view-translation tasks with following pairwise accuracy: IC (78.0), IT (83.0), KE (83.7) and SF (74.5).

Abstract

Enabling effective brain-computer interfaces requires understanding how the human brain encodes stimuli across modalities such as visual, language (or text), etc. Brain encoding aims at constructing fMRI brain activity given a stimulus. There exists a plethora of neural encoding models which study brain encoding for single mode stimuli: visual (pretrained CNNs) or text (pretrained language models). Few recent papers have also obtained separate visual and text representation models and performed late-fusion using simple heuristics. However, previous work has failed to explore: (a) the effectiveness of image Transformer models for encoding visual stimuli, and (b) co-attentive multi-modal modeling for visual and text reasoning. In this paper, we systematically explore the efficacy of image Transformers (ViT, DEiT, and BEiT) and multi-modal Transformers (VisualBERT, LXMERT, and CLIP) for brain encoding. Extensive experiments on two popular datasets, BOLD5000 and Pereira, provide the following insights. (1) To the best of our knowledge, we are the first to investigate the effectiveness of image and multi-modal Transformers for brain encoding. (2) We find that VisualBERT, a multi-modal Transformer, significantly outperforms previously proposed single-mode CNNs, image Transformers as well as other previously proposed multi-modal models, thereby establishing new state-of-theart. The supremacy of visio-linguistic models raises the question of whether the responses elicited in the visual regions are affected implicitly by linguistic processing even when passively viewing images. Future fMRI tasks can verify this computational insight in an appropriate experimental setting.

Abstract

Sepsis is a leading cause of mortality and its treatment is very expensive. Sepsis treatment is also very challenging because there is no consensus on what interventions work best and different patients respond very differently to the same treatment. Deep Reinforcement Learning methods can be used to come up with optimal policies for treatment strategies mirroring physician actions. In the healthcare scenario, the available data is mostly collected offline with no interaction with the environment, which necessitates the use of offline RL techniques. The Offline RL paradigm suffers from action distribution shifts which in turn negatively affects learning an optimal policy for the treatment. In this work, a Conservative-Q Learning (CQL) algorithm is used to mitigate this shift and its corresponding policy reaches closer to the physicians policy than conventional deep Q Learning. The policy learned could help clinicians in Intensive Care Units to make better decisions while treating septic patients and improve survival rate.

Abstract

This paper presents a bio-inspired intelligent controller to enhance the performance of a nonlinear system. The controller is designed by capturing the emotional intelligence of mammalian brain mediated by the limbic system in which certain parts are responsible for generating emotions and these can be combined together as brain affective system inspired control architecture (BASIC). This controller has been used to cope with nonlinearities present in control applications. In this paper brain inspired control architecture is proposed while incorporating the sensory cortex explicitly in the architecture and the computational equations of various modules are suitably developed. The performance of the proposed controller is analyzed on a typical nonlinear system, namely, Permanent magnet synchronous motor for speed control, harmonics in stator phase currents and ripples produced in electromagnetic torque at different operating conditions. Its performance is compared with the existing control techniques in offline simulations as well as in real-time Hardware-in-loop environment. The results establish the computational efficiency, accuracy and robustness of the proposed controller.

Abstract

The question of how the human brain represents information, and if insights from this knowledge help us in formulating better deep learning algorithms, is still open. This paper attempts to address these questions by investigating the brain responses when participants viewed images of objects belonging to a variety of categories. We adopt the representational similarity analysis (RSA) framework wherein the brain responses are projected into a representational dissimilarity (RD) space so that responses from multiple subjects can be assessed on a common basis. We performed RSA of the brain responses of 15 participants on a set of 92 images (from the Algonauts challenge data set) Cichy et al. (The Algonauts project: a platform for communication between the sciences of biological and artificial intelligence 2019 [4]). The results reveal that human brain responses exhibit appropriate qualitative similarities observed in the image space. We then evaluated various deep networks such as VGGnet, AlexNet, and Inception in Siamese configuration with RD-loss function and identified hidden layers that had maximal similarity to human RD matrices (RDM). The best layers then were subjected to further analysis by looking at the image pairs corresponding to high and

Abstract

ECG analysis comprises the following steps: preprocessing, segmentation, feature extraction, and classification of heart-beat instances to detect cardiac arrhythmias. This work focuses on the first three steps in cardiac arrhythmia analysis. Since no publicly available feature sets are available for the ECG arrhythmia detection problem, researchers have to explicitly extract the feature sets from the raw signals available in PhysioBank repository. In this work, the complete feature extraction pipeline has been developed using Matlab environment. Both the Matlab code and resulting feature sets for all records have been deposited and made publicly available in the Github repository. This is one of the major