Abstract

Cocaine use disorder (CUD) is described as a compulsive urge to seek and consume cocaine despite the inimical consequences. MRI studies from different modalities have shown that CUD patients exhibit structural and/or functional connectivity pathology among several brain regions. Nevertheless, both connectivities are commonly studied and analyzed separately, which may potentially obscure its relationship between them, and with the clinical pathology. Here, we compare and contrast structural and functional brain networks in CUD patients and healthy controls (HC) using multimodal fusion. The sample consisted of 63 (8 females) CUD patients and 42 (9 females) healthy controls (HC), recruited as part of the SUDMEX CONN database. For this, we computed a battery of graph-based measures from multi-shell diffusion-weighted imaging and resting state fc-fMRI to quantify local and global connectivity. Then we used multimodal canonical component analysis plus joint independent component analysis (mCCA+jICA) to compare between techniques, and evaluate group differences and its association with clinical alteration. Unimodal results showed a striatal decrease in the participation coefficient, but applied supervised data fusion revealed other regions with cocaine-related alterations in joint functional communication. When performing multimodal fusion analysis, we observed a higher centrality of the interrelationship and a lower participation coefficient in patients with CUD. In contrast to the unimodal approach, the multimodal fusion method was able to reveal latent information about brain regions involved in impairment due to cocaine abuse. The present results could help in understanding the pathology of CUD in order to develop better pre-treatment/post-treatment intervention designs. Keywords: Cocaine use disorder; Imaging; Graph theory; sMRI; fMRI; Multimodal fusion; mCCA + jICA

Abstract

Emotion recognition from a given music track has heavily relied on acoustic features, social tags, and metadata but is seldom focused on lyrics. There are no datasets of Indian language songs that contain both valence and arousal manual ratings of lyrics. We present a new manually annotated dataset of Telugu songs' lyrics collected from Spotify with valence and arousal annotated on a discrete scale. A fairly high inter-annotator agreement was observed for both valence and arousal. Subsequently, we create two music emotion recognition models by using two classification techniques to identify valence, arousal and respective emotion quadrant from lyrics. Support vector machine (SVM) with term frequency-inverse document frequency (TF-IDF) features and fine-tuning the pre-trained XLMRoBERTa (XLM-R) model were used for valence, arousal and quadrant classification tasks. Fine-tuned XLMRoBERTa performs better than the SVM by improving macro-averaged F1-scores of 54.69%, 67.61%, 34.13% to 77.90%, 80.71% and 58.33% for valence, arousal and quadrant classifications, respectively, on 10-fold cross-validation. In addition, we compare our lyrics annotations with Spotify's annotations of valence and energy (same as arousal), which are based on entire music tracks. The implications of our findings are discussed. Finally, we make the dataset publicly available with lyrics, annotations and Spotify IDs.

Abstract

Music sharing trends have been shown to change during times of socio-economic crises. Studies have also shown that music can act as a social surrogate, helping to significantly reduce loneliness by acting as an empathetic friend. We explored these phenomena through a novel study of online music sharing during the Covid-19 pandemic in India. We collected tweets from the popular social media platform Twitter during India’s first and second wave of the pandemic (n = 1,364). We examined the different ways in which music was able to accomplish the role of a social surrogate via analyzing tweet text using Natural Language Processing techniques. Additionally, we analyzed the emotional connotations of the music shared through the acoustic features and lyrical content and compared the results between pandemic and pre-pandemic times. It was observed that the role of music shifted to a more community focused function rather than tending to a more self-serving utility. Results demonstrated that people shared music during the Covid-19 pandemic which had lower valence and shared songs with topics that reflected turbulent times such as Hardship and Exclusion when compared to songs shared during pre-Covid times. The results are further discussed in the context of individualistic versus collectivistic cultures.

Abstract

It is our pleasure to welcome you to the 8th Annual Conference on Cognitive Science (ACCS8) held online and organized by the Amrita Mind Brain Center, Amrita Vishwa Vidyapeetham (Amrita University), Kerala India from January 20-22, 2022. Cognitive Science is an interdisciplinary domain that challenges researchers and scientists to examine cognitive processes and understand how the mind works, functions, and behaves. Given the interdisciplinary nature of cognitive science, The Government of India and the Department of Science and Technology had formed the Association for Cognitive Science (ACS) in 2013. In the last seven years, the ACS has been organizing an Annual Conference of Cognitive Science (ACCS) at some of the top universities in India including IIT Kanpur, IIT Gandhinagar, IIT Guwahati, IISc Bangalore, BITS Pilani Goa and University of Hyderabad. In the 2022 event organized by Amrita Vishwa Vidyapeetham, ACCS8 had 700 participants of which several of them were researchers or PhD students. The 30 oral and 61 poster presentations allowed 3 tracks of talks and 3 tracks of poster jam sessions. 2022’s ACCS has been graced by a wonderful array of 6 keynote speakers from various regions across the world. Prof. Nandini Chatterjee Singh from UNESCO MGIEP (India) talked on Game-based courses for learning – results of an online digital game-based course to build social and emotional skills in adolescents. Prof. Claudia Gandini Wheeler-Kingshott of University College London (UK) addressed on Principles of quantitative magnetic resonance imaging and relevance to clinical applications. Prof. Kenji Doya of Okinawa Institute of Science and Technology (Japan) spoke on Neural Circuits for Mental Simulation. Prof. Egidio D’Angelo of University Pavia (Italy) addressed Bottom-up and top-down strategies for multiscale brain modelling. Prof. Ned Block of New York University (USA) spoke on an empirical argument that perception is non-conceptual. Prof. Bhavani Rao R of Amrita University (India) addressed on “Humane” Computer Interaction – The role of HCI in facilitating social and vocational empowerment.

Abstract

Functional connectivity derived from functional MRI reflects the neuronal synchronization between brain regions anchored through an anatomical infrastructure of white matter pathways that can be computed from diffusion MRI. The inter-relation between the structure-function topography is of high interest in

Abstract

Predicting Individual Differences from Brain Responses to Music using Functional Network Centrality

Abstract

Music sharing trends have been shown to change during times of socio-economic crises. Studies have also shown that music can act as a social surrogate, helping to significantly reduce loneliness by acting as an empathetic friend. We explored these phenomena through a novel study of online music sharing during the Covid-19 pandemic in India. We collected tweets from the popular social media platform Twitter during India’s first and second wave of the pandemic (n = 1,364). We examined the different ways in which music was able to accomplish the role of a social surrogate via analyzing tweet text using Natural Language Processing techniques. Additionally, we analyzed the emotional connotations of the music shared through the acoustic features and lyrical content and compared the results between pandemic and pre-pandemic times. It was observed that the role of music shifted to a more community focused function rather than tending to a more self-serving utility. Results demonstrated that people shared music during the Covid-19 pandemic which had lower valence and shared songs with topics that reflected turbulent times such as Hardship and Exclusion when compared to songs shared during pre-Covid times. The results are further discussed in the context of individualistic versus collectivistic cultures.

Abstract

Reading, much like music listening, is an immersive experience that transports readers while taking them on an emotional journey. Listening to complementary music has the potential to amplify the reading experience, especially when the music is stylistically cohesive and emotionally relevant. In this paper, we propose the first fully automatic method to build a dense soundtrack for books, which can play high-quality instrumental music for the entirety of the reading duration. Our work employs a unique text processing and music weaving pipeline that determines the context and emotional composition of scenes in a chapter. This allows our method to identify and play relevant excerpts from the soundtrack of the book’s movie adaptation. By relying on the movie composer’s craftsmanship, our book soundtracks include expert-made motifs and other scene-specific musical characteristics. We validate the design decisions of our approach through a perceptual study. Our readers note that the book soundtrack greatly enhanced their reading experience, due to high immersiveness granted via uninterrupted and style-consistent music, and a heightened emotional state attained via high precision emotion and scene context recognition.

Abstract

Movement is a universal response to music, with dance often taking place in social settings. Although previous work has suggested that socially relevant information, such as personality and gender, are encoded in dance movement, the generalizability of previous work is limited. The current study aims to decode dancers’ gender, personality traits, and music preference from music‑induced movements. We propose a method that predicts such individual difference from free dance movements, and demonstrate the robustness of the proposed method by using two data sets collected using different musical stimuli. In addition, we introduce a novel measure to explore the relative importance of different joints in predicting individual differences. Results demonstrated near perfect classification of gender, and notably high prediction of personality and music preferences. Furthermore, learned models demonstrated generalizability across datasets highlighting the importance of certain joints in intrinsic movement patterns specific to individual differences. Results further support theories of embodied music cognition and the role of bodily movement in musical experiences by demonstrating the influence of gender, personality, and music preferences on embodied responses to heard music.

Abstract

The experience often described as feeling moved, understood chiefly as a social-relational emotion with social bonding functions, has gained significant research interest in recent years. Although listening to music often evokes what people describe as feeling moved, very little is known about the appraisals or musical features contributing to the experience. In the present study, we investigated experiences of feeling moved in response to music using a continuous rating paradigm. A total of 415 US participants completed an online experiment where they listened to seven moving musical excerpts and rated their experience while listening. Each excerpt was randomly coupled with one of seven rating scales (perceived sadness, perceived joy, feeling moved or touched, sense of connection, perceived beauty, warmth [in the chest], or chills) for each participant. The results revealed that musically evoked experiences of feeling moved are associated with a similar pattern of appraisals, physiological sensations, and trait correlations as feeling moved by videos depicting social scenarios (found in previous studies). Feeling moved or touched by both sadly and joyfully moving music was associated with experiencing a sense of connection and perceiving joy in the music, while perceived sadness was associated with feeling moved or touched only in the case of sadly moving music. Acoustic features related to arousal contributed to feeling moved only in the case of joyfully moving music. Finally, trait empathic concern was positively associated with feeling moved or touched by music. These findings support the role of social cognitive and empathic processes in music listening, and highlight the social-relational aspects of feeling moved or touched by music.