Abstract

We introduce MeronymNet, a novel hierarchical approach for con- trollable, part-based generation of multi-category objects using a single unified model. We adopt a guided coarse-to-fine strategy involving semantically conditioned generation of bounding box layouts, pixel-level part layouts and ultimately, the object depic- tions themselves. We use Graph Convolutional Networks, Deep Recurrent Networks along with custom-designed Conditional Vari- ational Autoencoders to enable flexible, diverse and category-aware generation of 2-D objects in a controlled manner. The performance scores for generated objects reflect MeronymNet’s superior perfor- mance compared to multiple strong baselines and ablative variants.

Abstract

The current study aims to analyse VR measures in correspondence with 360° virtual affective experiences to understand the underlying spatio-temporal attention processes. We selected extreme pleasant and extreme unpleasant emotional videos from the Stanford affective database and displayed to participants on HMD VR. The participants’ task was to explore the video and report their affective experience using the Self- Assessment Manikin (SAM) scale. The exploration behaviour was analysed using head-tracking parameters, such as standard deviation of all the three head-rotation axes (yaw, pitch and roll), angular speed and region-wise analysis. We observed a positive correlation between standard deviation of yaw and valence, and angular speed and valence. The result suggests that affective experience not only increases the scope of attention spatially (wide scanning), it also motivates to seek more information that leads to more head-movement during exploration. In region- wise analysis, we observed front field-of-view was primarily explored, and rear field-of-view was least explored, showing natural responses similar to real environments. In addition, we used Beck Depression Inventory-II (BDI) to assess participants’ emotional state, specifically depression symptoms. The relation between virtual affective experience and 360° exploration be- haviour is discussed in light of the BDI categories. The study findings broaden the scope for VR affective research by enabling psychomotor assessment in more ecologically valid settings. Index Terms—Emotion, Depression, Affective State, 360° Ex- ploration, Head-Tracking

Abstract

Control systems operate industrial plants to accomplish stakeholder objectives like achieving production targets, complying with environmental ordinances, handling faults, etc. Such stakeholder objectives get realised by identifying and executing valid control actions on the plant’s control system. E.g., to achieve fault management a command is fired to place machines in a fault mode when the plant is under an error state. Arriving at such control actions is a non-trivial task demanding a detailed understanding of the plant’s structure and behaviour. Besides, it is also essential to verify the consequences of such control actions relative to other cross-cutting objectives and plant behaviour. E.g., to fulfil fault management objectives, the action to set machines in fault mode may affect production goals due to the machine unavailability. Hence, validation of control actions is vital before executing them using the actual plant’s control system. With digital twin technologies (DT), it is now possible to verify the implications of such control actions against a plant’s behaviour and objectives in a simulated environment without affecting the actual plant operations. DTs get developed autonomously as one-off solutions to simulate and validate plant control actions in the current state of practice, demanding high efforts and domain expertise. Our paper proposes a knowledge-driven approach enabling automation in DT development. The result of our approach is an auto-generated digital twin that pro-actively mimics the plant’s control system behaviour and helps with the validation of control actions before their execution. We use this approach to build three fault management DTs in a power plant. The application of our approach significantly reduces the manual efforts and development time to build such DTs.

Abstract

This Full Paper in the Innovative Practice category begins by asking “can algorithms be thought of and taught as dynamical systems?” Our exploration of this idea — Algodynamics — is guided by a vision to achieve convergence between computing and engineering education. The engineering sciences share a common conceptual vocabulary originating in dynamical systems: state spaces, flows, actions, invariants, fixed points, convergence, etc. The goal of algodynamics is to build, ab initio, a framework for understanding and teaching algorithms using concepts from dynamics. This allows us to teach computing and algorithms as an engineering science. Engineers work with models. In algodynamics, models are expressed using transition systems rather than as pseudo- code or programs. This allows a crisp representation of two important classes of computation: sequential algo- rithms as ‘discrete flows’ (iterative systems) and interactive applications as ‘action flows’ (transition systems). The focus of this paper is on the first of these classes, algorithms, but using ideas from the second, viz., tran- sition systems. In this framework, algorithms emerge as convergent iterative systems. Due to their non-interactivity, iterative systems may be hard to understand. The student may trace through the algorithm, but to know how the parts of the algorithm work together requires ‘opening up’ the algorithm and situating it within the more general class of interactive systems. Doing so helps the student to understand the machinery of an algorithm in an incremen- tal and modular way. The student interactively solves the algorithmic problem, experimenting with various strategies along the way. At each stage of the design, interactivity is traded for automation

Abstract

Precise boundary annotations of image regions can be crucial for downstream applications which rely on region-class semantics. Some document collections contain densely laid out, highly irregular and over- lapping multi-class region instances with large range in aspect ratio. Fully automatic boundary estimation approaches tend to be data intensive, cannot handle variable-sized images and produce sub-optimal results for aforementioned images. To address these issues, we propose Bound- aryNet, a novel resizing-free approach for high-precision semi-automatic layout annotation. The variable-sized user selected region of interest is first processed by an attention-guided skip network. The network opti- mization is guided via Fast Marching distance maps to obtain a good quality initial boundary estimate and an associated feature represen- tation. These outputs are processed by a Residual Graph Convolution Network optimized using Hausdorff loss to obtain the final region bound- ary. Results on a challenging image manuscript dataset demonstrate that BoundaryNet outperforms strong baselines and produces high-quality se- mantic region boundaries. Qualitatively, our approach generalizes across multiple document image datasets containing different script systems and layouts, all without additional fine-tuning. We integrate Bound- aryNet into a document annotation system and show that it provides high annotation throughput compared to manual and fully automatic alternatives. Keywords: document layout analysis · interactive · deep learning

Abstract

Handwritten documents are often characterized by dense and uneven layout. Despite advances, standard deep network based approaches for semantic layout segmentation are not robust to complex deformations seen across semantic regions. This phenomenon is especially pronounced for the low-resource Indic palm-leaf manuscript domain. To address the issue, we first introduce Indiscapes2, a new large-scale diverse dataset of Indic manuscripts with semantic layout annotations. Indiscapes2 contains documents from four different historical collections and is 150% larger than its predecessor, Indiscapes. We also propose a novel deep network Palmira for robust, deformation-aware instance segmentation of regions in handwritten manuscripts. We also report Hausdorff distance and its variants as a boundary-aware performance measure. Our experiments demonstrate that Palmira provides robust layouts, outperforms strong baseline approaches and ablative variants. We also include qualitative results on Arabic, South-East Asian and Hebrew historical manuscripts to showcase the generalization capability of Palmira. Keywords: instance segmentation · deformable convolutional network · historical document analysis · document image segmentation · datase

Abstract

We introduce MeronymNet, a novel hierarchical approach for controllable, part-based generation of multi-category objects using a single unified model. We adopt a guided coarse-to-fine strategy involving semantically conditioned generation of bounding box layouts, pixel-level part layouts and ultimately, the object depictions themselves. We use Graph Convolutional Networks, Deep Recurrent Networks along with custom-designed Conditional Variational Autoencoders to enable flexible, diverse and category-aware generation of 2-D objects in a controlled manner. The performance scores for generated objects reflect MeronymNet’s superior performance compared to multiple strong baselines and ablative variants.

Abstract

Control barrier function (CBF) constraints provide a rigorous characterization of the space of control inputs that ensure the satisfaction of state constraints, such as collision avoidance, at all time instants. However, CBFs are highly nonlinear and non-convex and thus, when incorporated within an optimization-based algorithm such as Model Predictive Control (MPC), leads to a computationally challenging problem. Existing works by-pass the computational intractability by collapsing the horizon of the MPC to a single step, although this comes at the cost of severe degradation of performance. In this paper, we present two contributions to ensure the real-time performance of CBFs based MPC over long horizons in the context of multi-robot collision avoidance. First, we propose a customized Project Gradient Descent Method that incurs minimal computational overhead over existing one-step approaches but leads to a substantial improvement in trajectory smoothness, time to reach the goal, etc. Our second contribution lies in applying the proposed MPC to both quadrotors and fixed-wing aerial aircrafts (FWA). In particular, we show that the formulation for the quadrotors can be readily extended to the latter by deriving additional CBFs for the curvature and forward velocity constraints. We validate our algorithm with an extensive simulation of up to 10 robots in challenging benchmark scenarios.

Abstract

The intensity of online abuse has increased in recent years. Automated tools are being developed to prevent the use of hate speech and offensive content. Most of the technologies use natural language and machine learning tools to identify offensive text. In a multilingual society, where code-mixing is a norm, the hate content would be delivered in a code-mixed form in social media, which makes offensive content identification, further challenging. In this work, we participated in the EACL task to detect offensive content in the code-mixed social media scenario. The methodology uses a transformer model with transliteration and class balancing loss for offensive content identification. In this task, our model has been ranked 2 nd in Malayalam-English and 4 th in Tamil-English code-mixed languages.

Abstract

Code-mixing (CM) is a frequently observed phenomenon that uses multiple languages in an utterance or sentence. There are no strict grammatical constraints observed in codemixing, and it consists of non-standard variations of spelling. The linguistic complexity resulting from the above factors made the computational analysis of the code-mixed language a challenging task. Language identification (LI) and part of speech (POS) tagging are the fundamental steps that help analyze the structure of the code-mixed text. Often, the LI and POS tagging tasks are interdependent in the code-mixing scenario. We project the problem of dealing with multilingualism and grammatical structure while analyzing the code-mixed sentence as a joint learning task. In this paper, we jointly train and optimize language detection and part of speech tagging models in the code-mixed scenario. We used a Transformer with convolutional neural network architecture. We train a joint learning method by combining POS tagging and LI models on code-mixed social media text obtained from the ICON shared task.