EcoMLS: A Self-Adaptation Approach for Architecting Green ML-Enabled Systems
Meghana Tedla,Kulkarni Shubham Shantanu,Karthik Vaidhyanathan
IEEE International Conference on Software Architecture Companion, ICSA, 2024
@inproceedings{bib_EcoM_2024, AUTHOR = {Meghana Tedla, Kulkarni Shubham Shantanu, Karthik Vaidhyanathan}, TITLE = {EcoMLS: A Self-Adaptation Approach for Architecting Green ML-Enabled Systems}, BOOKTITLE = {IEEE International Conference on Software Architecture Companion}. YEAR = {2024}}
The sustainability of Machine Learning-Enabled Systems (MLS), particularly with regard to energy efficiency, is an important challenge in their development and deployment. Self-adaptation techniques, recognized for their potential in energy savings within software systems, have yet to be extensively explored in Machine Learning-Enabled Systems (MLS), where runtime uncertainties can significantly impact model performance and energy consumption. This variability, alongside the fluctuating energy demands of ML models during operation, necessitates a dynamic approach. Addressing these challenges, we introduce EcoMLS approach, which leverages the Machine Learning Model Balancer concept to enhance the sustainability of MLS through runtime ML model switching. By adapting to monitored runtime conditions, EcoMLS optimally balances energy consumption with model confidence, demonstrating a significant advancement towards sustainable, energy-efficient machine learning solutions. Through an object detection exemplar, we illustrate the application of EcoMLS, showcasing its ability to reduce energy consumption while maintaining high model accuracy throughout its use. This research underscores the feasibility of enhancing MLS sustainability through intelligent runtime adaptations, contributing a valuable perspective to the ongoing discourse on energy-efficient machine learning.
SWITCH: An Exemplar for Evaluating Self-Adaptive ML-Enabled Systems
Arya Pravin Marda,Kulkarni Shubham Shantanu,Karthik Vaidhyanathan
Software Engineering for Adaptive and Self-Managing Systems, SEAMS, 2024
@inproceedings{bib_SWIT_2024, AUTHOR = {Arya Pravin Marda, Kulkarni Shubham Shantanu, Karthik Vaidhyanathan}, TITLE = {SWITCH: An Exemplar for Evaluating Self-Adaptive ML-Enabled Systems}, BOOKTITLE = {Software Engineering for Adaptive and Self-Managing Systems}. YEAR = {2024}}
Addressing runtime uncertainties in Machine Learning-Enabled Systems (MLS) is crucial for maintaining Quality of Service (QoS). The Machine Learning Model Balancer is a concept that addresses these uncertainties by facilitating dynamic ML model switching, showing promise in improving QoS in MLS. Leveraging this concept, this paper introduces SWITCH, an exemplar developed to enhance self-adaptive capabilities in such systems through dynamic model switching in runtime. SWITCH is designed as a comprehensive web service catering to a broad range of ML scenarios, with its implementation demonstrated through an object detection use case. SWITCH provides researchers with a flexible platform to apply and evaluate their ML model switching strategies, aiming to enhance QoS in MLS. SWITCH features advanced input handling, real-time data processing, and logging for adaptation metrics supplemented with an interactive real-time dashboard for enhancing system observability. This paper details SWITCH's architecture, self-adaptation strategies through ML model switching, and its empirical validation through a case study, illustrating its potential to improve QoS in MLS. By enabling a hands-on approach to explore adaptive behaviors in ML systems, SWITCH contributes a valuable tool to the SEAMS community for research into self-adaptive mechanisms for MLS and their practical applications.
Exploratory Study of oneM2M-based Interoperability Architectures for IoT: A Smart City Perspective
Vjs Pranavasri,Leo Francis,Gaurav Pal,Ushasri Mogadali,Anuradha Vattem,Karthik Vaidhyanathan,Deepak Gangadharan
IEEE International Conference on Software Architecture Companion, ICSA, 2024
@inproceedings{bib_Expl_2024, AUTHOR = {Vjs Pranavasri, Leo Francis, Gaurav Pal, Ushasri Mogadali, Anuradha Vattem, Karthik Vaidhyanathan, Deepak Gangadharan}, TITLE = {Exploratory Study of oneM2M-based Interoperability Architectures for IoT: A Smart City Perspective}, BOOKTITLE = {IEEE International Conference on Software Architecture Companion}. YEAR = {2024}}
The advent of the Internet of Things (IoT) has ushered in transformative possibilities for smart cities, with the potential to revolutionize urban living through enhanced connectivity and data-driven decision-making. However, the effective realization of IoT in smart cities hinges upon the seamless interoperability of diverse devices and systems. To address this critical need, the oneM2M standards initiative has emerged as a foundational framework for IoT interoperability. In this research paper, we perform an exploratory analysis of three prominent open-source oneM2M based interoperability systems—Mobius, OM2M, and ACME. We leverage an existing large-scale system provided by our Smart City Living Lab deployed at IIIT Hyderabad, sprawling a 66-acre campus featuring over 370 nodes across eight verticals. We investigate the architectural characteristics of each solution, considering their strengths and limitations in facilitating IoT interoperability. Through this analysis, our paper aims to provide valuable insights for stakeholders seeking to implement IoT interoperability solutions in the context of smart cities. By evaluating the strengths and limitations of Mobius, OM2M, and ACME, we seek to offer guidance for selecting the most suitable solution. Our analysis reveals that the optimal framework choice depends on specific quality constraints: Mobius excels in performance, while ACME offers advantages in ease of setup for smaller-scale implementations.
Can LLMs Generate Architectural Design Decisions? - An Exploratory Empirical study
Rudra Dhar,Karthik Vaidhyanathan,Vasudeva Varma Kalidindi
IEEE International Conference on Software Architecture Companion, ICSA, 2024
@inproceedings{bib_Can__2024, AUTHOR = {Rudra Dhar, Karthik Vaidhyanathan, Vasudeva Varma Kalidindi}, TITLE = {Can LLMs Generate Architectural Design Decisions? - An Exploratory Empirical study}, BOOKTITLE = {IEEE International Conference on Software Architecture Companion}. YEAR = {2024}}
Architectural Knowledge Management (AKM) involves the organized handling of information related to architectural decisions and design within a project or organization. An essential artefact of AKM is the Architecture Decision Records (ADR), which documents key design decisions. ADRs are documents that capture decision context, decision made and various aspects related to a design decision, thereby promoting transparency, collaboration, and understanding. Despite their benefits, ADR adoption in software development has been slow due to challenges like time constraints and inconsistent uptake. Recent advancements in Large Language Models (LLMs) may help bridge this adoption gap by facilitating ADR generation. However, the effectiveness of LLM for ADR generation or understanding is something that has not been explored. To this end, in this work, we perform an exploratory study which aims to investigate the feasibility of using LLM for the generation of ADRs given the decision context. In our exploratory study, we utilize GPT and T5-based models with 0-shot, few-shot, and fine-tuning approaches to generate the Decision of an ADR given its Context. Our results indicate that in a 0-shot setting, state-of-the-art models such as GPT-4 generate relevant and accurate Design Decisions, although they fall short of human-level performance. Additionally, we observe that more cost-effective models like GPT-3.5 can achieve similar outcomes in a few-shot setting, and smaller models such as Flan-T5 can yield comparable results after fine-tuning. To conclude, this exploratory study suggests that LLM can generate Design Decisions, but further research is required to attain human-level generation and establish standardized widespread adoption.
Scalable and Interoperable Distributed Architecture for IoT in Smart Cities
Vjs Pranavasri,Leo Francis,Ushasri Mogadali,Gaurav Pal,Vaddhiparthy s V S L N Surya Suhas,Anuradha Vattem,Karthik Vaidhyanathan,Deepak Gangadharan
Technical Report, arXiv, 2023
@inproceedings{bib_Scal_2023, AUTHOR = {Vjs Pranavasri, Leo Francis, Ushasri Mogadali, Gaurav Pal, Vaddhiparthy s V S L N Surya Suhas, Anuradha Vattem, Karthik Vaidhyanathan, Deepak Gangadharan}, TITLE = {Scalable and Interoperable Distributed Architecture for IoT in Smart Cities}, BOOKTITLE = {Technical Report}. YEAR = {2023}}
The increase of IoT devices and the emergence of smart cities have revolutionized urban development, offering numerous benefits while addressing environmental concerns. This has caused an increase in the usage of IoT frameworks, and the need for efficient architecture and standardized ontology is imminent. In this regard, we propose a distributed, multi-layered data platform architecture comprising the Data Monitoring Layer (DML), Data Storage Layer (DSL), Data Enhancement Layer (DEnL), and Data Exchange Layer (DEL). Our architecture achieves interoperability, facilitates data transfer between nodes, enables telemetry data retrieval, and ensures cross-platform and cross-device compatibility. It addresses the challenges of handling increased sensor data and user demands by providing high throughput and scalability support. We investigated Smart City Living Lab at IIIT Hyderabad an existing large-scale system deployed within a 66-acre campus. This system consists of 291 nodes. By studying this deployed system, we were able to gather valuable real-world data, allowing us to analyze the challenges and potential solutions related to data architecture. Our results show improvements of up to 41.23\% in throughput and a decrease in latency by 29.19\% for data insertion from the sensor nodes. The retrieval by the data client gives an increase of over 800\% in both throughput and number of requests through DENL. These metrics are compared to a centralised data platform architecture. We conclude by discussing the implications of our findings and suggesting future work.
Toward Changing Users behavior with Emotion-based Adaptive Systems
Mina Alipour,Mahyar Tourchi Moghaddam,Karthik Vaidhyanathan,Mikkel Baun Kjærgaard
ACM Conference on User Modeling, Adaptation and Personalization, UMAP, 2023
@inproceedings{bib_Towa_2023, AUTHOR = {Mina Alipour, Mahyar Tourchi Moghaddam, Karthik Vaidhyanathan, Mikkel Baun Kjærgaard}, TITLE = {Toward Changing Users behavior with Emotion-based Adaptive Systems}, BOOKTITLE = {ACM Conference on User Modeling, Adaptation and Personalization}. YEAR = {2023}}
Interactive computer systems’ designers emphasize the importance of considering humans, their emotions, and behaviors as first-class entities. Emotions are integral parts of human nature, and ignoring that can lead the interactive systems to failure, low quality, or discomfort. User interfaces (UIs) are increasingly becoming adaptive to users’ various characteristics, intending to improve users’ satisfaction, performance, and decisions. However, the previous approaches proposed for supervising such adaptations are not effectively adopted in real-life problems. This paper proposes the novel approach to adapting UIs to users’ emotions using Model-Free Reinforcement Learning (MFRL). The approach aims to maximize applying the essential adaptations and minimize the unnecessary ones towards users’ task completion and satisfaction. We chose emergency evacuation training as a suitable evaluation domain since people experience intense emotions in potential danger. We performed experiments with a mobile application we developed that acts as a recommender system in emergency training. By taking contextual input of the users’ basic emotions from face recognition, the application intelligently adapts its UI to quickly lead people to safe areas while arousing target emotions. The research includes literature analysis, surveys, and further adopting an iterative process in implementation and experimentation. The evaluation process confirms the efficiency and effectiveness of the MFRL in iterations, as well as compared to other possible UI adaptation techniques, i.e., rule-based and sequential adaptation.
Emoticontrol: Emotions-based Control of User-Interfaces Adaptations
Mina Alipour,Mahyar T Moghaddam,Karthik Vaidhyanathan,Mikkel Baun Kjærgaard
Proceedings of the ACM on Human-Computer Interaction, PACMHCI, 2023
@inproceedings{bib_Emot_2023, AUTHOR = {Mina Alipour, Mahyar T Moghaddam, Karthik Vaidhyanathan, Mikkel Baun Kjærgaard}, TITLE = {Emoticontrol: Emotions-based Control of User-Interfaces Adaptations}, BOOKTITLE = {Proceedings of the ACM on Human-Computer Interaction}. YEAR = {2023}}
Emotions are integral to human nature, and their existence, duration, and evolution could lead to specific behaviors. If emotions and behaviors are ignored in the design of socio-technical systems, they will fail or cause discomfort. User interfaces (UIs) are elements of interactive systems able to trigger or moderate emotions. UIs are increasingly designed adaptive to users' various characteristics, intending to improve their satisfaction, performance, and decisions. However, previous adaptation supervising approaches are not effectively adopted in real life since they neglect the dynamic behaviors of humans or systems. This paper proposes Emoticontrol, a quality-driven approach to adapting UIs to users' emotions using Model-Free Reinforcement Learning (MFRL). The approach aims to maximize applying the essential adaptations and minimize the unnecessary ones towards users' enhanced quality of experience …
Towards Self-Adaptive Machine Learning-Enabled Systems Through QoS-Aware Model Switching
Kulkarni Shubham Shantanu,Arya Pravin Marda,Karthik Vaidhyanathan
Technical Report, arXiv, 2023
@inproceedings{bib_Towa_2023, AUTHOR = {Kulkarni Shubham Shantanu, Arya Pravin Marda, Karthik Vaidhyanathan}, TITLE = {Towards Self-Adaptive Machine Learning-Enabled Systems Through QoS-Aware Model Switching}, BOOKTITLE = {Technical Report}. YEAR = {2023}}
Machine Learning (ML), particularly deep learning, has seen vast advancements, leading to the rise of Machine Learning-Enabled Systems (MLS). However, numerous software engineering challenges persist in propelling these MLS into production, largely due to various run-time uncertainties that impact the overall Quality of Service (QoS). These uncertainties emanate from ML models, software components, and environmental factors. Self-adaptation techniques present potential in managing run-time uncertainties, but their application in MLS remains largely unexplored. As a solution, we propose the concept of a Machine Learning Model Balancer, focusing on managing uncertainties related to ML models by using multiple models. Subsequently, we introduce AdaMLS, a novel self-adaptation approach that leverages this concept and extends the traditional MAPE-K loop for continuous MLS adaptation. AdaMLS employs lightweight unsupervised learning for dynamic model switching, thereby ensuring consistent QoS. Through a self-adaptive object detection system prototype, we demonstrate AdaMLS's effectiveness in balancing system and model performance. Preliminary results suggest AdaMLS surpasses naive and single state-of-the-art models in QoS guarantees, heralding the advancement towards self-adaptive MLS with optimal QoS in dynamic environments.
Software Architecture for Multi-User Multiplexing to Enhance Scalability in IoT-Based Remote Labs
Akshit Gureja,Rishabh Anup Agrawal,Sachin Chaudhari,Karthik Vaidhyanathan,Venkatesh Choppella
World Forum on Internet of Things, WF-IoT, 2023
@inproceedings{bib_Soft_2023, AUTHOR = {Akshit Gureja, Rishabh Anup Agrawal, Sachin Chaudhari, Karthik Vaidhyanathan, Venkatesh Choppella}, TITLE = {Software Architecture for Multi-User Multiplexing to Enhance Scalability in IoT-Based Remote Labs}, BOOKTITLE = {World Forum on Internet of Things}. YEAR = {2023}}
Remote Labs refer to an end-to-end system, including hardware and software built to access scientific equipment and resources remotely. The software platform built for such purposes needs to be robust enough to handle the communication of inputs and outputs between the client and the hardware nodes with minimal latency and simultaneously provide a seamless user experience. This paper highlights the importance of scalability in Remote Labs and presents multi-user multiplexing as a solution, to essentially provide users with concurrent access to the hardware node for experiments which can generate outputs instantaneously. The paper discusses the inefficiency of existing web-based Remote Labs with 4-layered architectures and proposes the use of WebSocket with a 3-layer software architecture to enhance user experience, accelerate input-output communication and implement multi-user multiplexing. To showcase the effectiveness of the proposed architecture over existing implementations using Blynk IoT platform as the middleware, a comprehensive communication pipeline was developed from scratch to perform Kirchhoff’s Voltage Law (KVL) experiment remotely.
A Tool based Experiment to Teach Elicitation and Specification of Virtual Reality Product Requirements
Sai Anirudh Karre,Karthik Vaidhyanathan,Raghu Babu Reddy Y
ACM Conference on Global Computing Education, CompEd, 2023
@inproceedings{bib_A_To_2023, AUTHOR = {Sai Anirudh Karre, Karthik Vaidhyanathan, Raghu Babu Reddy Y}, TITLE = {A Tool based Experiment to Teach Elicitation and Specification of Virtual Reality Product Requirements}, BOOKTITLE = {ACM Conference on Global Computing Education}. YEAR = {2023}}
Students need to understand the assessment of requirements correctness while building software systems. It helps produce products that meet the stakeholder objectives. This poster illustrates an experiment conducted as a tool-based collaborative assignment for assessing the correctness of software products using a Virtual Reality (VR) application as part of a CS300-level course at our University.
Towards Self-Adaptive Machine Learning-Enabled Systems Through QoS-Aware Model Switching
Kulkarni Shubham Shantanu,Arya Pravin Marda,Karthik Vaidhyanathan
Automated Software Engineering, ASE, 2023
@inproceedings{bib_Towa_2023, AUTHOR = {Kulkarni Shubham Shantanu, Arya Pravin Marda, Karthik Vaidhyanathan}, TITLE = {Towards Self-Adaptive Machine Learning-Enabled Systems Through QoS-Aware Model Switching}, BOOKTITLE = {Automated Software Engineering}. YEAR = {2023}}
Machine Learning (ML), particularly deep learning, has seen vast advancements, leading to the rise of Machine Learning-Enabled Systems (MLS). However, numerous software engineering challenges persist in propelling these MLS into production, largely due to various run-time uncertainties that impact the overall Quality of Service (QoS). These uncertainties emanate from ML models, software components, and environmental factors. Self-adaptation techniques present potential in managing run-time uncertainties, but their application in MLS remains largely unexplored. As a solution, we propose the concept of a Machine Learning Model Balancer, focusing on managing uncertainties related to ML models by using multiple models. Subsequently, we introduce AdaMLS, a novel self-adaptation approach that leverages this concept and extends the traditional MAPE-K loop for continuous MLS adaptation. AdaMLS employs lightweight unsupervised learning for dynamic model switching, thereby ensuring consistent QoS. Through a self-adaptive object detection system prototype, we demonstrate AdaMLS's effectiveness in balancing system and model performance. Preliminary results suggest AdaMLS surpasses naive and single state-of-the-art models in QoS guarantees, heralding the advancement towards self-adaptive MLS with optimal OoS in dynamic environments.
