Abstract
Always-on agents are those agents which are like daemon programs that are always on and can do tasks as and when they arrive. These agents are idle when there is no task assigned to them. Further, those agents that work on a task, also wait for some event or task completion, and hence, are also idle for a short duration between execution of the tasks. The question arises what should the agent be doing when it is idle. In this paper, we conduct an empirical analysis to show improved decision-making capabilities by agents when they exploit their idle-time to analyze their past tasks in terms of decisions taken and their impact. The improvement of performance can be measured by considering an increase in success rate, avoiding strategies that may not work, quicker decision making, etc. Our always-on agent, while executing a task, stores some of the pertinent details of the task done in a database, such as decisions taken, paths of execution of the task, goodness of them, etc. The agent uses different strategies to use this stored knowledge. We present and evaluate three strategies that always-on agents can use (i) Frequent Decision Strategy (FDS) - the agent stores the prior executions and their frequency of success and failure, repeats the most frequent successful decision taken during prior executions of the task, (ii) Analyzed Decision Strategy (ADS) - the agent analyzes prior executions that were successful or not, stores in database the goodness of various alternatives and chooses the best alternative and (iii) Online analysis decision strategy (OADS) - the alwayson agent while executing its task, during its idle time analyzes the possible future situations and prepares the list of best possible decisions that can be taken in future. Note that the FDS and ADS are used when the agent is not doing any task and is off-line, whereas, OADS generates new mock tasks to consider possible alternative task execution situations to expand its decision-making scenarios while having a task at hand. We conduct our empirical study on always-on agents playing connect-4 games to check the viability and show improved decision making.