Author Archives: Daniel Muller

About Daniel Muller

I am a Ph.D. student at the Technion – Israel Institute of Technology, under the supervision of Dr. Erez Karpas. Over the last three years, I have been serving as a teaching assistant (TA) and a supervisor in the graduate level course of Entrepreneurship and Intellectual Property at the Faculty of Industrial Engineering and Management. My primary research interests are in the areas of artificial intelligence, machine learning, and economics. I received my B.Sc. in Industrial Engineering and Management (cum laude) and B.A. in Economics and Management from the Technion – Israel Institute of Technology. Before my Ph.D. studies, I was an information systems engineer at Elbit Systems for five years.

Vladimir Vysotsky - song about a friend , trust and mountain climbing

A Good Advice From the Past on Trust by Vladimir Vysotsky – Prove Yourself Being Wrong Before Being Right

In my previous blog post, I was writing about the illusion of being right. Here I want to share a piece of advice from my past on how to prove yourself wrong. This advice is suggested by my parents, Lev and Svetlana, which exposed my brother Alex and me in our childhood to the songs of Vladimir Vysotsky. One of those songs was the “Song About a Friend.” This song is talking about the awareness of not knowing, and the importance of taking a risk to prove yourself wrong before making a decision with impact on your fellow. This song starts with doubt and question; “If a friend suddenly turns out to be Not quite a friend, not quite an enemy, but just… “. The rest of the song is a perspective, one advice, Vladimir Vygotsky’s suggestion on how to avoid a rush judgment of somebody else actions. Being aware that we can’t know all the reasons that make a fellow to do bad or illogical actions, Emotional Intelligence if you like. Continue Reading A Good Advice From the Past on Trust by Vladimir Vysotsky – Prove Yourself Being Wrong Before Being Right

The illusion of being right and the paradox of being right and making the right thing happen

The Illusion of Being Right and The Paradox of Being Right and Making The Right Things Happen

Sometimes there is no credit for being right.
In many cases, there is a big difference between being right and making the right things happen.

If you see a disaster and you are right about this disaster going to happen, there are few decisions you can take:
1. If you want to be right, if you want the credit (sometimes without even notice) you will be right if you will show that it happened “hey here I told here is the disaster as I told you, it happened, I am right “ – so you were right and here is your credit, but what is the point of this credit?
2. If you want to make the right thing happen, you must to put yourself aside, eliminate the human weakness of wanting to be right, look at the big picture, with you small inside it (not too small, but as little as you really are) be aware of the thinking error in being right and making right things happen. If you do all this, you must know that by making the right things happen you prevent from a disaster to happen, and by doing this you lose the only proof of you being right. And sometimes even you can not be sure that you were right, but if you are focused on the right things to happen, who cares? If the new ways are better(maybe not perfect, or not perfect yet), then screw the old path and the credit. Continue Reading The Illusion of Being Right and The Paradox of Being Right and Making The Right Things Happen

What is it Value Landmarks? Why shall we use them?

Actually, I didn’t find a reason yet why shouldn’t we use them. Computationally cheap, can improve but do not do damage; In the worst case scenario using them will achieve the same results as not using. It just an extra, very relevant information that you can use or not. Make your choice… 🙂
But if you find a reason why not to use them, please let me know, contact me or leave a comment. Thanks!

Here are two examples where value-driven landmarks can lead us to better decisions in a complex (everyday life), oversubscription planning problems with sequential actions.

Bill achieved his goals! Well, it is a matter of perspective… Value Driven Landmarks for Oversubscription Planning show us a wider picture. Process-Oriented flexible planning for online, landmark-based sequential acting planning and decision making with negative utility interactions between variables (which widely appear also in the non-negative scenarios). Synergistic Criteria for a process of improvement defines a window of opportunity to terminate the process with a profit. Sometimes we better do nothing.

The context of negative effects and interactions with targets can be captured with the net utility of actions definition within Value Driven Landmarks for Oversubscription Planning. A sequence of actions that improve utility terminates with a positive net utility value action. The net and gross utility value of action definitions take into account a wider context of achievements, by capturing inter-state dependencies and intra-state dependencies.

For more details on how we find these Value Landmarks check out the introduction to oversubscription planning and our publications.

Professional Terms Dictionary

We will update this dictionary with professional terms in the fields of Artificial Intelligence (AI), Automated Planning in AI, Oversubscription Planning and more. Please feel free to suggest and ask for terms definition and clarification. Just leave a comment and your request will be clarified and added to the dictionary. (Few examples added to demonstrate how I suggest it to work, feel free to suggest different methods)

General AI TermsPlanning AI TermsOversubscription Planning Terms
A
AI
B
Big Data
C
Classification
F
Fact
L
Landmarkk
P
Proposition
S
State Variable
A
A
B
B
C
C
Oversubscription Planning (OSP) value landmarks

Technical Report for the Paper on Value Driven Landmarks for Oversubscription Planning

A detailed technical report of out ICAPS 2018 paper Value Driven Landmark for Oversubscription Planning is available. In the technical report, we provide detail examples of the theory in the paper. We look closely at the terms of optimality and achievements concerning the complexity of the real-world scenarios. ICAPS 2018 Slides of our presentation along with supplementary material can be found at the publication page.
Starting with the most fundamental question of what additive utility function in OSP problem is, we point out the challenges in multi-valued planning tasks with additive utility setting. We discuss the relationships between state variables and different value assignments to a variable in successive states along a plan. We closely consider negative interactions between state variables with multi-valued (non-zero binary) utility setting, and we show how these negative interactions could occur in tasks with non-negative utility setting.
We treat the OSP task as a process of improvement of the initial state rather than a process of collecting valuable facts is the most basic fundamental of our approach. In contrast to classical planning and partial satisfaction problems where there is one explicit assignment for each variable that is defined as valuable, OSP with additive utility functions allows for each variable to be associated with a set of different utilities. Thus, in the additive utility case, a variable assignment is valuable if its utility is better than the utility at the initial state, where an optimal solution will be the maxima(red circle) l utility over all variables that are {\em mutually consistent}. Therefore, it is easy to see that the concept of {\em improving states} rather than collecting valuable facts is much more suitable for the general case.
In order to capture the properties of the process, we define the net and gross term for the utility of actions which allow us to evaluate achievements with relative terms within the ongoing process of utility maximization. Each process that improves utility must agree with a few several structural properties of optimal. We can define these properties over process due to the definition of the net and gross actions. Finally, we represent these properties with Value-Driven Landmarks, These Value Landmarks are domain-independent (can be applied in each task if sequential decisions or actions), and lead to better performance, sometimes, as you can see in the attached image, without a search at all.
The red circle emphasizes the tasks that solved without search since no plan that meets optimal properties as applicable. In real-world scenarios that involve budget thus is very likely to happen at some point during the search.
Oversubscription action planning with value landmarks - Empirical evaluation of the improving approach

Oversubscription action planning with value landmarks – Empirical evaluation of the improving approach

Stay tuned, we will keep update here the progress of our research and if you find that problem interesting, let us know, there is a lot of work and we will be more than happy to collaborate.

We will soon post a call for collaboration with some of our suggestions.

 

Goal-Oriented Bill Could Do it Better…

Hi,

Here is a new animation explainer I am working on. It comes to clear another point from our research on Oversubscription planning and the merits of value landmarks in a complex (day life) problems with sequential actions.

 

There are some tuning left; I would love to have your comments.
Thanks!

that is a medal not a currency

How Can We Know if Our Coin is a Currency?

How Can We Know if Our Coin is a Currency?

Well, we can bite the coin and try to taste currency. But what is the taste of currency?
For me, it tastes like bread and a far flavor of a loan. It is here and now, but also there, in the future… weird?

Here is my minimum criterion for a coin to be currency, two guiding questions to decide:

  • Can my coin buy me bread?
  • Can I make a loan of my coin?

If both are true, maybe I have currency. Otherwise, perhaps I have a medal.
I don’t say if it is good or bad, matching expectations is all that is it about.

Would love to hear your thoughts on that.

Oversubscription Planning (OSP)

Introduction to our research on oversubscription planning – OSP

Introduction

Oversubscription planning termed by D. Smith (2004), also referred to as OSP, deals with achieving a state with a high utility value, given a budget on total action cost. This formulation allows us to handle situations with under-constrained resources, which do not allow us to achieve all possible goal facts. OSP objective differs from classical planning objective, in which the objective is to find a cheap plan which achieves all goal facts. In optimal OSP and optimal classical planning, the tasks are further constrained to finding a path which achieves a state with maximal utility, and, to finding the cheapest cost path which achieves the goal, respectively.

Over the years, the theory and practice of classical planning have been studied and advanced much more intensively compared to OSP. Recent work (Mirkis & Domshlak 2013,2014; Domshlak & Mirkis 2015) made several contributions aiming at improving the scalability of OSP solvers. In particular, they developed a planner which exploits standard landmark discovery tools of classical planning, as well as abstractions for solving OSP problems. They showed how standard goal-reachability landmarks of certain classical planning tasks could be generated to represent achievements of valuable facts of the original OSP task. These landmarks compiled into the original OSP task to obtain an equivalent OSP task with a lower cost allowance, and thus with a smaller effective search space. In this research, we investigate approximation methods for OSP, aiming at extending the scope of the landmark-based approximations for OSP, as well as on improving the scalability of the state-space search driven by these approximations. We propose techniques which allow us to discover more informative landmarks than previous methods. Furthermore, our techniques are applicable for OSP tasks generalized to additive utility setting.

Starting with the most basic question of what additive utility function in OSP problem is, we point out the challenges in multi-valued planning tasks with additive utility setting. We discuss the relationships between state variables and different value assignments to a variable in successive states along a plan. We closely consider negative interactions between state variables with multi-valued (non-zero binary) utility setting, and we show how these negative interactions could occur in tasks with non-negative utility setting. We introduce a novel heuristic search approach to address additive utility OSP tasks which differs from the traditional automated action planning approach in the sense of interpretation of the objective of planning for valuable facts. With our focus on improving state-variables rather than on collecting valuable facts, we define the utility of actions. Investigation of planning tasks and their utility structure with the utility of action definition in hand allowed us to discover properties of optimal plans on the level of actions and sequences of actions. A synergistic combination of these properties allows handling OSP additive utility functions over multi-valued variables.

Continue reading →

Check out our paper in ICAPS 2018

Our paper on Value Driven Landmarks for Oversubscription Planning [1] is presented in the International Conference on Automated Planning and Scheduling  – ICAPS 2018

Oversubscription planning is the problem of choosing an action sequence which reaches a state with a high utility, given a budget for total action cost. Most previous work on oversubscription planning was restricted to only non-negative utility functions and 0-binary utility functions. While this restriction allows using techniques similar to partial satisfaction planning, it limits the expressivity of the formalism. In this paper, we address oversubscription planning with general additive utility functions over a finite-domain representation. We introduce the notions of net utility of an action, and of a gross positive action. Using these notions, we prove several properties about the structure of an optimal plan, which are then compiled into a classical planning problem. The landmarks of this classical planning problem are value driven landmarks of the original oversubscription problem, that is, they must occur in any action sequence which improves utility. An empirical evaluation demonstrates that these landmarks are more informative than previous state-of-the-art methods for landmark discovery for oversubscription planning, and lead to better planning performance.

[1] D. Muller and E. Karpas, “Value driven landmarks for oversubscription planning.,” in Icaps, 2018.
[Bibtex]
@inproceedings{muller:karpas:icaps18,
title = {Value Driven Landmarks for Oversubscription Planning.},
author={Muller, Daniel and Karpas, Erez},
booktitle={ICAPS},
year = {2018}
}