Monthly Archives: August 2018

What is it Value Landmarks? Why shall we use them?

Actually, I didn’t find a reason yet why shouldn’t we use them. Computationally cheap, can improve but do not do damage; In the worst case scenario using them will achieve the same results as not using. It just an extra, very relevant information that you can use or not. Make your choice… 🙂
But if you find a reason why not to use them, please let me know, contact me or leave a comment. Thanks!

Here are two examples where value-driven landmarks can lead us to better decisions in a complex (everyday life), oversubscription planning problems with sequential actions.

Bill achieved his goals! Well, it is a matter of perspective… Value Driven Landmarks for Oversubscription Planning show us a wider picture. Process-Oriented flexible planning for online, landmark-based sequential acting planning and decision making with negative utility interactions between variables (which widely appear also in the non-negative scenarios). Synergistic Criteria for a process of improvement defines a window of opportunity to terminate the process with a profit. Sometimes we better do nothing.

The context of negative effects and interactions with targets can be captured with the net utility of actions definition within Value Driven Landmarks for Oversubscription Planning. A sequence of actions that improve utility terminates with a positive net utility value action. The net and gross utility value of action definitions take into account a wider context of achievements, by capturing inter-state dependencies and intra-state dependencies.

For more details on how we find these Value Landmarks check out the introduction to oversubscription planning and our publications.

Professional Terms Dictionary

We will update this dictionary with professional terms in the fields of Artificial Intelligence (AI), Automated Planning in AI, Oversubscription Planning and more. Please feel free to suggest and ask for terms definition and clarification. Just leave a comment and your request will be clarified and added to the dictionary. (Few examples added to demonstrate how I suggest it to work, feel free to suggest different methods)

General AI TermsPlanning AI TermsOversubscription Planning Terms
Big Data
State Variable
Oversubscription Planning (OSP) value landmarks

Technical Report for the Paper on Value Driven Landmarks for Oversubscription Planning

A detailed technical report of out ICAPS 2018 paper Value Driven Landmark for Oversubscription Planning is available. In the technical report, we provide detail examples of the theory in the paper. We look closely at the terms of optimality and achievements concerning the complexity of the real-world scenarios. ICAPS 2018 Slides of our presentation along with supplementary material can be found at the publication page.
Starting with the most fundamental question of what additive utility function in OSP problem is, we point out the challenges in multi-valued planning tasks with additive utility setting. We discuss the relationships between state variables and different value assignments to a variable in successive states along a plan. We closely consider negative interactions between state variables with multi-valued (non-zero binary) utility setting, and we show how these negative interactions could occur in tasks with non-negative utility setting.
We treat the OSP task as a process of improvement of the initial state rather than a process of collecting valuable facts is the most basic fundamental of our approach. In contrast to classical planning and partial satisfaction problems where there is one explicit assignment for each variable that is defined as valuable, OSP with additive utility functions allows for each variable to be associated with a set of different utilities. Thus, in the additive utility case, a variable assignment is valuable if its utility is better than the utility at the initial state, where an optimal solution will be the maxima(red circle) l utility over all variables that are {\em mutually consistent}. Therefore, it is easy to see that the concept of {\em improving states} rather than collecting valuable facts is much more suitable for the general case.
In order to capture the properties of the process, we define the net and gross term for the utility of actions which allow us to evaluate achievements with relative terms within the ongoing process of utility maximization. Each process that improves utility must agree with a few several structural properties of optimal. We can define these properties over process due to the definition of the net and gross actions. Finally, we represent these properties with Value-Driven Landmarks, These Value Landmarks are domain-independent (can be applied in each task if sequential decisions or actions), and lead to better performance, sometimes, as you can see in the attached image, without a search at all.
The red circle emphasizes the tasks that solved without search since no plan that meets optimal properties as applicable. In real-world scenarios that involve budget thus is very likely to happen at some point during the search.
Oversubscription action planning with value landmarks - Empirical evaluation of the improving approach

Oversubscription action planning with value landmarks – Empirical evaluation of the improving approach

Stay tuned, we will keep update here the progress of our research and if you find that problem interesting, let us know, there is a lot of work and we will be more than happy to collaborate.

We will soon post a call for collaboration with some of our suggestions.


Goal-Oriented Bill Could Do it Better…


Here is a new animation explainer I am working on. It comes to clear another point from our research on Oversubscription planning and the merits of value landmarks in a complex (day life) problems with sequential actions.


There are some tuning left; I would love to have your comments.

that is a medal not a currency

How Can We Know if Our Coin is a Currency?

How Can We Know if Our Coin is a Currency?

Well, we can bite the coin and try to taste currency. But what is the taste of currency?
For me, it tastes like bread and a far flavor of a loan. It is here and now, but also there, in the future… weird?

Here is my minimum criterion for a coin to be currency, two guiding questions to decide:

  • Can my coin buy me bread?
  • Can I make a loan of my coin?

If both are true, maybe I have currency. Otherwise, perhaps I have a medal.
I don’t say if it is good or bad, matching expectations is all that is it about.

Would love to hear your thoughts on that.