[request] Self learning: Should be possible to recapture a not found image on the fly and retry
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
SikuliX |
In Progress
|
Medium
|
RaiMan |
Bug Description
Hi,
I was thinking of how machine learning can be used to improve the automated scripts and how we can make the script learn.
I automate SAP PC resolutions and no matter what logic you write, there will be some day that an unexpected error will come.
We can not control that.
But I was thinking, what if we can write a logic so that if suppose a screenshot for error is not recognized and an exception occurs:
1) A screen pop ups asking you to maybe take a screenshot of the new error.
2) It saves that screenshot and then asks for you to select some options which will be predefined..like 1)repeat 2)wait ...so on
3)next time when the script runs it won't ask you for this type of error.
Although I can keep on updating the code when the error occurs,but I would like to implement this so that any other non programmer is also able to easily update the steps and update the script.
please suggest if someone know any idea to implement it ,or any other idea that is actually self learning.
Changed in sikuli: | |
status: | New → In Progress |
importance: | Undecided → Medium |
assignee: | nobody → RaiMan (raimund-hocke) |
milestone: | none → 2.0.0 |
Changed in sikuli: | |
milestone: | 2.0.0 → 2.1.0 |
The basic approach is already implemented: sponse( ) (see docs)
setFindFailedRe
What is missing is the possibility to recapture and then retry.
Additionally one should have the option to specify optional handlers (pre, instead, post)
The complete image handling will be revised in version 2 and we will then have such a feature.
There is one caveat though:
This only works for situations, where the resulting match with the re-capture does not need to be exact in position and size related to the original image.
If in the script you are using such features as targetOffset() or calculate relative positions with respect to the match, this might not work with the re-captured image.
Currently I do not have any idea, how to solve that.