FWD » Testing

11/21/2022

02:21 PM Support #6858: rework existing testcases to use ABLUnit

Vladimir Tsichevski wrote:
> # Bugs: the @abl_unit/procedure_annotations/test_suite_no_explicit_errors.p@ refers t... Marian Edu

02:09 PM Support #6858: rework existing testcases to use ABLUnit

Greg Shah wrote:
> Vladimir is only working on the ablunit parts. He is adding some tests at a minimum. One can th... Vladimir Tsichevski

02:04 PM Support #6858: rework existing testcases to use ABLUnit

Marian Edu wrote:
> Vladimir Tsichevski wrote:
> > I've started reworking the sources @abl_unit/@ subdirectory into... Vladimir Tsichevski

01:40 PM Support #6858: rework existing testcases to use ABLUnit

Vladimir is only working on the ablunit parts. He is adding some tests at a minimum. One can think of that work as ... Greg Shah

01:37 PM Support #6858: rework existing testcases to use ABLUnit

Vladimir Tsichevski wrote:
> I've started reworking the sources @abl_unit/@ subdirectory into a "pure ABLUnit". Also... Marian Edu

01:25 PM Support #6858: rework existing testcases to use ABLUnit

I've started reworking the sources @abl_unit/@ subdirectory into a "pure ABLUnit". Also I found some obvious bugs in ... Vladimir Tsichevski

09:30 AM Support #6858: rework existing testcases to use ABLUnit

Just to remind everyone: the "master plan" for testing can be found in [[p2j:Testing Process]] and those pages/tasks ... Greg Shah

09:13 AM Support #6858: rework existing testcases to use ABLUnit

Greg Shah wrote:
> I prefer to migrate these "in place". It is already confusing to have multiple testcase projects... Marian Edu

08:40 AM Support #6858: rework existing testcases to use ABLUnit

I prefer to migrate these "in place". It is already confusing to have multiple testcase projects (old and busted vs ... Greg Shah

06:22 AM Support #6858 (WIP): rework existing testcases to use ABLUnit

We're working on this one and migrate existing unit tests (no user interaction) to new ones using ABLUnit, is there a... Marian Edu

11/18/2022

02:44 PM Feature #6183: design and implement (as needed) the approach for writing automated 4GL compatibil...

A problem with @skeleton/oo4gl/OpenEdge/DataAdmin/Internal/Util/CdcTablePolicyInstanceEnum.cls@:... Vladimir Tsichevski

01:57 PM Bug #6920: Ins and outs of Sikuli for GUI testing

This chunk of code will show monitor information:... Roger Borrello

11/17/2022

09:26 AM Bug #6920: Ins and outs of Sikuli for GUI testing

After working for a few days on the customer testcases, and making sure I was able to get the @Region(x,y,w,h)@ value... Roger Borrello

09:07 AM Feature #6183: design and implement (as needed) the approach for writing automated 4GL compatibil...

In the "new" [[p2j:Testcases]] project, there is the @abl_unit/@ directory with the existing testcases. I think you'... Greg Shah

07:27 AM Feature #6183 (WIP): design and implement (as needed) the approach for writing automated 4GL comp...

I've created an @ABLUnit@ test for creating and sending all built-in errors implemented in FWD, which can be created ... Vladimir Tsichevski

11/14/2022

11:09 AM Feature #6183: design and implement (as needed) the approach for writing automated 4GL compatibil...

Marian Edu wrote:
> Vladimir Tsichevski wrote:
> > This will not work if the *conversion* of the test code is curre... Vladimir Tsichevski

10:42 AM Feature #6183: design and implement (as needed) the approach for writing automated 4GL compatibil...

Vladimir Tsichevski wrote:
> This will not work if the *conversion* of the test code is currently unsupported.
You ... Marian Edu

09:59 AM Feature #6183: design and implement (as needed) the approach for writing automated 4GL compatibil...

Marian Edu wrote:
> Vladimir Tsichevski wrote:
> > # #6183-5.
> > @Both have support for @Ignore.@
> > IMO ... Vladimir Tsichevski

09:54 AM Feature #6183: design and implement (as needed) the approach for writing automated 4GL compatibil...

Vladimir Tsichevski wrote:
> # #6183-5.
> @Both have support for @Ignore.@
> IMO @@Ignore@ is not what we ne... Marian Edu

08:14 AM Feature #6183: design and implement (as needed) the approach for writing automated 4GL compatibil...

# #6183-4.
@One thing to consider: we will need a mechanism to disable tests at runtime (e.g. those tests which w... Vladimir Tsichevski

11/11/2022

05:45 AM Bug #6920: Ins and outs of Sikuli for GUI testing

> Where does the @ExclusionRegion[] excludes@ come from that gets passed to the workers?
If you need one (because ... Greg Shah

10:39 PM Bug #6920: Ins and outs of Sikuli for GUI testing

I have this update. The script updates don't seem to be as easy as I thought. According to https://stackoverflow.com/... Roger Borrello

07:31 PM Bug #6920: Ins and outs of Sikuli for GUI testing

Greg Shah wrote:
> Not exactly. It is important that you do not need to instantiate the @BinaryFileCompare@ instanc... Roger Borrello

11/10/2022

06:46 PM Bug #6920: Ins and outs of Sikuli for GUI testing

> If I were to update the harness with interfaces for calling in from Sikuli, where would they go? For example, would... Greg Shah

04:43 PM Bug #6920: Ins and outs of Sikuli for GUI testing

With this update, I was able to build Sikuli that can handle our requirements:... Roger Borrello

02:28 PM Bug #6920: Ins and outs of Sikuli for GUI testing

Roger Borrello wrote:
> I'll try 2.0.5
It took searching through the issues, but I found this: https://github.com... Roger Borrello

02:17 PM Bug #6920: Ins and outs of Sikuli for GUI testing

Greg Shah wrote:
> > so I registered at GitHub and pulled the code
>
> Generally, you should not have to register... Roger Borrello

02:00 PM Bug #6920: Ins and outs of Sikuli for GUI testing

> so I registered at GitHub and pulled the code
Generally, you should not have to register for github to download ... Greg Shah

01:49 PM Bug #6920: Ins and outs of Sikuli for GUI testing

Roger Borrello wrote:
> Yes... I was investigating the source code that was available for download (without the buil... Roger Borrello

11:43 AM Bug #6920: Ins and outs of Sikuli for GUI testing

> I just can't figure out how to get results from the issuance of: @BinaryFileComparison(getLatestFile(xls_files),exp... Greg Shah

11:18 AM Bug #6920: Ins and outs of Sikuli for GUI testing

Greg Shah wrote:
> Sikuli is open source and written in Java, right?
Yes... I was investigating the source code t... Roger Borrello

11:08 AM Bug #6920: Ins and outs of Sikuli for GUI testing

Greg Shah wrote:
> In regard to the NPE, changes can be made to the Harness code to refactor it such that SFTP suppo... Roger Borrello

10:49 AM Bug #6920: Ins and outs of Sikuli for GUI testing

Sikuli is open source and written in Java, right? Greg Shah

10:47 AM Bug #6920: Ins and outs of Sikuli for GUI testing

Greg Shah wrote:
> It is important to move to a relative path for the @harness.jar@. I would copy it into the proje... Roger Borrello

06:45 AM Bug #6920: Ins and outs of Sikuli for GUI testing

It is important to move to a relative path for the @harness.jar@. I would copy it into the project as part of the se... Greg Shah

07:07 PM Bug #6920: Ins and outs of Sikuli for GUI testing

Committed revision 256 for hotel_gui contains a good amount of samples. They include
* Waiting for image to appear f... Roger Borrello

11/09/2022

01:45 PM Bug #6920: Ins and outs of Sikuli for GUI testing

Roger Borrello wrote:
> The first thing I'll try is the below, and add @getLatestFile@ to return the latest file of ... Roger Borrello

01:11 PM Bug #6920: Ins and outs of Sikuli for GUI testing

Greg Shah wrote:
> You can look at @com.goldencode.harness.TestFactory.processStepDefinition()@ to see how we load e... Roger Borrello

11:32 AM Bug #6920: Ins and outs of Sikuli for GUI testing

One of the main functions in Sikuli I use is the @.targetOffset(x,y)@ modification to a @Pattern@. For example, the @... Roger Borrello

11:19 AM Bug #6920: Ins and outs of Sikuli for GUI testing

I have the testcase to export guests. I am filtering the list by room, comparing the screen, then filtering by guest ... Roger Borrello

09:15 AM Bug #6920: Ins and outs of Sikuli for GUI testing

> Would I just need to add harness.jar to the classpath, or all the jars in the harness's build/lib directory?
Co... Greg Shah

08:40 AM Bug #6920: Ins and outs of Sikuli for GUI testing

There are situations where output from a key business process results in an exported file, mostly loaded into the bro... Roger Borrello

08:13 PM Bug #6920: Ins and outs of Sikuli for GUI testing

Please post the previous discussion about calling Java from the Sikuli python scripts. Greg Shah

08:12 PM Bug #6920: Ins and outs of Sikuli for GUI testing

Yes, that is fine. Greg Shah

11/08/2022

05:46 PM Bug #6920: Ins and outs of Sikuli for GUI testing

For now:... Roger Borrello

05:12 PM Bug #6920: Ins and outs of Sikuli for GUI testing

I have some Sikuli scripts to check into the hotel_gui project. However, I am unsure of the location in the directory... Roger Borrello

01:02 PM Bug #6920 (New): Ins and outs of Sikuli for GUI testing

Roger Borrello

01:04 PM Feature #3704: enable automated testing for GUI (Swing and web clients)

For ins and outs of Sikuli, please refer to #6920 which will focus purely on Sikuli Roger Borrello

11/04/2022

11:55 AM Feature #6183: design and implement (as needed) the approach for writing automated 4GL compatibil...

Email discussion with Marian:
> Since ABLUnit works both with procedures and classes what would be the preference,... Greg Shah

11/03/2022

03:43 PM Feature #6183: design and implement (as needed) the approach for writing automated 4GL compatibil...

We should consider how we measure code coverage during testing. The most obvious choice is "JaCoCo":https://www.jaco... Greg Shah

03:11 PM Feature #6183: design and implement (as needed) the approach for writing automated 4GL compatibil...

> Both have support for @Ignore.
Using @Ignore will work for something we want to exclude from testing in ... Greg Shah

11/02/2022

01:55 PM Support #6856: user interface tests

We need testcases that explore the following as comprehensively as possible. The intention is to provide complete cov... Greg Shah

10/28/2022

10:43 AM Support #6863: implement CI/CD servers and the rules for each set of tests

Greg Shah wrote:
> > It seems Ubuntu changed from bzr to git, if I'm not mistaken. See: https://code.launchpad.net/u... Tijs Wickardt

10:37 AM Support #6863: implement CI/CD servers and the rules for each set of tests

> It seems Ubuntu changed from bzr to git, if I'm not mistaken. See: https://code.launchpad.net/ubuntu
My understa... Greg Shah

10:34 AM Support #6863: implement CI/CD servers and the rules for each set of tests

Hynek Cihlar wrote:
> Btw. I found this https://github.com/felipec/git-remote-bzr. Perhaps it could be used to emplo... Tijs Wickardt

10:27 AM Support #6863: implement CI/CD servers and the rules for each set of tests

Btw. I found this https://github.com/felipec/git-remote-bzr. Perhaps it could be used to employ some of the git tools. Hynek Cihlar

10:14 AM Support #6863: implement CI/CD servers and the rules for each set of tests

Greg Shah wrote:
> The Breezy project is active, though it is admittedly not strategic. Please see my comments abou... Tijs Wickardt

09:40 AM Support #6863: implement CI/CD servers and the rules for each set of tests

Greg Shah wrote:
> Yes, in a rebase situation the revision numbers are not stable. But once something is committed ... Hynek Cihlar

09:29 AM Support #6863: implement CI/CD servers and the rules for each set of tests

As to why people use @bzr@ on Windows:
Users of this open source project must be able to check out and build FWD o... Greg Shah

08:42 AM Support #6863: implement CI/CD servers and the rules for each set of tests

Just to clarify my back-story... in using SikuliX for testing the customer's application, the screen grabs and develo... Roger Borrello

06:28 AM Support #6863: implement CI/CD servers and the rules for each set of tests

Tijs Wickardt wrote:
> Dominik, thank you for your input. You can leave out 'my/your' build.
> I'm talking about ou... Dominik Zalewski

06:19 AM Support #6863: implement CI/CD servers and the rules for each set of tests

Dominik, thank you for your input. You can leave out 'my/your' build.
I'm talking about our builds (as the Golden Co... Tijs Wickardt

06:14 AM Support #6863: implement CI/CD servers and the rules for each set of tests

Tijs Wickardt wrote:
> I presume Roger is talking about our FWD Windows builds, which is a valid point. They must be... Dominik Zalewski

05:51 AM Support #6863: implement CI/CD servers and the rules for each set of tests

A few more 'pro' considerations for moving to git:
* https://www.openhub.net/repositories/compare shows bzr is dea... Tijs Wickardt

05:36 AM Support #6863: implement CI/CD servers and the rules for each set of tests

Dominik, this is an interesting discussion. I'm a proponent of moving to git myself. There are a few things, which bu... Hynek Cihlar

05:31 AM Support #6863: implement CI/CD servers and the rules for each set of tests

I presume Roger is talking about our FWD Windows builds, which is a valid point. They must be automated (builds and t... Tijs Wickardt

05:10 AM Support #6863: implement CI/CD servers and the rules for each set of tests

Roger Borrello wrote:
> One thing I will add... Breezy isn't that straightforward to get working on Windows. They ... Dominik Zalewski

05:08 AM Support #6863: implement CI/CD servers and the rules for each set of tests

Greg Shah wrote:
> Original contents came from some years ago and there have been edits since (for example the Bre... Dominik Zalewski

10/27/2022

01:25 PM Support #6863: implement CI/CD servers and the rules for each set of tests

Greg Shah wrote:
> Original contents came from some years ago and there have been edits since (for example the Breez... Roger Borrello

12:50 PM Support #6863: implement CI/CD servers and the rules for each set of tests

Dominik Zalewski wrote:
> > In regard to @bzr@ vs @git@, please see [[p2j:Bazaar_Version_Control_System#Why-Do-We-Us... Greg Shah

12:00 PM Support #6863: implement CI/CD servers and the rules for each set of tests

> In regard to @bzr@ vs @git@, please see [[p2j:Bazaar_Version_Control_System#Why-Do-We-Use-bzr-Instead-of-git|Why-Do... Dominik Zalewski

10/25/2022

07:11 PM Support #6863: implement CI/CD servers and the rules for each set of tests

This is very useful. I've read through the wiki page. It is clear that we won't be using Bamboo. :)
As you deduc... Greg Shah

06:54 AM Support #6863: implement CI/CD servers and the rules for each set of tests

Dominik Zalewski wrote:
> However, GCD keeps the source code in bazaar. Due to the fact that this VCS is practical... Marian Edu

06:22 AM Support #6863: implement CI/CD servers and the rules for each set of tests

There is also another point worth considering and discussion. All of the CI/CD servers I worked with had some looser ... Dominik Zalewski

05:12 AM Support #6863: implement CI/CD servers and the rules for each set of tests

I had some experiences with various CI/CD server. Put a braindump here: [[internal-documentation:Choosing_CICD_Server... Dominik Zalewski