FWD » Testing

04/03/2025

11:51 AM Support #9270: design and implement an approach for executing multi-session 4GL testcases

Tomasz, in the code the only issue I see is:
* @TestPlan@ - the @sets@ are now a @HashMap@ instead of @List@ - shoul... Constantin Asofiei

08:14 AM Support #9270: design and implement an approach for executing multi-session 4GL testcases

Constantin, please review.
Tomasz Domin

11:03 AM Support #6860: lexer tests

I've worked the exception handling and error-logging. I also re-formatted some parts and started working on documenti... Florin Eugen Rotaru

10:22 AM Support #9844: finalize approach/techniques/standards for automating ABLUnit interactive UI tests

I have looked at [[p2j:Automating GUI Testing]]. This wiki page is very good in my opinion. It correctly shows the co... Șerban Bursuc

08:45 AM Support #6859: preprocessor tests

> Let me know if I should take this issue or what to do with it.
Not yet. Let's get the test suite in place first... Greg Shah

06:52 AM Support #6859: preprocessor tests

Greg Shah wrote:
> > When we have @;)@ progress translates that into just @)@, but in FWD it stays the same.
> > I ... Stefan Vieru

06:38 AM Support #6859: preprocessor tests

> Also another issues I've found during preprocessing is that: when a // comment is found, progress adds a NL. In FWD... Greg Shah

06:37 AM Support #6859: preprocessor tests

> When we have @;)@ progress translates that into just @)@, but in FWD it stays the same.
> I guess i have to look i... Greg Shah

06:30 AM Support #6859: preprocessor tests

Yes, it doesn't have to be hardcoded, it can be taken from @p2j.cfg@ i think.
Also another issues I've found during ... Stefan Vieru

06:28 AM Support #6859: preprocessor tests

> In OE the preprocessor IF would go on the 2nd statement, while in FWD it will go in the first. The reason being her... Greg Shah

06:27 AM Support #6859: preprocessor tests

Overall, this is all moving along nicely.
In regard to the different test plans/tests for OE vs FWD, please look i... Greg Shah

06:23 AM Support #6859: preprocessor tests

> My question would be: should i include somewhere in Preprocessor.java the logic that would created the path to the ... Greg Shah

03:22 AM Support #6859: preprocessor tests

While debugging the FWD Preprocessor I have found that:
When preprocessing... Stefan Vieru

08:41 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Tomasz Domin wrote:
> Stefan Vieru wrote:
> > I was thinking to use as suggested earlier @ant@ as an abstraction la... Stefan Vieru

08:39 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

The FWD @build.xml@ does this OS detection and changes things based on the result. You can look at that as an example. Greg Shah

07:46 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Stefan Vieru wrote:
> I was thinking to use as suggested earlier @ant@ as an abstraction layer, so I would have diff... Tomasz Domin

07:39 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

I was thinking to use as suggested earlier @ant@ as an abstraction layer, so I would have different ant commands base... Stefan Vieru

06:33 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Is it possible to choose between which tests are executed based on platform?
Please see #6859-32 #6859-33 #6859-36. Stefan Vieru

04/02/2025

11:01 AM Support #6860: lexer tests

I've made a commit to *6860a/15839* with what I've done so far.
The added classes are... Florin Eugen Rotaru

09:28 AM Support #6859: preprocessor tests

Windows update:
I created a different testplan for windows @test_plan_OE@... Stefan Vieru

08:37 AM Support #6859: preprocessor tests

As an update:
Tested this on Linux and it works:
@project-index.xml@... Stefan Vieru

05:04 AM Support #6859: preprocessor tests

I've created the following @ant@ task in @build.xml@:... Stefan Vieru

09:12 AM Support #9844: finalize approach/techniques/standards for automating ABLUnit interactive UI tests

Șerban Bursuc wrote:
> Greg, there are quite a lot of requirements listed. Can you list the requirements in the orde... Greg Shah

03:39 AM Support #9844: finalize approach/techniques/standards for automating ABLUnit interactive UI tests

Greg, there are quite a lot of requirements listed. Can you list the requirements in the order of their priority? Wha... Șerban Bursuc

07:54 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Stefan Vieru wrote:
> Is there a way yet to substitute the @text-file-comparison@ parameters?
> [...]
>
> I saw ... Tomasz Domin

07:43 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Is there a way yet to substitute the @text-file-comparison@ parameters?... Stefan Vieru

04/01/2025

03:31 PM Bug #9525: Testcases: incorrect placeholders in directory.xml.template and other configuration pr...

The testcases project will *not* be used as a template for customers. It is private.
Also: unless we need a speci... Greg Shah

02:47 PM Bug #9525: Testcases: incorrect placeholders in directory.xml.template and other configuration pr...

I think @maxStatementsPerConnection@ and @initialPoolSize@ from @server/default/database/tstcasesdb/orm/c3p0@ are sti... Ovidiu Maxiniuc

01:24 PM Support #6860: lexer tests

> Yes, at least for the successful ones. Note that we can successfully lex procedures in FWD that would otherwise fai... Greg Shah

10:34 AM Support #6860: lexer tests

Thanks for the reviews.
Greg Shah wrote:
> You plan to encode the FWD output as .lexer files?
Yes, at least fo... Florin Eugen Rotaru

10:08 AM Support #6859: preprocessor tests

I attached the Driver and the worker.
The command in windows would look like:
@pro -p tests/preproc/generate_prepr... Stefan Vieru

08:29 AM Support #6859: preprocessor tests

> It works for procedures without input parameters, but since you said there's no such thing for startup procedures, ... Greg Shah

08:11 AM Support #6859: preprocessor tests

In #9854-28 is the cli command for progress that i think i should use. It works for procedures without input paramete... Stefan Vieru

08:06 AM Support #6859: preprocessor tests

The driver that I've attached and I'll attach again since I've made the changes you suggested, is using the following... Stefan Vieru

08:02 AM Support #6859: preprocessor tests

Help me understand what you need to use input parameters to achieve. Greg Shah

08:01 AM Support #6859: preprocessor tests

> A question about this, how would I call this Driver from harness .xml test?
It can be called with direct Java co... Greg Shah

07:53 AM Support #6859: preprocessor tests

Greg Shah wrote:
> The general idea is good. I would probably just encode the parameters are extent variables and c... Stefan Vieru

05:42 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Correction, i didn't see you removed the VK_ENTER
It does work now!
It seems like replacing @VK_ENTER@ with @new_li... Stefan Vieru

05:39 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Tomasz Domin wrote:
> Please change @stream-write@ to:
> @<stream-write value="C:\Progress\OE116_64\bin\_progres.ex... Stefan Vieru

05:20 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Stefan Vieru wrote:
> Shouldn't I run the following test?
> [...]
> The idea is that the script doesn't execute, s... Tomasz Domin

04:36 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Shouldn't I run the following test?... Stefan Vieru

04:31 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Stefan Vieru wrote:
> [...]
> This is the output with @-d@
>
> Updated script:
> [...]
This script does not wa... Tomasz Domin

02:25 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Tomasz Domin wrote:
> Stefan Vieru wrote:
> > @Z:\testcases> java -jar ..\harness_9270a\build\lib\harness.jar -shel... Stefan Vieru

02:10 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

... Stefan Vieru

03/31/2025

06:51 PM Bug #9525: Testcases: incorrect placeholders in directory.xml.template and other configuration pr...

I think there is just some minor reviews necessary. Roger Borrello

04:34 PM Support #6860: lexer tests

> Greg, what do you think of my approach? Do you see any issues?
I like the approach. We will have to see how the... Greg Shah

04:32 PM Support #6860: lexer tests

> I have created the *tests/conversion/lexer* directory in *testcases* and added tests for @COMMENT@ rule and for @ST... Greg Shah

09:34 AM Support #6860: lexer tests

I took the liberty and made some initial classes and method definitions for the FWD Driver.
I've created 2 classes... Florin Eugen Rotaru

10:34 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Stefan Vieru wrote:
> @Z:\testcases> java -jar ..\harness_9270a\build\lib\harness.jar -shell cmd.exe .\support\harne... Tomasz Domin

10:32 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Stefan Vieru wrote:
> @Z:\testcases> java -jar ..\harness_9270a\build\lib\harness.jar -shell cmd.exe .\support\harne... Tomasz Domin

10:16 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

@Z:\testcases> java -jar ..\harness_9270a\build\lib\harness.jar -shell cmd.exe .\support\harness\test\mkdirTest-plan.... Stefan Vieru

10:00 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Stefan, thank you
Attached updated test plan and test.
You cant use @send-text@ for @target type="stream"@, you ... Tomasz Domin

08:57 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

These are the files i modified/added in @testcases/support/harness/test@
Let me know if you need anything else. Stefan Vieru

08:48 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Stefan Vieru wrote:
> I installed on VM java 8 and ant 10.
> I executed @cross_session_test.xml@ with harness and h... Tomasz Domin

08:42 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

I installed on VM java 8 and ant 10.
I executed @cross_session_test.xml@ with harness and had no errors. The tests w... Stefan Vieru

07:58 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

> > > The problem we have is different tooling on OE/Windows and FWD/Linux. I tried to mitigate it by using ant and P... Greg Shah

07:46 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

> Well, if Greg agrees to use it :) as we had some discussion about it earlier on.
Yeah, I heard/saw @ant@ several... Alexandru Lungu

07:42 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Alexandru Lungu wrote:
> > The problem we have is different tooling on OE/Windows and FWD/Linux. I tried to mitigate... Tomasz Domin

07:03 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Alexandru Lungu wrote:
> We need some guidance on how to use Harness, the main issue we're facing is that we can't r... Tomasz Domin

06:29 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

> The problem we have is different tooling on OE/Windows and FWD/Linux. I tried to mitigate it by using ant and PCT, ... Alexandru Lungu

06:17 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Alexandru Lungu wrote:
> > Its possible to spin-off a single test in harness #9270 with ant subshell in both - OE/Wi... Tomasz Domin

03:28 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

> Its possible to spin-off a single test in harness #9270 with ant subshell in both - OE/Windows and Linux/FWD.
> No... Alexandru Lungu

08:06 AM Support #9270: design and implement an approach for executing multi-session 4GL testcases

Code Review Task Branch 9270a Revisions 78 through 80
No objections. I did check in a minor reversion of whitespa... Greg Shah

08:05 AM Support #9270: design and implement an approach for executing multi-session 4GL testcases

Agreed. Greg Shah

05:35 AM Support #9270: design and implement an approach for executing multi-session 4GL testcases

Greg
I think second reviewer should be CA.
Tomasz Domin

04:09 AM Support #9270: design and implement an approach for executing multi-session 4GL testcases

Greg Shah wrote:
> Code Review Task Branch 9270a Revisions 35 through 77
>
> Overall, the changes are very good.
... Tomasz Domin

07:42 AM Support #9844: finalize approach/techniques/standards for automating ABLUnit interactive UI tests

Please look at the wiki pages I linked above. I think we are past the POC stage. We have implemented non-trivial te... Greg Shah

03/30/2025

05:04 AM Support #9844: finalize approach/techniques/standards for automating ABLUnit interactive UI tests

There is an interesting open source project called OpenCV.
Its interesting part in particular is the capability t... Hynek Cihlar

04:40 AM Support #9844: finalize approach/techniques/standards for automating ABLUnit interactive UI tests

There are many uncertainties regarding the tools and methodologies that will ensure reliable and efficient GUI testin... Hynek Cihlar

03/28/2025

04:55 PM Support #9844: finalize approach/techniques/standards for automating ABLUnit interactive UI tests

h1. Introduction
We've done quite a bit of work on automating UI testing. When you consider our work on the [[har... Greg Shah

01:04 PM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Alexandru Lungu wrote:
> Marian, is there any documentation on writing some OE driver for harness to do single-user ... Tomasz Domin

12:46 PM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Alexandru Lungu wrote:
> From email:
>
> Hi guys,
>
> We (me and Stefan Vieru) are trying to use Harness on W... Tomasz Domin

11:36 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

The reason we need to run in OE:
* Confirm that the tests do in fact work there.
* Test on different OE versions ... Greg Shah

11:30 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

> Marian, is there any documentation on writing some OE driver for harness to do single-user tests? I was thinking of... Greg Shah

11:26 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

Me, Stefan and Florin had multiple chats about using harness to cover the lexer and preprocessor tests. I suspect Gre... Alexandru Lungu

11:20 AM Support #9854: Discussion on how to leverage Harness to test certain drivers of FWD

From email:
Hi guys,
We (me and Stefan Vieru) are trying to use Harness on Windows. More specifically, we need... Alexandru Lungu

11:19 AM Support #9854 (New): Discussion on how to leverage Harness to test certain drivers of FWD

Alexandru Lungu

12:29 PM Support #6859: preprocessor tests

The general idea is good. I would probably just encode the parameters are extent variables and call @GeneratePreproc... Greg Shah

12:25 PM Support #6859: preprocessor tests

From Stefan:
> I worked on the Driver for 4GL and created some Harness tests to get a better understanding.
>
... Greg Shah

11:08 AM Support #6859: preprocessor tests

Stefan Vieru wrote:
> Greg Shah wrote:
>
> > # The "core" of each test is one or more 4GL source files (@.p@, @.i... Greg Shah

06:03 AM Support #6859: preprocessor tests

Greg Shah wrote:
> # The "core" of each test is one or more 4GL source files (@.p@, @.i@, @.cls@...). This is not... Stefan Vieru

10:59 AM Support #9270: design and implement an approach for executing multi-session 4GL testcases

Code Review Task Branch 9270a Revisions 35 through 77
Overall, the changes are very good.
1. Shouldn't the @abl... Greg Shah

10:27 AM Support #9270: design and implement an approach for executing multi-session 4GL testcases

Don't forget that without a reviewer set, this task will not appear in the list of needed code reviews. Greg Shah

05:18 AM Support #6860: lexer tests

I have created the *tests/conversion/lexer* directory in *testcases* and added tests for @COMMENT@ rule and for @STRI... Florin Eugen Rotaru

03/27/2025

11:48 AM Support #6859: preprocessor tests

That seems like a bug to fix. Let's fix it (in a newly created task) once the test suite is ready. Greg Shah

08:20 AM Support #6859: preprocessor tests

While working with harness I developed a test that uses @text-file-comparison@
But when comparing the @.cache@ and ... Stefan Vieru

08:52 AM Support #9844 (New): finalize approach/techniques/standards for automating ABLUnit interactive UI...

Greg Shah

08:44 AM Feature #3704 (Closed): enable automated testing for GUI (Swing and web clients)

This task is complete. Our documentation on how we use Sikuli:
[[p2j:Automating GUI Testing]]
[[p2j:Writing_4GL_... Greg Shah

03/26/2025

05:46 PM Bug #9525: Testcases: incorrect placeholders in directory.xml.template and other configuration pr...

Vladimir, these @build.xml@ files are written to handle conversion either via the fileset method (*-Z*) or the source... Roger Borrello

03:30 PM Bug #9525: Testcases: incorrect placeholders in directory.xml.template and other configuration pr...

Also, I would simplify things by removing all ‘old’ conversion targets entirely. I’d also rename the repository’s @zf... Vladimir Tsichevski

03:25 PM Bug #9525: Testcases: incorrect placeholders in directory.xml.template and other configuration pr...

Roger Borrello wrote:
> Vladimir Tsichevski wrote:
> > Review xfertestcases: r1687, r1696, r1711.
>
> You cut of... Vladimir Tsichevski

02:59 PM Bug #9525: Testcases: incorrect placeholders in directory.xml.template and other configuration pr...

Vladimir Tsichevski wrote:
> Review xfertestcases: r1687, r1696, r1711.
You cut off the targets before the very i... Roger Borrello

02:15 PM Bug #9525: Testcases: incorrect placeholders in directory.xml.template and other configuration pr...

Review xfertestcases: r1687, r1696, r1711.
Issues found in @build.xml@:
1. The @convert@ target does not depend... Vladimir Tsichevski

11:58 AM Bug #9525: Testcases: incorrect placeholders in directory.xml.template and other configuration pr...

Vladimir Tsichevski wrote:
> I mean where can we find the changes? Which repositories, revisions?
The @xfer.golde... Roger Borrello

11:06 AM Bug #9525: Testcases: incorrect placeholders in directory.xml.template and other configuration pr...

Roger Borrello wrote:
> Vladimir Tsichevski wrote:
> > Roger Borrello wrote:
> > > I believe this task is ready fo... Vladimir Tsichevski

09:08 AM Bug #9525: Testcases: incorrect placeholders in directory.xml.template and other configuration pr...

Vladimir Tsichevski wrote:
> Roger Borrello wrote:
> > I believe this task is ready for review.
>
> Which change... Roger Borrello

07:53 AM Bug #9525: Testcases: incorrect placeholders in directory.xml.template and other configuration pr...

Roger Borrello wrote:
> I believe this task is ready for review.
Which changes are we expected to review? Vladimir Tsichevski

09:26 AM Support #6859: preprocessor tests

Greg Shah wrote:
> Tomasz can help with understanding the Harness approach including how to setup tests that can run... Tomasz Domin

09:24 AM Support #6859: preprocessor tests

Tomasz can help with understanding the Harness approach including how to setup tests that can run under both OE and F... Greg Shah

09:21 AM Support #6859: preprocessor tests

> How should I test like in #6860?
> I created the tests in 4GL but when converting with FWD, FWD doesn't have @COMP... Greg Shah

09:11 AM Support #6859: preprocessor tests

Alexandru Lungu wrote:
> > There will be some tests which are hard to check in an ABLUnit test method. I still think... Greg Shah

08:43 AM Support #6859: preprocessor tests

Will look into harness for those tests that are using @compile@ statement. Stefan Vieru

07:37 AM Support #6859: preprocessor tests

I will upload the test classes that I've done, if it's relevant for now.
Stefan Vieru

07:31 AM Support #6859: preprocessor tests

Greg,
I migrated all of the tests but with a few exceptions. I see that in @old_testcases@ there are these files:
*... Stefan Vieru

04:40 AM Support #6859: preprocessor tests

How should I test like in #6860?
I created the tests in 4GL but when converting with FWD, FWD doesn't have @COMPILER... Stefan Vieru

03/25/2025

08:49 AM Support #6859: preprocessor tests

> There will be some tests which are hard to check in an ABLUnit test method. I still think we might need some level ... Alexandru Lungu

08:45 AM Support #6859: preprocessor tests

Nice. I think this approach can work well for some tests, maybe even all tests that are expected to "pass" in OE. F... Greg Shah

08:30 AM Support #6860: lexer tests

In the OE testing, we only need to know if it compiled or not and if it failed to compile, the details (as you have a... Greg Shah

03/24/2025

10:27 AM Support #6859: preprocessor tests

Created the following methods, adapted to the new @testcases@ project:... Stefan Vieru

08:08 AM Support #6859 (WIP): preprocessor tests

Started looking through the existing tests in @old_testcases@ and executed them on Developer Studio Stefan Vieru

08:59 AM Support #6860: lexer tests

Greg Shah wrote:
> To be clear: we will implement a driver that directly executes the lexer and checks the output. ... Florin Eugen Rotaru

03/21/2025

09:11 AM Support #6859: preprocessor tests

In addition to #6859-3, we need to consider the following:
* The testing must be able to run in both OE and FWD.
... Greg Shah

03/20/2025

04:47 PM Support #6860: lexer tests

We need to work on both the driver program as well as specific tests to check the full range of lexing behavior.
T... Greg Shah

03/19/2025

07:10 PM Bug #9525: Testcases: incorrect placeholders in directory.xml.template and other configuration pr...

I believe this task is ready for review. Roger Borrello