Golden Code Redmine

04/16/2026

10:15 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

I commented out the problematic adaptivePredict, and it seems to resolve the issue of fetching tokens on and on. I'll... Paula Păstrăguș

09:16 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Regarding the repeated token fetching triggered from @def_var_stmt@, and more specifically around @as_clause@, my cur... Paula Păstrăguș

09:08 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

I installed an ANTLR4 plugin for IntelliJ IDEA, and it provides some useful metrics. For example, it shows the effect... Paula Păstrăguș

04/15/2026

10:06 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

The getTokens method is *not* the culprit here. I did some debugging with a very simple testcase like:... Paula Păstrăguș

05:39 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

I'll investigate this next and try to confirm whether the lexer is actually tokenizing ahead to the end of file, or w... Paula Păstrăguș

05:26 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Here's the code:... Paula Păstrăguș

05:25 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

The measurement is about token stream buffering, not actual ANTLR prediction depth.. I'll see how can I measure how m... Paula Păstrăguș

05:09 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

The tests above were done with @BufferedTokenStream@. One possible direction would be to try @UnbufferedTokenStream@,... Paula Păstrăguș

03:40 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

I checked to see how many buffered tokens antlr4 tend to gather, here are some results:
* tested for the failing t... Paula Păstrăguș

09:20 AM Runtime Infrastructure Feature #10451: GUI interaction event logging

I performed some initial testing and it appears to work as expected. I'll continue with more extensive testing once i... Paula Păstrăguș

08:05 AM Runtime Infrastructure Feature #10451: GUI interaction event logging

I rebased 10451a, new rev is *16521*. (is should have been 16520, but the last rev contains a small rebase fix). Paula Păstrăguș

06:44 AM Runtime Infrastructure Feature #10451 (Review): GUI interaction event logging

Addressed review as rev *16139*.
Next, I'll rebase the branch to retest the behavior. Paula Păstrăguș

04/14/2026

08:22 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

I’ll also do some additional research to see what can be done specifically for this test case. I haven’t committed th... Paula Păstrăguș

08:12 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Another aspect worth mentioning is related to the testing phase. If we move toward emitting tokens differently in the... Paula Păstrăguș

08:04 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Greg Shah wrote:
> Yes, it is a systemic issue with the 4GL language design itself. This is not something we can co... Paula Păstrăguș

07:11 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

In the ANTLR2 version, this kind of situation was handled by mutating the token type inside the parser rule. That app... Paula Păstrăguș

02:16 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Current failing test:... Paula Păstrăguș

04/01/2026

08:07 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

I finally managed to get a version of trunk that compiles. Now I'm trying to figure out why the transform driver is t... Paula Păstrăguș

03/30/2026

09:33 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Ah, one more thing worth mentioning: I haven't tackled the lexer-side parser surgery yet, but I did find some equival... Paula Păstrăguș

09:26 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Just a quick update: I managed to get the Progress Parser class close to compile, but there are still quite a few inc... Paula Păstrăguș

03/20/2026

05:04 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

@setChannel(Token.HIDDEN_CHANNEL)@ likely does everything needed: the tokens aren't discarded, they're simply routed ... Paula Păstrăguș

05:00 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Used this grammar to see what happens when we hide a token in antlr4 using @setChannel(Token.HIDDEN_CHANNEL)@:
<pr... Paula Păstrăguș

03/19/2026

10:22 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Will be enough to set the channel to @HIDDEN_CHANNEL@ for the old @hide()@ method?
Note to myself: investigate whe... Paula Păstrăguș

03/18/2026

07:15 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Hm.., so are we aiming to eliminate all of the parser-side token stream surgery? Paula Păstrăguș

05:00 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

I started working on the Progress parser, and I'm seeing that hidden tokens are used quite a bit in methods such as @... Paula Păstrăguș

03:29 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Committed the migrated lexer and parser for @expression.g@ as rev *16468*. Paula Păstrăguș