Golden Code Redmine

05/07/2026

09:12 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

To be more specific, I reached a point where the conversion now generates all expected files, including the converted... Paula Păstrăguș

04:36 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

*Update*: @ant convert@ is now taking around *56* seconds to complete. This means the ANTLR4 based implementation is ... Paula Păstrăguș

05/04/2026

10:06 AM Runtime Infrastructure Feature #10451 (Review): GUI interaction event logging

Addressed code review as rev *16523*. Paula Păstrăguș

04/30/2026

08:53 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

*Update*: The AST produced for the @fwd-embedded-driver.p@ file now has the same structure. Next, I'll also verify th... Paula Păstrăguș

04/29/2026

06:59 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

*Update*: I compared the ASTs generated by ANTLR2 and ANTLR4 for @fwd-embedded-driver.p@ (full file, without commenti... Paula Păstrăguș

04/27/2026

10:17 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

I managed to get @ant convert@ to run successfully and produce a @.ast@ file. The build now completes, which is a sol... Paula Păstrăguș

04/24/2026

09:57 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

*Update*: Using *SLL* prediction mode together with @reserved_keywords@ and @unreserved_keywords@, the @fwd-embedded-... Paula Păstrăguș

04/23/2026

10:25 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

I'll try an approach based on a semantic predicate, something like @{ someMethodThatChangesTokenType() }?@. The idea ... Paula Păstrăguș

05:07 AM Runtime Infrastructure Feature #10451 (Review): GUI interaction event logging

Addressed code review as rev *16522*. I also added the one time warning.
Hynek, please review. Thanks! Paula Păstrăguș

04/22/2026

08:37 AM Conversion Tools Feature #1757: update ANTLR to latest version

For further profiling I'll use YourKit profiler. Paula Păstrăguș

08:35 AM Conversion Tools Feature #1757: update ANTLR to latest version

Paula Păstrăguș wrote:
> Paula Păstrăguș wrote:
> > Tokens generation time: @873586@ ns = 0.000873586 seconds. The ... Paula Păstrăguș

08:31 AM Conversion Tools Feature #1757: update ANTLR to latest version

... Paula Păstrăguș

08:20 AM Conversion Tools Feature #1757: update ANTLR to latest version

I only measured @tokens.fill()@, which generates all the tokens. Paula Păstrăguș

08:11 AM Conversion Tools Feature #1757: update ANTLR to latest version

Paula Păstrăguș wrote:
> Tokens generation time: @873586@ ns = 0.000873586 seconds. The lexer is clearly not the iss... Paula Păstrăguș

07:59 AM Conversion Tools Feature #1757: update ANTLR to latest version

Tokens generation time: @873586@ ns = 0.000873586 seconds. The lexer is clearly not the issue. Paula Păstrăguș

07:53 AM Conversion Tools Feature #1757: update ANTLR to latest version

As for the SLL lookahead, I wouldn't worry about the larger numbers, they represent the total lookahead across all in... Paula Păstrăguș

07:50 AM Conversion Tools Feature #1757: update ANTLR to latest version

I'm also reminded of Sam's advice from some forum: "Do not assume the lexer is fast." It might be worth profiling the... Paula Păstrăguș

07:48 AM Conversion Tools Feature #1757: update ANTLR to latest version

Yes, it helped a bit.
I enabled ANTLR4 profiling to see how much time is spent in each parser decision:
{{colla... Paula Păstrăguș

04:45 AM Runtime Infrastructure Feature #10451: GUI interaction event logging

Maybe we can exclude password fill-ins from logging. There is a place in counteract where users actually enter passwo... Paula Păstrăguș

04:40 AM Runtime Infrastructure Feature #10451: GUI interaction event logging

From my POV, this feature is meant strictly for a testing environment, not for production use. Still, you raise a fai... Paula Păstrăguș

04/21/2026

08:58 AM Conversion Tools Feature #1757: update ANTLR to latest version

Paula Păstrăguș wrote:
> Sure, I'm currently measuring the parsing time of @standard.df@ using ANTLR4 and comparing ... Paula Păstrăguș

08:28 AM Conversion Tools Feature #1757: update ANTLR to latest version

Also, there is an optimized fork of ANTLR4 available here: https://github.com/tunnelvisionlabs/antlr4/blob/master/doc... Paula Păstrăguș

08:16 AM Conversion Tools Feature #1757: update ANTLR to latest version

Sure, I'm currently measuring the parsing time of @standard.df@ using ANTLR4 and comparing it with the old ANTLR2 imp... Paula Păstrăguș

07:43 AM Conversion Tools Feature #1757: update ANTLR to latest version

I will continue the discussion here. For context, previous relevant notes include #10804-218, #10804-220, #10804-221. Paula Păstrăguș

08:21 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

I've just identified the issue with my latest commit. I think, due to the build.gradle, the @*TokenTypes.java@ files ... Paula Păstrăguș

07:35 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Greg Shah wrote:
> *Unfortunately, I don't think we can disable @ALL(*)@ completely and move back to @LL(k)@ in ANTL... Paula Păstrăguș

05:58 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Greg Shah wrote:
> I think we need more helper methods (outside of the parser) to reduce code like this (from @func_... Paula Păstrăguș

05:52 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Here is a breakdown of how @SLL@, @LL@, @adaptivePredict@, the @ATN@, and the @lookahead DFA@ all work together in th... Paula Păstrăguș

04/17/2026

11:06 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

You should now be able to see the latest version of @ProgressParser.g4@, along with the other grammars. Please note t... Paula Păstrăguș

10:53 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

I committed my test project as rev *16494* (is based on 16493 + 10804a changes). Paula Păstrăguș

10:37 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

I did some additional debugging, and I'm starting to think this may not actually be an ANTLR4 issue, but rather a pro... Paula Păstrăguș

09:38 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

I'll take care of it once the article has been read. Paula Păstrăguș

09:29 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Let me create a short grammar to see if this is clearly an antlr4 bug or not. (I'm referring to tokens fetching) Paula Păstrăguș

09:26 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Based on the documentation:
* *SLL* is fast but context insensitive and it may fail on complex grammars
* *LL* is a... Paula Păstrăguș

09:06 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Here's an article about @adaptive LL(*)@: https://www.antlr.org/papers/allstar-techreport.pdf I'll look into it. Paula Păstrăguș

09:02 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Neither prediction mode solved the token fetching issue after I reverted my fix. But let me surprise you even more: m... Paula Păstrăguș

08:32 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

However, I don't think adaptivePredict itself can be avoided. What we may be able to change instead is the prediction... Paula Păstrăguș

08:25 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

yes..
Here are the prediction modes: LL, LL_EXACT_AMBIG_DETECTION and SLL Paula Păstrăguș

08:23 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

I think by using @parser.getInterpreter().setPredictionMode(...)@, but I need to see what are the available predictio... Paula Păstrăguș

08:15 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Greg Shah wrote:
> I don't understand how @adaptivePredict()@ can be so stupid. From the original @progress.g@, that... Paula Păstrăguș

08:07 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

my testing project is based on trunk *16493* + 10804 changes. What if I overwrite the current version of 10804a with ... Paula Păstrăguș

07:42 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

If you want to test the parser I think I can upload my testing project on devsrv, tmp directory. Paula Păstrăguș

07:40 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Would @ProgressParser.g4@ be sufficient? I do have a some additional changes as well, but those are currently in a tr... Paula Păstrăguș

05:28 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

PS: My goal is to get the @fwd-embedded-driver@ converted correctly. I've made progress up to line @139@ so far, wher... Paula Păstrăguș

05:26 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

Current failing testcase:... Paula Păstrăguș

03:48 AM Conversion Tools Feature #10804: create replacement AST implementation for use with ANTLR 4

I think I found the root cause! 🥳 Let me break it down for you.
The flow for a DEFINE statement currently looks li... Paula Păstrăguș