FWD » Core Development » Database

12/20/2019

05:24 PM Feature #4011: database/persistence layer performance improvements

I committed revision 11369. Most important changes:
* removed completely the temporary @populateFields()@ and @popul... Ovidiu Maxiniuc

04:19 PM Feature #4011: database/persistence layer performance improvements

I had a question w.r.t. the FQL->SQL generation: I know you've been focused primarily on getting the functionality wo... Eric Faulhaber

01:55 PM Feature #4011: database/persistence layer performance improvements

Eric Faulhaber wrote:
> Yes, the idea behind @PropertyMeta@ was to store any information needed to convert between t... Ovidiu Maxiniuc

01:53 PM Feature #4011: database/persistence layer performance improvements

Yes, the idea behind @PropertyMeta@ was to store any information needed to convert between these lower level types an... Eric Faulhaber

01:28 PM Feature #4011: database/persistence layer performance improvements

Done, see r11368.
Related to the content of @data[]@: I was using BDT, with unknown values. Your approach uses @nu... Ovidiu Maxiniuc

01:08 PM Feature #4011: database/persistence layer performance improvements

Ah, makes sense. That's a remnant of how the old Hibernate @Transaction@ object worked. I did not really intend to ca... Eric Faulhaber

11:22 AM Feature #4011: database/persistence layer performance improvements

Ovidiu Maxiniuc wrote:
> However, after rolling back that code, it seems that there is a imbalance in @Persistence@ ... Ovidiu Maxiniuc

12/19/2019

05:21 PM Feature #4011: database/persistence layer performance improvements

RB's flushing and Hibernate's transparent write-behind are not directly related. We implemented the flushing in RB to... Eric Faulhaber

04:59 PM Feature #4011: database/persistence layer performance improvements

Well, a bit of investigation and I remember that in RecordBuffer:5917 I replaced @if (!isTransient())@ with @if (curr... Ovidiu Maxiniuc

04:47 PM Feature #4011: database/persistence layer performance improvements

The message is just a WARNING at the moment it is first displayed, but something goes wrong after the active (convert... Ovidiu Maxiniuc

04:41 PM Feature #4011: database/persistence layer performance improvements

Ovidiu Maxiniuc wrote:
> Oops, I have this too, but when closing the client window.
I am using the ChUI client.... Eric Faulhaber

04:38 PM Feature #4011: database/persistence layer performance improvements

Eric Faulhaber wrote:
> Hm, I still get the @Illegal attempt to register Finalizable@ crash. You're not seeing this?... Ovidiu Maxiniuc

04:34 PM Feature #4011: database/persistence layer performance improvements

Hm, I still get the @Illegal attempt to register Finalizable@ crash. You're not seeing this? Do you have any changes ... Eric Faulhaber

04:31 PM Feature #4011: database/persistence layer performance improvements

No, it is not. It works without the release, too, but I wanted t be sure it does this way, too. Ovidiu Maxiniuc

04:29 PM Feature #4011: database/persistence layer performance improvements

Ovidiu Maxiniuc wrote:
> Your basic testcase works for me. Clean convert, launched server, client and got the follow... Eric Faulhaber

04:28 PM Feature #4011: database/persistence layer performance improvements

Eric Faulhaber wrote:
> Hm, I had intended the block at line 262 to avoid this. I'll look at it in a bit...
I chang... Ovidiu Maxiniuc

04:25 PM Feature #4011: database/persistence layer performance improvements

Your basic testcase works for me. Clean convert, launched server, client and got the following output: @0x1 1@ after ... Ovidiu Maxiniuc

04:25 PM Feature #4011: database/persistence layer performance improvements

Ovidiu Maxiniuc wrote:
> The @for@ a line 252 will create multiple setters and getters for same property because the... Eric Faulhaber

04:21 PM Feature #4011: database/persistence layer performance improvements

Once that is working, I will implement the state changes to get an update test case going. Then expand into a more co... Eric Faulhaber

04:08 PM Feature #4011: database/persistence layer performance improvements

I see. I started form that point and gradually gain complexity. I'm going back to the basic testcase to have the same... Ovidiu Maxiniuc

04:05 PM Feature #4011: database/persistence layer performance improvements

I am working my way up to extent fields. I put in the basic getter/setter methods -- incorrectly, apparently ;-) -- b... Eric Faulhaber

04:00 PM Feature #4011: database/persistence layer performance improvements

Yes, sorry, I missed the file. Ovidiu Maxiniuc

03:59 PM Feature #4011: database/persistence layer performance improvements

Ovidiu Maxiniuc wrote:
> I have the following compile issue in @src/com/goldencode/p2j/persist/orm/DmoClass.java@:
... Eric Faulhaber

03:55 PM Feature #4011: database/persistence layer performance improvements

Sorry to bother. The generated classes are invalid when they contain extent fields. The @for@ a line 252 will create ... Ovidiu Maxiniuc

03:47 PM Feature #4011: database/persistence layer performance improvements

The @DmoClass@ does not have full support for EXTENT fields. For completeness, there are two more getter and three se... Ovidiu Maxiniuc

03:41 PM Feature #4011: database/persistence layer performance improvements

I have the following compile issue in @src/com/goldencode/p2j/persist/orm/DmoClass.java@:... Ovidiu Maxiniuc

03:29 PM Feature #4011: database/persistence layer performance improvements

There is still work I need to do on the DMO class assembler, but I wanted to try to get a real, converted, test code ... Eric Faulhaber

03:23 PM Feature #4011: database/persistence layer performance improvements

Ovidiu Maxiniuc wrote:
> Please move the line that registers the DMO class just before returning the @dmoIface@ (ie.... Eric Faulhaber

03:13 PM Feature #4011: database/persistence layer performance improvements

Please move the line that registers the DMO class just before returning the @dmoIface@ (ie. after the last @if@). Thi... Ovidiu Maxiniuc

03:06 PM Feature #4011: database/persistence layer performance improvements

Thanks, that helped. Now I get:... Eric Faulhaber

02:52 PM Feature #4011: database/persistence layer performance improvements

Eric Faulhaber wrote:
> I'm getting a @Failed to locate ALIAS for Tt_1_1__Impl__@ error on a select. Is there an imp... Ovidiu Maxiniuc

02:12 PM Feature #4011: database/persistence layer performance improvements

I'm getting a @Failed to locate ALIAS for Tt_1_1__Impl__@ error on a select. Is there an implicit assumption somewher... Eric Faulhaber

02:04 PM Feature #4011: database/persistence layer performance improvements

Ovidiu Maxiniuc wrote:
> As the priority is to get real code running, please continue to work through the @AbstractM... Eric Faulhaber

01:55 PM Feature #4011: database/persistence layer performance improvements

Ovidiu Maxiniuc wrote:
> Eric, I am aware of this. In fact, I wrote in note 14 about BDT used temporarily in data (s... Eric Faulhaber

01:54 PM Feature #4011: database/persistence layer performance improvements

Whew, ok good :)
I haven't gotten my head fully around your FQL stuff yet, and I was worried the dependency might ... Eric Faulhaber

01:52 PM Feature #4011: database/persistence layer performance improvements

Eric, I am aware of this. In fact, I wrote in note 14 about BDT used temporarily in data (search for "Note that the v... Ovidiu Maxiniuc

01:48 PM Feature #4011: database/persistence layer performance improvements

Ovidiu, I think there is a fundamental misunderstanding in your implementation of @populateData@, and as I dig furthe... Eric Faulhaber

12:06 PM Feature #4011: database/persistence layer performance improvements

FYI, I've gotten through the verifier errors and I'm trying a simpler test case than yours (to begin with):... Eric Faulhaber

09:48 AM Feature #4011: database/persistence layer performance improvements

_And the answer from Eric (also by email):_
I think you are correct that the @Buf@ interface can be removed, but I... Ovidiu Maxiniuc

09:46 AM Feature #4011: database/persistence layer performance improvements

_Current state of the task (from email):_
I have just committed the revision 11365 of 4011a. I tested it, and the ... Ovidiu Maxiniuc

12/17/2019

06:27 PM Feature #4011: database/persistence layer performance improvements

Getting rid of @dmo_index.xml@ is a long-term goal, not a short term requirement. I thought you had begun to undertak... Eric Faulhaber

05:20 PM Feature #4011: database/persistence layer performance improvements

I am aware of the startup problem. There are a couple of issues which prevented me to completely drop it until now an... Ovidiu Maxiniuc

05:22 AM Feature #4011: database/persistence layer performance improvements

I have a very rough cut of a DMO implementation class assembler in 4011a/11363. It is not feature complete and it has... Eric Faulhaber

12/13/2019

11:13 AM Bug #4450: implement shared query and shared browse

The queries also lack this features. The conversion ignores the @new@ and @shared@ options and no warning is issued w... Ovidiu Maxiniuc

09:24 AM Bug #4450: implement shared query and shared browse

I can't remember meeting a shared browse. And I didn't add any support for it. Stanislav Lomany

09:10 AM Bug #4450: implement shared query and shared browse

Ovidiu/Stanislav/Eric: Do we have any support for SHARED QUERY or SHARED BROWSE resources? I think the cause of thi... Greg Shah

12/12/2019

04:52 PM Feature #4011: database/persistence layer performance improvements

I have a not-yet-stable UPDATE implementation in @Persister@. It uses a combination of both @RecordState@ and @Proper... Ovidiu Maxiniuc

03:29 PM Bug #4450: implement shared query and shared browse

Roger Borrello wrote:
> Roger Borrello wrote:
> > I'm not sure that that logic is attempting to do, but it looks wr... Roger Borrello

02:30 PM Bug #4450: implement shared query and shared browse

Roger Borrello wrote:
> I'm not sure that that logic is attempting to do, but it looks wrong.
The information in ... Roger Borrello

01:29 PM Bug #4450: implement shared query and shared browse

Roger Borrello wrote:
> Just a little thing to mention, as I was looking through how orphan frames are created/detec... Roger Borrello

10:46 AM Bug #4450: implement shared query and shared browse

Just a little thing to mention, as I was looking through how orphan frames are created/detected:
There is a commen... Roger Borrello

10:42 AM Feature #2156: datetime-tz and hibernate

The fix from #2156-66 is in 3809e rev 11440. Constantin Asofiei

12/11/2019

06:46 PM Feature #2156: datetime-tz and hibernate

Constantin Asofiei wrote:
> Ovidiu Maxiniuc wrote:
> > Constantin,
> > I inspected how DTZ are converted (with sli... Constantin Asofiei

04:54 PM Feature #2156: datetime-tz and hibernate

Ovidiu Maxiniuc wrote:
> Constantin,
> I inspected how DTZ are converted (with slightly modified FWD code, to aviod... Constantin Asofiei

05:00 PM Bug #4450: implement shared query and shared browse

Stanislav Lomany wrote:
> > I check with you on the issue #4450 to see if you have any help you can provide me to fi... Roger Borrello

12:05 PM Bug #4450: implement shared query and shared browse

Constantin Asofiei wrote:
> Roger Borrello wrote:
> > Constantin Asofiei wrote:
> > > Roger, any external program ... Roger Borrello

11:40 AM Bug #4450: implement shared query and shared browse

Roger Borrello wrote:
> Constantin Asofiei wrote:
> > Roger, any external program which defines a simple @shared@ r... Constantin Asofiei

11:40 AM Bug #4450: implement shared query and shared browse

Constantin Asofiei wrote:
> Roger, any external program which defines a simple @shared@ resource needs to be invoked... Roger Borrello

11:33 AM Bug #4450: implement shared query and shared browse

Roger, any external program which defines a simple @shared@ resource needs to be invoked from another program which d... Constantin Asofiei

11:31 AM Bug #4450: implement shared query and shared browse

Stanislav Lomany wrote:
> > I check with you on the issue #4450 to see if you have any help you can provide me to fi... Roger Borrello

04:39 PM Feature #4011: database/persistence layer performance improvements

In the previous post, I meant to refer to the @PropertyState@ and the @BaseRecord.propState@ array w.r.t. individual ... Eric Faulhaber

02:42 PM Feature #4011: database/persistence layer performance improvements

Ovidiu, I saw you were working on the update statement part of the process. Please discuss your thoughts here. My int... Eric Faulhaber

04:26 AM Feature #4011: database/persistence layer performance improvements

Ovidiu wrote (in email):
> At this moment (at least for _temp database, but I believe the permanent databases beha... Eric Faulhaber

12/06/2019

02:09 PM Bug #4450: implement shared query and shared browse

> I check with you on the issue #4450 to see if you have any help you can provide me to fix this.
Roger, it seems ... Stanislav Lomany

09:40 AM Bug #4450: implement shared query and shared browse

h1. Description
There are missing parameters in the generated registerQuery() as a result of a SHARED BROWSE
<p... Roger Borrello

09:18 AM Bug #4450 (Closed): implement shared query and shared browse

Roger Borrello

12/04/2019

12:29 PM Bug #4426: Cannot find parent when processing REPEAT PRESELECT

Roger Borrello wrote:
> [...]
> It sounds like this is a _Base Language_ issue, related to the conversion, rather t... Eric Faulhaber

12:14 PM Bug #4426: Cannot find parent when processing REPEAT PRESELECT

Eric Faulhaber wrote:
> Eric Faulhaber wrote:
> > Roger Borrello wrote:
> > > [...]
> > > What do you make of tha... Roger Borrello

12:07 PM Bug #4426: Cannot find parent when processing REPEAT PRESELECT

Eric Faulhaber wrote:
> Roger Borrello wrote:
> > [...]
> > What do you make of that?
>
> It converts incorrect... Eric Faulhaber

11:47 AM Bug #4426: Cannot find parent when processing REPEAT PRESELECT

Roger Borrello wrote:
> [...]
> What do you make of that?
It converts incorrectly: looks like the where clause o... Eric Faulhaber

09:49 AM Bug #4426: Cannot find parent when processing REPEAT PRESELECT

Eric Faulhaber wrote:
> What I'm trying to figure out is whether it is safe to move the FIND's where clause to the R... Roger Borrello

12/03/2019

06:57 PM Bug #4426: Cannot find parent when processing REPEAT PRESELECT

What I'm trying to figure out is whether it is safe to move the FIND's where clause to the REPEAT PRESELECT level, ei... Eric Faulhaber

03:52 PM Bug #4426: Cannot find parent when processing REPEAT PRESELECT

Roger Borrello wrote:
> Eric Faulhaber wrote:
> > Which construct controls sorting? That is, if the REPEAT PRESELEC... Roger Borrello

03:10 PM Bug #4426: Cannot find parent when processing REPEAT PRESELECT

Eric Faulhaber wrote:
> Which construct controls sorting? That is, if the REPEAT PRESELECT specifies one index and t... Roger Borrello

02:53 PM Bug #4426: Cannot find parent when processing REPEAT PRESELECT

Which construct controls sorting? That is, if the REPEAT PRESELECT specifies one index and the inner FIND a different... Eric Faulhaber

10:16 AM Bug #4426: Cannot find parent when processing REPEAT PRESELECT

This is by far the most prevalent use of this syntax in customer code (@PRESELECT@ doesn't filter anything, and lets ... Roger Borrello

09:47 AM Bug #4426: Cannot find parent when processing REPEAT PRESELECT

Eric Faulhaber wrote:
> We could add an API which accepts a client-side where clause in the form of a lambda, to be ... Roger Borrello

06:09 AM Bug #4426: Cannot find parent when processing REPEAT PRESELECT

So, the problem is that we don't anticipate the where clause for the inner FIND statement. In every other case we've ... Eric Faulhaber

12/02/2019

03:37 PM Bug #4422: h2.sortNullsHigh in page-store mode

Eric Faulhaber wrote:
> Are you saying it isn't working in the version of H2 we're using now, but it _is_ working in... Constantin Asofiei

03:28 PM Bug #4422: h2.sortNullsHigh in page-store mode

Are you saying it isn't working in the version of H2 we're using now, but it _is_ working in 1.4.200? Eric Faulhaber

09:55 AM Bug #4422: h2.sortNullsHigh in page-store mode

Constantin Asofiei wrote:
> H2 1.4.200 doesn't have support for sortNullsHigh.
Scratch that, sortNullsHigh in page-... Constantin Asofiei

09:41 AM Bug #4422: h2.sortNullsHigh in page-store mode

H2 1.4.200 doesn't have support for sortNullsHigh. Constantin Asofiei

09:21 AM Bug #4421: blob/clob access with H2

H2 1.4.200 with page-store still has the LOB bugs. Constantin Asofiei

11/26/2019

01:44 PM Bug #4426: Cannot find parent when processing REPEAT PRESELECT

@database_access.rules@ is one of the nastier persistence rule sets, because it tries to handle so many related but s... Eric Faulhaber

11/25/2019

04:35 AM Bug #4421: blob/clob access with H2

Constantin Asofiei wrote:
> ... then the abend is seen, but only if the LOB size exceeds the H2's BLOCK_LENGTH (2000... Constantin Asofiei

11/24/2019

12:32 PM Bug #4421: blob/clob access with H2

Eric, my conclusion is this: LOB in page-store is broken, only in MVStore is working - if I remove the @mv_store=fal... Constantin Asofiei

08:42 AM Bug #4421: blob/clob access with H2

Eric Faulhaber wrote:
> You can invoke @session.getInterceptor()@, which will return an instance of @ChangeBroker$Se... Constantin Asofiei

11/22/2019

05:03 PM Bug #4421: blob/clob access with H2

Constantin Asofiei wrote:
> @BlobUserType@ and @ClobUserType@ need to be changed, so that the LOB access is done in ... Eric Faulhaber

03:53 PM Bug #4421: blob/clob access with H2

Even after I added the @:_temp@ exclusion (so that only dirty and meta will use the stream lob APIs), it still fails.... Constantin Asofiei

03:39 PM Bug #4421: blob/clob access with H2

Ovidiu, your solution is working, but I need one more criteria, to distinguish between session-local tables and physi... Constantin Asofiei

02:44 PM Bug #4421: blob/clob access with H2

Constantin,
As a temporary workaround until a better solution is found, try to use @session.connection().getMetaData... Ovidiu Maxiniuc

01:43 PM Bug #4421: blob/clob access with H2

For reference, this is the kind of error H2 throws, when using the LOB setters:... Constantin Asofiei

09:45 AM Bug #4421: blob/clob access with H2

The Hibernate dialect has a method named @useInputStreamToInsertBlob@ - the implementation for H2 returns true, while... Constantin Asofiei

09:39 AM Bug #4421 (WIP): blob/clob access with H2

Constantin Asofiei

04:17 PM Bug #4426: Cannot find parent when processing REPEAT PRESELECT

h1. General
Expression execution error when there is a @preselect@ qualifier on @repeat@.
*20191231 Update: Cus... Roger Borrello

04:05 PM Bug #4426 (New): Cannot find parent when processing REPEAT PRESELECT

Roger Borrello

12:59 PM Bug #4422: h2.sortNullsHigh in page-store mode

Eric Faulhaber wrote:
> For our development/testing use of H2, I think it is ok to switch to the MV_STORE storage en... Constantin Asofiei

12:55 PM Bug #4422: h2.sortNullsHigh in page-store mode

For our development/testing use of H2, I think it is ok to switch to the MV_STORE storage engine when using H2 as the... Eric Faulhaber

10:32 AM Bug #4422: h2.sortNullsHigh in page-store mode

With #3961, we disabled MVCC and moved to page-store. But with page-store, the h2.sortNullsHigh is not working - thi... Constantin Asofiei

10:29 AM Bug #4422 (New): h2.sortNullsHigh in page-store mode

Constantin Asofiei

12:56 PM Bug #3961: "Unexpected code path" failure when using H2 in MVCC mode

Eric Faulhaber wrote:
> Please refresh my memory on this issue. Is there a production use case where this is a probl... Constantin Asofiei

12:43 PM Bug #3961: "Unexpected code path" failure when using H2 in MVCC mode

Please refresh my memory on this issue. Is there a production use case where this is a problem?
We do not support ... Eric Faulhaber