[GNC] SQLLite + OFX Import + Bayes = Massive network traffic

[peterb]

Good point. Mac OS X, Gnucash 4.11.

On Wed, Apr 5, 2023 at 6:00 PM David Carlson <david.carlson.417 at gmail.com>
wrote:

> I am not sure which OS TCPDump runs in, but it would still be very helpful
> to list which version of GnuCash you are running and which OS.
>
> On Wed, Apr 5, 2023 at 2:45 PM peterb <peterb at gmail.com> wrote:
>
>> Also, despite my error in the Subject: line of this post, I did
>> actually meant MySQL, and *not* SQLite.
>>
>>
>> On Wed, Apr 5, 2023 at 2:35 PM peterb <peterb at gmail.com> wrote:
>>
>> > I've been maintaining a GnuCash database in a MySQL database for several
>> > years. Lately, I've noticed various stages of OFX import (including
>> > changing accounts, but also hitting the "OK" button to finish the
>> import)
>> > taking more and more time. When on the same LAN as the database it's
>> bad,
>> > perhaps 10 seconds, but when SSH tunnelling from a remote location the
>> > delay becomes truly ridiculous, on the order of 10 to 20 minutes.
>> >
>> > Peeking at what's going on with tcpdump, it looks like for an import of
>> > around 50 items clicking the ok button triggers thousands coupon
>> thousand
>> > of SQL inserts, the vast majority of which are somehow related to
>> updating
>> > the bayesian inference database.
>> >
>> > My questions are:
>> >
>> > (1) Anyone else seeing this? I feel like I must have hit some sort of
>> > quadratic threshold because as I said I've been using this for literally
>> > years and only recently has it gotten noticeably worse.
>> > (2) Workarounds: Is there some reasonable way to prevent OFX import from
>> > doing these updates at all? Failing that, is there some way to safely
>> nuke
>> > *just* the bayesian inference DB and start over (short of starting a
>> > completely new GnuCash db?). This isn't my ideal solution but it might
>> buy
>> > me some time.
>> > (3) Clearly "accessing an SQL DB, remotely, across the internet" is not
>> a
>> > core use case compared to updating a local GnuCash file. But might be a
>> > good performance work issue for some interested person who wants to
>> > contribute to an open source project to poke at.
>> >
>> > Thanks!
>> > -Peter
>> >
>> _______________________________________________
>> gnucash-user mailing list
>> gnucash-user at gnucash.org
>> To update your subscription preferences or to unsubscribe:
>> https://lists.gnucash.org/mailman/listinfo/gnucash-user
>> -----
>> Please remember to CC this list on all your replies.
>> You can do this by using Reply-To-List or Reply-All.
>>
>
>
> --
> David Carlson
>