[GNC] SQLLite + OFX Import + Bayes = Massive network traffic

[peterb]

Also, despite my error in the Subject: line of this post, I did
actually meant MySQL, and *not* SQLite.


On Wed, Apr 5, 2023 at 2:35 PM peterb <peterb at gmail.com> wrote:

> I've been maintaining a GnuCash database in a MySQL database for several
> years. Lately, I've noticed various stages of OFX import (including
> changing accounts, but also hitting the "OK" button to finish the import)
> taking more and more time. When on the same LAN as the database it's bad,
> perhaps 10 seconds, but when SSH tunnelling from a remote location the
> delay becomes truly ridiculous, on the order of 10 to 20 minutes.
>
> Peeking at what's going on with tcpdump, it looks like for an import of
> around 50 items clicking the ok button triggers thousands coupon thousand
> of SQL inserts, the vast majority of which are somehow related to updating
> the bayesian inference database.
>
> My questions are:
>
> (1) Anyone else seeing this? I feel like I must have hit some sort of
> quadratic threshold because as I said I've been using this for literally
> years and only recently has it gotten noticeably worse.
> (2) Workarounds: Is there some reasonable way to prevent OFX import from
> doing these updates at all? Failing that, is there some way to safely nuke
> *just* the bayesian inference DB and start over (short of starting a
> completely new GnuCash db?). This isn't my ideal solution but it might buy
> me some time.
> (3) Clearly "accessing an SQL DB, remotely, across the internet" is not a
> core use case compared to updating a local GnuCash file. But might be a
> good performance work issue for some interested person who wants to
> contribute to an open source project to poke at.
>
> Thanks!
> -Peter
>