[GNC] SQLLite + OFX Import + Bayes = Massive network traffic

[David Carlson]

I am not sure which OS TCPDump runs in, but it would still be very helpful
to list which version of GnuCash you are running and which OS.

On Wed, Apr 5, 2023 at 2:45 PM peterb <peterb at gmail.com> wrote:

> Also, despite my error in the Subject: line of this post, I did
> actually meant MySQL, and *not* SQLite.
>
>
> On Wed, Apr 5, 2023 at 2:35 PM peterb <peterb at gmail.com> wrote:
>
> > I've been maintaining a GnuCash database in a MySQL database for several
> > years. Lately, I've noticed various stages of OFX import (including
> > changing accounts, but also hitting the "OK" button to finish the import)
> > taking more and more time. When on the same LAN as the database it's bad,
> > perhaps 10 seconds, but when SSH tunnelling from a remote location the
> > delay becomes truly ridiculous, on the order of 10 to 20 minutes.
> >
> > Peeking at what's going on with tcpdump, it looks like for an import of
> > around 50 items clicking the ok button triggers thousands coupon thousand
> > of SQL inserts, the vast majority of which are somehow related to
> updating
> > the bayesian inference database.
> >
> > My questions are:
> >
> > (1) Anyone else seeing this? I feel like I must have hit some sort of
> > quadratic threshold because as I said I've been using this for literally
> > years and only recently has it gotten noticeably worse.
> > (2) Workarounds: Is there some reasonable way to prevent OFX import from
> > doing these updates at all? Failing that, is there some way to safely
> nuke
> > *just* the bayesian inference DB and start over (short of starting a
> > completely new GnuCash db?). This isn't my ideal solution but it might
> buy
> > me some time.
> > (3) Clearly "accessing an SQL DB, remotely, across the internet" is not a
> > core use case compared to updating a local GnuCash file. But might be a
> > good performance work issue for some interested person who wants to
> > contribute to an open source project to poke at.
> >
> > Thanks!
> > -Peter
> >
> _______________________________________________
> gnucash-user mailing list
> gnucash-user at gnucash.org
> To update your subscription preferences or to unsubscribe:
> https://lists.gnucash.org/mailman/listinfo/gnucash-user
> -----
> Please remember to CC this list on all your replies.
> You can do this by using Reply-To-List or Reply-All.
>


-- 
David Carlson