[GNC] SQLLite + OFX Import + Bayes = Massive network traffic

[john]

You can remove Bayesian matches using Tools>Import Map Editor. 

Regards,
John Ralls


> On Apr 5, 2023, at 4:37 PM, peterb <peterb at gmail.com> wrote:
> 
> Good point. Mac OS X, Gnucash 4.11.
> 
> On Wed, Apr 5, 2023 at 6:00 PM David Carlson <david.carlson.417 at gmail.com>
> wrote:
> 
>> I am not sure which OS TCPDump runs in, but it would still be very helpful
>> to list which version of GnuCash you are running and which OS.
>> 
>> On Wed, Apr 5, 2023 at 2:45 PM peterb <peterb at gmail.com> wrote:
>> 
>>> Also, despite my error in the Subject: line of this post, I did
>>> actually meant MySQL, and *not* SQLite.
>>> 
>>> 
>>> On Wed, Apr 5, 2023 at 2:35 PM peterb <peterb at gmail.com> wrote:
>>> 
>>>> I've been maintaining a GnuCash database in a MySQL database for several
>>>> years. Lately, I've noticed various stages of OFX import (including
>>>> changing accounts, but also hitting the "OK" button to finish the
>>> import)
>>>> taking more and more time. When on the same LAN as the database it's
>>> bad,
>>>> perhaps 10 seconds, but when SSH tunnelling from a remote location the
>>>> delay becomes truly ridiculous, on the order of 10 to 20 minutes.
>>>> 
>>>> Peeking at what's going on with tcpdump, it looks like for an import of
>>>> around 50 items clicking the ok button triggers thousands coupon
>>> thousand
>>>> of SQL inserts, the vast majority of which are somehow related to
>>> updating
>>>> the bayesian inference database.
>>>> 
>>>> My questions are:
>>>> 
>>>> (1) Anyone else seeing this? I feel like I must have hit some sort of
>>>> quadratic threshold because as I said I've been using this for literally
>>>> years and only recently has it gotten noticeably worse.
>>>> (2) Workarounds: Is there some reasonable way to prevent OFX import from
>>>> doing these updates at all? Failing that, is there some way to safely
>>> nuke
>>>> *just* the bayesian inference DB and start over (short of starting a
>>>> completely new GnuCash db?). This isn't my ideal solution but it might
>>> buy
>>>> me some time.
>>>> (3) Clearly "accessing an SQL DB, remotely, across the internet" is not
>>> a
>>>> core use case compared to updating a local GnuCash file. But might be a
>>>> good performance work issue for some interested person who wants to
>>>> contribute to an open source project to poke at.
>>>> 
>>>> Thanks!
>>>> -Peter
>>>> 
>>> _______________________________________________
>>> gnucash-user mailing list
>>> gnucash-user at gnucash.org
>>> To update your subscription preferences or to unsubscribe:
>>> https://lists.gnucash.org/mailman/listinfo/gnucash-user
>>> -----
>>> Please remember to CC this list on all your replies.
>>> You can do this by using Reply-To-List or Reply-All.
>>> 
>> 
>> 
>> --
>> David Carlson
>> 
> _______________________________________________
> gnucash-user mailing list
> gnucash-user at gnucash.org
> To update your subscription preferences or to unsubscribe:
> https://lists.gnucash.org/mailman/listinfo/gnucash-user
> -----
> Please remember to CC this list on all your replies.
> You can do this by using Reply-To-List or Reply-All.