[GNC] SQLLite + OFX Import + Bayes = Massive network traffic
peterb
peterb at gmail.com
Wed Apr 5 14:35:20 EDT 2023
I've been maintaining a GnuCash database in a MySQL database for several
years. Lately, I've noticed various stages of OFX import (including
changing accounts, but also hitting the "OK" button to finish the import)
taking more and more time. When on the same LAN as the database it's bad,
perhaps 10 seconds, but when SSH tunnelling from a remote location the
delay becomes truly ridiculous, on the order of 10 to 20 minutes.
Peeking at what's going on with tcpdump, it looks like for an import of
around 50 items clicking the ok button triggers thousands coupon thousand
of SQL inserts, the vast majority of which are somehow related to updating
the bayesian inference database.
My questions are:
(1) Anyone else seeing this? I feel like I must have hit some sort of
quadratic threshold because as I said I've been using this for literally
years and only recently has it gotten noticeably worse.
(2) Workarounds: Is there some reasonable way to prevent OFX import from
doing these updates at all? Failing that, is there some way to safely nuke
*just* the bayesian inference DB and start over (short of starting a
completely new GnuCash db?). This isn't my ideal solution but it might buy
me some time.
(3) Clearly "accessing an SQL DB, remotely, across the internet" is not a
core use case compared to updating a local GnuCash file. But might be a
good performance work issue for some interested person who wants to
contribute to an open source project to poke at.
Thanks!
-Peter
More information about the gnucash-user
mailing list