[GNC] OFX Import with Investment Transactions

Tue Oct 5 10:25:04 EDT 2021

I loaded up 4.8 version of GnuCash on another computer last night and imported one of the file that is most complex that had failed to import properly on 4.5 version of GnuCash. Good news is that where I was seeing 4.5 failing to import all transactions appears to be fixed in 4.8 and loaded all transactions properly. I imported same file in both, version 4.4 where it is known to work correctly, and in 4.8 and they both give the same end results after importing them into a clean new files. I will test out two more files which are not as complex as the one that is already tried one. Only case I am not able to test is the one with multiple accounts in the same ofx file where it is part of the same session. I will be testing multiple ofx files concatenated into a single file and import it in to see the end results. I’ll report back.

From: Roger Moore <ripngo at gmail.com> 
Sent: Sunday, October 03, 2021 11:50 PM
To: john <jralls at ceridwen.us>
Cc: Robin Chattopadhyay <robinraymn at gmail.com>; Kalpesh Patel <kalpesh.patel at usa.net>; Gnucash Users <gnucash-user at gnucash.org>
Subject: Re: [GNC] OFX Import with Investment Transactions

There was indeed a bug so I opened https://bugs.gnucash.org/show_bug.cgi?id=798327 and created a PR with a simple fix.

I verified that on the file that Robin provided the import continues as expected for all 11 securities.

On Sun, Oct 3, 2021 at 2:21 PM john <jralls at ceridwen.us> wrote:

That sounds like https://bugs.gnucash.org/show_bug.cgi?id=798208 <https://bugs.gnucash.org/show_bug.cgi?id=798208>, which is fixed in GnuCash 4.8.

Regards,
John Ralls

> On Oct 3, 2021, at 9:19 AM, Robin Chattopadhyay <robinraymn at gmail.com <mailto:robinraymn at gmail.com> > wrote:
> 
> Yes, I'm familiar with that issue as well as my spouse's 401K OFX has fee
> transactions where shares are sold to pay plan expenses, but those
> transactions appear only as cash withdrawals and the sale transactions do
> not get imported.
> 
> That one doesn't bother me as much because it's one transaction per month
> vs 9 every two weeks.
> 
> On Sun, Oct 3, 2021 at 11:04 AM Kalpesh Patel <kalpesh.patel at usa.net <mailto:kalpesh.patel at usa.net> > wrote:
> 
>> The issues that you are seeing I believe has to do with changes that OFX
>> introduced in libofx which has been included since 4.5 and above version of
>> GnuCash. FWIW, I am running on Windows 10 Pro desktop but that likely
>> doesn't matter when it comes to core functionality.
>> 
>> I also had problems where some of transactions would not get imported in
>> from an OFX file and these transactions I deduced from trial and error are
>> specifically if they are related to deposit and withdrawal of cash in Stock
>> or Mutual Fund account. I am not sure if this is the behavior on your end
>> or
>> not but it sounds like it. This might be because libofx author may have
>> changed philosophy and its implementation where cash in and out are not
>> considered investment transactions such as buy and sell of a stock, bond,
>> mutual fund, etc.
>> 
>> Because of that I have stayed at GnuCash 4.4 (specifically Build ID:
>> 4.4+(2020-12-28) for Windows) which I have known to properly import
>> brokerage created OFX files for import. I've reached out to the author of
>> libofx for understanding and I am still waiting to hear back from them.
>> 
>> It may be worth a shot to install that version and see if it imports OFX
>> correctly. If you have a blank file then it should ask for appropriate
>> input
>> via dialogue box such as creation of "securities", corresponding
>> "brokerage"
>> account, etc. You can then go back and edit those "security" and enable
>> download of prices using Finance::Quote Perl module with yahoo_jason as the
>> source for it if you want to automate it.
>> 
>> For FWIW, GnuCash 4.5 on windows used to crash when 'Actions' --> 'Check &
>> Repair' --> 'Check & Repair All' would be selected to run which I do now
>> and
>> then to make sure that my xml based file is in good shape (this is carry
>> over habit from Quicken as it was known to corrupt files).
>> 
>> This may not be the answer you are looking for but hope this helps a bit.
>> 
>> Kalpesh...
>> 
>> ------------------------------
>> 
>> Message: 2
>> Date: Sat, 2 Oct 2021 10:58:44 -0500
>> From: Robin Chattopadhyay <robinraymn at gmail.com <mailto:robinraymn at gmail.com> >
>> To: Gnucash Users <gnucash-user at gnucash.org <mailto:gnucash-user at gnucash.org> >
>> Subject: [GNC] OFX Import with Investment Transactions
>> Message-ID:
>>        <CACYeXFv+kFMZqDqB2czLz_tT9Z8=
>> 7Jjed1Oqxw_jPqssxjxG1Q at mail.gmail.com <mailto:7Jjed1Oqxw_jPqssxjxG1Q at mail.gmail.com> >
>> Content-Type: text/plain; charset="UTF-8"
>> 
>> Ubuntu 20.04 LTS (VMWare virtual machine in case that matters) Gnucash 4.8
>> libofx 0.9.15
>> 
>> I tried importing an OFX file from my 401K provider this morning and I got
>> a
>> message box that said it had imported 2 transactions for a single security
>> in the file and there were no additional transactions to process.
>> This was incorrect as there were 18 new transactions across nine securities
>> (along with a number of other transactions that had already been imported
>> previously).
>> 
>> I tried a number of things to resolve (after taking a backup, of course):
>> 1 - Tools > Import Map Editor and deleted all of the associations for this
>> file. When I re-imported, I was prompted to map each security in the file
>> to
>> the correct account. No issues there. But when importing the OFX file
>> again,
>> I had the same experience as described above
>> 2 - Created a blank file and attempted to import the file there. Through
>> the
>> import process, I created new securities and new accounts, nothing
>> unexpected there. Then the generic transaction importer dialog popped up,
>> but with just the two transactions for the same security cited in the
>> original problem dialog. I imported those, clicked OK and then the generic
>> transaction importer dialog came up *again* but only with transactions for
>> a
>> single, different security. I imported those and repeated the process for
>> each security with transactions in the file. Each time the generic
>> transaction importer dialog came up, it only had transactions for a single
>> security. This is definitely new behavior that I didn't see in 4.6.
>> Previously the import dialog had all the new transactions in the file
>> 3 - Reverted to 4.7. Crashed when selecting Import from the File menu
>> (Trace/breakpoint trap (core dumped). Not unexpected, but thought I would
>> try anyway.
>> 4 - Reverted to 4.6. This works as it used to with all the new transactions
>> in a single dialog
>> 
>> Finally, I don't know if this matters, but I scanned stdout from the
>> build/make/install process to see if anything looked obviously wrong and I
>> found this (I don't know if it's relevant):
>> 
>> -- Performing Test HAVE_OFX_BUG_39
>> -- Performing Test HAVE_OFX_BUG_39 - Failed
>> 
>> Thanks,
>> Robin
>> 
>> 
>> 
>> 
> _______________________________________________
> gnucash-user mailing list
> gnucash-user at gnucash.org <mailto:gnucash-user at gnucash.org> 
> To update your subscription preferences or to unsubscribe:
> https://lists.gnucash.org/mailman/listinfo/gnucash-user
> If you are using Nabble or Gmane, please see https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
> -----
> Please remember to CC this list on all your replies.
> You can do this by using Reply-To-List or Reply-All.

_______________________________________________
gnucash-user mailing list
gnucash-user at gnucash.org <mailto:gnucash-user at gnucash.org> 
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
If you are using Nabble or Gmane, please see https://wiki.gnucash.org/wiki/Mailing_Lists for more information.
-----
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.