[GNC] Gnucash 5.1 Online Quotes not working
Thornefamilytrust at bigpond.com
Thornefamilytrust at bigpond.com
Thu Jun 1 23:47:27 EDT 2023
Hi Kalpesh,
Thanks for your help hopefully the following helps
The following is what happened.
Running Win 10 this has not changed see attached for PC / Win details.
Running previous Gnucash 4.xx latest version and quotes were working fine.
Upgraded Gnucash V5.0 Quotes 26Apr23 stopped working waited for V5.1 and
upgraded still not working but.
* Was able to run CMD and get F:Q commodity information.
* Was able to create new clean Gnucash project and "retrieve Online
Quotes".
Went back to my main project and .
* Tried deleting commodities in security editor as below, couldn't as
error came up that commodity was in use
* Switched off all "retrieve Online Quotes" in current project.
* Switched back one at a time and changed from single source to
multi-source.
* F:Q started to work again - have now got all commodities back
working
* Switched all commodities back to single source ASX for Aus and
Alphavantage for US commodities.
Have auto backup set but only keeps last 30 days logs an files - last I have
is 22May2023
Attached two log files when not working (May) and one when working (Jun)
From: Kalpesh Patel <kalpesh.patel at usa.net>
Sent: Thursday, June 1, 2023 9:05 PM
To: Thornefamilytrust at bigpond.com; 'Murugan Muruganandam'
<m.muruganandam at hotmail.com>; 'David H' <hellvee at gmail.com>
Cc: gnucash-user at gnucash.org
Subject: RE: [GNC] Gnucash 5.1 Online Quotes not working
Hi Kevin -
I am glad it is sorted out and working now, in workaround that is a bit of a
pain.
That behavior though seems odd. I lodge a bug on it at
https://bugs.gnucash.org/.
Just to understand what actions manifested the issue - did you upgrade the
version of GNC, moved it over from one platform (windows, Linux or mac ) to
another, bulk import the securities or anything else by chance? If you have
an earlier version of the file somewhere (you did enable auto-backup, right)
then worth attaching to the bug report. If the file has sensitive data then
you can reach out to dev team (on this list) to see how they like you to
provide a sample so that they can reproduce. There is anonymizing the data
process but I am leaning that it may change things to auto-magically fix the
issue and loose an opportunity to get to root of the bug.
From: Thornefamilytrust at bigpond.com <mailto:Thornefamilytrust at bigpond.com>
<Thornefamilytrust at bigpond.com <mailto:Thornefamilytrust at bigpond.com> >
Sent: Thursday, June 01, 2023 12:17 AM
To: 'Kalpesh Patel' <kalpesh.patel at usa.net <mailto:kalpesh.patel at usa.net> >;
'Murugan Muruganandam' <m.muruganandam at hotmail.com
<mailto:m.muruganandam at hotmail.com> >; 'David H' <hellvee at gmail.com
<mailto:hellvee at gmail.com> >
Cc: gnucash-user at gnucash.org <mailto:gnucash-user at gnucash.org>
Subject: RE: [GNC] Gnucash 5.1 Online Quotes not working
Hi Kaplesh,
Had to switch off each get online quotes for all commodities in price editor
and then switch each one on again one at a time and they started updating!!
From: Kalpesh Patel <kalpesh.patel at usa.net <mailto:kalpesh.patel at usa.net> >
Sent: Saturday, May 27, 2023 6:32 AM
To: Thornefamilytrust at bigpond.com <mailto:Thornefamilytrust at bigpond.com> ;
'Murugan Muruganandam' <m.muruganandam at hotmail.com
<mailto:m.muruganandam at hotmail.com> >; 'David H' <hellvee at gmail.com
<mailto:hellvee at gmail.com> >
Cc: gnucash-user at gnucash.org <mailto:gnucash-user at gnucash.org>
Subject: RE: [GNC] Gnucash 5.1 Online Quotes not working
Kevin -
Given that the price retrieval facility is known to work correctly, only
scenario I can think of is that there might be two different definition of
the same security under two different namespace and that might be colliding
with each other. Only other trial I can suggest is that delete the security
in the file where it is not working, close GNC, relaunch and add the
security back in again. Before removing the security, I HIGHLY recommend you
create backup (multiple of them) to restore back if other things break in
this process.
Otherwise I am out of wits and I think the folks that are in-&-in (hint
development team) thick of the things may need to help debug as I think for
me this is first time I am coming across a scenario where a security price
can and cannot be retrieved is function of which file is open. This is NOT
how it supposed to function )-: .
The remotest thing that comes to mind is that something might be corrupt
semantically within a file provided that it is being stored in XML format.
Only thought that comes to mind in that case is -- sadly too painful - to
export out all data using CSV format and then import it back in as CSV
starting with accounts first and then transaction.
The other alternative I can suggest is to run an offline python script that
I've written and import prices in as CSV afterwards. See
https://github.com/ka-patel/dl_quotes repo for details.
From: Thornefamilytrust at bigpond.com <mailto:Thornefamilytrust at bigpond.com>
<Thornefamilytrust at bigpond.com <mailto:Thornefamilytrust at bigpond.com> >
Sent: Thursday, May 25, 2023 9:23 PM
To: 'Kalpesh Patel' <kalpesh.patel at usa.net <mailto:kalpesh.patel at usa.net> >;
'Murugan Muruganandam' <m.muruganandam at hotmail.com
<mailto:m.muruganandam at hotmail.com> >; 'David H' <hellvee at gmail.com
<mailto:hellvee at gmail.com> >
Cc: gnucash-user at gnucash.org <mailto:gnucash-user at gnucash.org>
Subject: RE: [GNC] Gnucash 5.1 Online Quotes not working
Kalpesh -
Some success .
My perl location the same as below
Setup clean GNU with BRK-B using Alphavantage and ANZ with ASX the price for
both updates when running the Get Quotes
But . using same settings in current GNU file there I can still not update
quotes
From: Kalpesh Patel <kalpesh.patel at usa.net <mailto:kalpesh.patel at usa.net> >
Sent: Wednesday, May 24, 2023 11:21 PM
To: 'Murugan Muruganandam' <m.muruganandam at hotmail.com
<mailto:m.muruganandam at hotmail.com> >; Thornefamilytrust at bigpond.com
<mailto:Thornefamilytrust at bigpond.com> ; 'David H' <hellvee at gmail.com
<mailto:hellvee at gmail.com> >
Cc: gnucash-user at gnucash.org <mailto:gnucash-user at gnucash.org>
Subject: RE: [GNC] Gnucash 5.1 Online Quotes not working
Kevin -
In addition to below what Murugan has mentioned . two additional items to
try:
1. Check which perl is GNC using (this is to eliminate munged up path
or GNC is looking at different Perl install base - unlikely but validation
won't hurt)
To do so, type in following in an clean CMD window:
where Perl
This for me returns back 'C:\Strawberry\Perl\bin\perl.exe'
2. Start with a clean slate in GNC . also recommend that you fully turn
off Norton mal-ware/anti-virus software for duration of this clean slate
test.
a. Open GNC
Select 'File' -> 'New File' (select default all the way through and save the
file as 'test' or something like that at a known location in a separate
folder. You'll want to delete the folder once test is over)
b. Define the 'Berkshire Hathaway Inc Class B' security as previously
mentioned and only this one security precisely as detailed in prior email.
c. Update prices
d. Review if prices got retrieved
Few notes:
On 'Change the symbol for Berkshire to BRK.B from BRK-B', for me when the
source is set to 'Yahoo as JSON', BRK-B (one with the dash) retrieves
prices. There is likely a chance that different price sourcer might set the
symbol format differently - this is the experimentation part which is to
figure out what security works with which price source as mentioned earlier
in the thread. If you want an alternate that does not have a complication of
different classes of security then try the below simpler one:
Security Information:
Full Name: BANK OF NEW YORK MELLON CORP COM
Symbol/abbreviation: BK
Display symbol: BK
Namespace: NYSE
ISIN, CUSIP or other code: <blank>
Fraction traded 1/:1000
Quote Source Information:
--tick 'Get Online Quotes'
Type of quote source:
--click 'Single' and field next to it needs to read 'Yahoo
as JSON' (scroll down the drop down by clicking the arrow on the right side
and then select it from the list. )
Timezone: Use local time
Prices pull for 'BRK-B' via 'Yahoo as JSON' source was working for me as of
this writing but your mileage may very if Yahoo is in middle of shutdown of
v6 spigot (David H mentioned this).
From: Murugan Muruganandam <m.muruganandam at hotmail.com
<mailto:m.muruganandam at hotmail.com> >
Sent: Wednesday, May 24, 2023 10:49 AM
To: Thornefamilytrust at bigpond.com <mailto:Thornefamilytrust at bigpond.com> ;
'David H' <hellvee at gmail.com <mailto:hellvee at gmail.com> >
Cc: 'Kalpesh Patel' <kalpesh.patel at usa.net <mailto:kalpesh.patel at usa.net> >;
gnucash-user at gnucash.org <mailto:gnucash-user at gnucash.org>
Subject: Re: [GNC] Gnucash 5.1 Online Quotes not working
couple of things from your screen shots
1. Change the symbol for Berkshire to BRK.B from BRK-B
2. for ANZ choose single quote and exchange as Australian Stock
Exchange, AU
Saludos Cordiales
Murugan
_____
From: gnucash-user
<gnucash-user-bounces+m.muruganandam=hotmail.com at gnucash.org
<mailto:gnucash-user-bounces+m.muruganandam=hotmail.com at gnucash.org> > on
behalf of Thornefamilytrust at bigpond.com
<mailto:Thornefamilytrust at bigpond.com> <Thornefamilytrust at bigpond.com
<mailto:Thornefamilytrust at bigpond.com> >
Sent: Wednesday, May 24, 2023 3:43 AM
To: 'David H' <hellvee at gmail.com <mailto:hellvee at gmail.com> >
Cc: 'Kalpesh Patel' <kalpesh.patel at usa.net <mailto:kalpesh.patel at usa.net> >;
gnucash-user at gnucash.org <mailto:gnucash-user at gnucash.org>
<gnucash-user at gnucash.org <mailto:gnucash-user at gnucash.org> >
Subject: Re: [GNC] Gnucash 5.1 Online Quotes not working
Thanks David that works - still no online quotes in Gnucash
I can run gnucash-cli from the CMD and get the desired results for ASX and
ALPHAVANTAGE as per attached, but no online quotes within Gnucash - see
settings attached.
Is there another step I need to do in Gnucash to get this to work?
From: David H <hellvee at gmail.com <mailto:hellvee at gmail.com> >
Sent: Wednesday, May 24, 2023 1:07 PM
To: Thornefamilytrust at bigpond.com <mailto:Thornefamilytrust at bigpond.com>
Cc: Kalpesh Patel <kalpesh.patel at usa.net <mailto:kalpesh.patel at usa.net> >;
gnucash-user at gnucash.org
Subject: Re: [GNC] Gnucash 5.1 Online Quotes not working
It's a windows exe and you'll need double quotes around the path name
because of the embedded spaces - see Geert's email -
https://lists.gnucash.org/pipermail/gnucash-user/2023-May/106961.html
Try the following in a windows command prompt, you should see similar
results....
Cheers David H.
C:\Users\David>"c:\Program Files (x86)\gnucash\bin\gnucash-cli" --quotes
info
Found Finance::Quote version 1.55.
Finance::Quote sources:
aex alphavantage amfiindia asegr asx
aufunds australia bamosz bet bloomberg bourso
bse bseindia canada canadamutual comdirect
cse deka dutch dwsfunds europe
fetch_live_currencies fidelity fidelity_direct
finanzpartner fondsweb fool france ftfunds
fundata fundlibrary goldmoney greece hu hufund
hungary hustock iexcloud india indiamutual
known_currencies morningstarau morningstarch
morningstarjp mstaruk nasdaq nseindia nyse
nzx onvista oslobors romania seb_funds sinvestor
six tesouro_direto tiaacref tmx tradegate
tradeville treasurydirect troweprice troweprice_direct
tsp tsx ukfunds unionfunds usa xetra
yahoo_json za
On Wed, 24 May 2023 at 14:48, <Thornefamilytrust at bigpond.com
<mailto:Thornefamilytrust at bigpond.com> > wrote:
Hi David,
Thanks that makes sense and yes gnc-fq-check no longer exists
Am I able to run gnucash-cli?
I cant get it to work manually? See attached
From: David H <hellvee at gmail.com <mailto:hellvee at gmail.com> >
Sent: Wednesday, May 24, 2023 12:37 PM
To: Thornefamilytrust at bigpond.com <mailto:Thornefamilytrust at bigpond.com>
<mailto:Thornefamilytrust at bigpond.com>
Cc: Kalpesh Patel <kalpesh.patel at usa.net <mailto:kalpesh.patel at usa.net> >;
gnucash-user at gnucash.org <mailto:gnucash-user at gnucash.org>
<mailto:gnucash-user at gnucash.org>
Subject: Re: [GNC] Gnucash 5.1 Online Quotes not working
Hi Kevin,
Note that Gnucash Get Quotes has been completely rewritten so there is no
longer a gnc-fq-check script in gnucash version 5 that's why you are
getting the error, check your C:\Program Files (x86)\gnucash\bin folder -
this was mentioned in the release notes :-) There's only gnc-fq-update and
gnc-path-check (which you can't run manually apparently) now so probably
nothing wrong with your Perl install.
Cheers David H.
On Wed, 24 May 2023 at 10:53, <Thornefamilytrust at bigpond.com
<mailto:Thornefamilytrust at bigpond.com> > wrote:
Hi,
In addition to the below, when I try to run a PERL command it also fails,
previously with v4.xx this was possible?
See attached
-----Original Message-----
From: Thornefamilytrust at bigpond.com <mailto:Thornefamilytrust at bigpond.com>
<mailto:Thornefamilytrust at bigpond.com> <Thornefamilytrust at bigpond.com
<mailto:Thornefamilytrust at bigpond.com> >
Sent: Wednesday, May 24, 2023 8:42 AM
To: 'Kalpesh Patel' <kalpesh.patel at usa.net <mailto:kalpesh.patel at usa.net> >
Cc: 'gnucash-user at gnucash.org <mailto:gnucash-user at gnucash.org> '
<gnucash-user at gnucash.org <mailto:gnucash-user at gnucash.org> >
Subject: RE: [GNC] Gnucash 5.1 Online Quotes not working
Hi,
I have those exact settings selected as below and it's not updating see
attached
Last update was with v4.xx in April 2023 see attached.
Previously with V4.xx was working fine, all I have done is upgrade to v5.1,
uninstall Perl and run the online price retrieval tool which has reinstalled
the latest Perl.
Nothing else on my PC has changed and still running Norton with the same
settings as previously.
-----Original Message-----
From: Kalpesh Patel <kalpesh.patel at usa.net <mailto:kalpesh.patel at usa.net> >
Sent: Tuesday, May 23, 2023 9:36 PM
To: Thornefamilytrust at bigpond.com <mailto:Thornefamilytrust at bigpond.com>
<mailto:Thornefamilytrust at bigpond.com>
Cc: gnucash-user at gnucash.org <mailto:gnucash-user at gnucash.org>
Subject: RE: [GNC] Gnucash 5.1 Online Quotes not working
If it is "seems to do something for a while 30-60 sec then the Perl wind
closes without any errors" then your quote retrieving facility is most
likely working correctly and retrieving prices. Re-running install script
and displaying the info you list is further concurrence that the quote
retrieving facility is working fine. Here most likely is case of security
definition having incorrect ticker symbol or the source you are selecting
does not carry prices for it. Try adding a known security with a known
source and see if it retrieves prices or not (see below known to work for
me). If it does not retrieve prices even after that then there is likely a
third party malware protection installed on your system which is blocking
networking connection to the source to retrieve prices.
Here is the security definition...
Security Information
Full Name: Berkshire Hathaway Inc Class B
Symbol/abbreviation: BRK-B
Display symbol: BRK-B
Namespace: NYSE (note: type in 'NYSE' if it is not found in the drop
down)
ISIN,CUSIP or other code: (leave it blank)
Fraction traded 1/:100000
Quote Source Information:
--tick 'Get Online Quotes'
Type of quote source:
--click 'Single' and field next to it needs to read 'Yahoo
as JSON' (scroll down the drop down by clicking the arrow on the right side
and then select it from the list. )
Timezone: Use local time
Update the prices (Tools -> Price Database --> click 'Get Quotes' button)
and then review it in that window whether price was retrieved or not. Expand
the 'NYSE' namespace and underneath it you should see BRK-B. Click arrow to
the left of 'BRK-B' to see prices that GNC has collected so far. If nothing
is there then most likely a third party malware protection (or a malware)
is restricting connection. If prices were retrieved then you need to
ascertain correct source and symbol by means of experimentation for the
security that is of interest for which prices retrieval has eluded you so
far.
-----Original Message-----
From: Thornefamilytrust at bigpond.com <mailto:Thornefamilytrust at bigpond.com>
<mailto:Thornefamilytrust at bigpond.com> <Thornefamilytrust at bigpond.com
<mailto:Thornefamilytrust at bigpond.com> >
Sent: Monday, May 22, 2023 9:22 PM
To: gnucash-user at gnucash.org <mailto:gnucash-user at gnucash.org>
<mailto:gnucash-user at gnucash.org>
Subject: [GNC] Gnucash 5.1 Online Quotes not working
Hi,
I have re-tried by installing Gnucash v5.1 on my Win 10 machine to get
online quotes to work.
Upgraded from 4.XX to 5.1 uninstalled Strawberry and ran the "Install Online
Price retrieval" tool for Gnucash. This reinstalled Strawberry Perl , F:Q
etc
but all I get when clicking Get Quotes within Gnucash is the Perl window
opens and seems to do something for a while 30-60 sec then the Perl wind
closes without any errors - the quotes have not been updated.
System:
Win 10
Gnucash 5.1
F:Q 1.55
Re-running "Install Online Price retrieval" tool for Gnucash produces the
following
*Check Perl
* Check Perl version
* Install required perl modules
Database was generated on Mon, 22 May 2023 03:35:21 GMT
Test2 is up to date (1.302195).
Finance::Quote is up to date (1.55).
JSON::Parse is up to date (0.62).
* Check environment variable ALPHAVANTAGE_API_KEY
***
*** You need an API key (from https://www.alphavantage.co)
*** to run the Perl module Finance::Quote.
***
*** Make it available to GnuCash by
*** - setting the environment variable ALPHAVANTAGE_API_KEY or
*** - starting GnuCash and adding the Alpha Vantage api key in
*** Edit->Preferences->Online Quotes
***
* Installation succeeded
Press any key to continue . . .
I have set the Alphavantage Key in Gnucash and can see it in preferences.
Not sure what to do to get this working - please assist.
Regards
Kevin
_______________________________________________
gnucash-user mailing list
gnucash-user at gnucash.org <mailto:gnucash-user at gnucash.org>
<mailto:gnucash-user at gnucash.org>
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
-----
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Win 10 Screenshot 2023-06-02 111542.jpg
Type: image/jpeg
Size: 14928 bytes
Desc: not available
URL: <http://lists.gnucash.org/pipermail/gnucash-user/attachments/20230602/6dc1a52f/attachment-0002.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: TFT.gnucash.20230526144906.log
Type: application/octet-stream
Size: 900 bytes
Desc: not available
URL: <http://lists.gnucash.org/pipermail/gnucash-user/attachments/20230602/6dc1a52f/attachment-0003.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: TFT.gnucash.20230526145001.log
Type: application/octet-stream
Size: 592 bytes
Desc: not available
URL: <http://lists.gnucash.org/pipermail/gnucash-user/attachments/20230602/6dc1a52f/attachment-0004.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: TFT.gnucash.20230601171759.log
Type: application/octet-stream
Size: 1359 bytes
Desc: not available
URL: <http://lists.gnucash.org/pipermail/gnucash-user/attachments/20230602/6dc1a52f/attachment-0005.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: System Screenshot 2023-06-02 111505.jpg
Type: image/jpeg
Size: 9583 bytes
Desc: not available
URL: <http://lists.gnucash.org/pipermail/gnucash-user/attachments/20230602/6dc1a52f/attachment-0003.jpg>
More information about the gnucash-user
mailing list