Re: [GNC] Crash when importing OFX file from Bank of America

2022-10-01 Thread William Starrs
Thank you,

done:
*Bug 798629* <https://bugs.gnucash.org/show_bug.cgi?id=798629> - gnucash
crashes attempting to import OFX file (edit
<https://bugs.gnucash.org/show_bug.cgi?id=798629#>)

Best regards,

Bill

On Sat, Oct 1, 2022 at 1:37 PM john  wrote:

>
>
> On Oct 1, 2022, at 8:26 AM, William Starrs  wrote:
>
> Hello all,
>
> I have been downloading and importing OFX (QFX) files from BofA nightly for
> many years.  Starting a few days ago, it crashes when attempting.  This is
> for a checking account.
>
> I do the same for Chase and Amex Credit Cards without issue.  Here is what
> I see in the terminal:
>
> -
>
>
> 1 ./gnucash_error.txt+ 
>   Bufs
> (Above message occurred on Line 2, Column 1)
> LibOFX INFO: Created OfxDummyContainer to hold unsupported aggregate SONRS
> (Above message occurred on Line 3, Column 1)
> LibOFX INFO: Created OfxDummyContainer to hold unsupported aggregate FI
> (Above message occurred on Line 11, Column 1)
> LibOFX INFO: Created OfxDummyContainer to hold unsupported aggregate
> BANKMSGSRSV1
> (Above message occurred on Line 17, Column 1)
> LibOFX INFO: Created OfxDummyContainer to hold unsupported aggregate
> STMTTRNRS
> (Above message occurred on Line 18, Column 1)
> free(): double free detected in tcache 2
>
> [1]  + 1959188 IOT instruction (core dumped)  gnucash
>
> ---
>
> Here is the header of the OFX file that I download:
>
> OFXHEADER:100
> DATA:OFXSGML
> VERSION:102
> SECURITY:NONE
> ENCODING:USASCII
> CHARSET:1252
> COMPRESSION:NONE
> OLDFILEUID:NONE
> NEWFILEUID:NONE
>
>
> I tried running ofxdump (command line tool from libofx) against the
> downloaded file and it gave those same INFO warnings but did not crash, and
> successfully parsed out the account info, statement info, and transactions.
>
> The only error that appeared in the GNUcash trace that was not in the
> ofxdump was the last line:
>
> free(): double free detected in tcache 2
>
> I have no clue what that pertains to.
>
>
> Any help would be much appreciated.
>
>
> The double-free detected error seems to be a feature of the Linux C
> runtime. It's a good clue, double-frees are a definite crasher.
>
> Please open a bug report[1] and attach a stack trace[2].
>
> Regards,
> John Ralls
> [1]
> https://wiki.gnucash.org/wiki/Bugzilla#Commenting_on_existing_bugs_or_entering_new_ones
> [2] https://wiki.gnucash.org/wiki/Stack_Trace
>
>
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.


[GNC] Crash when importing OFX file from Bank of America

2022-10-01 Thread William Starrs
Hello all,

I have been downloading and importing OFX (QFX) files from BofA nightly for
many years.  Starting a few days ago, it crashes when attempting.  This is
for a checking account.

I do the same for Chase and Amex Credit Cards without issue.  Here is what
I see in the terminal:

-


 1 ./gnucash_error.txt+ 
   Bufs
(Above message occurred on Line 2, Column 1)
LibOFX INFO: Created OfxDummyContainer to hold unsupported aggregate SONRS
(Above message occurred on Line 3, Column 1)
LibOFX INFO: Created OfxDummyContainer to hold unsupported aggregate FI
(Above message occurred on Line 11, Column 1)
LibOFX INFO: Created OfxDummyContainer to hold unsupported aggregate
BANKMSGSRSV1
(Above message occurred on Line 17, Column 1)
LibOFX INFO: Created OfxDummyContainer to hold unsupported aggregate
STMTTRNRS
(Above message occurred on Line 18, Column 1)
free(): double free detected in tcache 2

[1]  + 1959188 IOT instruction (core dumped)  gnucash

---

Here is the header of the OFX file that I download:

OFXHEADER:100
DATA:OFXSGML
VERSION:102
SECURITY:NONE
ENCODING:USASCII
CHARSET:1252
COMPRESSION:NONE
OLDFILEUID:NONE
NEWFILEUID:NONE


I tried running ofxdump (command line tool from libofx) against the
downloaded file and it gave those same INFO warnings but did not crash, and
successfully parsed out the account info, statement info, and transactions.

The only error that appeared in the GNUcash trace that was not in the
ofxdump was the last line:

free(): double free detected in tcache 2

I have no clue what that pertains to.


Any help would be much appreciated.

Thanks,

Bill
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.


Re: [GNC] Date error running report from gnucash-cli, report runs fine in GUI

2022-10-01 Thread William Starrs
Hello Geoff,

Piecash works like a charm.  The gnucash-cli still will not work, but it is
actually more efficient and powerful to use piecash, so I'll just go with
that.

Thanks for your help.

On Wed, Sep 21, 2022 at 9:00 AM William Starrs 
wrote:

> Hi Geoff,
>
> I had tested hard-coded dates in the saved reports as well, none of them
> work.  I'm running GC 4.11 on Archlinux.
>
> If piecash works, I"ll just go to that.  I currently have other reports
> (also transaction reports) working this way fine, but I have to scrape the
> html file with BeautifulSoup to complete my summaries.  If I can just
> directly get the data without those steps it will be better all around.  I
> may still try to generate some logs to see why it's not playing nice.
>
> Thanks,
>
> Bill
>
> On Wed, Sep 21, 2022 at 8:06 AM Geoff  wrote:
>
>> Hmmm
>>
>> I've just tested a saved report (Transaction Report) and it worked OK:
>>
>> "C:\Program Files (x86)\gnucash\bin\gnucash-cli" -R run --name "Saved
>> Report" --output-file "C:\Temp\SR.html" mybudget.gnucash
>>
>> I tested both hard coded specific dates, and the same relative dates as
>> you (Previous Quarter -> Today) - both worked OK.  I am running GnuCash
>> v4.8 on Windows 10.
>>
>> What next?
>>
>> You could experiment with the debug settings (see the --help for
>> gnucash-cli) but unfortunately I lack the knowledge to tell you which
>> modules to debug.  This worked (but told me nothing meaningful):-
>>
>> "C:\Program Files (x86)\gnucash\bin\gnucash-cli" -R run --name "Saved
>> Report" --output-file "C:\Temp\SR.html" --log gnc.backend.file.sx=debug
>> --logto "C:\Temp\SF.txt" budget2021.gnucash
>>
>> Whereas "--log gnc=debug" generated a 100MB log file before I terminated
>> the process.
>>
>>
>> This is a long shot, but you could try saving the report with hard coded
>> dates to see if that makes any difference.
>>
>>
>> Regards
>>
>> Geoff
>> =
>>
>> On 21/09/2022 9:39 pm, William Starrs wrote:
>> > That's exactly what I was doing, hence this thread!  My report name
>> > should not be an issue as the -R show option finds the report and lists
>> > the criteria without issue.
>> >
>> > What is happening here is that a saved report runs without issue in the
>> > GUI and errors out in the CLI.  If it's a bug I'd like to help fix it,
>> > just need to know where to look.
>> >
>> >
>> >
>> > On Wed, Sep 21, 2022 at 7:25 AM Geoff > > <mailto:cleanoutmys...@gmail.com>> wrote:
>> >
>> > Well, in that case it should work out of the box like this:
>> >
>> > C:\BUDGET>"C:\Program Files (x86)\gnucash\bin\gnucash-cli" -R run
>> >     --name
>> > "68827f48ea584054a227fbf7591a2b1b" --output-file "C:\Temp\BS.html"
>> > mybudget.gnucash
>> >
>> > NOTE that in this case, because I have multiple Balance Sheet
>> reports,
>> > I had to specify the report name using its GUID as I encountered an
>> > error when I used: -R run --name "Balance Sheet", however the error
>> > message kindly gave me the GUID.
>> >
>> > Hope this helps.
>> >
>> > Regards
>> >
>> > Geoff
>> > =
>> >
>> > On 21/09/2022 8:48 pm, William Starrs wrote:
>> >  > Hello Jeff, I am au courant with Python (le Python c'est bon!)
>> > Thank
>> >  > you for that suggestion, I will give it a try.
>> >  >
>> >  > To be clear, all of the date filtering combinations that I tried
>> > were
>> >  > part of the saved report configurations, I was not trying to
>> > provide any
>> >  > parameters via command line other than to run the saved report
>> as-is.
>> >  >
>> >  > Bill
>> >  >
>> >  > On Wed, Sep 21, 2022 at 5:36 AM Geoff > > <mailto:cleanoutmys...@gmail.com>
>> >  > <mailto:cleanoutmys...@gmail.com
>> > <mailto:cleanoutmys...@gmail.com>>> wrote:
>> >  >
>> >  > Hi William
>> >  >
>> >  > Based on my interpretation of the gnucash-cli --help text,
>> > and this
>> >  > Reddit forum post, I don't thi

Re: [GNC] Date error running report from gnucash-cli, report runs fine in GUI

2022-09-21 Thread William Starrs
Hi Geoff,

I had tested hard-coded dates in the saved reports as well, none of them
work.  I'm running GC 4.11 on Archlinux.

If piecash works, I"ll just go to that.  I currently have other reports
(also transaction reports) working this way fine, but I have to scrape the
html file with BeautifulSoup to complete my summaries.  If I can just
directly get the data without those steps it will be better all around.  I
may still try to generate some logs to see why it's not playing nice.

Thanks,

Bill

On Wed, Sep 21, 2022 at 8:06 AM Geoff  wrote:

> Hmmm
>
> I've just tested a saved report (Transaction Report) and it worked OK:
>
> "C:\Program Files (x86)\gnucash\bin\gnucash-cli" -R run --name "Saved
> Report" --output-file "C:\Temp\SR.html" mybudget.gnucash
>
> I tested both hard coded specific dates, and the same relative dates as
> you (Previous Quarter -> Today) - both worked OK.  I am running GnuCash
> v4.8 on Windows 10.
>
> What next?
>
> You could experiment with the debug settings (see the --help for
> gnucash-cli) but unfortunately I lack the knowledge to tell you which
> modules to debug.  This worked (but told me nothing meaningful):-
>
> "C:\Program Files (x86)\gnucash\bin\gnucash-cli" -R run --name "Saved
> Report" --output-file "C:\Temp\SR.html" --log gnc.backend.file.sx=debug
> --logto "C:\Temp\SF.txt" budget2021.gnucash
>
> Whereas "--log gnc=debug" generated a 100MB log file before I terminated
> the process.
>
>
> This is a long shot, but you could try saving the report with hard coded
> dates to see if that makes any difference.
>
>
> Regards
>
> Geoff
> =
>
> On 21/09/2022 9:39 pm, William Starrs wrote:
> > That's exactly what I was doing, hence this thread!  My report name
> > should not be an issue as the -R show option finds the report and lists
> > the criteria without issue.
> >
> > What is happening here is that a saved report runs without issue in the
> > GUI and errors out in the CLI.  If it's a bug I'd like to help fix it,
> > just need to know where to look.
> >
> >
> >
> > On Wed, Sep 21, 2022 at 7:25 AM Geoff  > <mailto:cleanoutmys...@gmail.com>> wrote:
> >
> > Well, in that case it should work out of the box like this:
> >
> > C:\BUDGET>"C:\Program Files (x86)\gnucash\bin\gnucash-cli" -R run
> > --name
> > "68827f48ea584054a227fbf7591a2b1b" --output-file "C:\Temp\BS.html"
> > mybudget.gnucash
> >
> > NOTE that in this case, because I have multiple Balance Sheet
> reports,
> > I had to specify the report name using its GUID as I encountered an
> > error when I used: -R run --name "Balance Sheet", however the error
> > message kindly gave me the GUID.
> >
> > Hope this helps.
> >
> > Regards
> >
> > Geoff
> > =
> >
> > On 21/09/2022 8:48 pm, William Starrs wrote:
> >  > Hello Jeff, I am au courant with Python (le Python c'est bon!)
> > Thank
> >  > you for that suggestion, I will give it a try.
> >  >
> >  > To be clear, all of the date filtering combinations that I tried
> > were
> >  > part of the saved report configurations, I was not trying to
> > provide any
> >  > parameters via command line other than to run the saved report
> as-is.
> >  >
> >  > Bill
> >  >
> >  > On Wed, Sep 21, 2022 at 5:36 AM Geoff  > <mailto:cleanoutmys...@gmail.com>
> >  > <mailto:cleanoutmys...@gmail.com
> > <mailto:cleanoutmys...@gmail.com>>> wrote:
> >  >
> >  > Hi William
> >  >
> >  > Based on my interpretation of the gnucash-cli --help text,
> > and this
> >  > Reddit forum post, I don't think that it is possible to pass
> date
> >  > parameters to reports from the command line.
> >  >
> >  >
> >
> https://www.reddit.com/r/GnuCash/comments/mf834b/how_to_use_gnucashcliexe_on_windows_to_run_a/
> > <
> https://www.reddit.com/r/GnuCash/comments/mf834b/how_to_use_gnucashcliexe_on_windows_to_run_a/
> >
> >  >
> >   <
> https://www.reddit.com/r/GnuCash/comments/mf834b/how_to_use_gnucashcliexe_on_windows_to_run_a/
> <
> https://www.reddit.com/r/GnuCash/comments/mf834b/how_to_use_gnucashcliexe_on_windows_to_run_a/
> >>
> >  >
> >  > 

Re: [GNC] Date error running report from gnucash-cli, report runs fine in GUI

2022-09-21 Thread William Starrs
That's exactly what I was doing, hence this thread!  My report name should
not be an issue as the -R show option finds the report and lists the
criteria without issue.

What is happening here is that a saved report runs without issue in the GUI
and errors out in the CLI.  If it's a bug I'd like to help fix it, just
need to know where to look.



On Wed, Sep 21, 2022 at 7:25 AM Geoff  wrote:

> Well, in that case it should work out of the box like this:
>
> C:\BUDGET>"C:\Program Files (x86)\gnucash\bin\gnucash-cli" -R run --name
> "68827f48ea584054a227fbf7591a2b1b" --output-file "C:\Temp\BS.html"
> mybudget.gnucash
>
> NOTE that in this case, because I have multiple Balance Sheet reports,
> I had to specify the report name using its GUID as I encountered an
> error when I used: -R run --name "Balance Sheet", however the error
> message kindly gave me the GUID.
>
> Hope this helps.
>
> Regards
>
> Geoff
> =
>
> On 21/09/2022 8:48 pm, William Starrs wrote:
> > Hello Jeff, I am au courant with Python (le Python c'est bon!)  Thank
> > you for that suggestion, I will give it a try.
> >
> > To be clear, all of the date filtering combinations that I tried were
> > part of the saved report configurations, I was not trying to provide any
> > parameters via command line other than to run the saved report as-is.
> >
> > Bill
> >
> > On Wed, Sep 21, 2022 at 5:36 AM Geoff  > <mailto:cleanoutmys...@gmail.com>> wrote:
> >
> > Hi William
> >
> > Based on my interpretation of the gnucash-cli --help text, and this
> > Reddit forum post, I don't think that it is possible to pass date
> > parameters to reports from the command line.
> >
> >
> https://www.reddit.com/r/GnuCash/comments/mf834b/how_to_use_gnucashcliexe_on_windows_to_run_a/
> > <
> https://www.reddit.com/r/GnuCash/comments/mf834b/how_to_use_gnucashcliexe_on_windows_to_run_a/
> >
> >
> > If you are au courant with Python you could probably achieve a
> > transaction list for a custom date range fairly easily using PieCash:
> >
> > https://github.com/sdementen/piecash
> > <https://github.com/sdementen/piecash>
> >
> > Good luck!
> >
> > Regards
> >
> > Geoff
> > =
> >
> > On 21/09/2022 9:38 am, William Starrs wrote:
> >  > Update:  I tried also setting a fixed Start Date and end of
> > "Today", as
> >  > well as a fixed start and end date.  All configurations give the
> same
> >  > error.  Again, no error in the GUI.
> >  >
> >  > Thanks,
> >  >
> >  > Bill
> >  >
> >  > On Mon, Sep 19, 2022 at 3:27 PM William Starrs
> > mailto:wjstarrs...@gmail.com>>
> >  > wrote:
> >  >
> >  >> Hello,
> >  >>
> >  >> I would like to script a report that will show me all
> > transactions on
> >  >> credit cards since their last closing date.  I'll maintain
> > closing dates
> >  >> outside of Gnucash.  I have the report set to show me all
> > transactions
> >  >> since the start of the previous quarter (so it is rolling)
> > through today.
> >  >> I would then filter out transactions prior to the closing date in
> >  >> post-processing.
> >  >>
> >  >> The report runs fine in the GUI, but when I try to run from
> > gnucash-cli I
> >  >> get the following error:
> >  >>
> >  >>  ERROR http://gnc.engine.sx>> Bad End Date:
> > Invalid or before Start Date
> >  >>
> >  >> The -R show command shows options regarding the dates that ought
> > to work:
> >  >>
> >  >> General / Start Date: relative . start-prev-quarter
> >  >> General / End Date: relative . today
> >  >>
> >  >> So I can't think of a situation where the start of previous
> > quarter would
> >  >> be missing or before today.
> >  >>
> >  >> Any suggestions?
> >  >>
> >  >> Thanks
> >  >>
> >  >> Bill
> >  >>
> >  > ___
> >  > gnucash-user mailing list
> >  > gnucash-user@gnucash.org <mailto:gnucash-user@gnucash.org>
> >  > To update your subscription preferences or to unsubscribe:
> >  > https://lists.gnucash.org/mailman/listinfo/gnucash-user
> > <https://lists.gnucash.org/mailman/listinfo/gnucash-user>
> >  > -
> >  > Please remember to CC this list on all your replies.
> >  > You can do this by using Reply-To-List or Reply-All.
> >
>
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.


Re: [GNC] Date error running report from gnucash-cli, report runs fine in GUI

2022-09-21 Thread William Starrs
Hello Jeff, I am au courant with Python (le Python c'est bon!)  Thank you
for that suggestion, I will give it a try.

To be clear, all of the date filtering combinations that I tried were part
of the saved report configurations, I was not trying to provide any
parameters via command line other than to run the saved report as-is.

Bill

On Wed, Sep 21, 2022 at 5:36 AM Geoff  wrote:

> Hi William
>
> Based on my interpretation of the gnucash-cli --help text, and this
> Reddit forum post, I don't think that it is possible to pass date
> parameters to reports from the command line.
>
>
> https://www.reddit.com/r/GnuCash/comments/mf834b/how_to_use_gnucashcliexe_on_windows_to_run_a/
>
> If you are au courant with Python you could probably achieve a
> transaction list for a custom date range fairly easily using PieCash:
>
> https://github.com/sdementen/piecash
>
> Good luck!
>
> Regards
>
> Geoff
> =
>
> On 21/09/2022 9:38 am, William Starrs wrote:
> > Update:  I tried also setting a fixed Start Date and end of "Today", as
> > well as a fixed start and end date.  All configurations give the same
> > error.  Again, no error in the GUI.
> >
> > Thanks,
> >
> > Bill
> >
> > On Mon, Sep 19, 2022 at 3:27 PM William Starrs 
> > wrote:
> >
> >> Hello,
> >>
> >> I would like to script a report that will show me all transactions on
> >> credit cards since their last closing date.  I'll maintain closing dates
> >> outside of Gnucash.  I have the report set to show me all transactions
> >> since the start of the previous quarter (so it is rolling) through
> today.
> >> I would then filter out transactions prior to the closing date in
> >> post-processing.
> >>
> >> The report runs fine in the GUI, but when I try to run from gnucash-cli
> I
> >> get the following error:
> >>
> >>  ERROR  Bad End Date: Invalid or before Start Date
> >>
> >> The -R show command shows options regarding the dates that ought to
> work:
> >>
> >> General / Start Date: relative . start-prev-quarter
> >> General / End Date: relative . today
> >>
> >> So I can't think of a situation where the start of previous quarter
> would
> >> be missing or before today.
> >>
> >> Any suggestions?
> >>
> >> Thanks
> >>
> >> Bill
> >>
> > ___
> > gnucash-user mailing list
> > gnucash-user@gnucash.org
> > To update your subscription preferences or to unsubscribe:
> > https://lists.gnucash.org/mailman/listinfo/gnucash-user
> > -
> > Please remember to CC this list on all your replies.
> > You can do this by using Reply-To-List or Reply-All.
>
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.


Re: [GNC] Date error running report from gnucash-cli, report runs fine in GUI

2022-09-20 Thread William Starrs
Update:  I tried also setting a fixed Start Date and end of "Today", as
well as a fixed start and end date.  All configurations give the same
error.  Again, no error in the GUI.

Thanks,

Bill

On Mon, Sep 19, 2022 at 3:27 PM William Starrs 
wrote:

> Hello,
>
> I would like to script a report that will show me all transactions on
> credit cards since their last closing date.  I'll maintain closing dates
> outside of Gnucash.  I have the report set to show me all transactions
> since the start of the previous quarter (so it is rolling) through today.
> I would then filter out transactions prior to the closing date in
> post-processing.
>
> The report runs fine in the GUI, but when I try to run from gnucash-cli I
> get the following error:
>
> ERROR  Bad End Date: Invalid or before Start Date
>
> The -R show command shows options regarding the dates that ought to work:
>
> General / Start Date: relative . start-prev-quarter
> General / End Date: relative . today
>
> So I can't think of a situation where the start of previous quarter would
> be missing or before today.
>
> Any suggestions?
>
> Thanks
>
> Bill
>
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.


[GNC] Date error running report from gnucash-cli, report runs fine in GUI

2022-09-19 Thread William Starrs
Hello,

I would like to script a report that will show me all transactions on
credit cards since their last closing date.  I'll maintain closing dates
outside of Gnucash.  I have the report set to show me all transactions
since the start of the previous quarter (so it is rolling) through today.
I would then filter out transactions prior to the closing date in
post-processing.

The report runs fine in the GUI, but when I try to run from gnucash-cli I
get the following error:

ERROR  Bad End Date: Invalid or before Start Date

The -R show command shows options regarding the dates that ought to work:

General / Start Date: relative . start-prev-quarter
General / End Date: relative . today

So I can't think of a situation where the start of previous quarter would
be missing or before today.

Any suggestions?

Thanks

Bill
___
gnucash-user mailing list
gnucash-user@gnucash.org
To update your subscription preferences or to unsubscribe:
https://lists.gnucash.org/mailman/listinfo/gnucash-user
-
Please remember to CC this list on all your replies.
You can do this by using Reply-To-List or Reply-All.