Hi :) I think it's the same with programmer training. Inevitably there are too many variables or unknown factors that rarely occur.
One methodology to handle it is to "release early and release often" to get "more eyeballs on the code". Even if people can't see the code itself or don't bother to look it still helps to have a real-world usable tool, even if it can only work under limited conditions. It being in use helps prioritise issues that really need to be dealt with. It also helps attract attention from other people and some of those might be able to help. Some might only point out problems that hadn't been noticed before and that might lead to a better understanding of some other problem. Doing the first draft or building the first prototype is really tough but once it's done it really helps figure out what needed to be done to build the prototype. Trying to be too perfect first time is rarely useful. Regards from Tom :) On 1 May 2014 06:07, andrewH <ahoer...@rprogress.org> wrote: > Dear Tom -- Thanks for your attention to my problem. > I believe the problem with using Calc as a viewer is that I have 3.6 > million lines of data. > But I am getting more comfortable with using R itself to answer these > questions. I think part of my problem is that it is the nature of of legal > training to try to andticipate every possible problem. But when the number > of possible problems exceeds a certain level, my brain runs out of working > memory even if my computer still has RAM. Also, I set ambitious goals for > allowing people to run my software on ordinary laptops a year or three old. > I have to say that since I have scaled those back and got 24 gig of RAM > instead, many problems seem more manageable, even without a database. > > Peace, Andrew > > > On Fri, Apr 18, 2014 at 6:39 AM, TomD [via Document Foundation Mail > Archive] <ml-node+s969070n4105676...@n3.nabble.com> wrote: > > > Hi :) > > Ahh, Base seems to be better when the data is held externally. > Postgresql > > should be an excellent choice for holding the data and then 'just' get > > Base > > to connect to it. > > > > I would have thought Calc would then be really good at displaying the > > data?! So i'm not sure what the problem is now. Hopefully someone > better > > with databases might be more helpful! Errr, most people on this mailing > > list seem to be better with databases than me! > > Good luck and regards from > > Tom :) > > > > > > > > > > > > On 17 April 2014 22:56, andrewH <[hidden email]< > http://user/SendEmail.jtp?type=node&node=4105676&i=0>> > > wrote: > > > > > Thanks Tom! > > > > > > Gnumeric is a great product and I have used it before. I was hoping to > > use > > > Calc in this case because I am trying to learn to use the LO database, > > > Base, as a stand-alone or a front end for PostgreSQL. But I find it > very > > > hard to define, use, and even just to import a file into a database if > I > > > can not first look at it and determine how missing variables are coded, > > > which fields are character and which are numeric, etc. Some census > > products > > > are really good at giving users this kind of metadata, others not so > > much. > > > (The Economic Census metadata is hard enough to read and understand > > (would > > > you put material intended to explain something to the public in > > > pipe-delimited text?) that I have written to them asking for meta-meta > > > data). So I wanted to use Calc for exploration and base to do the heavy > > > lifting, in the hope that things might be easier if I stayed withing > one > > > document family. Now I am thinking that some other approach will be > > easier. > > > > > > Warmest regards, Andrew > > > > > > > > > On Sat, Apr 5, 2014 at 2:09 AM, TomD [via Document Foundation Mail > > Archive] > > > <[hidden email] <http://user/SendEmail.jtp?type=node&node=4105676&i=1 > >> > > wrote: > > > > > > > Hi :) > > > > Try Gnumeric; > > > > http://www.gnumeric.org/download.html > > > > > > > > It's a dedicated spreadsheet program with a tiny footprint that uses > > > > minimal resources, so it's faster, lighter and more robust than Excel > > > > or Calc. Many people find Gnumeric to be better than Calc or Excel > > > > for serious or hefty spreadsheets and/or for handling many more > > > > spreadsheets in a shorter time-frame. > > > > > > > > It can be installed alongside LibreOffice and/or MS Office. It uses > > > > the same format as LibreOffice natively so most spreadsheets can be > > > > bounced between the 2 programs quite happily. > > > > > > > > Part of the advantage of LibreOffice is that it fits well into a > wider > > > > eco-system and co-operates well with a wider range of programs and > > > > suites allowing you to tailor individual machines to specific > > > > use-cases and yet still retain the ability to share files between > > > > different machines and different people using different OSes and > > > > programs. > > > > > > > > Regards from > > > > Tom ) > > > > > > > > > > > > > > > > > > > > On 5 April 2014 06:43, Andrew Douglas Pitonyak <[hidden email]< > > > http://user/SendEmail.jtp?type=node&node=4104190&i=0>> > > > > wrote: > > > > > > > > > On 04/04/2014 07:44 PM, andrewH wrote: > > > > >> > > > > >> I am working with a data set that keeps causing my LibreOffice to > > > > freeze. > > > > >> I > > > > >> am pretty sure that this is only because it is big. It is a > > > > pipe-separated > > > > >> text from the US Economic Census imported into Calc, about 30 > > columns > > > > and > > > > >> around a million rows. (The actual data set is bigger, but Calc > > quits > > > > at a > > > > >> million-odd. The complete file is about 0.8 gig.) I suspect but > can > > > not > > > > >> prove that this is related to file handling somehow, e.g. breaking > > > down > > > > >> during auto-saving. The first time I saved the data as a Calc file > > it > > > > took > > > > >> nearly an hour with the "soffice.bin *32" process running at 25 > > > percent > > > > of > > > > >> CPU time and using about 825 meg of memory the entire time. (Not > > sure > > > > why > > > > >> this is showing up as a 32-bit version). And when Calc freezes, > > all > > > > the > > > > >> LibreOffice programs freeze. So I can't just switch to another > file > > > and > > > > >> noodle away while waiting. > > > > > > > > > > > > > > > It looks to me as though Calc cannot handle more than 1048576 rows > > of > > > > data, > > > > > > > > > > Do you have more rows than that? If yes, then I think that you > > cannot > > > > open > > > > > the file. > > > > > > > > > > If you have less than that, and, if you think that you are simply > > > > running > > > > > out of memory.... if you can figure out how to get the data to me, > I > > > can > > > > run > > > > > a test on a 64 bit version (running on Linux). My machine has 32 GB > > of > > > > > RAM... > > > > > > > > > > > > > > > -- > > > > > Andrew Pitonyak > > > > > My Macro Document: http://www.pitonyak.org/AndrewMacro.odt > > > > > Info: http://www.pitonyak.org/oo.php > > > > > > > > > > > > > > > > > > > > -- > > > > > To unsubscribe e-mail to: [hidden email]< > > > http://user/SendEmail.jtp?type=node&node=4104190&i=1> > > > > > Problems? > > > > > > > http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ > > > > > Posting guidelines + more: > > > http://wiki.documentfoundation.org/Netiquette > > > > > List archive: http://listarchives.libreoffice.org/global/users/ > > > > > All messages sent to this list will be publicly archived and cannot > > be > > > > > deleted > > > > > > > > > > > > > -- > > > > To unsubscribe e-mail to: [hidden email]< > > > http://user/SendEmail.jtp?type=node&node=4104190&i=2> > > > > Problems? > > > > > http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ > > > > Posting guidelines + more: > > http://wiki.documentfoundation.org/Netiquette > > > > List archive: http://listarchives.libreoffice.org/global/users/ > > > > All messages sent to this list will be publicly archived and cannot > be > > > > deleted > > > > > > > > > > > > > > > > ------------------------------ > > > > If you reply to this email, your message will be added to the > > discussion > > > > below: > > > > > > > > > > > > > > http://nabble.documentfoundation.org/Intentionally-crashing-LibreOffice-when-frozen-LibreOffice-will-not-start-tp4104156p4104190.html > > > > To unsubscribe from Intentionally crashing LibreOffice when > > > > frozen/LibreOffice will not start., click here< > > > > > > > > > > . > > > > NAML< > > > > > > http://nabble.documentfoundation.org/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml > > > > > > > > > > > > > > > > > > > > > > -- > > > J. Andrew Hoerner > > > Director, Sustainable Economics Program > > > Redefining Progress > > > (510) 507-4820 > > > > > > > > > > > > > > > -- > > > View this message in context: > > > > > > http://nabble.documentfoundation.org/Intentionally-crashing-LibreOffice-when-frozen-LibreOffice-will-not-start-tp4104156p4105610.html > > > Sent from the Users mailing list archive at Nabble.com. > > > -- > > > To unsubscribe e-mail to: [hidden email]< > http://user/SendEmail.jtp?type=node&node=4105676&i=2> > > > Problems? > > > http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ > > > Posting guidelines + more: > http://wiki.documentfoundation.org/Netiquette > > > List archive: http://listarchives.libreoffice.org/global/users/ > > > All messages sent to this list will be publicly archived and cannot be > > > deleted > > > > > > > > > > -- > > To unsubscribe e-mail to: [hidden email]< > http://user/SendEmail.jtp?type=node&node=4105676&i=3> > > Problems? > > http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ > > Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette > > List archive: http://listarchives.libreoffice.org/global/users/ > > All messages sent to this list will be publicly archived and cannot be > > deleted > > > > > > ------------------------------ > > If you reply to this email, your message will be added to the discussion > > below: > > > > > http://nabble.documentfoundation.org/Intentionally-crashing-LibreOffice-when-frozen-LibreOffice-will-not-start-tp4104156p4105676.html > > To unsubscribe from Intentionally crashing LibreOffice when > > frozen/LibreOffice will not start., click here< > http://nabble.documentfoundation.org/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4104156&code=YWhvZXJuZXJAcnByb2dyZXNzLm9yZ3w0MTA0MTU2fC0yMDQ3NjI1NDM5 > > > > . > > NAML< > http://nabble.documentfoundation.org/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml > > > > > > > > -- > J. Andrew Hoerner > Director, Sustainable Economics Program > Redefining Progress > (510) 507-4820 > > > > > -- > View this message in context: > http://nabble.documentfoundation.org/Intentionally-crashing-LibreOffice-when-frozen-LibreOffice-will-not-start-tp4104156p4107071.html > Sent from the Users mailing list archive at Nabble.com. > -- > To unsubscribe e-mail to: users+unsubscr...@global.libreoffice.org > Problems? > http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ > Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette > List archive: http://listarchives.libreoffice.org/global/users/ > All messages sent to this list will be publicly archived and cannot be > deleted > > -- To unsubscribe e-mail to: users+unsubscr...@global.libreoffice.org Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://listarchives.libreoffice.org/global/users/ All messages sent to this list will be publicly archived and cannot be deleted
