Re: [Jprogramming] J and Spreadsheets

2021-01-11 Thread Henry Rich
Any further traffic on this thread needs to be moved to chat. Henry Rich On 1/11/2021 5:05 PM, Hauke Rehr wrote: You don’t want to understand me, right? I answered to We are not limited to 9 labels at any level. Ten possibilities are labeled 11 12 13 14 15 21 22 23 24 25. Reread and understa

Re: [Jprogramming] J and Spreadsheets

2021-01-11 Thread Hauke Rehr
You don’t want to understand me, right? I answered to We are not limited to 9 labels at any level. Ten possibilities are labeled 11 12 13 14 15 21 22 23 24 25. Reread and understand that your system just doesn’t work for people who want to get things done. If I put a tenth entry into collection

Re: [Jprogramming] J and Spreadsheets

2021-01-11 Thread 'Bo Jacoby' via Programming
Hi Hauke. You have  3151 s 3152 o 3153 m 3154 e 3155 t 3156 h 3157 i 3158 n 3159 g 3251 s 3252 t 3253 u 3254 f 3255 f You select 3150: s o m e t h i n g  You want to insert 315, but 315=3150 is already superordinate to 'something'. Where do you want to place it? A commercial data base does not

Re: [Jprogramming] J and Spreadsheets

2021-01-10 Thread Hauke Rehr
Again: This just doesn’t work. Say I have 9 Elements at 315 3151 s 3152 o 3153 m 3154 e 3155 t 3156 h 3157 i 3158 n 3159 g and correspondingly I have some elements at 325 3251 s 3252 t 3253 u 3254 f 3255 f and say I used to get all of them using query 3050 If I now want to introduce another it

Re: [Jprogramming] J and Spreadsheets

2021-01-10 Thread Justin Paston-Cooper
On Sun, 10 Jan 2021 at 19:09, 'Bo Jacoby' via Programming < programm...@jsoftware.com> wrote: > Dear friends. > I sincerely apologize to Hauke for wrongly accusing him for improving > before understanding. Talking about Aleph triggered me. > The ordinal fraction file is not merely a tree. To the

Re: [Jprogramming] J and Spreadsheets

2021-01-10 Thread 'Bo Jacoby' via Programming
Dear friends. I sincerely apologize to Hauke for wrongly accusing him for improving before understanding. Talking about  Aleph triggered me. The ordinal fraction file is not merely a tree. To the branch 13500 is attached a two times two matrix with rows 13510 ADORATUR and 13520 GLORIFICATUR and

Re: [Jprogramming] J and Spreadsheets

2021-01-10 Thread R.E. Boss
le of days is also a good indicator. Let's all do something else. R.E. Boss -Original Message- From: Programming On Behalf Of Hauke Rehr Sent: zondag 10 januari 2021 12:54 To: programm...@jsoftware.com Subject: Re: [Jprogramming] J and Spreadsheets • 9 labels Yes, the “digit” res

Re: [Jprogramming] J and Spreadsheets

2021-01-10 Thread Hauke Rehr
• 9 labels Yes, the “digit” restriction should be abstracted away when reasoning about the concept; When I read the paper, I tended to agree that in practice, though, digits are easy to deal with, and it doesn’t hurt introducing another fractional digit without semantics only in order to have enou

Re: [Jprogramming] J and Spreadsheets

2021-01-10 Thread Raul Miller
This system supports different kinds of transitive or "edge" concepts. There's strict sequence (no zeros). There's also allowance for alternatives (with zeros). It's also a bit awkward that you're limited to 9 labels at any level, which implies some shenanigans with large and/or growing data set

Re: [Jprogramming] J and Spreadsheets

2021-01-10 Thread Justin Paston-Cooper
That is an equivalent representation which is more user-friendly. You have explicitly partitioned the nodes of each edge by which base sets/edges they reside in. I wonder what other interesting transpositions/partitions might come up by following the hyperedges. On Sun, 10 Jan 2021 at 14:15, Hauke

Re: [Jprogramming] J and Spreadsheets

2021-01-10 Thread Hauke Rehr
Now this is beginning to make much more sense to me. Regarding base sets, I /meant/ what you wrote, only confused terminology of significant and significate. I now understand your first E, but I think the second one is not an improvement. is not subordinate to . And I think subordination/containm

Re: [Jprogramming] J and Spreadsheets

2021-01-10 Thread Justin Paston-Cooper
To be honest, I don't know why you shouldn't be able to make edges over more than one vertex of a given base set. The base sets should also be hyperedges. For the values corresponding to an edge, take the cartesian product over the corresponding subsets of base edges using the order defined. E = <

Re: [Jprogramming] J and Spreadsheets

2021-01-10 Thread Justin Paston-Cooper
1 CREDO 11 IN 111 UNUM 11 DEUM 112 PATREM 1121 OMNIPOTENTEM 113 FACTOREM Set_1 = <> Set_2 = <> Set_3 = <, , > Set_4 = <> Forall i >= j, a >= b: (Union Set_i)_a >= (Union Set_j)_b V = DisjointUnion {Set_i}. The vertices are ordered multisets like , and . E = <<, >, <, , >, <, , >,

Re: [Jprogramming] J and Spreadsheets

2021-01-10 Thread Hauke Rehr
Sorry for the many posts from my side, but: After reading, and re-reading, though, I don’t quite understand. How could hyperedges touch at most one element of each base set? I obviously have a wrong picture of what is being referred to by the term “base sets”. I thought they correspond to sequence

Re: [Jprogramming] J and Spreadsheets

2021-01-09 Thread Hauke Rehr
Hopefully, this will be a characterization that can be agreed upon so we won’t have to continue any wild guessing due to lack of a consistent description. Thanks for the efforts. Am 10.01.21 um 07:46 schrieb Justin Paston-Cooper: > Error: Base sets of nodes, and not base hyperedges. Each hyperedg

Re: [Jprogramming] J and Spreadsheets

2021-01-09 Thread Justin Paston-Cooper
Error: Base sets of nodes, and not base hyperedges. Each hyperedge touches at most one element of each base set. On Sun, 10 Jan 2021 at 09:35, Justin Paston-Cooper wrote: > Can we summarise all of this as: > > A representation of hypergraphs ordered in a certain way, with nodes > represented by

Re: [Jprogramming] J and Spreadsheets

2021-01-09 Thread Justin Paston-Cooper
Can we summarise all of this as: A representation of hypergraphs ordered in a certain way, with nodes represented by numbers, and tuples of numbers for representing the hyperedges. Node values are ordered sets of strings. There is a number of base hyperedges (columns), whose disjoint union gives

Re: [Jprogramming] J and Spreadsheets

2021-01-09 Thread Hauke Rehr
I’m feeling misunderstood. What did I write? • Do I understand correctly that this algebra of data thing can essentially be represented as a tree (or wood)? So I asked if I understood correctly. I wanted to understand. Not suggest improvement. I asked if it can essentially be represented as such

Re: [Jprogramming] J and Spreadsheets

2021-01-09 Thread Henry Rich
The Nicene Creed was hammered out, practically at the sword's point, to manifest the orthodox credenda.  Every line, almost every phrase, takes a position on a disputed issue of theology.  To be orthodox, one had to affirm it all. Picking parts of the Creed and willfully omitting others would

Re: [Jprogramming] J and Spreadsheets

2021-01-09 Thread 'Bo Jacoby' via Programming
Justin wrote: "Quite an interesting paper. What were the reasons for its rejection?" Thank you! The referee wrote that he did not consider me serious. He thought I was joking.  I wrote an article to en.wikipedia.org, but as original research is not allowed on wikipedia the article was deleted.

Re: [Jprogramming] J and Spreadsheets

2021-01-09 Thread Justin Paston-Cooper
On Sat, 9 Jan 2021 at 15:59, Hauke Rehr wrote: > > My two comments (or, my 2¢): > > > concerning the aleph numbers > > is this related to my concern about dependence on order? > I understand the fractional digits to be meant to encode > both (semantic) structure and order > (or else the prayer wou

Re: [Jprogramming] J and Spreadsheets

2021-01-09 Thread Hauke Rehr
My two comments (or, my 2¢): concerning the aleph numbers is this related to my concern about dependence on order? I understand the fractional digits to be meant to encode both (semantic) structure and order (or else the prayer wouldn’t be the best kind of example). After all, that’s why they’r

Re: [Jprogramming] J and Spreadsheets

2021-01-08 Thread Justin Paston-Cooper
On Sat, 9 Jan 2021 at 00:13, 'Bo Jacoby' via Programming < programm...@jsoftware.com> wrote: > Answering Justin's questions. > 01 question > 02 answer > 11. The data in your solution seems to be similar to the data in > relational databases, but the query space seems to be the same. > Cyclic rela

Re: [Jprogramming] J and Spreadsheets

2021-01-08 Thread 'Bo Jacoby' via Programming
Answering Justin's questions. 01 question 02 answer 11. The data in your solution seems to be similar to the data in relational databases, but the query space seems to be the same. Cyclic  relations seem to be ruled out, but this maybe isn't a problem. Am I wrong, and is either stronger than the

Re: [Jprogramming] J and Spreadsheets

2021-01-08 Thread Hauke Rehr
Thanks, Ian, turns out that implementation, for the matching part, isn’t too far from what I did. Funnily, I thought about rewording what you called match as ('0' e. ".@-,,)/ in the left part of “aligned” – sorry for my bad names, it’s been written down quickly And then I found that the way I did

Re: [Jprogramming] J and Spreadsheets

2021-01-08 Thread Ian Clark
…sorry Hauke, that was meant for your eyes only. Ian On Fri, 8 Jan 2021 at 12:36, Ian Clark wrote: > Hauke, > > Might this help towards what you're aiming to do? > > https://code.jsoftware.com/wiki/User:Ian_Clark/credo > > Ian > > On Fri, 8 Jan 2021 at 11:50, Hauke Rehr wrote: > >> re-implemen

Re: [Jprogramming] J and Spreadsheets

2021-01-08 Thread Ian Clark
Hauke, Might this help towards what you're aiming to do? https://code.jsoftware.com/wiki/User:Ian_Clark/credo Ian On Fri, 8 Jan 2021 at 11:50, Hauke Rehr wrote: > re-implementing in another language is often helpful > I thought lua’s tables should lend themselves to the > structure we have he

Re: [Jprogramming] J and Spreadsheets

2021-01-08 Thread Hauke Rehr
re-implementing in another language is often helpful I thought lua’s tables should lend themselves to the structure we have here, so I tried another approach – and found another quirk: your solution depends on the order of entry I had to add lines 50, 106–109 incl., and change lines 61 and 277 in

Re: [Jprogramming] J and Spreadsheets

2021-01-08 Thread emacstheviking
"csv/tsv is amoung the best in scalability," ...it's a shame my illustrious UK government don't know about this... many moons ago I wrote some code with Dr.Racket to extract 20 year old BTRIEVE records from a VAX system and migrate it into MS SQL Server. In the end for various reasons the only fo

Re: [Jprogramming] J and Spreadsheets

2021-01-08 Thread Justin Paston-Cooper
Quite an interesting paper. What were the reasons for its rejection? The mathematics is quite simple and well defined, however it doesn't go too much into the application aspect. I don't have the time to actually explore this in depth right now, but: 1. The data in your solution seems to be simi

Re: [Jprogramming] J and Spreadsheets

2021-01-07 Thread Hauke Rehr
… and here’s a J implementation (and output) but I stumbled upon another aspect that didn’t match the specification as I understood it: consider the first example 13510: your solution contains SIMUL which is 13509 so I implemented that whenever either of them has a 0, they match. I think that’s wr

Re: [Jprogramming] J and Spreadsheets

2021-01-07 Thread Hauke Rehr
I jotted down a q&d-implementation in D. When I found out that your example doesn’t fit the hierarcical layout (multiple instances for 11, for example, so 11 isn’t a category even though there are things like 111), I ripped out the code depending on the hierarchy. The results agree with your resul

Re: [Jprogramming] J and Spreadsheets

2021-01-07 Thread Hauke Rehr
That post was written too soon. Now that I’ve taken a look at what ordinal fractions are meant to be, it looks to me more like what I think I first came to know when learning some prolog. I try to write down my new understanding of ordinal fractions, in a more old-fashioned lingo of enums (concepts

Re: [Jprogramming] J and Spreadsheets

2021-01-07 Thread Hauke Rehr
Do I understand correctly that this algebra of data thing can essentially be represented as a tree (or wood)? Looks like one could easily represent this using the LEO editor, maybe even annotating each node and having a top level script that walks the tree according to the input. Am 07.01.21 um 22

Re: [Jprogramming] J and Spreadsheets

2021-01-07 Thread Hauke Rehr
agreed Am 07.01.21 um 23:20 schrieb Devon McCormick: > Flat files are fine for large amounts of data up to maybe a few hundred MB > if the data is uniform and not too complex, say lots of equity prices. > Databases are more suitable as the data becomes more complex, say > information about various

Re: [Jprogramming] J and Spreadsheets

2021-01-07 Thread Devon McCormick
Flat files are fine for large amounts of data up to maybe a few hundred MB if the data is uniform and not too complex, say lots of equity prices. Databases are more suitable as the data becomes more complex, say information about various companies: their financial instruments - bonds and different

Re: [Jprogramming] J and Spreadsheets

2021-01-07 Thread Hauke Rehr
Why only moderate? csv/tsv is amoung the best in scalability, way more reliable than spreadsheets (afaik) Of course, customized databases can be better. Am 07.01.21 um 23:07 schrieb Devon McCormick: > To be clear, I was expressing caution about spreadsheets with embedded > formulas and code. Keep

Re: [Jprogramming] J and Spreadsheets

2021-01-07 Thread Devon McCormick
To be clear, I was expressing caution about spreadsheets with embedded formulas and code. Keeping data in flat files, like TSV files, is fine for moderate amounts of data. On Thu, Jan 7, 2021 at 4:08 PM 'Bo Jacoby' via Programming < programm...@jsoftware.com> wrote: > "I am looking for a way to

Re: [Jprogramming] J and Spreadsheets

2021-01-07 Thread 'Bo Jacoby' via Programming
"I am looking for a way to better organise my research. If not spreadsheets, do you have some advice on how to coordinate all this separate data in one place?" I have used ordinal fractions for structuring data since 1980. ORDINAL FRACTIONS - the algebra of data | | | | | | | | | | |

Re: [Jprogramming] J and Spreadsheets

2021-01-07 Thread Justin Paston-Cooper
Thanks. I have been meaning to look at that. On Thu, 7 Jan 2021 at 23:33, Joe Bogner wrote: > > Jupyter notebooks may help you with organizing your research - > https://code.jsoftware.com/wiki/Guides/Jupyter > > This has been my preferred tool - far above Excel. > > On Thu, Jan 7, 2021 at 2:39 PM

Re: [Jprogramming] J and Spreadsheets

2021-01-07 Thread Joe Bogner
Jupyter notebooks may help you with organizing your research - https://code.jsoftware.com/wiki/Guides/Jupyter This has been my preferred tool - far above Excel. On Thu, Jan 7, 2021 at 2:39 PM Justin Paston-Cooper wrote: > I am open to suggestions. Right now I'm researching a lot of related > th

Re: [Jprogramming] J and Spreadsheets

2021-01-07 Thread Justin Paston-Cooper
I am open to suggestions. Right now I'm researching a lot of related things concurrently. I'm storing some of the results in TSV files. Some of the scripts are Python, some are curl | jq | awk. Some of the results I am storing as variables in J scripts. I am constantly going back and forth between

Re: [Jprogramming] J and Spreadsheets

2021-01-07 Thread Devon McCormick
It would be remiss of me not to mention that you really ought to re-consider making a spreadsheet an integral part of your design, not the least due to the historically high rates of error that have been measured in spreadsheets - 1 to 5%: https://arxiv.org/ftp/arxiv/papers/1602/1602.02601.pdf .

Re: [Jprogramming] J and Spreadsheets

2021-01-06 Thread Don Kelly
check out 'Libre Office' which is free and from what i see, can run on Linux. I prefer it to Microsoft Office although I rarely use ther Excel equivalent. Don Kelly On 2021-01-05 7:40 a.m., Justin Paston-Cooper wrote: Hello, I don't know much Excel, and I know some J. The dataflow aspect of

Re: [Jprogramming] J and Spreadsheets

2021-01-06 Thread jph . butler
Sorry, I have only enountered batch mode requirements using closed Excel files. ssconvert does have a --recalc option though, so it might work with a file opened with LibreOffice. De : Justin Paston-Cooper À : Programming forum Sujet : Re: [Jprogramming] J and Spreadsheets Date : 06/01/2021

Re: [Jprogramming] J and Spreadsheets

2021-01-06 Thread Justin Paston-Cooper
cellent terminal for > multi-system workflows (transparent security for scp, provides cygwin > scripting on Windows, single tool which greatly simplifies training etc.). > > > > Philip > > > > De : Justin Paston-Cooper > À : Programming forum > Sujet : [Jprogramming] J

Re: [Jprogramming] J and Spreadsheets

2021-01-06 Thread jph . butler
cumentation is necessary. I also find MobaXterm provides an excellent terminal for multi-system workflows (transparent security for scp, provides cygwin scripting on Windows, single tool which greatly simplifies training etc.).   Philip De : Justin Paston-Cooper À : Programming forum Sujet

Re: [Jprogramming] J and Spreadsheets

2021-01-06 Thread Don Guinn
It was called ADRS - A Departmental Reporting System On Wed, Jan 6, 2021 at 3:34 AM Justin Paston-Cooper wrote: > I am not sure what kind of interfaces were available in the old days. > I have never really used spreadsheets, but for me there would be a > strict increase in utility in being able

Re: [Jprogramming] J and Spreadsheets

2021-01-06 Thread Justin Paston-Cooper
I am not sure what kind of interfaces were available in the old days. I have never really used spreadsheets, but for me there would be a strict increase in utility in being able to edit and display data in a spreadsheet as opposed to keeping track of various variables and manually figuring out whic

Re: [Jprogramming] J and Spreadsheets

2021-01-06 Thread Scott Locklin
Two alternatives: there's R methods for dealing with OpenOffice, and a J package for calling R methods. Probably not the experience you're looking for. There's also a couple of QT demos which have a spreadsheet like interface if you just want the experience of seeing the data laid out in graphical

Re: [Jprogramming] J and Spreadsheets

2021-01-05 Thread bill lam
Interfacing excel or openoffice can be done using com interface, but the technology is windows specific. openoffice also supports interface to python, but can't be called from J directly. Another approach is to parse an excel workbook directly from J and then write back changes to the file. But t

[Jprogramming] J and Spreadsheets

2021-01-05 Thread Justin Paston-Cooper
Hello, I don't know much Excel, and I know some J. The dataflow aspect of Excel excites me, and I am averse to GUI programming. https://code.jsoftware.com/wiki/Articles/JExcel details how to integrate J with Excel. I don't know how up-to-date this is. Because I run Linux, it would be difficult fo