[Trisquel-users] Re : Separating hostnames having multiple IPv4 addresses from a long two-column list
HTML is plain text... that awk can write for you (no need for an editor):
$ awk 'NR > 2 { print $2, $1 }' selection.txt | uniq -Df 1 | awk 'BEGIN {
print "\nhostnameIPv4 address\n" } { print "" $2 "" $1 "" } END { print "\n"
}'
hostnameIPv4 address
alnikino.ru212.109.192.55
alnikino.ru212.109.197.49
alolika.su82.202.160.112
alolika.su92.63.110.215
Re: [Trisquel-users] Separating hostnames having multiple IPv4 addresses from a long two-column list
Magic Banana (the teacher !) is right to admonish me for my ad hoc approach to script writing ... He makes a compelling rationale for supporting higher education as well as continuing education. The substitutes can be exhausting and time consuming. The tutorial is superb, but no lasting knowledge is gained without doing one's homework. I learned that in my High School math classes. At this wrting I'm halfway through the task of converting the ~20,000 row spreadsheet of duplicate hostnames and their IPv4 addresses into an ~80-cell HTML table for the Internet, bearing in mind that my HTML-editor doesn't like more than a thousand rows in its tables. That has to be readable by folks tracking down those unresolvable hostnames appearing in their raw access files. George Langford
Re: [Trisquel-users] Best way to watch Youtube videos?
minitube? El 18/4/19 a les 18:39, kerda...@disroot.org ha escrit: > I am using Invidious after reading this great thread. I was using > Hooktube and then they got a cease and desist letter from YouTube, so > apparently they were spooked and switched to using normal YT embeds. Is > this an inevitable fate for Invidious too?
Re: [Trisquel-users] Questions about sw applications
> > openjdk is a dependency of NetBeans, so it will be installed automatically. > > This is new to me, thanks You can view a package's dependencies in a terminal with "apt depends [package-name]". For example, $ apt depends netbeans netbeans |Depends: default-jdk (>= 2:1.8) Depends: default-jdk openjdk-8-jdk openjdk-9-jdk Depends: libnb-apisupport3-java (= 8.1+dfsg2-3) Depends: libnb-ide14-java (= 8.1+dfsg2-3) Depends: libnb-java5-java (= 8.1+dfsg2-3) Depends: libnb-platform18-java (>= 8.1) The same information is available in Synaptic by searching for a package and viewing its "Properties". signature.asc Description: PGP signature
Re: [Trisquel-users] Questions about sw applications
Many thanks for your message! > openjdk is a dependency of NetBeans, so it will be installed automatically. This is new to me, thanks
[Trisquel-users] Re : Separating hostnames having multiple IPv4 addresses from a long two-column list
Geek wins ! That is precisely what my fifth slide on https://dcc.ufmg.br/~lcerf/slides/mda3.pdf says. :-) The half day spent mechanically processing the large file was more than enough to read those slides, practice with the related exercises (the data are still online, together with the solutions) and, in the end (on slide 20), know about 'uniq', among many other simple text-processing commands. The subsequent slides on https://dcc.ufmg.br/~lcerf/pt/mda.html#slides up to "A few words about efficiency", are about 'grep' (and regular expressions), 'sed' (almost only the substitution command, actually), awk (far more in-depth: awk is great!) and, well, "A few words about efficiency". I assume the student knows how the fundamentals of the interactive use of the Shell. If it is not your case, then read, before any of the above slides, http://en.flossmanuals.net/command-line/ : The whole "Basics" section"; The subsections "Basic commands", "Cut down on typing" and "Redirection" of the "Commands" section; The subsection "Piping" of the" "Advanced-ish" section.
Re: [Trisquel-users] Separating hostnames having multiple IPv4 addresses from a long two-column list
Geek wins ! I applied Magic Banana's script to the ~2.5MB master file (sans parentheses) and obtained a ~600KB file of duplicates in ~.2 second. Thank you ! These hostnames came from the combined address ranges of the autonomous systems 34300,29182,59729,15626,56630,44493, and 48666. I skipped a few CIDR blocks because those were addressed in previous studies that I did on the derivatives of example.com. The resulting spreadsheet has ~19,000 rows. That's as many as all the permutations of example.com and are just as difficult to resolve with nslookup or dig. It's roughly a fifth of the number of rows in the master file. Bear in mind that this is a moving target and would have to be repeated on almost a daily basis to maintain an accurate list of unresolvable hostnames. There is apparently no oversight of this issue. Registrars in the Western World will not let us register a domain name exactly like another one, and they even deprecate typographic lookalikes. Think of the issues of universal inoculations, seat belts, inspection of pressure vessels, and driver licenses ... I am indebted to Magic Banana for his contribution to this effort. He's right about manual processing; I had even proofread the longer list. George Langford
Re: [Trisquel-users] Best way to watch Youtube videos?
> I was using > Hooktube and then they got a cease and desist letter from YouTube, so > apparently they were spooked and switched to using normal YT embeds. Is > this an inevitable fate for Invidious too? Unlike Hooktube, Invidious does not use YouTube's API, so I think it should be at less risk of legal threats from Google. signature.asc Description: PGP signature
Re: [Trisquel-users] VirtualBox, Eclipse Java
I've used Gnome Boxes on Trisquel. Worked quite well if you want a virtual manager with a GUI.
Re: [Trisquel-users] Best way to watch Youtube videos?
I am using Invidious after reading this great thread. I was using Hooktube and then they got a cease and desist letter from YouTube, so apparently they were spooked and switched to using normal YT embeds. Is this an inevitable fate for Invidious too?
Re: [Trisquel-users] VirtualBox, Eclipse Java
Isn't there a VirtualBox alternative to use on Trisquel (libvirt)? I remember reading about it here when I was trying to set up Vagrant on Trisquel. I eventually gave up though, it seemed a little complicated to me at the time. I would like to explore this again myself.
[Trisquel-users] Re : Separating hostnames having multiple IPv4 addresses from a long two-column list
OK. So that is basically the opposite of what I understood in the first
place: the -D option of 'uniq' must be used instead of its -u option:
$ awk 'NR > 2 { print $2, $1 }' selection.txt | uniq -Df 1 | awk '{ print $2
"\t" $1 }'
alnikino.ru 212.109.192.55
alnikino.ru 212.109.197.49
alolika.su 82.202.160.112
alolika.su 92.63.110.215
Using the same command on selection-longer.txt and redirecting the output to
a file named out, I can then compare with your manual work (after removing
the headers and "normalizing" the number of tabs to one). I find three
differences:
$ tail -n +3 selection-longer-dups.txt | tr -s '\t' | diff - out
11a12
> a214947.fvds.ru(149.154.69.180)
76a78,79
> a920222.fvds.ru(188.120.251.198)
> a920222.fvds.ru(188.120.251.50)
So, well, either I still have not understood the task or you forgot those
three lines. In any case, you should never mechanically process by hand long
files.
Re: [Trisquel-users] Separating hostnames having multiple IPv4 addresses from a long two-column list
Magic Banana is on the right track, but we're not getting the hoped-for output. Here's the original data, without the third column (which was only presented to indicate of the magnitude of the issue, which is that duplicated hostnames are used to obfuscate their IPv4 addresses): hostnameIPv4 address ,, alneo.ru188.120.236.138 alnikino.ru 212.109.192.55 alnikino.ru 212.109.197.49 alnitcorp.fvds.ru 91.240.86.50 alod.fvds.ru82.146.42.228 aloe-slings.com 62.109.12.147 alohomora.ru82.146.60.203 alolika.su 82.202.160.112 alolika.su 92.63.110.215 aloshop.ru 62.109.17.21 alosvlad.fvds.ru82.146.34.229 alovera.ru 212.109.193.28 The hoped-for output should be: duplicated hostnamesIPv4 address alnikino.ru 212.109.192.55 alnikino.ru 212.109.197.49 alolika.su 82.202.160.112 alolika.su 92.63.110.215 Yes, the first column was already sorted; and the second column is free from duplicate IPv4 addresses (which originally got in there because I accidentally scanned some of the same IPv4 addresses more than once by covering the same CIDR ranges with /24 that has already been covered with larger CIDR spans). Attached is a longer selection which includes hostnames that begin with numerals, followed by the "redacted" version, containing only duplicated hostnames and their IPv4 addresses (not yet rid of their enclosing parentheses, artifacts of the nMap output files. My "redaction" is manual, of course. There's no need to retain the headers, of course; we are unlikely to get the two columns confused; on the other hand, it is essential that the sorting process correctly mantain the pairs from each row of the table. I started to process the ~80,000 row ODS file and got through marking about 11,000 rows with 0's and 1's in about half a day's efforts. The race between geek & grunt has begun !
Re: [Trisquel-users] Is there an amd gpu (deblobbed) which I can use?
In the short-term, the quality of display might be the least of your concerns, but in the long-term, resolution would play a vital role in our mass revolution or evolution. Although, I almost lost particular interest in computer.
