Re: CLI interface to packages.debian.org

2020-06-20 Thread Ihor Antonov
On Saturday, 20 June 2020 08:05:04 PDT Jude DaShiell wrote:
> Another possibility may be one of the surfraw packages once configured
> correctly.  Lots of other search possibilities in surfraw too.  Once
> installed and configured read up on the -elvi in surfraw to find what
> search possibilities you have.
> 
> 
> 
> --

Thanks for suggestions. I haven't heard anything about both of the mentioned 
tools:
- ramdison
- surfraw

Can you recommend any tutorials/wiki pages/blogs to get up to speed quickly?

Thanks

-- 
Ihor Antonov

signature.asc
Description: This is a digitally signed message part.


Re: CLI interface to packages.debian.org

2020-06-20 Thread Ihor Antonov
On Saturday, 20 June 2020 05:32:41 PDT John Hasler wrote:
> Ihor writes:
> > I wish there was a way to do it without using a web browser. Is there
> > some sort of CLI interface to packages.debian org?
> 
> Do you specifically require a command line interface, or just a text
> one?  They are not the same thing.  If the latter use a text browser
> such as Lynx.  If the former perhaps the -c and/or -o options for
> apt-cache might be interesting.

I want some sort of API, something I can potentially automate.
Lynx does not really fit that requirement. If anything, I'd rather do it with 
curl.. but this is too low level.


-- 
Ihor Antonov

signature.asc
Description: This is a digitally signed message part.


Re: CLI interface to packages.debian.org

2020-06-20 Thread Ihor Antonov
On Saturday, 20 June 2020 02:20:59 PDT to...@tuxteam.de wrote:
> On Sat, Jun 20, 2020 at 11:05:41AM +0200, l0f...@tuta.io wrote:
> > Hi,
> > 
> > 20 juin 2020 à 10:29 de ihor@antonovs.family:
> > > I often use https://packages.debian.org to look up package information.
> > > I often search for binary and source packages, across various releases
> > > 
> > > I wish there was a way to do it without using a web browser. Is there
> > > some
> > > sort of CLI interface to packages.debian org?
> 
> What is your aim: to search offline or to avoid the browser?

Avoid browser primarily. Offline would be a cherry on the cake, but I realize 
that such an offline database would go out of date quickly for Sid and 
Bullseye. 



-- 
Ihor Antonov

signature.asc
Description: This is a digitally signed message part.


CLI interface to packages.debian.org

2020-06-20 Thread Ihor Antonov
Hello everyone,

I often use https://packages.debian.org to look up package information.
I often search for binary and source packages, across various releases

I wish there was a way to do it without using a web browser. Is there some 
sort of CLI interface to packages.debian org?

Or maybe I need to add *everything* to my /etc/apt/sources.list ?

Any recommendations are appreciated.

Thanks
-- 
Ihor Antonov

signature.asc
Description: This is a digitally signed message part.


[RESOLVED] make apt show packages in column

2020-05-20 Thread Ihor Antonov
On Wednesday, 20 May 2020 05:29:18 PDT Curt wrote:
> On 2020-05-17, Ihor Antonov  wrote:
> > Hi
> > 
> > when installing a package with multiple dependencies apt gives an output:
> > (example: apt install gnome)
> > 
> >> The following NEW packages will be installed:
> >>  accountsservice aisleriot apache2-bin apg baobab bluez bluez-obexd
> >>  bogofilter ogofilter-bdb bogofilter-common bolt brasero-common
> >>  caribou cheese cheese-common chrome-gnome-shell cracklib-runtime
> >>  dconf-cli dleyna-server eog evince evince-common evolution
> >>  evolution-common evolution-data-server evolution-data-server-common
> >>  evolution-plugin-bogofilter evolution-plugin-pstimport
> >>  evolution-plugins file-roller five-or-more
> >>  
> >>   ..
> > 
> > output truncated
> > 
> > It is very inconvenient to inspect the list of installed packages in
> > such output. Is it possible to make apt output this in a column?
> 
> Giving the verbose flag (unaware if it has already been suggested) gives
> more readable (if fittingly more verbose) output.
> 
> curty@einstein:~$ apt -sV install gnome
> NOTE: This is only a simulation!
>   apt needs root privileges for real execution.
>   Keep also in mind that locking is deactivated,
>   so don't depend on the relevance to the real current situation!
> Reading package lists...
> Building dependency tree...
> Reading state information...
> The following package was automatically installed and is no longer required:
> libmicrodns0 (0.0.3-3)
> Use 'apt autoremove' to remove it.
> The following additional packages will be installed:
>argyll (1.9.2+repack-1+b1)
>argyll-ref (1.9.2+repack-1)
>brasero (3.12.1-4)
>brasero-cdrkit (3.12.1-4)
> 
> etc.

 -V is doing what I want.
Thanks everyone!

-- 
Ihor Antonov


signature.asc
Description: This is a digitally signed message part.


make apt show packages in column

2020-05-16 Thread Ihor Antonov
Hi

when installing a package with multiple dependencies apt gives an output:
(example: apt install gnome)

> The following NEW packages will be installed:
>
>  accountsservice aisleriot apache2-bin apg baobab bluez bluez-obexd 
>  bogofilter ogofilter-bdb bogofilter-common bolt brasero-common 
>  caribou cheese cheese-common chrome-gnome-shell cracklib-runtime
>  dconf-cli dleyna-server eog evince evince-common evolution 
>  evolution-common evolution-data-server evolution-data-server-common
>  evolution-plugin-bogofilter evolution-plugin-pstimport 
>  evolution-plugins file-roller five-or-more 
>   ..
output truncated

It is very inconvenient to inspect the list of installed packages in
such output. Is it possible to make apt output this in a column? 

For example:
> The following NEW packages will be installed:
>
>  accountsservice  (version, size, ...)
>  aisleriot 
>  apache2-bin 
>  apg 
>  baobab 
>  bluez 
>  bluez-obexd 
>  

This is something that FreeBSD pkg does by default and I find it to be very 
convenient. I have not found any options in apt.conf

Looking at the source [1] it seems that space separator is hard-coded..


[1] https://sources.debian.org/src/aptitude/0.8.12-3/src/cmdline/
cmdline_prompt.cc/?hl=227#L227

-- 
Ihor Antonov

signature.asc
Description: This is a digitally signed message part.


Re: Suspicious output during apt update

2020-05-13 Thread Ihor Antonov
On Wednesday, 13 May 2020 00:30:31 PDT Darac Marjal wrote:
> That's an odd one because, as far as I can tell
> (https://codesearch.debian.net/search?q=get\s%2Bhaircut&literal=0) the
> phrase "get haircut" isn't anywhere in Debian. That would imply that
> it's in a datafile on your computer. You could try grepping your hard
> disk for that phrase and see what files it turns up in?

I did it just in case I drunk myself into oblivion and started writing down 
such tasks into my computer, but no, there is not a single file on my computer 
with such string. 

Additionally, Anders has reported similar issue, so I think this is something 
bigger then just 1 malfunctioning PC.


-- 
Ihor Antonov

signature.asc
Description: This is a digitally signed message part.


Suspicious output during apt update

2020-05-12 Thread Ihor Antonov
Today during apt update I got a very strange error message (below)
Running apt udpate did not seem to reproduce the issue.

Does anyone know what is this? And why does it tell "get haircut" ?


$ sudo apt update   

  
[sudo] password for ngor:

...

Fetched 14.9 MB in 4s (3,979 kB/s)
Entity: line 4: parser error : xmlParseEntityRef: no name
e original message barList of languages in a config file instead iso-codesFind &
   ^
Entity: line 8: parser error : EntityRef: expecting ';'
- get haircut @s 24 @r d &i 14 @o r
   ^
Entity: line 11: parser error : EntityRef: expecting ';'
@r y &i 4 &M 11 &m 2, 3, 4, 5, 6, 7, 8 &w TU
   ^
Entity: line 11: parser error : EntityRef: expecting ';'
@r y &i 4 &M 11 &m 2, 3, 4, 5, 6, 7, 8 &w TU
^
Entity: line 11: parser error : EntityRef: expecting ';'
@r y &i 4 &M 11 &m 2, 3, 4, 5, 6, 7, 8 &w TU
  ^
Entity: line 11: parser error : EntityRef: expecting ';'
@r y &i 4 &M 11 &m 2, 3, 4, 5, 6, 7, 8 &w TU
 ^
Reading package lists... Done
Building dependency tree
Reading state information... Done
12 packages can be upgraded. Run 'apt list --upgradable' to see them.

-- 
Ihor Antonov

signature.asc
Description: This is a digitally signed message part.


Re: debsecan does not report a vulnerability?

2020-05-11 Thread Ihor Antonov
On Monday, 11 May 2020 00:14:02 PDT Victor Sudakov wrote:
> Ihor Antonov wrote:
> > On Sunday, 10 May 2020 08:18:29 PDT Victor Sudakov wrote:
> > > Have I asked in the wrong list? Which list would be more appropriate?
> > 
> > Hi Victor,
> > 
> > I think this is the right list. But it seems that the message got lost
> > somehow in the high volume. I have not used debescan personally, so I am
> > replying simply
> > to keep this thread alive hoping to get it more visibility
> 
> Hi Ihor!
> 
> What do you use to track vulnerabilites in your Debian hosts? What's the
> general approach? Do we just rely upon unattended-upgrade to fetch and
> install patched packages for us?

Running unattended upgrades is generally a recommended way to keep the system 
up-to-date. It minimizes the time from update being published to installed.

I got interested and installed debsecan on my laptop. Here is what man says:

   Much like the official Debian security advisories, debsecan's
   vulnerability tracking is mostly based on source packages.
   
So it seems that it only knows about issues that were reported to source 
packages. The next logical step would be to grep bugtracker to see if this CVE 
was even reported to that package. 

> I come from the FreeBSD world where there are two distinct mechanisms to
> fix vulnerabilites: one for the base system (FreeBSD Security Advisories
> and freebsd-update to install binary updates to the base system) and
> another for third-party software from the ports collection ("pkg audit
> -F" instead of security advisories, "pkg upgrade" to install up-to-date
> patched versions of packages).
> 
> What do we have here, or where can I read more about it?
There are also Debian security advisories:
https://www.debian.org/security/ and debian-security-announce mailing list


Separately - I also happened to run a couple of FreeBSD boxes, could you share 
your motivation for switching to Debian? 

Thanks

-- 
Ihor Antonov

signature.asc
Description: This is a digitally signed message part.


Re: debsecan does not report a vulnerability?

2020-05-10 Thread Ihor Antonov
On Sunday, 10 May 2020 08:18:29 PDT Victor Sudakov wrote:
> Have I asked in the wrong list? Which list would be more appropriate?

Hi Victor,

I think this is the right list. But it seems that the message got lost somehow 
in the high volume. I have not used debescan personally, so I am replying 
simply 
to keep this thread alive hoping to get it more visibility
 
> Victor Sudakov wrote:
> > Dear Colleagues,

> > There is something about debsecan I don't understand, can you please
> > clarify for me?
> > 
> > CVE-2020-1967 was fixed in version 1.1.1d-0+deb10u3, I have
> > 1.1.1d-0+deb10u2 installed, but for some reason debsecan does not report
> > the vulnerable package:
> > 
> > # dpkg -l | grep openssl
> > ii  openssl   1.1.1d-0+deb10u2 amd64  
> >  Secure Sockets Layer toolkit - cryptographic utility # debsecan --suite
> > buster | grep CVE-2020-1967
> > #
> > 
> > What am I doing wrong?
> > 
> > I'm familiar with FreeBSD's "pkg audit", maybe I'm misusing debsecan?

---
Ihor Antonov




Re: How to start offlineimap systemd

2020-05-03 Thread Ihor Antonov
On Sunday, 3 May 2020 06:28:11 PDT jose...@posteo.net wrote:
> Hello all!!
> 
> I'm sorry if my question is terribly simple but I'm a new debian
> user. I have always been an archlinux user but now I've decided to
> give debian buster a try.
> 
> Everything is working smoothly except offlineimap. Actually I works
> well, the problem is that I can't start the systemd service.
> 
> I've tried like this:
> 
> systemctl --user start offlineimap
> Failed to start offlineimap.service: Unit offlineimap.service not
> found.
> 
> You can see that the service is not found. I have also tried starting
> with socket activation but it is the same.
> 
> Is there anything obvious I'm not seeing?
> 
> Thanks a lot,
> Jose.

Hello Jose

If you look at list of files in offlineimap package in Archlinux[1] and
compare the same with Debian [2] you will notice that Archlinux installs 
some unit files in: 

usr/lib/systemd/user/offlineimap-oneshot.service
usr/lib/systemd/user/offlineimap-oneshot.timer
usr/lib/systemd/user/offlineimap-oneshot@.service
usr/lib/systemd/user/offlineimap-oneshot@.timer
usr/lib/systemd/user/offlineimap.service
usr/lib/systemd/user/offlineimap@.service

while Debian does not. So `systemctl --user` is looking for unit files in 
specific locations and it does not find one.


Debian installs these unit files to examples directory:
/usr/share/doc/offlineimap/examples/systemd/README.md
/usr/share/doc/offlineimap/examples/systemd/offlineimap-oneshot.service
/usr/share/doc/offlineimap/examples/systemd/offlineimap-oneshot.timer
/usr/share/doc/offlineimap/examples/systemd/offlineimap-oneshot@.service
/usr/share/doc/offlineimap/examples/systemd/offlineimap-oneshot@.timer
/usr/share/doc/offlineimap/examples/systemd/offlineimap.service
/usr/share/doc/offlineimap/examples/systemd/offlineimap@.service


Check out Archlinux' wiki page [3] about systemd and user configurations.
I think all you need to do is to copy one of the example unit files to the 
location where systemd expects it. But definitely give 
/usr/share/doc/offlineimap/examples/systemd/README.md 
a read


[1] https://www.archlinux.org/packages/community/any/offlineimap/
[2] https://packages.debian.org/sid/all/offlineimap/filelist
[3] https://wiki.archlinux.org/index.php/Systemd/User

-
Ihor Antonov




Re: Debian is testing Discourse

2020-04-20 Thread Ihor Antonov
I am not sure why we are discussing this is in a discourse thread, but what 
the heck.
> 
> In my experience, the content of the Arch wiki is ofter far superior to
> ours, not just the organization and structure.
> 
> ...
> 
> > So they have different philosophies. Perhaps Debian puts more effort
> > into the packages themselves, the installer, and documentation like
> > the Reference Manual, Release Notes etc, whereas AIUI Arch relies
> 
> > more on its wiki. And I think Debian has a much broader scope:
> But the Debian documentation you mention doesn't cover a great deal
> of practical, real-world areas of system configuration, maintenance,
> and use, at least not in any useful, up-to-date way. The Arch wiki, in
> my experience, simply does a much better job at documenting this sort of
> stuff than any Debian documentation.

As a former Arch user I second that opinion. The wiki is better structured, 
has better contents and is easy to edit anyway. Archlinux wiki is the primary, 
if not the only, source of the documentation, so all the effort is concentrated 
there.

I would love to get better navigation / search in Debian wiki, some sort of 
side bar would not be amiss. What do you think can be done to make Debian wiki 
more usable and more attractive to users/editors?


---
Ihor Antonov





Re: Reporting bugs in Stable

2020-04-20 Thread Ihor Antonov
On Sunday, 19 April 2020 23:30:43 PDT Andrei POPESCU wrote:
> On Du, 19 apr 20, 13:28:57, Ihor Antonov wrote:
> > Reporting from Debian Sid, everything is quite stable. I do run ZFS on
> > root
> > and make snapshots prior to big upgrades as a pre-caution, but so far
> > I did not have a reason to revert anything.
> 
> It's just a matter of time. Even if Debian does much more automated
> testing now than in the past some serious issues could still slip
> through.

I know, for me this is exactly the point: unstable becomes stable only if 
someone uses it and finds out issues, reports/fixes them. 

> > I was using Archlinux for a long time, and I can say that Sid feels
> > more stable than Archlinux, although software is less fresh. But
> > overall quite usable as a daily driver on my Lenovo X1 Extreme
> 
> As far as I know Archlinux is also not a beginners distro (like Mint or
> Ubuntu), so issues that may appear trivial to you can be major
> showstoppers for others.

Absolutely, no disputing that. 
I was trying to make a point that "unstable", despite scary name is quite 
usable. Also as someone mentioned - backports should be the first option to try 
if you run stable. I run a few servers stable + backports and everything is 
rock-solid.


But I am afraid that we have deviated from the original topic.  If I 
understood Carl correctly - he was expressing his pain because of  
bureaucratic scrutiny of filing bugs to stable that brings absolutely no 
results. I can't help much here as I am just a mere user, but IMHO if software 
in stable does not work - it is a severe bug. It has to be either fixed or 
software should be removed from stable.


Thanks

Ihor Antonov




Re: Reporting bugs in Stable

2020-04-19 Thread Ihor Antonov
On Sunday, 19 April 2020 07:26:31 PDT Andrei POPESCU wrote:
> On Du, 19 apr 20, 09:43:46, Carl Fink wrote:
> > So this has bugged me every time I run Debian Stable: you find a bug. You
> > try to report it, and are told not to bother because there's a newer
> > version.
> 
> By? I'm guessing you mean the standard request from reportbug to try a
> newer version.
> 
> > Why is reportbug even in Stable? Why not just replace it with a script
> > that
> > says "Sorry, bugs in Stable are never fixed. Try Testing." Seriously,
> > that's literally the Debian policy, that only security fixes are done in
> > Stable.
> Actually bugs of severity "important" or higher can be fixed in stable,
> provided certain criteria are met.
> 
> > So, actual question: how usable is the current Testing?
 
Reporting from Debian Sid, everything is quite stable. I do run ZFS on root 
and make snapshots prior to big upgrades as a pre-caution, but so far I did 
not have a reason to revert anything. I was using Archlinux for a long time, 
and I can say that Sid feels more stable than Archlinux, although software is 
less fresh. But overall quite usable as a daily driver on my Lenovo X1 Extreme

---
Ihor Antonov






[RESOLVED] Saner way to install ohmyzsh

2020-04-16 Thread Ihor Antonov
On Thursday, 16 April 2020 12:14:35 PDT Darac Marjal wrote:
> On 16/04/2020 19:12, Ihor Antonov wrote:
> > Hi Debian Community,
> > 
> > I was looking for a better way to install oh-my-zsh.
> > 
> > The website advocates for
> > 
> >sh -c "$(curl -fsSL
> >https://raw.github.com/ohmyzsh/ohmyzsh/master/tools/
> > 
> > install.sh)"
> > 
> > I did not find existing Debian packages, so maybe someone knows a a way to
> > install it without piping internet into sh.
> 
> The README (https://github.com/ohmyzsh/ohmyzsh#manual-installation)
> suggests:
> 
> git clone https://github.com/ohmyzsh/ohmyzsh.git ~/.oh-my-zsh
> 
> cp ~/.zshrc ~/.zshrc.orig
> 
> cp ~/.oh-my-zsh/templates/zshrc.zsh-template ~/.zshrc
> 
> chsh -s $(which zsh)
> 

Somehow I missed this manual installation instructions page. This solution is 
what I was looking for.

Thanks guys!

> > Thanks
> > ---
> > Ihor Antonov






Re: Saner way to install ohmyzsh

2020-04-16 Thread Ihor Antonov
On Thursday, 16 April 2020 11:33:34 PDT Kenneth Parker wrote:
> On Thu, Apr 16, 2020, 2:19 PM Ihor Antonov  wrote:
> > Hi Debian Community,
> > 
> > I was looking for a better way to install oh-my-zsh.
> > 
> > The website advocates for
> > 
> >sh -c "$(curl -fsSL
> > 
> > https://raw.github.com/ohmyzsh/ohmyzsh/master/tools/
> > install.sh)"
> 
> I got a "400: Invalid Request", when I tried to follow that Link.
> 
> I did not find existing Debian packages, so maybe someone knows a a way to
> 
> > install it without piping internet into sh.
> 
> What is oh-my-zsh anyway?  I never heard of it.  (I used zsh, but it was
> years ago).

It is a plugin framework for zsh
https://ohmyz.sh/

---
Ihor Antonov
 
> Kenneth Parker






Saner way to install ohmyzsh

2020-04-16 Thread Ihor Antonov
Hi Debian Community,

I was looking for a better way to install oh-my-zsh.

The website advocates for
   sh -c "$(curl -fsSL https://raw.github.com/ohmyzsh/ohmyzsh/master/tools/
install.sh)"

I did not find existing Debian packages, so maybe someone knows a a way to 
install it without piping internet into sh.

Thanks
---
Ihor Antonov







Re: Debian is testing Discourse

2020-04-12 Thread Ihor Antonov
On Sunday, April 12, 2020 12:39:43 PM PDT John Hasler wrote:
> I note that Discourse is not in the Debian archive.
> 
> Not that it matters, but I certainly won't use Discourse and if most
> debian-user traffic were to shift to Discourse I would simply stop
> subscribing.
> 
> "Ease of moderation" is *not* a plus.

+1
Observing how zealots have moderated Norbert Preining is a perfect example of 
how 
biased and closed-minded those moderators can be.


-- 
Ihor Antonov
https://useplaintext.email


Re: Debian is testing Discourse

2020-04-12 Thread Ihor Antonov
On Sunday, April 12, 2020 8:55:48 AM PDT Nate Bargmann wrote:

> I've been hearing/reading this old saw about "less technical users" for
> well over two decades, and not just in Linux land but amateur radio as
> well, and it really touches a nerve of mine.  How are less technical
> users ever going to progress into more technical users unless they have
> the opportunity to break something and thus learn?  Striving to make
> *everything* at beginner level 0.1 just retards growth.  That said, I do
> use Gnome.  ;-)

This touches my nerve too and I can't agree more. Both justifications for 
Discourse are 
wrong at their core:

1. The "lets attract more users with this new convenient tool" premise thin is 
like this.

 Imagine you are the owner of the Healthy Food Restaurant. And for some reason 
people 
don't visit your place very often, instead they go to fast food chain where 
they get fast, 
unhealthy coated with sugar food. 

And you think "So average person is impatient, addicted to sugar and is 
overweight, I 
need to put more sugar into my food, compromise on quality to increase speed of 
delivery to attract more sugar-addicted visitors!"

It is only a good decision if you only care about making money. 


2. The "it is easier to moderate" premise is IMHO is an attack on computing 
freedom and 
freedom of speech.  

Email is decentralized and replacing it with a centralized communication tool 
puts to 
much trust into the person/group who moderates it. Moderation + centralization 
is a 
slippery slope to dictatorship. Too much power in one's hands. I wouldn't trust 
myself to 
make the right call every time I need to "moderate" someone. 

And the whole idea of "moderation" is evil in its core. People are different,
they have different thoughts, different opinions and often they are bad at 
communication.  And learning how to communicate properly together as a 
community is 
freaking hard. And all that scares the shit out of some folks so they decide to 
"moderate" 
and use "centralized platform" so  they can hide from real problems that we 
can't talk to 
each other.

Do you really want more users that bad that you are willing to compromise on 
your own 
principles of freedom and technical excellence?



> > As far as I can tell for Debian the main drivers are:
> > 
> > 1. The hope that software like Discourse can improve the quality of
> > discussion as well as signal-to-noise ration, e.g. by providing an
> > alternative to "+1" messages.
> 
> As the message archive is centrally managed, moderators can remove
> messages behind the scenes, for good or for ill.  On a mailing list we
> all get the good with the bad.  It's up to us which is which.  Yeah it's
> messy and doesn't provide much of a safe space.  Viva la liberty!
> 
> > 2. Providing communication options that are preferred by the younger
> > generation, and that's just the natural course of life.
> 
> More than likely this is driven by mobile device users where typing is a
> pain at best and typing long missives is better left for when one is at
> a real computer.
> 
> As I use neomutt as an MUA and make heavy use of procmail filtering,
> trying to access my mail via my phone simply isn't feasible.  Unlike
> most I do not have a Gmail account to access from my phone, etc.
> 
> - Nate


-- 
Ihor Antonov
https://useplaintext.email


Re: how to save video on web page

2020-04-07 Thread Ihor Antonov
On Tuesday, April 7, 2020 12:27:20 PM PDT David Wright wrote:
> On Tue 07 Apr 2020 at 19:11:57 (+0300), Anastasios Lisgaras wrote:
> > Youtube-dl <https://github.com/ytdl-org/youtube-dl> is indeed a
> > powerful and very good software for this job with many features and
> > options, but can you download videos *from anywhere ?*
> > 
> > What I want to say is that there are many web pages which greatly
> > hinder (prohibit) this possibility.
> > In this case, what can we do? Can we always find the hidden link
> > (source) of the video? If so, how?
> > If the page requires you to be logged in, what can we do?
> 
> I'm not sure what the implications are of having to login to a site.
> But in general you need different tools for different web sites.
> The BBC iplayer and youtube-dl are two such tools, and sometimes
> a download link is even available, which either the browser or
> wget can use (the latter preserving the metadata).
> 
> Where videos exist in their entirety, some sites still play them
> by downloading to a temporary file (and you can see the
> download in the progress bar, ahead of what's actually playing.
> A technique there is to examine /proc/N/fd where N is the
> process number of the browser tab. (The process name used to
> be xul-runner, Web Content etc, and looks as if it's currently
> /usr/lib/firefox-esr/firefox-esr -contentproc.)
> If you find an fd number F that's pointing to a file (deleted) in
> /tmp, then try copying that /proc/N/fd/F (following links). Do it
> when the download progress bar has reached the end, but the file
> is still playing. (Sometimes everything disappears as soon as the
> end is reached.)
> 
> Another technique is where the source is streaming (and might be
> open-ended). Here, the video can end up as fragments in your
> browser cache. How you handle them depends on whether they are
> audiovisual or in two seperate streams, and whether they are
> timestamped. Some are, some aren't. The former are relatively
> easy to reassemble with ffprobe to read the timings and ffmpeg
> to concatenate the pieces (and merge audio/video if necessary).
> 
> Where there's no internal timestamping, you can sometimes rely
> on the filesystem's own to figure out the correct ordering.
> But I prefer to run a script that watches files in the cache
> as they are closed (with inotifywait), and immediately copies
> them out (if the filetype is of interest) with a sequence
> number and the file type in the filename. The relevant segments
> can then be concatenated quite easily. A timeformat of
> %Y%m%d-%H%M%S works well as a more meaningful sequence number,
> particularly if you append %N to include nanoseconds for the
> necessary time resolution.
> 
> Be aware that the fragments in your cache might not all be
> identified by the file program's defaults. For example, I use
> 0 string  G@  TS transport stream
> in ~/.magic to pickup files that file might otherwise label
> as 'data'.
> 
> Sometimes, even then, you have to use a little ingenuity for
> the quiet life: eg there's a UK railway site that has three
> webcams (two stations and the yard) which run simultaneously
> on the same web page. Fortunately, each webcam runs with a
> different frame speed, so it's quick and easy to distinguish
> their files and divide them up.
> 
> Finally, when all else fails, and if you've read this far,
> you can just capture the screen contents with ffmpeg's
> x11grab and record it to an mpg file. The disadvantages are
> that you capture extraneous screen decorations, and you've got
> to dedicate the whole screen to watching the video, remembering
> to increase your blanking timeout too. If you can only record
> audio through the microphone, you get more extraneous rubbish
> there too.
> 

That is one comprehensive write up!
Thanks David, today I learned something new thanks to you.

-- 
Ihor Antonov
https://useplaintext.email


Re: how to save video on web page

2020-04-06 Thread Ihor Antonov
On Monday, April 6, 2020 3:28:26 PM PDT Long Wind wrote:
>  Thank Ihor Antonov!i've just tried youtube-dl
> zhou@debian:~$  youtube-dl https://cl7v.com/html/14071/
> [generic] 14071: Requesting header
> WARNING: Falling back on generic information extractor.
> [generic] 14071: Downloading webpage
> [generic] 14071: Extracting information
> ERROR: Unsupported URL: https://cl7v.com/html/14071/


> i've tried wget:wget
> http://ppp.downloadxx.com/assets/52c97a151032aafc25c39304ae62d3ee.mp4"it
> doesn't work either
> 
> On Tuesday, April 7, 2020, 5:58:11 AM GMT+8, Ihor Antonov
>  wrote:
> 
>  #yiv6712804207 p, #yiv6712804207 li {white-space:pre-wrap;}
> 
> On Monday, April 6, 2020 2:37:20 PM PDT Long Wind wrote:
> > i have stretch and want to save video on web
> 

Well Long Wind, I was going to get the exact command for you but I have opened 
that 
video link and it appeared to be some sort of porn. 

I am not sure what Debian policy have to say about this but I personally do not 
support 
this. You should at least warn people about such things. A lot of people read 
this mailing list 
at work or at home and nobody want to have porn coming.

Having said that you can try downloading it yourself - all you need is to find 
a link to 
".m3u8" file in network tab of developer mode when you start the video.

youtube-dl https://bla-bla/playlist.m3u8



-- 
Ihor Antonov
https://useplaintext.email


Re: how to save video on web page

2020-04-06 Thread Ihor Antonov
On Monday, April 6, 2020 2:37:20 PM PDT Long Wind wrote:
> i have stretch and want to save video on web
> page:https://cl7v.com/html/14071/which tool shall i install? Thanks!

I usually use youtube-dl

https://packages.debian.org/search?
suite=all§ion=all&arch=any&searchon=names&keywords=youtube-dl[1] 

Official upstream site:
https://youtube-dl.org/[2] 



-- 
Ihor Antonov
https://useplaintext.email


[1] https://packages.debian.org/search?
suite=all§ion=all&arch=any&searchon=names&keywords=youtube-dl
[2] https://youtube-dl.org/