Re: Completion of links to man pages

[Michael Albinus]

Eli Zaretskii  writes:

Hi,

>> > I don't think woman.el is being developed, or is it?
>>
>> Do you mean that woman.el will be obsoleted?
>
> AFAIU, it already is, de-facto.  Unless someone steps forward and
> volunteers to develop woman.el so as to add all the many missing
> features that Groff has added during the last years, woman.el will
> continue to bitrot.

In my long-term TODO there is adding support for man pages on remote
hosts. This is counted for man.el, no plans for woman.el. See discussion
at bug#46911. (Unfortunately, no progress yet).

Just a data point.

Best regards, Michael.

Re: Emacs-related IRC channels moving to Libera.Chat

[Michael Albinus]

Amin Bandali  writes:

> Hello,

Hi Amin,

> Per today's announcement [0] on GNU and FSF moving to the Libera.Chat
> IRC network, the following Emacs-related channels are also moving from
> Freenode to Libera.Chat:

Are there plans to replace freenode by Libera.Chat in the Emacs sources?

Best regards, Michael.

Re: org-capture user-error: Abort

[Michael Albinus]

Jean Louis  writes:

Hi Jean,

> Even if it is error, why it should be written with the dash as
> "user-error"?!

`user-error' is a standard error symbol in Emacs, which is fired by the
function `user-error'. See (info "(elisp) Signaling Errors")

Best regards, Michael.

[O] bug#32722: bug#32722: bug#32722: bug#32722: 26.1; Org-publish depend on non-free platform ?

[Michael Albinus]

Nicolas Goaziou  writes:

> Hello,

Hi Nicolas,

> Alternatively, by using TRAMP (see [TRAMP User Manual]),
> `org-mobile-directory' may point to a remote directory accessible
> through, for example, SSH, SCP, or DAVS:
>
>   (setq org-mobile-directory "/davs:/u...@remote.host:org/webdav/")

Pls use (setq org-mobile-directory "/davs:u...@remote.host.org:/webdav/")
Otherwise, LGTM.

> Regards,

Best regards, Michael.

[O] bug#32722: bug#32722: bug#32722: bug#32722: 26.1; Org-publish depend on non-free platform ?

[Michael Albinus]

Nicolas Goaziou  writes:

> Hello,

Hi Nicolas,

> 1 Setting up the staging area
> ═
>
>   The mobile application needs access to a file directory on a server[1]
>
>   Alternatively, by using TRAMP (see [TRAMP User Manual]),
>   `org-mobile-directory' may point to a remote directory accessible
>   through, for example, SSH and SCP:
>
>   ┌
>   │ (setq org-mobile-directory "/scpc:u...@remote.host:org/webdav/")
>   └
>
> [1] For a server to host files, consider using a WebDAV server, such
> as [Nextcloud] ().

Not every WebDAV server will support an ssh connection. On GNU/Linux
systems, Tramp supports also the connection methods "dav", "davs", and
"nextcloud" (this one since Emacs 27). Maybe it is worth to mention this.

> Regards,

Best regards, Michael.

[O] bug#32722: bug#32722: 26.1; Org-publish depend on non-free platform ?

[Michael Albinus]

Nicolas Goaziou  writes:

> Hello,

Hi,

>> Is the WebDAV server code free software?
>
> At least some implementations are, e.g., Nextcloud, listed in the FSF
> directory.
>
>> Can you talk to such a server without any nonfree client software?
>
> I do it with Gnome file manager. There is also an official client for
> Nextcloud, which is free.

For the records, Emacs 27.0.50 / Tramp 2.4.1-pre got a nextcloud client
for GNU/Linux systems. Like the Gnome File Manager it uses the GVFS
library and tools.

> Regards,

Best regards, Michael.

Re: [O] bug in tramp?

[Michael Albinus]

Nicolas Goaziou  writes:

> Hello,

Hi Nicolas,

> I removed the sole (require 'tramp) I could find in the code base.
> Hopefully it solves the problem.

Thanks!

> Regards,

Best regards, Michael.

Re: [O] bug in tramp?

[Michael Albinus]

Thomas Holst  writes:

> Hi Michael,

Hi Thomas,

> The culprit was that I use org-mode and tramp from git. Now I set the
> load-path for org at the very beginning of my .emacs file but for
> tramp further down. As I understand org requires tramp at some point.
> So it loaded tramp from emacs but not from git repo.

I believe it is unfortune in Org to require Tramp while
loading. Instead, it shall declare used Tramp functions.

> Now I set load-path for tramp and require tramp before org and
> everything works fine.
>
> Thanks again.
>   Thomas

Best regards, Michael.

Re: [O] 6 failing tests on master branch

[Michael Albinus]

Kaushal Modi  writes:

> This seems to be related to a tramp file notation change on emacs
> master. I don't use tramp, but I heard about it on emacs-devel.

Indeed.

> Here is a test expression:
>
> (find-file-name-handler "/myself@some.where:papers/last.pdf"
> 'file-remote-p)
>
> On emacs 25.2, that returns tramp-file-name-handler.
> On emacs master, that returns nil.
>
> @Michael How should the above find-file-name-handler arg change to
> support that test file path?

The stronger Tramp file name syntax requires now a method. Something
like "/ssh:myself@some.where:papers/last.pdf". This is backward
compatible with Emacs 25, 24, etc pp.

> Thanks.

Best regards, Michael.

Re: [O] Bug: :session doesn't honor :verbatim [8.2.10 (release_8.2.10 @ /usr/local/share/emacs/26.0.50/lisp/org/)]

[Michael Albinus]

"Charles C. Berry"  writes:

>> However, I don't want to change this globally. Is there an org mean to
>> change this locally just for the session?
>>
>> Maybe the shell prompt could be customizable for a session in ob-sh.el?
>
> That happens in the shell. You can do this to start your session:
>
> #+BEGIN_SRC shell :session mysess
>PS1="MyPrompt-$ "
> #+END_SRC
>
> #+RESULTS:
>
> and then tell emacs to locally set `comint-prompt-regexp' to a value
> other than what was copied from `shell-prompt-pattern'
>
> #+BEGIN_SRC emacs-lisp
>(save-excursion
>  (pop-to-buffer "mysess")
>  (setq-local comint-prompt-regexp "MyPrompt-$ "))
> #+END_SRC
>
> #+RESULTS:
> : MyPrompt-$
>
> and then it should work.
>
> #+BEGIN_SRC shell :session mysess
>echo "a%b"
> #+END_SRC
>
> #+RESULTS:
> : a%b
>
> ---
>
> You might skip the second step and instead set `shell-prompt-pattern'
> to "MyPrompt-$ ". If `comint-use-prompt-regexp' is nil, then the
> `comint-prompt-regexp' is only consulted by ob-shell.el funs per the 
> docstring of comint-use-prompt-regexp.

Thanks for the examples. Anything goes, of course, but I'm hoping for a
tighter integration. Maybe a :prompt param to sh source blocks, which
sets the prompt in a session, and which also manipulates
`comint-prompt-regexp' or `shell-prompt-pattern' local in the session buffer.

Or a mechanism like in Tramp, where the shell prompt is set to a random
string not expected in the shell (see `tramp-end-of-output'), and
`comint-prompt-regexp' or `shell-prompt-pattern' are adapted
automatically local in the session buffer.

> Chuck

Best regards, Michael.

Re: [O] Bug: :session doesn't honor :verbatim [8.2.10 (release_8.2.10 @ /usr/local/share/emacs/26.0.50/lisp/org/)]

[Michael Albinus]

"Charles C. Berry"  writes:

> Michael might get some relief by altering `shell-prompt-pattern' whose
> default value is
>
> "^[^#$%>\n]*[#$%>] *"
>
> is tricked by the embedded `%' in the output lines
>
> If you know the prompt will not contain `%', you could delete that.
>
> Changing the asterisk to a plus might work (untested) or maybe adding
> a blank in the first (negated) char class (also untested). Or if you
> know what the prompt will be literally, use that: "^My-prompt-[$] *"

I've eval'ed (setq shell-prompt-pattern "^[^#$>\n]*[#$>] *") , this
helps. Thanks for the tip.

However, I don't want to change this globally. Is there an org mean to
change this locally just for the session?

Maybe the shell prompt could be customizable for a session in ob-sh.el?

> HTH,
>
> Chuck

Best regards, Michael.

[O] Bug: :session doesn't honor :verbatim [8.2.10 (release_8.2.10 @ /usr/local/share/emacs/26.0.50/lisp/org/)]

[Michael Albinus]

Hi,

when I eval the following source block, everything is fine:

#+BEGIN_SRC sh :results verbatim
df -h /
#+END_SRC

#+RESULTS:
: Filesystem  Size  Used Avail Use% Mounted on
: /dev/sda6   137G   55G   76G  43% /

However, using a :session shortens the output unexpectedly:

#+BEGIN_SRC sh :results verbatim :session *session*
df -h /
#+END_SRC

#+RESULTS:
: 
: Mounted on
: /

I suppose it is due to the "%" character in the output, because the
following works fine:

#+BEGIN_SRC sh :results verbatim :session *session*
df --output=source,size,used,avail,target -h /
#+END_SRC

#+RESULTS:
: Filesystem  Size  Used Avail Mounted on
: /dev/sda6   137G   55G   76G /


Emacs  : GNU Emacs 26.0.50 (build 44, x86_64-pc-linux-gnu, GTK+ Version 2.24.30)
 of 2017-03-31
Package: Org-mode version 8.2.10 (release_8.2.10 @ 
/usr/local/share/emacs/26.0.50/lisp/org/)

current state:
==
(setq
 org-src-mode-hook '(org-src-babel-configure-edit-buffer
 org-src-mode-configure-edit-buffer)
 org-after-todo-state-change-hook '(org-clock-out-if-current)
 org-metadown-hook '(org-babel-pop-to-session-maybe)
 org-clock-out-hook '(org-clock-remove-empty-clock-drawer)
 org-mode-hook '(#[nil "\300\301\302\303\304$\207"
   [org-add-hook change-major-mode-hook org-show-block-all
append local]
   5]
 #[nil "\300\301\302\303\304$\207"
   [org-add-hook change-major-mode-hook
org-babel-show-result-all append local]
   5]
 org-babel-result-hide-spec org-babel-hide-all-hashes)
 org-confirm-elisp-link-function 'yes-or-no-p
 org-agenda-before-write-hook '(org-agenda-add-entry-text)
 org-metaup-hook '(org-babel-load-in-session-maybe)
 org-babel-pre-tangle-hook '(save-buffer)
 org-tab-first-hook '(org-hide-block-toggle-maybe
  org-src-native-tab-command-maybe
  org-babel-hide-result-toggle-maybe
  org-babel-header-arg-expand)
 org-occur-hook '(org-first-headline-recenter)
 org-ctrl-c-ctrl-c-hook '(org-babel-hash-at-point
  org-babel-execute-safely-maybe)
 org-cycle-hook '(org-cycle-hide-archived-subtrees org-cycle-hide-drawers
  org-cycle-hide-inline-tasks org-cycle-show-empty-lines
  org-optimize-window-after-visibility-change)
 org-speed-command-hook '(org-speed-command-default-hook
  org-babel-speed-command-hook)
 org-confirm-shell-link-function 'yes-or-no-p
 )

Re: [O] Sync up the org in emacs master to org maint branch?

[Michael Albinus]

Rasmus  writes:

> Hi,

Hi,

> *AFAIR* it was too late and would thus not have received enough test from
> the general Emacs community.

org-mode comes with some hundred ert test cases. It would be great if
they'll land also in the Emacs master branch; this will give much more
testing.

> Thanks,
> Rasmus

Best regards, Michael.

Re: [O] [Patch] org-display-inline-images: Add support for remote images

[Michael Albinus]

Kit-Yan Choi  writes:

> But is it theoretically possible to have two remote file paths sharing
> the same local copy file name? i.e. `make-temp-file' generates the
> same temporary file name for two separate calls?

No, never ever. After choosing a random file name, make-temp-file checks
whether there exists already such a file. In case of yes, it chosses
another random file name, and so on.

> As far as org-mode is concerned, and assuming the current stable
> version of tramp, I think there are two options (1) the current
> approach which preserves the path of the remote file and therefore
> avoid unnecessary downloads; however we forgo the capability of
> compression that tramp's file-local-copy offers, (2) use
> `file-local-copy' but risk overwriting (albeit unlikely) downloaded
> local copy; this is possible with or with out a look-up table for
> reusing files.

Again, the risk of overwriting something else does not exist.

> Thanks,
> Kit

Best regards, Michael.

Re: [O] [Patch] org-display-inline-images: Add support for remote images

[Michael Albinus]

Kit-Yan Choi  writes:

> Michael,

Hi Kit,

> Thanks for the suggestion. Indeed `file-local-copy' would have made
> the code cleaner. Yet `file-local-copy' generates a new filename each
> time it's run. But I wanted to allow the code to check whether the
> remote image has already been fetched before and so skip unnecessary
> file transfer, which takes time (think of it like "rsync -a").
> Therefore I wanted to preserve the remote path under a temporary
> directory.

After first retrieval via file-local-copy, you could cache this
information somewhere for later use.

Or you could write a ticket towards Tramp, that file-local-copy shall
remember that a file was downloaded already, and should offer that file
for reuse.

Note: I'm the Tramp maintainer :-)

> Best,
> Kit

Best regards, Michael.

Re: [O] [Patch] org-display-inline-images: Add support for remote images

[Michael Albinus]

Kit-Yan Choi  writes:

> Ah my apologies. I forgot I had to use `file-name-directory' for
> creating the path to the temporary directory (too long ago since I did
> this). Here is the corrected version.
>
> --- a/lisp/org.el
> +++ b/lisp/org.el
> @@ -19340,7 +19340,7 @@ boundaries."
> (not (cdr (org-element-contents parent)
> (org-string-match-p file-extension-re
> (org-element-property :path link)))
> - (let ((file (expand-file-name (org-element-property :path link
> + (let ((file (substitute-in-file-name (expand-file-name
> (org-element-property :path link)
> (when (file-exists-p file)
> (let ((width
> ;; Apply `org-image-actual-width' specifications.
> @@ -19378,10 +19378,25 @@ boundaries."
> 'org-image-overlay)))
> (if (and (car-safe old) refresh)
> (image-refresh (overlay-get (cdr old) 'display))
> - (let ((image (create-image file
> - (and width 'imagemagick)
> - nil
> - :width width)))
> + (let ((image 
> + (create-image (if (org-file-remote-p file)
> + (let* ((tramp-tmpdir (concat
> + (if (featurep 'xemacs)
> + (temp-directory)
> + temporary-file-directory)
> + "/tramp"
> + (file-name-directory (expand-file-name file
> + (newname (concat
> + tramp-tmpdir 
> + (file-name-nondirectory (expand-file-name file)
> + (make-directory tramp-tmpdir t)
> + (if (file-newer-than-file-p file newname)
> + (copy-file file newname t t))
> + newname)
> + file)
> + (and width 'imagemagick)
> + nil
> + :width width)))
> (when image
> (let* ((link
> ;; If inline image is the description

This code looks much to complicate to me. Wouldn't a simple
file-local-copy suffice? You don't need to care whether the file is
remote (let Tramp do the job) or local (there won't be a copy).

Best regards, Michael.

Re: [O] Custom todo-like thing in agenda?

[Michael Albinus]

Sebastien Vauban 
writes:

> Hello Marcin,

Hi,

> - `org-debbugs.el' package from Michael Albinus

... which is meanwhile debbugs-org.el, part of the debbugs package on
GNU ELPA.

> Best regards,
>   Seb

Best regards, Michael.

Re: [O] results from Python block not visible

[Michael Albinus]

Daniel Clemente  writes:

> I reported this to emacs (bug 18095):
> http://lists.gnu.org/archive/html/bug-gnu-emacs/2014-07/msg00736.html
>
> It's still happening with latest emacs and org-mode

It's fixed in Emacs' trunk.

Best regards, Michael.

Re: [O] [bug?] Tramp tries to open remote file links

[Michael Albinus]

Sebastien Vauban 
writes:

> I'm not sure I use the right wording, but I'm trying to say that Org
> (when set to open inline images) should never try to open PDF files, as
> they can't be opened inline in a buffer anyway.

This might change, when Emacs' xwidget branch is merged into trunk.
And no, I don't know when this will happen.

> Best regards,
>   Seb

Best regards, Michael.

Re: [O] [bug?] Tramp tries to open remote file links

[Michael Albinus]

Sebastien Vauban 
writes:

>> That's what I'm speaking about. And if you have a local DocView
>> installation, it works for either remote or local files (Tramp provides
>> a local copy of the remote file).
>
> But DocView won't display a PDF file as an image inside a buffer of
> text, will it?

No, it uses an own buffer.

> Best regards,
>   Seb

Best regards, Michael.

Re: [O] [bug?] Tramp tries to open remote file links

[Michael Albinus]

Sebastien Vauban  writes:

> Michael Albinus wrote:
>> Sebastien Vauban writes:
>>
>>> Though, is it normal to try to open a remote PDF file while Emacs is
>>> unable of displaying it in the buffer (unlike PNG files, IIUC)?
>>
>> Emacs is also able to open and display a remote PDF file.
>
> IIUC, Emacs can't display real PDF files. It only can convert them (via
> DocView) to PNG, one per page, in order to give a similar experience.

That's what I'm speaking about. And if you have a local DocView
installation, it works for either remote or local files (Tramp provides
a local copy of the remote file).

If you want to suppress PDFs in org, you shall do it regardless of its
location.

> Best regards,
>   Seb

Best regards, Michael.

Re: [O] [bug?] Tramp tries to open remote file links

[Michael Albinus]

Sebastien Vauban 
writes:

> Though, is it normal to try to open a remote PDF file while Emacs is
> unable of displaying it in the buffer (unlike PNG files, IIUC)?

Emacs is also able to open and display a remote PDF file.

> Maybe that's not a bug per se, but rather a feature that should only be
> enabled for specific file extensions?

I wouldn't parse URI-like file names in org-mode at all. There is
url-handlers.el, which shall do it proper.

> Best regards,
>   Seb

Best regards, Michael.

Re: [O] [bug?] Tramp tries to open remote file links

[Michael Albinus]

Sebastien Vauban 
writes:

>   <... lots of contents...>

Well, Tramp is invoked via (expand-file-name "/myself@..."). The call
hierarchy is (if I haven't overseen something)

expand-file-name
org-element-link-parser
org-element-context
org-image-file-name-regexp
org-display-inline-images
org-mode

Maybe it is worth to find out, why org-display-inline-images is invoked?

> Best regards,
>   Seb

Best regards, Michael.

Re: [O] [bug?] Tramp tries to open remote file links

[Michael Albinus]

Sebastien Vauban 
writes:

>>> Is this supposed to be normal?  Why does Tramp open the file?
>>
>> Because Tramp has been instructed so? I suppose, following the above
>> link results in
>
> I think we did not understand each other (or did we?) because that's the
> thing: I don't follow the link, I just open the file which contains such
> a link.

It doesn't for me, when I have a simple org file with just your
example. I use org 8.2.6.

Do you have some customization, which let org expand links per default?
Does it also happen when you start "emacs -Q"?

Or do you have some customization code in the file itself? Local
variables, code snippets to be evaluated when opening the file?

> See http://screencast.com/t/aXoxf9D1P.

This does not work for me :-(

> Best regards,
>   Seb

Best regards, Michael.

Re: [O] [bug?] Tramp tries to open remote file links

[Michael Albinus]

Sebastien Vauban 
writes:

> Hello,

Hi Sebastien,

> When I just open an Org file that has a link to a remote file, Tramp
> tries to open it, leading to errors and timeouts when offline, at least.
>
> * References
>
> Some files of interest:
>
> [[file:/me-ohc15rc7jgtnlxjtenl...@public.gmane.org:papers/current.pdf][paper]]
>
> Errors:
>
>   ╭
>   │ Tramp: Opening connection for
> me-ohc15rc7jgtnlxjtenl...@public.gmane.org using plink...
>   │ Tramp: Sending command `plink -l me -ssh -t somewhere.org " env
> 'TERM=dumb' 'PROMPT_COMMAND=' 'PS1=#$ ' /bin/sh " && exit || exit'
>   │ Tramp: Waiting for prompts from remote shell...
>   │ Tramp failed to connect.  If this happens repeatedly, try
>   │ `M-x tramp-cleanup-this-connection'
>   │ Tramp: Waiting for prompts from remote shell...failed
>   │ Tramp: Opening connection for
> me-ohc15rc7jgtnlxjtenl...@public.gmane.org using plink...failed
>   ╰
>
> Is this supposed to be normal?  Why does Tramp open the file?

Because Tramp has been instructed so? I suppose, following the above
link results in

(insert-file-contents 
"/me-ohc15rc7jgtnlxjtenl...@public.gmane.org:papers/current.pdf")

This is remote file name syntax, and Tramp tries to do its job, using
the default method "plink". You could avoid Tramp's reaction by a link
like (untested)

[[file:/:/me-ohc15rc7jgtnlxjtenl...@public.gmane.org:papers/current.pdf][paper]]

Alternatively, you could choose another file name.

> Best regards,
>   Seb

Best regards, Michael.

Re: [O] An org password manager

[Michael Albinus]

jorge.a.alf...@gmail.com (Jorge A. Alfaro-Murillo) writes:

> Michael Albinus  writes:

Hi Jorge,

>> A useful feature would be an auth-source backend, See (info "(auth)")
>> By this, other packages (like Gnus or Tramp) would profit from the
>> password manager directly.
>
> Thanks Michael. I will look more into auth. What is your idea? To be
> able to use something like auth-source-search, to pass features of the
> org-passwords database as secrets? 

yes.

> I only use auth for gnus and jabber, so my .authinfo.gpg is only five
> lines. What setup could benefit on that? Can auth send secrets to other
> applications, like a web browser?

If another Emacs package uses auth-source-search, it would benefit
automatically from your backend. Several packages uses it already, like
Tramp, gnus, url, erc, ldap.

> Best,
>
> Jorge.

Bet regards, Michael.

Re: [O] An org password manager

[Michael Albinus]

Bastien  writes:

> Hi Jorge,

Hi,

>> If there is interest from the community this can also go to
>> /contrib.
>
> I think this would be a nice contribution.

A useful feature would be an auth-source backend, See (info "(auth)")
By this, other packages (like Gnus or Tramp) would profit from the
password manager directly.

Best regards, Michael.

Re: [O] Preventing Tramp from executing on agenda command?

[Michael Albinus]

'Mash  writes:

> Morning,

Hi,

> I have an agenda file which contains a URL with port
> (https://example.example.com:2000) which unfortunately Tramp attempts
> to connect to when I pull the agenda, causing Emacs to hang.
>
> Any idea why this is happening by default?

That's not a Tramp file, Tramp shouldn't feel responsible. Could you try
to find out, which host Tramp is attempting to connect? You might see it
in the respective Tramp buffer name.

> Thanks,
>
> 'Mash

Best regards, Michael.

Re: [O] Local variables and babel

[Michael Albinus]

t...@tsdye.com (Thomas S. Dye) writes:

> Aloha all,

Hi,

> This led me to try to incorporate some of the file-specific setup steps
> into the local variables as well.  For instance, in a file where I'm
> working with Common Lisp source code blocks and a graph library, I have
> this:
>
>   # eval: (slime)
>   # eval: (org-sbe "graph-setup")
>
> What I've found is that the graph-setup doesn't have any effect on the
> Common Lisp environment when run this way. It works fine if, after slime
> is up and running, I go to the graph-setup source code block and
> evaluate it with C-c C-c.
>
> I'm guessing that I might be running into a concurrency problem here,
> such that the local variable evaluation of graph-setup is taking place
> before slime has finished setting itself up (which takes many seconds on
> my machine).
>
> I am well beyond my programming abilities here and would like to have
> opinions on whether this approach is potentially workable and, if so,
> how it might be implemented.

I don't know slime, but usual there are hooks where you could add your
code to run once a package (like slime) has finished its
initialization. Look for such a hook in slime, and add the call to
graph-setup there.

> All the best,
> Tom

Best regards, Michael.

Re: [O] Local variables in org files

[Michael Albinus]

"Sebastien Vauban" 
writes:

> Hello Michael,

Hi Sebastien,

>> However, I must have misread the documentation. The "#+CALL: init"
>> directive has no effect when loading a respective xxx.org file :-(
>
> Nope, it doesn't, but you can add an `eval' directive in your Local
> Variables section, and evaluate a call to the init block, like this:
>
> # Local variables:
> # eval: (sbe "init")
> # End:

That does the trick. Thanks a lot!

> Best regards,
>   Seb

Best regards, Michael.

Re: [O] Local variables in org files

[Michael Albinus]

Nick Dokos  writes:

> Not sure if there are any limits for the top style but maybe you could
> combine the two styles of local variables - maybe:
>
> # -*- foo: (1 2 3 4) -*-

This would move the problem to the headline. No idea, whether there is a
limit (to be tested). But this extremely long and ugly headline would be
visible - nothing I like to offer :-(

But maybe we don't need the Local Variables block? Code blocks could help?

--8<---cut here---start->8---
* COMMENT Local Variables

#+NAME: init
#+BEGIN_SRC elisp
(set (make-local-variable 'debbugs-org-ids) '(1 2 3))
#+END_SRC

#+CALL: init
--8<---cut here---end--->8---

However, I must have misread the documentation. The "#+CALL: init"
directive has no effect when loading a respective xxx.org file :-(

Best regards, Michael.

[O] Local variables in org files

[Michael Albinus]

Hi,

I'm trying to save the result of "M-x debbugs-org" into a file (this is
a TODO list). For further handling, also some buffer local variables
must survive. Therefore, I append at the very end of that file something
like this:

* Local Variables
** Local Variables:
** eval: (debbugs-org-mode 1)
** debbugs-org-ids: (1 2 3)
** End:

This has the nice effect, that those variables do not disturb in
overview mode, because they look like

* Local Variables...

Being invisible would be even better, but so what.

Unfortunately, the value of debbugs-org-ids could be very lng,
exceeding the 3000 chars limit the "Local Variables:" section size is
allowed to be in Emacs. So I must rearrange things like this:

* Local Variables
** debbugs-org-ids: (1 2 3)
** Local Variables:
** eval: (debbugs-org-mode 1)
** debbugs-org-ids: (access-the-value-above)
** End:

Is there some functionality in org I could use implementing
`access-the-value-above'? It is org structure, so I'm hoping there is an
easy way to access a given node with a well defined position.

Or maybe there is already a clever way storing local variables in an org
file, which I'm not aware of.

Thanks, and best regards, Michael.

Re: [O] Org-mode in windows fires Tramp without any intervention

[Michael Albinus]

Toni Cebrián  writes:

> Hi,

Hi Toni,

> I have my own complex Emacs configuration files developed over time
> when working in a Linux environment. You can see that
> https://github.com/tonicebrian/emacsconfig in case you are curious. It
> works seamlessly in Linux and I tried to use that as-is when working
> in Windows. Emacs in Windows reads that configuration and fires up
> also without any warning. The problem comes when I try to open a
> complex Org file, with some links in it. I don't know why, but Tramp
> is fired and tries to ssh to the machines in one URL within a link
> element that has the form "http://machine:8080/more/levels";. 
>
> I don't even have the (require 'tramp) in my init.el file so this is
> something the Org mode plugging is doing by itself. By the way, the
> org mode version I have is org-20131202 from elpa and Emacs is 24.3.1
> for Windows. Do you know where to look or what to try? This same Org
> file, the same init.el and the same emacs version work without any
> problem in Linux.
>
> Any clues?

I guess something of the decoded URL, like "/machine:8080", is treated
as remote file name Tramp feels responsible for.

Could you please send a short example file which triggers the bug? I
would try to debug it then.

Please note that I don't use org regularly, so some comments on what to
do with that file would be helpful.

Best regards, Michael.

Re: [O] org-debbugs.el

[Michael Albinus]

Bastien  writes:

> Hi Michael,

Hi Bastien,

> Can you resend a patch so that I add this to contrib/?

Did you read the whole thread? My last message on the topic?



> Thanks!

Best regards, Michael.

Re: [O] org-debbugs.el

[Michael Albinus]

Michael Albinus  writes:

Hi,

>> If the org-mode maintainers find this package useful, it could be added
>> to the contrib directory.
>
> Still no response from the maintainers. Before I continue to invest into
> this package, I would like to know whether it is a suitable
> approach. Otherwise, I could spend my time better.

Well, I've renamed the file to debbugs-org.el; it is added to the
debbugs package on GNU ELPA. No need any longer to add this to contrib.

Best regards, Michael.

Re: [O] org-debbugs.el

[Michael Albinus]

Nicolas Richard  writes:

> Hello Michael,

Hi Nicolas,

> While trying your package, I noticed that C-h m would not work because
> of a misplaced docstring. Here's the patch (but I'm not sure I have the
> latest version, sorry if this is already fixed).

Thanks. I've submitted a similar patch some days ago.

> Also, I heard recently on #org-mode about bugpile, which is an old (last
> updated more than a year ago) of Thorsten Jolitz and Eric Schulte. The
> doc says:
> ,
> |  The Bugpile project has two goals:
> | 
> | Develop a bugtracker (called Bugpile) for GNU Emacs Org-mode,
> | using Elisp, Elnode, Org-mode, and a dVCS.
> | As part of the engineering process, abstract out a web-framework
> | (iOrg) based on these GNU Emacs technologies.
> ` Source:
> http://orgmode.org/worg/org-contrib/gsoc2012/student-projects/bugpile/

No idea about the status either. However, org-debbugs has the advantage
to access Emacs' bug tracking system, which is not listed above. I
expect org related bugs arriving not only via `org-submit-bug-report',
but also via `report-emacs-bug'.

Anyway, if the org maintainers decide for another bug tracking system
but debbugs, it would also be OK for me. It just decreases the priority
of that package for me.

Best regards, Michael.

Re: [O] org-debbugs.el

[Michael Albinus]

Michael Albinus  writes:

Hi,

> If the org-mode maintainers find this package useful, it could be added
> to the contrib directory.

Still no response from the maintainers. Before I continue to invest into
this package, I would like to know whether it is a suitable
approach. Otherwise, I could spend my time better.

Best regards, Michael.

Re: [O] org-debbugs.el

[Michael Albinus]

Michael Albinus  writes:

Hi Suvayu,

>> I tried to test by looking for a specific bug.  This is what I tried:
>>
>> - search phrase: emacsclient
>> - submitter: fatkasuvayu (that is leading part of my email address)
>> - status: done or nothing
>>
>> But then I get an empty "*Org Bugs*" buffer.
>
> Hmm, yes. But this seems to be a server side problem.

I still have no idea why the submitter does not work. However, there are
more attributes which could be used. I have added the "author" keyword
to the `org-debbugs-search' interface. This gives you all bugs, for
which you have sent an email with the given email address (or a
substring of). Patch appended.

Try

- search phrase: emacsclient
- author: fatkasuvayu

Best regards, Michael.

>From 3c2ef9d8f8aa0da8dc0c2d8514a52b52ec36ed9b Mon Sep 17 00:00:00 2001
From: Michael Albinus 
Date: Fri, 4 Oct 2013 21:12:08 +0200
Subject: [PATCH] * org-debbugs.el (org-debbugs-search): Accept empty phrase.
 Add keyword "author". (org-debbugs-show-next-reports): Make "Next bugs" an
 own entry.

---
 contrib/lisp/org-debbugs.el | 11 +--
 1 file changed, 5 insertions(+), 6 deletions(-)

diff --git a/contrib/lisp/org-debbugs.el b/contrib/lisp/org-debbugs.el
index fe5430e..9ab805e 100644
--- a/contrib/lisp/org-debbugs.el
+++ b/contrib/lisp/org-debbugs.el
@@ -144,16 +144,14 @@ returned."
 
 	;; Check for the phrase.
 	(setq phrase (read-string debbugs-gnu-phrase-prompt))
-	(if (zerop (length phrase))
-	(setq phrase nil)
-	  (add-to-list 'debbugs-gnu-current-query (cons 'phrase phrase)))
+	(add-to-list 'debbugs-gnu-current-query (cons 'phrase phrase))
 
 	;; The other queries.
 	(catch :finished
 	  (while t
 	(setq key (completing-read
 		   "Enter attribute: "
-		   '("severity" "package" "tags" "submitter"
+		   '("severity" "package" "tags" "submitter" "author"
 			 "subject" "status")
 		   nil t))
 	(cond
@@ -178,7 +176,8 @@ returned."
 		(add-to-list
 		 'debbugs-gnu-current-query (cons (intern key) val1
 
-	 ((equal key "submitter")
+	 ((member key '("submitter" "author"))
+	  (when (equal key "author") (setq key "@author"))
 	  (setq val1 (read-string "Enter email address: "))
 	  (when (not (zerop (length val1)))
 		(add-to-list
@@ -405,7 +404,7 @@ returned."
 	(goto-char (point-max))
 	(insert
 	 (format
-	  "[[elisp:(org-debbugs-show-next-reports %s)][Next bugs]]\n"
+	  "* [[elisp:(org-debbugs-show-next-reports %s)][Next bugs]]\n"
 	  hits))
 
 (defconst org-debbugs-mode-map
-- 
1.8.1.2

Re: [O] Org mode issue tracker

[Michael Albinus]

Brett Viren  writes:

> Hi,

Hi Brett,

>>   * TODO Subject  :emacs_ver:org_ver:org_module:
> ...
>> Emacs version ends up as a tag:
>>
>> * TODO  .   :24.3:
>
> Or, if I add an Org version:
>
>  * TODO  .   :24.3:8.0.3:
>
> These bare numbers seem a bit too anonymous to me.  I think it's
> unlikely that Org will reach versions in the 20's anytime soon so
> collision won't happen for a while but eventually (hackers willing!) it
> will.
>
> So, I suggest simply qualifying the versions like:
>
>   * TODO  .  :emacs_24.3:org_8.0.3:

>From the metadata retrieved from debbugs.gnu.org, we have just a list of
version strings. There is no indication about the meaning:

 (found_versions "24.3")

One could teach people to use also package names but mere version
numbers, but that's up to the package maintainer's will. So up to now
the strings provided by found_versions will be used as tags, until
there's a better rule for matching.

> I can also see a desire to list other software and their versions that
> might be implicated in the bug being reported.  Listing their bare
> versions as tags is, I think, obviously no good.  They could just
> include this info in an ad-hoc manner in the body of their report, but
> maybe it would be good to define a property to explicitly list them
> following the same _ pattern of the tags.
>
>   * TODO  .  :emacs_24.3:org_8.0.3:
> :PROPERTIES:
> :IMPLICATED_SOFTWARE: texlive_2012.20120611-5 beamer_3.10-2

The debbugs server returns also a list like

 (found
  (item
   (key . 24.3)
   (value)))

Maybe this could go the direction we want. Obviously, in this example
"key" should be Emacs, and "value" should be 24.3. Then we might also
get something like (if set properly by submitter or maintainer)

 (found
  (item
   (key . "emacs")
   (value . 24.3))
  (item
   (key . "org")
   (value . 8.0.3)))

The IMPLICATED_SOFTWARE property proposed by you could be derived from the

 (affects)

entry. But I haven't seen ever that somebody uses this attribute. It's
always empty, as shown in this example.

> -Brett.

Best regards, Michael.

Re: [O] org-debbugs.el

[Michael Albinus]

Michael Albinus  writes:

>> I tried to test by looking for a specific bug.  This is what I tried:
>>
>> - search phrase: emacsclient
>> - submitter: fatkasuvayu (that is leading part of my email address)
>> - status: done or nothing
>>
>> But then I get an empty "*Org Bugs*" buffer.
>
> Hmm, yes. But this seems to be a server side problem. If you apply the
> same search via its web interface, you get the same empty result:
>
> <http://debbugs.gnu.org/cgi/search.cgi?phrase=emacsclient&search=search&skip=0&attribute_field=submitter&attribute_operator=STRINC&attribute_value=fatkasuvayu&order_field=&order_operator=STRA&max_results=10>
>
> I'll investigate.

PS: You could bypass this restriction using the search phrase
"emacsclient AND fatkasuvayu" (without quotes).

Best regards, Michael.

Re: [O] org-debbugs.el

[Michael Albinus]

Suvayu Ali  writes:

> Hi Michael,

Hi Suvayu,

> I tried to test by looking for a specific bug.  This is what I tried:
>
> - search phrase: emacsclient
> - submitter: fatkasuvayu (that is leading part of my email address)
> - status: done or nothing
>
> But then I get an empty "*Org Bugs*" buffer.

Hmm, yes. But this seems to be a server side problem. If you apply the
same search via its web interface, you get the same empty result:

<http://debbugs.gnu.org/cgi/search.cgi?phrase=emacsclient&search=search&skip=0&attribute_field=submitter&attribute_operator=STRINC&attribute_value=fatkasuvayu&order_field=&order_operator=STRA&max_results=10>

I'll investigate.

> A small problem though, calling org-debbugs-search or org-debbugs-bugs
> from an "*Org Bugs*" buffer gives me the following backtraces:

Oops. Fixed, patch appended.

Best regards, Michael.

>From c0214b63bc7a5e532a1c0fe06ebe3bb50f1a9b49 Mon Sep 17 00:00:00 2001
From: Michael Albinus 
Date: Wed, 2 Oct 2013 13:36:20 +0200
Subject: [PATCH] * org-debbugs.el (org-debbugs-mode-map): Move docstring where
 it belongs to.

---
 contrib/lisp/org-debbugs.el | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/contrib/lisp/org-debbugs.el b/contrib/lisp/org-debbugs.el
index 9c31b2b..fe5430e 100644
--- a/contrib/lisp/org-debbugs.el
+++ b/contrib/lisp/org-debbugs.el
@@ -409,11 +409,11 @@ returned."
 	  hits))
 
 (defconst org-debbugs-mode-map
-  "Keymap for the `org-debbugs-mode' minor mode."
   (let ((map (make-sparse-keymap)))
 (define-key map (kbd "C-c # c") 'debbugs-gnu-send-control-message)
 (define-key map (kbd "C-c # d") 'debbugs-gnu-display-status)
-map))
+map)
+  "Keymap for the `org-debbugs-mode' minor mode.")
 
 ;; Make byte-compiler quiet.
 (defvar gnus-posting-styles)
-- 
1.8.1.2

Re: [O] org-debbugs.el

[Michael Albinus]

Michael Albinus  writes:

Hi,

> I have produced a very first shot of org-debbugs.el. It shows you bug
> reports from debbugs.gnu.org as TODO items. It needs the debbugs package
> from the GNU ELPA repository.

Well, there hasn't been too much response for this. I have completed the
work anyway. Maybe it is worth to say, that the package does not show
org-mode bugs only. It could show any bug located on debbugs.gnu.org as
TODO item.

Compared with the first version, this package uses now tags similar to
the proposal by Suvayu. It also shows archived bugs, if desired.

There is a new minor mode org-debbugs-mode, which allows to send control
messages directly to debbugs.gnu.org. This simplifies handling of bugs.

There are also two new commands: `org-debbugs-search' allows full text
search on debbugs.gnu.org. `org-debbugs-bugs' shows bugs according to
their number. Read the Commentary section for details.

If the org-mode maintainers find this package useful, it could be added
to the contrib directory. A respective patch is appended. I'm pretty
sure that org-mode aficionados could improve the handling of TODO items;
I'm rather a rookie wrt org-mode. If there are questions wrt to the
gnus.debbugs.org interface I'll be happy to help.

Best regards, Michael.

>From 6f002a1da1835625cd7451da2aaa4699254a6372 Mon Sep 17 00:00:00 2001
From: Michael Albinus 
Date: Wed, 2 Oct 2013 09:28:50 +0200
Subject: [PATCH] Add org-debbugs.el.

---
 contrib/README  |   1 +
 contrib/lisp/org-debbugs.el | 455 
 2 files changed, 456 insertions(+)
 create mode 100644 contrib/lisp/org-debbugs.el

diff --git a/contrib/README b/contrib/README
index bdbdb47..6aba0d6 100644
--- a/contrib/README
+++ b/contrib/README
@@ -22,6 +22,7 @@ org-collector.el --- Collect properties into tables
 org-colview-xemacs.el	 --- Column View in Org-mode, XEmacs-specific version
 org-contacts.el  --- Contacts management
 org-contribdir.el--- Dummy file to mark the org contrib Lisp directory
+org-debbugs.el   --- Org-mode interface for the GNU bug tracker
 org-depend.el--- TODO dependencies for Org-mode
 org-drill.el --- Self-testing with org-learn
 org-element.el   --- Parser and applications for Org syntax
diff --git a/contrib/lisp/org-debbugs.el b/contrib/lisp/org-debbugs.el
new file mode 100644
index 000..9c31b2b
--- /dev/null
+++ b/contrib/lisp/org-debbugs.el
@@ -0,0 +1,455 @@
+;;; org-debbugs.el --- Org-mode interface for the GNU bug tracker
+
+;; Copyright (C) 2013 Free Software Foundation, Inc.
+
+;; Author: Michael Albinus 
+;; Keywords: comm, hypermedia, maint, outlines
+
+;; This file is not part of GNU Emacs.
+
+;; This program is free software: you can redistribute it and/or modify
+;; it under the terms of the GNU General Public License as published by
+;; the Free Software Foundation, either version 3 of the License, or
+;; (at your option) any later version.
+
+;; This program is distributed in the hope that it will be useful,
+;; but WITHOUT ANY WARRANTY; without even the implied warranty of
+;; MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+;; GNU General Public License for more details.
+
+;; You should have received a copy of the GNU General Public License
+;; along with GNU Emacs.  If not, see <http://www.gnu.org/licenses/>.
+
+;;; Commentary:
+
+;; This package provides an interface to bug reports which are located
+;; on the GNU bug tracker debbugs.gnu.org.  Its main purpose is to
+;; show and manipulate bug reports as org-mode TODO items.
+
+;; If you have `org-debbugs.el' in your load-path, you could enable
+;; the bug tracker commands by the following lines in your ~/.emacs
+;;
+;;   (autoload 'org-debbugs "org-debbugs" "" 'interactive)
+;;   (autoload 'org-debbugs-search "org-debbugs" "" 'interactive)
+;;   (autoload 'org-debbugs-bugs "org-debbugs" "" 'interactive)
+
+;; The bug tracker is called interactively by
+;;
+;;   M-x org-debbugs
+
+;; It asks for the severities, for which bugs shall be shown. This can
+;; be either just one severity, or a list of severities, separated by
+;; comma.  Valid severities are "serious", "important", "normal",
+;; "minor" or "wishlist".  Severities "critical" and "grave" are not
+;; used, although configured on the GNU bug tracker.  If no severity
+;; is given, all bugs are selected.
+
+;; If a prefix is given to the command, more search parameters are
+;; asked for, like packages (also a comma separated list, "org-mode" is
+;; the default), or whether archived bugs shall be shown.
+
+;; Another command is
+;;
+;;   M-x org-debbugs-search
+
+;; It behaves like `org-debbugs', but asks at the beginning for a
+;; search phrase t

[O] org-debbugs.el

[Michael Albinus]

Hi,

I have produced a very first shot of org-debbugs.el. It shows you bug
reports from debbugs.gnu.org as TODO items. It needs the debbugs package
from the GNU ELPA repository.

If you want to try it, you could call

  (org-debbugs nil '("org-mode"))

You will see a list of TODO items which belong to the org-mode bugs on
debbugs.gnu.org. The last link of such an item, [[Messages]], shows you
all corresponding messages for that bug.

If you want to see a bulk of bug reports, call

  (org-debbugs
'("serious" "important" "normal")
'("emacs"))

This returns much more bugs (from the "emacs" project), presented as
chunk of 500 TODO items. If you follow the link at the very end of the
buffer, you will get the next 500 items. And so on.

You can call it also interactively, via "M-x org-debbugs" or "C-u M-x
org-debbugs".

Have fun!

Best regards, Michael.



org-debbugs.el
Description: application/emacs-lisp

Re: [O] org mode R remote code evaluation

[Michael Albinus]

Eric Schulte  writes:

> I'd rather not hard-code the value of "/tmp/".  Perhaps you could rework
> the patch so that it introduces a new customizable variable (including a
> documentation string) so that users can set the value for their system.
>
> Also, please package the patch with git format-patch.

Patch is appended.

> Thanks,

Best regards, Michael.

>From 2b8db5486de75ec35c2c0d3e6063847cf582ace7 Mon Sep 17 00:00:00 2001
From: Michael Albinus 
Date: Fri, 27 Sep 2013 13:34:03 +0200
Subject: [PATCH] * ob-core.el (org-babel-local-file-name): Simplify.
 (org-babel-process-file-name): Apply `expand-file-name' first.
 (org-babel-remote-temporary-directory): New defcustom. (org-babel-temp-file):
 Use it.

---
 lisp/ob-core.el | 19 ---
 1 file changed, 12 insertions(+), 7 deletions(-)

diff --git a/lisp/ob-core.el b/lisp/ob-core.el
index 5a032a1..a7c227b 100644
--- a/lisp/ob-core.el
+++ b/lisp/ob-core.el
@@ -2680,11 +2680,7 @@ Fixes a bug in `tramp-handle-call-process-region'."
 
 (defun org-babel-local-file-name (file)
   "Return the local name component of FILE."
-  (if (file-remote-p file)
-  (let (localname)
-	(with-parsed-tramp-file-name file nil
- localname))
-file))
+  (or (file-remote-p file 'localname) file))
 
 (defun org-babel-process-file-name (name &optional no-quote-p)
   "Prepare NAME to be used in an external process.
@@ -2694,7 +2690,10 @@ remotely.  The file name is then processed by `expand-file-name'.
 Unless second argument NO-QUOTE-P is non-nil, the file name is
 additionally processed by `shell-quote-argument'"
   ((lambda (f) (if no-quote-p f (shell-quote-argument f)))
-   (expand-file-name (org-babel-local-file-name name
+   ;; We must apply `expand-file-name' on the whole filename.  If we
+   ;; would apply it on the local filename only, undesired effects
+   ;; like prepending a drive letter on MS Windows could happen.
+   (org-babel-local-file-name (expand-file-name name
 
 (defvar org-babel-temporary-directory)
 (unless (or noninteractive (boundp 'org-babel-temporary-directory))
@@ -2707,6 +2706,11 @@ additionally processed by `shell-quote-argument'"
 Used by `org-babel-temp-file'.  This directory will be removed on
 Emacs shutdown."))
 
+(defcustom org-babel-remote-temporary-directory "/tmp/"
+  "Directory to hold temporary files on remote hosts."
+  :group 'org-babel
+  :type 'string)
+
 (defmacro org-babel-result-cond (result-params scalar-form &rest table-forms)
   "Call the code to parse raw string results according to RESULT-PARAMS."
   (declare (indent 1)
@@ -2736,7 +2740,8 @@ of `org-babel-temporary-directory'."
   (if (file-remote-p default-directory)
   (let ((prefix
  (concat (file-remote-p default-directory)
- (expand-file-name prefix temporary-file-directory
+ (expand-file-name
+		  prefix org-babel-remote-temporary-directory
 (make-temp-file prefix nil suffix))
 (let ((temporary-file-directory
 	   (or (and (boundp 'org-babel-temporary-directory)
-- 
1.8.1.2

Re: [O] org mode R remote code evaluation

[Michael Albinus]

Alexander Vorobiev  writes:

> #+BEGIN_SRC sql :engine postgresql :dir /grid: :results output :
> colnames yes
> select 2+2 as four, 1+1 as one;
> #+END_SRC
>
> #+RESULTS:
> | 4\t2 |
>
> It works! As you see there are still some problems with ob-sql (no
> column names and \t is not parsed correctly) but the remote execution
> seems to be fixed.

Great! I will prepare the patch tomorrow, as instructed by Eric.

> Thanks,
> Alex

Best regards, Michael.

Re: [O] Org mode issue tracker

[Michael Albinus]

Suvayu Ali  writes:

> I forgot to add; regarding your comment about retrieving several
> messages might be expensive, there could be an elisp link or a babel
> source block that does this on demand.

"Elisp link" is the beast I was looking for, thanks. Likely, there is no
need for a babel source block.

Best regards, Michael.

Re: [O] Org mode issue tracker

[Michael Albinus]

"Sebastien Vauban" 
writes:

Hi Sebastien and Suvayu,

Thanks a lot for your comments. That's pretty good for starting a
proof-of-concept. Will do.

Some comments from my side:

>>> ((source . "unknown")
>>>  (found_versions "24.3")
>>
>> Emacs version ends up as a tag:
>>
>> * TODO  .   :24.3:

found_versions is optional. So we cannot assume it is always
set. Furthermore, it is a *list* of strings (although I haven't seen
ever more than one entry). What to do in this case?

>>>  (msgid . "<877gfqkm9t.fsf-re5jqeeqqe8avxtiumw...@public.gmane.org>")
>>
>> An added bonus idea: Gmane has this amazing feature where you can link
>> to a message using it's message id.  So a property like: GMANE_URL would
>> be awesome.
>>
>> * TODO  .   :24.3:
>>   :PROPERTIES:
>>   :GMANE_URL:
>> http://mid.gmane.org/877gfqkm9t.fsf-re5jqeeqqe8avxtiumw...@public.gmane.org
>>   :END:
>>   <2013-08-13 Tue>

Agreed. However, debbugs.el is also capable to retrieve all messages
from the server, as we do in debbugs-gnu. I'll show below.

>>>  (severity . "normal")

I would really appreciate, if we could make the severity visible. In the
org manual, I've read something about A B C priorities. On debbugs, we
have the severities "serious", "important", "normal", "minor",
"wishlist", and "tagged". How could we map them on the TODO items? In
debbugs-gnu we use different faces (colors) for the entries.

>>>  (subject . "24.3; org-crypt: Making epg-context local to *epg* while 
>>> let-bound!")
>>
>> * TODO Making epg-context local to *epg* while let-bound! :24.3:org_crypt:
>>   :PROPERTIES:
>>   :DEBGUGS_ID:   15081
>>   :GMANE_URL:
>> http://mid.gmane.org/877gfqkm9t.fsf-re5jqeeqqe8avxtiumw...@public.gmane.org
>>   :END:
>>   <2013-08-13 Tue>
>>
>> As you see above, it would be great if we could simplify the suject and
>> tag the org-module involved (note hyphens are not allowed, they need to
>> be transformed to underscore).

OK. However, we cannot assume a given syntax on the subject. An error
can be reported by a simple mail to @debbugs.gnu.org, with free
subject. A preformatted subject can be assumed only, if the error has
been reported by `report-emacs-bug' or `org-submit-bug-report'.

>>>  (pending . "pending")
>>
>> And this should finally decide the TODO state.  For the moment a
>> reasonable mapping would be "pending" -> "TODO".  But would be good to
>> have support for "DONE", "WIP", or similar (I'm not familiar with all
>> the debbug states :-p)

The pending field could have the values "pending", "forwarded" or
"done". "forwarded" does not seem to be used on debbugs.gnu.org.

>>>  (tags)

Tags are useful for more information on the status. They are a list of
strings like "fixed", "notabug", "wontfix", "unreproducible",
"moreinfo" or "patch". In the given example, this list is empty.

>>>  (package "emacs" "org-mode")
>>
>> I guess this is how you filter out org-mode bugs from the rest.

Yep. In the org-mode case, it is sufficient to filter for the package
"org-mode". But why not create a todo list for another debbugs project,
like "emacs" or "gnus" or whatever? And btw, one could filter also for
other attributes but just package. Even full text search is possible.

>> * TODO Making epg-context local to  *epg* while let-bound! 
>> :24.3:org_crypt:
>>   :PROPERTIES:
>>   :DEBGUGS_ID:   15081
>>   :REPORTER: Thierry Volpiatto 
>> 
>>   :GMANE_URL:
>> http://mid.gmane.org/877gfqkm9t.fsf-re5jqeeqqe8avxtiumw...@public.gmane.org
>>   :END:

Yep.

Now it comes to the attached emails. In a second (!) step, debbugs-gnu
is able to retrieve the corresponding emails. In the given example, it
would call (debbugs-get-bug-log 15081) This returns a list like

(((body . "The body of the message")
  (msg_num . 5)
  (attachments)
  (header . "All header lines of the message")))

I have just shown one message, of course all messages will be
retrieved. Alternative, one could retrieve the messages in MBOX format.

Wouldn't it be nice, if we could include the messages as well? Likely
not by default (it would be expensive to download all messages for,
let's say, 500 bugs at once). But we could add a kind of link which,
when followed, could show the messages as well in org-mode. Somehow.

> Best regards,
>   Seb

Best regards, Michael.

Re: [O] org mode R remote code evaluation

[Michael Albinus]

Alexander Vorobiev  writes:

> Michael,

Hi Alex,

> * this doesn't work
> #+BEGIN_SRC sql :engine postgresql :dir /grid: :results output
> select 1+2 as three;
> #+END_SRC
>
> /plinkx:grid:/tmp/sql-in-7928arv...done
> psql -A -F " " -f "c:/tmp/sql-in-7928arv" -o "c:/tmp/sql-out-7928Z_E" 
> -f c:/tmp/sql-in-7928arv -o c:/tmp/sql-out-7928Z_E
> No such file or directory 'c:/tmp/sql-in-7928arv'

Try this extended patch:

--8<---cut here---start->8---
diff --git a/lisp/ob-core.el b/lisp/ob-core.el
index 5a032a1..2789f47 100644
--- a/lisp/ob-core.el
+++ b/lisp/ob-core.el
@@ -2680,11 +2680,7 @@ Fixes a bug in
`tramp-handle-call-process-region'."
 
 (defun org-babel-local-file-name (file)
   "Return the local name component of FILE."
-  (if (file-remote-p file)
-  (let (localname)
-   (with-parsed-tramp-file-name file nil
-localname))
-file))
+  (or (file-remote-p file 'localname) file))
 
 (defun org-babel-process-file-name (name &optional no-quote-p)
   "Prepare NAME to be used in an external process.
@@ -2694,7 +2690,10 @@ remotely.  The file name is then processed by
   `expand-file-name'.
 Unless second argument NO-QUOTE-P is non-nil, the file name is
 additionally processed by `shell-quote-argument'"
   ((lambda (f) (if no-quote-p f (shell-quote-argument f)))
-   (expand-file-name (org-babel-local-file-name name
+   ;; We must apply `expand-file-name' on the whole filename.  If we
+   ;; would apply it on the local filename only, undesired effects
+   ;; like prepending a drive letter on MS Windows could happen.
+   (org-babel-local-file-name (expand-file-name name
 
 (defvar org-babel-temporary-directory)
 (unless (or noninteractive (boundp 'org-babel-temporary-directory))
@@ -2736,7 +2735,7 @@ of `org-babel-temporary-directory'."
   (if (file-remote-p default-directory)
   (let ((prefix
  (concat (file-remote-p default-directory)
- (expand-file-name prefix temporary-file-directory
+ (expand-file-name prefix "/tmp/"
 (make-temp-file prefix nil suffix))
 (let ((temporary-file-directory
   (or (and (boundp 'org-babel-temporary-directory)
--8<---cut here---end--->8---

> Thanks
> Alex

Best regards, Michael.

PS: the analysis of your cygwin problem is delayed. I don't run MS
Windows on my machines, I need to hijack a machine from my wife or
somebody else for analysis.

Re: [O] org mode R remote code evaluation

[Michael Albinus]

Eric Schulte  writes:

> I'd rather not hard-code the value of "/tmp/".  Perhaps you could rework
> the patch so that it introduces a new customizable variable (including a
> documentation string) so that users can set the value for their system.

Will do, tomorrow. I would even prefer a more general solution, a new
function which returns a ("the") temp directory on a remote host. This
would be useful also outside org-mode. But this would require changes in
Emacs/Tramp, which won't be applicable for org immediately (backwards
compatibility, and alike).

> If you can keep the patch under 15LOC we can include it w/o requiring
> FSF copyright assignment, otherwise see [1] for contribution details.

No problem. As Tramp maintainer, I have signed the FSF papers for Emacs
10+ years ago. This shall be valid also for org patches.

> Thanks,

Best regards, Michael.

Re: [O] Org mode issue tracker

[Michael Albinus]

"Loyall, David"  writes:

>> (I'm not so experienced with org-mode, so I would need at least some
>> assistance how such a TODO item should look like)
>
> A 'headline' is a 'TODO item' if-and-only-if it contains one of the
> TODO Keywords in the appropriate position.
>
> See: http://orgmode.org/worg/dev/org-syntax.html
>
> While you're in that document, have a look at the various structures
> that can live inside a headline (for example, timestamps).

Thanks. I've contacted already the org info pages, in order to get an
idea what's possible. But a general doc is one thing, a mapping of a
debbugs record onto a TODO entry is another one.

Let's check it with an example. For bug 15081, debbugs-gnu returns the
following list:

((source . "unknown")
 (found_versions "24.3")
 (done)
 (blocks)
 (date . 1376383861)
 (fixed)
 (fixed_versions)
 (mergedwith)
 (found
  (item
   (key . 24.3)
   (value)))
 (unarchived)
 (blockedby)
 (keywords)
 (summary)
 (msgid . "<877gfqkm9t@gmail.com>")
 (id . 15081)
 (forwarded)
 (severity . "normal")
 (owner)
 (log_modified . 1376383862)
 (location . "db-h")
 (subject . "24.3; org-crypt: Making epg-context local to  *epg* while 
let-bound!")
 (originator . "Thierry Volpiatto ")
 (last_modified . 1376408720)
 (pending . "pending")
 (affects)
 (archived)
 (tags)
 (package "emacs" "org-mode")
 (fixed_date)
 (found_date)
 (bug_num . 15081))

The keys shall be self-explaining. How would a TODO item look like?
Note, that these metadata do not contain the corresponding messages
yet. debbugs-gnu could retrieve them in a second run; the TODO item
shall offer a link to them, inline.

> Thank you,
> --Dave

Best regards, Michael.

Re: [O] org mode R remote code evaluation

[Michael Albinus]

Alexander Vorobiev  writes:

> Hi Michael,

Hi Alex,

> The patch seems to be working, the only thing I noticed is having
> http://www.emacswiki.org/emacs/setup-cygwin.el loaded together with
> the patched ob-core.el makes tramp prepend "/cygwin" to /tmp/. When I
> disabled (require 'setup-cygwin) the patch works as expected. Outside
> of org/babel setup-cygwin has no effect on Tramp.

This problem does not seem to be related to org-mode code. Could
somebody, please, commit my patch to org's repository? Thanks.

I will try to find out what's up with Tramp and Cygwin. Sadly, it has
been a misalliance very often :-(

> Thanks,
> Alex

Best regards, Michael.

Re: [O] Org mode issue tracker

[Michael Albinus]

"Sebastien Vauban" 
writes:

> Hi Suvayu,

Hi,

>>> The other solution that I'd see would be using Emacs' own bug tracker (the
>>> `org' package is already known to them), if that's
>>> possible. Anyway, having the
>>> bugs in an Org file seems natural too!
>>
>> I think this is a great idea.  A combination of an Org file (either
>> public or private) and the Emacs bug tracker with Org package tags
>> should be able to handle our needs.
>>
>> I see only one potential problem, is there an easy way to subscribe to
>> only a specific package tag on the Emacs bug tracker?  I imagine most
>> contributors following Org bugs will not be interested in other Emacs
>> bugs.
>
> I don't know. I guess this should be asked directly to them. Indeed, it'd be
> good to have a (virtual) newsgroup with only bugs related to `org', like what
> exists for Stack Overflow.

There is the debbugs package on ELPA. The frontend, debbugs-gnu, allows
to filter for packages and tags. Try

(debbugs-gnu '("serious" "important" "normal") '("org-mode"))

On my wannabe todo list is a package debbugs-org.el, which shows the
entries as TODO items. If the org community decides to use debbugs as
issue tracker, it would give me a push.

(I'm not so experienced with org-mode, so I would need at least some
assistance how such a TODO item should look like)

> Best regards,
>   Seb

Best regards, Michael.

Re: [O] org mode R remote code evaluation

[Michael Albinus]

Alexander Vorobiev  writes:

> Hi Michael,

Hi Alex,

> Here it is.

Thanks. I believe, the following patch shall cure it:

--8<---cut here---start->8---
--- a/lisp/ob-core.el
+++ b/lisp/ob-core.el
@@ -2735,8 +2735,12 @@
 value of `temporary-file-directory' temporarily set to the value
 of `org-babel-temporary-directory'."
   (if (file-remote-p default-directory)
   (let ((prefix
+;; We cannot use `temporary-file-directory' as local part
+;; on the remote host, because it might be another OS
+;; there.  So we assume "/tmp", which ought to exist on
+;; relevant architectures.
  (concat (file-remote-p default-directory)
- (expand-file-name prefix temporary-file-directory
+ (expand-file-name prefix "/tmp/"
 (make-temp-file prefix nil suffix))
 (let ((temporary-file-directory
   (or (and (boundp 'org-babel-temporary-directory)
--8<---cut here---end--->8---

Could you, please, test?

> Thanks,
> Alex

Best regards, Michael.

Re: [O] org mode R remote code evaluation

[Michael Albinus]

Alexander Vorobiev  writes:

> Here is what I have:
>
> ELISP> emacs-version
> "24.3.1"
> ELISP> tramp-version
> "2.2.7"
> ELISP> org-version
> "8.2"

Well, that sounds recent. Could you, please, perform (setq tramp-verbose 6)
prior your test? There will be a Tramp debug buffer, which I would like
to analyze.

> Thanks,
> Alex

Best regards, Michael.

Re: [O] org mode R remote code evaluation

[Michael Albinus]

Alexander Vorobiev  writes:

> The ":results output" doesn't help in my setup (I'm on Windows, the
> remote system is linux, access is via putty/plink)

I do not run Windows, so I cannot reproduce exactly. However, ...

> #+BEGIN_SRC sh :results output :dir /grid:
> ls
> #+END_SRC
>
> executing Sh code block...
> Tramp: Encoding region using function `base64-encode-region'...done
> Tramp: Decoding region into remote file
> /plinkx:grid:/Users/avorobi/AppData/Local/Temp/ob-input-6116fuY...done
> byte-code: Couldn't write region to
> `/plinkx:grid:/Users/avorobi/AppData/Local/Temp/ob-input-6116fuY',
> decode using `tramp_perl_decode_with_module >%s' failed
>
> The /Users directory obviously does not exist on linux.

... this looks like an old problem. Which Emacs/Tramp version are you using?
Check variables `emacs-version' and `tramp-version'.

> Thanks,
> Alex

Best regards, Michael.

Re: [O] Connect to the ssh and execute any command

[Michael Albinus]

Andrey Tykhonov  writes:

> Hi Michael!

Hi Andrey,

>> Your remote host does not find a proper "id" command. What happens, if
>> you call the following commands in a shell on that remote host:
>> 
>> # id -u
>
> id: Command not found.
>
>> # whereis id
>
> whereis: Command not found.
>
> I also didn't find 'id' by means of
>
> find / -name id
>
> As I understand TRAMP is not able to work without 'id'. Therefore TRAMP is
> not suitable for me...
>
>> # uname -a
>
> FreeBSD {hostname} 8.2-RELEASE FreeBSD 8.2-RELEASE #0: Fri Sep 13
> 21:22:42 PDT 2013 auto-build@{hostname}:{some/path/} amd64

Strange. `id' (and also `whereis') belong to FreeBSD proper. See for
example 

You might check with your remote host why it is not installed.

> Best regards,
> Andrey

Best regards, Michael.

Re: [O] Connect to the ssh and execute any command

[Michael Albinus]

Andrey Tykhonov  writes:

Hi Andrey,

>> Tramp does not use FUSE for ssh connections. Please show an example
>> connection to the remote host, and how it fails.

> Here I try to "ls -la" and get the following error:
>
> Couldn't find a POSIX `id' command

Your remote host does not find a proper "id" command. What happens, if
you call the following commands in a shell on that remote host:

# id -u
# id --version
# which id
# whereis id
# uname -a

> Best regards,
> Andrey.

Best regards, Michael.

Re: [O] Connect to the ssh and execute any command

[Michael Albinus]

Andrey Tykhonov  writes:

[Cc to tramp-de...@gnu.org, because I want to help with Tramp config]

> Hi all!

Hi Andrey,

> During last several days I was trying to implement quite simple script
> which:
>
> 1. Creates new buffer with the shell (M-x shell)
> 2. Executes there "ssh usern...@domain.com". As result -- the password
> prompt appears in the minibuffer. I manually input password.
> 3. Then script executes any command in the recently created buffer
> (shell), for example: "ls -la". So I expect to see directory listing on
> the domain.com.
>
> but, for sorry, I cannot to do so that "ls -la" will be executed!
>
> I googled, I have tried many different approaches but without any luck :-(
>
> Here I should mention quite important thing: I cannot use TRAMP because
> it does not work with the server to which the script connects and then
> on which executes "ls -la". (I suppose that TRAMP uses FUSE, but for
> sorry FUSE does not work with mine server). So TRAMP is not available
> for me.

Tramp does not use FUSE for ssh connections. Please show an example
connection to the remote host, and how it fails.

Prior to the test, you should apply

   (setq tramp-verbose 6)

This will create a Tramp debug buffer, which shall show the problem.

> Regards,
> Andrey

Best regards, Michael.

Re: [O] ediff-directories - how to ignore timestamps and work recursively

[Michael Albinus]

Suvayu Ali  writes:

>> Hello,
>> 
>> I want to compare two directories and see what files are different,
>> however, the comparison should ignore timestamps of files. Is there
>> a simple solution?
>> 
>> I had assumed that ediff would also consider files in subdirectories
>> of the directory paths given for comparison. Apparently, it does not
>> do that in Emacs 23.4.1 - is there a "recursive" option?
>> 
>
> You might have better luck on the emacs list.  That said, did you look
> at `ediff-directories'?

That's also my tool of choice. Combined with the key sequene "= h x",
which shows you only the files which differ.

`ediff-directories' is not recursive, but it gives you also subdirectory
pairs to compare. Just hit enter on such a pair.

As bonus, it even works for remote directories.

Best regards, Michael.

Re: [O] bug-tracker

[Michael Albinus]

Andreas Röhler  writes:

>> There is `reporter-submit-bug-report' of reporter.el, which you could
>> customize to your needs.
>>
>> Compare, how Tramp uses it in `tramp-bug' (Ha! another advertisement!).
>
> Hmm, maybe you are fastest just to copy a version with org-mode in the slots.
>
> That may replace org-submit-bug-report, if Bastien and the others agree.

I believe it is better written by org maintainers. They know much better
which kind of information is needed.

> Andreas

Best regards, Michael.

Re: [O] bug-tracker

[Michael Albinus]

David Engster  writes:

> I was always under the impression that those tags are merely a way for,
> well, tagging bugs, so that you can search for them.  Same for
> packages. I didn't know that this also implied that you're encouraged to
> report bugs against upstream packages, possibly for features which are
> not yet in Emacs (or may even never land there, like some stuff in
> org/contrib, cedet/contrib, etc.).

This must be discussed with the Emacs maintainers, of course. If org
error reports will contain a substantial part of non-core Emacs
problems, an own debbugs package "org" might be better. Reports arriving
via the Emacs report chain could be reassigned to both packages
"emacs,org" then.

I recommend to contact Glenn Morris.

> -David

Best regards, Michael.

Re: [O] bug-tracker

[Michael Albinus]

David Engster  writes:

> Is it OK to report bugs for upstream/development versions through
> `report-emacs-bugs', though? I always thought this should only be used
> for stuff that's actually bundled with Emacs (what about bugs in
> org/contrib, for instance?).

debbugs.gnu.org is not only for Emacs. See
 which other projects are
hosted there. "gnus" is a prominent example for a subpackage of Emacs
with an own bug package using debbugs.gnu.org.

An alternative approach is tagging bugs of a project with your package
name. See existing user tags of project emacs at
. "cedet"
uses this mechanism already.

And shame on me, Tramp doesn't use debbugs.gnu.org (yet).

> -David

Best regards, Michael.

Re: [O] bug-tracker

[Michael Albinus]

Andreas Röhler  writes:

> With exception of the noise, M-x report-emacs-bugs tends to send.
>
> Herewith is a slim version, adapted to org-mode AFAIU

Why do you want to code all the nasty bits yourself? There is
`reporter-submit-bug-report' of reporter.el, which you could customize
to your needs.

Compare, how Tramp uses it in `tramp-bug' (Ha! another advertisement!).

Best regards, Michael.

Re: [O] bug-tracker

[Michael Albinus]

Andreas Röhler  writes:

> Hi folks,

Hi,

> What about using some of the tools around?
>
> Mirroring the stuff at github would provide a tracker just by the way...

Or you use debbugs.gnu.org, which hosts the Emacs bugtracker. Some of
the org bugs will arrive there anyway, from people using "M-x
report-emacs-bug".


And there are debbugs.el and debbugs-gnu.el, which allow access to the
bugs from inside Emacs. I could imagine a debbugs-org.el as well, which
translates bugs into org tasks, or whatever.


> Cheers,
>
> Andreas

Best regards, Michael (author of debbugs.el, coauthor of debbugs-gnu.el)

Re: [O] Running a sudo in a #+begin_src sh fails to get tty and askpass

[Michael Albinus]

Emilio Torres Manzanera  writes:

> Dear list,
> I want to compile (C-c C-c) the following code
>
> #+begin_src sh
> sudo apt-get update
> #+end_src

#+begin_src sh :dir /sudo::
apt-get update
#+end_src

> Thanks!
> Emilio

Best regards, Michael.

Re: [O] [BUG] remote execution in heterogeneous environment

[Michael Albinus]

Bastien  writes:

> Hi Michael,

Hi Bastien,

> Please send me your public key so that I can give your write access.
> Otherwise can you just resent the patch as a git patch with a commit
> message have an Emacs-ready ChangeLog entry?

I don't believe I need permanent write access. Patch appended.

> Thanks!

Best regards, Michael.

>From a39b35c3967ac7c95e3442434a3ca44cba54fca5 Mon Sep 17 00:00:00 2001
From: Michael Albinus 
Date: Wed, 9 Jan 2013 13:48:30 +0100
Subject: [PATCH] * ob-eval.el (org-babel-shell-command-on-region): Use
 `executable-find' for local `shell-file-name'

---
 lisp/ob-eval.el |   14 ++
 1 file changed, 10 insertions(+), 4 deletions(-)

diff --git a/lisp/ob-eval.el b/lisp/ob-eval.el
index 8764920..8018111 100644
--- a/lisp/ob-eval.el
+++ b/lisp/ob-eval.el
@@ -137,11 +137,17 @@ specifies the value of ERROR-BUFFER."
 		   t)))
   (let ((input-file (org-babel-temp-file "input-"))
 	(error-file (if error-buffer (org-babel-temp-file "scor-") nil))
+	;; Unfortunately, `executable-find' does not support file name
+	;; handlers.  Therefore, we could use it in the local case
+	;; only.
 	(shell-file-name
-	 (if (file-executable-p
-	  (concat (file-remote-p default-directory) shell-file-name))
-	 shell-file-name
-	   "/bin/sh"))
+	 (cond ((and (not (file-remote-p default-directory))
+		 (executable-find shell-file-name))
+		shell-file-name)
+	   ((file-executable-p
+		 (concat (file-remote-p default-directory) shell-file-name))
+		shell-file-name)
+	   ("/bin/sh")))
 	exit-status)
 ;; There is an error in `process-file' when `error-file' exists.
 ;; This is fixed in Emacs trunk as of 2012-12-21; let's use this
-- 
1.7.10.4

Re: [O] [BUG] remote execution in heterogeneous environment

[Michael Albinus]

Achim Gratz  writes:

> Works a treat.  Please install!

I have no write access to the org repo. Maybe somebody else could install?

> Regards,
> Achim.

Best regards, Michael.

Re: [O] [BUG] remote execution in heterogeneous environment

[Michael Albinus]

Achim Gratz  writes:

>> The use of "/bin/sh" as fallback should be OK. In the local case, the
>> first cond clause shall be selected (otherwise there is something really
>> wrong).
>
> Yes.  But on Windows there is always something wrong… :-)

Again: under Windows, on the local host, `shell-file-name' should do. For
the remote case you are right, but I doubt that any org user has ever
tried to run a remote Windows shell via Tramp.

>> And for remote execution, "/bin/sh" should exist execept in case
>> of remote MS Windows or Android devices. Once you want run shells from
>> org there, we could even tweak this :-)
>
> I was thinking towards being able to use a restricted shell.

`shell-file-name' is your friend. "/bin/sh" is just the last resort. If
you dislike it, you could raise an error instead :-)

> Regards,
> Achim.

Best regards, Michael.

Re: [O] [BUG] remote execution in heterogeneous environment

[Michael Albinus]

Achim Gratz  writes:

>> +  (let ((input-file (org-babel-temp-file "input-"))
>> +(error-file (if error-buffer (org-babel-temp-file "scor-") nil))
>> +(shell-file-name
>> + (if (file-executable-p
>> +  (concat (file-remote-p default-directory) shell-file-name))
>> + shell-file-name
>> +   "/bin/sh"))
>
> The hard-coded /bin/sh breaks testing with NT-Emacs and using Cygwin as
> the backend because of the different path conventions in both
> environments.  This is a hack, but it works when setting SHELL=dash,
> note that there are no path components in there and even if your test
> would fail: NTEmacs knows nothing about Cygwin's path.  Can you please
> arrange that shell-file-name is used without alteration when the
> execution is local?  Even for remote execution hardcoding /bin/sh seems
> a bit heavy-handed to me…

What about this:

--8<---cut here---start->8---
--- a/lisp/ob-eval.el
+++ b/lisp/ob-eval.el
@@ -137,11 +137,17 @@ specifies the value of ERROR-BUFFER."
   t)))
   (let ((input-file (org-babel-temp-file "input-"))
(error-file (if error-buffer (org-babel-temp-file "scor-") nil))
+   ;; Unfortunately, `executable-find' does not support file name
+   ;; handlers.  Therefore, we could use it in the local case
+   ;; only.
(shell-file-name
-(if (file-executable-p
- (concat (file-remote-p default-directory) shell-file-name))
-shell-file-name
-  "/bin/sh"))
+(cond ((and (not (file-remote-p default-directory))
+(executable-find shell-file-name))
+   shell-file-name)
+  ((file-executable-p
+(concat (file-remote-p default-directory) shell-file-name))
+   shell-file-name)
+  ("/bin/sh")))
exit-status)
 ;; There is an error in `process-file' when `error-file' exists.
 ;; This is fixed in Emacs trunk as of 2012-12-21; let's use this
--8<---cut here---end--->8---

The use of "/bin/sh" as fallback should be OK. In the local case, the
first cond clause shall be selected (otherwise there is something really
wrong). And for remote execution, "/bin/sh" should exist execept in case
of remote MS Windows or Android devices. Once you want run shells from
org there, we could even tweak this :-)

> Regards,
> Achim.

Best regards, Michael.

Re: [O] remote execution in heterogeneous environment

[Michael Albinus]

George Jones  writes:

> Success. No setting of temporary-file-directory needed.

Great! Thanks for your inisistent testing.

> Thanks,
> ---George

Best regards, Micvhael.

Re: [O] remote execution in heterogeneous environment

[Michael Albinus]

Bastien  writes:

> Hi Michael,

Hi Bastien,

>> Indeed. I've published a patch to ob.el (as of Emacs trunk). Meanwhile,
>> ob.el has been renamed to ob-core.el; likely that patch was lost :-(
>>
>> Bastien, could you please apply this patch (for `org-babel-temp-file')?
>
> Mhh... not sure what patch you refer to -- can you send me the patch
> itself and/or a link to it?



The last patch in this message. Again, the function seems to be moved to
ob-core.el now.

> Thanks!

Re: [O] remote execution in heterogeneous environment

[Michael Albinus]

George Jones  writes:

> Still need to 
> (setq temporary-file-directory "/tmp/") 
>
> for things to work, else I get:
>
> Couldn't write region to
> `/scpc:george@localhost#:/var/folders/j6/j6w17khs3vl9s2_yg4rb5zsmgn/T/input-
> 11249kNp', decode using `base64 -d -i >%s\
> ' failed 
>
> Test script and output, without explicitly setting
> temporary-file-directory, attached:

Indeed. I've published a patch to ob.el (as of Emacs trunk). Meanwhile,
ob.el has been renamed to ob-core.el; likely that patch was lost :-(

Bastien, could you please apply this patch (for `org-babel-temp-file')?

> Thanks,
> ---George Jones

Best regards, Michael.

Re: [O] remote execution in heterogeneous environment

[Michael Albinus]

George  writes:

Hi George,

> Make everything works with:
>
>   (setq temporary-file-directory "/tmp/")

That's a misunderstanding. I meant the workaround I have proposed
yesterday on the org-mode ML, and which has been committed by Bastien.

Meanwhile, everything shall work out-of-the box. Does it for you?

> Thanks,
> ---George Jones

Best regards, Michael.

Re: [O] remote execution in heterogeneous environment

[Michael Albinus]

George Jones  writes:

> Hi.

Hi George,

> Similar procedure on a mac still yeilds:
>
> Couldn't write region to
> `/scpc:g...@example.com:/var/folders/j6/j6w17khs3vl9s2_yg4rb5zsmgn/T/input-
> 61683xyS', decode using `mimencode -u -b >%s' f\
> ailed

Could you, please, show the exact test case? And please apply the
workaround first (see my other email).

> FYI/Thanks,
> ---George Jones

Best regards, Michael.

Re: [O] remote execution in heterogeneous environment

[Michael Albinus]

Bastien  writes:

> Hi Michael,

Hi everybody,

> From the org-mode repo, simply run "make test": it will compile the
> files and run the test suite.  

I could reproduce the problem.

Finally, it is an error in `process-file', which wasn't detected until
now. Thanks to triggering this!

I've fixed it already in Emacs' trunk. For org-mode, I have used the
following workaround:

--8<---cut here---start->8---
~/src/org-mode> git diff
diff --git a/lisp/ob-eval.el b/lisp/ob-eval.el
index 23e7143..df95d0a 100644
--- a/lisp/ob-eval.el
+++ b/lisp/ob-eval.el
@@ -143,6 +143,11 @@ specifies the value of ERROR-BUFFER."
 shell-file-name
   "/bin/sh"))
exit-status)
+;; There is an error in `process-file', when `error-file' exists.
+;; Fixed already in Emacs trunk; for the time being we apply a
+;; workaround.
+(unless (file-remote-p default-directory)
+  (delete-file error-file))
 (if (or replace
(and output-buffer
 (not (or (bufferp output-buffer) (stringp output-buffer)
--8<---cut here---end--->8---

With that workaround, "make test" results in

--8<---cut here---start->8---
Ran 320 tests, 319 results as expected, 1 unexpected (2012-12-21 09:13:44+0100)
7 expected failures

1 unexpected results:
   FAILED  ob-exp/exports-inline
--8<---cut here---end--->8---

> Best,

Best regards, Michael.

Re: [O] remote execution in heterogeneous environment

[Michael Albinus]

Achim Gratz  writes:

>>> The following patch I've committed to Emacs' trunk, it fixes the problem
>>> as far as I could test. Maybe somebody from the org maintainers could
>>> merge it into the org repository.
>>
>> I've already merged it in maint and master.
>
> Unfortunately it breaks testing, at least in batch mode.  See my other
> posting about it.

Could you, please, give me a short pointer how to run the test suite? I
will check then what happened.

Note, that I don't use the org repository (yet). Maybe you must explain
from the beginning ...

Or you give me a short test program I could run for this dedicated test.

> Regards,
> Achim.

Best regards, Michael.

Re: [O] remote execution in heterogeneous environment

[Michael Albinus]

Michael Albinus  writes:

Hi,

> Looks, like nobody did take the ball :-(
>
> Maybe I'll check it again over XMas days, and maybe I can propose a
> concrete patch then.

The following patch I've committed to Emacs' trunk, it fixes the problem
as far as I could test. Maybe somebody from the org maintainers could
merge it into the org repository.

--8<---cut here---start->8---
~/src/emacs/lisp/org> bzr diff >123
=== modified file 'lisp/org/ChangeLog'
--- lisp/org/ChangeLog  2012-12-13 05:29:15 +
+++ lisp/org/ChangeLog  2012-12-20 13:09:40 +0000
@@ -1,3 +1,12 @@
+2012-12-20  Michael Albinus  
+
+   * ob.el (org-babel-temp-file): Fix setting of
+   `temporary-file-directory' on remote hosts.
+
+   * ob-eval.el (org-babel-shell-command-on-region): Use
+   `process-file' instead of `call-process-region'.  The latter one
+   does not work on remote hosts.
+
 2012-12-13  Bastien Guerry  

* org-latex.el (org-export-latex-links): Escape raw path when

=== modified file 'lisp/org/ob-eval.el'
--- lisp/org/ob-eval.el 2012-09-30 15:14:59 +
+++ lisp/org/ob-eval.el 2012-12-20 13:06:27 +
@@ -134,14 +134,13 @@
   current-prefix-arg
   shell-command-default-error-buffer
   t)))
-  (let ((error-file
-(if error-buffer
-(make-temp-file
- (expand-file-name "scor"
-(if (featurep 'xemacs)
-(temp-directory)
-  temporary-file-directory)))
-  nil))
+  (let ((input-file (org-babel-temp-file "input-"))
+   (error-file (if error-buffer (org-babel-temp-file "scor-") nil))
+   (shell-file-name
+(if (file-executable-p
+ (concat (file-remote-p default-directory) shell-file-name))
+shell-file-name
+  "/bin/sh"))
exit-status)
 (if (or replace
(and output-buffer
@@ -151,12 +150,14 @@
  ;; Don't muck with mark unless REPLACE says we should.
  (goto-char start)
  (and replace (push-mark (point) 'nomsg))
+ (write-region start end input-file)
+ (delete-region start end)
  (setq exit-status
-   (call-process-region start end shell-file-name t
-(if error-file
-(list output-buffer error-file)
-  t)
-nil shell-command-switch command))
+   (process-file shell-file-name input-file
+ (if error-file
+ (list output-buffer error-file)
+   t)
+ nil shell-command-switch command))
  ;; It is rude to delete a buffer which the command is not using.
  ;; (let ((shell-buffer (get-buffer "*Shell Command Output*")))
  ;;   (and shell-buffer (not (eq shell-buffer (current-buffer)))
@@ -175,14 +176,14 @@
(progn (setq buffer-read-only nil)
   (delete-region (max start end) (point-max))
   (delete-region (point-min) (min start end))
+  (write-region (point-min) (point-max) input-file)
+  (delete-region (point-min) (point-max))
   (setq exit-status
-(call-process-region (point-min) (point-max)
- shell-file-name t
- (if error-file
- (list t error-file)
-   t)
- nil shell-command-switch
- command)))
+(process-file shell-file-name input-file
+  (if error-file
+  (list t error-file)
+t)
+  nil shell-command-switch command)))
  ;; Clear the output buffer, then run the command with
  ;; output there.
  (let ((directory default-directory))
@@ -192,11 +193,11 @@
  (setq default-directory directory))
  (erase-buffer)))
  (setq exit-status
-   (call-process-region start end shell-file-name nil
-(if error-file
-(list buffer error-file)
-  buffer)
-   

Re: [O] remote execution in heterogeneous environment

[Michael Albinus]

[Cc emacs-orgmode@gnu.org]

George Jones  writes:

Hi George,

> Did you ever get resolution on these?  I think I'm hitting the same
> exact problems.

In my last message, I gave some hints what to do in org's code. Since I
don't use org myself (yet), I haven't followed that.

Looks, like nobody did take the ball :-(

Maybe I'll check it again over XMas days, and maybe I can propose a
concrete patch then.

> Thanks,
> ---George Jones

Best regards, Michael.

Re: [O] remote execution in heterogeneous environment

[Michael Albinus]

Neil Best  writes:

> I had just recently upgraded Emacs through Macports but had not since
> restarted it, that's all.  No such luck on the Tramp upgrade.  I will
> just wait for the next release to propagate through Macports unless
> some intolerable behavior crops up.  I do have a shiny new version of
> Org to play with thanks to ELPA.  :)

There are still several problems, even with Tramp 2.2.6. I use Org
20121126 from ELPA.

1. test
===

My local and remote hosts use "/tmp", both run Linux. So I have applied
prior to the test

--8<---cut here---start->8---
(setq temporary-file-directory "~/tmp/")
--8<---cut here---end--->8---

This directory is known to exist locally, but not remotely. When I eval
the source code block, I don't run into this infloop as you have seen
(this is fixed with Tramp 2.2.6, indeed). But there is another error

--8<---cut here---start->8---
Tramp: Decoding region into remote file 
/scpc:ford:/home/albinus/tmp/sh-205735cU...done
cond: Couldn't write region to `/scpc:ford:/home/albinus/tmp/sh-205735cU', 
decode using `base64 -d -i >%s' failed
--8<---cut here---end--->8---

Somewhere in the code, the remote temporary directory is created based
on `temporary-file-directory', which is wrong. I believe this is in
Org's code, must be debugged further.

2. test
===

I keep `temporary-file-directory' as "/tmp". The source code block
evaluates fine, but the result is:

--8<---cut here---start->8---
#+BEGIN_SRC sh :dir /ford:~
echo "Executed by `whoami` on `hostname` in `pwd`"
#+END_SRC

#+RESULTS:
: Executed by albinus on detlef in /home/albinus
--8<---cut here---end--->8---

Obviously, the code is executed on the local host. As far as I could
debug it, this is because `org-babel-shell-command-on-region' calls
`call-process-region', which is not aware of remote execution.

>> PS: it's on my wishlist for a long time to learn org-mode. Maybe I have
>> a chance now.
>
> You won't regret it.  Have fun.  What's your use case?

Accessing lists on different devices, under Linux, Android etc.

> How did you happen to get on this thread?  Was there a cross-post that
> I missed?

Nothing special. I have looked into the ML archive for some other
reason, and I have seen this thread by accident.

> Thanks for pitching in, everyone.

Best regards, Michael.

Re: [O] remote execution in heterogeneous environment

[Michael Albinus]

Neil Best  writes:

> tramp-version
> "2.2.3-24.1"
>
> emacs-version
> "24.2.1"
>
> Looks like I should upgrade tramp.  I will look into that.

Emacs 24.3 is in pretest, it contains Tramp 2.2.6. This might be another
option. See .

> I think if I restart emacs it will be upgraded to some minor, minor
> release, so maybe that took care of it already.  Fat chance?

Sorry, this I don't understand ...

>> Btw, I don't use org. For local tests, what shall I apply in order to
>> execute the code in #+BEGIN_SRC  ... #+END_SRC?
>
> I should mention that my source code block got mangled when I tried to
> post through Gmane.  It should look like this:
>
> #+BEGIN_SRC sh :dir /midway:~
> echo "Executed by `whoami` on `hostname` in `pwd`"
> #+END_SRC
>
> Just go into Org mode, move the point within the block, and hit C-c C-c.

Thanks, I will try to reproduce your problem locally.

Best regards, Michael.

PS: it's on my wishlist for a long time to learn org-mode. Maybe I have
a chance now.

Re: [O] remote execution in heterogeneous environment

[Michael Albinus]

Nick Dokos  writes:

> OK - thanks. Sorry for the noise.
>
> Trying-to-get-foot-out-of-mouth-ly yours,

Come on, there's nothing you have to sorry. You don't know Tramp, that's
all. And this is not exclusive by you :-)

> Nick

Best regards, Michael.

Re: [O] remote execution in heterogeneous environment

[Michael Albinus]

Nick Dokos  writes:

> See
>
>   http://thread.gmane.org/gmane.emacs.orgmode/62963

I've seen that.

> It was a weird setting of the variable ``temporary-file-directory'' in
> Neil's Macport setup, plus the assumption by tramp that that setting was
> valid for the remote - that turned out to be a bad assumption. Not sure
> it's worth it for tramp to provide a way to customize that, but that's
> your decision :-) AFAIAC, /tmp should be a universal standard.

I don't believe it is a weird setting of `temporary-file-directory'. It
is a valid value for OS X, AFAIK.

And "/tmp" isn't a universal standard. For example, it doesn't work,
when your local machine runs MS Windows.

The patch in Tramp I have mentioned tries to distinguish between local
and remote temporary directories. I would like to know, whether this
works correctly for org-mode, or whether there is still an issue.

> Nick

Best regards, Michael.

Re: [O] remote execution in heterogeneous environment

[Michael Albinus]

Neil Best  writes:

Hi,

> I run Macport's Emacs and ELPA's Org on my Mac but my data lives in a
> Red Hat environment.  I thought I could edit locally and compute
> remotely but there seems to be a problem with temp files for executing
> source blocks.
>
> #+BEGIN_SRC sh :dir /midway:~ echo "Executed by `whoami` on `hostname`
> in `pwd`" #+END_SRC
>
> Results are empty and in the message buffers appears this:
>
> executing Sh code block...  Tramp: Opening connection for midway using
> ssh...
>
> Opening connection for midway using ssh... \ Tramp: Opening connection
> for midway using ssh...done Tramp: Encoding region using function
> `base64-encode-region'...done Tramp: Decoding region into remote file
> /ssh:midway:/var/folders/2y/qrw3hhkx0dlb9sbl51mjy5wmgn/T/sh-510999vN...done
> byte-code: Couldn't write region to
> `/ssh:midway:/var/folders/2y/qrw3hhkx0dlb9sbl51mjy5wmgn/T/sh-510999vN',
> decode using `base64 -d -i >%s' failed

Which version of Tramp are you using? You find it by "C-h v tramp-version".
I remember a problem with remote temporary directories, fixed in Tramp 2.2.6.

Btw, I don't use org. For local tests, what shall I apply in order to
execute the code in #+BEGIN_SRC  ... #+END_SRC?

Best regards, Michael (Tramp maintainer).