Re: emacs lisp text processing example (html5 figure/figcaption)
On Mon, Jul 4, 2011 at 12:36 AM, Xah Lee xah...@gmail.com wrote: So, a solution by regex is out. Actually, none of the complications you listed appear to exclude regexes. Here's a possible (untested) solution: div class=img ((?:\s*img src=[^.]+\.(?:jpg|png|gif) alt=[^]+ width=[0-9]+ height=[0-9]+)+) \s*p class=cpt((?:[^]|(?!/p))+)/p \s*/div and corresponding replacement string: figure \1 figcaption\2/figcaption /figure I don't know what dialect Emacs uses for regexes; the above is the Python re dialect. I assume it is translatable. If not, then the above should at least work with other editors, such as Komodo's Find/Replace in Files command. I kept the line breaks here for readability, but for completeness they should be stripped out of the final regex. The possibility of nested HTML in the caption is allowed for by using a negative look-ahead assertion to accept any tag except a closing /p. It would break if you had nested p tags, but then that would be invalid html anyway. Cheers, Ian -- http://mail.python.org/mailman/listinfo/python-list
Re: emacs lisp text processing example (html5 figure/figcaption)
On Jul 4, 12:13 pm, S.Mandl stefanma...@web.de wrote: Nice. I guess that XSLT would be another (the official) approach for such a task. Is there an XSLT-engine for Emacs? -- Stefan haven't used XSLT, and don't know if there's one in emacs... it'd be nice if someone actually give a example... Xah -- http://mail.python.org/mailman/listinfo/python-list
Re: emacs lisp text processing example (html5 figure/figcaption)
On Jul 5, 12:17 pm, Ian Kelly ian.g.ke...@gmail.com wrote: On Mon, Jul 4, 2011 at 12:36 AM, Xah Lee xah...@gmail.com wrote: So, a solution by regex is out. Actually, none of the complications you listed appear to exclude regexes. Here's a possible (untested) solution: div class=img ((?:\s*img src=[^.]+\.(?:jpg|png|gif) alt=[^]+ width=[0-9]+ height=[0-9]+)+) \s*p class=cpt((?:[^]|(?!/p))+)/p \s*/div and corresponding replacement string: figure \1 figcaption\2/figcaption /figure I don't know what dialect Emacs uses for regexes; the above is the Python re dialect. I assume it is translatable. If not, then the above should at least work with other editors, such as Komodo's Find/Replace in Files command. I kept the line breaks here for readability, but for completeness they should be stripped out of the final regex. The possibility of nested HTML in the caption is allowed for by using a negative look-ahead assertion to accept any tag except a closing /p. It would break if you had nested p tags, but then that would be invalid html anyway. Cheers, Ian that's fantastic. Thanks! I'll try it out. Xah -- http://mail.python.org/mailman/listinfo/python-list
Re: emacs lisp text processing example (html5 figure/figcaption)
On Jul 5, 12:17 pm, Ian Kelly ian.g.ke...@gmail.com wrote: On Mon, Jul 4, 2011 at 12:36 AM, Xah Lee xah...@gmail.com wrote: So, a solution by regex is out. Actually, none of the complications you listed appear to exclude regexes. Here's a possible (untested) solution: div class=img ((?:\s*img src=[^.]+\.(?:jpg|png|gif) alt=[^]+ width=[0-9]+ height=[0-9]+)+) \s*p class=cpt((?:[^]|(?!/p))+)/p \s*/div and corresponding replacement string: figure \1 figcaption\2/figcaption /figure I don't know what dialect Emacs uses for regexes; the above is the Python re dialect. I assume it is translatable. If not, then the above should at least work with other editors, such as Komodo's Find/Replace in Files command. I kept the line breaks here for readability, but for completeness they should be stripped out of the final regex. The possibility of nested HTML in the caption is allowed for by using a negative look-ahead assertion to accept any tag except a closing /p. It would break if you had nested p tags, but then that would be invalid html anyway. Cheers, Ian emacs regex supports shygroup (the 「(?:…)」) but it doesn't support the negative assertion 「?!…」 though. but in anycase, i can't see how this part would work p class=cpt((?:[^]|(?!/p))+)/p ? Xah -- http://mail.python.org/mailman/listinfo/python-list
Re: emacs lisp text processing example (html5 figure/figcaption)
On Tue, Jul 5, 2011 at 2:37 PM, Xah Lee xah...@gmail.com wrote: but in anycase, i can't see how this part would work p class=cpt((?:[^]|(?!/p))+)/p It's not that different from the pattern 「alt=[^]+」 earlier in the regex. The capture group accepts one or more characters that either aren't '', or that are '' but are not immediately followed by '/p'. Thus it stops capturing when it sees exactly '/p' without consuming the ''. Using my regex with the example that you posted earlier demonstrates that it works: import re s = '''div class=img ... img src=jamie_cat.jpg alt=jamie's cat width=167 height=106 ... p class=cptjamie's cat! Her blog is a href=http://example.com/ ... jamie/http://example.com/jamie//a/p ... /div''' print re.sub(pattern, replace, s) figure img src=jamie_cat.jpg alt=jamie's cat width=167 height=106 figcaptionjamie's cat! Her blog is a href=http://example.com/ jamie/http://example.com/jamie//a/figcaption /figure Cheers, Ian -- http://mail.python.org/mailman/listinfo/python-list
Re: emacs lisp text processing example (html5 figure/figcaption)
haven't used XSLT, and don't know if there's one in emacs... it'd be nice if someone actually give a example... Hi Xah, actually I have to correct myself. HTML is not XML. If it were, you could use a stylesheet like this: ?xml version=1.0 encoding=ISO-8859-1? xsl:stylesheet version=1.0 xmlns:xsl=http://www.w3.org/1999/XSL/Transform; xsl:template match=p[@class='cpt'] figcaption xsl:value-of select=./ /figcaption /xsl:template xsl:template match=div[@class='img'] figure xsl:apply-templates select=@*|node()/ /figure /xsl:template xsl:template match=@*|node() xsl:copy xsl:apply-templates select=@*|node()/ /xsl:copy /xsl:template /xsl:stylesheet which applied to this document: ?xml version=1.0 encoding=ISO-8859-1? doc h1Just having fun/h1with all the div class=img img src=cat1.jpg alt=my cat width=200 height=200/ img src=cat2.jpg alt=my cat width=200 height=200/ p class=cptmy 2 cats/p /div cats here: h1Just fooling around/h1 div class=img img src=jamie_cat.jpg alt=jamie's cat width=167 height=106/ p class=cptjamie's cat! Her blog is a href=http://example.com/ jamie/http://example.com/jamie//a/p /div /doc would yield: ?xml version=1.0? doc h1Just having fun/h1with all the figure class=img img src=cat1.jpg alt=my cat width=200 height=200/ img src=cat2.jpg alt=my cat width=200 height=200/ figcaptionmy 2 cats/figcaption /figure cats here: h1Just fooling around/h1 figure class=img img src=jamie_cat.jpg alt=jamie's cat width=167 height=106/ figcaptionjamie's cat! Her blog is http://example.com/jamie//figcaption /figure /doc But well, as you don't have XML as input ... there really was no point to my remark. Best, Stefan -- http://mail.python.org/mailman/listinfo/python-list
emacs lisp text processing example (html5 figure/figcaption)
OMG, emacs lisp beats perl/python again! Hiya all, another little emacs lisp tutorial from the tiny Xah's Edu Corner. 〈Emacs Lisp: Processing HTML: Transform Tags to HTML5 “figure” and “figcaption” Tags〉 xahlee.org/emacs/elisp_batch_html5_tag_transform.html plain text version follows. -- Emacs Lisp: Processing HTML: Transform Tags to HTML5 “figure” and “figcaption” Tags Xah Lee, 2011-07-03 Another triumph of using elisp for text processing over perl/python. The Problem -- Summary I want batch transform the image tags in 5 thousand html files to use HTML5's new “figure” and “figcaption” tags. I want to be able to view each change interactively, while optionally give it a “go ahead” to do the whole job in batch. Interactive eye-ball verification on many cases lets me be reasonably sure the transform is done correctly. Yet i don't want to spend days to think/write/test a mathematically correct program that otherwise can be finished in 30 min with human interaction. -- Detail HTML5 has the following new tags: “figure” and “figcaption”. They are used like this: figure img src=cat.jpg alt=my cat width=167 height=106 figcaptionmy cat!/figcaption /figure (For detail, see: HTML5 “figure” ＆ “figurecaption” Tags Browser Support) On my website, i used a similar structure. They look like this: div class=img img src=cat.jpg alt=my cat width=167 height=106 p class=cptmy cat!/p /div So, i want to replace them with the HTML5's new tags. This can be done with a regex. Here's the “find” regex: div class=img ?img src=\([^.]+?\)\.jpg alt=\([^]+?\) width=\([0-9]+?\) height=\([0-9]+?\)? p class=cpt\([^]+?\)/p ?/div Here's the replacement string: figure img src=\1.jpg alt=\2 width=\3 height=\4 figcaption\5/figcaption /figure Then, you can use “find-file” and dired's “dired-do-query-replace- regexp” to work on your 5 thousand pages. Nice. (See: Emacs: Interactively Find ＆ Replace String Patterns on Multiple Files.) However, the problem here is more complicated. The image file may be jpg or png or gif. Also, there may be more than one image per group. Also, the caption part may also contain complicated html. Here's some examples: div class=img img src=cat1.jpg alt=my cat width=200 height=200 img src=cat2.jpg alt=my cat width=200 height=200 p class=cptmy 2 cats/p /div div class=img img src=jamie_cat.jpg alt=jamie's cat width=167 height=106 p class=cptjamie's cat! Her blog is a href=http://example.com/ jamie/http://example.com/jamie//a/p /div So, a solution by regex is out. Solution The solution is pretty simple. Here's the major steps: Use “find-lisp-find-files” to traverse a dir. For each file, open it. Search for the string div class=img Use “sgml-skip-tag-forward” to jump to its closing tag. Save the positions of these tag begin/end positions. Ask user if she wants to replace. If so, do it. (using “delete- region” and “insert”) Repeat. Here's the code: ;; -*- coding: utf-8 -*- ;; 2011-07-03 ;; replace image tags to use html5's “figure” and “figcaption” tags. ;; Example. This: ;; div class=img…/div ;; should become this ;; figure…/figure ;; do this for all files in a dir. ;; rough steps: ;; find the div class=img ;; use sgml-skip-tag-forward to move to the ending tag. ;; save their positions. (defun my-process-file (fpath) process the file at fullpath FPATH ... (let (mybuff p1 p2 p3 p4 ) (setq mybuff (find-file fpath)) (widen) (goto-char 0) ;; in case buffer already open (while (search-forward div class=\img\ nil t) (progn (setq p2 (point) ) (backward-char 17) ; beginning of “div” tag (setq p1 (point) ) (forward-char 1) (sgml-skip-tag-forward 1) ; move to the closing tag (setq p4 (point) ) (backward-char 6) ; beginning of the closing div tag (setq p3 (point) ) (narrow-to-region p1 p4) (when (y-or-n-p replace?) (progn (delete-region p3 p4 ) (goto-char p3) (insert /figure) (delete-region p1 p2 ) (goto-char p1) (insert figure) (widen) ) ) ) ) (when (not (buffer-modified-p mybuff)) (kill-buffer mybuff) ) ) ) (require 'find-lisp) (let (outputBuffer) (setq outputBuffer *xah img/figure replace output* ) (with-output-to-temp-buffer outputBuffer (mapc 'my-process-file (find-lisp-find-files ~/web/xahlee_org/ emacs/ \\.html$)) (princ Done deal!) ) ) Seems pretty simple right? The “p1” and “p2” variables are the positions of start/end of div class=img. The “p3” and “p4” is the start/end of it's closing tag / div. We also used a little trick with “widen” and “narrow-to-region”. It lets me see just the part that i'm interested. It narrows to the beginning/end of the div.img. This makes eye-balling a bit easier. The real
Re: emacs lisp text processing example (html5 figure/figcaption)
Nice. I guess that XSLT would be another (the official) approach for such a task. Is there an XSLT-engine for Emacs? -- Stefan -- http://mail.python.org/mailman/listinfo/python-list
