php-general Digest 4 May 2013 20:52:44 -0000 Issue 8217
Topics (messages 321002 through 321007):
Re: Need a tool to minimize HTML before storing in memecache
321002 by: Daevid Vincent
321003 by: Marco Behnke
321004 by: Daevid Vincent
321005 by: Marco Behnke
321006 by: Sebastian Krebs
generate onfly PDF
321007 by: Rafnews
Administrivia:
To subscribe to the digest, e-mail:
php-general-digest-subscr...@lists.php.net
To unsubscribe from the digest, e-mail:
php-general-digest-unsubscr...@lists.php.net
To post to the list, e-mail:
php-gene...@lists.php.net
----------------------------------------------------------------------
--- Begin Message ---
Well we get about 30,000 page hits PER SECOND.
So we have a template engine that generates a page using PHP/MySQL and
populates it as everyone else does with the generic content.
Then we store THAT rendered page in a cache (memcache pool as well as a local
copy on each server).
HOWEVER, there are of course dynamic parts of the page that can't be cached or
we'd be making a cached page for every unique user. So things like their <?=
$username ?>, or maybe parts of the page change based up their membership <?php
if ($loggedin == true) { ?>, or maybe parts of the page rotate different
content (modules if you like).
Therefore we are trying to mininimize/compress the cached pages that need to be
served by removing all <!-- --> and /* */ and // and whitespace and other
stuff. When you have this much data to serve that fast, those few characters
here and there add up quickly in bandwidth and space. As well as render time
for both apache and the client's browser's parser.
Dig?
> -----Original Message-----
> From: ma...@behnke.biz [mailto:ma...@behnke.biz]
> Sent: Friday, May 03, 2013 4:28 AM
> To: Daevid Vincent; 'php-general General'
> Subject: RE: [PHP] Need a tool to minimize HTML before storing in memecache
>
> But why are you caching uncompiled php code?
>
> > Daevid Vincent <dae...@daevid.com> hat am 2. Mai 2013 um 23:21
> geschrieben:
> >
> >
> > While that may be true for most users, I see no reason that it should
> limit or
> > force me to a certain use case given that dynamic pages make up the vast
> > majority of web pages served.
> >
> > Secondly, there are 8 billion options in Tidy to configure it, I would be
> > astonished if they were so short-sighted to not have one to disable
> converting
> > < and > to < and > as they do for all sorts of other things like
> quotes,
> > ampersands, etc. I just don't know which flag this falls under or what
> > combination of flags I'm setting that is causing this to happen.
> >
> > Barring that little snag, it works like a champ.
> >
> > > -----Original Message-----
> > > From: ma...@behnke.biz [mailto:ma...@behnke.biz]
> > > Sent: Thursday, May 02, 2013 4:55 AM
> > > To: Daevid Vincent; 'php-general General'
> > > Subject: RE: [PHP] Need a tool to minimize HTML before storing in
> memecache
> > >
> > > This is because tidy is for optimizing HTML, not for optimizing PHP.
> > >
> > > > Daevid Vincent <dae...@daevid.com> hat am 2. Mai 2013 um 02:20
> > > geschrieben:
> > > >
> > > >
> > > > So I took the time to install Tidy extension and wedge it into my
> code.
> > > Now
> > > > there is one thing that is killing me and breaking all my pages.
> > > >
> > > > This is what I WANT the result to be:
> > > >
> > > > <link rel="stylesheet" type="text/css"
> > > href="/templates/<?=
> > > > $layout_id ?>/css/styles.css" />
> > > > <link rel="stylesheet" type="text/css"
> > > href="/templates/<?=
> > > > $layout_id ?>/css/retina.css" media="only screen and
> > > > (-webkit-min-device-pixel-ratio: 2)" />
> > > >
> > > > Which then 'renders' out to this normally without Tidy:
> > > >
> > > > <link rel="stylesheet" type="text/css"
> > > > href="/templates/2/css/styles.css" />
> > > > <link rel="stylesheet" type="text/css"
> > > > href="/templates/2/css/retina.css" media="only screen and
> > > > (-webkit-min-device-pixel-ratio: 2)" />
> > > >
> > > > This is what Tidy does:
> > > >
> > > > <link rel="stylesheet" type="text/css"
> > > > href="/templates/%3C?=%20$layout_id%20?%3E/css/styles.css">
> > > > <link rel="stylesheet" type="text/css"
> > > > href="/templates/%3C?=%20$layout_id%20?%3E/css/retina.css" media="only
> > > > screen and (-webkit-min-device-pixel-ratio: 2)">
> > > >
> > > > I found ['fix-uri' => false] which gets closer:
> > > >
> > > > <link rel="stylesheet" type="text/css"
> > > > href="/templates/<?= $layout_id ?>/css/styles.css">
> > > > <link rel="stylesheet" type="text/css"
> > > > href="/templates/<?= $layout_id ?>/css/retina.css" media="only
> > > screen
> > > > and (-webkit-min-device-pixel-ratio: 2)">
> > > >
> > > > I've tried about every option I can think of. What is the solution to
> make
> > > > it stop trying to be smarter than me and converting my < and > tags??
> > > >
> > > > //See all parameters available here:
> > > > http://tidy.sourceforge.net/docs/quickref.html
> > > > $tconfig = array(
> > > > //'clean' => true,
> > > > 'hide-comments' => true,
> > > > 'hide-endtags' => true,
> > > > 'drop-proprietary-attributes' => true,
> > > > //'join-classes' => true,
> > > > //'join-styles' => true,
> > > > //'quote-marks' => true,
> > > > 'fix-uri' => false,
> > > > 'numeric-entities' => true,
> > > > 'preserve-entities' => true,
> > > > 'doctype' => 'omit',
> > > > 'tab-size' => 1,
> > > > 'wrap' => 0,
> > > > 'wrap-php' => false,
> > > > 'char-encoding' => 'raw',
> > > > 'input-encoding' => 'raw',
> > > > 'output-encoding' => 'raw',
> > > > 'newline' => 'LF',
> > > > 'tidy-mark' => false,
> > > > 'quiet' => true,
> > > > 'show-errors' => ($this->_debug ? 6 : 0),
> > > > 'show-warnings' => $this->_debug,
> > > > );
> > > >
> > > >
> > > > From: Joseph Moniz [mailto:joseph.mo...@gmail.com]
> > > > Sent: Wednesday, April 17, 2013 2:55 PM
> > > > To: Daevid Vincent
> > > > Cc: php-general General
> > > > Subject: Re: [PHP] Need a tool to minimize HTML before storing in
> > > memecache
> > > >
> > > > http://php.net/manual/en/book.tidy.php
> > > >
> > > >
> > > > - Joseph Moniz
> > > > (510) 509-0775 | @josephmoniz <https://twitter.com/josephmoniz> |
> > > > <https://github.com/JosephMoniz> GitHub |
> > > > <http://www.linkedin.com/pub/joseph-moniz/13/949/b54/> LinkedIn | Blog
> > > > <http://josephmoniz.github.io/> | CoderWall
> > > > <https://coderwall.com/josephmoniz>
> > > >
> > > > "Wake up early, Stay up late, Change the world"
> > > >
> > > > On Wed, Apr 17, 2013 at 2:52 PM, Daevid Vincent <dae...@daevid.com>
> wrote:
> > > > We do a lot with caching and storing in memecached as well as local
> copies
> > > > so as to not hit the cache pool over the network and we have found
> some
> > > > great tools to minimize our javascript and our css, and now we'd like
> to
> > > > compress our HTML in these cache slabs.
> > > >
> > > >
> > > >
> > > > Anyone know of a good tool or even regex magic that I can call from
> PHP to
> > > > compress/minimize the giant string web page before I store it in the
> > > cache?
> > > >
> > > >
> > > >
> > > > It's not quite as simple as stripping white space b/c obviously there
> are
> > > > spaces between attributes in tags that need to be preserved, but also
> in
> > > the
> > > > words/text on the page. I could strip out newlines I suppose, but then
> do
> > > I
> > > > run into any issues in other ways? In any event, it seems like someone
> > > would
> > > > have solved this by now before I go re-inventing the wheel.
> > > >
> > > >
> > > >
> > > > d.
> > > >
> > >
> > > --
> > > Marco Behnke
> > > Dipl. Informatiker (FH), SAE Audio Engineer Diploma
> > > Zend Certified Engineer PHP 5.3
> > >
> > > Tel.: 0174 / 9722336
> > > e-Mail: ma...@behnke.biz
> > >
> > > Softwaretechnik Behnke
> > > Heinrich-Heine-Str. 7D
> > > 21218 Seevetal
> > >
> > > http://www.behnke.biz
> >
>
> --
> Marco Behnke
> Dipl. Informatiker (FH), SAE Audio Engineer Diploma
> Zend Certified Engineer PHP 5.3
>
> Tel.: 0174 / 9722336
> e-Mail: ma...@behnke.biz
>
> Softwaretechnik Behnke
> Heinrich-Heine-Str. 7D
> 21218 Seevetal
>
> http://www.behnke.biz
--- End Message ---
--- Begin Message ---
If you really have that much traffic, then memcache isn't your answer to
caching. It is as slow as a fast database.
You should use APC caching instead. APC will also handle a lot of
bytecode caching.
If you want to go with tidy and surf around the php issues you could
optimize the single html parts, before glueing everything together.
Maybe google page speed is worth a look for you too?
With the loggedin flag, you can save two versions of your rendered, one
for loggedin users and for not logged in users. That saves you php code
in your template and you can use tidy. And for any other variables you
can load the dynamic data after the page load.
With tidy, have you tried
http://tidy.sourceforge.net/docs/quickref.html#preserve-entities
http://tidy.sourceforge.net/docs/quickref.html#fix-uri
Regards,
Marco
Am 03.05.13 19:40, schrieb Daevid Vincent:
> Well we get about 30,000 page hits PER SECOND.
>
> So we have a template engine that generates a page using PHP/MySQL and
> populates it as everyone else does with the generic content.
> Then we store THAT rendered page in a cache (memcache pool as well as a local
> copy on each server).
> HOWEVER, there are of course dynamic parts of the page that can't be cached
> or we'd be making a cached page for every unique user. So things like their
> <?= $username ?>, or maybe parts of the page change based up their membership
> <?php if ($loggedin == true) { ?>, or maybe parts of the page rotate
> different content (modules if you like).
>
> Therefore we are trying to mininimize/compress the cached pages that need to
> be served by removing all <!-- --> and /* */ and // and whitespace and other
> stuff. When you have this much data to serve that fast, those few characters
> here and there add up quickly in bandwidth and space. As well as render time
> for both apache and the client's browser's parser.
>
> Dig?
>
>> -----Original Message-----
>> From: ma...@behnke.biz [mailto:ma...@behnke.biz]
>> Sent: Friday, May 03, 2013 4:28 AM
>> To: Daevid Vincent; 'php-general General'
>> Subject: RE: [PHP] Need a tool to minimize HTML before storing in memecache
>>
>> But why are you caching uncompiled php code?
>>
>>> Daevid Vincent <dae...@daevid.com> hat am 2. Mai 2013 um 23:21
>> geschrieben:
>>>
>>> While that may be true for most users, I see no reason that it should
>> limit or
>>> force me to a certain use case given that dynamic pages make up the vast
>>> majority of web pages served.
>>>
>>> Secondly, there are 8 billion options in Tidy to configure it, I would be
>>> astonished if they were so short-sighted to not have one to disable
>> converting
>>> < and > to < and > as they do for all sorts of other things like
>> quotes,
>>> ampersands, etc. I just don't know which flag this falls under or what
>>> combination of flags I'm setting that is causing this to happen.
>>>
>>> Barring that little snag, it works like a champ.
>>>
>>>> -----Original Message-----
>>>> From: ma...@behnke.biz [mailto:ma...@behnke.biz]
>>>> Sent: Thursday, May 02, 2013 4:55 AM
>>>> To: Daevid Vincent; 'php-general General'
>>>> Subject: RE: [PHP] Need a tool to minimize HTML before storing in
>> memecache
>>>> This is because tidy is for optimizing HTML, not for optimizing PHP.
>>>>
>>>>> Daevid Vincent <dae...@daevid.com> hat am 2. Mai 2013 um 02:20
>>>> geschrieben:
>>>>>
>>>>> So I took the time to install Tidy extension and wedge it into my
>> code.
>>>> Now
>>>>> there is one thing that is killing me and breaking all my pages.
>>>>>
>>>>> This is what I WANT the result to be:
>>>>>
>>>>> <link rel="stylesheet" type="text/css"
>>>> href="/templates/<?=
>>>>> $layout_id ?>/css/styles.css" />
>>>>> <link rel="stylesheet" type="text/css"
>>>> href="/templates/<?=
>>>>> $layout_id ?>/css/retina.css" media="only screen and
>>>>> (-webkit-min-device-pixel-ratio: 2)" />
>>>>>
>>>>> Which then 'renders' out to this normally without Tidy:
>>>>>
>>>>> <link rel="stylesheet" type="text/css"
>>>>> href="/templates/2/css/styles.css" />
>>>>> <link rel="stylesheet" type="text/css"
>>>>> href="/templates/2/css/retina.css" media="only screen and
>>>>> (-webkit-min-device-pixel-ratio: 2)" />
>>>>>
>>>>> This is what Tidy does:
>>>>>
>>>>> <link rel="stylesheet" type="text/css"
>>>>> href="/templates/%3C?=%20$layout_id%20?%3E/css/styles.css">
>>>>> <link rel="stylesheet" type="text/css"
>>>>> href="/templates/%3C?=%20$layout_id%20?%3E/css/retina.css" media="only
>>>>> screen and (-webkit-min-device-pixel-ratio: 2)">
>>>>>
>>>>> I found ['fix-uri' => false] which gets closer:
>>>>>
>>>>> <link rel="stylesheet" type="text/css"
>>>>> href="/templates/<?= $layout_id ?>/css/styles.css">
>>>>> <link rel="stylesheet" type="text/css"
>>>>> href="/templates/<?= $layout_id ?>/css/retina.css" media="only
>>>> screen
>>>>> and (-webkit-min-device-pixel-ratio: 2)">
>>>>>
>>>>> I've tried about every option I can think of. What is the solution to
>> make
>>>>> it stop trying to be smarter than me and converting my < and > tags??
>>>>>
>>>>> //See all parameters available here:
>>>>> http://tidy.sourceforge.net/docs/quickref.html
>>>>> $tconfig = array(
>>>>> //'clean' => true,
>>>>> 'hide-comments' => true,
>>>>> 'hide-endtags' => true,
>>>>> 'drop-proprietary-attributes' => true,
>>>>> //'join-classes' => true,
>>>>> //'join-styles' => true,
>>>>> //'quote-marks' => true,
>>>>> 'fix-uri' => false,
>>>>> 'numeric-entities' => true,
>>>>> 'preserve-entities' => true,
>>>>> 'doctype' => 'omit',
>>>>> 'tab-size' => 1,
>>>>> 'wrap' => 0,
>>>>> 'wrap-php' => false,
>>>>> 'char-encoding' => 'raw',
>>>>> 'input-encoding' => 'raw',
>>>>> 'output-encoding' => 'raw',
>>>>> 'newline' => 'LF',
>>>>> 'tidy-mark' => false,
>>>>> 'quiet' => true,
>>>>> 'show-errors' => ($this->_debug ? 6 : 0),
>>>>> 'show-warnings' => $this->_debug,
>>>>> );
>>>>>
>>>>>
>>>>> From: Joseph Moniz [mailto:joseph.mo...@gmail.com]
>>>>> Sent: Wednesday, April 17, 2013 2:55 PM
>>>>> To: Daevid Vincent
>>>>> Cc: php-general General
>>>>> Subject: Re: [PHP] Need a tool to minimize HTML before storing in
>>>> memecache
>>>>> http://php.net/manual/en/book.tidy.php
>>>>>
>>>>>
>>>>> - Joseph Moniz
>>>>> (510) 509-0775 | @josephmoniz <https://twitter.com/josephmoniz> |
>>>>> <https://github.com/JosephMoniz> GitHub |
>>>>> <http://www.linkedin.com/pub/joseph-moniz/13/949/b54/> LinkedIn | Blog
>>>>> <http://josephmoniz.github.io/> | CoderWall
>>>>> <https://coderwall.com/josephmoniz>
>>>>>
>>>>> "Wake up early, Stay up late, Change the world"
>>>>>
>>>>> On Wed, Apr 17, 2013 at 2:52 PM, Daevid Vincent <dae...@daevid.com>
>> wrote:
>>>>> We do a lot with caching and storing in memecached as well as local
>> copies
>>>>> so as to not hit the cache pool over the network and we have found
>> some
>>>>> great tools to minimize our javascript and our css, and now we'd like
>> to
>>>>> compress our HTML in these cache slabs.
>>>>>
>>>>>
>>>>>
>>>>> Anyone know of a good tool or even regex magic that I can call from
>> PHP to
>>>>> compress/minimize the giant string web page before I store it in the
>>>> cache?
>>>>>
>>>>>
>>>>> It's not quite as simple as stripping white space b/c obviously there
>> are
>>>>> spaces between attributes in tags that need to be preserved, but also
>> in
>>>> the
>>>>> words/text on the page. I could strip out newlines I suppose, but then
>> do
>>>> I
>>>>> run into any issues in other ways? In any event, it seems like someone
>>>> would
>>>>> have solved this by now before I go re-inventing the wheel.
>>>>>
>>>>>
>>>>>
>>>>> d.
>>>>>
>>>> --
>>>> Marco Behnke
>>>> Dipl. Informatiker (FH), SAE Audio Engineer Diploma
>>>> Zend Certified Engineer PHP 5.3
>>>>
>>>> Tel.: 0174 / 9722336
>>>> e-Mail: ma...@behnke.biz
>>>>
>>>> Softwaretechnik Behnke
>>>> Heinrich-Heine-Str. 7D
>>>> 21218 Seevetal
>>>>
>>>> http://www.behnke.biz
>> --
>> Marco Behnke
>> Dipl. Informatiker (FH), SAE Audio Engineer Diploma
>> Zend Certified Engineer PHP 5.3
>>
>> Tel.: 0174 / 9722336
>> e-Mail: ma...@behnke.biz
>>
>> Softwaretechnik Behnke
>> Heinrich-Heine-Str. 7D
>> 21218 Seevetal
>>
>> http://www.behnke.biz
>
--
Marco Behnke
Dipl. Informatiker (FH), SAE Audio Engineer Diploma
Zend Certified Engineer PHP 5.3
Tel.: 0174 / 9722336
e-Mail: ma...@behnke.biz
Softwaretechnik Behnke
Heinrich-Heine-Str. 7D
21218 Seevetal
http://www.behnke.biz
signature.asc
Description: OpenPGP digital signature
--- End Message ---
--- Begin Message ---
> -----Original Message-----
> From: Marco Behnke [mailto:ma...@behnke.biz]
> Sent: Friday, May 03, 2013 12:01 PM
> To: Daevid Vincent; php >> "php-gene...@lists.php.net"
> Subject: Re: [PHP] Need a tool to minimize HTML before storing in memecache
>
> If you really have that much traffic, then memcache isn't your answer to
> caching. It is as slow as a fast database.
That's not entirely true.
> You should use APC caching instead. APC will also handle a lot of
> bytecode caching.
We have both.
> If you want to go with tidy and surf around the php issues you could
> optimize the single html parts, before glueing everything together.
That would require much more work than simply getting < and > to work. And
honestly I've been hacking around Tidy so much at this point with regex to
minify the output, that I'm even wondering if Tidy is worth the both anymore.
Not sure what else it will give me.
> Maybe google page speed is worth a look for you too?
We have over 1,000 servers in house and also distributed across nodes in
various cities and countries.
> With the loggedin flag, you can save two versions of your rendered, one
> for loggedin users and for not logged in users. That saves you php code
> in your template and you can use tidy. And for any other variables you
> can load the dynamic data after the page load.
I gave simplistic examples for the sake of illustration.
> With tidy, have you tried
> http://tidy.sourceforge.net/docs/quickref.html#preserve-entities
> http://tidy.sourceforge.net/docs/quickref.html#fix-uri
Yes. See below. I posted all the flags I have tried and I too thought those
were the key, but sadly not.
> Regards,
> Marco
>
> Am 03.05.13 19:40, schrieb Daevid Vincent:
> > Well we get about 30,000 page hits PER SECOND.
> >
> > So we have a template engine that generates a page using PHP/MySQL and
> populates it as everyone else does with the generic content.
> > Then we store THAT rendered page in a cache (memcache pool as well as a
> local copy on each server).
> > HOWEVER, there are of course dynamic parts of the page that can't be
> cached or we'd be making a cached page for every unique user. So things like
> their <?= $username ?>, or maybe parts of the page change based up their
> membership <?php if ($loggedin == true) { ?>, or maybe parts of the page
> rotate different content (modules if you like).
> >
> > Therefore we are trying to mininimize/compress the cached pages that need
> to be served by removing all <!-- --> and /* */ and // and whitespace and
> other stuff. When you have this much data to serve that fast, those few
> characters here and there add up quickly in bandwidth and space. As well as
> render time for both apache and the client's browser's parser.
> >
> > Dig?
> >
> >> -----Original Message-----
> >> From: ma...@behnke.biz [mailto:ma...@behnke.biz]
> >> Sent: Friday, May 03, 2013 4:28 AM
> >> To: Daevid Vincent; 'php-general General'
> >> Subject: RE: [PHP] Need a tool to minimize HTML before storing in
> memecache
> >>
> >> But why are you caching uncompiled php code?
> >>
> >>> Daevid Vincent <dae...@daevid.com> hat am 2. Mai 2013 um 23:21
> >> geschrieben:
> >>>
> >>> While that may be true for most users, I see no reason that it should
> >> limit or
> >>> force me to a certain use case given that dynamic pages make up the vast
> >>> majority of web pages served.
> >>>
> >>> Secondly, there are 8 billion options in Tidy to configure it, I would
> be
> >>> astonished if they were so short-sighted to not have one to disable
> >> converting
> >>> < and > to < and > as they do for all sorts of other things like
> >> quotes,
> >>> ampersands, etc. I just don't know which flag this falls under or what
> >>> combination of flags I'm setting that is causing this to happen.
> >>>
> >>> Barring that little snag, it works like a champ.
> >>>
> >>>> -----Original Message-----
> >>>> From: ma...@behnke.biz [mailto:ma...@behnke.biz]
> >>>> Sent: Thursday, May 02, 2013 4:55 AM
> >>>> To: Daevid Vincent; 'php-general General'
> >>>> Subject: RE: [PHP] Need a tool to minimize HTML before storing in
> >> memecache
> >>>> This is because tidy is for optimizing HTML, not for optimizing PHP.
> >>>>
> >>>>> Daevid Vincent <dae...@daevid.com> hat am 2. Mai 2013 um 02:20
> >>>> geschrieben:
> >>>>>
> >>>>> So I took the time to install Tidy extension and wedge it into my
> >> code.
> >>>> Now
> >>>>> there is one thing that is killing me and breaking all my pages.
> >>>>>
> >>>>> This is what I WANT the result to be:
> >>>>>
> >>>>> <link rel="stylesheet" type="text/css"
> >>>> href="/templates/<?=
> >>>>> $layout_id ?>/css/styles.css" />
> >>>>> <link rel="stylesheet" type="text/css"
> >>>> href="/templates/<?=
> >>>>> $layout_id ?>/css/retina.css" media="only screen and
> >>>>> (-webkit-min-device-pixel-ratio: 2)" />
> >>>>>
> >>>>> Which then 'renders' out to this normally without Tidy:
> >>>>>
> >>>>> <link rel="stylesheet" type="text/css"
> >>>>> href="/templates/2/css/styles.css" />
> >>>>> <link rel="stylesheet" type="text/css"
> >>>>> href="/templates/2/css/retina.css" media="only screen and
> >>>>> (-webkit-min-device-pixel-ratio: 2)" />
> >>>>>
> >>>>> This is what Tidy does:
> >>>>>
> >>>>> <link rel="stylesheet" type="text/css"
> >>>>> href="/templates/%3C?=%20$layout_id%20?%3E/css/styles.css">
> >>>>> <link rel="stylesheet" type="text/css"
> >>>>> href="/templates/%3C?=%20$layout_id%20?%3E/css/retina.css" media="only
> >>>>> screen and (-webkit-min-device-pixel-ratio: 2)">
> >>>>>
> >>>>> I found ['fix-uri' => false] which gets closer:
> >>>>>
> >>>>> <link rel="stylesheet" type="text/css"
> >>>>> href="/templates/<?= $layout_id ?>/css/styles.css">
> >>>>> <link rel="stylesheet" type="text/css"
> >>>>> href="/templates/<?= $layout_id ?>/css/retina.css" media="only
> >>>> screen
> >>>>> and (-webkit-min-device-pixel-ratio: 2)">
> >>>>>
> >>>>> I've tried about every option I can think of. What is the solution to
> >> make
> >>>>> it stop trying to be smarter than me and converting my < and > tags??
> >>>>>
> >>>>> //See all parameters available here:
> >>>>> http://tidy.sourceforge.net/docs/quickref.html
> >>>>> $tconfig = array(
> >>>>> //'clean' => true,
> >>>>> 'hide-comments' => true,
> >>>>> 'hide-endtags' => true,
> >>>>> 'drop-proprietary-attributes' => true,
> >>>>> //'join-classes' => true,
> >>>>> //'join-styles' => true,
> >>>>> //'quote-marks' => true,
> >>>>> 'fix-uri' => false,
> >>>>> 'numeric-entities' => true,
> >>>>> 'preserve-entities' => true,
> >>>>> 'doctype' => 'omit',
> >>>>> 'tab-size' => 1,
> >>>>> 'wrap' => 0,
> >>>>> 'wrap-php' => false,
> >>>>> 'char-encoding' => 'raw',
> >>>>> 'input-encoding' => 'raw',
> >>>>> 'output-encoding' => 'raw',
> >>>>> 'newline' => 'LF',
> >>>>> 'tidy-mark' => false,
> >>>>> 'quiet' => true,
> >>>>> 'show-errors' => ($this->_debug ? 6 : 0),
> >>>>> 'show-warnings' => $this->_debug,
> >>>>> );
> >>>>>
> >>>>>
> >>>>> From: Joseph Moniz [mailto:joseph.mo...@gmail.com]
> >>>>> Sent: Wednesday, April 17, 2013 2:55 PM
> >>>>> To: Daevid Vincent
> >>>>> Cc: php-general General
> >>>>> Subject: Re: [PHP] Need a tool to minimize HTML before storing in
> >>>> memecache
> >>>>> http://php.net/manual/en/book.tidy.php
> >>>>>
> >>>>>
> >>>>> - Joseph Moniz
> >>>>> (510) 509-0775 | @josephmoniz <https://twitter.com/josephmoniz> |
> >>>>> <https://github.com/JosephMoniz> GitHub |
> >>>>> <http://www.linkedin.com/pub/joseph-moniz/13/949/b54/> LinkedIn | Blog
> >>>>> <http://josephmoniz.github.io/> | CoderWall
> >>>>> <https://coderwall.com/josephmoniz>
> >>>>>
> >>>>> "Wake up early, Stay up late, Change the world"
> >>>>>
> >>>>> On Wed, Apr 17, 2013 at 2:52 PM, Daevid Vincent <dae...@daevid.com>
> >> wrote:
> >>>>> We do a lot with caching and storing in memecached as well as local
> >> copies
> >>>>> so as to not hit the cache pool over the network and we have found
> >> some
> >>>>> great tools to minimize our javascript and our css, and now we'd like
> >> to
> >>>>> compress our HTML in these cache slabs.
> >>>>>
> >>>>>
> >>>>>
> >>>>> Anyone know of a good tool or even regex magic that I can call from
> >> PHP to
> >>>>> compress/minimize the giant string web page before I store it in the
> >>>> cache?
> >>>>>
> >>>>>
> >>>>> It's not quite as simple as stripping white space b/c obviously there
> >> are
> >>>>> spaces between attributes in tags that need to be preserved, but also
> >> in
> >>>> the
> >>>>> words/text on the page. I could strip out newlines I suppose, but then
> >> do
> >>>> I
> >>>>> run into any issues in other ways? In any event, it seems like someone
> >>>> would
> >>>>> have solved this by now before I go re-inventing the wheel.
> >>>>>
> >>>>>
> >>>>>
> >>>>> d.
> >>>>>
> >>>> --
> >>>> Marco Behnke
> >>>> Dipl. Informatiker (FH), SAE Audio Engineer Diploma
> >>>> Zend Certified Engineer PHP 5.3
> >>>>
> >>>> Tel.: 0174 / 9722336
> >>>> e-Mail: ma...@behnke.biz
> >>>>
> >>>> Softwaretechnik Behnke
> >>>> Heinrich-Heine-Str. 7D
> >>>> 21218 Seevetal
> >>>>
> >>>> http://www.behnke.biz
> >> --
> >> Marco Behnke
> >> Dipl. Informatiker (FH), SAE Audio Engineer Diploma
> >> Zend Certified Engineer PHP 5.3
> >>
> >> Tel.: 0174 / 9722336
> >> e-Mail: ma...@behnke.biz
> >>
> >> Softwaretechnik Behnke
> >> Heinrich-Heine-Str. 7D
> >> 21218 Seevetal
> >>
> >> http://www.behnke.biz
> >
>
>
> --
> Marco Behnke
> Dipl. Informatiker (FH), SAE Audio Engineer Diploma
> Zend Certified Engineer PHP 5.3
>
> Tel.: 0174 / 9722336
> e-Mail: ma...@behnke.biz
>
> Softwaretechnik Behnke
> Heinrich-Heine-Str. 7D
> 21218 Seevetal
>
> http://www.behnke.biz
>
--- End Message ---
--- Begin Message ---
Am 03.05.2013 21:34, schrieb Daevid Vincent:
-----Original Message-----
From: Marco Behnke [mailto:ma...@behnke.biz]
Sent: Friday, May 03, 2013 12:01 PM
To: Daevid Vincent; php >> "php-gene...@lists.php.net"
Subject: Re: [PHP] Need a tool to minimize HTML before storing in memecache
If you really have that much traffic, then memcache isn't your answer to
caching. It is as slow as a fast database.
That's not entirely true.
There are many comparisions all around the web and we did a benchmark
for ourselves when we evaluated what the fastest solution is. Memcache
is slower than APC. It gets worse when you start communicating over the
network with memcache.
If you want to go with tidy and surf around the php issues you could
optimize the single html parts, before glueing everything together.
That would require much more work than simply getting < and > to work. And
honestly I've been hacking around Tidy so much at this point with regex to minify the
output, that I'm even wondering if Tidy is worth the both anymore. Not sure what else
it will give me.
Maybe it is the best solution to think about optimizations you want and
code them by hand like stripping comments, too much whitespace, empty
tags, linebreaks and whatever. I guess it will save a lot of time.
Or you download the tidy sourcecode and put in your wanted changes?
Maybe suggest a change request or submit a patch?
Maybe google page speed is worth a look for you too?
We have over 1,000 servers in house and also distributed across nodes in
various cities and countries.
Don't know if this is an answer to my question? You know what google
page speed is about?
smime.p7s
Description: S/MIME Kryptografische Unterschrift
--- End Message ---
--- Begin Message ---
2013/5/3 Daevid Vincent <dae...@daevid.com>
>
> > -----Original Message-----
> > From: Marco Behnke [mailto:ma...@behnke.biz]
> > Sent: Friday, May 03, 2013 12:01 PM
> > To: Daevid Vincent; php >> "php-gene...@lists.php.net"
> > Subject: Re: [PHP] Need a tool to minimize HTML before storing in
> memecache
> >
> > If you really have that much traffic, then memcache isn't your answer to
> > caching. It is as slow as a fast database.
>
> That's not entirely true.
>
> > You should use APC caching instead. APC will also handle a lot of
> > bytecode caching.
>
> We have both.
>
> > If you want to go with tidy and surf around the php issues you could
> > optimize the single html parts, before glueing everything together.
>
> That would require much more work than simply getting < and > to work. And
> honestly I've been hacking around Tidy so much at this point with regex to
> minify the output, that I'm even wondering if Tidy is worth the both
> anymore. Not sure what else it will give me.
>
> > Maybe google page speed is worth a look for you too?
>
> We have over 1,000 servers in house and also distributed across nodes in
> various cities and countries.
>
Really? Ever considered HTTP-Caching, or even Load-Balancing including ESI?
>
> > With the loggedin flag, you can save two versions of your rendered, one
> > for loggedin users and for not logged in users. That saves you php code
> > in your template and you can use tidy. And for any other variables you
> > can load the dynamic data after the page load.
>
> I gave simplistic examples for the sake of illustration.
>
> > With tidy, have you tried
> > http://tidy.sourceforge.net/docs/quickref.html#preserve-entities
> > http://tidy.sourceforge.net/docs/quickref.html#fix-uri
>
> Yes. See below. I posted all the flags I have tried and I too thought
> those were the key, but sadly not.
>
> > Regards,
> > Marco
> >
> > Am 03.05.13 19:40, schrieb Daevid Vincent:
> > > Well we get about 30,000 page hits PER SECOND.
> > >
> > > So we have a template engine that generates a page using PHP/MySQL and
> > populates it as everyone else does with the generic content.
> > > Then we store THAT rendered page in a cache (memcache pool as well as a
> > local copy on each server).
> > > HOWEVER, there are of course dynamic parts of the page that can't be
> > cached or we'd be making a cached page for every unique user. So things
> like
> > their <?= $username ?>, or maybe parts of the page change based up their
> > membership <?php if ($loggedin == true) { ?>, or maybe parts of the page
> > rotate different content (modules if you like).
> > >
> > > Therefore we are trying to mininimize/compress the cached pages that
> need
> > to be served by removing all <!-- --> and /* */ and // and whitespace and
> > other stuff. When you have this much data to serve that fast, those few
> > characters here and there add up quickly in bandwidth and space. As well
> as
> > render time for both apache and the client's browser's parser.
> > >
> > > Dig?
> > >
> > >> -----Original Message-----
> > >> From: ma...@behnke.biz [mailto:ma...@behnke.biz]
> > >> Sent: Friday, May 03, 2013 4:28 AM
> > >> To: Daevid Vincent; 'php-general General'
> > >> Subject: RE: [PHP] Need a tool to minimize HTML before storing in
> > memecache
> > >>
> > >> But why are you caching uncompiled php code?
> > >>
> > >>> Daevid Vincent <dae...@daevid.com> hat am 2. Mai 2013 um 23:21
> > >> geschrieben:
> > >>>
> > >>> While that may be true for most users, I see no reason that it should
> > >> limit or
> > >>> force me to a certain use case given that dynamic pages make up the
> vast
> > >>> majority of web pages served.
> > >>>
> > >>> Secondly, there are 8 billion options in Tidy to configure it, I
> would
> > be
> > >>> astonished if they were so short-sighted to not have one to disable
> > >> converting
> > >>> < and > to < and > as they do for all sorts of other things
> like
> > >> quotes,
> > >>> ampersands, etc. I just don't know which flag this falls under or
> what
> > >>> combination of flags I'm setting that is causing this to happen.
> > >>>
> > >>> Barring that little snag, it works like a champ.
> > >>>
> > >>>> -----Original Message-----
> > >>>> From: ma...@behnke.biz [mailto:ma...@behnke.biz]
> > >>>> Sent: Thursday, May 02, 2013 4:55 AM
> > >>>> To: Daevid Vincent; 'php-general General'
> > >>>> Subject: RE: [PHP] Need a tool to minimize HTML before storing in
> > >> memecache
> > >>>> This is because tidy is for optimizing HTML, not for optimizing PHP.
> > >>>>
> > >>>>> Daevid Vincent <dae...@daevid.com> hat am 2. Mai 2013 um 02:20
> > >>>> geschrieben:
> > >>>>>
> > >>>>> So I took the time to install Tidy extension and wedge it into my
> > >> code.
> > >>>> Now
> > >>>>> there is one thing that is killing me and breaking all my pages.
> > >>>>>
> > >>>>> This is what I WANT the result to be:
> > >>>>>
> > >>>>> <link rel="stylesheet" type="text/css"
> > >>>> href="/templates/<?=
> > >>>>> $layout_id ?>/css/styles.css" />
> > >>>>> <link rel="stylesheet" type="text/css"
> > >>>> href="/templates/<?=
> > >>>>> $layout_id ?>/css/retina.css" media="only screen and
> > >>>>> (-webkit-min-device-pixel-ratio: 2)" />
> > >>>>>
> > >>>>> Which then 'renders' out to this normally without Tidy:
> > >>>>>
> > >>>>> <link rel="stylesheet" type="text/css"
> > >>>>> href="/templates/2/css/styles.css" />
> > >>>>> <link rel="stylesheet" type="text/css"
> > >>>>> href="/templates/2/css/retina.css" media="only screen and
> > >>>>> (-webkit-min-device-pixel-ratio: 2)" />
> > >>>>>
> > >>>>> This is what Tidy does:
> > >>>>>
> > >>>>> <link rel="stylesheet" type="text/css"
> > >>>>> href="/templates/%3C?=%20$layout_id%20?%3E/css/styles.css">
> > >>>>> <link rel="stylesheet" type="text/css"
> > >>>>> href="/templates/%3C?=%20$layout_id%20?%3E/css/retina.css"
> media="only
> > >>>>> screen and (-webkit-min-device-pixel-ratio: 2)">
> > >>>>>
> > >>>>> I found ['fix-uri' => false] which gets closer:
> > >>>>>
> > >>>>> <link rel="stylesheet" type="text/css"
> > >>>>> href="/templates/<?= $layout_id ?>/css/styles.css">
> > >>>>> <link rel="stylesheet" type="text/css"
> > >>>>> href="/templates/<?= $layout_id ?>/css/retina.css"
> media="only
> > >>>> screen
> > >>>>> and (-webkit-min-device-pixel-ratio: 2)">
> > >>>>>
> > >>>>> I've tried about every option I can think of. What is the solution
> to
> > >> make
> > >>>>> it stop trying to be smarter than me and converting my < and >
> tags??
> > >>>>>
> > >>>>> //See all parameters available here:
> > >>>>> http://tidy.sourceforge.net/docs/quickref.html
> > >>>>> $tconfig = array(
> > >>>>> //'clean' => true,
> > >>>>> 'hide-comments' => true,
> > >>>>> 'hide-endtags' => true,
> > >>>>> 'drop-proprietary-attributes' => true,
> > >>>>> //'join-classes' => true,
> > >>>>> //'join-styles' => true,
> > >>>>> //'quote-marks' => true,
> > >>>>> 'fix-uri' => false,
> > >>>>> 'numeric-entities' => true,
> > >>>>> 'preserve-entities' => true,
> > >>>>> 'doctype' => 'omit',
> > >>>>> 'tab-size' => 1,
> > >>>>> 'wrap' => 0,
> > >>>>> 'wrap-php' => false,
> > >>>>> 'char-encoding' => 'raw',
> > >>>>> 'input-encoding' => 'raw',
> > >>>>> 'output-encoding' => 'raw',
> > >>>>> 'newline' => 'LF',
> > >>>>> 'tidy-mark' => false,
> > >>>>> 'quiet' => true,
> > >>>>> 'show-errors' => ($this->_debug ? 6 : 0),
> > >>>>> 'show-warnings' => $this->_debug,
> > >>>>> );
> > >>>>>
> > >>>>>
> > >>>>> From: Joseph Moniz [mailto:joseph.mo...@gmail.com]
> > >>>>> Sent: Wednesday, April 17, 2013 2:55 PM
> > >>>>> To: Daevid Vincent
> > >>>>> Cc: php-general General
> > >>>>> Subject: Re: [PHP] Need a tool to minimize HTML before storing in
> > >>>> memecache
> > >>>>> http://php.net/manual/en/book.tidy.php
> > >>>>>
> > >>>>>
> > >>>>> - Joseph Moniz
> > >>>>> (510) 509-0775 | @josephmoniz <https://twitter.com/josephmoniz> |
> > >>>>> <https://github.com/JosephMoniz> GitHub |
> > >>>>> <http://www.linkedin.com/pub/joseph-moniz/13/949/b54/> LinkedIn |
> Blog
> > >>>>> <http://josephmoniz.github.io/> | CoderWall
> > >>>>> <https://coderwall.com/josephmoniz>
> > >>>>>
> > >>>>> "Wake up early, Stay up late, Change the world"
> > >>>>>
> > >>>>> On Wed, Apr 17, 2013 at 2:52 PM, Daevid Vincent <dae...@daevid.com
> >
> > >> wrote:
> > >>>>> We do a lot with caching and storing in memecached as well as local
> > >> copies
> > >>>>> so as to not hit the cache pool over the network and we have found
> > >> some
> > >>>>> great tools to minimize our javascript and our css, and now we'd
> like
> > >> to
> > >>>>> compress our HTML in these cache slabs.
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> Anyone know of a good tool or even regex magic that I can call from
> > >> PHP to
> > >>>>> compress/minimize the giant string web page before I store it in
> the
> > >>>> cache?
> > >>>>>
> > >>>>>
> > >>>>> It's not quite as simple as stripping white space b/c obviously
> there
> > >> are
> > >>>>> spaces between attributes in tags that need to be preserved, but
> also
> > >> in
> > >>>> the
> > >>>>> words/text on the page. I could strip out newlines I suppose, but
> then
> > >> do
> > >>>> I
> > >>>>> run into any issues in other ways? In any event, it seems like
> someone
> > >>>> would
> > >>>>> have solved this by now before I go re-inventing the wheel.
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> d.
> > >>>>>
> > >>>> --
> > >>>> Marco Behnke
> > >>>> Dipl. Informatiker (FH), SAE Audio Engineer Diploma
> > >>>> Zend Certified Engineer PHP 5.3
> > >>>>
> > >>>> Tel.: 0174 / 9722336
> > >>>> e-Mail: ma...@behnke.biz
> > >>>>
> > >>>> Softwaretechnik Behnke
> > >>>> Heinrich-Heine-Str. 7D
> > >>>> 21218 Seevetal
> > >>>>
> > >>>> http://www.behnke.biz
> > >> --
> > >> Marco Behnke
> > >> Dipl. Informatiker (FH), SAE Audio Engineer Diploma
> > >> Zend Certified Engineer PHP 5.3
> > >>
> > >> Tel.: 0174 / 9722336
> > >> e-Mail: ma...@behnke.biz
> > >>
> > >> Softwaretechnik Behnke
> > >> Heinrich-Heine-Str. 7D
> > >> 21218 Seevetal
> > >>
> > >> http://www.behnke.biz
> > >
> >
> >
> > --
> > Marco Behnke
> > Dipl. Informatiker (FH), SAE Audio Engineer Diploma
> > Zend Certified Engineer PHP 5.3
> >
> > Tel.: 0174 / 9722336
> > e-Mail: ma...@behnke.biz
> >
> > Softwaretechnik Behnke
> > Heinrich-Heine-Str. 7D
> > 21218 Seevetal
> >
> > http://www.behnke.biz
> >
>
>
>
> --
> PHP General Mailing List (http://www.php.net/)
> To unsubscribe, visit: http://www.php.net/unsub.php
>
>
--
github.com/KingCrunch
--- End Message ---
--- Begin Message ---
Hi,
Is there a solution to generate onfly PDF from HTML page, and from data
user typed in form (let's say like a template) without using PECL ?
i read that is hosting does not allow such extension, we can not
generate PDF, so i would rather get a solution without such library.
Moreover i'm searching a solution free and that i can supply with my web
components.
I created a component that should be able to generate PDF files quite
often as service for user.
thx
Al.
--- End Message ---
