Good day Thomas.
Thank you for the information you provided. I am no expert with Perl. I
am far from it. Sorry for all my noob questions but I trying to learn
and attempting to find some of this information elsewhere has gotten me
no where.
--What we are doing here - IT?
My apologies if I gave the impression that I was attempting to have
someone do my IT work for me. That was not my intention at all. All I
wanted to to know is if anyone used the Strawberry Perl with that flag
enabled. I guess I came off as trying to have someone fix this for me
and that's not what I intended on doing. Sorry I posted anything about it.
--Strawberry Perl 64Bit is the only 64Bit Perl than can be used on
Windows for assp.
This is information I did not know about. Great information. Thank you
for clearing this up as well.
On 3/18/2016 10:14 AM, Thomas Eckardt wrote:
Pertaining to the USE_64_BIT_INT flag, I think we are not on the same
page here. The build of Perl I am using does not have the USE_64_BIT_INT
enabled. So I run into the situation where Perl dies at 1.8GB of ram
usage. Sorry for the confusion and I didn't mean to aggravate anyone. I
just figured I would ask if anyone has used Strawberry Perl with that
flag enabled. I will figure it out.
What we are doing here - IT?
Perl 32 Bit is limited to 4GB memory - it does'nt matter, if the
USE_64_BIT_INT flag is set or not.
The USE_64_BIT_INT flag enables the 64Bit integer variable usage and
calculation in Perl.
Because assp does not use any integer variable that breaks the 32Bit
limit, the usage of the USE_64_BIT_INT flag is useless - it only allocates
more memory.
If you want to break the 4GB limit, you have to use a 64Bit Perl.
Strawberry Perl
Strawberry Perl 64Bit is the only 64Bit Perl than can be used on Windows
for assp. ActivePerl 64 Bit misses too many XS modules - how ever, even
this can be used with some XS and include modifications for several
modules and the right compiler.
Thomas
Von: Jay <[email protected]>
An: [email protected]
Datum: 18.03.2016 14:42
Betreff: Re: [Assp-user] A few questions on ASSP.....
Good day Thomas.
Thank you for the follow up. I suspected MySQL already and to be more
exact, the HMM table. I already have a plan to install MySQL 5.5 and
port the database over. Most likely I am going to have to start HMM over
again fresh.
Pertaining to the USE_64_BIT_INT flag, I think we are not on the same
page here. The build of Perl I am using does not have the USE_64_BIT_INT
enabled. So I run into the situation where Perl dies at 1.8GB of ram
usage. Sorry for the confusion and I didn't mean to aggravate anyone. I
just figured I would ask if anyone has used Strawberry Perl with that
flag enabled. I will figure it out.
Thanks anyways.
On 3/18/2016 7:30 AM, Thomas Eckardt wrote:
At startup assp analyzes several databases - spamdb, whitelistdb, HMMdb.
Foreach of these tables a simple 'SELECT COUNT(*) FROM ..' is done. If
this SQL statement fails for any reason, assp counts records.
Your MySQL server is simply badly installed or configured - it is too
slow. Even you have 6 million records in table, this statement should
never take longer than 2 to 5 seconds!
a know problem with Perl 32bit unless USE_64_BIT_INT enabled
What has the USE_64_BIT_INT flag to do with the 4GB memory restriction
of
a 32Bit application?
(please answer this question your self!)
Thomas
Von: Jay <[email protected]>
An: For Users of ASSP <[email protected]>
Datum: 16.03.2016 15:47
Betreff: [Assp-user] A few questions on ASSP.....
Good day everyone.
I am hoping someone can give me some guidance on this. Here's some info
and the issue I am dealing with:
We are using ASSP 2.4.5(15272) with ActiveState Perl 5.16.3 (32bit). We
also use MySQL(5.1.45) as our database back end. The only data that we
send through MySQL is the spamdb and HMMdb.
Here's some info on MySQL, currently HMMdb is 826mb and has almost
5.4million rows. Our spamdb is currently at 237mb and has almost 1.9
million rows. We have a lot more users on our mail server now than we
did when we started using ASSP which has been in place for several years
now. Close to 8 years at this point.
Problems:
1. So the first issue I am dealing with is when we have to restart ASSP,
it can take several minutes for ASSP to be ready because it appears the
hold up at this point is MySQL. MySQL is slow to send the info needed to
ASSP and thus holds up the SMTP processing of email. I realize this and
am planning on making whatever changes I need to get this resolved.
2. Trying to use the spamdb and HMMdb files resident in memory at this
point is an issue because we are using Perl 32bit. Once the perl service
hits 1.8GB of ram it crashes instantly. I researched this and it is a
know problem with Perl 32bit unless USE_64_BIT_INT enabled and compiled
in that version of Perl. I want to use the HMM and spamdb in
conjunction with each other.
3. Strawberry Perl has a build specially for still using a 32bit build
but have the USE_64_BIT_INT enabled in the build so 32bit Perl can use
3GB of ram total. The other alternative is to use 64bit Perl, but I
remember in the past trying this and ASSP would just crash within a few
seconds after starting. Reading through the previous knowledge base
there was at one point the discussion that not all modules on CPAN are
compiled in 64bit. So the consensus was to use 32bit Perl. Is this still
the case anymore or does it make sense to move to Perl 64bit?
So I realize that MySQL is not really cutting it for us any longer. We
are out growing it quickly. For now I turned off DoHMM so we don't have
to wait for several minutes for ASSP to start up. Once we disabled
DoHMM, ASSP starts within 30 seconds. This is only a temporary measure
until I can get some guidance on what to do about Perl. Anyone out there
using either the special build of Strawberry Perl with the
USE_64_BIT_INT enabled? Or successfully using 64bit Perl itself?
Please let me know and thank you any assistance. I really appreciate it.
------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785231&iu=/4140
_______________________________________________
Assp-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-user
DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential,
legally
privileged and protected in law and are intended solely for the use of
the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no
known virus in this email!
*******************************************************
------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785231&iu=/4140
_______________________________________________
Assp-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-user
-----
No virus found in this message.
Checked by AVG - www.avg.com
Version: 2016.0.7497 / Virus Database: 4542/11829 - Release Date:
03/17/16
------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785231&iu=/4140
_______________________________________________
Assp-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-user
DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally
privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no
known virus in this email!
*******************************************************
------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785231&iu=/4140
_______________________________________________
Assp-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-user
-----
No virus found in this message.
Checked by AVG - www.avg.com
Version: 2016.0.7497 / Virus Database: 4542/11836 - Release Date: 03/18/16
------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785231&iu=/4140
_______________________________________________
Assp-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-user
