Re: Running pilter.pl as a service

2018-04-25 Thread John Huong


Hi I got pilter.pl running in the background.

I'm not sure if I'm doing things correctly but when i run pilterimport
it generates errors instead.

pilerimport -d /var/piler/imap/cur -D
failed to import: /var/piler/imap/cur/1524639972-820035-4378-EMYFRKOW
(id: 40005ae029c0076ab844005dcd3da30b)
error importing: '/var/piler/imap/cur/1524639972-820035-4378-EMYFRKOW'
failed to import: /var/piler/imap/cur/1524639776-195775-4378-PBG39UA4
(id: 40005ae029c00866fa64006ff10703e0)
error importing: '/var/piler/imap/cur/1524639776-195775-4378-PBG39UA4'
failed to import: /var/piler/imap/cur/1524640059-82319-4380-LWGG0P2Z
(id: 40005ae029c008988214001a841dbe7e)
error importing: '/var/piler/imap/cur/1524640059-82319-4380-LWGG0P2Z'
failed to import: /var/piler/imap/cur/1524639684-292356-4376-QMNNYITL
(id: 40005ae029c008c268a400752fdace29)
error importing: '/var/piler/imap/cur/1524639684-292356-4376-QMNNYITL'
processed:   0

On Sat, Apr 21, 2018 at 9:25 PM,   wrote:
>
>
> Hello,
>
> well, pilter.pl can run in the foreground, so any service
> manager should be able to handle it. You should check some
> examples of your favourite implementation.
>
> Try this:
> https://wiki.ubuntu.com/SystemdForUpstartUsers#Example_Systemd_service
>
> Janos
>
> On 2018-04-19 22:16, John Huong wrote:
>>
>> HI,
>>
>> Can anyone share their experience or give pointers how to run
>> pilter.pl [1] as a service in Ubuntu 16.04? Think they are using
>> systemd.
>
>
>



Re: Running pilter.pl as a service

2018-04-25 Thread Janos SUTO
Hello,

check the logs. If piler encounters a problem, it will syslog it.

Janos


 Original Message 
From: John Huong 
Sent: Wed Apr 25 09:11:27 GMT+02:00 2018
To: Piler User 
Subject: Re: Running pilter.pl as a service



Hi I got pilter.pl running in the background.

I'm not sure if I'm doing things correctly but when i run pilterimport
it generates errors instead.

pilerimport -d /var/piler/imap/cur -D
failed to import: /var/piler/imap/cur/1524639972-820035-4378-EMYFRKOW
(id: 40005ae029c0076ab844005dcd3da30b)
error importing: '/var/piler/imap/cur/1524639972-820035-4378-EMYFRKOW'
failed to import: /var/piler/imap/cur/1524639776-195775-4378-PBG39UA4
(id: 40005ae029c00866fa64006ff10703e0)
error importing: '/var/piler/imap/cur/1524639776-195775-4378-PBG39UA4'
failed to import: /var/piler/imap/cur/1524640059-82319-4380-LWGG0P2Z
(id: 40005ae029c008988214001a841dbe7e)
error importing: '/var/piler/imap/cur/1524640059-82319-4380-LWGG0P2Z'
failed to import: /var/piler/imap/cur/1524639684-292356-4376-QMNNYITL
(id: 40005ae029c008c268a400752fdace29)
error importing: '/var/piler/imap/cur/1524639684-292356-4376-QMNNYITL'
processed:   0

On Sat, Apr 21, 2018 at 9:25 PM,   wrote:
>
>
> Hello,
>
> well, pilter.pl can run in the foreground, so any service
> manager should be able to handle it. You should check some
> examples of your favourite implementation.
>
> Try this:
> https://wiki.ubuntu.com/SystemdForUpstartUsers#Example_Systemd_service
>
> Janos
>
> On 2018-04-19 22:16, John Huong wrote:
>>
>> HI,
>>
>> Can anyone share their experience or give pointers how to run
>> pilter.pl [1] as a service in Ubuntu 16.04? Think they are using
>> systemd.
>
>
>



Re: Running pilter.pl as a service

2018-04-25 Thread John Huong


Hi,

I'm seeing these in the syslog.

Apr 26 00:07:33 archive pilerimport[12512]:
40005ae0a7cf1d86672c005304895f97: mkdir
/var/piler/store/00/5ae/5f/97: error=No such file or directory
Apr 26 00:07:33 archive pilerimport[12512]:
40005ae0a7cf1d86672c005304895f97: cannot open:
/var/piler/store/00/5ae/5f/97/40005ae0a7cf1d86672c005304895f97.a1
Apr 26 00:07:33 archive pilerimport[12512]:
40005ae0a7cf1d86672c005304895f97: error storing attachment:
40005ae0a7cf1d86672c005304895f97.a1
Apr 26 00:07:33 archive pilerimport[12512]:
40005ae0a7cf1e217a6400fbba2a1f04: mkdir
/var/piler/store/00/5ae/1f/04: error=No such file or directory
Apr 26 00:07:33 archive pilerimport[12512]:
40005ae0a7cf1e217a6400fbba2a1f04: cannot open:
/var/piler/store/00/5ae/1f/04/40005ae0a7cf1e217a6400fbba2a1f04.m
Apr 26 00:07:33 archive pilerimport[12512]:
40005ae0a7cf1e217a6400fbba2a1f04: error storing message:
40005ae0a7cf1e217a6400fbba2a1f04.m
Apr 26 00:07:33 archive pilerimport[12512]:
40005ae0a7cf1e86cfcc00aec29de87b: mkdir
/var/piler/store/00/5ae/e8/7b: error=No such file or directory
Apr 26 00:07:33 archive pilerimport[12512]:
40005ae0a7cf1e86cfcc00aec29de87b: cannot open:
/var/piler/store/00/5ae/e8/7b/40005ae0a7cf1e86cfcc00aec29de87b.a1
Apr 26 00:07:33 archive pilerimport[12512]:
40005ae0a7cf1e86cfcc00aec29de87b: error storing attachment:
40005ae0a7cf1e86cfcc00aec29de87b.a1

Hope you can advise on the next step. The folder permissions seems to
be correct.


On Wed, Apr 25, 2018 at 8:23 PM, Janos SUTO  wrote:
> Hello,
>
> check the logs. If piler encounters a problem, it will syslog it.
>
> Janos
> 
> From: John Huong
> Sent: Wed Apr 25 09:11:27 GMT+02:00 2018
> To: Piler User
> Subject: Re: Running pilter.pl as a service
>
>
>
> Hi I got pilter.pl running in the background.
>
> I'm not sure if I'm doing things correctly but when i run pilterimport
> it generates errors instead.
>
> pilerimport -d /var/piler/imap/cur -D
> failed to import: /var/piler/imap/cur/1524639972-820035-4378-EMYFRKOW
> (id: 40005ae029c0076ab844005dcd3da30b)
> error importing: '/var/piler/imap/cur/1524639972-820035-4378-EMYFRKOW'
> failed to import: /var/piler/imap/cur/1524639776-195775-4378-PBG39UA4
> (id: 40005ae029c00866fa64006ff10703e0)
> error importing: '/var/piler/imap/cur/1524639776-195775-4378-PBG39UA4'
> failed to import: /var/piler/imap/cur/1524640059-82319-4380-LWGG0P2Z
> (id: 40005ae029c008988214001a841dbe7e)
> error importing: '/var/piler/imap/cur/1524640059-82319-4380-LWGG0P2Z'
> failed to import: /var/piler/imap/cur/1524639684-292356-4376-QMNNYITL
> (id: 40005ae029c008c268a400752fdace29)
> error importing: '/var/piler/imap/cur/1524639684-292356-4376-QMNNYITL'
> processed:   0
>
> On Sat, Apr 21, 2018 at 9:25 PM,   wrote:
>>
>>
>>
>>  Hello,
>>
>>  well, pilter.pl can run in the foreground, so any service
>>  manager should be able to handle it. You should check some
>>  examples of your favourite implementation.
>>
>>  Try this:
>>  https://wiki.ubuntu.com/SystemdForUpstartUsers#Example_Systemd_service
>>
>>  Janos
>>
>>  On 2018-04-19 22:16, John Huong wrote:
>>>
>>>
>>>  HI,
>>>
>>>  Can anyone share their experience or give pointers how to run
>>>  pilter.pl [1] as a service in Ubuntu 16.04? Think they are using
>>>  systemd.
>
>
>
>



Re: Running pilter.pl as a service

2018-04-25 Thread sj



Hello,

if /var/piler/store/00 does not exist, then create it, and chown it to 
piler.


Janos


On 2018-04-25 16:09, John Huong wrote:

Hi,

I'm seeing these in the syslog.

Apr 26 00:07:33 archive pilerimport[12512]:
40005ae0a7cf1d86672c005304895f97: mkdir
/var/piler/store/00/5ae/5f/97: error=No such file or directory
Apr 26 00:07:33 archive pilerimport[12512]:
40005ae0a7cf1d86672c005304895f97: cannot open:
/var/piler/store/00/5ae/5f/97/40005ae0a7cf1d86672c005304895f97.a1
Apr 26 00:07:33 archive pilerimport[12512]:
40005ae0a7cf1d86672c005304895f97: error storing attachment:
40005ae0a7cf1d86672c005304895f97.a1
Apr 26 00:07:33 archive pilerimport[12512]:
40005ae0a7cf1e217a6400fbba2a1f04: mkdir
/var/piler/store/00/5ae/1f/04: error=No such file or directory
Apr 26 00:07:33 archive pilerimport[12512]:
40005ae0a7cf1e217a6400fbba2a1f04: cannot open:
/var/piler/store/00/5ae/1f/04/40005ae0a7cf1e217a6400fbba2a1f04.m
Apr 26 00:07:33 archive pilerimport[12512]:
40005ae0a7cf1e217a6400fbba2a1f04: error storing message:
40005ae0a7cf1e217a6400fbba2a1f04.m
Apr 26 00:07:33 archive pilerimport[12512]:
40005ae0a7cf1e86cfcc00aec29de87b: mkdir
/var/piler/store/00/5ae/e8/7b: error=No such file or directory
Apr 26 00:07:33 archive pilerimport[12512]:
40005ae0a7cf1e86cfcc00aec29de87b: cannot open:
/var/piler/store/00/5ae/e8/7b/40005ae0a7cf1e86cfcc00aec29de87b.a1
Apr 26 00:07:33 archive pilerimport[12512]:
40005ae0a7cf1e86cfcc00aec29de87b: error storing attachment:
40005ae0a7cf1e86cfcc00aec29de87b.a1

Hope you can advise on the next step. The folder permissions seems to
be correct.


On Wed, Apr 25, 2018 at 8:23 PM, Janos SUTO  wrote:

Hello,

check the logs. If piler encounters a problem, it will syslog it.

Janos

From: John Huong
Sent: Wed Apr 25 09:11:27 GMT+02:00 2018
To: Piler User
Subject: Re: Running pilter.pl as a service



Hi I got pilter.pl running in the background.

I'm not sure if I'm doing things correctly but when i run pilterimport
it generates errors instead.

pilerimport -d /var/piler/imap/cur -D
failed to import: /var/piler/imap/cur/1524639972-820035-4378-EMYFRKOW
(id: 40005ae029c0076ab844005dcd3da30b)
error importing: '/var/piler/imap/cur/1524639972-820035-4378-EMYFRKOW'
failed to import: /var/piler/imap/cur/1524639776-195775-4378-PBG39UA4
(id: 40005ae029c00866fa64006ff10703e0)
error importing: '/var/piler/imap/cur/1524639776-195775-4378-PBG39UA4'
failed to import: /var/piler/imap/cur/1524640059-82319-4380-LWGG0P2Z
(id: 40005ae029c008988214001a841dbe7e)
error importing: '/var/piler/imap/cur/1524640059-82319-4380-LWGG0P2Z'
failed to import: /var/piler/imap/cur/1524639684-292356-4376-QMNNYITL
(id: 40005ae029c008c268a400752fdace29)
error importing: '/var/piler/imap/cur/1524639684-292356-4376-QMNNYITL'
processed:   0

On Sat, Apr 21, 2018 at 9:25 PM,   wrote:




 Hello,

 well, pilter.pl can run in the foreground, so any service
 manager should be able to handle it. You should check some
 examples of your favourite implementation.

 Try this:
 
https://wiki.ubuntu.com/SystemdForUpstartUsers#Example_Systemd_service


 Janos

 On 2018-04-19 22:16, John Huong wrote:



 HI,

 Can anyone share their experience or give pointers how to run
 pilter.pl [1] as a service in Ubuntu 16.04? Think they are using
 systemd.









Re: Running pilter.pl as a service

2018-04-25 Thread John Huong


Hi Janos,

Seems that did the trick. Thanks for the help.

I'm not seeing any archive mails appearing in the web ui yet though.

Looking through the syslog I am picking up the following errors:

Apr 26 09:27:20 archive pilerimport[21255]:
40005ae12b0207dbc9940028795314a2: mysql_stmt_execute error:
*Incorrect string value: '\xF0\x9F\x91\x91' for column 'subject' at
row 1* (errno: 1366)
Apr 26 09:27:20 archive pilerimport[21255]:
40005ae12b020a8e56d4005fa0d0854a: mysql_stmt_execute error:
*Incorrect string value: '\xF0\x9F\x98\x83' for column 'subject' at
row 1* (errno: 1366)
Apr 26 09:27:20 archive pilerimport[21263]: error: helper: execl
Apr 26 09:27:20 archive pilerimport[21269]: error: helper: execl
Apr 26 09:27:20 archive pilerimport[21270]: error: helper: execl
Apr 26 09:27:20 archive pilerimport[21274]: error: helper: execl
Apr 26 09:27:20 archive pilerimport[21275]: error: helper: execl
Apr 26 09:27:20 archive pilerimport[21255]:
40005ae12b02340e9f3c00f39dd268da: mysql_stmt_execute error:
*Incorrect string value: '\xF0\x9F\x92\xB2 O...' for column 'subject'
at row 1* (errno: 1366)
Apr 26 09:27:20 archive pilerimport[21255]:
40005ae12b0234ec6c7c002618ce4991: mysql_stmt_execute error:
*Incorrect string value: '\xF0\x9F\x98\x8D N...' for column 'subject'
at row 1* (errno: 1366)

On Thu, Apr 26, 2018 at 1:01 AM,   wrote:
>
>
> Hello,
>
> if /var/piler/store/00 does not exist, then create it, and chown it to
> piler.
>
> Janos
>
>
>
> On 2018-04-25 16:09, John Huong wrote:
>>
>> Hi,
>>
>> I'm seeing these in the syslog.
>>
>> Apr 26 00:07:33 archive pilerimport[12512]:
>> 40005ae0a7cf1d86672c005304895f97: mkdir
>> /var/piler/store/00/5ae/5f/97: error=No such file or directory
>> Apr 26 00:07:33 archive pilerimport[12512]:
>> 40005ae0a7cf1d86672c005304895f97: cannot open:
>> /var/piler/store/00/5ae/5f/97/40005ae0a7cf1d86672c005304895f97.a1
>> Apr 26 00:07:33 archive pilerimport[12512]:
>> 40005ae0a7cf1d86672c005304895f97: error storing attachment:
>> 40005ae0a7cf1d86672c005304895f97.a1
>> Apr 26 00:07:33 archive pilerimport[12512]:
>> 40005ae0a7cf1e217a6400fbba2a1f04: mkdir
>> /var/piler/store/00/5ae/1f/04: error=No such file or directory
>> Apr 26 00:07:33 archive pilerimport[12512]:
>> 40005ae0a7cf1e217a6400fbba2a1f04: cannot open:
>> /var/piler/store/00/5ae/1f/04/40005ae0a7cf1e217a6400fbba2a1f04.m
>> Apr 26 00:07:33 archive pilerimport[12512]:
>> 40005ae0a7cf1e217a6400fbba2a1f04: error storing message:
>> 40005ae0a7cf1e217a6400fbba2a1f04.m
>> Apr 26 00:07:33 archive pilerimport[12512]:
>> 40005ae0a7cf1e86cfcc00aec29de87b: mkdir
>> /var/piler/store/00/5ae/e8/7b: error=No such file or directory
>> Apr 26 00:07:33 archive pilerimport[12512]:
>> 40005ae0a7cf1e86cfcc00aec29de87b: cannot open:
>> /var/piler/store/00/5ae/e8/7b/40005ae0a7cf1e86cfcc00aec29de87b.a1
>> Apr 26 00:07:33 archive pilerimport[12512]:
>> 40005ae0a7cf1e86cfcc00aec29de87b: error storing attachment:
>> 40005ae0a7cf1e86cfcc00aec29de87b.a1
>>
>> Hope you can advise on the next step. The folder permissions seems to
>> be correct.
>>
>>
>> On Wed, Apr 25, 2018 at 8:23 PM, Janos SUTO  wrote:
>>>
>>> Hello,
>>>
>>> check the logs. If piler encounters a problem, it will syslog it.
>>>
>>> Janos
>>> 
>>> From: John Huong
>>> Sent: Wed Apr 25 09:11:27 GMT+02:00 2018
>>> To: Piler User
>>> Subject: Re: Running pilter.pl as a service
>>>
>>>
>>>
>>> Hi I got pilter.pl running in the background.
>>>
>>> I'm not sure if I'm doing things correctly but when i run pilterimport
>>> it generates errors instead.
>>>
>>> pilerimport -d /var/piler/imap/cur -D
>>> failed to import: /var/piler/imap/cur/1524639972-820035-4378-EMYFRKOW
>>> (id: 40005ae029c0076ab844005dcd3da30b)
>>> error importing: '/var/piler/imap/cur/1524639972-820035-4378-EMYFRKOW'
>>> failed to import: /var/piler/imap/cur/1524639776-195775-4378-PBG39UA4
>>> (id: 40005ae029c00866fa64006ff10703e0)
>>> error importing: '/var/piler/imap/cur/1524639776-195775-4378-PBG39UA4'
>>> failed to import: /var/piler/imap/cur/1524640059-82319-4380-LWGG0P2Z
>>> (id: 40005ae029c008988214001a841dbe7e)
>>> error importing: '/var/piler/imap/cur/1524640059-82319-4380-LWGG0P2Z'
>>> failed to import: /var/piler/imap/cur/1524639684-292356-4376-QMNNYITL
>>> (id: 40005ae029c008c268a400752fdace29)
>>> error importing: '/var/piler/imap/cur/1524639684-292356-4376-QMNNYITL'
>>> processed:   0
>>>
>>> On Sat, Apr 21, 2018 at 9:25 PM,   wrote:




  Hello,

  well, pilter.pl can run in the foreground, so any service
  manager should be able to handle it. You should check some
  examples of your favourite implementation.

  Try this:
  https://wiki.ubuntu.com/SystemdForUpstartUsers#Example_Systemd_service

  Janos

  On 2018-04-19 22:16, John Huong wrote:
>
>
>
>  HI,
>
>  Can anyone share their experience or giv

Re: Running pilter.pl as a service

2018-04-25 Thread John Huong


Hi Janos,

Apologies. Found the answer is in the newer version of piler. I was
using piler 1.3.1 earlier.

Also I have run into another issue as it seems I can't find the class
memcache. However I am able to get around that for now by disabling
memcached_enabled.

I'm using PHP 7 at the moment on a new Ubuntu install

It would seem I've got the domains defined, piler and searchd running
now. But I am not able to view the messages I have imported... or
perhaps I need to key in a specific search parameter?

Or is there a way to view all archived messages without a search parameter.

On Thu, Apr 26, 2018 at 9:32 AM, John Huong  wrote:
> Hi Janos,
>
> Seems that did the trick. Thanks for the help.
>
> I'm not seeing any archive mails appearing in the web ui yet though.
>
> Looking through the syslog I am picking up the following errors:
>
> Apr 26 09:27:20 archive pilerimport[21255]:
> 40005ae12b0207dbc9940028795314a2: mysql_stmt_execute error:
> *Incorrect string value: '\xF0\x9F\x91\x91' for column 'subject' at
> row 1* (errno: 1366)
> Apr 26 09:27:20 archive pilerimport[21255]:
> 40005ae12b020a8e56d4005fa0d0854a: mysql_stmt_execute error:
> *Incorrect string value: '\xF0\x9F\x98\x83' for column 'subject' at
> row 1* (errno: 1366)
> Apr 26 09:27:20 archive pilerimport[21263]: error: helper: execl
> Apr 26 09:27:20 archive pilerimport[21269]: error: helper: execl
> Apr 26 09:27:20 archive pilerimport[21270]: error: helper: execl
> Apr 26 09:27:20 archive pilerimport[21274]: error: helper: execl
> Apr 26 09:27:20 archive pilerimport[21275]: error: helper: execl
> Apr 26 09:27:20 archive pilerimport[21255]:
> 40005ae12b02340e9f3c00f39dd268da: mysql_stmt_execute error:
> *Incorrect string value: '\xF0\x9F\x92\xB2 O...' for column 'subject'
> at row 1* (errno: 1366)
> Apr 26 09:27:20 archive pilerimport[21255]:
> 40005ae12b0234ec6c7c002618ce4991: mysql_stmt_execute error:
> *Incorrect string value: '\xF0\x9F\x98\x8D N...' for column 'subject'
> at row 1* (errno: 1366)
>
> On Thu, Apr 26, 2018 at 1:01 AM,   wrote:
>>
>>
>> Hello,
>>
>> if /var/piler/store/00 does not exist, then create it, and chown it to
>> piler.
>>
>> Janos
>>
>>
>>
>> On 2018-04-25 16:09, John Huong wrote:
>>>
>>> Hi,
>>>
>>> I'm seeing these in the syslog.
>>>
>>> Apr 26 00:07:33 archive pilerimport[12512]:
>>> 40005ae0a7cf1d86672c005304895f97: mkdir
>>> /var/piler/store/00/5ae/5f/97: error=No such file or directory
>>> Apr 26 00:07:33 archive pilerimport[12512]:
>>> 40005ae0a7cf1d86672c005304895f97: cannot open:
>>> /var/piler/store/00/5ae/5f/97/40005ae0a7cf1d86672c005304895f97.a1
>>> Apr 26 00:07:33 archive pilerimport[12512]:
>>> 40005ae0a7cf1d86672c005304895f97: error storing attachment:
>>> 40005ae0a7cf1d86672c005304895f97.a1
>>> Apr 26 00:07:33 archive pilerimport[12512]:
>>> 40005ae0a7cf1e217a6400fbba2a1f04: mkdir
>>> /var/piler/store/00/5ae/1f/04: error=No such file or directory
>>> Apr 26 00:07:33 archive pilerimport[12512]:
>>> 40005ae0a7cf1e217a6400fbba2a1f04: cannot open:
>>> /var/piler/store/00/5ae/1f/04/40005ae0a7cf1e217a6400fbba2a1f04.m
>>> Apr 26 00:07:33 archive pilerimport[12512]:
>>> 40005ae0a7cf1e217a6400fbba2a1f04: error storing message:
>>> 40005ae0a7cf1e217a6400fbba2a1f04.m
>>> Apr 26 00:07:33 archive pilerimport[12512]:
>>> 40005ae0a7cf1e86cfcc00aec29de87b: mkdir
>>> /var/piler/store/00/5ae/e8/7b: error=No such file or directory
>>> Apr 26 00:07:33 archive pilerimport[12512]:
>>> 40005ae0a7cf1e86cfcc00aec29de87b: cannot open:
>>> /var/piler/store/00/5ae/e8/7b/40005ae0a7cf1e86cfcc00aec29de87b.a1
>>> Apr 26 00:07:33 archive pilerimport[12512]:
>>> 40005ae0a7cf1e86cfcc00aec29de87b: error storing attachment:
>>> 40005ae0a7cf1e86cfcc00aec29de87b.a1
>>>
>>> Hope you can advise on the next step. The folder permissions seems to
>>> be correct.
>>>
>>>
>>> On Wed, Apr 25, 2018 at 8:23 PM, Janos SUTO  wrote:

 Hello,

 check the logs. If piler encounters a problem, it will syslog it.

 Janos
 
 From: John Huong
 Sent: Wed Apr 25 09:11:27 GMT+02:00 2018
 To: Piler User
 Subject: Re: Running pilter.pl as a service



 Hi I got pilter.pl running in the background.

 I'm not sure if I'm doing things correctly but when i run pilterimport
 it generates errors instead.

 pilerimport -d /var/piler/imap/cur -D
 failed to import: /var/piler/imap/cur/1524639972-820035-4378-EMYFRKOW
 (id: 40005ae029c0076ab844005dcd3da30b)
 error importing: '/var/piler/imap/cur/1524639972-820035-4378-EMYFRKOW'
 failed to import: /var/piler/imap/cur/1524639776-195775-4378-PBG39UA4
 (id: 40005ae029c00866fa64006ff10703e0)
 error importing: '/var/piler/imap/cur/1524639776-195775-4378-PBG39UA4'
 failed to import: /var/piler/imap/cur/1524640059-82319-4380-LWGG0P2Z
 (id: 40005ae029c008988214001a841dbe7e)
 error importing: '/var/pil

Re: Running pilter.pl as a service

2018-04-25 Thread John Huong


Finally found the answer to my own question. The user needs to be an auditor.

Still not able to use memcached though. There isn't a php7 memcache
package it seems too .

On Thu, Apr 26, 2018 at 11:34 AM, John Huong  wrote:
> Hi Janos,
>
> Apologies. Found the answer is in the newer version of piler. I was
> using piler 1.3.1 earlier.
>
> Also I have run into another issue as it seems I can't find the class
> memcache. However I am able to get around that for now by disabling
> memcached_enabled.
>
> I'm using PHP 7 at the moment on a new Ubuntu install
>
> It would seem I've got the domains defined, piler and searchd running
> now. But I am not able to view the messages I have imported... or
> perhaps I need to key in a specific search parameter?
>
> Or is there a way to view all archived messages without a search parameter.
>
> On Thu, Apr 26, 2018 at 9:32 AM, John Huong  wrote:
>> Hi Janos,
>>
>> Seems that did the trick. Thanks for the help.
>>
>> I'm not seeing any archive mails appearing in the web ui yet though.
>>
>> Looking through the syslog I am picking up the following errors:
>>
>> Apr 26 09:27:20 archive pilerimport[21255]:
>> 40005ae12b0207dbc9940028795314a2: mysql_stmt_execute error:
>> *Incorrect string value: '\xF0\x9F\x91\x91' for column 'subject' at
>> row 1* (errno: 1366)
>> Apr 26 09:27:20 archive pilerimport[21255]:
>> 40005ae12b020a8e56d4005fa0d0854a: mysql_stmt_execute error:
>> *Incorrect string value: '\xF0\x9F\x98\x83' for column 'subject' at
>> row 1* (errno: 1366)
>> Apr 26 09:27:20 archive pilerimport[21263]: error: helper: execl
>> Apr 26 09:27:20 archive pilerimport[21269]: error: helper: execl
>> Apr 26 09:27:20 archive pilerimport[21270]: error: helper: execl
>> Apr 26 09:27:20 archive pilerimport[21274]: error: helper: execl
>> Apr 26 09:27:20 archive pilerimport[21275]: error: helper: execl
>> Apr 26 09:27:20 archive pilerimport[21255]:
>> 40005ae12b02340e9f3c00f39dd268da: mysql_stmt_execute error:
>> *Incorrect string value: '\xF0\x9F\x92\xB2 O...' for column 'subject'
>> at row 1* (errno: 1366)
>> Apr 26 09:27:20 archive pilerimport[21255]:
>> 40005ae12b0234ec6c7c002618ce4991: mysql_stmt_execute error:
>> *Incorrect string value: '\xF0\x9F\x98\x8D N...' for column 'subject'
>> at row 1* (errno: 1366)
>>
>> On Thu, Apr 26, 2018 at 1:01 AM,   wrote:
>>>
>>>
>>> Hello,
>>>
>>> if /var/piler/store/00 does not exist, then create it, and chown it to
>>> piler.
>>>
>>> Janos
>>>
>>>
>>>
>>> On 2018-04-25 16:09, John Huong wrote:

 Hi,

 I'm seeing these in the syslog.

 Apr 26 00:07:33 archive pilerimport[12512]:
 40005ae0a7cf1d86672c005304895f97: mkdir
 /var/piler/store/00/5ae/5f/97: error=No such file or directory
 Apr 26 00:07:33 archive pilerimport[12512]:
 40005ae0a7cf1d86672c005304895f97: cannot open:
 /var/piler/store/00/5ae/5f/97/40005ae0a7cf1d86672c005304895f97.a1
 Apr 26 00:07:33 archive pilerimport[12512]:
 40005ae0a7cf1d86672c005304895f97: error storing attachment:
 40005ae0a7cf1d86672c005304895f97.a1
 Apr 26 00:07:33 archive pilerimport[12512]:
 40005ae0a7cf1e217a6400fbba2a1f04: mkdir
 /var/piler/store/00/5ae/1f/04: error=No such file or directory
 Apr 26 00:07:33 archive pilerimport[12512]:
 40005ae0a7cf1e217a6400fbba2a1f04: cannot open:
 /var/piler/store/00/5ae/1f/04/40005ae0a7cf1e217a6400fbba2a1f04.m
 Apr 26 00:07:33 archive pilerimport[12512]:
 40005ae0a7cf1e217a6400fbba2a1f04: error storing message:
 40005ae0a7cf1e217a6400fbba2a1f04.m
 Apr 26 00:07:33 archive pilerimport[12512]:
 40005ae0a7cf1e86cfcc00aec29de87b: mkdir
 /var/piler/store/00/5ae/e8/7b: error=No such file or directory
 Apr 26 00:07:33 archive pilerimport[12512]:
 40005ae0a7cf1e86cfcc00aec29de87b: cannot open:
 /var/piler/store/00/5ae/e8/7b/40005ae0a7cf1e86cfcc00aec29de87b.a1
 Apr 26 00:07:33 archive pilerimport[12512]:
 40005ae0a7cf1e86cfcc00aec29de87b: error storing attachment:
 40005ae0a7cf1e86cfcc00aec29de87b.a1

 Hope you can advise on the next step. The folder permissions seems to
 be correct.


 On Wed, Apr 25, 2018 at 8:23 PM, Janos SUTO  wrote:
>
> Hello,
>
> check the logs. If piler encounters a problem, it will syslog it.
>
> Janos
> 
> From: John Huong
> Sent: Wed Apr 25 09:11:27 GMT+02:00 2018
> To: Piler User
> Subject: Re: Running pilter.pl as a service
>
>
>
> Hi I got pilter.pl running in the background.
>
> I'm not sure if I'm doing things correctly but when i run pilterimport
> it generates errors instead.
>
> pilerimport -d /var/piler/imap/cur -D
> failed to import: /var/piler/imap/cur/1524639972-820035-4378-EMYFRKOW
> (id: 40005ae029c0076ab844005dcd3da30b)
> error importing: '/var/piler/imap/cur/1524639972-820035-4378-EMYF