Re: cassandra user request log

[Jeff Jirsa]

On 2017-02-20 05:52 (-0800), Edward Capriolo  wrote: 
> Not directly. Consider proxing request through an application server and
> log at that level.

As is often the case, Ed probably has the most straight-forward solution given 
current feature set. The other is to turn on tracing with probability 1.0, 
which will (as already mentioned) be very write intensive. Final suggestion is 
to open a JIRA with a feature request for a light-weight query log - no 
guarantee that anyone ever implements it, but perhaps someone else with a 
similar compliance requirement will decide it's worth implementing if they 
realize it's generally useful. 

Re: cassandra user request log

[Edward Capriolo]

Not directly. Consider proxing request through an application server and
log at that level.

On Friday, February 10, 2017, Benjamin Roth  wrote:

> If you want to audit write operations only, you could maybe use CDC, this
> is a quite new feature in 3.x (I think it was introduced in 3.9 or 3.10)
>
> 2017-02-10 10:10 GMT+01:00 vincent gromakowski <
> vincent.gromakow...@gmail.com
> >:
>
>> tx
>>
>> 2017-02-10 10:01 GMT+01:00 Benjamin Roth > >:
>>
>>> you could write a custom trigger that logs access to specific CFs. But
>>> be aware that this may have a big performance impact.
>>>
>>> 2017-02-10 9:58 GMT+01:00 vincent gromakowski <
>>> vincent.gromakow...@gmail.com
>>> >:
>>>
 GDPR compliancy...we need to trace user activity on personal data.
 Maybe there is another way ?

 2017-02-10 9:46 GMT+01:00 Benjamin Roth >:

> On a cluster with just a little bit load, that would cause zillions of
> petabytes of logs (just roughly ;)). I don't think this is viable.
> There are many many JMX metrics on an aggregated level. But none per
> authed used.
> What exactly do you want to find out? Is it for debugging purposes?
>
>
> 2017-02-10 9:42 GMT+01:00 vincent gromakowski <
> vincent.gromakow...@gmail.com
> >:
>
>> Hi all,
>> Is there any way to trace user activity at the server level to see
>> which user is accessing which data ? Do you thin it would be simple to
>> implement ?
>> Tx
>>
>
>
>
> --
> Benjamin Roth
> Prokurist
>
> Jaumo GmbH · www.jaumo.com
> Wehrstraße 46 · 73035 Göppingen · Germany
> Phone +49 7161 304880-6 <+49%207161%203048806> · Fax +49 7161 304880-1
> <+49%207161%203048801>
> AG Ulm · HRB 731058 · Managing Director: Jens Kammerer
>


>>>
>>>
>>> --
>>> Benjamin Roth
>>> Prokurist
>>>
>>> Jaumo GmbH · www.jaumo.com
>>> Wehrstraße 46 · 73035 Göppingen · Germany
>>> Phone +49 7161 304880-6 <+49%207161%203048806> · Fax +49 7161 304880-1
>>> <+49%207161%203048801>
>>> AG Ulm · HRB 731058 · Managing Director: Jens Kammerer
>>>
>>
>>
>
>
> --
> Benjamin Roth
> Prokurist
>
> Jaumo GmbH · www.jaumo.com
> Wehrstraße 46 · 73035 Göppingen · Germany
> Phone +49 7161 304880-6 · Fax +49 7161 304880-1
> AG Ulm · HRB 731058 · Managing Director: Jens Kammerer
>


-- 
Sorry this was sent from mobile. Will do less grammar and spell check than
usual.

Re: cassandra user request log

[Benjamin Roth]

If you want to audit write operations only, you could maybe use CDC, this
is a quite new feature in 3.x (I think it was introduced in 3.9 or 3.10)

2017-02-10 10:10 GMT+01:00 vincent gromakowski <
vincent.gromakow...@gmail.com>:

> tx
>
> 2017-02-10 10:01 GMT+01:00 Benjamin Roth :
>
>> you could write a custom trigger that logs access to specific CFs. But be
>> aware that this may have a big performance impact.
>>
>> 2017-02-10 9:58 GMT+01:00 vincent gromakowski <
>> vincent.gromakow...@gmail.com>:
>>
>>> GDPR compliancy...we need to trace user activity on personal data. Maybe
>>> there is another way ?
>>>
>>> 2017-02-10 9:46 GMT+01:00 Benjamin Roth :
>>>
 On a cluster with just a little bit load, that would cause zillions of
 petabytes of logs (just roughly ;)). I don't think this is viable.
 There are many many JMX metrics on an aggregated level. But none per
 authed used.
 What exactly do you want to find out? Is it for debugging purposes?


 2017-02-10 9:42 GMT+01:00 vincent gromakowski <
 vincent.gromakow...@gmail.com>:

> Hi all,
> Is there any way to trace user activity at the server level to see
> which user is accessing which data ? Do you thin it would be simple to
> implement ?
> Tx
>



 --
 Benjamin Roth
 Prokurist

 Jaumo GmbH · www.jaumo.com
 Wehrstraße 46 · 73035 Göppingen · Germany
 Phone +49 7161 304880-6 <+49%207161%203048806> · Fax +49 7161 304880-1
 <+49%207161%203048801>
 AG Ulm · HRB 731058 · Managing Director: Jens Kammerer

>>>
>>>
>>
>>
>> --
>> Benjamin Roth
>> Prokurist
>>
>> Jaumo GmbH · www.jaumo.com
>> Wehrstraße 46 · 73035 Göppingen · Germany
>> Phone +49 7161 304880-6 <+49%207161%203048806> · Fax +49 7161 304880-1
>> <+49%207161%203048801>
>> AG Ulm · HRB 731058 · Managing Director: Jens Kammerer
>>
>
>


-- 
Benjamin Roth
Prokurist

Jaumo GmbH · www.jaumo.com
Wehrstraße 46 · 73035 Göppingen · Germany
Phone +49 7161 304880-6 · Fax +49 7161 304880-1
AG Ulm · HRB 731058 · Managing Director: Jens Kammerer

Re: cassandra user request log

[vincent gromakowski]

tx

2017-02-10 10:01 GMT+01:00 Benjamin Roth :

> you could write a custom trigger that logs access to specific CFs. But be
> aware that this may have a big performance impact.
>
> 2017-02-10 9:58 GMT+01:00 vincent gromakowski <
> vincent.gromakow...@gmail.com>:
>
>> GDPR compliancy...we need to trace user activity on personal data. Maybe
>> there is another way ?
>>
>> 2017-02-10 9:46 GMT+01:00 Benjamin Roth :
>>
>>> On a cluster with just a little bit load, that would cause zillions of
>>> petabytes of logs (just roughly ;)). I don't think this is viable.
>>> There are many many JMX metrics on an aggregated level. But none per
>>> authed used.
>>> What exactly do you want to find out? Is it for debugging purposes?
>>>
>>>
>>> 2017-02-10 9:42 GMT+01:00 vincent gromakowski <
>>> vincent.gromakow...@gmail.com>:
>>>
 Hi all,
 Is there any way to trace user activity at the server level to see
 which user is accessing which data ? Do you thin it would be simple to
 implement ?
 Tx

>>>
>>>
>>>
>>> --
>>> Benjamin Roth
>>> Prokurist
>>>
>>> Jaumo GmbH · www.jaumo.com
>>> Wehrstraße 46 · 73035 Göppingen · Germany
>>> Phone +49 7161 304880-6 <+49%207161%203048806> · Fax +49 7161 304880-1
>>> <+49%207161%203048801>
>>> AG Ulm · HRB 731058 · Managing Director: Jens Kammerer
>>>
>>
>>
>
>
> --
> Benjamin Roth
> Prokurist
>
> Jaumo GmbH · www.jaumo.com
> Wehrstraße 46 · 73035 Göppingen · Germany
> Phone +49 7161 304880-6 <+49%207161%203048806> · Fax +49 7161 304880-1
> <+49%207161%203048801>
> AG Ulm · HRB 731058 · Managing Director: Jens Kammerer
>

Re: cassandra user request log

[Benjamin Roth]

you could write a custom trigger that logs access to specific CFs. But be
aware that this may have a big performance impact.

2017-02-10 9:58 GMT+01:00 vincent gromakowski :

> GDPR compliancy...we need to trace user activity on personal data. Maybe
> there is another way ?
>
> 2017-02-10 9:46 GMT+01:00 Benjamin Roth :
>
>> On a cluster with just a little bit load, that would cause zillions of
>> petabytes of logs (just roughly ;)). I don't think this is viable.
>> There are many many JMX metrics on an aggregated level. But none per
>> authed used.
>> What exactly do you want to find out? Is it for debugging purposes?
>>
>>
>> 2017-02-10 9:42 GMT+01:00 vincent gromakowski <
>> vincent.gromakow...@gmail.com>:
>>
>>> Hi all,
>>> Is there any way to trace user activity at the server level to see which
>>> user is accessing which data ? Do you thin it would be simple to implement ?
>>> Tx
>>>
>>
>>
>>
>> --
>> Benjamin Roth
>> Prokurist
>>
>> Jaumo GmbH · www.jaumo.com
>> Wehrstraße 46 · 73035 Göppingen · Germany
>> Phone +49 7161 304880-6 <+49%207161%203048806> · Fax +49 7161 304880-1
>> <+49%207161%203048801>
>> AG Ulm · HRB 731058 · Managing Director: Jens Kammerer
>>
>
>


-- 
Benjamin Roth
Prokurist

Jaumo GmbH · www.jaumo.com
Wehrstraße 46 · 73035 Göppingen · Germany
Phone +49 7161 304880-6 · Fax +49 7161 304880-1
AG Ulm · HRB 731058 · Managing Director: Jens Kammerer

Re: cassandra user request log

[vincent gromakowski]

GDPR compliancy...we need to trace user activity on personal data. Maybe
there is another way ?

2017-02-10 9:46 GMT+01:00 Benjamin Roth :

> On a cluster with just a little bit load, that would cause zillions of
> petabytes of logs (just roughly ;)). I don't think this is viable.
> There are many many JMX metrics on an aggregated level. But none per
> authed used.
> What exactly do you want to find out? Is it for debugging purposes?
>
>
> 2017-02-10 9:42 GMT+01:00 vincent gromakowski <
> vincent.gromakow...@gmail.com>:
>
>> Hi all,
>> Is there any way to trace user activity at the server level to see which
>> user is accessing which data ? Do you thin it would be simple to implement ?
>> Tx
>>
>
>
>
> --
> Benjamin Roth
> Prokurist
>
> Jaumo GmbH · www.jaumo.com
> Wehrstraße 46 · 73035 Göppingen · Germany
> Phone +49 7161 304880-6 <+49%207161%203048806> · Fax +49 7161 304880-1
> <+49%207161%203048801>
> AG Ulm · HRB 731058 · Managing Director: Jens Kammerer
>

Re: cassandra user request log

[Benjamin Roth]

On a cluster with just a little bit load, that would cause zillions of
petabytes of logs (just roughly ;)). I don't think this is viable.
There are many many JMX metrics on an aggregated level. But none per authed
used.
What exactly do you want to find out? Is it for debugging purposes?


2017-02-10 9:42 GMT+01:00 vincent gromakowski :

> Hi all,
> Is there any way to trace user activity at the server level to see which
> user is accessing which data ? Do you thin it would be simple to implement ?
> Tx
>



-- 
Benjamin Roth
Prokurist

Jaumo GmbH · www.jaumo.com
Wehrstraße 46 · 73035 Göppingen · Germany
Phone +49 7161 304880-6 · Fax +49 7161 304880-1
AG Ulm · HRB 731058 · Managing Director: Jens Kammerer