Re: Is there a plan for Feature like this in C* ?

[Justin Cameron]

Sorry - you'd need a source connector, not the sink.

On Tue, 3 Jul 2018 at 04:24 Justin Cameron  wrote:

> Yeah, if you're using Kafka Connect you could use the Cassandra sink
> connector
>
> On Tue, 3 Jul 2018 at 02:37 Jeff Jirsa  wrote:
>
>> Its a stable API - the project doesn’t ship a Kafka connector but
>> certainly people have written them
>>
>>
>> --
>> Jeff Jirsa
>>
>>
>> On Jul 2, 2018, at 6:50 PM, Kant Kodali  wrote:
>>
>> Hi Justin,
>>
>> Thanks, Looks like a very early stage feature and no integration with
>> Kafka yet I suppose.
>>
>> Thanks!
>>
>> On Mon, Jul 2, 2018 at 6:24 PM, Justin Cameron 
>> wrote:
>>
>>> yes, take a look at
>>> http://cassandra.apache.org/doc/latest/operating/cdc.html
>>>
>>> On Tue, 3 Jul 2018 at 01:20 Kant Kodali  wrote:
>>>
 https://www.cockroachlabs.com/docs/v2.1/change-data-capture.html

>>> --
>>>
>>>
>>> *Justin Cameron*Senior Software Engineer
>>>
>>>
>>> 
>>>
>>>
>>> This email has been sent on behalf of Instaclustr Pty. Limited
>>> (Australia) and Instaclustr Inc (USA).
>>>
>>> This email and any attachments may contain confidential and legally
>>> privileged information.  If you are not the intended recipient, do not copy
>>> or disclose its content, but please reply to this email immediately and
>>> highlight the error to the sender and then immediately delete the message.
>>>
>>
>> --
>
>
> *Justin Cameron*Senior Software Engineer
>
>
> 
>
>
> This email has been sent on behalf of Instaclustr Pty. Limited (Australia)
> and Instaclustr Inc (USA).
>
> This email and any attachments may contain confidential and legally
> privileged information.  If you are not the intended recipient, do not copy
> or disclose its content, but please reply to this email immediately and
> highlight the error to the sender and then immediately delete the message.
>
-- 


*Justin Cameron*Senior Software Engineer





This email has been sent on behalf of Instaclustr Pty. Limited (Australia)
and Instaclustr Inc (USA).

This email and any attachments may contain confidential and legally
privileged information.  If you are not the intended recipient, do not copy
or disclose its content, but please reply to this email immediately and
highlight the error to the sender and then immediately delete the message.

Re: Is there a plan for Feature like this in C* ?

[Justin Cameron]

Yeah, if you're using Kafka Connect you could use the Cassandra sink
connector

On Tue, 3 Jul 2018 at 02:37 Jeff Jirsa  wrote:

> Its a stable API - the project doesn’t ship a Kafka connector but
> certainly people have written them
>
>
> --
> Jeff Jirsa
>
>
> On Jul 2, 2018, at 6:50 PM, Kant Kodali  wrote:
>
> Hi Justin,
>
> Thanks, Looks like a very early stage feature and no integration with
> Kafka yet I suppose.
>
> Thanks!
>
> On Mon, Jul 2, 2018 at 6:24 PM, Justin Cameron 
> wrote:
>
>> yes, take a look at
>> http://cassandra.apache.org/doc/latest/operating/cdc.html
>>
>> On Tue, 3 Jul 2018 at 01:20 Kant Kodali  wrote:
>>
>>> https://www.cockroachlabs.com/docs/v2.1/change-data-capture.html
>>>
>> --
>>
>>
>> *Justin Cameron*Senior Software Engineer
>>
>>
>> 
>>
>>
>> This email has been sent on behalf of Instaclustr Pty. Limited
>> (Australia) and Instaclustr Inc (USA).
>>
>> This email and any attachments may contain confidential and legally
>> privileged information.  If you are not the intended recipient, do not copy
>> or disclose its content, but please reply to this email immediately and
>> highlight the error to the sender and then immediately delete the message.
>>
>
> --


*Justin Cameron*Senior Software Engineer





This email has been sent on behalf of Instaclustr Pty. Limited (Australia)
and Instaclustr Inc (USA).

This email and any attachments may contain confidential and legally
privileged information.  If you are not the intended recipient, do not copy
or disclose its content, but please reply to this email immediately and
highlight the error to the sender and then immediately delete the message.

Re: Is there a plan for Feature like this in C* ?

[Jeff Jirsa]

Its a stable API - the project doesn’t ship a Kafka connector but certainly 
people have written them

-- 
Jeff Jirsa


> On Jul 2, 2018, at 6:50 PM, Kant Kodali  wrote:
> 
> Hi Justin,
> 
> Thanks, Looks like a very early stage feature and no integration with Kafka 
> yet I suppose.
> 
> Thanks!
> 
>> On Mon, Jul 2, 2018 at 6:24 PM, Justin Cameron  
>> wrote:
>> yes, take a look at http://cassandra.apache.org/doc/latest/operating/cdc.html
>> 
>>> On Tue, 3 Jul 2018 at 01:20 Kant Kodali  wrote:
>>> https://www.cockroachlabs.com/docs/v2.1/change-data-capture.html
>> -- 
>> Justin Cameron
>> Senior Software Engineer
>> 
>> 
>> 
>> 
>> 
>> 
>> This email has been sent on behalf of Instaclustr Pty. Limited (Australia) 
>> and Instaclustr Inc (USA).
>> 
>> This email and any attachments may contain confidential and legally 
>> privileged information.  If you are not the intended recipient, do not copy 
>> or disclose its content, but please reply to this email immediately and 
>> highlight the error to the sender and then immediately delete the message.
>> 
> 

Re: Is there a plan for Feature like this in C* ?

[Kant Kodali]

Hi Justin,

Thanks, Looks like a very early stage feature and no integration with Kafka
yet I suppose.

Thanks!

On Mon, Jul 2, 2018 at 6:24 PM, Justin Cameron 
wrote:

> yes, take a look at http://cassandra.apache.org/
> doc/latest/operating/cdc.html
>
> On Tue, 3 Jul 2018 at 01:20 Kant Kodali  wrote:
>
>> https://www.cockroachlabs.com/docs/v2.1/change-data-capture.html
>>
> --
>
>
> *Justin Cameron*Senior Software Engineer
>
>
> 
>
>
> This email has been sent on behalf of Instaclustr Pty. Limited (Australia)
> and Instaclustr Inc (USA).
>
> This email and any attachments may contain confidential and legally
> privileged information.  If you are not the intended recipient, do not copy
> or disclose its content, but please reply to this email immediately and
> highlight the error to the sender and then immediately delete the message.
>

Re: Is there a plan for Feature like this in C* ?

[Justin Cameron]

yes, take a look at
http://cassandra.apache.org/doc/latest/operating/cdc.html

On Tue, 3 Jul 2018 at 01:20 Kant Kodali  wrote:

> https://www.cockroachlabs.com/docs/v2.1/change-data-capture.html
>
-- 


*Justin Cameron*Senior Software Engineer





This email has been sent on behalf of Instaclustr Pty. Limited (Australia)
and Instaclustr Inc (USA).

This email and any attachments may contain confidential and legally
privileged information.  If you are not the intended recipient, do not copy
or disclose its content, but please reply to this email immediately and
highlight the error to the sender and then immediately delete the message.

Is there a plan for Feature like this in C* ?

[Kant Kodali]

https://www.cockroachlabs.com/docs/v2.1/change-data-capture.html

Resources for Monitoring Cassandra, Spark, Solr

[Rahul Singh]

Folks,

We often get questions on monitoring here so I assembled this post with 
articles from those in the community as well as links to the component tools to 
give folks a more comprehensive listing.

https://blog.anant.us/resources-for-monitoring-datastax-cassandra-spark-solr-performance/

This is a work in progress and I'll update this with screenshots as well as 
with links from other contributors.

--
Rahul Singh
rahul.si...@anant.us

Anant Corporation

Bind keyspace to specific data directory

[Abdul Patel]

Hi

Can we bind or specify while creating keyspace to bind to specific
filesystem or directory for writing?
I see we can split data on multiple filesystems but can we decide while
fileystem a particular keyspace can read and write?

Bind keyspace to specific data directory

[Abdul Patel]

Hi

Can we bind or specify while creating keyspace to bind to specific
filesystem or directory for writing?
I see we can split data on multiple filesystems but can we decide while
fileystem a particular keyspace can read and write?

Re: Problem with dropped mutations

[Jeff Jirsa]

Dropped mutations are load shedding - somethings not happy.

Are you seeing GC pauses? 

What heap size and version?

What memtable settings ?

-- 
Jeff Jirsa


> On Jul 2, 2018, at 12:48 AM, Hannu Kröger  wrote:
> 
> Yes, there are timeouts sometimes but more on the read side. And yes, there 
> are certain data modeling problems which will be soon addressed but we need 
> to keep things steady before we get there. 
> 
> I guess many write timeouts go unnoticed due to consistency level != ALL. 
> 
> Network looks to be working fine. 
> 
> Hannu
> 
>> ZAIDI, ASAD A  kirjoitti 26.6.2018 kello 21.42:
>> 
>> Are you also seeing time-outs on certain Cassandra operations?? If yes, you 
>> may have to tweak *request_timeout parameter in order to get rid of dropped 
>> mutation messages if application data model is not upto mark!
>> 
>> You can also check if network isn't dropping packets (ifconfig  -a tool) +  
>> storage (dstat tool) isn't reporting too slow disks.
>> 
>> Cheers/Asad
>> 
>> 
>> -Original Message-
>> From: Hannu Kröger [mailto:hkro...@gmail.com] 
>> Sent: Tuesday, June 26, 2018 9:49 AM
>> To: user 
>> Subject: Problem with dropped mutations
>> 
>> Hello,
>> 
>> We have a cluster with somewhat heavy load and we are seeing dropped 
>> mutations (variable amount and not all nodes have those).
>> 
>> Are there some clear trigger which cause those? What would be the best 
>> pragmatic approach to start debugging those? We have already added more 
>> memory which seemed to help somewhat but not completely.
>> 
>> Cheers,
>> Hannu
>> 
>> 
>> 
>> -
>> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org
>> For additional commands, e-mail: user-h...@cassandra.apache.org
>> 
>> 
>> -
>> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org
>> For additional commands, e-mail: user-h...@cassandra.apache.org
>> 
> 
> -
> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org
> For additional commands, e-mail: user-h...@cassandra.apache.org
> 

-
To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org
For additional commands, e-mail: user-h...@cassandra.apache.org

Re: Problem with dropped mutations

[Hannu Kröger]

Yes, there are timeouts sometimes but more on the read side. And yes, there are 
certain data modeling problems which will be soon addressed but we need to keep 
things steady before we get there. 

I guess many write timeouts go unnoticed due to consistency level != ALL. 

Network looks to be working fine. 

Hannu

> ZAIDI, ASAD A  kirjoitti 26.6.2018 kello 21.42:
> 
> Are you also seeing time-outs on certain Cassandra operations?? If yes, you 
> may have to tweak *request_timeout parameter in order to get rid of dropped 
> mutation messages if application data model is not upto mark!
> 
> You can also check if network isn't dropping packets (ifconfig  -a tool) +  
> storage (dstat tool) isn't reporting too slow disks.
> 
> Cheers/Asad
> 
> 
> -Original Message-
> From: Hannu Kröger [mailto:hkro...@gmail.com] 
> Sent: Tuesday, June 26, 2018 9:49 AM
> To: user 
> Subject: Problem with dropped mutations
> 
> Hello,
> 
> We have a cluster with somewhat heavy load and we are seeing dropped 
> mutations (variable amount and not all nodes have those).
> 
> Are there some clear trigger which cause those? What would be the best 
> pragmatic approach to start debugging those? We have already added more 
> memory which seemed to help somewhat but not completely.
> 
> Cheers,
> Hannu
> 
> 
> 
> -
> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org
> For additional commands, e-mail: user-h...@cassandra.apache.org
> 
> 
> -
> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org
> For additional commands, e-mail: user-h...@cassandra.apache.org
> 

-
To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org
For additional commands, e-mail: user-h...@cassandra.apache.org