Re: The main difference use case between orderBY and sort

2016-07-29 Thread Daniel Santana
As far as I know *sort* is just an alias of *orderBy* (or vice-versa) And your last operation is taking longer because you are sorting it twice. -- *Daniel Santana* Senior Software Engineer EVERY*MUNDO* 25 SE 2nd Ave., Suite 900 Miami, FL 33131 USA main:+1 (305) 375-0045 EveryMundo.com <h

Re: Spark Streaming Kinesis Performance Decrease When Cluster Scale Up with More Executors

2016-07-14 Thread Daniel Santana
Are you re-sharding your kinesis stream as well? I had a similar problem and increasing the number of kinesis stream shards solved it. -- *Daniel Santana* Senior Software Engineer EVERY*MUNDO* 25 SE 2nd Ave., Suite 900 Miami, FL 33131 USA main:+1 (305) 375-0045 EveryMundo.com <h