Re: spark architecture question -- Pleas Read

2017-01-28 Thread Sachin Naik
n, I would be happy to chat with you. I built some products in this space that extensively used connection pooling over ODBC/JDBC. Happy to chat if you need more information. -Sachin Naik >>Hard to tell. Can you give more insights >>on what you try to achieve and >>what the

Re: Design patterns for Spark implementation

2016-12-08 Thread Sachin Naik
Not sure if you are aware of these 1) Edx/Berkely/Databricks has three Spark related certifications. Might be a good start. 2) Fair understanding of scala/distributed collection patterns to better appreciate the internals of Spark. Coursera has three scala courses. I know there are other

Re: NO Cygwin Support in bin/spark-class in Spark 1.4.0

2015-07-28 Thread Sachin Naik
I agree with Sean - using virtual box on windows and using linux vm is a lot easier than trying to circumvent the cygwin oddities. a lot of functionality might not work in cygwin and you will end up trying to do back patches. Unless there is a compelling reason - cygwin support seems not