Re: Spark Shell issue on HDInsight

Oh ok Denny, great!!! Also, thanks for your effort in resolving my issue. can I ask one more (more open ended) question? We have a requirement where we want to read data from either Blob storage or Hive table, and upsert few records in CosmosDB. One option is run a C# activity on a windows batch

Re: Spark Shell issue on HDInsight

Sorry for the delay, you just did as I'm with the Azure CosmosDB (formerly DocumentDB) team. If you'd like to make it official, why not add an issue to the GitHub repo at https://github.com/Azure/azure-documentdb-spark/issues. HTH! On Thu, May 11, 2017 at 9:08 PM ayan guha

Re: Spark Shell issue on HDInsight

Works for me tooyou are a life-saver :) But the question: should/how we report this to Azure team? On Fri, May 12, 2017 at 10:32 AM, Denny Lee wrote: > I was able to repro your issue when I had downloaded the jars via blob but > when I downloaded them as raw, I was

Re: Spark Shell issue on HDInsight

I was able to repro your issue when I had downloaded the jars via blob but when I downloaded them as raw, I was able to get everything up and running. For example: wget https://github.com/Azure/azure-documentdb-spark/*blob*

Re: Spark Shell issue on HDInsight

Hi Thanks for reply, but unfortunately did not work. I am getting same error. sshuser@ed0-svochd:~/azure-spark-docdb-test$ spark-shell --jars azure-documentdb-spark-0.0.3-SNAPSHOT.jar,azure-documentdb-1.10.0.jar SPARK_MAJOR_VERSION is set to 2, using Spark2 Setting default log level to "WARN".

Re: Spark Shell issue on HDInsight

This appears to be an issue with the Spark to DocumentDB connector, specifically version 0.0.1. Could you run the 0.0.3 version of the jar and see if you're still getting the same error? i.e. spark-shell --master yarn --jars

Spark Shell issue on HDInsight

Hi I am facing an issue while trying to use azure-document-db connector from Microsoft. Instructions/Github . Error while trying to add jar in spark-shell: spark-shell --jars