Re: Spark Druid Ingestion

2018-07-02 Thread gosoy
Hi Nayan, Were you able to resolve this issue? Is it because of some file/folder permission problems? -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ - To unsubscribe e-mail:

Re: Spark Druid Ingestion

2018-03-22 Thread nayan sharma
Hey Jorge, Thanks for responding. Can you elaborate on the user permission part ? HDFS or local ? As of now, hdfs path -> hdfs://n2pl-pa-hdn220.xxx.xxx:8020/user/yarn/.sparkStaging/application_1521457397747_0013/__spark_libs__8247917347016008883.zip already has complete access for yarn

Spark Druid Ingestion

2018-03-22 Thread nayan sharma
Hi All,As druid uses Hadoop MapReduce to ingest batch data but I am trying spark for ingesting data into druid taking reference from https://github.com/metamx/druid-spark-batchBut we are stuck at the following error.Application Log:—>2018-03-20T07:54:28,782 INFO [task-runner-0-priority-0]

Re: Spark Druid Ingestion

2018-03-22 Thread Jorge Machado
Seems to me permissions problems ! Can you check your user / folder permissions ? Jorge Machado > On 22 Mar 2018, at 08:21, nayan sharma wrote: > > Hi All, > As druid uses Hadoop MapReduce to ingest batch data but I am trying spark for > ingesting data into