by Twitter.
Regards,
Vasu C
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-pass-parameters-to-a-spark-jobserver-Scala-class-tp21671p21727.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
Hi Sasi,
Forgot to mention job server uses Typesafe Config library. The input is
JSON, you can find syntax in below link
https://github.com/typesafehub/config
Regards,
Vasu C
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-pass-parameters
sqlContext = new org.apache.spark.sql.SQLContext(sc)
val jsonRdd = sqlContext.jsonRDD(results)
val parquetTable = sqlContext.parquetFile(parquetFilePath)
parquetTable.registerTempTable(tableName)
jsonRdd.insertInto(tableName)
Regards,
Vasu C
://github.com/spark-jobserver/spark-jobserver
Regards,
Vasu C
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-pass-parameters-to-a-spark-jobserver-Scala-class-tp21671p21692.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
Hi Arthur,
May I know what is the solution., I have similar requirements.
Regards,
Vasu C
On Sun, Oct 26, 2014 at 12:09 PM, arthur.hk.c...@gmail.com
arthur.hk.c...@gmail.com wrote:
Hi,
I have already found the way about how to “insert into HIVE_TABLE values
(…..)
Regards
Arthur
)
at
scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Regards,
Vasu C
On Thu, Nov 6, 2014 at 1:14 PM, Sean Owen so...@cloudera.com wrote:
You didn't say what isn't serializable or where the exception occurs,
but, is it the same as this issue?
https://issues.apache.org/jira/browse/SPARK-4196
On Thu, Nov 6
the computation
context.awaitTermination();
}
}
Regards,
Vasu C
On Thu, Nov 6, 2014 at 1:33 PM, Sean Owen so...@cloudera.com wrote:
No, not the same thing then. This just means you accidentally have a
reference to the unserializable enclosing test class in your code.
Just make sure
Dear All,
I am getting java.io.NotSerializableException for below code. if
jssc.checkpoint(HDFS_CHECKPOINT_DIR); is blocked there is not exception
Please help
JavaStreamingContextFactory contextFactory = new
JavaStreamingContextFactory() {
@Override
public JavaStreamingContext create() {
