using replace function

2016-12-11 Thread Hitesh Goyal
mpleFunctionRegistry$$anonfun$2.apply(FunctionRegistry.scala:65) Please specify how can I do this. Regards, Hitesh Goyal Simpli5d Technologies Cont No.: 9996588220

reading data from s3

2016-12-08 Thread Hitesh Goyal
; d1.printSchema(); d1.show(); But it is not registering the text file as a temp table so that I can make SQL queries on that. Can't I do this on a text file ?? Or if I can, suggest any way to do. Like if I try to do it by JSON file, it is successful. Regards, Hitesh Go

time to run Spark SQL query

2016-11-28 Thread Hitesh Goyal
) dataframe.select(column_name).where(column_condition); Now there is a question arising in my mind that which query would take more time to execute if I run both on the same dataset. Or both would execute in the same time duration. Please suggest your answer. Regards, Hitesh Goyal Simpli5d

RE: if conditions

2016-11-27 Thread Hitesh Goyal
herwise("unknown"))) .show ++--++ |name|genderCode|genderString| ++--++ | bob| 1|male| |lucy| 2| female| | pat| 3| unknown| ++--++ On Sun, Nov 27, 2016 at 10:45 PM, Hitesh Goyal <

if conditions

2016-11-27 Thread Hitesh Goyal
that. Regards, Hitesh Goyal Simpli5d Technologies Cont No.: 9996588220

spark sql on json

2016-09-29 Thread Hitesh Goyal
Hi team, I have a json document. I want to put spark SQL to it. Can you please send me an example app built in JAVA so that I would be able to put spark sql queries on my data. Regards, Hitesh Goyal Simpli5d Technologies Cont No.: 9996588220

Trying to fetch S3 data

2016-09-27 Thread Hitesh Goyal
how can I retrieve the data buckets stored in S3. Regards, Hitesh Goyal Simpli5d Technologies Cont No.: 9996588220

Access Amazon s3 data

2016-09-26 Thread Hitesh Goyal
Hi team, I have data in the amazon s3. I want to access the data using apache spark application. I am new to it. Please tell me how can i make application in java so that i can be able to apply spark sql queries on the s3. -Hitesh Goyal