Re: Error in show()

2018-09-08 Thread Prakash Joshi
Pls checke the specific ERORR lines of the text file . Chaces are are few Columns are not properly delimited in specific rows. Regards Prakash On Fri, Sep 7, 2018, 3:41 AM dimitris plakas wrote: > Hello everyone, I am new in Pyspark and i am facing an issue. Let me > explain what exactly is

Re: Spark Dataframe and HIVE

2018-02-09 Thread Prakash Joshi
Ravi, Can you send the result of Show create table your_table_name Thanks Prakash On Feb 9, 2018 8:20 PM, "☼ R Nair (रविशंकर नायर)" < ravishankar.n...@gmail.com> wrote: > All, > > It has been three days continuously I am on this issue. Not getting any > clue. > > Environment: Spark 2.2.x, all

Re: Reading Hive RCFiles?

2018-01-20 Thread Prakash Joshi
If it's simply reading the files from source in HDFS then we have an option of sc.hadoopFile in spark API Not sure if Spark SQL provides direct method to read On Jan 18, 2018 9:32 PM, "Michael Segel" wrote: > No idea on how that last line of garbage got in the