Hi Divya Considering you are able to successfully load both tables testCond and test as data frames. As now taking your case: when you do val condval = testCond.select(“Cond”) //Where Cond is a column name, here condval is a DataFrame.Even if it has one row, it is still a data frame if you want to filter data in data frame (test) according to values in data frame condval, as of what I understand you are trying to do.
the appropriate syntax would be this in java (I am not sure about scala syntax but i am sure its easy to port) DataFrame newDataFrame = test.join(test, test.col(“Cond”).equalTo(condval.col(“Cond”)), “inner”); This would give you rows in test data frame that match the Cond column in condval. Please tell me if that helps. > On Feb 10, 2016, at 9:23 PM, Divya Gehlot <divya.htco...@gmail.com> wrote: > > Hi, > //Loading all the DB Properties > val options1 = Map("url" -> > "jdbc:oracle:thin:@xx.xxx.xxx.xx:1521:dbname","user"->"username","password"->"password","dbtable" > -> "TESTCONDITIONS") > val testCond = sqlContext.load("jdbc",options1 ) > val condval = testCond.select("Cond") > > testCond.show() > val options2 = Map("url" -> > "jdbc:oracle:thin:@xx.xxx.xxx.xx:1521:dbanme","user"->"username","password"->"password","dbtable" > -> "Test") > val test= sqlContext.load("jdbc",options2 ) > test.select.where(condval ) //gives error as cannot convert sql.Column to > Dataframe > > test.select().where(???) > > My TestConditions table has only one row > which looks like year = 1965 and month = ;december' > > Can I convert sql.Column to list and pass ? > I am new Spark and scala. > > > Will really appreciate the help. > > Thanks, > Divya --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org