Jerrick, Let me ask a few clarification questions. What is the version of Spark? Is the table a hive table? What is the format of the table? Is the table partitioned?
Thanks, Yin On Sun, Jul 12, 2015 at 6:01 PM, ayan guha <guha.a...@gmail.com> wrote: > Describe computes statistics, so it will try to query the table. The one > you are looking for is df.printSchema() > > On Mon, Jul 13, 2015 at 10:03 AM, Jerrick Hoang <jerrickho...@gmail.com> > wrote: > >> Hi all, >> >> I'm new to Spark and this question may be trivial or has already been >> answered, but when I do a 'describe table' from SparkSQL CLI it seems to >> try looking at all records at the table (which takes a really long time for >> big table) instead of just giving me the metadata of the table. Would >> appreciate if someone can give me some pointers, thanks! >> > > > > -- > Best Regards, > Ayan Guha >
