Hi, Spark is a query tool. It stores data in HDFS or Hive database or anything else but does not have its own generic database
nulls values and foreign key constraint belong to the domain of databases. What is exactly the nature of your requirements? Do you want to use Spark tool to look at the DDL and relationship in the underlying storage layer? HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com On 5 May 2016 at 11:51, Divya Gehlot <divya.htco...@gmail.com> wrote: > Hi, > > Is there any package or project in Spark/scala which supports Data Quality > check? > For instance checking null values , foreign key constraint > > Would really appreciate ,if somebody has already done it and happy to > share or has any open source package . > > > Thanks, > Divya >
