Hey,
I understand that your empty values in your CSV are "" , if so, try this
option:
*.option("emptyValue", "\"\"")*
Hope it helps
On Thu, 30 Jul 2020 at 08:49, Stephen Coy
wrote:
> Hi there,
>
> I’m trying to import a tab delimited file with:
>
> Dataset catalogData = sparkSession
>
Hi there,
I’m trying to import a tab delimited file with:
Dataset catalogData = sparkSession
.read()
.option("sep", "\t")
.option("header", "true")
.csv(args[0])
.cache();
This works great, except for the fact that any column that is empty is given
the value null, when I need these
