Hi, I only know about comments which you can add to each column where you
can add these key values.
Thanks.
On Wed, Jun 23, 2021 at 11:31 AM Bode, Meikel, NMA-CFD <
meikel.b...@bertelsmann.de> wrote:
> Hi folks,
>
>
>
> Maybe not the right audience but maybe you came along such an requirement.
Hi folks,
Maybe not the right audience but maybe you came along such an requirement.
Is it possible to define a parquet schema, that contains technical column names
and a list of translations for a certain column name into different languages?
I give an example:
Technical: "custnr" would
will return an unexpected result for my
use cases. Is there any way I can skip using the parquet metadata and enforce
the filter for every query?
Thank you,
Best,
Gary
Hey Guys,
Do you know any possible way to refresh parquet tables that will clear
cached metadata for all users in Spark Thrift Server. Or can I somehow stop
caching metadata at all for parquet tables? Seems like
spark.sql.parquet.cacheMetadata doesnt work anymore.
Thanks
Tom
--
Tomasz Krol
Hi,
How can we disable writing _common_metdata while saving Data Frame in
parquet format in PySpark. I tried to set the property using below command
but didn't helped.
sparkContext._jsc.hadoopConfiguration().set("parquet.enable.summary-metadata",
"false")
Thanks,
Bijay
