hi all,
i noticed a weird behavior to when spark parses nested json with schema
conflict.
i also just noticed that spark "fixed" this in the most recent release
3.5.0 but since i'm working with AWS services being:
* EMR 6: spark 3.3.* spark3.4.*
* Glue 3: spark3.1.1
* Glue 4: spark 3.3.0
secure (no
>> need for static credentials, automatically renew permissions in shorter
>> time without any specific configuration in Spark).
>>
>> Have you checked with AWS support?
>>
>> Am 22.10.2023 um 21:14 schrieb Carlos Aguni :
>>
>>
>&
hi all,
i've a scenario where I need to assume a cross account role to have S3 bucket
access.
the problem is that this role only allows for 1h time span (no negotiation).
that said.
does anyone know a way to tell spark to automatically renew the token
or to dinamically renew the token on each
