Re: Convert camelCase to snake_case when saving Dataframe/Dataset to parquet?

[Mike Wheeler]

Cool. Thanks a lot in advance.

On Mon, May 22, 2017 at 2:12 PM, Bryan Jeffrey 
wrote:

> Mike,
>
> I have code to do that. I'll share it tomorrow.
>
> Get Outlook for Android 
>
>
>
>
> On Mon, May 22, 2017 at 4:53 PM -0400, "Mike Wheeler" <
> rotationsymmetr...@gmail.com> wrote:
>
> Hi Spark User,
>>
>> For Scala case class, we usually use camelCase (carType) for member
>> fields. However, many data system use snake_case (car_type) for column
>> names. When saving a Dataset of case class to parquet, is there any way to
>> automatically convert camelCase to snake_case (carType -> car_type)?
>>
>> Thanks,
>>
>> Mike
>>
>>
>>

Re: Convert camelCase to snake_case when saving Dataframe/Dataset to parquet?

[Bryan Jeffrey]

Mike, 




I have code to do that. I'll share it tomorrow. 




Get Outlook for Android







On Mon, May 22, 2017 at 4:53 PM -0400, "Mike Wheeler" 
 wrote:










Hi Spark User,
For Scala case class, we usually use camelCase (carType) for member fields. 
However, many data system use snake_case (car_type) for column names. When 
saving a Dataset of case class to parquet, is there any way to automatically 
convert camelCase to snake_case (carType -> car_type)? 
Thanks,
Mike

Convert camelCase to snake_case when saving Dataframe/Dataset to parquet?

[Mike Wheeler]

Hi Spark User,

For Scala case class, we usually use camelCase (carType) for member fields.
However, many data system use snake_case (car_type) for column names. When
saving a Dataset of case class to parquet, is there any way to
automatically convert camelCase to snake_case (carType -> car_type)?

Thanks,

Mike