Re: Convert camelCase to snake_case when saving Dataframe/Dataset to parquet?

2017-05-22 Thread Mike Wheeler
Cool. Thanks a lot in advance. On Mon, May 22, 2017 at 2:12 PM, Bryan Jeffrey wrote: > Mike, > > I have code to do that. I'll share it tomorrow. > > Get Outlook for Android > > > > > On Mon, May 22, 2017 at 4:53 PM -0400, "Mike Wheeler" < > rotationsymmetr...@gmail.com> w

Re: Convert camelCase to snake_case when saving Dataframe/Dataset to parquet?

2017-05-22 Thread Bryan Jeffrey
Mike, I have code to do that. I'll share it tomorrow. Get Outlook for Android On Mon, May 22, 2017 at 4:53 PM -0400, "Mike Wheeler" wrote: Hi Spark User, For Scala case class, we usually use camelCase (carType) for member fields. However, many data system use snake_cas

Convert camelCase to snake_case when saving Dataframe/Dataset to parquet?

2017-05-22 Thread Mike Wheeler
Hi Spark User, For Scala case class, we usually use camelCase (carType) for member fields. However, many data system use snake_case (car_type) for column names. When saving a Dataset of case class to parquet, is there any way to automatically convert camelCase to snake_case (carType -> car_type)?