Re: Write each group to its own file

2017-10-23 Thread Rodrigo Lazoti
; Piotrek > > > On 11 Oct 2017, at 17:47, rlazoti <rodrigolaz...@gmail.com> wrote: > > > > Hi, > > > > Is there a way to write each group to its own file using the Dataset api > > (Batch)? > > > > For example, lets use the following class: >

Re: Write each group to its own file

2017-10-12 Thread Piotr Nowojski
of categories is very high. Piotrek > On 11 Oct 2017, at 17:47, rlazoti <rodrigolaz...@gmail.com> wrote: > > Hi, > > Is there a way to write each group to its own file using the Dataset api > (Batch)? > > For example, lets use the following class: > > case class Pr

Write each group to its own file

2017-10-11 Thread rlazoti
Hi, Is there a way to write each group to its own file using the Dataset api (Batch)? For example, lets use the following class: case class Product(name: String, category: String) And the following Dataset: val products = env.fromElements(Product("i7", "cpu"), Product(&

Write each group to its own file

2017-10-11 Thread rlazoti
Hi, Is there a way to write each group to its own file using the Dataset api (Batch)? For example, lets use the following class: And the following Dataset: So in this example my output should be these 3 files: - cpu.csv i7, cpu R5, cpu - gpu.csv gtx1080, gpu vega64, gpu - ssd.csv