Re: Spark DataFrame Partition Ordering Issue

2018-07-24 Thread Stuart Macdonald
Thanks Nikolay, yes I’ll provide a fix. Stuart. > On 24 Jul 2018, at 10:18, Nikolay Izhikov wrote: > > Hello, Stuart. > > I'm able to reproduce your issue > > So I've created the ticket for it - > https://issues.apache.org/jira/browse/IGNITE-9063 > > Do you want to provide a fix? > > В Пт, 20/0

Re: Spark DataFrame Partition Ordering Issue

2018-07-24 Thread Nikolay Izhikov
Hello, Stuart. I'm able to reproduce your issue So I've created the ticket for it - https://issues.apache.org/jira/browse/IGNITE-9063 Do you want to provide a fix? В Пт, 20/07/2018 в 19:37 +0300, Nikolay Izhikov пишет: > Hello, Stuart. > > I will investigate this issue and return to you in a

Re: Spark DataFrame Partition Ordering Issue

2018-07-20 Thread Nikolay Izhikov
Hello, Stuart. I will investigate this issue and return to you in a couple days. пт, 20 июля 2018 г., 17:59 Stuart Macdonald : > Ignite Dev Community, > > I’m working with the Ignite 2.4+ Spark SQL DataFrame functionality and > have run into what I believe to be a bug where spark partition infor

Spark DataFrame Partition Ordering Issue

2018-07-20 Thread Stuart Macdonald
Ignite Dev Community, I’m working with the Ignite 2.4+ Spark SQL DataFrame functionality and have run into what I believe to be a bug where spark partition information is incorrect for non-trivial sizes of Ignite clusters. The partition array returned to Spark via org.apache.ignite.spark.i