Re: Parquet divide by zero
Hi Jim, I am sorry, I know about your patch and I will commit it ASAP. Lukas Nalezenec On 28.1.2015 22:28, Jim Carroll wrote: Hello all, I've been hitting a divide by zero error in Parquet though Spark detailed (and fixed) here: https://github.com/apache/incubator-parquet-mr/pull/102 Is anyone else hitting this error? I hit it frequently. It looks like the Parquet team is preparing to release 1.6.0 and, since they have been completely unresponsive, I'm assuming its going to go with this bug (without the fix). Other than the fact that the divide by zero mistake is obvious, perhaps the conditions it occurs are rare and I'm doing something wrong. Has anyone else hit this and if so, have they resolved it? Thanks Jim -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Parquet-divide-by-zero-tp21406.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: Parquet divide by zero
Answered my own questions seconds later: these aren't doubles, so you don't get NaN, you get an Exception. Right. On Wed, Jan 28, 2015 at 9:35 PM, Sean Owen wrote: > It looks like it's just a problem with the log message? is it actually > causing a problem in Parquet / Spark? but yeah seems like an easy fix. > > On Wed, Jan 28, 2015 at 9:28 PM, Jim Carroll wrote: >> Hello all, >> >> I've been hitting a divide by zero error in Parquet though Spark detailed >> (and fixed) here: https://github.com/apache/incubator-parquet-mr/pull/102 >> >> Is anyone else hitting this error? I hit it frequently. >> >> It looks like the Parquet team is preparing to release 1.6.0 and, since they >> have been completely unresponsive, I'm assuming its going to go with this >> bug (without the fix). Other than the fact that the divide by zero mistake >> is obvious, perhaps the conditions it occurs are rare and I'm doing >> something wrong. >> >> Has anyone else hit this and if so, have they resolved it? >> >> Thanks >> Jim >> >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/Parquet-divide-by-zero-tp21406.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> - >> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> For additional commands, e-mail: user-h...@spark.apache.org >> - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: Parquet divide by zero
It looks like it's just a problem with the log message? is it actually causing a problem in Parquet / Spark? but yeah seems like an easy fix. On Wed, Jan 28, 2015 at 9:28 PM, Jim Carroll wrote: > Hello all, > > I've been hitting a divide by zero error in Parquet though Spark detailed > (and fixed) here: https://github.com/apache/incubator-parquet-mr/pull/102 > > Is anyone else hitting this error? I hit it frequently. > > It looks like the Parquet team is preparing to release 1.6.0 and, since they > have been completely unresponsive, I'm assuming its going to go with this > bug (without the fix). Other than the fact that the divide by zero mistake > is obvious, perhaps the conditions it occurs are rare and I'm doing > something wrong. > > Has anyone else hit this and if so, have they resolved it? > > Thanks > Jim > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Parquet-divide-by-zero-tp21406.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Parquet divide by zero
Hello all, I've been hitting a divide by zero error in Parquet though Spark detailed (and fixed) here: https://github.com/apache/incubator-parquet-mr/pull/102 Is anyone else hitting this error? I hit it frequently. It looks like the Parquet team is preparing to release 1.6.0 and, since they have been completely unresponsive, I'm assuming its going to go with this bug (without the fix). Other than the fact that the divide by zero mistake is obvious, perhaps the conditions it occurs are rare and I'm doing something wrong. Has anyone else hit this and if so, have they resolved it? Thanks Jim -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Parquet-divide-by-zero-tp21406.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
