Re: Multiplication on decimals in a dataframe query

2015-12-03 Thread Philip Dodds
190.0| >> |199.5| >> |190.0| >> |256.5| >> |218.5| >> |275.5| >> | 218.5| >> .. >> .. >> >> >> Could it be with the precision? ccing dev list, may be you can open up a >

Re: Multiplication on decimals in a dataframe query

2015-12-03 Thread Philip Dodds
Opened https://issues.apache.org/jira/browse/SPARK-12128 Thanks P On Thu, Dec 3, 2015 at 8:51 AM, Philip Dodds <philip.do...@gmail.com> wrote: > I'll open up a JIRA for it, it appears to work when you use a literal > number but not when it is coming from the same dataframe >

Re: Multiplication on decimals in a dataframe query

2015-12-03 Thread Philip Dodds
Did a little more digging and it appears it was just the way I constructed the Decimal It works if you do val data = Seq.fill(5) { Trade(Decimal(BigDecimal(5),38,20), Decimal(BigDecimal(5),38,20)) } On Thu, Dec 3, 2015 at 8:58 AM, Philip Dodds <philip.do...@gmail.com> wrote: &g

Creating a dataframe with decimals changes the precision and scale

2015-12-03 Thread Philip Dodds
-- Philip Dodds philip.do...@gmail.com @philipdodds

Multiplication on decimals in a dataframe query

2015-11-29 Thread Philip Dodds
8.00...| 0E-18| +++++ Just keen to know what I did wrong? Cheers P -- Philip Dodds