[jira] [Commented] (SPARK-18853) Project (UnaryNode) is way too aggressive in estimating statistics

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749405#comment-15749405 ] Reynold Xin commented on SPARK-18853: - Let's do that separately (I thought about doing it but it

[jira] [Commented] (SPARK-18853) Project (UnaryNode) is way too aggressive in estimating statistics

2016-12-14 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749397#comment-15749397 ] Michael Allman commented on SPARK-18853: [~rxin] [~hvanhovell] Should we move the overridden

[jira] [Commented] (SPARK-18853) Project (UnaryNode) is way too aggressive in estimating statistics

2016-12-14 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748968#comment-15748968 ] Michael Allman commented on SPARK-18853: Yes, nested arrays. > Project (UnaryNode) is way too

[jira] [Commented] (SPARK-18853) Project (UnaryNode) is way too aggressive in estimating statistics

2016-12-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748964#comment-15748964 ] Reynold Xin commented on SPARK-18853: - Can you say more? Are you talking about deeply nested arrays?

[jira] [Commented] (SPARK-18853) Project (UnaryNode) is way too aggressive in estimating statistics

2016-12-14 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748962#comment-15748962 ] Michael Allman commented on SPARK-18853: I'll just add another issue with overestimating the

[jira] [Commented] (SPARK-18853) Project (UnaryNode) is way too aggressive in estimating statistics

2016-12-14 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748961#comment-15748961 ] Michael Allman commented on SPARK-18853: Should we link this to

[jira] [Commented] (SPARK-18853) Project (UnaryNode) is way too aggressive in estimating statistics

2016-12-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746888#comment-15746888 ] Apache Spark commented on SPARK-18853: -- User 'rxin' has created a pull request for this issue: