[jira] [Created] (SPARK-1366) The sql function should be consistent between different types of SQLContext

2014-03-31 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1366: --- Summary: The sql function should be consistent between different types of SQLContext Key: SPARK-1366 URL: https://issues.apache.org/jira/browse/SPARK-1366

[jira] [Created] (SPARK-1370) HashJoin should stream one relation

2014-03-31 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1370: --- Summary: HashJoin should stream one relation Key: SPARK-1370 URL: https://issues.apache.org/jira/browse/SPARK-1370 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1374) Python API for running SQL queries

2014-03-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13955502#comment-13955502 ] Michael Armbrust commented on SPARK-1374: - This is dependent on [SPARK-1333]

[jira] [Updated] (SPARK-1364) DataTypes missing from ScalaReflection

2014-04-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1364: Priority: Blocker (was: Major) DataTypes missing from ScalaReflection

[jira] [Updated] (SPARK-1371) HashAggregate should stream tuples and avoid doing an extra count

2014-04-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1371: Priority: Blocker (was: Major) HashAggregate should stream tuples and avoid doing an

[jira] [Commented] (SPARK-1367) NPE when joining Parquet Relations

2014-04-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13956781#comment-13956781 ] Michael Armbrust commented on SPARK-1367: - No, in that commit there is a TODO as

[jira] [Assigned] (SPARK-1367) NPE when joining Parquet Relations

2014-04-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-1367: --- Assignee: Michael Armbrust (was: Andre Schumacher) NPE when joining Parquet

[jira] [Commented] (SPARK-1371) HashAggregate should stream tuples and avoid doing an extra count

2014-04-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13957365#comment-13957365 ] Michael Armbrust commented on SPARK-1371: -

[jira] [Resolved] (SPARK-1372) Expose in-memory columnar caching for tables.

2014-04-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1372. - Resolution: Fixed Expose in-memory columnar caching for tables.

[jira] [Commented] (SPARK-1364) DataTypes missing from ScalaReflection

2014-04-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13957366#comment-13957366 ] Michael Armbrust commented on SPARK-1364: -

[jira] [Updated] (SPARK-1363) Add streaming support for Spark SQL module

2014-04-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1363: Assignee: (was: Michael Armbrust) Add streaming support for Spark SQL module

[jira] [Assigned] (SPARK-1363) Add streaming support for Spark SQL module

2014-04-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-1363: --- Assignee: Michael Armbrust Add streaming support for Spark SQL module

[jira] [Updated] (SPARK-1402) 3 more compression algorithms for in-memory columnar storage

2014-04-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1402: Fix Version/s: 1.0.0 3 more compression algorithms for in-memory columnar storage

[jira] [Updated] (SPARK-1402) 3 more compression algorithms for in-memory columnar storage

2014-04-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1402: Affects Version/s: (was: 1.0.0) 3 more compression algorithms for in-memory columnar

[jira] [Created] (SPARK-1409) Flaky Test: actor input stream test in org.apache.spark.streaming.InputStreamsSuite

2014-04-03 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1409: --- Summary: Flaky Test: actor input stream test in org.apache.spark.streaming.InputStreamsSuite Key: SPARK-1409 URL: https://issues.apache.org/jira/browse/SPARK-1409

[jira] [Commented] (SPARK-1410) Class not found exception with application launched from sbt 0.13.x

2014-04-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13959265#comment-13959265 ] Michael Armbrust commented on SPARK-1410: - I don't understand how the classloader

[jira] [Resolved] (SPARK-1367) NPE when joining Parquet Relations

2014-04-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1367. - Resolution: Fixed NPE when joining Parquet Relations

[jira] [Resolved] (SPARK-1360) Add Timestamp Support

2014-04-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1360. - Resolution: Fixed Add Timestamp Support - Key:

[jira] [Commented] (SPARK-1410) Class not found exception with application launched from sbt 0.13.x

2014-04-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13959501#comment-13959501 ] Michael Armbrust commented on SPARK-1410: - So I haven't tracked down why this is

[jira] [Updated] (SPARK-1412) Disable partial aggregation automatically when reduction factor is low

2014-04-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1412: Priority: Minor (was: Major) Disable partial aggregation automatically when reduction

[jira] [Commented] (SPARK-1366) The sql function should be consistent between different types of SQLContext

2014-04-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13960292#comment-13960292 ] Michael Armbrust commented on SPARK-1366: -

[jira] [Resolved] (SPARK-1366) The sql function should be consistent between different types of SQLContext

2014-04-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1366. - Resolution: Fixed The sql function should be consistent between different types of

[jira] [Created] (SPARK-1424) InsertInto should work on JavaSchemaRDD as well.

2014-04-05 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1424: --- Summary: InsertInto should work on JavaSchemaRDD as well. Key: SPARK-1424 URL: https://issues.apache.org/jira/browse/SPARK-1424 Project: Spark Issue

[jira] [Commented] (SPARK-1374) Python API for running SQL queries

2014-04-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963922#comment-13963922 ] Michael Armbrust commented on SPARK-1374: -

[jira] [Updated] (SPARK-1424) InsertInto should work on JavaSchemaRDD as well.

2014-04-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1424: Fix Version/s: 1.0.0 InsertInto should work on JavaSchemaRDD as well.

[jira] [Commented] (SPARK-1494) Hive Dependencies being checked by MIMA

2014-04-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13969113#comment-13969113 ] Michael Armbrust commented on SPARK-1494: - We could change the object to contain a

[jira] [Commented] (SPARK-1495) support leftsemijoin for sparkSQL

2014-04-15 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13969853#comment-13969853 ] Michael Armbrust commented on SPARK-1495: - This should make adding the new

[jira] [Updated] (SPARK-1368) HiveTableScan is slow

2014-04-15 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1368: Assignee: (was: Cheng Lian) HiveTableScan is slow -

[jira] [Created] (SPARK-1508) Add support for reading from SparkConf

2014-04-15 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1508: --- Summary: Add support for reading from SparkConf Key: SPARK-1508 URL: https://issues.apache.org/jira/browse/SPARK-1508 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-1424) InsertInto should work on JavaSchemaRDD as well.

2014-04-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1424. - Resolution: Fixed InsertInto should work on JavaSchemaRDD as well.

[jira] [Assigned] (SPARK-1571) UnresolvedException when running JavaSparkSQL example

2014-04-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-1571: --- Assignee: Michael Armbrust UnresolvedException when running JavaSparkSQL example

[jira] [Resolved] (SPARK-1571) UnresolvedException when running JavaSparkSQL example

2014-04-23 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1571. - Resolution: Fixed UnresolvedException when running JavaSparkSQL example

[jira] [Commented] (SPARK-1571) UnresolvedException when running JavaSparkSQL example

2014-04-23 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13978991#comment-13978991 ] Michael Armbrust commented on SPARK-1571: - I think this is fixed by

[jira] [Reopened] (SPARK-1494) Hive Dependencies being checked by MIMA

2014-04-24 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reopened SPARK-1494: - Hive Dependencies being checked by MIMA ---

[jira] [Commented] (SPARK-1649) DataType should contain nullable bit

2014-04-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983318#comment-13983318 ] Michael Armbrust commented on SPARK-1649: - Why do you think it would be better to

[jira] [Updated] (SPARK-1649) Figure out Nullability semantics for Array elements and Map values

2014-04-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1649: Summary: Figure out Nullability semantics for Array elements and Map values (was:

[jira] [Commented] (SPARK-1649) Figure out Nullability semantics for Array elements and Map values

2014-04-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984909#comment-13984909 ] Michael Armbrust commented on SPARK-1649: - Oh, I see. I forgot that we would also

[jira] [Resolved] (SPARK-1610) Cast from BooleanType to NumericType should use exact type value.

2014-04-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1610. - Resolution: Fixed Fix Version/s: 1.0.0 Cast from BooleanType to NumericType

[jira] [Commented] (SPARK-1512) improve spark sql to support table with more than 22 fields

2014-04-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984922#comment-13984922 ] Michael Armbrust commented on SPARK-1512: - Now that we have updated the docs to

[jira] [Resolved] (SPARK-1512) improve spark sql to support table with more than 22 fields

2014-04-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1512. - Resolution: Fixed improve spark sql to support table with more than 22 fields

[jira] [Updated] (SPARK-1515) Specialized ColumnTypes for Array, Map and Struct

2014-04-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1515: Labels: compression (was: ) Specialized ColumnTypes for Array, Map and Struct

[jira] [Commented] (SPARK-1373) Compression for In-Memory Columnar storage

2014-04-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984997#comment-13984997 ] Michael Armbrust commented on SPARK-1373: - Note that the code is in a large part

[jira] [Resolved] (SPARK-1661) the result of querying table created with RegexSerDe is all null

2014-04-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1661. - Resolution: Won't Fix the result of querying table created with RegexSerDe is all null

[jira] [Commented] (SPARK-1661) the result of querying table created with RegexSerDe is all null

2014-04-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13985055#comment-13985055 ] Michael Armbrust commented on SPARK-1661: - Thanks for your report. This JIRA is

[jira] [Created] (SPARK-1678) Compression loses repeated values.

2014-04-30 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1678: --- Summary: Compression loses repeated values. Key: SPARK-1678 URL: https://issues.apache.org/jira/browse/SPARK-1678 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-1694) Simplify ColumnBuilder/Accessor class hierarchy

2014-05-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1694: Priority: Minor (was: Major) Simplify ColumnBuilder/Accessor class hierarchy

[jira] [Updated] (SPARK-1726) Tasks that fail to serialize remain in active stages forever.

2014-05-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1726: Attachment: ZombieTask.tiff Tasks that fail to serialize remain in active stages forever.

[jira] [Updated] (SPARK-1726) Tasks that fail to serialize remain in active stages forever.

2014-05-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1726: Assignee: Andrew Or Tasks that fail to serialize remain in active stages forever.

[jira] [Commented] (SPARK-1704) java.lang.AssertionError: assertion failed: No plan for ExplainCommand (Project [*])

2014-05-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13990129#comment-13990129 ] Michael Armbrust commented on SPARK-1704: - Thanks for reporting this. Looks like

[jira] [Created] (SPARK-1732) Support for primitive nulls in SparkSQL

2014-05-05 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1732: --- Summary: Support for primitive nulls in SparkSQL Key: SPARK-1732 URL: https://issues.apache.org/jira/browse/SPARK-1732 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-1788) Upgrade Parquet to 1.4.3

2014-05-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1788: Component/s: SQL Upgrade Parquet to 1.4.3

[jira] [Created] (SPARK-1788) Upgrade Parquet to 1.4.3

2014-05-14 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1788: --- Summary: Upgrade Parquet to 1.4.3 Key: SPARK-1788 URL: https://issues.apache.org/jira/browse/SPARK-1788 Project: Spark Issue Type: Dependency upgrade

[jira] [Resolved] (SPARK-1788) Upgrade Parquet to 1.4.3

2014-05-15 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1788. - Resolution: Fixed Upgrade Parquet to 1.4.3

[jira] [Commented] (SPARK-1836) REPL $outer type mismatch causes lookup() and equals() problems

2014-05-15 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13998312#comment-13998312 ] Michael Armbrust commented on SPARK-1836: - This sounds like it could be related to

[jira] [Resolved] (SPARK-1494) Hive Dependencies being checked by MIMA

2014-05-15 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1494. - Resolution: Fixed Hive Dependencies being checked by MIMA

[jira] [Updated] (SPARK-1487) Support record filtering via predicate pushdown in Parquet

2014-05-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1487: Fix Version/s: (was: 1.1.0) Support record filtering via predicate pushdown in

[jira] [Commented] (SPARK-1826) Some bad head notations in sparksql

2014-05-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13998988#comment-13998988 ] Michael Armbrust commented on SPARK-1826: - Fixed in:

[jira] [Resolved] (SPARK-1826) Some bad head notations in sparksql

2014-05-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1826. - Resolution: Fixed Some bad head notations in sparksql

[jira] [Resolved] (SPARK-1845) Use AllScalaRegistrar for SparkSqlSerializer to register serializers of Scala collections.

2014-05-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1845. - Resolution: Fixed Use AllScalaRegistrar for SparkSqlSerializer to register serializers

[jira] [Updated] (SPARK-1442) Add Window function support

2014-05-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1442: Fix Version/s: 1.1.0 Add Window function support ---

[jira] [Created] (SPARK-1852) SparkSQL Queries with Sorts run before the user asks them to

2014-05-16 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1852: --- Summary: SparkSQL Queries with Sorts run before the user asks them to Key: SPARK-1852 URL: https://issues.apache.org/jira/browse/SPARK-1852 Project: Spark

[jira] [Updated] (SPARK-1368) HiveTableScan is slow

2014-05-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1368: Assignee: Cheng Lian HiveTableScan is slow - Key:

[jira] [Created] (SPARK-1847) Pushdown filters on non-required parquet columns

2014-05-16 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1847: --- Summary: Pushdown filters on non-required parquet columns Key: SPARK-1847 URL: https://issues.apache.org/jira/browse/SPARK-1847 Project: Spark Issue

[jira] [Updated] (SPARK-1487) Support record filtering via predicate pushdown in Parquet

2014-05-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1487: Fix Version/s: 1.1.0 Support record filtering via predicate pushdown in Parquet

[jira] [Commented] (SPARK-1487) Support record filtering via predicate pushdown in Parquet

2014-05-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13999034#comment-13999034 ] Michael Armbrust commented on SPARK-1487: - PR here:

[jira] [Updated] (SPARK-1800) Add broadcast hash join operator

2014-05-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1800: Fix Version/s: 1.1.0 Add broadcast hash join operator

[jira] [Commented] (SPARK-1864) Classpath not correctly sent to executors.

2014-05-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14000587#comment-14000587 ] Michael Armbrust commented on SPARK-1864: -

[jira] [Created] (SPARK-1864) Classpath not correctly sent to executors.

2014-05-16 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1864: --- Summary: Classpath not correctly sent to executors. Key: SPARK-1864 URL: https://issues.apache.org/jira/browse/SPARK-1864 Project: Spark Issue Type:

[jira] [Commented] (SPARK-1836) REPL $outer type mismatch causes lookup() and equals() problems

2014-05-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14011477#comment-14011477 ] Michael Armbrust commented on SPARK-1836: - Yeah I think its likely they are

[jira] [Created] (SPARK-1958) Calling .collect() on a SchemaRDD should call executeCollect() on the underlying query plan.

2014-05-28 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1958: --- Summary: Calling .collect() on a SchemaRDD should call executeCollect() on the underlying query plan. Key: SPARK-1958 URL: https://issues.apache.org/jira/browse/SPARK-1958

[jira] [Updated] (SPARK-1913) Parquet table column pruning error caused by filter pushdown

2014-05-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1913: Assignee: Cheng Lian Parquet table column pruning error caused by filter pushdown

[jira] [Resolved] (SPARK-1913) Parquet table column pruning error caused by filter pushdown

2014-05-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1913. - Resolution: Fixed Parquet table column pruning error caused by filter pushdown

[jira] [Created] (SPARK-1964) Timestamp missing from HiveMetastore types parser

2014-05-29 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-1964: --- Summary: Timestamp missing from HiveMetastore types parser Key: SPARK-1964 URL: https://issues.apache.org/jira/browse/SPARK-1964 Project: Spark Issue

[jira] [Assigned] (SPARK-1964) Timestamp missing from HiveMetastore types parser

2014-05-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-1964: --- Assignee: Michael Armbrust Timestamp missing from HiveMetastore types parser

[jira] [Commented] (SPARK-1964) Timestamp missing from HiveMetastore types parser

2014-05-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14012543#comment-14012543 ] Michael Armbrust commented on SPARK-1964: -

[jira] [Updated] (SPARK-1958) Calling .collect() on a SchemaRDD should call executeCollect() on the underlying query plan.

2014-05-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1958: Assignee: Cheng Lian Calling .collect() on a SchemaRDD should call executeCollect() on

[jira] [Updated] (SPARK-1852) SparkSQL Queries with Sorts run before the user asks them to

2014-05-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1852: Assignee: Cheng Lian SparkSQL Queries with Sorts run before the user asks them to

[jira] [Updated] (SPARK-1947) Child of SumDistinct or Average should be widened to prevent overflows the same as Sum.

2014-05-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1947: Assignee: Takuya Ueshin Child of SumDistinct or Average should be widened to prevent

[jira] [Updated] (SPARK-1968) SQL commands for caching tables

2014-05-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1968: Component/s: SQL SQL commands for caching tables ---

[jira] [Updated] (SPARK-1968) SQL commands for caching tables

2014-05-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1968: Priority: Blocker (was: Critical) SQL commands for caching tables

[jira] [Resolved] (SPARK-1947) Child of SumDistinct or Average should be widened to prevent overflows the same as Sum.

2014-05-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1947. - Resolution: Fixed Child of SumDistinct or Average should be widened to prevent

[jira] [Updated] (SPARK-1947) Child of SumDistinct or Average should be widened to prevent overflows the same as Sum.

2014-05-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1947: Fix Version/s: 1.1.0 1.0.1 Child of SumDistinct or Average should be

[jira] [Updated] (SPARK-1508) Add support for reading from SparkConf

2014-06-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1508: Description: Right now we have no ability to configure things in Spark SQL. A good start

[jira] [Updated] (SPARK-1508) Add support for reading from SparkConf

2014-06-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1508: Assignee: Zongheng Yang Add support for reading from SparkConf

[jira] [Resolved] (SPARK-1958) Calling .collect() on a SchemaRDD should call executeCollect() on the underlying query plan.

2014-06-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1958. - Resolution: Fixed Fix Version/s: 1.0.1 Calling .collect() on a SchemaRDD should

[jira] [Resolved] (SPARK-1461) Support Short-circuit Expression Evaluation

2014-06-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1461. - Resolution: Fixed Fix Version/s: 1.0.1 Support Short-circuit Expression

[jira] [Created] (SPARK-2010) Support for nested data in PySpark SQL

2014-06-03 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-2010: --- Summary: Support for nested data in PySpark SQL Key: SPARK-2010 URL: https://issues.apache.org/jira/browse/SPARK-2010 Project: Spark Issue Type:

[jira] [Commented] (SPARK-1508) Add support for reading from SparkConf

2014-06-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14018053#comment-14018053 ] Michael Armbrust commented on SPARK-1508: - It is likely we will fix this issue

[jira] [Created] (SPARK-2041) Exception when querying when tableName == columnName

2014-06-05 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-2041: --- Summary: Exception when querying when tableName == columnName Key: SPARK-2041 URL: https://issues.apache.org/jira/browse/SPARK-2041 Project: Spark

[jira] [Updated] (SPARK-2010) Support for nested data in PySpark SQL

2014-06-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2010: Assignee: Kan Zhang (was: Michael Armbrust) Support for nested data in PySpark SQL

[jira] [Assigned] (SPARK-2010) Support for nested data in PySpark SQL

2014-06-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-2010: --- Assignee: Michael Armbrust Support for nested data in PySpark SQL

[jira] [Created] (SPARK-2042) Take triggers unneeded shuffle.

2014-06-05 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-2042: --- Summary: Take triggers unneeded shuffle. Key: SPARK-2042 URL: https://issues.apache.org/jira/browse/SPARK-2042 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-2042) Take triggers unneeded shuffle.

2014-06-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2042: Assignee: Sameer Agarwal Take triggers unneeded shuffle. ---

[jira] [Updated] (SPARK-2036) CaseConversionExpression should check if the evaluated value is null.

2014-06-06 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2036: Assignee: Takuya Ueshin CaseConversionExpression should check if the evaluated value is

[jira] [Updated] (SPARK-2050) LIKE, RLIKE and IN in HQL should not be case sensitive

2014-06-06 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2050: Component/s: SQL LIKE, RLIKE and IN in HQL should not be case sensitive

[jira] [Created] (SPARK-2059) Unresolved Attributes should cause a failure before execution time

2014-06-06 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-2059: --- Summary: Unresolved Attributes should cause a failure before execution time Key: SPARK-2059 URL: https://issues.apache.org/jira/browse/SPARK-2059 Project:

[jira] [Assigned] (SPARK-1994) Weird data corruption bug when running Spark SQL on data in HDFS

2014-06-06 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-1994: --- Assignee: Michael Armbrust Weird data corruption bug when running Spark SQL on data

[jira] [Updated] (SPARK-2060) Querying JSON Datasets with SQL and DSL in Spark SQL

2014-06-07 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2060: Assignee: Yin Huai Querying JSON Datasets with SQL and DSL in Spark SQL

[jira] [Updated] (SPARK-2063) Creating a SchemaRDD via sql() does not correctly resolve nested types

2014-06-07 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2063: Assignee: Cheng Lian (was: Michael Armbrust) Creating a SchemaRDD via sql() does not

[jira] [Updated] (SPARK-2059) Unresolved Attributes should cause a failure before execution time

2014-06-07 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2059: Assignee: Cheng Lian Unresolved Attributes should cause a failure before execution time

  1   2   3   4   5   6   7   8   9   10   >