[jira] [Updated] (SPARK-23892) Improve coverage and fix lint error in UTF8String-related Suite

[ https://issues.apache.org/jira/browse/SPARK-23892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-23892: - Description: The following code in {{UTF8StringSuite}} has no sense. {code} assertTru

[jira] [Created] (SPARK-23893) Possible overflow in long = int * int

Kazuaki Ishizaki created SPARK-23893: Summary: Possible overflow in long = int * int Key: SPARK-23893 URL: https://issues.apache.org/jira/browse/SPARK-23893 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-23924) High-order function: element_at

[ https://issues.apache.org/jira/browse/SPARK-23924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431002#comment-16431002 ] Kazuaki Ishizaki commented on SPARK-23924: -- I will work for this. > High-order

[jira] [Commented] (SPARK-23919) High-order function: array_position(x, element) → bigint

[ https://issues.apache.org/jira/browse/SPARK-23919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431004#comment-16431004 ] Kazuaki Ishizaki commented on SPARK-23919: -- I am working for this. > High-order

[jira] [Commented] (SPARK-23923) High-order function: cardinality(x) → bigint

[ https://issues.apache.org/jira/browse/SPARK-23923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431009#comment-16431009 ] Kazuaki Ishizaki commented on SPARK-23923: -- I am working for this. > High-order

[jira] [Comment Edited] (SPARK-23919) High-order function: array_position(x, element) → bigint

[ https://issues.apache.org/jira/browse/SPARK-23919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431004#comment-16431004 ] Kazuaki Ishizaki edited comment on SPARK-23919 at 4/9/18 6:19 PM: -

[jira] [Commented] (SPARK-23921) High-order function: array_sort(x) → array

[ https://issues.apache.org/jira/browse/SPARK-23921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431037#comment-16431037 ] Kazuaki Ishizaki commented on SPARK-23921: -- I am working for this > High-order

[jira] [Comment Edited] (SPARK-23923) High-order function: cardinality(x) → bigint

[ https://issues.apache.org/jira/browse/SPARK-23923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431009#comment-16431009 ] Kazuaki Ishizaki edited comment on SPARK-23923 at 4/9/18 6:36 PM: -

[jira] [Commented] (SPARK-23916) High-order function: array_join(x, delimiter, null_replacement) → varchar

[ https://issues.apache.org/jira/browse/SPARK-23916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431795#comment-16431795 ] Kazuaki Ishizaki commented on SPARK-23916: -- Sorry for my mistake regarding a PR

[jira] [Commented] (SPARK-23913) High-order function: array_intersect(x, y) → array

[ https://issues.apache.org/jira/browse/SPARK-23913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16434491#comment-16434491 ] Kazuaki Ishizaki commented on SPARK-23913: -- I will work for this, thank you. >

[jira] [Commented] (SPARK-23914) High-order function: array_union(x, y) → array

[ https://issues.apache.org/jira/browse/SPARK-23914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16434494#comment-16434494 ] Kazuaki Ishizaki commented on SPARK-23914: -- I will work for this, thank you. >

[jira] [Commented] (SPARK-23915) High-order function: array_except(x, y) → array

[ https://issues.apache.org/jira/browse/SPARK-23915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16435666#comment-16435666 ] Kazuaki Ishizaki commented on SPARK-23915: -- I will work for this, thanks. > Hig

[jira] [Commented] (SPARK-23933) High-order function: map(array, array) → map

[ https://issues.apache.org/jira/browse/SPARK-23933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16436136#comment-16436136 ] Kazuaki Ishizaki commented on SPARK-23933: -- I will work for this, thank you. >

[jira] [Commented] (SPARK-23933) High-order function: map(array, array) → map

[ https://issues.apache.org/jira/browse/SPARK-23933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16436976#comment-16436976 ] Kazuaki Ishizaki commented on SPARK-23933: -- [~smilegator] [~ueshin] Could you fa

[jira] [Created] (SPARK-23976) UTF8String.concat() or ByteArray.concat() may allocate shorter structure.

Kazuaki Ishizaki created SPARK-23976: Summary: UTF8String.concat() or ByteArray.concat() may allocate shorter structure. Key: SPARK-23976 URL: https://issues.apache.org/jira/browse/SPARK-23976 Pro

[jira] [Commented] (SPARK-23986) CompileException when using too many avg aggregation after joining

[ https://issues.apache.org/jira/browse/SPARK-23986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16438818#comment-16438818 ] Kazuaki Ishizaki commented on SPARK-23986: -- Thank for reporting an issue with de

[jira] [Comment Edited] (SPARK-23986) CompileException when using too many avg aggregation after joining

[ https://issues.apache.org/jira/browse/SPARK-23986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16438818#comment-16438818 ] Kazuaki Ishizaki edited comment on SPARK-23986 at 4/15/18 7:36 PM:

[jira] [Commented] (SPARK-23986) CompileException when using too many avg aggregation after joining

[ https://issues.apache.org/jira/browse/SPARK-23986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16438885#comment-16438885 ] Kazuaki Ishizaki commented on SPARK-23986: -- While I also checked it with branch-

[jira] [Commented] (SPARK-23933) High-order function: map(array, array) → map

[ https://issues.apache.org/jira/browse/SPARK-23933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16441268#comment-16441268 ] Kazuaki Ishizaki commented on SPARK-23933: -- ping [~smilegator] > High-order fun

[jira] [Comment Edited] (SPARK-23933) High-order function: map(array, array) → map

[ https://issues.apache.org/jira/browse/SPARK-23933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16436976#comment-16436976 ] Kazuaki Ishizaki edited comment on SPARK-23933 at 4/18/18 4:22 PM:

[jira] [Commented] (SPARK-10399) Off Heap Memory Access for non-JVM libraries (C++)

[ https://issues.apache.org/jira/browse/SPARK-10399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16446166#comment-16446166 ] Kazuaki Ishizaki commented on SPARK-10399: -- https://issues.apache.org/jira/brows

[jira] [Commented] (SPARK-26477) Use ConfigEntry for hardcoded configs for unsafe category.

[ https://issues.apache.org/jira/browse/SPARK-26477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16730340#comment-16730340 ] Kazuaki Ishizaki commented on SPARK-26477: -- I will work for this > Use ConfigE

[jira] [Commented] (SPARK-26442) Use ConfigEntry for hardcoded configs.

[ https://issues.apache.org/jira/browse/SPARK-26442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16730883#comment-16730883 ] Kazuaki Ishizaki commented on SPARK-26442: -- Thank you for updaing them. > Use

[jira] [Comment Edited] (SPARK-26442) Use ConfigEntry for hardcoded configs.

[ https://issues.apache.org/jira/browse/SPARK-26442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16730883#comment-16730883 ] Kazuaki Ishizaki edited comment on SPARK-26442 at 12/30/18 4:18 AM: --

[jira] [Commented] (SPARK-26463) Use ConfigEntry for hardcoded configs for scheduler categories.

[ https://issues.apache.org/jira/browse/SPARK-26463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16730882#comment-16730882 ] Kazuaki Ishizaki commented on SPARK-26463: -- I will work for this > Use ConfigE

[jira] [Created] (SPARK-26508) Address warning messages in Java by lgtm.com

Kazuaki Ishizaki created SPARK-26508: Summary: Address warning messages in Java by lgtm.com Key: SPARK-26508 URL: https://issues.apache.org/jira/browse/SPARK-26508 Project: Spark Issue Ty

[jira] [Created] (SPARK-12502) Script /dev/run-tests fails when IBM Java is used

Kazuaki Ishizaki created SPARK-12502: Summary: Script /dev/run-tests fails when IBM Java is used Key: SPARK-12502 URL: https://issues.apache.org/jira/browse/SPARK-12502 Project: Spark Iss

[jira] [Commented] (SPARK-12502) Script /dev/run-tests fails when IBM Java is used

[ https://issues.apache.org/jira/browse/SPARK-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15069991#comment-15069991 ] Kazuaki Ishizaki commented on SPARK-12502: -- Yes, I will do it. I will change a f

[jira] [Created] (SPARK-12530) Build break at Spark-Master-Maven-Snapshots from #1293

Kazuaki Ishizaki created SPARK-12530: Summary: Build break at Spark-Master-Maven-Snapshots from #1293 Key: SPARK-12530 URL: https://issues.apache.org/jira/browse/SPARK-12530 Project: Spark

[jira] [Updated] (SPARK-12530) Build break at Spark-Master-Maven-Snapshots from #1293

[ https://issues.apache.org/jira/browse/SPARK-12530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-12530: - Description: Build break happens at Spark-Master-Maven-Snapshots from #1293 due to compi

[jira] [Created] (SPARK-12580) Remove string concatenations from usage and extended in @ExpressionDescription

Kazuaki Ishizaki created SPARK-12580: Summary: Remove string concatenations from usage and extended in @ExpressionDescription Key: SPARK-12580 URL: https://issues.apache.org/jira/browse/SPARK-12580

[jira] [Updated] (SPARK-12580) Remove string concatenations from usage and extended in @ExpressionDescription

[ https://issues.apache.org/jira/browse/SPARK-12580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-12580: - External issue ID: SPARK-12454, SPARK-12530 (was: 12454, 12530) > Remove string concaten

[jira] [Updated] (SPARK-12580) Remove string concatenations from usage and extended in @ExpressionDescription

[ https://issues.apache.org/jira/browse/SPARK-12580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-12580: - External issue ID: SPARK-12454, SPARK-12530, SPARK-12455,SPARK-12456,SPARK-12457,SPARK-12

[jira] [Updated] (SPARK-12580) Remove string concatenations from usage and extended in @ExpressionDescription

[ https://issues.apache.org/jira/browse/SPARK-12580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-12580: - Description: More than one string concatenation in {{usage}} or {{extended}} for {{@Expr

[jira] [Commented] (SPARK-12580) Remove string concatenations from usage and extended in @ExpressionDescription

[ https://issues.apache.org/jira/browse/SPARK-12580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15074738#comment-15074738 ] Kazuaki Ishizaki commented on SPARK-12580: -- Thank you, however I have already do

[jira] [Commented] (SPARK-3785) Support off-loading computations to a GPU

[ https://issues.apache.org/jira/browse/SPARK-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080653#comment-15080653 ] Kazuaki Ishizaki commented on SPARK-3785: - Let us reopen this thread :) We are wo

[jira] [Reopened] (SPARK-3785) Support off-loading computations to a GPU

[ https://issues.apache.org/jira/browse/SPARK-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki reopened SPARK-3785: - Add a comment of our prototype to offload to GPU > Support off-loading computations to a GPU

[jira] [Issue Comment Deleted] (SPARK-3785) Support off-loading computations to a GPU

[ https://issues.apache.org/jira/browse/SPARK-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-3785: Comment: was deleted (was: Add a comment of our prototype to offload to GPU) > Support off-

[jira] [Comment Edited] (SPARK-3785) Support off-loading computations to a GPU

[ https://issues.apache.org/jira/browse/SPARK-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080653#comment-15080653 ] Kazuaki Ishizaki edited comment on SPARK-3785 at 1/4/16 3:44 AM: ---

[jira] [Created] (SPARK-12620) Proposal of GPU exploitation for Spark

Kazuaki Ishizaki created SPARK-12620: Summary: Proposal of GPU exploitation for Spark Key: SPARK-12620 URL: https://issues.apache.org/jira/browse/SPARK-12620 Project: Spark Issue Type: Ne

[jira] [Commented] (SPARK-3785) Support off-loading computations to a GPU

[ https://issues.apache.org/jira/browse/SPARK-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081184#comment-15081184 ] Kazuaki Ishizaki commented on SPARK-3785: - I am sorry to reopen this. Based on you

[jira] [Commented] (SPARK-12620) Proposal of GPU exploitation for Spark

[ https://issues.apache.org/jira/browse/SPARK-12620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081332#comment-15081332 ] Kazuaki Ishizaki commented on SPARK-12620: -- [~srowen] would it be better to cont

[jira] [Commented] (SPARK-12620) Proposal of GPU exploitation for Spark

[ https://issues.apache.org/jira/browse/SPARK-12620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082589#comment-15082589 ] Kazuaki Ishizaki commented on SPARK-12620: -- I will close this, and continue a di

[jira] [Closed] (SPARK-12620) Proposal of GPU exploitation for Spark

[ https://issues.apache.org/jira/browse/SPARK-12620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki closed SPARK-12620. Move to SPARK-3875. > Proposal of GPU exploitation for Spark > ---

[jira] [Commented] (SPARK-3785) Support off-loading computations to a GPU

[ https://issues.apache.org/jira/browse/SPARK-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082596#comment-15082596 ] Kazuaki Ishizaki commented on SPARK-3785: - [~rxin][~srowen] thank you for your dir

[jira] [Commented] (SPARK-3785) Support off-loading computations to a GPU

[ https://issues.apache.org/jira/browse/SPARK-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082859#comment-15082859 ] Kazuaki Ishizaki commented on SPARK-3785: - To use CUDA is an intermediate approach

[jira] [Commented] (SPARK-3785) Support off-loading computations to a GPU

[ https://issues.apache.org/jira/browse/SPARK-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082881#comment-15082881 ] Kazuaki Ishizaki commented on SPARK-3785: - # You can specify cpu-cores by using co

[jira] [Created] (SPARK-12907) Use BitSet to represent null fields in ColumnVector

Kazuaki Ishizaki created SPARK-12907: Summary: Use BitSet to represent null fields in ColumnVector Key: SPARK-12907 URL: https://issues.apache.org/jira/browse/SPARK-12907 Project: Spark I

[jira] [Created] (SPARK-12311) [CORE] Restore previous "os.arch" property in test suites after forcing to set specific value to "os.arch" property

Kazuaki Ishizaki created SPARK-12311: Summary: [CORE] Restore previous "os.arch" property in test suites after forcing to set specific value to "os.arch" property Key: SPARK-12311 URL: https://issues.apache.or

[jira] [Updated] (SPARK-12311) [CORE] Restore previous value of "os.arch" property in test suites after forcing to set specific value to "os.arch" property

[ https://issues.apache.org/jira/browse/SPARK-12311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-12311: - Summary: [CORE] Restore previous value of "os.arch" property in test suites after forcing

[jira] [Updated] (SPARK-12311) [CORE] Restore previous value of "os.arch" property in test suites after forcing to set specific value to "os.arch" property

[ https://issues.apache.org/jira/browse/SPARK-12311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-12311: - Description: Although current BlockManagerSuite.scala and SizeEstimatorSuite.scala set th

[jira] [Commented] (SPARK-12311) [CORE] Restore previous value of "os.arch" property in test suites after forcing to set specific value to "os.arch" property

[ https://issues.apache.org/jira/browse/SPARK-12311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056317#comment-15056317 ] Kazuaki Ishizaki commented on SPARK-12311: -- Yes. Even when I run core test on a

[jira] [Created] (SPARK-13432) Add the origin of the source code into a generated Java code

Kazuaki Ishizaki created SPARK-13432: Summary: Add the origin of the source code into a generated Java code Key: SPARK-13432 URL: https://issues.apache.org/jira/browse/SPARK-13432 Project: Spark

[jira] [Commented] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15157104#comment-15157104 ] Kazuaki Ishizaki commented on SPARK-13431: -- According to AMPLAB's Jenkins, the f

[jira] [Commented] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15157182#comment-15157182 ] Kazuaki Ishizaki commented on SPARK-13431: -- I succeeded to build Spark by commen

[jira] [Commented] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15157208#comment-15157208 ] Kazuaki Ishizaki commented on SPARK-13431: -- I am using mvn, and executed the fol

[jira] [Commented] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15157297#comment-15157297 ] Kazuaki Ishizaki commented on SPARK-13431: -- The size of a static initializer met

[jira] [Comment Edited] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15157297#comment-15157297 ] Kazuaki Ishizaki edited comment on SPARK-13431 at 2/22/16 5:17 PM:

[jira] [Created] (SPARK-13437) Add InternalColumn

Kazuaki Ishizaki created SPARK-13437: Summary: Add InternalColumn Key: SPARK-13437 URL: https://issues.apache.org/jira/browse/SPARK-13437 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15159649#comment-15159649 ] Kazuaki Ishizaki commented on SPARK-13431: -- I identified why this problem occurs

[jira] [Commented] (SPARK-13421) Make output of a SparkPlan configurable

[ https://issues.apache.org/jira/browse/SPARK-13421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15160157#comment-15160157 ] Kazuaki Ishizaki commented on SPARK-13421: -- I am willing to work for and contrib

[jira] [Closed] (SPARK-12907) Use BitSet to represent null fields in ColumnVector

[ https://issues.apache.org/jira/browse/SPARK-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki closed SPARK-12907. Resolution: Won't Fix > Use BitSet to represent null fields in ColumnVector > -

[jira] [Commented] (SPARK-13530) Add ShortType support to UnsafeRowParquetRecordReader

[ https://issues.apache.org/jira/browse/SPARK-13530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15170636#comment-15170636 ] Kazuaki Ishizaki commented on SPARK-13530: -- I saw the same exception in my envir

[jira] [Created] (SPARK-13644) [SQL] add the source file name and line into Logger when an exception occurs in the generated code

Kazuaki Ishizaki created SPARK-13644: Summary: [SQL] add the source file name and line into Logger when an exception occurs in the generated code Key: SPARK-13644 URL: https://issues.apache.org/jira/browse/SPA

[jira] [Updated] (SPARK-13644) add the source file name and line into Logger when an exception occurs in the generated code

[ https://issues.apache.org/jira/browse/SPARK-13644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-13644: - Issue Type: Improvement (was: Bug) Summary: add the source file name and line into

[jira] [Updated] (SPARK-13644) Add the source file name and line into Logger when an exception occurs in the generated code

[ https://issues.apache.org/jira/browse/SPARK-13644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-13644: - Summary: Add the source file name and line into Logger when an exception occurs in the ge

[jira] [Created] (SPARK-13805) Direct consume ColumnVector in generated code when ColumnarBatch is used

Kazuaki Ishizaki created SPARK-13805: Summary: Direct consume ColumnVector in generated code when ColumnarBatch is used Key: SPARK-13805 URL: https://issues.apache.org/jira/browse/SPARK-13805 Proj

[jira] [Created] (SPARK-13844) Generate better code for filters with a non-nullable column

Kazuaki Ishizaki created SPARK-13844: Summary: Generate better code for filters with a non-nullable column Key: SPARK-13844 URL: https://issues.apache.org/jira/browse/SPARK-13844 Project: Spark

[jira] [Created] (SPARK-14072) Show JVM information when we run Benchmark

Kazuaki Ishizaki created SPARK-14072: Summary: Show JVM information when we run Benchmark Key: SPARK-14072 URL: https://issues.apache.org/jira/browse/SPARK-14072 Project: Spark Issue Type

[jira] [Created] (SPARK-14098) Generate code that get a value in each column from CachedBatch when DataFrame.cache() is called

Kazuaki Ishizaki created SPARK-14098: Summary: Generate code that get a value in each column from CachedBatch when DataFrame.cache() is called Key: SPARK-14098 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Commented] (SPARK-14098) Generate code that get a value in each column from CachedBatch when DataFrame.cache() is called

[ https://issues.apache.org/jira/browse/SPARK-14098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209047#comment-15209047 ] Kazuaki Ishizaki commented on SPARK-14098: -- After fixing some trivial compilatio

[jira] [Comment Edited] (SPARK-14098) Generate code that get a value in each column from CachedBatch when DataFrame.cache() is called

[ https://issues.apache.org/jira/browse/SPARK-14098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209047#comment-15209047 ] Kazuaki Ishizaki edited comment on SPARK-14098 at 3/23/16 8:02 PM:

[jira] [Commented] (SPARK-14138) Generated SpecificColumnarIterator code can exceed JVM size limit for cached DataFrames

[ https://issues.apache.org/jira/browse/SPARK-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213071#comment-15213071 ] Kazuaki Ishizaki commented on SPARK-14138: -- I will make a PR that includes two s

[jira] [Commented] (SPARK-14083) Analyze JVM bytecode and turn closures into Catalyst expressions

[ https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213959#comment-15213959 ] Kazuaki Ishizaki commented on SPARK-14083: -- Another possible bytecode analysis l

[jira] [Commented] (SPARK-14083) Analyze JVM bytecode and turn closures into Catalyst expressions

[ https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15219637#comment-15219637 ] Kazuaki Ishizaki commented on SPARK-14083: -- Looks interesting. I am also interes

[jira] [Commented] (SPARK-14083) Analyze JVM bytecode and turn closures into Catalyst expressions

[ https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15220055#comment-15220055 ] Kazuaki Ishizaki commented on SPARK-14083: -- Thank you. Makes sense to me. It see

[jira] [Commented] (SPARK-14083) Analyze JVM bytecode and turn closures into Catalyst expressions

[ https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15222634#comment-15222634 ] Kazuaki Ishizaki commented on SPARK-14083: -- Good point. On the other hand, shoul

[jira] [Created] (SPARK-14656) Benchmark.getPorcessorName() always return "Unknown processor" on Linux

Kazuaki Ishizaki created SPARK-14656: Summary: Benchmark.getPorcessorName() always return "Unknown processor" on Linux Key: SPARK-14656 URL: https://issues.apache.org/jira/browse/SPARK-14656 Proje

[jira] [Commented] (SPARK-14656) Benchmark.getPorcessorName() always return "Unknown processor" on Linux

[ https://issues.apache.org/jira/browse/SPARK-14656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15242688#comment-15242688 ] Kazuaki Ishizaki commented on SPARK-14656: -- The root cause is described at https

[jira] [Created] (SPARK-14689) [SQL] SPARK-9757 fails in Jenkins for master

Kazuaki Ishizaki created SPARK-14689: Summary: [SQL] SPARK-9757 fails in Jenkins for master Key: SPARK-14689 URL: https://issues.apache.org/jira/browse/SPARK-14689 Project: Spark Issue Ty

[jira] [Created] (SPARK-14690) [SQL] SPARK-9757 fails in Jenkins for master

Kazuaki Ishizaki created SPARK-14690: Summary: [SQL] SPARK-9757 fails in Jenkins for master Key: SPARK-14690 URL: https://issues.apache.org/jira/browse/SPARK-14690 Project: Spark Issue Ty

[jira] [Updated] (SPARK-14690) [SQL] SPARK-8020 fails in Jenkins for master

[ https://issues.apache.org/jira/browse/SPARK-14690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-14690: - Summary: [SQL] SPARK-8020 fails in Jenkins for master (was: [SQL] SPARK-9757 fails in Je

[jira] [Resolved] (SPARK-14690) [SQL] SPARK-8020 fails in Jenkins for master

[ https://issues.apache.org/jira/browse/SPARK-14690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki resolved SPARK-14690. -- Resolution: Duplicate > [SQL] SPARK-8020 fails in Jenkins for master >

[jira] [Commented] (SPARK-14690) [SQL] SPARK-8020 fails in Jenkins for master

[ https://issues.apache.org/jira/browse/SPARK-14690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244798#comment-15244798 ] Kazuaki Ishizaki commented on SPARK-14690: -- I see. I will reopen the original JI

[jira] [Closed] (SPARK-14690) [SQL] SPARK-8020 fails in Jenkins for master

[ https://issues.apache.org/jira/browse/SPARK-14690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki closed SPARK-14690. Add a link to the original JIRA > [SQL] SPARK-8020 fails in Jenkins for master > -

[jira] [Issue Comment Deleted] (SPARK-14690) [SQL] SPARK-8020 fails in Jenkins for master

[ https://issues.apache.org/jira/browse/SPARK-14690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-14690: - Comment: was deleted (was: Add a link to the original JIRA) > [SQL] SPARK-8020 fails in

[jira] [Commented] (SPARK-13904) Add support for pluggable cluster manager

[ https://issues.apache.org/jira/browse/SPARK-13904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244805#comment-15244805 ] Kazuaki Ishizaki commented on SPARK-13904: -- To merge this PR may have begun caus

[jira] [Commented] (SPARK-13904) Add support for pluggable cluster manager

[ https://issues.apache.org/jira/browse/SPARK-13904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15247498#comment-15247498 ] Kazuaki Ishizaki commented on SPARK-13904: -- I agree with you since SPARK-14689 a

[jira] [Commented] (SPARK-14138) Generated SpecificColumnarIterator code can exceed JVM size limit for cached DataFrames

[ https://issues.apache.org/jira/browse/SPARK-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15254061#comment-15254061 ] Kazuaki Ishizaki commented on SPARK-14138: -- Yes, it will be included in 1.6.2 an

[jira] [Updated] (SPARK-14098) Generate code that get a value in each column from CachedBatch when DataFrame.cache() is called

[ https://issues.apache.org/jira/browse/SPARK-14098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-14098: - Target Version/s: 2.0.0 > Generate code that get a value in each column from CachedBatch

[jira] [Commented] (SPARK-28699) Cache an indeterminate RDD could lead to incorrect result while stage rerun

[ https://issues.apache.org/jira/browse/SPARK-28699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16910907#comment-16910907 ] Kazuaki Ishizaki commented on SPARK-28699: -- [~smilegator] Thank you for cc. I w

[jira] [Commented] (SPARK-28699) Cache an indeterminate RDD could lead to incorrect result while stage rerun

[ https://issues.apache.org/jira/browse/SPARK-28699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16910983#comment-16910983 ] Kazuaki Ishizaki commented on SPARK-28699: -- [~dongjoon] Thank you for pointing

[jira] [Created] (SPARK-28891) do-release-docker.sh in master does not work for branch-2.3

Kazuaki Ishizaki created SPARK-28891: Summary: do-release-docker.sh in master does not work for branch-2.3 Key: SPARK-28891 URL: https://issues.apache.org/jira/browse/SPARK-28891 Project: Spark

[jira] [Updated] (SPARK-28891) do-release-docker.sh in master does not work for branch-2.3

[ https://issues.apache.org/jira/browse/SPARK-28891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-28891: - Description: According to [~maropu], [do-release-docker.sh|https://github.com/apache/sp

[jira] [Commented] (SPARK-28906) `bin/spark-submit --version` shows incorrect info

[ https://issues.apache.org/jira/browse/SPARK-28906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919330#comment-16919330 ] Kazuaki Ishizaki commented on SPARK-28906: -- I attached output of 2.3.0 and 2.3.

[jira] [Commented] (SPARK-28906) `bin/spark-submit --version` shows incorrect info

[ https://issues.apache.org/jira/browse/SPARK-28906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919420#comment-16919420 ] Kazuaki Ishizaki commented on SPARK-28906: -- In {{jars/spark-core_2.11-2.3.*.jar

[jira] [Comment Edited] (SPARK-28906) `bin/spark-submit --version` shows incorrect info

[ https://issues.apache.org/jira/browse/SPARK-28906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919420#comment-16919420 ] Kazuaki Ishizaki edited comment on SPARK-28906 at 8/30/19 10:51 AM: --

[jira] [Commented] (SPARK-28906) `bin/spark-submit --version` shows incorrect info

[ https://issues.apache.org/jira/browse/SPARK-28906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919893#comment-16919893 ] Kazuaki Ishizaki commented on SPARK-28906: -- For user name, we have to pass {{US

[jira] [Commented] (SPARK-28906) `bin/spark-submit --version` shows incorrect info

[ https://issues.apache.org/jira/browse/SPARK-28906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920594#comment-16920594 ] Kazuaki Ishizaki commented on SPARK-28906: -- For the information on {{git}} coma

[jira] [Comment Edited] (SPARK-28906) `bin/spark-submit --version` shows incorrect info

[ https://issues.apache.org/jira/browse/SPARK-28906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920594#comment-16920594 ] Kazuaki Ishizaki edited comment on SPARK-28906 at 9/2/19 8:48 AM:

<    4   5   6   7   8   9   10   >