[
https://issues.apache.org/jira/browse/SPARK-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15136004#comment-15136004
]
Ted Yu commented on SPARK-13171:
No, I have not.
bq. Could it be that Hive does some fun
[
https://issues.apache.org/jira/browse/SPARK-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15136006#comment-15136006
]
Ted Yu commented on SPARK-13171:
https://amplab.cs.berkeley.edu/jenkins/job/spark-master-
[
https://issues.apache.org/jira/browse/SPARK-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15136320#comment-15136320
]
Ted Yu commented on SPARK-13120:
I do see the advantage of shading protobuf-java which wo
[
https://issues.apache.org/jira/browse/SPARK-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-13120:
---
Description:
https://groups.google.com/forum/#!topic/protobuf/wAqvtPLBsE8
PB2 and PB3 are wire compatible, bu
[
https://issues.apache.org/jira/browse/SPARK-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15136383#comment-15136383
]
Ted Yu commented on SPARK-13120:
I don't think this JIRA is limited to the scenario from
[
https://issues.apache.org/jira/browse/SPARK-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-10561:
---
Description:
Here is the discussion thread:
http://search-hadoop.com/m/q3RTtcD20F1o62xE
Richard Hillegas mad
[
https://issues.apache.org/jira/browse/SPARK-13180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137674#comment-15137674
]
Ted Yu commented on SPARK-13180:
I wonder if we should provide better error message when
[
https://issues.apache.org/jira/browse/SPARK-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-10561:
---
Description:
Here is the discussion thread:
http://search-hadoop.com/m/q3RTtcD20F1o62xE
Richard Hillegas mad
[
https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-5427:
--
Description:
floor() function is supported in Hive SQL.
This issue is to add floor() function to Spark SQL.
Rel
Ted Yu created SPARK-7107:
-
Summary: Add parameter for zookeeper.znode.parent to
hbase_inputformat.py
Key: SPARK-7107
URL: https://issues.apache.org/jira/browse/SPARK-7107
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-7107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-7107:
--
Description:
[~yeshavora] first reported encountering the following exception running
hbase_inputformat.py :
{c
[
https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-4066:
--
Description:
Here is the thread Koert started:
http://search-hadoop.com/m/JW1q5j8z422/scalastyle+annoys+me+a+li
[
https://issues.apache.org/jira/browse/SPARK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14523503#comment-14523503
]
Ted Yu commented on SPARK-5041:
---
Considering '[discuss] ending support for Java 6' discussio
Ted Yu created SPARK-7450:
-
Summary: Use UNSAFE.getLong() to speed up BitSetMethods#anySet()
Key: SPARK-7450
URL: https://issues.apache.org/jira/browse/SPARK-7450
Project: Spark
Issue Type: Improveme
[
https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-5427:
--
Description:
floor() function is supported in Hive SQL.
This issue is to add floor() function to Spark SQL.
Rela
[
https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-4066:
--
Description:
Here is the thread Koert started:
http://search-hadoop.com/m/JW1q5j8z422/scalastyle+annoys+me+a+li
[
https://issues.apache.org/jira/browse/SPARK-7538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14540083#comment-14540083
]
Ted Yu commented on SPARK-7538:
---
As mentioned by Cody Koeninger on the mailing list, using
[
https://issues.apache.org/jira/browse/SPARK-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14558316#comment-14558316
]
Ted Yu commented on SPARK-7853:
---
Subject says ClassNotFoundException.
Which class couldn't b
[
https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-5427:
--
Description:
floor() function is supported in Hive SQL.
This issue is to add floor() function to Spark SQL.
Rel
[
https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-5427:
--
Description:
floor() function is supported in Hive SQL.
This issue is to add floor() function to Spark SQL.
Rela
Ted Yu created SPARK-8336:
-
Summary: Fix NullPointerException with functions.rand()
Key: SPARK-8336
URL: https://issues.apache.org/jira/browse/SPARK-8336
Project: Spark
Issue Type: Bug
Re
[
https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-5427:
--
Description:
floor() function is supported in Hive SQL.
This issue is to add floor() function to Spark SQL.
Rel
[
https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-5427:
--
Description:
floor() function is supported in Hive SQL.
This issue is to add floor() function to Spark SQL.
Rela
Ted Yu created SPARK-9446:
-
Summary: Clear Active SparkContext in stop() method
Key: SPARK-9446
URL: https://issues.apache.org/jira/browse/SPARK-9446
Project: Spark
Issue Type: Bug
Report
Ted Yu created SPARK-10074:
--
Summary: Include Float in @specialized annotation
Key: SPARK-10074
URL: https://issues.apache.org/jira/browse/SPARK-10074
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-10074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14701332#comment-14701332
]
Ted Yu commented on SPARK-10074:
I performed the following search in Spark codebase:
fin
[
https://issues.apache.org/jira/browse/SPARK-10074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14701388#comment-14701388
]
Ted Yu commented on SPARK-10074:
I would argue that Double should be taken out from Mutab
[
https://issues.apache.org/jira/browse/SPARK-10074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu resolved SPARK-10074.
Resolution: Later
Until the need comes.
> Include Float in @specialized annotation
> -
[
https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-4066:
--
Description:
Here is the thread Koert started:
http://search-hadoop.com/m/JW1q5j8z422/scalastyle+annoys+me+a+li
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-1297:
--
Attachment: spark-1297-v6.txt
Patch v6 uses 0.98.5 hbase release.
> Upgrade HBase dependency to 0.98.0
> --
[
https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-4066:
--
Attachment: spark-4066-v1.txt
With attached patch, developer can specify the following on command line:
-Dscala
Ted Yu created SPARK-4066:
-
Summary: Make whether maven builds fails on scalastyle violation
configurable
Key: SPARK-4066
URL: https://issues.apache.org/jira/browse/SPARK-4066
Project: Spark
Issue T
[
https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14183016#comment-14183016
]
Ted Yu commented on SPARK-4066:
---
bq. -Dscalastyle.failOnViolation was already a built-in way
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-1297:
--
Attachment: spark-1297-v7.txt
> Upgrade HBase dependency to 0.98.0
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14198510#comment-14198510
]
Ted Yu commented on SPARK-1297:
---
Patch v7 uses 0.98.7 hbase release
> Upgrade HBase depende
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14198701#comment-14198701
]
Ted Yu commented on SPARK-1297:
---
Create a new pull request:
https://github.com/apache/spark/
Ted Yu created SPARK-4455:
-
Summary: Exclude dependency on hbase-annotations module
Key: SPARK-4455
URL: https://issues.apache.org/jira/browse/SPARK-4455
Project: Spark
Issue Type: Bug
Re
[
https://issues.apache.org/jira/browse/SPARK-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1423#comment-1423
]
Ted Yu commented on SPARK-1127:
---
According to Reynold,
First half of the external data sourc
Ted Yu created SPARK-6045:
-
Summary: RecordWriter should be checked against null in
PairRDDFunctions#saveAsNewAPIHadoopDataset
Key: SPARK-6045
URL: https://issues.apache.org/jira/browse/SPARK-6045
Project: Sp
[
https://issues.apache.org/jira/browse/SPARK-6045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339147#comment-14339147
]
Ted Yu commented on SPARK-6045:
---
https://github.com/apache/spark/pull/4794
> RecordWriter s
[
https://issues.apache.org/jira/browse/SPARK-6045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339169#comment-14339169
]
Ted Yu commented on SPARK-6045:
---
The logic of CassandraHadoopMigrator.scala is unknown.
Wit
[
https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-5427:
--
Labels: math (was: )
> Add support for floor function in Spark SQL
> --
Ted Yu created SPARK-6085:
-
Summary: Increase default value for memory overhead
Key: SPARK-6085
URL: https://issues.apache.org/jira/browse/SPARK-6085
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-6085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14342398#comment-14342398
]
Ted Yu commented on SPARK-6085:
---
In my opinion, priority for this JIRA should be Major.
Use
Ted Yu created SPARK-2720:
-
Summary: spark-examples should depend on HBase modules for HBase
0.96+
Key: SPARK-2720
URL: https://issues.apache.org/jira/browse/SPARK-2720
Project: Spark
Issue Type: Ta
[
https://issues.apache.org/jira/browse/SPARK-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14077740#comment-14077740
]
Ted Yu commented on SPARK-2720:
---
0.98 is currently the stable release of HBase.
bq. It woul
[
https://issues.apache.org/jira/browse/SPARK-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-2706:
--
Attachment: spark-hive.err
This file shows the error I got after applying tentative patch.
> Enable Spark to s
[
https://issues.apache.org/jira/browse/SPARK-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-2706:
--
Attachment: spark-2706-v1.txt
Tentative patch.
I copied Hive 0.13.1 artifacts to local maven repo manually.
>
Ted Yu created SPARK-2771:
-
Summary: GenerateMIMAIgnore fails scalastyle check due to long line
Key: SPARK-2771
URL: https://issues.apache.org/jira/browse/SPARK-2771
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-2771:
--
Attachment: spark-2771-v1.txt
Patch v1 shortens line 118 to 100 chars wide.
> GenerateMIMAIgnore fails scalast
Ted Yu created SPARK-2772:
-
Summary: Spark Project SQL fails compilation
Key: SPARK-2772
URL: https://issues.apache.org/jira/browse/SPARK-2772
Project: Spark
Issue Type: Bug
Reporter: Ted
[
https://issues.apache.org/jira/browse/SPARK-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu resolved SPARK-2772.
---
Resolution: Not a Problem
'mvn install' solves the issue.
> Spark Project SQL fails compilation
> --
[
https://issues.apache.org/jira/browse/SPARK-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu resolved SPARK-2771.
---
Resolution: Fixed
> GenerateMIMAIgnore fails scalastyle check due to long line
>
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14088747#comment-14088747
]
Ted Yu commented on SPARK-1297:
---
Thanks for checking, Reynold.
Upgrading dependency to 0.98
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089331#comment-14089331
]
Ted Yu commented on SPARK-1297:
---
We can add two profiles for 0.98: hbase-hadoop1 and hbase-h
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089568#comment-14089568
]
Ted Yu commented on SPARK-1297:
---
bq. the HBase Hadoop 2 deps can be copied into the various
[
https://issues.apache.org/jira/browse/SPARK-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-2706:
--
Attachment: spark-2706-v2.txt
Patch rebased on current master.
Compilation passed.
> Enable Spark to support
[
https://issues.apache.org/jira/browse/SPARK-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091514#comment-14091514
]
Ted Yu commented on SPARK-2706:
---
Running Hive test, I got:
{code}
^[[31m*** RUN ABORTED ***^
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-1297:
--
Attachment: spark-1297-v2.txt
Tentative patch adds hbase-hadoop2 profile.
> Upgrade HBase dependency to 0.98.0
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-1297:
--
Attachment: (was: spark-1297-v2.txt)
> Upgrade HBase dependency to 0.98.0
> ---
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-1297:
--
Attachment: spark-1297-v2.txt
> Upgrade HBase dependency to 0.98.0
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-1297:
--
Attachment: spark-1297-v4.txt
Patch v4 adds two profiles to examples/pom.xml :
hbase-hadoop1 (default)
hbase-h
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14092988#comment-14092988
]
Ted Yu commented on SPARK-1297:
---
HBase client doesn't need to specify dependency on hbase-ha
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14093012#comment-14093012
]
Ted Yu commented on SPARK-1297:
---
https://github.com/apache/spark/pull/1893
> Upgrade HBase
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14093466#comment-14093466
]
Ted Yu commented on SPARK-1297:
---
w.r.t. build, by default, hbase-hadoop1 would be used.
If u
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-1297:
--
Attachment: pom.xml
This is examples/pom.xml for spark-1.0.2
> Upgrade HBase dependency to 0.98.0
> --
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-1297:
--
Attachment: spark-1297-v5.txt
> Upgrade HBase dependency to 0.98.0
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113977#comment-14113977
]
Ted Yu commented on SPARK-1297:
---
Patch v5 is the aggregate of the 4 commits in the pull requ
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114113#comment-14114113
]
Ted Yu commented on SPARK-1297:
---
Here is sample command for building against 0.98 hbase:
mv
[
https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14133250#comment-14133250
]
Ted Yu commented on SPARK-1297:
---
Please note: spark-1297-v5.txt is a level 0 patch.
> Upgra
Ted Yu created SPARK-5041:
-
Summary: hive-exec jar should be generated with JDK 6
Key: SPARK-5041
URL: https://issues.apache.org/jira/browse/SPARK-5041
Project: Spark
Issue Type: Bug
Repo
[
https://issues.apache.org/jira/browse/SPARK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-5041:
--
Labels: maven (was: )
> hive-exec jar should be generated with JDK 6
>
[
https://issues.apache.org/jira/browse/SPARK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-5041:
--
Labels: jdk1.7 maven (was: maven)
> hive-exec jar should be generated with JDK 6
>
[
https://issues.apache.org/jira/browse/SPARK-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286407#comment-14286407
]
Ted Yu commented on SPARK-1714:
---
{code}
if (completedContainer.getExitStatus == -103
[
https://issues.apache.org/jira/browse/SPARK-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286416#comment-14286416
]
Ted Yu commented on SPARK-1714:
---
allocatedHostToContainersMap.synchronized is absent for the
Ted Yu created SPARK-5427:
-
Summary: Add support for floor function in Spark SQL
Key: SPARK-5427
URL: https://issues.apache.org/jira/browse/SPARK-5427
Project: Spark
Issue Type: Improvement
Ted Yu created SPARK-41197:
--
Summary: Upgrade Kafka version to 3.3 release
Key: SPARK-41197
URL: https://issues.apache.org/jira/browse/SPARK-41197
Project: Spark
Issue Type: Improvement
Co
Ted Yu created SPARK-41274:
--
Summary: Bump Kubernetes Client Version to 6.2.0
Key: SPARK-41274
URL: https://issues.apache.org/jira/browse/SPARK-41274
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-41274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu resolved SPARK-41274.
Resolution: Duplicate
This is dup of commit 02a2242a45062755bf7e20805958d5bdf1f5ed74
> Bump Kubernetes Cl
Ted Yu created SPARK-41419:
--
Summary: [K8S] Decrement PVC_COUNTER when the pod deletion happens
Key: SPARK-41419
URL: https://issues.apache.org/jira/browse/SPARK-41419
Project: Spark
Issue Type: Ta
Ted Yu created SPARK-41705:
--
Summary: Move generate_protos.sh to dev/
Key: SPARK-41705
URL: https://issues.apache.org/jira/browse/SPARK-41705
Project: Spark
Issue Type: Task
Components: C
Ted Yu created SPARK-41853:
--
Summary: Use Map in place of SortedMap for ErrorClassesJsonReader
Key: SPARK-41853
URL: https://issues.apache.org/jira/browse/SPARK-41853
Project: Spark
Issue Type: Task
Ted Yu created SPARK-42090:
--
Summary: Introduce sasl retry count in RetryingBlockTransferor
Key: SPARK-42090
URL: https://issues.apache.org/jira/browse/SPARK-42090
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-42090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-42090:
---
Description:
Previously a boolean variable, saslTimeoutSeen, was used in
RetryingBlockTransferor. However,
[
https://issues.apache.org/jira/browse/SPARK-23636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527204#comment-16527204
]
Ted Yu commented on SPARK-23636:
It seems in KafkaDataConsumer#close :
{code}
def close
Ted Yu created SPARK-25201:
--
Summary: Synchronization performed on AtomicReference in LevelDB
class
Key: SPARK-25201
URL: https://issues.apache.org/jira/browse/SPARK-25201
Project: Spark
Issue Type
Ted Yu created SPARK-23714:
--
Summary: Add metrics for cached KafkaConsumer
Key: SPARK-23714
URL: https://issues.apache.org/jira/browse/SPARK-23714
Project: Spark
Issue Type: Improvement
Co
[
https://issues.apache.org/jira/browse/SPARK-23714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16403112#comment-16403112
]
Ted Yu commented on SPARK-23714:
[~tdas] made the following suggestion:
apache commons p
[
https://issues.apache.org/jira/browse/SPARK-23714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16403792#comment-16403792
]
Ted Yu commented on SPARK-23714:
Ryan reminded me of the possibility of using the existin
[
https://issues.apache.org/jira/browse/SPARK-23714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416138#comment-16416138
]
Ted Yu commented on SPARK-23714:
[~tdas]:
What do you think ?
Thanks
> Add metrics for
[
https://issues.apache.org/jira/browse/SPARK-21569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472295#comment-16472295
]
Ted Yu commented on SPARK-21569:
What would be workaround ?
Thanks
> Internal Spark cla
[
https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16495580#comment-16495580
]
Ted Yu commented on SPARK-18057:
There are compilation errors in KafkaTestUtils.scala ag
[
https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16497070#comment-16497070
]
Ted Yu commented on SPARK-18057:
I tend to agree with Cody.
Just wondering if other peo
[
https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499535#comment-16499535
]
Ted Yu commented on SPARK-18057:
I have created a PR, shown above.
Kafka 2.0.0 is used
Ted Yu created SPARK-23347:
--
Summary: Introduce buffer between Java data stream and gzip stream
Key: SPARK-23347
URL: https://issues.apache.org/jira/browse/SPARK-23347
Project: Spark
Issue Type: Imp
[
https://issues.apache.org/jira/browse/SPARK-23347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16354907#comment-16354907
]
Ted Yu commented on SPARK-23347:
See JDK 1.8 code:
{code}
class DeflaterOutputStream {
[
https://issues.apache.org/jira/browse/SPARK-23347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16354939#comment-16354939
]
Ted Yu commented on SPARK-23347:
{code}
public final byte[] serialize(Object o) throws
Ted Yu created SPARK-33915:
--
Summary: Allow json expression to be pushable column
Key: SPARK-33915
URL: https://issues.apache.org/jira/browse/SPARK-33915
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-33915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated SPARK-33915:
---
Description:
Currently PushableColumnBase provides no support for json / jsonb expression.
Example of json
[
https://issues.apache.org/jira/browse/SPARK-33915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17254944#comment-17254944
]
Ted Yu commented on SPARK-33915:
I have experimented with two patches which allow json e
101 - 200 of 228 matches
Mail list logo
