[
https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14801:
---
Status: Patch Available (was: In Progress)
> Enhance the Spark-HBase connector catalog with j
[
https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14801:
---
Status: In Progress (was: Patch Available)
> Enhance the Spark-HBase connector catalog with j
[
https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14801:
---
Attachment: HBASE-14801-2.patch
> Enhance the Spark-HBase connector catalog with json for
[
https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14801:
---
Attachment: (was: HBASE-14801-2.patch)
> Enhance the Spark-HBase connector catalog with j
Hi James,
You can try to write with other format, e.g., parquet to see whether it is a
orc specific issue or more generic issue.
Thanks.
Zhan Zhang
On Feb 23, 2016, at 6:05 AM, James Barney
<jamesbarne...@gmail.com<mailto:jamesbarne...@gmail.com>> wrote:
I'm trying to write
[
https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15159806#comment-15159806
]
Zhan Zhang commented on HBASE-14801:
Will update the scoreboard after the sanity test by server
[
https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14801:
---
Attachment: HBASE-14801-2.patch
> Enhance the Spark-HBase connector catalog with json for
[
https://issues.apache.org/jira/browse/SPARK-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125205#comment-15125205
]
Zhan Zhang commented on SPARK-7009:
---
Yes. This one is obsoleted.
> Build assembly JAR via ant to av
[
https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118266#comment-15118266
]
Zhan Zhang commented on HBASE-14801:
Looks like most of warning does not apply to this patch. I
[
https://issues.apache.org/jira/browse/SPARK-11075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113560#comment-15113560
]
Zhan Zhang commented on SPARK-11075:
Duplicated to SPARK-5159?
> Spark SQL Thrift Ser
[
https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14801:
---
Attachment: HBASE-14801-1.patch
> Enhance the Spark-HBase connector catalog with json for
[
https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14801:
---
Status: Patch Available (was: Open)
> Enhance the Spark-HBase connector catalog with json for
[
https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15102183#comment-15102183
]
Zhan Zhang commented on SPARK-5159:
---
What happen if an user have a valid visit to a table, which
[
https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15102183#comment-15102183
]
Zhan Zhang edited comment on SPARK-5159 at 1/15/16 5:50 PM:
What happen
[
https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098734#comment-15098734
]
Zhan Zhang commented on SPARK-5159:
---
This issue is definitely broken. But fixing it needs a complete
at
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319)
Thanks,
Zhan Zhang
Zhan Zhang created AMBARI-14601:
---
Summary: Disable impersonation in spark
Key: AMBARI-14601
URL: https://issues.apache.org/jira/browse/AMBARI-14601
Project: Ambari
Issue Type: Bug
[
https://issues.apache.org/jira/browse/AMBARI-14601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091161#comment-15091161
]
Zhan Zhang commented on AMBARI-14601:
-
Currently spark thriftserver cannot do impersonation
[
https://issues.apache.org/jira/browse/AMBARI-14601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated AMBARI-14601:
Attachment: AMBARI-14601.patch
set hive.server2.enable.doAs to false
> Disable impersonat
-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org
[
https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086414#comment-15086414
]
Zhan Zhang commented on HBASE-14801:
I will start to working on this. Please let me know if anyone
[
https://issues.apache.org/jira/browse/HBASE-14796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14796:
---
Attachment: HBASE-14796-1.patch
solve review comments
> Enhance the Gets in the connec
to be materialized in each partition, because
some partition may not have enough number of records, sometimes it is even
empty.
I didn’t see any straightforward walk around for this.
Thanks.
Zhan Zhang
On Dec 23, 2015, at 5:32 PM, 汪洋
<tiandiwo...@icloud.com<mailto:tiandiwo...@icloud.com&g
You are using embedded mode, which will create the db locally (in your case,
maybe the db has been created, but you do not have right permission?).
To connect to remote metastore, hive-site.xml has to be correctly configured.
Thanks.
Zhan Zhang
On Dec 23, 2015, at 7:24 AM, Soni spark
[
https://issues.apache.org/jira/browse/HBASE-14796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14796:
---
Attachment: HBASE-14976.patch
We have use case where bulkget may consists of thousands of gets. Move
[
https://issues.apache.org/jira/browse/HBASE-14796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14796:
---
Release Note: spark.hbase.bulkGetSize in HBaseSparkConf is for grouping
bulkGet, and default value
Now json, parquet, orc(in hivecontext), text are natively supported. If you use
avro or others, you have to include the package, which are not built into spark
jar.
Thanks.
Zhan Zhang
On Dec 23, 2015, at 8:57 AM, Christopher Brady
<christopher.br...@oracle.com<mailto:christop
[
https://issues.apache.org/jira/browse/HBASE-14796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070286#comment-15070286
]
Zhan Zhang commented on HBASE-14796:
Thanks [~ted.m] for the quick review. It is reasonable to have
SQLContext is in driver side, and I don’t think you can use it in executors.
How to provide lookup functionality in executors really depends on how you
would use them.
Thanks.
Zhan Zhang
On Dec 22, 2015, at 4:44 PM, SRK <swethakasire...@gmail.com> wrote:
> Hi,
>
> Can SQL
In what situation, you have such cases? If there is no shuffle, you can
collapse all these functions into one, right? In the meantime, it is not
recommended to collect
all data to driver.
Thanks.
Zhan Zhang
On Dec 21, 2015, at 3:44 AM, Zhiliang Zhu
<zchl.j...@yahoo.com.INVALID<mailto:
application.
Thanks.
Zhan Zhang
On Dec 21, 2015, at 10:43 AM, Zhiliang Zhu
<zchl.j...@yahoo.com.INVALID<mailto:zchl.j...@yahoo.com.INVALID>> wrote:
What is difference between repartition / collect and collapse ...
Is collapse the same costly as collect or repartition ?
Thank
.
Thanks.
Zhan Zhang
Note that when sc is stopped, all resources are released (for example in yarn
On Dec 20, 2015, at 2:59 PM, Jerry Lam <chiling...@gmail.com> wrote:
> Hi Spark developers,
>
> I found that SQLContext.getOrCreate(sc: SparkContext) does not behave
> correctly when
it, at application run time, you can log into the container’s box, and
check the local cache of the container to find whether the log file exists or
not (after app terminate, these local cache files will be deleted as well).
Thanks.
Zhan Zhang
On Dec 18, 2015, at 7:23 AM, Kalpesh Jadhav
<kalpesh.
BTW: It is not only a Yarn-webui issue. In capacity scheduler, vcore is
ignored. If you want Yarn to honor vcore requests, you have to use
DominantResourceCalculator as Saisai suggested.
Thanks.
Zhan Zhang
On Dec 21, 2015, at 5:30 PM, Saisai Shao
<sai.sai.s...@gmail.com<mailto:sai
[
https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14849:
---
Attachment: HBASE-14849-2.patch
Solve review comments.
> Add option to set block cache to fa
[
https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14849:
---
Release Note:
For user configurable parameters for HBase datasources. Please refer
[
https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064656#comment-15064656
]
Zhan Zhang commented on HBASE-14849:
[~ted_yu] Not very familiar with it. Could you clarify which doc
[
https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14849:
---
Attachment: HBASE-14849-1.patch
fix style check. The javadoc warning is not related to this jira
[
https://issues.apache.org/jira/browse/HBASE-14991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14991:
---
Attachment: HBASE-14991-1.patch
Attach the same file to kick off the testing
> Fix the feat
If you want dataframe support, you can refer to https://github.com/zhzhan/shc,
which I am working on to integrate to HBase upstream with existing support.
Thanks.
Zhan Zhang
On Dec 15, 2015, at 4:34 AM, censj
<ce...@lotuseed.com<mailto:ce...@lotuseed.com>> wrote:
hi,fight fa
You should be able to get the logs from yarn by “yarn logs -applicationId xxx”,
where you can possible find the cause.
Thanks.
Zhan Zhang
On Dec 15, 2015, at 11:50 AM, Eran Witkon <eranwit...@gmail.com> wrote:
> When running
> val data = sc.wholeTextFile("someDir/*") d
[
https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058997#comment-15058997
]
Zhan Zhang commented on HBASE-14795:
[~jmhsieh] Thanks for bring this up. I am working on HBASE-14849
[
https://issues.apache.org/jira/browse/YARN-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated YARN-4445:
-
Attachment: YARN-4445-feature-YARN-2928.001.patch
> Unify the term flowId and flowName in timeline
[
https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14849:
---
Status: Open (was: Patch Available)
> Add option to set block cache to false on SparkSQL executi
[
https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14849:
---
Attachment: HBASE-14849.patch
> Add option to set block cache to false on SparkSQL executi
[
https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14849:
---
Status: Patch Available (was: Open)
> Add option to set block cache to false on SparkSQL executi
[
https://issues.apache.org/jira/browse/YARN-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated YARN-4445:
-
Attachment: YARN-4445.patch
> Unify the term flowId and flowName in timeline v2 codeb
[
https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14849:
---
Attachment: HBASE-14849.patch
Migrate hbase configuration to SparkConf, and some cleanup.
>
[
https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14849:
---
Status: Patch Available (was: Open)
> Add option to set block cache to false on SparkSQL executi
[
https://issues.apache.org/jira/browse/YARN-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059212#comment-15059212
]
Zhan Zhang commented on YARN-4445:
--
rename
> Unify the term flowId and flowName in timeline v2 codeb
[
https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14849:
---
Attachment: (was: HBASE-14849.patch)
> Add option to set block cache to false on Spark
[
https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059509#comment-15059509
]
Zhan Zhang commented on HBASE-14795:
[~jmhsieh] I am trying to figure out how to "r
[
https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059498#comment-15059498
]
Zhan Zhang commented on HBASE-14795:
[~jmhsieh] My patch in HBASE-14849 will not fix those three
[
https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059502#comment-15059502
]
Zhan Zhang commented on HBASE-14795:
My mistake. These warning are different from those three
Zhan Zhang created HBASE-14991:
--
Summary: Fix the feature warning in scala code
Key: HBASE-14991
URL: https://issues.apache.org/jira/browse/HBASE-14991
Project: HBase
Issue Type: Bug
Zhan Zhang created HBASE-14991:
--
Summary: Fix the feature warning in scala code
Key: HBASE-14991
URL: https://issues.apache.org/jira/browse/HBASE-14991
Project: HBase
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059533#comment-15059533
]
Zhan Zhang commented on HBASE-14795:
[~jmhsieh] HBASE-14991 is opened for this, and the patch
[
https://issues.apache.org/jira/browse/HBASE-14991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059532#comment-15059532
]
Zhan Zhang commented on HBASE-14991:
@Jonathan Hsieh Please review.
> Fix the feature warn
[
https://issues.apache.org/jira/browse/HBASE-14991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059531#comment-15059531
]
Zhan Zhang commented on HBASE-14991:
Enable feature option and fix feature warning.
>
[
https://issues.apache.org/jira/browse/HBASE-14991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14991:
---
Status: Patch Available (was: Open)
> Fix the feature warning in scala c
[
https://issues.apache.org/jira/browse/HBASE-14991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14991:
---
Attachment: HBASE-14991.patch
> Fix the feature warning in scala c
There are two cases here. If the container is killed by yarn, you can increase
jvm overhead. Otherwise, you have to increase the executor-memory if there is
no memory leak happening.
Thanks.
Zhan Zhang
On Dec 15, 2015, at 9:58 PM, Eran Witkon
<eranwit...@gmail.com<mailto:eranwit...@gma
[
https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059555#comment-15059555
]
Zhan Zhang commented on HBASE-14849:
I use following command, but didn't find any javadoc warning
I noticed that it is configurable in job level spark.task.cpus. Anyway to
support on task level?
Thanks.
Zhan Zhang
On Dec 11, 2015, at 10:46 AM, Zhan Zhang <zzh...@hortonworks.com> wrote:
> Hi Folks,
>
> Is it possible to assign multiple core per task and how? Suppo
I noticed that it is configurable in job level spark.task.cpus. Anyway to
support on task level?
Thanks.
Zhan Zhang
On Dec 11, 2015, at 10:46 AM, Zhan Zhang <zzh...@hortonworks.com> wrote:
> Hi Folks,
>
> Is it possible to assign multiple core per task and how? Suppo
I think you are fetching too many results to the driver. Typically, it is not
recommended to collect much data to driver. But if you have to, you can
increase the driver memory, when submitting jobs.
Thanks.
Zhan Zhang
On Dec 11, 2015, at 6:14 AM, Tom Seddon
<mr.tom.sed...@gmail.
[
https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053169#comment-15053169
]
Zhan Zhang commented on HBASE-14849:
[~ted.m] Please feel free to assign to me.
> Add option to
it make sense to add this feature. It may seems
make user worry about more configuration, but by default we can still do 1 core
per task and only advanced users need to be aware of this feature.
Thanks.
Zhan Zhang
-
To unsubscribe
set if you wan tot
do some performance benchmark.
Thanks.
Zhan Zhang
On Dec 11, 2015, at 9:34 AM, Wei Da <xwd0...@qq.com<mailto:xwd0...@qq.com>>
wrote:
Hi, all
I have done a test in different HW configurations of Spark 1.5.0. A KMeans
algorithm has been ran in four dif
[
https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053168#comment-15053168
]
Zhan Zhang commented on HBASE-14849:
I suggest to put this type of configuration into SparkConf
it make sense to add this feature. It may seems
make user worry about more configuration, but by default we can still do 1 core
per task and only advanced users need to be aware of this feature.
Thanks.
Zhan Zhang
-
To unsubscribe
As Sean mentioned, you cannot referring to the local file in your remote
machine (executors). One walk around is to copy the file to all machines within
same directory.
Thanks.
Zhan Zhang
On Dec 11, 2015, at 10:26 AM, Lin, Hao
<hao@finra.org<mailto:hao@finra.org&g
[
https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051856#comment-15051856
]
Zhan Zhang commented on HBASE-14795:
[~ted.m] Thanks for reviewing this. I have updated
[
https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14795:
---
Attachment: HBASE-14795-4.patch
> Enhance the spark-hbase scan operati
[
https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052024#comment-15052024
]
Zhan Zhang commented on HBASE-14795:
Thanks [~ted.m] and [~ted_yu] for the help. [~ted.m]If you don't
[
https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14795:
---
Attachment: HBASE-14795-3.patch
> Enhance the spark-hbase scan operati
[
https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14795:
---
Attachment: HBASE-14795-2.patch
> Enhance the spark-hbase scan operati
[
https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046013#comment-15046013
]
Zhan Zhang commented on HBASE-14795:
Thanks for reviewing it. I have updated the revised one
[
https://issues.apache.org/jira/browse/HBASE-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14789:
---
Attachment: (was: HBASE-14795-1.patch)
> Enhance the current spark-hbase connec
[
https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14795:
---
Attachment: HBASE-14795-1.patch
solve review comments
> Enhance the spark-hbase scan operati
[
https://issues.apache.org/jira/browse/HBASE-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14789:
---
Attachment: HBASE-14795-1.patch
solve review comments.
> Enhance the current spark-hbase connec
[
https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046297#comment-15046297
]
Zhan Zhang commented on HBASE-14795:
[~malaskat] I forget to publish it. It is available now. Sorry
[
https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15039729#comment-15039729
]
Zhan Zhang commented on HBASE-14795:
Sure. I cannot submit review in review board, and will consult
[
https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14795:
---
Attachment: 0001-HBASE-14795-Enhance-the-spark-hbase-scan-operations.patch
> Enhance the spark-hb
[
https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14795:
---
Status: Patch Available (was: Open)
Initial patch to consolidate hbase-spark scan operations
[
https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014494#comment-15014494
]
Zhan Zhang commented on HBASE-14795:
[~malaskat] The work is in progress. I may send out the PR after
When you have following query, 'account=== “acct1” will be pushdown to generate
new query with “where account = acct1”
Thanks.
Zhan Zhang
On Nov 18, 2015, at 11:36 AM, Eran Medan
<eran.me...@gmail.com<mailto:eran.me...@gmail.com>> wrote:
I understand that the following ar
[
https://issues.apache.org/jira/browse/SPARK-11704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15005682#comment-15005682
]
Zhan Zhang commented on SPARK-11704:
[~maropu] You are right. I mean fetching from network is a big
[
https://issues.apache.org/jira/browse/SPARK-11705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15004744#comment-15004744
]
Zhan Zhang commented on SPARK-11705:
simple reproduce step:
import sqlContext.implicits._
case class
[
https://issues.apache.org/jira/browse/SPARK-11704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15005136#comment-15005136
]
Zhan Zhang edited comment on SPARK-11704 at 11/14/15 5:16 AM:
--
I think we
[
https://issues.apache.org/jira/browse/SPARK-11704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15005134#comment-15005134
]
Zhan Zhang commented on SPARK-11704:
[~maropu] Maybe I misunderstand. If RDD2 is coming from
[
https://issues.apache.org/jira/browse/SPARK-11704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15005136#comment-15005136
]
Zhan Zhang commented on SPARK-11704:
I think we can add a cleanup hook in SQLContext, and when
[
https://issues.apache.org/jira/browse/HBASE-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14789:
---
Summary: Enhance the current spark-hbase connector (was: Provide an
alternative spark-hbase
Zhan Zhang created HBASE-14801:
--
Summary: Enhance the Spark-HBase connector catalog with json format
Key: HBASE-14801
URL: https://issues.apache.org/jira/browse/HBASE-14801
Project: HBase
Issue
Zhan Zhang created HBASE-14801:
--
Summary: Enhance the Spark-HBase connector catalog with json format
Key: HBASE-14801
URL: https://issues.apache.org/jira/browse/HBASE-14801
Project: HBase
Issue
[
https://issues.apache.org/jira/browse/HBASE-14796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14796:
---
Summary: Enhance the Gets in the connector (was: Provide an alternative
spark-hbase SQL
[
https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14795:
---
Summary: Enhance the spark-hbase scan operations (was: Provide an
alternative spark-hbase SQL
[
https://issues.apache.org/jira/browse/HBASE-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14789:
---
Description: This JIRA is to optimize the RDD construction in the current
connector implementation
Zhan Zhang created SPARK-11704:
--
Summary: Optimize the Cartesian Join
Key: SPARK-11704
URL: https://issues.apache.org/jira/browse/SPARK-11704
Project: Spark
Issue Type: Bug
Components
[
https://issues.apache.org/jira/browse/SPARK-11704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated SPARK-11704:
---
Issue Type: Improvement (was: Bug)
> Optimize the Cartesian J
201 - 300 of 560 matches
Mail list logo
