Thanks, Even! Can gdalinfo also get all the bands info needed as
GDALGetRasterCount() + GDALGetRasterBand() + GDALGetMetadata() +
GDALGetDescription() ) work together?
> On Mar 19, 2019, at 12:44 PM, Even Rouault wrote:
>
>> On dimanche 10 mars 2019 21:19:30 CET Zhan Zhang - NO
when I say "filter out", I mean "retrieve".
On Sun, Mar 10, 2019 at 9:19 PM Zhan Zhang - NOAA Affiliate <
zhan.j.zh...@noaa.gov> wrote:
> I have a grib2 file which contains many messages, and those messages
> define different products on different surfaces (li
I have a grib2 file which contains many messages, and those messages define
different products on different surfaces (like z axis). For
instance, some messages defines "soil temperature"(product name) on a
surface called "depth below land surface" (surface name); and other
messages define
09:29:41 CET Zhan Zhang - NOAA Affiliate wrote:
> > I am new to the gdal apis and is interested in getting some knowledge of
> > the grib driver. May I ask whether it basically provides the same
> > functionality as degrib from MDL/NWS/NOAA? Thanks! --Zhan
>
> The GDAL
I am new to the gdal apis and is interested in getting some knowledge of
the grib driver. May I ask whether it basically provides the same
functionality as degrib from MDL/NWS/NOAA? Thanks! --Zhan
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
Zhan Zhang created SPARK-23306:
--
Summary: Race condition in TaskMemoryManager
Key: SPARK-23306
URL: https://issues.apache.org/jira/browse/SPARK-23306
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-21505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236365#comment-16236365
]
Zhan Zhang commented on SPARK-21505:
Any comments on this feature? Do you think the design is OK
[
https://issues.apache.org/jira/browse/SPARK-21492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095425#comment-16095425
]
Zhan Zhang commented on SPARK-21492:
root cause: In the SortMergeJoin, inner/leftOuter/rightOuter
Zhan Zhang created SPARK-21492:
--
Summary: Memory leak in SortMergeJoin
Key: SPARK-21492
URL: https://issues.apache.org/jira/browse/SPARK-21492
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-20215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated SPARK-20215:
---
Comment: was deleted
(was: Seems to be fixed in SPARK-20229)
> ReuseExchange is boken in Spark
[
https://issues.apache.org/jira/browse/SPARK-20215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968734#comment-15968734
]
Zhan Zhang commented on SPARK-20215:
Seems to be fixed in SPARK-20229
> ReuseExchange is bo
Zhan Zhang created SPARK-20215:
--
Summary: ReuseExchange is boken in SparkSQL
Key: SPARK-20215
URL: https://issues.apache.org/jira/browse/SPARK-20215
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-20006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931054#comment-15931054
]
Zhan Zhang edited comment on SPARK-20006 at 3/18/17 4:42 AM:
-
The default
[
https://issues.apache.org/jira/browse/SPARK-20006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931054#comment-15931054
]
Zhan Zhang commented on SPARK-20006:
The default ShuffledHashJoin threshold can fallback
[
https://issues.apache.org/jira/browse/SPARK-20006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated SPARK-20006:
---
Description:
Currently both canBroadcast and canBuildLocalHashMap use the same
configuration
Zhan Zhang created SPARK-20006:
--
Summary: Separate threshold for broadcast and shuffled hash join
Key: SPARK-20006
URL: https://issues.apache.org/jira/browse/SPARK-20006
Project: Spark
Issue
Zhan Zhang created SPARK-19908:
--
Summary: Direct buffer memory OOM should not cause stage retries.
Key: SPARK-19908
URL: https://issues.apache.org/jira/browse/SPARK-19908
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-19890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated SPARK-19890:
---
Description:
Currently the MetastoreRelation statistics is retrieved on the analyze phase
Zhan Zhang created SPARK-19890:
--
Summary: Make MetastoreRelation statistics estimation more
accurately
Key: SPARK-19890
URL: https://issues.apache.org/jira/browse/SPARK-19890
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-19839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897975#comment-15897975
]
Zhan Zhang commented on SPARK-19839:
When BytesToBytesMap spills, its longArray should be released
Zhan Zhang created SPARK-19839:
--
Summary: Fix memory leak in BytesToBytesMap
Key: SPARK-19839
URL: https://issues.apache.org/jira/browse/SPARK-19839
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-19815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895522#comment-15895522
]
Zhan Zhang commented on SPARK-19815:
I am thinking the logic again. On the surface, the logic may
[
https://issues.apache.org/jira/browse/SPARK-19815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated SPARK-19815:
---
Summary: Not orderable should be applied to right key instead of left key
(was: Not order able
Zhan Zhang created SPARK-19815:
--
Summary: Not order able should be applied to right key instead of
left key
Key: SPARK-19815
URL: https://issues.apache.org/jira/browse/SPARK-19815
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-19354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862588#comment-15862588
]
Zhan Zhang commented on SPARK-19354:
This fix is actually critical. In production, we found
[
https://issues.apache.org/jira/browse/SPARK-13450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812550#comment-15812550
]
Zhan Zhang commented on SPARK-13450:
ExternalAppendOnlyMap estimate the size of the data saved
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15722901#comment-15722901
]
Zhan Zhang commented on HBASE-15335:
[~tedyu] It seems that I do not have permission to reassign
[
https://issues.apache.org/jira/browse/SPARK-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706961#comment-15706961
]
Zhan Zhang commented on SPARK-18637:
[~hvanhovell] It is an annotation.
/**
* UDFType annotations
[
https://issues.apache.org/jira/browse/SPARK-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706961#comment-15706961
]
Zhan Zhang edited comment on SPARK-18637 at 11/29/16 11:52 PM
[
https://issues.apache.org/jira/browse/SPARK-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated SPARK-18637:
---
Component/s: SQL
> Stateful UDF should be considered as nondeterminis
[
https://issues.apache.org/jira/browse/SPARK-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706905#comment-15706905
]
Zhan Zhang commented on SPARK-18637:
Here is the comments from UDFType
/**
* If a UDF stores
Zhan Zhang created SPARK-18637:
--
Summary: Stateful UDF should be considered as nondeterministic
Key: SPARK-18637
URL: https://issues.apache.org/jira/browse/SPARK-18637
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-18550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688361#comment-15688361
]
Zhan Zhang commented on SPARK-18550:
I was not aware it has been fixed already. Please help to close
Zhan Zhang created SPARK-18550:
--
Summary: Make the queue capacity of LiveListenerBus configurable.
Key: SPARK-18550
URL: https://issues.apache.org/jira/browse/SPARK-18550
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-17637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687474#comment-15687474
]
Zhan Zhang commented on SPARK-17637:
[~hvanhovell] Thanks. PR is updated with conflicts resolved
Hi Folks,
We have some Dataset/Dataframe use cases that will benefit from reuse the
SparkPlan and shuffle stage.
For example, the following cases. Because the query optimization and
sparkplan is generated by catalyst when it is executed, as a result, the
underlying RDD lineage is regenerated
[
https://issues.apache.org/jira/browse/SPARK-17637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15516851#comment-15516851
]
Zhan Zhang commented on SPARK-17637:
[~jerryshao] The idea is straightforward. Instead of doing round
[
https://issues.apache.org/jira/browse/SPARK-17637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515247#comment-15515247
]
Zhan Zhang commented on SPARK-17637:
cc [~rxin]
A quick prototype shows that for a tested pipeline
[
https://issues.apache.org/jira/browse/SPARK-17637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514105#comment-15514105
]
Zhan Zhang commented on SPARK-17637:
The plan is to introduce a new configuration so that different
Zhan Zhang created SPARK-17637:
--
Summary: Packed scheduling for Spark tasks across executors
Key: SPARK-17637
URL: https://issues.apache.org/jira/browse/SPARK-17637
Project: Spark
Issue Type
Zhan Zhang created SPARK-17526:
--
Summary: Display the executor log links with the job failure
message on Spark UI and Console
Key: SPARK-17526
URL: https://issues.apache.org/jira/browse/SPARK-17526
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378457#comment-15378457
]
Zhan Zhang commented on HBASE-15335:
[~tedyu] The scaladoc warning seems to be false positive, as I
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15335:
---
Attachment: HBASE-15335-9.patch
> Add composite key support in row
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15335:
---
Attachment: HBASE-15335-8.patch
> Add composite key support in row
I saw the pom file having hive version as
1.2.1.spark2. But I cannot find the branch in
https://github.com/pwendell/
Does anyone know where the repo is?
Thanks.
Zhan Zhang
--
View this message in context:
http://apache-spark-developers-list.1001551.n3.nabble.com/Anyone-knows-the-hive
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15335:
---
Status: Patch Available (was: Open)
> Add composite key support in row
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15335:
---
Status: Open (was: Patch Available)
> Add composite key support in row
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15335:
---
Status: Open (was: Patch Available)
> Add composite key support in row
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15335:
---
Status: Patch Available (was: Open)
> Add composite key support in row
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15335:
---
Attachment: HBASE-15335-7.patch
> Add composite key support in row
[
https://issues.apache.org/jira/browse/HBASE-16017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-16017:
---
Attachment: HBASE-16017-1.patch
> HBase TableOutputFormat has connection leak in getRecordWri
[
https://issues.apache.org/jira/browse/HBASE-16017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-16017:
---
Attachment: (was: HBASE-16017-1.patch)
> HBase TableOutputFormat has connection l
[
https://issues.apache.org/jira/browse/HBASE-16017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-16017:
---
Status: Patch Available (was: Open)
> HBase TableOutputFormat has connection l
[
https://issues.apache.org/jira/browse/HBASE-16017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328354#comment-15328354
]
Zhan Zhang commented on HBASE-16017:
[~te...@apache.org] Can you please take a look? It is a simple
[
https://issues.apache.org/jira/browse/HBASE-16017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-16017:
---
Attachment: HBASE-16017-1.patch
> HBase TableOutputFormat has connection leak in getRecordWri
Zhan Zhang created HBASE-16017:
--
Summary: HBase TableOutputFormat has connection leak in
getRecordWriter
Key: HBASE-16017
URL: https://issues.apache.org/jira/browse/HBASE-16017
Project: HBase
Zhan Zhang created HBASE-16017:
--
Summary: HBase TableOutputFormat has connection leak in
getRecordWriter
Key: HBASE-16017
URL: https://issues.apache.org/jira/browse/HBASE-16017
Project: HBase
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15335:
---
Attachment: HBASE-15335-6.patch
> Add composite key support in row
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15335:
---
Attachment: HBASE-15335-5.patch
> Add composite key support in row
[
https://issues.apache.org/jira/browse/SPARK-15848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated SPARK-15848:
---
Affects Version/s: 1.6.1
> Spark unable to read partitioned table in avro format and column n
[
https://issues.apache.org/jira/browse/SPARK-15848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323195#comment-15323195
]
Zhan Zhang commented on SPARK-15848:
cat > file1.csv< file2.csv< val tbl = sqlCont
Zhan Zhang created SPARK-15848:
--
Summary: Spark unable to read partitioned table in avro format and
column name in upper case
Key: SPARK-15848
URL: https://issues.apache.org/jira/browse/SPARK-15848
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15335:
---
Attachment: HBASE-15335-4.patch
> Add composite key support in row
[
https://issues.apache.org/jira/browse/HBASE-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15473:
---
Assignee: (was: Zhan Zhang)
> Documentation for the usage of hbase dataframe user api (J
[
https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang reassigned HBASE-14801:
--
Assignee: Zhan Zhang
> Enhance the Spark-HBase connector catalog with json for
[
https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-14801:
---
Assignee: (was: Zhan Zhang)
> Enhance the Spark-HBase connector catalog with json for
[
https://issues.apache.org/jira/browse/SPARK-15441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297881#comment-15297881
]
Zhan Zhang commented on SPARK-15441:
Currently new GenericInternalRow(right.output.length) is used
The reason for "-1" is that the default value for Integer is -1 if the value
is null
def defaultValue(jt: String): String = jt match {
...
case JAVA_INT => "-1"
...
}
--
View this message in context:
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15335:
---
Status: Patch Available (was: Open)
> Add composite key support in row
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15335:
---
Status: Open (was: Patch Available)
> Add composite key support in row
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15335:
---
Attachment: HBASE-15335-3.patch
> Add composite key support in row
[
https://issues.apache.org/jira/browse/HBASE-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289993#comment-15289993
]
Zhan Zhang commented on HBASE-15473:
[~WeiqingYang] is working on this.
> Documentat
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15335:
---
Attachment: HBASE-15335-2.patch
> Add composite key support in row
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15335:
---
Attachment: HBASE-15335-2.patch
> Add composite key support in row
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15335:
---
Attachment: HBASE-15335-2.patch
> Add composite key support in row
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15335:
---
Attachment: (was: HBASE-15335-2.patch)
> Add composite key support in row
[
https://issues.apache.org/jira/browse/HBASE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15335:
---
Attachment: (was: HBASE-15335-2.patch)
> Add composite key support in row
[
https://issues.apache.org/jira/browse/HBASE-15825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284923#comment-15284923
]
Zhan Zhang commented on HBASE-15825:
[~ted_yu] Thanks a lot
> Fix the null poin
[
https://issues.apache.org/jira/browse/HBASE-15825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15825:
---
Status: Patch Available (was: Open)
> Fix the null pointer in DynamicLogicExpressionSu
[
https://issues.apache.org/jira/browse/HBASE-15825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283172#comment-15283172
]
Zhan Zhang commented on HBASE-15825:
[~te...@apache.org] [~jmhsieh] Can you please take a quick look
[
https://issues.apache.org/jira/browse/HBASE-15825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15825:
---
Attachment: HBASE-15825-1.patch
> Fix the null pointer in DynamicLogicExpressionSu
[
https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283159#comment-15283159
]
Zhan Zhang commented on HBASE-15333:
Open jira HBASE-15825 to fix the test case.
> [hbase-sp
Zhan Zhang created HBASE-15825:
--
Summary: Fix the null pointer in DynamicLogicExpressionSuite
Key: HBASE-15825
URL: https://issues.apache.org/jira/browse/HBASE-15825
Project: HBase
Issue Type
Zhan Zhang created HBASE-15825:
--
Summary: Fix the null pointer in DynamicLogicExpressionSuite
Key: HBASE-15825
URL: https://issues.apache.org/jira/browse/HBASE-15825
Project: HBase
Issue Type
[
https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283153#comment-15283153
]
Zhan Zhang commented on HBASE-15333:
Not sure why it is not caught during the systest. The failure
[
https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15333:
---
Attachment: HBASE-15333-10.patch
> Enhance the filter to handle short, integer, long, fl
[
https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15280574#comment-15280574
]
Zhan Zhang commented on HBASE-15333:
[~jmhsieh] Would you like to take a final look? Thanks
[
https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274815#comment-15274815
]
Zhan Zhang commented on HBASE-15333:
I checked the warning, they are false positive.
> Enha
[
https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15333:
---
Attachment: HBASE-15333-9.patch
> Enhance the filter to handle short, integer, long, fl
[
https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15333:
---
Attachment: HBASE-15333-8.patch
> Enhance the filter to handle short, integer, long, fl
[
https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15333:
---
Attachment: HBASE-15333-7.patch
solve warnings
> Enhance the filter to handle short, integer, l
[
https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhan Zhang updated HBASE-15333:
---
Attachment: HBASE-15333-6.patch
Solve review comments. Restructure the encoder as a plugin, so
[
https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15267434#comment-15267434
]
Zhan Zhang commented on HBASE-15333:
Thanks for the feedback, and I will restructure the code
[
https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15260928#comment-15260928
]
Zhan Zhang commented on HBASE-15333:
[~jmhsieh] Thanks for reviewing the code. I want to discuss
struct(1, 2). Please check how the Ordering is
implemented in InterpretedOrdering.
The output itself does not have any ordering. I am not sure why the unit test
and the real env have different environment.
Xiao,
I do see the difference between unit test and local cluster run. Do you know
the reaso
You can try this
https://github.com/hortonworks/shc.git
or here
http://spark-packages.org/package/zhzhan/shc
Currently it is in the process of merging into HBase.
Thanks.
Zhan Zhang
On Apr 21, 2016, at 8:44 AM, Benjamin Kim
<bbuil...@gmail.com<mailto:bbuil...@gmail.com>> wr
INSERT OVERWRITE will overwrite any existing data in the table or partition
* unless IF NOT EXISTS is provided for a partition (as of Hive
0.9.0<https://issues.apache.org/jira/browse/HIVE-2612>).
Thanks.
Zhan Zhang
On Apr 21, 2016, at 3:20 PM, Bijay Kumar Pathak
<bkpat..
You can define your own udf, following is one example
Thanks
Zhan Zhang
val foo = udf((a: Int, b: String) => a.toString + b)
checkAnswer(
// SELECT *, foo(key, value) FROM testData
testData.select($"*", foo('key, 'value)).limit(3),
On Apr 21, 2016, at 8:51 PM, Naveen
.
Thanks.
Zhan Zhang
On Apr 20, 2016, at 1:38 AM, ζζδΌ
<kramer2...@126.com<mailto:kramer2...@126.com>> wrote:
Hi
the input data size is less than 10M. The task result size should be less I
think. Because I am doing aggregation on the data
At 2016-04-20 16:18:31, "Jeff Zhang&qu
You can take a look at this blog from data bricks about GraphFrames
https://databricks.com/blog/2016/03/03/introducing-graphframes.html
Thanks.
Zhan Zhang
On Apr 21, 2016, at 12:53 PM, Robin East
<robin.e...@xense.co.uk<mailto:robin.e...@xense.co.uk>> wrote:
Hi
Aside fro
1 - 100 of 560 matches
Mail list logo
