[jira] [Commented] (HIVE-2777) ability to add and drop partitions atomically

2014-05-02 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13988029#comment-13988029 ] Steven Wong commented on HIVE-2777: --- ASF.LICENSE.NOT.GRANTED--HIVE-2777.D2271.1.patch

Re: Patch available for HIVE-6104

2014-01-30 Thread Steven Wong
What does it take to get this bug fix reviewed and committed? If I am not following the proper procedure, do let me know, don't ignore the jira. Thanks. On Thu, Jan 23, 2014 at 5:06 PM, Steven Wong sw...@netflix.com wrote: *bump* Any chance someone will look at this patch? :) It should

[jira] [Commented] (HIVE-6104) Join-key logging in join operator

2014-01-30 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13886996#comment-13886996 ] Steven Wong commented on HIVE-6104: --- Can someone please review and commit this bug fix

Re: Patch available for HIVE-6104

2014-01-30 Thread Steven Wong
wrote: For some reason, gmail marked your mail as spam. It might have happened for others too. Can you try sending this mail from other email id? so that it gets noticed by everyone.. Thanks Prasanth Jayachandran On Jan 30, 2014, at 11:41 AM, Steven Wong sw...@netflix.com wrote: What does

Re: Patch available for HIVE-6104

2014-01-30 Thread Steven Wong
, Steven Wong sw...@netflix.com wrote: It is unfortunate that Gmail flagged my email (or my email address or domain) for you, considering I used Gmail to send it! Prasanth, thanks for your response. Vikram Dixit K said he will look at the patch. On Thu, Jan 30, 2014 at 1:28 PM, Prasanth

[jira] [Commented] (HIVE-6104) Join-key logging in join operator

2014-01-30 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13887208#comment-13887208 ] Steven Wong commented on HIVE-6104: --- Thanks, Vikram! Join-key logging in join operator

Rare ORC bug when used with preemption

2014-01-29 Thread Steven Wong
We had a Hive MR job writing to a table using the ORC file format. The cluster had fair share scheduler with task preemption enabled. For one of the job's reduce tasks, task attempt 0 finished putting the output file to the final location and, before it completed, was killed by preemption. All

Re: Patch available for HIVE-6104

2014-01-23 Thread Steven Wong
*bump* Any chance someone will look at this patch? :) It should be a pretty quick review. On Mon, Jan 13, 2014 at 1:41 PM, Steven Wong sw...@netflix.com wrote: Hi devs, Would someone please review the patch for HIVE-6104https://issues.apache.org/jira/browse/HIVE-6104? It is a very small

Patch available for HIVE-6104

2014-01-13 Thread Steven Wong
Hi devs, Would someone please review the patch for HIVE-6104https://issues.apache.org/jira/browse/HIVE-6104? It is a very small patch that should be easy to review and commit. Thanks in advance. Steven

Review Request 16836: HIVE-6104 - Join-key logging in join operator

2014-01-13 Thread Steven Wong
://reviews.apache.org/r/16836/diff/ Testing --- Manually ran a join and checked the log file. Thanks, Steven Wong

[jira] [Commented] (HIVE-6104) Join-key logging in join operator

2014-01-13 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13870145#comment-13870145 ] Steven Wong commented on HIVE-6104: --- https://reviews.apache.org/r/16836/ (my bad

[jira] [Updated] (HIVE-6104) Join-key logging in join operator

2013-12-26 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong updated HIVE-6104: -- Fix Version/s: 0.13.0 Join-key logging in join operator

[jira] [Created] (HIVE-6104) Join-key logging in join operator

2013-12-23 Thread Steven Wong (JIRA)
Steven Wong created HIVE-6104: - Summary: Join-key logging in join operator Key: HIVE-6104 URL: https://issues.apache.org/jira/browse/HIVE-6104 Project: Hive Issue Type: Bug Components

[jira] [Updated] (HIVE-6104) Join-key logging in join operator

2013-12-23 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong updated HIVE-6104: -- Attachment: HIVE-6104.patch Join-key logging in join operator

[jira] [Updated] (HIVE-6104) Join-key logging in join operator

2013-12-23 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong updated HIVE-6104: -- Status: Patch Available (was: Open) Join-key logging in join operator

[jira] [Updated] (HIVE-6104) Join-key logging in join operator

2013-12-23 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong updated HIVE-6104: -- Affects Version/s: 0.12.0 Join-key logging in join operator

[jira] [Updated] (HIVE-6104) Join-key logging in join operator

2013-12-23 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong updated HIVE-6104: -- Description: JoinOperator.processOp logs lines like table 0 has x rows for join key \[foo

[jira] [Commented] (HIVE-6104) Join-key logging in join operator

2013-12-23 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13856171#comment-13856171 ] Steven Wong commented on HIVE-6104: --- I don't think the above test failure is related

[jira] [Commented] (HIVE-4574) XMLEncoder thread safety issues in openjdk7 causes HiveServer2 to be stuck

2013-12-11 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845856#comment-13845856 ] Steven Wong commented on HIVE-4574: --- [https://bugs.openjdk.java.net/browse/JDK-8028054

[jira] [Updated] (HIVE-5418) Integer overflow bug in ConditionalResolverCommonJoin.AliasFileSizePair

2013-10-11 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong updated HIVE-5418: -- Affects Version/s: 0.12.0 Integer overflow bug in ConditionalResolverCommonJoin.AliasFileSizePair

[jira] [Updated] (HIVE-5418) Integer overflow bug in ConditionalResolverCommonJoin.AliasFileSizePair

2013-10-03 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong updated HIVE-5418: -- Affects Version/s: 0.13.0 Integer overflow bug in ConditionalResolverCommonJoin.AliasFileSizePair

[jira] [Updated] (HIVE-5418) Integer overflow bug in ConditionalResolverCommonJoin.AliasFileSizePair

2013-10-02 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong updated HIVE-5418: -- Attachment: HIVE-5418.1.patch Integer overflow bug in ConditionalResolverCommonJoin.AliasFileSizePair

[jira] [Commented] (HIVE-5418) Integer overflow bug in ConditionalResolverCommonJoin.AliasFileSizePair

2013-10-02 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13784740#comment-13784740 ] Steven Wong commented on HIVE-5418: --- The patch is applicable to trunk as well as branch

[jira] [Assigned] (HIVE-5418) Integer overflow bug in ConditionalResolverCommonJoin.AliasFileSizePair

2013-10-01 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong reassigned HIVE-5418: - Assignee: Steven Wong Integer overflow bug in ConditionalResolverCommonJoin.AliasFileSizePair

[jira] [Created] (HIVE-5418) Integer overflow bug in ConditionalResolverCommonJoin.AliasFileSizePair

2013-10-01 Thread Steven Wong (JIRA)
Steven Wong created HIVE-5418: - Summary: Integer overflow bug in ConditionalResolverCommonJoin.AliasFileSizePair Key: HIVE-5418 URL: https://issues.apache.org/jira/browse/HIVE-5418 Project: Hive

[jira] [Updated] (HIVE-5418) Integer overflow bug in ConditionalResolverCommonJoin.AliasFileSizePair

2013-10-01 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong updated HIVE-5418: -- Attachment: HIVE-5418.0.patch Integer overflow bug in ConditionalResolverCommonJoin.AliasFileSizePair

[jira] [Updated] (HIVE-5418) Integer overflow bug in ConditionalResolverCommonJoin.AliasFileSizePair

2013-10-01 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong updated HIVE-5418: -- Status: Patch Available (was: Open) Integer overflow bug

[jira] [Updated] (HIVE-3104) Predicate pushdown doesn't work with multi-insert statements using LATERAL VIEW

2013-08-29 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong updated HIVE-3104: -- Description: Predicate pushdown seems to work for single-insert queries using LATERAL VIEW. It also

[jira] [Updated] (HIVE-3104) Predicate pushdown doesn't work with multi-insert statements using LATERAL VIEW

2013-08-29 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong updated HIVE-3104: -- Description: Predicate pushdown seems to work for single-insert queries using LATERAL VIEW. It also

[jira] [Commented] (HIVE-5124) group by without map aggregation lead to mapreduce exception

2013-08-21 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13747001#comment-13747001 ] Steven Wong commented on HIVE-5124: --- Would you please provide a repro case

[jira] [Commented] (HIVE-967) Implement show create table

2012-09-13 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13455158#comment-13455158 ] Steven Wong commented on HIVE-967: -- @Kevin, https://cwiki.apache.org/confluence/display

Phabricator login problem

2012-09-11 Thread Steven Wong
I tried to log in to Phabricator using my GitHub account, but after entering user name and password correctly, I'm landed on this page https://reviews.facebook.net/oauth/github/login/?code=c440e14489ef15596a83state= which reads: GitHub Auth Failed Unable to authenticate with GitHub. There are

[jira] [Commented] (HIVE-967) Implement show create table

2012-09-11 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13453441#comment-13453441 ] Steven Wong commented on HIVE-967: -- I'm having trouble with Fabricator login, so here's my

[jira] [Commented] (HIVE-581) improve group by syntax

2012-05-12 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13273876#comment-13273876 ] Steven Wong commented on HIVE-581: -- I actually agree with Namit's first instinct

[jira] [Commented] (HIVE-581) improve group by syntax

2012-05-11 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13273789#comment-13273789 ] Steven Wong commented on HIVE-581: -- Namit, It may well be a bug. At least I never have

[jira] [Commented] (HIVE-581) improve group by syntax

2012-05-10 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272976#comment-13272976 ] Steven Wong commented on HIVE-581: -- But grouping by column position breaks existing scripts

FW: Post-gres Hive Metastore

2012-02-09 Thread Steven Wong
-Original Message- From: Kevin Wilfong [mailto:kevinwilf...@fb.com] Sent: Thursday, February 09, 2012 10:59 AM To: dev@hive.apache.org Subject: Post-gres Hive Metastore Hello, Does anyone still use postgres as the Hive metastore SQL backend? I'm in the process of writing scripts to

[jira] [Commented] (HIVE-2612) support hive table/partitions coexistes in more than one clusters

2012-01-17 Thread Steven Wong (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13188183#comment-13188183 ] Steven Wong commented on HIVE-2612: --- Yongqiang, please clarify what you mean by option 3

[jira] [Commented] (HIVE-2612) support hive table/partitions coexistes in more than one clusters

2012-01-17 Thread Steven Wong (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13188322#comment-13188322 ] Steven Wong commented on HIVE-2612: --- Won't that conflict with authorization

RE: pass entire row as parameter in hive UDF

2011-11-01 Thread Steven Wong
Would https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Select#LanguageManualSelect-REGEXColumnSpecification work for you in the meantime? From: Chen Song [mailto:chens_alb...@yahoo.com] Sent: Monday, October 31, 2011 9:15 AM To: hive dev list; hive user list Subject: pass entire

[jira] [Commented] (HIVE-1332) Archiving partitions

2011-10-23 Thread Steven Wong (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13133587#comment-13133587 ] Steven Wong commented on HIVE-1332: --- If an archive operation runs when a select query

RE: Hive in EC2

2011-08-31 Thread Steven Wong
When you launch an EMR cluster (or job flow in EMR terminology), it launches new EC2 instances, optionally with an Elastic IP assigned to the cluster's master host. One does not install EMR on existing EC2 (non-EMR) instances. -Original Message- From: MIS [mailto:misapa...@gmail.com]

RE: number of maptasks of hive

2011-07-18 Thread Steven Wong
What input format are you using in Hive? (It should be the one specified by the hive.input.format setting.) -Original Message- From: 牛兆捷 [mailto:nzjem...@gmail.com] Sent: Sunday, July 17, 2011 10:26 PM To: dev@hive.apache.org Subject: number of maptasks of hive Does hive split input

[jira] [Commented] (HIVE-1841) datanucleus.fixedDatastore should be true in hive-default.xml

2011-07-11 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13063474#comment-13063474 ] Steven Wong commented on HIVE-1841: --- Unfortunately, if both datanucleus.{autoCreateSchema

[jira] [Commented] (HIVE-746) constant folding

2011-06-09 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13046837#comment-13046837 ] Steven Wong commented on HIVE-746: -- For a query like: select * from src where partcol

[jira] [Updated] (HIVE-1019) java.io.FileNotFoundException: HIVE_PLAN (No such file or directory)

2011-05-09 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong updated HIVE-1019: -- Component/s: Server Infrastructure java.io.FileNotFoundException: HIVE_PLAN (No such file or directory

[jira] [Commented] (HIVE-2087) Dynamic partition insert performance problem

2011-05-09 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13030836#comment-13030836 ] Steven Wong commented on HIVE-2087: --- This problem seems to happen only when

[jira] [Updated] (HIVE-2150) Sampling fails after dynamic-partition insert into a bucketed s3n table

2011-05-04 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong updated HIVE-2150: -- Description: When using dynamic-partition insert and bucketing together on an s3n table, the insert

[jira] Resolved: (HIVE-1957) Complete data could not be retrieved using ResultSet API's when some of the input record column values are blank.

2011-02-09 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong resolved HIVE-1957. --- Resolution: Duplicate Should have been fixed by HIVE-1378. Complete data could not be retrieved

[jira] Resolved: (HIVE-1972) HiveResultset is always returning null for Array Data types in the select Query

2011-02-09 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong resolved HIVE-1972. --- Resolution: Duplicate Should have been fixed by HIVE-1378. HiveResultset is always returning null

[jira] Commented: (HIVE-1815) The class HiveResultSet should implement batch fetching.

2011-01-06 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12978476#action_12978476 ] Steven Wong commented on HIVE-1815: --- Using fetchN will be nice. The Hive driver should use

[jira] Updated: (HIVE-1815) The class HiveResultSet should implement batch fetching.

2011-01-06 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong updated HIVE-1815: -- Fix Version/s: (was: 0.6.0) The class HiveResultSet should implement batch fetching

[jira] Commented: (HIVE-1860) Hive's smallint datatype is not supported by the Hive JDBC driver

2010-12-23 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12974732#action_12974732 ] Steven Wong commented on HIVE-1860: --- This should have been fixed by HIVE-1378 in trunk

[jira] Commented: (HIVE-1861) Hive's float datatype is not supported by the Hive JDBC driver

2010-12-23 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12974731#action_12974731 ] Steven Wong commented on HIVE-1861: --- This should have been fixed by HIVE-1378 in trunk

[jira] Commented: (HIVE-1859) Hive's tinyint datatype is not supported by the Hive JDBC driver

2010-12-23 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12974733#action_12974733 ] Steven Wong commented on HIVE-1859: --- This should have been fixed by HIVE-1378 in trunk

[jira] Commented: (HIVE-1816) Reporting of (seemingly inconsequential) transport exception has major impact on performance

2010-11-30 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12965457#action_12965457 ] Steven Wong commented on HIVE-1816: --- HiveResultSet stops using DynamicSerDe in 0.7, so