[jira] [Updated] (HIVE-12164) Remove jdbc stats collection mechanism

2015-12-22 Thread Ashutosh Chauhan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-12164:

Hadoop Flags: Incompatible change

> Remove jdbc stats collection mechanism
> --
>
> Key: HIVE-12164
> URL: https://issues.apache.org/jira/browse/HIVE-12164
> Project: Hive
>  Issue Type: Task
>  Components: Statistics
>Affects Versions: 2.0.0
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
>  Labels: TODOC2.0
> Fix For: 2.0.0
>
> Attachments: HIVE-12164.1.patch, HIVE-12164.2.patch, 
> HIVE-12164.3.patch, HIVE-12164.patch
>
>
> Though there are some deployments using it, usually its painful to setup 
> since a valid hive-site.xml is needed on all task nodes (containing 
> connection details) and for large tasks (with thousands of tasks) results in 
> a scalability issue with all of them hammering DB at nearly same time.
> Because of these pain points alternative stats collection mechanism were 
> added. FS stats based system is default for some time.
> We should remove jdbc stats collection mechanism as it needlessly adds 
> complexity in TS and FS operators w.r.t key handling.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-12164) Remove jdbc stats collection mechanism

2015-10-18 Thread Lefty Leverenz (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lefty Leverenz updated HIVE-12164:
--
Labels: TODOC2.0  (was: )

> Remove jdbc stats collection mechanism
> --
>
> Key: HIVE-12164
> URL: https://issues.apache.org/jira/browse/HIVE-12164
> Project: Hive
>  Issue Type: Task
>  Components: Statistics
>Affects Versions: 2.0.0
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
>  Labels: TODOC2.0
> Fix For: 2.0.0
>
> Attachments: HIVE-12164.1.patch, HIVE-12164.2.patch, 
> HIVE-12164.3.patch, HIVE-12164.patch
>
>
> Though there are some deployments using it, usually its painful to setup 
> since a valid hive-site.xml is needed on all task nodes (containing 
> connection details) and for large tasks (with thousands of tasks) results in 
> a scalability issue with all of them hammering DB at nearly same time.
> Because of these pain points alternative stats collection mechanism were 
> added. FS stats based system is default for some time.
> We should remove jdbc stats collection mechanism as it needlessly adds 
> complexity in TS and FS operators w.r.t key handling.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-12164) Remove jdbc stats collection mechanism

2015-10-17 Thread Ashutosh Chauhan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-12164:

Affects Version/s: 2.0.0

> Remove jdbc stats collection mechanism
> --
>
> Key: HIVE-12164
> URL: https://issues.apache.org/jira/browse/HIVE-12164
> Project: Hive
>  Issue Type: Task
>  Components: Statistics
>Affects Versions: 2.0.0
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
> Fix For: 2.0.0
>
> Attachments: HIVE-12164.1.patch, HIVE-12164.2.patch, 
> HIVE-12164.3.patch, HIVE-12164.patch
>
>
> Though there are some deployments using it, usually its painful to setup 
> since a valid hive-site.xml is needed on all task nodes (containing 
> connection details) and for large tasks (with thousands of tasks) results in 
> a scalability issue with all of them hammering DB at nearly same time.
> Because of these pain points alternative stats collection mechanism were 
> added. FS stats based system is default for some time.
> We should remove jdbc stats collection mechanism as it needlessly adds 
> complexity in TS and FS operators w.r.t key handling.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-12164) Remove jdbc stats collection mechanism

2015-10-17 Thread Ashutosh Chauhan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-12164:

Attachment: HIVE-12164.3.patch

> Remove jdbc stats collection mechanism
> --
>
> Key: HIVE-12164
> URL: https://issues.apache.org/jira/browse/HIVE-12164
> Project: Hive
>  Issue Type: Task
>  Components: Statistics
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-12164.1.patch, HIVE-12164.2.patch, 
> HIVE-12164.3.patch, HIVE-12164.patch
>
>
> Though there are some deployments using it, usually its painful to setup 
> since a valid hive-site.xml is needed on all task nodes (containing 
> connection details) and for large tasks (with thousands of tasks) results in 
> a scalability issue with all of them hammering DB at nearly same time.
> Because of these pain points alternative stats collection mechanism were 
> added. FS stats based system is default for some time.
> We should remove jdbc stats collection mechanism as it needlessly adds 
> complexity in TS and FS operators w.r.t key handling.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-12164) Remove jdbc stats collection mechanism

2015-10-16 Thread Ashutosh Chauhan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-12164:

Attachment: HIVE-12164.2.patch

Addressed Pengcheng's comments.

> Remove jdbc stats collection mechanism
> --
>
> Key: HIVE-12164
> URL: https://issues.apache.org/jira/browse/HIVE-12164
> Project: Hive
>  Issue Type: Task
>  Components: Statistics
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-12164.1.patch, HIVE-12164.2.patch, HIVE-12164.patch
>
>
> Though there are some deployments using it, usually its painful to setup 
> since a valid hive-site.xml is needed on all task nodes (containing 
> connection details) and for large tasks (with thousands of tasks) results in 
> a scalability issue with all of them hammering DB at nearly same time.
> Because of these pain points alternative stats collection mechanism were 
> added. FS stats based system is default for some time.
> We should remove jdbc stats collection mechanism as it needlessly adds 
> complexity in TS and FS operators w.r.t key handling.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-12164) Remove jdbc stats collection mechanism

2015-10-15 Thread Ashutosh Chauhan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-12164:

Attachment: HIVE-12164.1.patch

> Remove jdbc stats collection mechanism
> --
>
> Key: HIVE-12164
> URL: https://issues.apache.org/jira/browse/HIVE-12164
> Project: Hive
>  Issue Type: Task
>  Components: Statistics
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-12164.1.patch, HIVE-12164.patch
>
>
> Though there are some deployments using it, usually its painful to setup 
> since a valid hive-site.xml is needed on all task nodes (containing 
> connection details) and for large tasks (with thousands of tasks) results in 
> a scalability issue with all of them hammering DB at nearly same time.
> Because of these pain points alternative stats collection mechanism were 
> added. FS stats based system is default for some time.
> We should remove jdbc stats collection mechanism as it needlessly adds 
> complexity in TS and FS operators w.r.t key handling.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-12164) Remove jdbc stats collection mechanism

2015-10-14 Thread Ashutosh Chauhan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-12164:

Attachment: HIVE-12164.patch

> Remove jdbc stats collection mechanism
> --
>
> Key: HIVE-12164
> URL: https://issues.apache.org/jira/browse/HIVE-12164
> Project: Hive
>  Issue Type: Task
>  Components: Statistics
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-12164.patch
>
>
> Though there are some deployments using it, usually its painful to setup 
> since a valid hive-site.xml is needed on all task nodes (containing 
> connection details) and for large tasks (with thousands of tasks) results in 
> a scalability issue with all of them hammering DB at nearly same time.
> Because of these pain points alternative stats collection mechanism were 
> added. FS stats based system is default for some time.
> We should remove jdbc stats collection mechanism as it needlessly adds 
> complexity in TS and FS operators w.r.t key handling.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)