[jira] Updated: (HIVE-1032) Better Error Messages for Execution Errors
[ https://issues.apache.org/jira/browse/HIVE-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-1032: - Resolution: Fixed Fix Version/s: 0.6.0 Release Note: HIVE-1032. Better Error Messages for Execution Errors. (Paul Yang via zshao) Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Committed. Thanks Paul! > Better Error Messages for Execution Errors > -- > > Key: HIVE-1032 > URL: https://issues.apache.org/jira/browse/HIVE-1032 > Project: Hadoop Hive > Issue Type: New Feature > Components: Query Processor >Affects Versions: 0.6.0 >Reporter: Paul Yang >Assignee: Paul Yang > Fix For: 0.6.0 > > Attachments: HIVE-1032.1.patch, HIVE-1032.2.patch, HIVE-1032.3.patch, > HIVE-1032.4.patch, HIVE-1032.5.patch, HIVE-1032.6.patch > > > Three common errors that occur during execution are: > 1. Map-side group-by causing an out of memory exception due to large > aggregation hash tables > 2. ScriptOperator failing due to the user's script throwing an exception or > otherwise returning a non-zero error code > 3. Incorrectly specifying the join order of small and large tables, causing > the large table to be loaded into memory and producing an out of memory > exception. > These errors are typically discovered by manually examining the error log > files of the failed task. This task proposes to create a feature that would > automatically read the error logs and output a probable cause and solution to > the command line. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1032) Better Error Messages for Execution Errors
[ https://issues.apache.org/jira/browse/HIVE-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang updated HIVE-1032: Status: Patch Available (was: Open) > Better Error Messages for Execution Errors > -- > > Key: HIVE-1032 > URL: https://issues.apache.org/jira/browse/HIVE-1032 > Project: Hadoop Hive > Issue Type: New Feature > Components: Query Processor >Affects Versions: 0.6.0 >Reporter: Paul Yang >Assignee: Paul Yang > Attachments: HIVE-1032.1.patch, HIVE-1032.2.patch, HIVE-1032.3.patch, > HIVE-1032.4.patch, HIVE-1032.5.patch, HIVE-1032.6.patch > > > Three common errors that occur during execution are: > 1. Map-side group-by causing an out of memory exception due to large > aggregation hash tables > 2. ScriptOperator failing due to the user's script throwing an exception or > otherwise returning a non-zero error code > 3. Incorrectly specifying the join order of small and large tables, causing > the large table to be loaded into memory and producing an out of memory > exception. > These errors are typically discovered by manually examining the error log > files of the failed task. This task proposes to create a feature that would > automatically read the error logs and output a probable cause and solution to > the command line. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1032) Better Error Messages for Execution Errors
[ https://issues.apache.org/jira/browse/HIVE-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang updated HIVE-1032: Attachment: HIVE-1032.6.patch * Fixed checkstyle issues > Better Error Messages for Execution Errors > -- > > Key: HIVE-1032 > URL: https://issues.apache.org/jira/browse/HIVE-1032 > Project: Hadoop Hive > Issue Type: New Feature > Components: Query Processor >Affects Versions: 0.6.0 >Reporter: Paul Yang >Assignee: Paul Yang > Attachments: HIVE-1032.1.patch, HIVE-1032.2.patch, HIVE-1032.3.patch, > HIVE-1032.4.patch, HIVE-1032.5.patch, HIVE-1032.6.patch > > > Three common errors that occur during execution are: > 1. Map-side group-by causing an out of memory exception due to large > aggregation hash tables > 2. ScriptOperator failing due to the user's script throwing an exception or > otherwise returning a non-zero error code > 3. Incorrectly specifying the join order of small and large tables, causing > the large table to be loaded into memory and producing an out of memory > exception. > These errors are typically discovered by manually examining the error log > files of the failed task. This task proposes to create a feature that would > automatically read the error logs and output a probable cause and solution to > the command line. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1032) Better Error Messages for Execution Errors
[ https://issues.apache.org/jira/browse/HIVE-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-1032: - Status: Open (was: Patch Available) > Better Error Messages for Execution Errors > -- > > Key: HIVE-1032 > URL: https://issues.apache.org/jira/browse/HIVE-1032 > Project: Hadoop Hive > Issue Type: New Feature > Components: Query Processor >Affects Versions: 0.6.0 >Reporter: Paul Yang >Assignee: Paul Yang > Attachments: HIVE-1032.1.patch, HIVE-1032.2.patch, HIVE-1032.3.patch, > HIVE-1032.4.patch, HIVE-1032.5.patch > > > Three common errors that occur during execution are: > 1. Map-side group-by causing an out of memory exception due to large > aggregation hash tables > 2. ScriptOperator failing due to the user's script throwing an exception or > otherwise returning a non-zero error code > 3. Incorrectly specifying the join order of small and large tables, causing > the large table to be loaded into memory and producing an out of memory > exception. > These errors are typically discovered by manually examining the error log > files of the failed task. This task proposes to create a feature that would > automatically read the error logs and output a probable cause and solution to > the command line. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1032) Better Error Messages for Execution Errors
[ https://issues.apache.org/jira/browse/HIVE-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang updated HIVE-1032: Affects Version/s: 0.6.0 Status: Patch Available (was: Open) > Better Error Messages for Execution Errors > -- > > Key: HIVE-1032 > URL: https://issues.apache.org/jira/browse/HIVE-1032 > Project: Hadoop Hive > Issue Type: New Feature > Components: Query Processor >Affects Versions: 0.6.0 >Reporter: Paul Yang >Assignee: Paul Yang > Attachments: HIVE-1032.1.patch, HIVE-1032.2.patch, HIVE-1032.3.patch, > HIVE-1032.4.patch, HIVE-1032.5.patch > > > Three common errors that occur during execution are: > 1. Map-side group-by causing an out of memory exception due to large > aggregation hash tables > 2. ScriptOperator failing due to the user's script throwing an exception or > otherwise returning a non-zero error code > 3. Incorrectly specifying the join order of small and large tables, causing > the large table to be loaded into memory and producing an out of memory > exception. > These errors are typically discovered by manually examining the error log > files of the failed task. This task proposes to create a feature that would > automatically read the error logs and output a probable cause and solution to > the command line. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1032) Better Error Messages for Execution Errors
[ https://issues.apache.org/jira/browse/HIVE-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang updated HIVE-1032: Attachment: HIVE-1032.5.patch > Better Error Messages for Execution Errors > -- > > Key: HIVE-1032 > URL: https://issues.apache.org/jira/browse/HIVE-1032 > Project: Hadoop Hive > Issue Type: New Feature > Components: Query Processor >Affects Versions: 0.6.0 >Reporter: Paul Yang >Assignee: Paul Yang > Attachments: HIVE-1032.1.patch, HIVE-1032.2.patch, HIVE-1032.3.patch, > HIVE-1032.4.patch, HIVE-1032.5.patch > > > Three common errors that occur during execution are: > 1. Map-side group-by causing an out of memory exception due to large > aggregation hash tables > 2. ScriptOperator failing due to the user's script throwing an exception or > otherwise returning a non-zero error code > 3. Incorrectly specifying the join order of small and large tables, causing > the large table to be loaded into memory and producing an out of memory > exception. > These errors are typically discovered by manually examining the error log > files of the failed task. This task proposes to create a feature that would > automatically read the error logs and output a probable cause and solution to > the command line. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1032) Better Error Messages for Execution Errors
[ https://issues.apache.org/jira/browse/HIVE-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-1032: - Status: Open (was: Patch Available) > Better Error Messages for Execution Errors > -- > > Key: HIVE-1032 > URL: https://issues.apache.org/jira/browse/HIVE-1032 > Project: Hadoop Hive > Issue Type: New Feature > Components: Query Processor >Reporter: Paul Yang >Assignee: Paul Yang > Attachments: HIVE-1032.1.patch, HIVE-1032.2.patch, HIVE-1032.3.patch, > HIVE-1032.4.patch > > > Three common errors that occur during execution are: > 1. Map-side group-by causing an out of memory exception due to large > aggregation hash tables > 2. ScriptOperator failing due to the user's script throwing an exception or > otherwise returning a non-zero error code > 3. Incorrectly specifying the join order of small and large tables, causing > the large table to be loaded into memory and producing an out of memory > exception. > These errors are typically discovered by manually examining the error log > files of the failed task. This task proposes to create a feature that would > automatically read the error logs and output a probable cause and solution to > the command line. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1032) Better Error Messages for Execution Errors
[ https://issues.apache.org/jira/browse/HIVE-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang updated HIVE-1032: Status: Patch Available (was: Open) > Better Error Messages for Execution Errors > -- > > Key: HIVE-1032 > URL: https://issues.apache.org/jira/browse/HIVE-1032 > Project: Hadoop Hive > Issue Type: New Feature > Components: Query Processor >Reporter: Paul Yang >Assignee: Paul Yang > Attachments: HIVE-1032.1.patch, HIVE-1032.2.patch, HIVE-1032.3.patch, > HIVE-1032.4.patch > > > Three common errors that occur during execution are: > 1. Map-side group-by causing an out of memory exception due to large > aggregation hash tables > 2. ScriptOperator failing due to the user's script throwing an exception or > otherwise returning a non-zero error code > 3. Incorrectly specifying the join order of small and large tables, causing > the large table to be loaded into memory and producing an out of memory > exception. > These errors are typically discovered by manually examining the error log > files of the failed task. This task proposes to create a feature that would > automatically read the error logs and output a probable cause and solution to > the command line. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1032) Better Error Messages for Execution Errors
[ https://issues.apache.org/jira/browse/HIVE-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang updated HIVE-1032: Attachment: HIVE-1032.4.patch * Incorporated Zheng's comments, removed isMapTask flag. For the data split error condition, I only checked for the EOFException. Is that good enough? > Better Error Messages for Execution Errors > -- > > Key: HIVE-1032 > URL: https://issues.apache.org/jira/browse/HIVE-1032 > Project: Hadoop Hive > Issue Type: New Feature > Components: Query Processor >Reporter: Paul Yang >Assignee: Paul Yang > Attachments: HIVE-1032.1.patch, HIVE-1032.2.patch, HIVE-1032.3.patch, > HIVE-1032.4.patch > > > Three common errors that occur during execution are: > 1. Map-side group-by causing an out of memory exception due to large > aggregation hash tables > 2. ScriptOperator failing due to the user's script throwing an exception or > otherwise returning a non-zero error code > 3. Incorrectly specifying the join order of small and large tables, causing > the large table to be loaded into memory and producing an out of memory > exception. > These errors are typically discovered by manually examining the error log > files of the failed task. This task proposes to create a feature that would > automatically read the error logs and output a probable cause and solution to > the command line. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1032) Better Error Messages for Execution Errors
[ https://issues.apache.org/jira/browse/HIVE-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang updated HIVE-1032: Attachment: HIVE-1032.3.patch * Removed the join order error message as it seems that HIVE-963 fixed it * Added flag to indicate whether the log came from a map or reduce task > Better Error Messages for Execution Errors > -- > > Key: HIVE-1032 > URL: https://issues.apache.org/jira/browse/HIVE-1032 > Project: Hadoop Hive > Issue Type: New Feature > Components: Query Processor >Reporter: Paul Yang >Assignee: Paul Yang > Attachments: HIVE-1032.1.patch, HIVE-1032.2.patch, HIVE-1032.3.patch > > > Three common errors that occur during execution are: > 1. Map-side group-by causing an out of memory exception due to large > aggregation hash tables > 2. ScriptOperator failing due to the user's script throwing an exception or > otherwise returning a non-zero error code > 3. Incorrectly specifying the join order of small and large tables, causing > the large table to be loaded into memory and producing an out of memory > exception. > These errors are typically discovered by manually examining the error log > files of the failed task. This task proposes to create a feature that would > automatically read the error logs and output a probable cause and solution to > the command line. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1032) Better Error Messages for Execution Errors
[ https://issues.apache.org/jira/browse/HIVE-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang updated HIVE-1032: Attachment: HIVE-1032.2.patch * Resolved conflict > Better Error Messages for Execution Errors > -- > > Key: HIVE-1032 > URL: https://issues.apache.org/jira/browse/HIVE-1032 > Project: Hadoop Hive > Issue Type: New Feature > Components: Query Processor >Reporter: Paul Yang >Assignee: Paul Yang > Attachments: HIVE-1032.1.patch, HIVE-1032.2.patch > > > Three common errors that occur during execution are: > 1. Map-side group-by causing an out of memory exception due to large > aggregation hash tables > 2. ScriptOperator failing due to the user's script throwing an exception or > otherwise returning a non-zero error code > 3. Incorrectly specifying the join order of small and large tables, causing > the large table to be loaded into memory and producing an out of memory > exception. > These errors are typically discovered by manually examining the error log > files of the failed task. This task proposes to create a feature that would > automatically read the error logs and output a probable cause and solution to > the command line. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1032) Better Error Messages for Execution Errors
[ https://issues.apache.org/jira/browse/HIVE-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang updated HIVE-1032: Attachment: HIVE-1032.1.patch > Better Error Messages for Execution Errors > -- > > Key: HIVE-1032 > URL: https://issues.apache.org/jira/browse/HIVE-1032 > Project: Hadoop Hive > Issue Type: New Feature > Components: Query Processor >Reporter: Paul Yang >Assignee: Paul Yang > Attachments: HIVE-1032.1.patch > > > Three common errors that occur during execution are: > 1. Map-side group-by causing an out of memory exception due to large > aggregation hash tables > 2. ScriptOperator failing due to the user's script throwing an exception or > otherwise returning a non-zero error code > 3. Incorrectly specifying the join order of small and large tables, causing > the large table to be loaded into memory and producing an out of memory > exception. > These errors are typically discovered by manually examining the error log > files of the failed task. This task proposes to create a feature that would > automatically read the error logs and output a probable cause and solution to > the command line. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
