[jira] [Commented] (SQOOP-2896) Sqoop exec job fails with SQLException Access denied for user

2016-03-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15217279#comment-15217279
 ] 

Hudson commented on SQOOP-2896:
---

FAILURE: Integrated in Sqoop-hadoop100 #1010 (See 
[https://builds.apache.org/job/Sqoop-hadoop100/1010/])
SQOOP-2896: Sqoop exec job fails with SQLException Access denied for (venkat: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=729e681f106d58d4048e002a00b1112cec3a0a5b])
* src/java/org/apache/sqoop/tool/JobTool.java


> Sqoop exec job fails with SQLException Access denied for user
> -
>
> Key: SQOOP-2896
> URL: https://issues.apache.org/jira/browse/SQOOP-2896
> Project: Sqoop
>  Issue Type: Bug
>Reporter: Kavan Suresh
>Assignee: Sowmya Ramesh
> Fix For: 1.4.7
>
> Attachments: SQOOP-2896.V0.patch, SQOOP-2896.V1.patch
>
>
> Sqoop save jobs which records the config information required to execute a 
> Sqoop command have been failing on recent builds with an access denied 
> exception. The default behavior is to create a job and then invoke the job 
> with exec job command by passing username and password. In the recent builds 
> of HDP 2.4 the parameter is not being passed when executing the exec command 
> as seen in the below logs:
> {code:java}
> RUNNING: /usr/hdp/current/sqoop-client/bin/sqoop job --create myjob -- eval 
> --driver com.mysql.jdbc.Driver --connect 
> jdbc:mysql://hn0-sqoop.sqoop-hadl24-ssh.c7.internal.cloudapp.net/employees -e 
> "select e.emp_no, e.first_name, e.last_name from employees as e limit 10"  
> --username sqoop --password sqoop
> 2016-03-22 
> 22:15:02,464|beaver.machine|INFO|3182|139761292187392|Thread-4|Warning: 
> /usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
> 2016-03-22 
> 22:15:02,464|beaver.machine|INFO|3182|139761292187392|Thread-4|Please set 
> $ACCUMULO_HOME to the root of your Accumulo installation.
> 2016-03-22 
> 22:15:05,815|beaver.machine|INFO|3182|139761283794688|Thread-5|16/03/22 
> 22:15:05 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-29
> 2016-03-22 
> 22:15:06,682|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Class 
> path contains multiple SLF4J bindings.
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: See 
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 2016-03-22 
> 22:15:06,693|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Actual 
> binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2016-03-22 
> 22:15:07,710|beaver.machine|INFO|3182|139761283794688|Thread-5|16/03/22 
> 22:15:07 WARN tool.BaseSqoopTool: Setting your password on the command-line 
> is insecure. Consider using -P instead.
> 2016-03-22 
> 22:15:08,550|beaver.machine|INFO|3182|139761510102848|MainThread|RUNNING: 
> /usr/hdp/current/sqoop-client/bin/sqoop job --list
> 2016-03-22 
> 22:15:08,572|beaver.machine|INFO|3182|139761292187392|Thread-6|Warning: 
> /usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
> 2016-03-22 
> 22:15:08,573|beaver.machine|INFO|3182|139761292187392|Thread-6|Please set 
> $ACCUMULO_HOME to the root of your Accumulo installation.
> 2016-03-22 
> 22:15:12,014|beaver.machine|INFO|3182|139761283794688|Thread-7|16/03/22 
> 22:15:12 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-29
> 2016-03-22 
> 22:15:12,855|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Class 
> path contains multiple SLF4J bindings.
> 2016-03-22 
> 22:15:12,855|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:12,856|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:12,856|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: See 
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 2016-03-22 
> 22:15:12,864|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Actual 
> binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2016-03-22 
> 22:15:13,961|beaver.machine|INFO|3182|139761292187392|Thread-6|Available jobs:
> 2016-03-22 
> 22:15:13,962|beaver.machi

[jira] [Commented] (SQOOP-2896) Sqoop exec job fails with SQLException Access denied for user

2016-03-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15217215#comment-15217215
 ] 

Hudson commented on SQOOP-2896:
---

FAILURE: Integrated in Sqoop-hadoop23 #1248 (See 
[https://builds.apache.org/job/Sqoop-hadoop23/1248/])
SQOOP-2896: Sqoop exec job fails with SQLException Access denied for (venkat: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=729e681f106d58d4048e002a00b1112cec3a0a5b])
* src/java/org/apache/sqoop/tool/JobTool.java


> Sqoop exec job fails with SQLException Access denied for user
> -
>
> Key: SQOOP-2896
> URL: https://issues.apache.org/jira/browse/SQOOP-2896
> Project: Sqoop
>  Issue Type: Bug
>Reporter: Kavan Suresh
>Assignee: Sowmya Ramesh
> Fix For: 1.4.7
>
> Attachments: SQOOP-2896.V0.patch, SQOOP-2896.V1.patch
>
>
> Sqoop save jobs which records the config information required to execute a 
> Sqoop command have been failing on recent builds with an access denied 
> exception. The default behavior is to create a job and then invoke the job 
> with exec job command by passing username and password. In the recent builds 
> of HDP 2.4 the parameter is not being passed when executing the exec command 
> as seen in the below logs:
> {code:java}
> RUNNING: /usr/hdp/current/sqoop-client/bin/sqoop job --create myjob -- eval 
> --driver com.mysql.jdbc.Driver --connect 
> jdbc:mysql://hn0-sqoop.sqoop-hadl24-ssh.c7.internal.cloudapp.net/employees -e 
> "select e.emp_no, e.first_name, e.last_name from employees as e limit 10"  
> --username sqoop --password sqoop
> 2016-03-22 
> 22:15:02,464|beaver.machine|INFO|3182|139761292187392|Thread-4|Warning: 
> /usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
> 2016-03-22 
> 22:15:02,464|beaver.machine|INFO|3182|139761292187392|Thread-4|Please set 
> $ACCUMULO_HOME to the root of your Accumulo installation.
> 2016-03-22 
> 22:15:05,815|beaver.machine|INFO|3182|139761283794688|Thread-5|16/03/22 
> 22:15:05 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-29
> 2016-03-22 
> 22:15:06,682|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Class 
> path contains multiple SLF4J bindings.
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: See 
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 2016-03-22 
> 22:15:06,693|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Actual 
> binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2016-03-22 
> 22:15:07,710|beaver.machine|INFO|3182|139761283794688|Thread-5|16/03/22 
> 22:15:07 WARN tool.BaseSqoopTool: Setting your password on the command-line 
> is insecure. Consider using -P instead.
> 2016-03-22 
> 22:15:08,550|beaver.machine|INFO|3182|139761510102848|MainThread|RUNNING: 
> /usr/hdp/current/sqoop-client/bin/sqoop job --list
> 2016-03-22 
> 22:15:08,572|beaver.machine|INFO|3182|139761292187392|Thread-6|Warning: 
> /usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
> 2016-03-22 
> 22:15:08,573|beaver.machine|INFO|3182|139761292187392|Thread-6|Please set 
> $ACCUMULO_HOME to the root of your Accumulo installation.
> 2016-03-22 
> 22:15:12,014|beaver.machine|INFO|3182|139761283794688|Thread-7|16/03/22 
> 22:15:12 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-29
> 2016-03-22 
> 22:15:12,855|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Class 
> path contains multiple SLF4J bindings.
> 2016-03-22 
> 22:15:12,855|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:12,856|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:12,856|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: See 
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 2016-03-22 
> 22:15:12,864|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Actual 
> binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2016-03-22 
> 22:15:13,961|beaver.machine|INFO|3182|139761292187392|Thread-6|Available jobs:
> 2016-03-22 
> 22:15:13,962|beaver.machine

[jira] [Commented] (SQOOP-2896) Sqoop exec job fails with SQLException Access denied for user

2016-03-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15217204#comment-15217204
 ] 

Hudson commented on SQOOP-2896:
---

FAILURE: Integrated in Sqoop-hadoop20 #1045 (See 
[https://builds.apache.org/job/Sqoop-hadoop20/1045/])
SQOOP-2896: Sqoop exec job fails with SQLException Access denied for (venkat: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=729e681f106d58d4048e002a00b1112cec3a0a5b])
* src/java/org/apache/sqoop/tool/JobTool.java


> Sqoop exec job fails with SQLException Access denied for user
> -
>
> Key: SQOOP-2896
> URL: https://issues.apache.org/jira/browse/SQOOP-2896
> Project: Sqoop
>  Issue Type: Bug
>Reporter: Kavan Suresh
>Assignee: Sowmya Ramesh
> Fix For: 1.4.7
>
> Attachments: SQOOP-2896.V0.patch, SQOOP-2896.V1.patch
>
>
> Sqoop save jobs which records the config information required to execute a 
> Sqoop command have been failing on recent builds with an access denied 
> exception. The default behavior is to create a job and then invoke the job 
> with exec job command by passing username and password. In the recent builds 
> of HDP 2.4 the parameter is not being passed when executing the exec command 
> as seen in the below logs:
> {code:java}
> RUNNING: /usr/hdp/current/sqoop-client/bin/sqoop job --create myjob -- eval 
> --driver com.mysql.jdbc.Driver --connect 
> jdbc:mysql://hn0-sqoop.sqoop-hadl24-ssh.c7.internal.cloudapp.net/employees -e 
> "select e.emp_no, e.first_name, e.last_name from employees as e limit 10"  
> --username sqoop --password sqoop
> 2016-03-22 
> 22:15:02,464|beaver.machine|INFO|3182|139761292187392|Thread-4|Warning: 
> /usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
> 2016-03-22 
> 22:15:02,464|beaver.machine|INFO|3182|139761292187392|Thread-4|Please set 
> $ACCUMULO_HOME to the root of your Accumulo installation.
> 2016-03-22 
> 22:15:05,815|beaver.machine|INFO|3182|139761283794688|Thread-5|16/03/22 
> 22:15:05 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-29
> 2016-03-22 
> 22:15:06,682|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Class 
> path contains multiple SLF4J bindings.
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: See 
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 2016-03-22 
> 22:15:06,693|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Actual 
> binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2016-03-22 
> 22:15:07,710|beaver.machine|INFO|3182|139761283794688|Thread-5|16/03/22 
> 22:15:07 WARN tool.BaseSqoopTool: Setting your password on the command-line 
> is insecure. Consider using -P instead.
> 2016-03-22 
> 22:15:08,550|beaver.machine|INFO|3182|139761510102848|MainThread|RUNNING: 
> /usr/hdp/current/sqoop-client/bin/sqoop job --list
> 2016-03-22 
> 22:15:08,572|beaver.machine|INFO|3182|139761292187392|Thread-6|Warning: 
> /usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
> 2016-03-22 
> 22:15:08,573|beaver.machine|INFO|3182|139761292187392|Thread-6|Please set 
> $ACCUMULO_HOME to the root of your Accumulo installation.
> 2016-03-22 
> 22:15:12,014|beaver.machine|INFO|3182|139761283794688|Thread-7|16/03/22 
> 22:15:12 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-29
> 2016-03-22 
> 22:15:12,855|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Class 
> path contains multiple SLF4J bindings.
> 2016-03-22 
> 22:15:12,855|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:12,856|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:12,856|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: See 
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 2016-03-22 
> 22:15:12,864|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Actual 
> binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2016-03-22 
> 22:15:13,961|beaver.machine|INFO|3182|139761292187392|Thread-6|Available jobs:
> 2016-03-22 
> 22:15:13,962|beaver.machine

[jira] [Commented] (SQOOP-2896) Sqoop exec job fails with SQLException Access denied for user

2016-03-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15217202#comment-15217202
 ] 

Hudson commented on SQOOP-2896:
---

FAILURE: Integrated in Sqoop-hadoop200 #1050 (See 
[https://builds.apache.org/job/Sqoop-hadoop200/1050/])
SQOOP-2896: Sqoop exec job fails with SQLException Access denied for (venkat: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=729e681f106d58d4048e002a00b1112cec3a0a5b])
* src/java/org/apache/sqoop/tool/JobTool.java


> Sqoop exec job fails with SQLException Access denied for user
> -
>
> Key: SQOOP-2896
> URL: https://issues.apache.org/jira/browse/SQOOP-2896
> Project: Sqoop
>  Issue Type: Bug
>Reporter: Kavan Suresh
>Assignee: Sowmya Ramesh
> Fix For: 1.4.7
>
> Attachments: SQOOP-2896.V0.patch, SQOOP-2896.V1.patch
>
>
> Sqoop save jobs which records the config information required to execute a 
> Sqoop command have been failing on recent builds with an access denied 
> exception. The default behavior is to create a job and then invoke the job 
> with exec job command by passing username and password. In the recent builds 
> of HDP 2.4 the parameter is not being passed when executing the exec command 
> as seen in the below logs:
> {code:java}
> RUNNING: /usr/hdp/current/sqoop-client/bin/sqoop job --create myjob -- eval 
> --driver com.mysql.jdbc.Driver --connect 
> jdbc:mysql://hn0-sqoop.sqoop-hadl24-ssh.c7.internal.cloudapp.net/employees -e 
> "select e.emp_no, e.first_name, e.last_name from employees as e limit 10"  
> --username sqoop --password sqoop
> 2016-03-22 
> 22:15:02,464|beaver.machine|INFO|3182|139761292187392|Thread-4|Warning: 
> /usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
> 2016-03-22 
> 22:15:02,464|beaver.machine|INFO|3182|139761292187392|Thread-4|Please set 
> $ACCUMULO_HOME to the root of your Accumulo installation.
> 2016-03-22 
> 22:15:05,815|beaver.machine|INFO|3182|139761283794688|Thread-5|16/03/22 
> 22:15:05 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-29
> 2016-03-22 
> 22:15:06,682|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Class 
> path contains multiple SLF4J bindings.
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: See 
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 2016-03-22 
> 22:15:06,693|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Actual 
> binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2016-03-22 
> 22:15:07,710|beaver.machine|INFO|3182|139761283794688|Thread-5|16/03/22 
> 22:15:07 WARN tool.BaseSqoopTool: Setting your password on the command-line 
> is insecure. Consider using -P instead.
> 2016-03-22 
> 22:15:08,550|beaver.machine|INFO|3182|139761510102848|MainThread|RUNNING: 
> /usr/hdp/current/sqoop-client/bin/sqoop job --list
> 2016-03-22 
> 22:15:08,572|beaver.machine|INFO|3182|139761292187392|Thread-6|Warning: 
> /usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
> 2016-03-22 
> 22:15:08,573|beaver.machine|INFO|3182|139761292187392|Thread-6|Please set 
> $ACCUMULO_HOME to the root of your Accumulo installation.
> 2016-03-22 
> 22:15:12,014|beaver.machine|INFO|3182|139761283794688|Thread-7|16/03/22 
> 22:15:12 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-29
> 2016-03-22 
> 22:15:12,855|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Class 
> path contains multiple SLF4J bindings.
> 2016-03-22 
> 22:15:12,855|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:12,856|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:12,856|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: See 
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 2016-03-22 
> 22:15:12,864|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Actual 
> binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2016-03-22 
> 22:15:13,961|beaver.machine|INFO|3182|139761292187392|Thread-6|Available jobs:
> 2016-03-22 
> 22:15:13,962|beaver.machi

[jira] [Commented] (SQOOP-2896) Sqoop exec job fails with SQLException Access denied for user

2016-03-29 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15217179#comment-15217179
 ] 

ASF subversion and git services commented on SQOOP-2896:


Commit 729e681f106d58d4048e002a00b1112cec3a0a5b in sqoop's branch 
refs/heads/trunk from [~venkatnrangan]
[ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=729e681 ]

SQOOP-2896: Sqoop exec job fails with SQLException Access denied for user

(Sowmya Ramesh via Venkat Ranganathan)


> Sqoop exec job fails with SQLException Access denied for user
> -
>
> Key: SQOOP-2896
> URL: https://issues.apache.org/jira/browse/SQOOP-2896
> Project: Sqoop
>  Issue Type: Bug
>Reporter: Kavan Suresh
>Assignee: Sowmya Ramesh
> Fix For: 1.4.7
>
> Attachments: SQOOP-2896.V0.patch, SQOOP-2896.V1.patch
>
>
> Sqoop save jobs which records the config information required to execute a 
> Sqoop command have been failing on recent builds with an access denied 
> exception. The default behavior is to create a job and then invoke the job 
> with exec job command by passing username and password. In the recent builds 
> of HDP 2.4 the parameter is not being passed when executing the exec command 
> as seen in the below logs:
> {code:java}
> RUNNING: /usr/hdp/current/sqoop-client/bin/sqoop job --create myjob -- eval 
> --driver com.mysql.jdbc.Driver --connect 
> jdbc:mysql://hn0-sqoop.sqoop-hadl24-ssh.c7.internal.cloudapp.net/employees -e 
> "select e.emp_no, e.first_name, e.last_name from employees as e limit 10"  
> --username sqoop --password sqoop
> 2016-03-22 
> 22:15:02,464|beaver.machine|INFO|3182|139761292187392|Thread-4|Warning: 
> /usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
> 2016-03-22 
> 22:15:02,464|beaver.machine|INFO|3182|139761292187392|Thread-4|Please set 
> $ACCUMULO_HOME to the root of your Accumulo installation.
> 2016-03-22 
> 22:15:05,815|beaver.machine|INFO|3182|139761283794688|Thread-5|16/03/22 
> 22:15:05 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-29
> 2016-03-22 
> 22:15:06,682|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Class 
> path contains multiple SLF4J bindings.
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: See 
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 2016-03-22 
> 22:15:06,693|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Actual 
> binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2016-03-22 
> 22:15:07,710|beaver.machine|INFO|3182|139761283794688|Thread-5|16/03/22 
> 22:15:07 WARN tool.BaseSqoopTool: Setting your password on the command-line 
> is insecure. Consider using -P instead.
> 2016-03-22 
> 22:15:08,550|beaver.machine|INFO|3182|139761510102848|MainThread|RUNNING: 
> /usr/hdp/current/sqoop-client/bin/sqoop job --list
> 2016-03-22 
> 22:15:08,572|beaver.machine|INFO|3182|139761292187392|Thread-6|Warning: 
> /usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
> 2016-03-22 
> 22:15:08,573|beaver.machine|INFO|3182|139761292187392|Thread-6|Please set 
> $ACCUMULO_HOME to the root of your Accumulo installation.
> 2016-03-22 
> 22:15:12,014|beaver.machine|INFO|3182|139761283794688|Thread-7|16/03/22 
> 22:15:12 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-29
> 2016-03-22 
> 22:15:12,855|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Class 
> path contains multiple SLF4J bindings.
> 2016-03-22 
> 22:15:12,855|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:12,856|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:12,856|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: See 
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 2016-03-22 
> 22:15:12,864|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Actual 
> binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2016-03-22 
> 22:15:13,961|beaver.machine|INFO|3182|139761292187392|Thread-6|Available jobs:
> 2016-03-22 
> 22:15:13,962|beaver.ma

Re: Review Request 45446: Sqoop exec job fails with SQLException Access denied for user

2016-03-29 Thread Venkat Ranganathan

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/45446/#review125995
---


Ship it!




Thanks for updating the patch Sowmya.  +1 - will commit after verification

- Venkat Ranganathan


On March 29, 2016, 3:40 p.m., Sowmya Ramesh wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/45446/
> ---
> 
> (Updated March 29, 2016, 3:40 p.m.)
> 
> 
> Review request for Sqoop and Venkat Ranganathan.
> 
> 
> Repository: sqoop-trunk
> 
> 
> Description
> ---
> 
> Sqoop exec job fails with SQLException Access denied for user
> 
> RUNNING: /usr/hdp/current/sqoop-client/bin/sqoop job --exec myjob -- 
> --username sqoop --password sqoop
> 2016-03-22 
> 22:15:22,783|beaver.machine|INFO|3182|139761283794688|Thread-10|Warning: 
> /usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
> 2016-03-22 
> 22:15:22,783|beaver.machine|INFO|3182|139761283794688|Thread-10|Please set 
> $ACCUMULO_HOME to the root of your Accumulo installation.
> 2016-03-22 
> 22:15:27,442|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:27 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-29
> 2016-03-22 
> 22:15:28,531|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: Class 
> path contains multiple SLF4J bindings.
> 2016-03-22 
> 22:15:28,531|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:28,531|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:28,531|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: See 
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 2016-03-22 
> 22:15:28,542|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: Actual 
> binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2016-03-22 
> 22:15:30,073|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 ERROR sqoop.SqoopOptions: It seems that you have launched a Sqoop 
> metastore job via
> 2016-03-22 
> 22:15:30,083|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 ERROR sqoop.SqoopOptions: Oozie with 
> sqoop.metastore.client.record.password disabled.
> 2016-03-22 
> 22:15:30,083|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 ERROR sqoop.SqoopOptions: But this configuration is not supported 
> because Sqoop can't
> 2016-03-22 
> 22:15:30,084|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 ERROR sqoop.SqoopOptions: prompt the user to enter the password 
> while being executed
> 2016-03-22 
> 22:15:30,093|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 ERROR sqoop.SqoopOptions: as Oozie tasks. Please enable 
> sqoop.metastore.client.record
> 2016-03-22 
> 22:15:30,093|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 ERROR sqoop.SqoopOptions: .password in sqoop-site.xml, or provide 
> the password
> 2016-03-22 
> 22:15:30,093|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 ERROR sqoop.SqoopOptions: explicitly using --password in the command 
> tag of the Oozie
> 2016-03-22 
> 22:15:30,094|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 ERROR sqoop.SqoopOptions: workflow file.
> 2016-03-22 
> 22:15:30,229|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 WARN sqoop.ConnFactory: Parameter --driver is set to an explicit 
> driver however appropriate connection manager is not being set (via 
> --connection-manager). Sqoop is going to fall back to 
> org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which 
> connection manager should be used next time.
> 2016-03-22 
> 22:15:30,264|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 INFO manager.SqlManager: Using default fetchSize of 1000
> 2016-03-22 
> 22:15:30,769|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 WARN tool.EvalSqlTool: SQL exception executing statement: 
> java.sql.SQLException: Access denied for user 'sqoop'@'10.0.0.26' (using 
> password: NO)
> 
> 
> Diffs
> -
> 
>   src/java/org/apache/sqoop/tool/JobTool.java 2eafac3 
> 
> Diff: https://reviews.apache.org/r/45446/diff/
> 
> 
> Testing
> ---
> 
> Manual testing done
> 
> 
> Thanks,
> 
> Sowmya Ramesh
> 
>



[jira] [Updated] (SQOOP-2896) Sqoop exec job fails with SQLException Access denied for user

2016-03-29 Thread Sowmya Ramesh (JIRA)

 [ 
https://issues.apache.org/jira/browse/SQOOP-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sowmya Ramesh updated SQOOP-2896:
-
Attachment: SQOOP-2896.V1.patch

> Sqoop exec job fails with SQLException Access denied for user
> -
>
> Key: SQOOP-2896
> URL: https://issues.apache.org/jira/browse/SQOOP-2896
> Project: Sqoop
>  Issue Type: Bug
>Reporter: Kavan Suresh
>Assignee: Sowmya Ramesh
> Attachments: SQOOP-2896.V0.patch, SQOOP-2896.V1.patch
>
>
> Sqoop save jobs which records the config information required to execute a 
> Sqoop command have been failing on recent builds with an access denied 
> exception. The default behavior is to create a job and then invoke the job 
> with exec job command by passing username and password. In the recent builds 
> of HDP 2.4 the parameter is not being passed when executing the exec command 
> as seen in the below logs:
> {code:java}
> RUNNING: /usr/hdp/current/sqoop-client/bin/sqoop job --create myjob -- eval 
> --driver com.mysql.jdbc.Driver --connect 
> jdbc:mysql://hn0-sqoop.sqoop-hadl24-ssh.c7.internal.cloudapp.net/employees -e 
> "select e.emp_no, e.first_name, e.last_name from employees as e limit 10"  
> --username sqoop --password sqoop
> 2016-03-22 
> 22:15:02,464|beaver.machine|INFO|3182|139761292187392|Thread-4|Warning: 
> /usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
> 2016-03-22 
> 22:15:02,464|beaver.machine|INFO|3182|139761292187392|Thread-4|Please set 
> $ACCUMULO_HOME to the root of your Accumulo installation.
> 2016-03-22 
> 22:15:05,815|beaver.machine|INFO|3182|139761283794688|Thread-5|16/03/22 
> 22:15:05 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-29
> 2016-03-22 
> 22:15:06,682|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Class 
> path contains multiple SLF4J bindings.
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: See 
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 2016-03-22 
> 22:15:06,693|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Actual 
> binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2016-03-22 
> 22:15:07,710|beaver.machine|INFO|3182|139761283794688|Thread-5|16/03/22 
> 22:15:07 WARN tool.BaseSqoopTool: Setting your password on the command-line 
> is insecure. Consider using -P instead.
> 2016-03-22 
> 22:15:08,550|beaver.machine|INFO|3182|139761510102848|MainThread|RUNNING: 
> /usr/hdp/current/sqoop-client/bin/sqoop job --list
> 2016-03-22 
> 22:15:08,572|beaver.machine|INFO|3182|139761292187392|Thread-6|Warning: 
> /usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
> 2016-03-22 
> 22:15:08,573|beaver.machine|INFO|3182|139761292187392|Thread-6|Please set 
> $ACCUMULO_HOME to the root of your Accumulo installation.
> 2016-03-22 
> 22:15:12,014|beaver.machine|INFO|3182|139761283794688|Thread-7|16/03/22 
> 22:15:12 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-29
> 2016-03-22 
> 22:15:12,855|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Class 
> path contains multiple SLF4J bindings.
> 2016-03-22 
> 22:15:12,855|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:12,856|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:12,856|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: See 
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 2016-03-22 
> 22:15:12,864|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Actual 
> binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2016-03-22 
> 22:15:13,961|beaver.machine|INFO|3182|139761292187392|Thread-6|Available jobs:
> 2016-03-22 
> 22:15:13,962|beaver.machine|INFO|3182|139761292187392|Thread-6|myjob
> {code}
> {code:java}
> RUNNING: /usr/hdp/current/sqoop-client/bin/sqoop job --exec myjob -- 
> --username sqoop --password sqoop
> 2016-03-22 
> 22:15:22,783|beaver.machine|INFO|3182|139761283794688|Thread-10|Warning: 
> /usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
> 2016-03-22 
> 22:15:22,783|beaver.ma

Re: Review Request 45446: Sqoop exec job fails with SQLException Access denied for user

2016-03-29 Thread Sowmya Ramesh

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/45446/
---

(Updated March 29, 2016, 10:40 p.m.)


Review request for Sqoop and Venkat Ranganathan.


Changes
---

Applied feedback.


Repository: sqoop-trunk


Description
---

Sqoop exec job fails with SQLException Access denied for user

RUNNING: /usr/hdp/current/sqoop-client/bin/sqoop job --exec myjob -- --username 
sqoop --password sqoop
2016-03-22 
22:15:22,783|beaver.machine|INFO|3182|139761283794688|Thread-10|Warning: 
/usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
2016-03-22 
22:15:22,783|beaver.machine|INFO|3182|139761283794688|Thread-10|Please set 
$ACCUMULO_HOME to the root of your Accumulo installation.
2016-03-22 
22:15:27,442|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:27 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-29
2016-03-22 
22:15:28,531|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: Class 
path contains multiple SLF4J bindings.
2016-03-22 
22:15:28,531|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: Found 
binding in 
[jar:file:/usr/hdp/2.4.2.0-29/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2016-03-22 
22:15:28,531|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: Found 
binding in 
[jar:file:/usr/hdp/2.4.2.0-29/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2016-03-22 
22:15:28,531|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: See 
http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2016-03-22 
22:15:28,542|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: Actual 
binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2016-03-22 
22:15:30,073|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 ERROR sqoop.SqoopOptions: It seems that you have launched a Sqoop 
metastore job via
2016-03-22 
22:15:30,083|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 ERROR sqoop.SqoopOptions: Oozie with 
sqoop.metastore.client.record.password disabled.
2016-03-22 
22:15:30,083|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 ERROR sqoop.SqoopOptions: But this configuration is not supported 
because Sqoop can't
2016-03-22 
22:15:30,084|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 ERROR sqoop.SqoopOptions: prompt the user to enter the password while 
being executed
2016-03-22 
22:15:30,093|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 ERROR sqoop.SqoopOptions: as Oozie tasks. Please enable 
sqoop.metastore.client.record
2016-03-22 
22:15:30,093|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 ERROR sqoop.SqoopOptions: .password in sqoop-site.xml, or provide the 
password
2016-03-22 
22:15:30,093|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 ERROR sqoop.SqoopOptions: explicitly using --password in the command 
tag of the Oozie
2016-03-22 
22:15:30,094|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 ERROR sqoop.SqoopOptions: workflow file.
2016-03-22 
22:15:30,229|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 WARN sqoop.ConnFactory: Parameter --driver is set to an explicit 
driver however appropriate connection manager is not being set (via 
--connection-manager). Sqoop is going to fall back to 
org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which 
connection manager should be used next time.
2016-03-22 
22:15:30,264|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 INFO manager.SqlManager: Using default fetchSize of 1000
2016-03-22 
22:15:30,769|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 WARN tool.EvalSqlTool: SQL exception executing statement: 
java.sql.SQLException: Access denied for user 'sqoop'@'10.0.0.26' (using 
password: NO)


Diffs (updated)
-

  src/java/org/apache/sqoop/tool/JobTool.java 2eafac3 

Diff: https://reviews.apache.org/r/45446/diff/


Testing
---

Manual testing done


Thanks,

Sowmya Ramesh



[jira] [Commented] (SQOOP-2889) Read and write from encrypted repository

2016-03-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216929#comment-15216929
 ] 

Hudson commented on SQOOP-2889:
---

SUCCESS: Integrated in Sqoop2 #1038 (See 
[https://builds.apache.org/job/Sqoop2/1038/])
SQOOP-2889: Read and write from encrypted repository (jarcec: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=5b897a46fcbbe8a83fdb7ce1ebe8d862c34e9736])
* 
repository/repository-common/src/main/java/org/apache/sqoop/repository/common/CommonRepositoryHandler.java
* 
connector/connector-oracle-jdbc/src/main/resources/oracle-jdbc-connector-config.properties
* 
repository/repository-common/src/main/java/org/apache/sqoop/repository/common/CommonRepositoryInsertUpdateDeleteSelectQuery.java
* core/src/main/java/org/apache/sqoop/repository/Repository.java
* 
repository/repository-mysql/src/main/java/org/apache/sqoop/repository/mysql/MysqlRepositoryInsertUpdateDeleteSelectQuery.java
* dist/src/main/conf/sqoop.properties
* common/src/main/java/org/apache/sqoop/error/code/PasswordError.java
* shell/src/main/java/org/apache/sqoop/shell/SetTruststoreFunction.java
* core/src/main/java/org/apache/sqoop/repository/MasterKeyManager.java
* core/src/test/java/org/apache/sqoop/repository/TestMasterKeyManager.java
* common-test/src/main/java/org/apache/sqoop/common/test/db/DerbyProvider.java
* 
repository/repository-derby/src/main/java/org/apache/sqoop/repository/derby/DerbySchemaCreateQuery.java
* 
repository/repository-mysql/src/main/java/org/apache/sqoop/repository/mysql/MySqlSchemaCreateQuery.java
* core/src/main/java/org/apache/sqoop/core/SqoopServer.java
* common/src/main/java/org/apache/sqoop/model/MMasterKey.java
* common/src/main/java/org/apache/sqoop/utils/ProcessUtils.java
* core/src/main/java/org/apache/sqoop/security/SecurityConstants.java
* 
repository/repository-postgresql/src/main/java/org/apache/sqoop/repository/postgresql/PostgresqlSchemaUpgradeQuery.java
* 
repository/repository-common/src/main/java/org/apache/sqoop/repository/common/CommonRepositorySchemaConstants.java
* 
repository/repository-derby/src/main/java/org/apache/sqoop/repository/derby/DerbySchemaUpgradeQuery.java
* common/src/main/java/org/apache/sqoop/error/code/CommonRepositoryError.java
* core/src/main/java/org/apache/sqoop/repository/JdbcRepository.java
* 
repository/repository-postgresql/src/main/java/org/apache/sqoop/repository/postgresql/PostgresqlRepositoryHandler.java
* 
repository/repository-derby/src/test/java/org/apache/sqoop/repository/derby/DerbyTestCase.java
* core/src/main/java/org/apache/sqoop/repository/JdbcRepositoryHandler.java
* core/src/main/java/org/apache/sqoop/security/SecurityError.java
* common/src/test/java/org/apache/sqoop/utils/TestPasswordUtils.java
* common/src/main/java/org/apache/sqoop/utils/PasswordUtils.java
* test/src/main/java/org/apache/sqoop/test/minicluster/SqoopMiniCluster.java
* 
repository/repository-derby/src/main/java/org/apache/sqoop/repository/derby/DerbyRepositoryHandler.java
* 
repository/repository-postgresql/src/main/java/org/apache/sqoop/repository/postgresql/PostgresqlSchemaCreateQuery.java
* server/src/main/java/org/apache/sqoop/server/SqoopJettyServer.java
* 
repository/repository-mysql/src/main/java/org/apache/sqoop/repository/mysql/MySqlRepositoryHandler.java


> Read and write from encrypted repository
> 
>
> Key: SQOOP-2889
> URL: https://issues.apache.org/jira/browse/SQOOP-2889
> Project: Sqoop
>  Issue Type: Sub-task
>Affects Versions: 1.99.6
>Reporter: Abraham Fine
>Assignee: Abraham Fine
> Fix For: 1.99.7
>
> Attachments: SQOOP-2889.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SQOOP-2889) Read and write from encrypted repository

2016-03-29 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216850#comment-15216850
 ] 

ASF subversion and git services commented on SQOOP-2889:


Commit 5b897a46fcbbe8a83fdb7ce1ebe8d862c34e9736 in sqoop's branch 
refs/heads/sqoop2 from [~jarcec]
[ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=5b897a4 ]

SQOOP-2889: Read and write from encrypted repository

(Abraham Fine via Jarek Jarcec Cecho)


> Read and write from encrypted repository
> 
>
> Key: SQOOP-2889
> URL: https://issues.apache.org/jira/browse/SQOOP-2889
> Project: Sqoop
>  Issue Type: Sub-task
>Affects Versions: 1.99.6
>Reporter: Abraham Fine
>Assignee: Abraham Fine
> Fix For: 1.99.7
>
> Attachments: SQOOP-2889.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Review Request 45446: Sqoop exec job fails with SQLException Access denied for user

2016-03-29 Thread Venkat Ranganathan

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/45446/#review125951
---




src/java/org/apache/sqoop/tool/JobTool.java (line 224)


Nit: can length be < 0?


- Venkat Ranganathan


On March 29, 2016, 1:36 p.m., Sowmya Ramesh wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/45446/
> ---
> 
> (Updated March 29, 2016, 1:36 p.m.)
> 
> 
> Review request for Sqoop and Venkat Ranganathan.
> 
> 
> Repository: sqoop-trunk
> 
> 
> Description
> ---
> 
> Sqoop exec job fails with SQLException Access denied for user
> 
> RUNNING: /usr/hdp/current/sqoop-client/bin/sqoop job --exec myjob -- 
> --username sqoop --password sqoop
> 2016-03-22 
> 22:15:22,783|beaver.machine|INFO|3182|139761283794688|Thread-10|Warning: 
> /usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
> 2016-03-22 
> 22:15:22,783|beaver.machine|INFO|3182|139761283794688|Thread-10|Please set 
> $ACCUMULO_HOME to the root of your Accumulo installation.
> 2016-03-22 
> 22:15:27,442|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:27 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-29
> 2016-03-22 
> 22:15:28,531|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: Class 
> path contains multiple SLF4J bindings.
> 2016-03-22 
> 22:15:28,531|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:28,531|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:28,531|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: See 
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 2016-03-22 
> 22:15:28,542|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: Actual 
> binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2016-03-22 
> 22:15:30,073|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 ERROR sqoop.SqoopOptions: It seems that you have launched a Sqoop 
> metastore job via
> 2016-03-22 
> 22:15:30,083|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 ERROR sqoop.SqoopOptions: Oozie with 
> sqoop.metastore.client.record.password disabled.
> 2016-03-22 
> 22:15:30,083|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 ERROR sqoop.SqoopOptions: But this configuration is not supported 
> because Sqoop can't
> 2016-03-22 
> 22:15:30,084|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 ERROR sqoop.SqoopOptions: prompt the user to enter the password 
> while being executed
> 2016-03-22 
> 22:15:30,093|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 ERROR sqoop.SqoopOptions: as Oozie tasks. Please enable 
> sqoop.metastore.client.record
> 2016-03-22 
> 22:15:30,093|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 ERROR sqoop.SqoopOptions: .password in sqoop-site.xml, or provide 
> the password
> 2016-03-22 
> 22:15:30,093|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 ERROR sqoop.SqoopOptions: explicitly using --password in the command 
> tag of the Oozie
> 2016-03-22 
> 22:15:30,094|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 ERROR sqoop.SqoopOptions: workflow file.
> 2016-03-22 
> 22:15:30,229|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 WARN sqoop.ConnFactory: Parameter --driver is set to an explicit 
> driver however appropriate connection manager is not being set (via 
> --connection-manager). Sqoop is going to fall back to 
> org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which 
> connection manager should be used next time.
> 2016-03-22 
> 22:15:30,264|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 INFO manager.SqlManager: Using default fetchSize of 1000
> 2016-03-22 
> 22:15:30,769|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
> 22:15:30 WARN tool.EvalSqlTool: SQL exception executing statement: 
> java.sql.SQLException: Access denied for user 'sqoop'@'10.0.0.26' (using 
> password: NO)
> 
> 
> Diffs
> -
> 
>   src/java/org/apache/sqoop/tool/JobTool.java 2eafac3 
> 
> Diff: https://reviews.apache.org/r/45446/diff/
> 
> 
> Testing
> ---
> 
> Manual testing done
> 
> 
> Thanks,
> 
> Sowmya Ramesh
> 
>



Review Request 45446: Sqoop exec job fails with SQLException Access denied for user

2016-03-29 Thread Sowmya Ramesh

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/45446/
---

Review request for Sqoop and Venkat Ranganathan.


Repository: sqoop-trunk


Description
---

Sqoop exec job fails with SQLException Access denied for user

RUNNING: /usr/hdp/current/sqoop-client/bin/sqoop job --exec myjob -- --username 
sqoop --password sqoop
2016-03-22 
22:15:22,783|beaver.machine|INFO|3182|139761283794688|Thread-10|Warning: 
/usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
2016-03-22 
22:15:22,783|beaver.machine|INFO|3182|139761283794688|Thread-10|Please set 
$ACCUMULO_HOME to the root of your Accumulo installation.
2016-03-22 
22:15:27,442|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:27 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-29
2016-03-22 
22:15:28,531|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: Class 
path contains multiple SLF4J bindings.
2016-03-22 
22:15:28,531|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: Found 
binding in 
[jar:file:/usr/hdp/2.4.2.0-29/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2016-03-22 
22:15:28,531|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: Found 
binding in 
[jar:file:/usr/hdp/2.4.2.0-29/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2016-03-22 
22:15:28,531|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: See 
http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2016-03-22 
22:15:28,542|beaver.machine|INFO|3182|139761292187392|Thread-11|SLF4J: Actual 
binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2016-03-22 
22:15:30,073|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 ERROR sqoop.SqoopOptions: It seems that you have launched a Sqoop 
metastore job via
2016-03-22 
22:15:30,083|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 ERROR sqoop.SqoopOptions: Oozie with 
sqoop.metastore.client.record.password disabled.
2016-03-22 
22:15:30,083|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 ERROR sqoop.SqoopOptions: But this configuration is not supported 
because Sqoop can't
2016-03-22 
22:15:30,084|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 ERROR sqoop.SqoopOptions: prompt the user to enter the password while 
being executed
2016-03-22 
22:15:30,093|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 ERROR sqoop.SqoopOptions: as Oozie tasks. Please enable 
sqoop.metastore.client.record
2016-03-22 
22:15:30,093|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 ERROR sqoop.SqoopOptions: .password in sqoop-site.xml, or provide the 
password
2016-03-22 
22:15:30,093|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 ERROR sqoop.SqoopOptions: explicitly using --password in the command 
tag of the Oozie
2016-03-22 
22:15:30,094|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 ERROR sqoop.SqoopOptions: workflow file.
2016-03-22 
22:15:30,229|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 WARN sqoop.ConnFactory: Parameter --driver is set to an explicit 
driver however appropriate connection manager is not being set (via 
--connection-manager). Sqoop is going to fall back to 
org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which 
connection manager should be used next time.
2016-03-22 
22:15:30,264|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 INFO manager.SqlManager: Using default fetchSize of 1000
2016-03-22 
22:15:30,769|beaver.machine|INFO|3182|139761292187392|Thread-11|16/03/22 
22:15:30 WARN tool.EvalSqlTool: SQL exception executing statement: 
java.sql.SQLException: Access denied for user 'sqoop'@'10.0.0.26' (using 
password: NO)


Diffs
-

  src/java/org/apache/sqoop/tool/JobTool.java 2eafac3 

Diff: https://reviews.apache.org/r/45446/diff/


Testing
---

Manual testing done


Thanks,

Sowmya Ramesh



[jira] [Updated] (SQOOP-2896) Sqoop exec job fails with SQLException Access denied for user

2016-03-29 Thread Sowmya Ramesh (JIRA)

 [ 
https://issues.apache.org/jira/browse/SQOOP-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sowmya Ramesh updated SQOOP-2896:
-
Attachment: SQOOP-2896.V0.patch

> Sqoop exec job fails with SQLException Access denied for user
> -
>
> Key: SQOOP-2896
> URL: https://issues.apache.org/jira/browse/SQOOP-2896
> Project: Sqoop
>  Issue Type: Bug
>Reporter: Kavan Suresh
>Assignee: Sowmya Ramesh
> Attachments: SQOOP-2896.V0.patch
>
>
> Sqoop save jobs which records the config information required to execute a 
> Sqoop command have been failing on recent builds with an access denied 
> exception. The default behavior is to create a job and then invoke the job 
> with exec job command by passing username and password. In the recent builds 
> of HDP 2.4 the parameter is not being passed when executing the exec command 
> as seen in the below logs:
> {code:java}
> RUNNING: /usr/hdp/current/sqoop-client/bin/sqoop job --create myjob -- eval 
> --driver com.mysql.jdbc.Driver --connect 
> jdbc:mysql://hn0-sqoop.sqoop-hadl24-ssh.c7.internal.cloudapp.net/employees -e 
> "select e.emp_no, e.first_name, e.last_name from employees as e limit 10"  
> --username sqoop --password sqoop
> 2016-03-22 
> 22:15:02,464|beaver.machine|INFO|3182|139761292187392|Thread-4|Warning: 
> /usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
> 2016-03-22 
> 22:15:02,464|beaver.machine|INFO|3182|139761292187392|Thread-4|Please set 
> $ACCUMULO_HOME to the root of your Accumulo installation.
> 2016-03-22 
> 22:15:05,815|beaver.machine|INFO|3182|139761283794688|Thread-5|16/03/22 
> 22:15:05 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-29
> 2016-03-22 
> 22:15:06,682|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Class 
> path contains multiple SLF4J bindings.
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:06,683|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: See 
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 2016-03-22 
> 22:15:06,693|beaver.machine|INFO|3182|139761283794688|Thread-5|SLF4J: Actual 
> binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2016-03-22 
> 22:15:07,710|beaver.machine|INFO|3182|139761283794688|Thread-5|16/03/22 
> 22:15:07 WARN tool.BaseSqoopTool: Setting your password on the command-line 
> is insecure. Consider using -P instead.
> 2016-03-22 
> 22:15:08,550|beaver.machine|INFO|3182|139761510102848|MainThread|RUNNING: 
> /usr/hdp/current/sqoop-client/bin/sqoop job --list
> 2016-03-22 
> 22:15:08,572|beaver.machine|INFO|3182|139761292187392|Thread-6|Warning: 
> /usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
> 2016-03-22 
> 22:15:08,573|beaver.machine|INFO|3182|139761292187392|Thread-6|Please set 
> $ACCUMULO_HOME to the root of your Accumulo installation.
> 2016-03-22 
> 22:15:12,014|beaver.machine|INFO|3182|139761283794688|Thread-7|16/03/22 
> 22:15:12 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-29
> 2016-03-22 
> 22:15:12,855|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Class 
> path contains multiple SLF4J bindings.
> 2016-03-22 
> 22:15:12,855|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:12,856|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Found 
> binding in 
> [jar:file:/usr/hdp/2.4.2.0-29/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 2016-03-22 
> 22:15:12,856|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: See 
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 2016-03-22 
> 22:15:12,864|beaver.machine|INFO|3182|139761283794688|Thread-7|SLF4J: Actual 
> binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2016-03-22 
> 22:15:13,961|beaver.machine|INFO|3182|139761292187392|Thread-6|Available jobs:
> 2016-03-22 
> 22:15:13,962|beaver.machine|INFO|3182|139761292187392|Thread-6|myjob
> {code}
> {code:java}
> RUNNING: /usr/hdp/current/sqoop-client/bin/sqoop job --exec myjob -- 
> --username sqoop --password sqoop
> 2016-03-22 
> 22:15:22,783|beaver.machine|INFO|3182|139761283794688|Thread-10|Warning: 
> /usr/hdp/2.4.2.0-29/accumulo does not exist! Accumulo imports will fail.
> 2016-03-22 
> 22:15:22,783|beaver.machine|INFO|3182|13976

[jira] [Commented] (SQOOP-2889) Read and write from encrypted repository

2016-03-29 Thread Sqoop QA bot (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216709#comment-15216709
 ] 

Sqoop QA bot commented on SQOOP-2889:
-

Testing file 
[SQOOP-2889.patch|https://issues.apache.org/jira/secure/attachment/12795716/SQOOP-2889.patch]
 against branch sqoop2 took 1:21:40.966850.

{color:green}Overall:{color} +1 all checks pass

{color:green}SUCCESS:{color} Clean was successful
{color:green}SUCCESS:{color} Patch applied correctly
{color:green}SUCCESS:{color} Patch add/modify test case
{color:green}SUCCESS:{color} License check passed
{color:green}SUCCESS:{color} Patch compiled
{color:green}SUCCESS:{color} All unit tests passed (executed 1728 tests)
{color:green}SUCCESS:{color} Test coverage did not decreased 
([report|https://builds.apache.org/job/PreCommit-SQOOP-Build/2336/artifact/patch-process/cobertura_report.txt])
{color:green}SUCCESS:{color} No new findbugs warnings 
([report|https://builds.apache.org/job/PreCommit-SQOOP-Build/2336/artifact/patch-process/findbugs_report.txt])
{color:green}SUCCESS:{color} All integration tests passed (executed 228 tests)

Console output is available 
[here|https://builds.apache.org/job/PreCommit-SQOOP-Build/2336/console].

This message is automatically generated.

> Read and write from encrypted repository
> 
>
> Key: SQOOP-2889
> URL: https://issues.apache.org/jira/browse/SQOOP-2889
> Project: Sqoop
>  Issue Type: Sub-task
>Affects Versions: 1.99.6
>Reporter: Abraham Fine
>Assignee: Abraham Fine
> Attachments: SQOOP-2889.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SQOOP-2561) Special Character removal from Column name as avro data results in duplicate column and fails the import

2016-03-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-2561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216521#comment-15216521
 ] 

Hudson commented on SQOOP-2561:
---

FAILURE: Integrated in Sqoop-hadoop200 #1049 (See 
[https://builds.apache.org/job/Sqoop-hadoop200/1049/])
SQOOP-2561: Special Character removal from Column name as avro data (jarcec: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=1dd50cfb2ae327b0df8393dd96d1adb86bb2f65f])
* src/test/com/cloudera/sqoop/TestAvroImport.java
* src/java/org/apache/sqoop/avro/AvroUtil.java


> Special Character removal from Column name as avro data results in duplicate 
> column and fails the import
> 
>
> Key: SQOOP-2561
> URL: https://issues.apache.org/jira/browse/SQOOP-2561
> Project: Sqoop
>  Issue Type: Bug
>Affects Versions: 1.4.6
> Environment: cdh5.3.2
>Reporter: Suresh
>Assignee: VISHNU S NAIR
>  Labels: AVRO, SQOOP
> Fix For: 1.4.7
>
> Attachments: 0001-SQOOP-2561.patch
>
>
> When a Special character like '$' or  '#' are present in column name, 
> sqoop/avro removes those special character. In some cases it leads to 
> duplicate column.
> e.g. If we have COL$1 and COL1$ in the schema, it removes both of them and 
> creates the duplicate column as COL1 and it results in failure of the SQOOP 
> import job as a avro data. The same table can be loaded without 
> --as-avarodata flag.
> The similar issue is raised in, 
> https://issues.apache.org/jira/browse/SQOOP-1361 - which i suppose is fixed 
> and the fix is creating this new issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SQOOP-2889) Read and write from encrypted repository

2016-03-29 Thread Abraham Fine (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216515#comment-15216515
 ] 

Abraham Fine commented on SQOOP-2889:
-

i do not think the failures are relevant to the patch. i will relaunch the 
build.

> Read and write from encrypted repository
> 
>
> Key: SQOOP-2889
> URL: https://issues.apache.org/jira/browse/SQOOP-2889
> Project: Sqoop
>  Issue Type: Sub-task
>Affects Versions: 1.99.6
>Reporter: Abraham Fine
>Assignee: Abraham Fine
> Attachments: SQOOP-2889.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SQOOP-2561) Special Character removal from Column name as avro data results in duplicate column and fails the import

2016-03-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-2561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216402#comment-15216402
 ] 

Hudson commented on SQOOP-2561:
---

FAILURE: Integrated in Sqoop-hadoop100 #1009 (See 
[https://builds.apache.org/job/Sqoop-hadoop100/1009/])
SQOOP-2561: Special Character removal from Column name as avro data (jarcec: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=1dd50cfb2ae327b0df8393dd96d1adb86bb2f65f])
* src/java/org/apache/sqoop/avro/AvroUtil.java
* src/test/com/cloudera/sqoop/TestAvroImport.java


> Special Character removal from Column name as avro data results in duplicate 
> column and fails the import
> 
>
> Key: SQOOP-2561
> URL: https://issues.apache.org/jira/browse/SQOOP-2561
> Project: Sqoop
>  Issue Type: Bug
>Affects Versions: 1.4.6
> Environment: cdh5.3.2
>Reporter: Suresh
>Assignee: VISHNU S NAIR
>  Labels: AVRO, SQOOP
> Fix For: 1.4.7
>
> Attachments: 0001-SQOOP-2561.patch
>
>
> When a Special character like '$' or  '#' are present in column name, 
> sqoop/avro removes those special character. In some cases it leads to 
> duplicate column.
> e.g. If we have COL$1 and COL1$ in the schema, it removes both of them and 
> creates the duplicate column as COL1 and it results in failure of the SQOOP 
> import job as a avro data. The same table can be loaded without 
> --as-avarodata flag.
> The similar issue is raised in, 
> https://issues.apache.org/jira/browse/SQOOP-1361 - which i suppose is fixed 
> and the fix is creating this new issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SQOOP-2561) Special Character removal from Column name as avro data results in duplicate column and fails the import

2016-03-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-2561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216312#comment-15216312
 ] 

Hudson commented on SQOOP-2561:
---

FAILURE: Integrated in Sqoop-hadoop23 #1247 (See 
[https://builds.apache.org/job/Sqoop-hadoop23/1247/])
SQOOP-2561: Special Character removal from Column name as avro data (jarcec: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=1dd50cfb2ae327b0df8393dd96d1adb86bb2f65f])
* src/java/org/apache/sqoop/avro/AvroUtil.java
* src/test/com/cloudera/sqoop/TestAvroImport.java


> Special Character removal from Column name as avro data results in duplicate 
> column and fails the import
> 
>
> Key: SQOOP-2561
> URL: https://issues.apache.org/jira/browse/SQOOP-2561
> Project: Sqoop
>  Issue Type: Bug
>Affects Versions: 1.4.6
> Environment: cdh5.3.2
>Reporter: Suresh
>Assignee: VISHNU S NAIR
>  Labels: AVRO, SQOOP
> Fix For: 1.4.7
>
> Attachments: 0001-SQOOP-2561.patch
>
>
> When a Special character like '$' or  '#' are present in column name, 
> sqoop/avro removes those special character. In some cases it leads to 
> duplicate column.
> e.g. If we have COL$1 and COL1$ in the schema, it removes both of them and 
> creates the duplicate column as COL1 and it results in failure of the SQOOP 
> import job as a avro data. The same table can be loaded without 
> --as-avarodata flag.
> The similar issue is raised in, 
> https://issues.apache.org/jira/browse/SQOOP-1361 - which i suppose is fixed 
> and the fix is creating this new issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SQOOP-2561) Special Character removal from Column name as avro data results in duplicate column and fails the import

2016-03-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-2561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216290#comment-15216290
 ] 

Hudson commented on SQOOP-2561:
---

FAILURE: Integrated in Sqoop-hadoop20 #1044 (See 
[https://builds.apache.org/job/Sqoop-hadoop20/1044/])
SQOOP-2561: Special Character removal from Column name as avro data (jarcec: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=1dd50cfb2ae327b0df8393dd96d1adb86bb2f65f])
* src/java/org/apache/sqoop/avro/AvroUtil.java
* src/test/com/cloudera/sqoop/TestAvroImport.java


> Special Character removal from Column name as avro data results in duplicate 
> column and fails the import
> 
>
> Key: SQOOP-2561
> URL: https://issues.apache.org/jira/browse/SQOOP-2561
> Project: Sqoop
>  Issue Type: Bug
>Affects Versions: 1.4.6
> Environment: cdh5.3.2
>Reporter: Suresh
>Assignee: VISHNU S NAIR
>  Labels: AVRO, SQOOP
> Fix For: 1.4.7
>
> Attachments: 0001-SQOOP-2561.patch
>
>
> When a Special character like '$' or  '#' are present in column name, 
> sqoop/avro removes those special character. In some cases it leads to 
> duplicate column.
> e.g. If we have COL$1 and COL1$ in the schema, it removes both of them and 
> creates the duplicate column as COL1 and it results in failure of the SQOOP 
> import job as a avro data. The same table can be loaded without 
> --as-avarodata flag.
> The similar issue is raised in, 
> https://issues.apache.org/jira/browse/SQOOP-1361 - which i suppose is fixed 
> and the fix is creating this new issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SQOOP-2561) Special Character removal from Column name as avro data results in duplicate column and fails the import

2016-03-29 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-2561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216284#comment-15216284
 ] 

ASF subversion and git services commented on SQOOP-2561:


Commit 1dd50cfb2ae327b0df8393dd96d1adb86bb2f65f in sqoop's branch 
refs/heads/trunk from [~jarcec]
[ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=1dd50cf ]

SQOOP-2561: Special Character removal from Column name as avro data results in 
duplicate column and fails the import

(VISHNU S NAIR via Jarek Jarcec Cecho)


> Special Character removal from Column name as avro data results in duplicate 
> column and fails the import
> 
>
> Key: SQOOP-2561
> URL: https://issues.apache.org/jira/browse/SQOOP-2561
> Project: Sqoop
>  Issue Type: Bug
>Affects Versions: 1.4.6
> Environment: cdh5.3.2
>Reporter: Suresh
>Assignee: VISHNU S NAIR
>  Labels: AVRO, SQOOP
> Fix For: 1.4.7
>
> Attachments: 0001-SQOOP-2561.patch
>
>
> When a Special character like '$' or  '#' are present in column name, 
> sqoop/avro removes those special character. In some cases it leads to 
> duplicate column.
> e.g. If we have COL$1 and COL1$ in the schema, it removes both of them and 
> creates the duplicate column as COL1 and it results in failure of the SQOOP 
> import job as a avro data. The same table can be loaded without 
> --as-avarodata flag.
> The similar issue is raised in, 
> https://issues.apache.org/jira/browse/SQOOP-1361 - which i suppose is fixed 
> and the fix is creating this new issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Review Request 44317: SQOOP-2561

2016-03-29 Thread Jarek Cecho

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/44317/#review125900
---


Ship it!




Ship It!

- Jarek Cecho


On March 29, 2016, 4:49 a.m., vishnu  s nair wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/44317/
> ---
> 
> (Updated March 29, 2016, 4:49 a.m.)
> 
> 
> Review request for Sqoop.
> 
> 
> Bugs: SQOOP-2561
> https://issues.apache.org/jira/browse/SQOOP-2561
> 
> 
> Repository: sqoop-trunk
> 
> 
> Description
> ---
> 
> Special Character removal from Column name as avro data results in
> duplicate column and fails the import
> 
> Solution:  Instead of removing the special character, replace it with
> underscore
> 
> 
> Diffs
> -
> 
>   src/java/org/apache/sqoop/avro/AvroUtil.java 90cc9d0 
>   src/test/com/cloudera/sqoop/TestAvroImport.java 00d7a95 
> 
> Diff: https://reviews.apache.org/r/44317/diff/
> 
> 
> Testing
> ---
> 
> Test case for the same is exceuted successfully.
> 
> 
> File Attachments
> 
> 
> 0001-SQOOP-2561.patch
>   
> https://reviews.apache.org/media/uploaded/files/2016/03/29/a11e1fb7-b6ca-4a2d-9914-cd3049fb9e7f__0001-SQOOP-2561.patch
> 
> 
> Thanks,
> 
> vishnu  s nair
> 
>



[jira] [Resolved] (SQOOP-2897) Help with Sqoop Free-form import

2016-03-29 Thread Nandha K Subramaniam (JIRA)

 [ 
https://issues.apache.org/jira/browse/SQOOP-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nandha K Subramaniam resolved SQOOP-2897.
-
   Resolution: Fixed
Fix Version/s: 1.4.6

Added the below properties and it worked.



oozie.launcher.mapreduce.map.java.opts
-Dsqoop.test.import.rootDir=/my_root_dir



> Help with Sqoop Free-form import
> 
>
> Key: SQOOP-2897
> URL: https://issues.apache.org/jira/browse/SQOOP-2897
> Project: Sqoop
>  Issue Type: Bug
>  Components: connectors/hdfs
>Affects Versions: 1.4.6
> Environment: Sqoop version: 1.4.6-cdh5.5.2
>Reporter: Nandha K Subramaniam
> Fix For: 1.4.6
>
>
> I am trying to do sqoop free-form through oozie workflow and I am moving the 
> data from Teradata to HDFS Encrypted zone. When I try to run the work flow, I 
> am getting the error 
>  ERROR tool.ImportTool: Encountered IOException running import job: 
> org.apache.hadoop.ipc.RemoteException(java.io.IOException): 
> /user/nbswhm01/_sqoop/7b098d969d134b9ebd4c3f2aa441ac6c_4d741387/part-m-0 
> can't be moved into an encryption zone.
> Please note that I was able to run free form import with no Oozie process by 
> using the option
>  HADOOP_OPTS=-Dsqoop.test.import.rootDir
> Can you please help? 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SQOOP-2897) Help with Sqoop Free-form import

2016-03-29 Thread Nandha K Subramaniam (JIRA)
Nandha K Subramaniam created SQOOP-2897:
---

 Summary: Help with Sqoop Free-form import
 Key: SQOOP-2897
 URL: https://issues.apache.org/jira/browse/SQOOP-2897
 Project: Sqoop
  Issue Type: Bug
  Components: connectors/hdfs
Affects Versions: 1.4.6
 Environment: Sqoop version: 1.4.6-cdh5.5.2
Reporter: Nandha K Subramaniam


I am trying to do sqoop free-form through oozie workflow and I am moving the 
data from Teradata to HDFS Encrypted zone. When I try to run the work flow, I 
am getting the error 
 ERROR tool.ImportTool: Encountered IOException running import job: 
org.apache.hadoop.ipc.RemoteException(java.io.IOException): 
/user/nbswhm01/_sqoop/7b098d969d134b9ebd4c3f2aa441ac6c_4d741387/part-m-0 
can't be moved into an encryption zone.

Please note that I was able to run free form import with no Oozie process by 
using the option
 HADOOP_OPTS=-Dsqoop.test.import.rootDir

Can you please help? 




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SQOOP-2895) NCLOB import to Hive not supported

2016-03-29 Thread Benjamin BONNET (JIRA)

 [ 
https://issues.apache.org/jira/browse/SQOOP-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benjamin BONNET updated SQOOP-2895:
---
Affects Version/s: 1.4.6

> NCLOB import to Hive not supported 
> ---
>
> Key: SQOOP-2895
> URL: https://issues.apache.org/jira/browse/SQOOP-2895
> Project: Sqoop
>  Issue Type: Bug
>  Components: hive-integration
>Affects Versions: 1.4.6
>Reporter: Benjamin BONNET
>
> Hi,
> Sqoop cannot import and create Hive table when the table to be imported 
> contains NCLOB columns.
> Actually, data is correctly imported into HDFS but Hive table creation fails 
> with :
> ERROR tool.ImportTool: Encountered IOException running import job: 
> java.io.IOException: Hive does not support the SQL type for column 
> myNClobColumn
> at 
> org.apache.sqoop.hive.TableDefWriter.getCreateTableStmt(TableDefWriter.java:181)
> at org.apache.sqoop.hive.HiveImport.importTable(HiveImport.java:188)
> at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:514)
> at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
> at org.apache.sqoop.Sqoop.run(Sqoop.java:148)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
> at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:184)
> at org.apache.sqoop.Sqoop.runTool(Sqoop.java:226)
> at org.apache.sqoop.Sqoop.runTool(Sqoop.java:235)
> at org.apache.sqoop.Sqoop.main(Sqoop.java:244)
> That issue is due to the fact SQOOP knows CLOB type but not NCLOB. See type 
> mappings in org.apache.sqoop.hive.HiveTypes where NCLOB is not.
> Regards



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)