Lars George created KAFKA-3759:
----------------------------------
Summary: Incorrect JDBC credentials cause Connect worker to
permanently fail
Key: KAFKA-3759
URL: https://issues.apache.org/jira/browse/KAFKA-3759
Project: Kafka
Issue Type: Bug
Components: KafkaConnect
Affects Versions: 0.9.0.1
Environment: I work on a cloudera quickstart VM. I installed kafka /
confluent via yum :
[cloudera@quickstart confluent]$ yum list installed | grep confluent
confluent-camus.noarch 2.0.1-1 @confluent-2.0
confluent-common.noarch 2.0.1-1 @confluent-2.0
confluent-kafka-2.11.7.noarch 0.9.0.1-1 @confluent-2.0
confluent-kafka-connect-hdfs.noarch 2.0.1-1 @confluent-2.0
confluent-kafka-connect-jdbc.noarch 2.0.1-1 @confluent-2.0
confluent-kafka-rest.noarch 2.0.1-1 @confluent-2.0
confluent-rest-utils.noarch 2.0.1-1 @confluent-2.0
confluent-schema-registry.noarch 2.0.1-1 @confluent-2.0
Reporter: Lars George
Assignee: Ewen Cheslack-Postava
As reported by our peers:
All the following steps are executed in one cloudera instance, each in a
different terminal.
- I start the kafka server with the (unchanged) properties file in
/etc/kafka/server.properties
- I start the schema-registry with the (unchanged) properties file in
/etc/schema-registry/schema-registry.properties
- I start the connect worker with the properties file
/etc/schema-registry/connect-avro-distributed.properties
HOWEVER I have changed the following 2 properties for my test:
config.storage.topic=connect-configs-broken
offset.storage.topic=connect-offsets-broken
Now I execute a shell script that uses the REST API to post a connector
configuration to the worker. Here the snippet from the script
that shows the connector config:
{noformat}
==========================================================
read -resp $'please enter the password for the postgresql user \n'
postgres_password
echo posting connector config into the kafka cluster
data="{
\"name\": \"projectx-postgres-test\",
\"config\": {
\"connection.url\":\"jdbc:postgresql://$postgres_db_url/$postgres_db_name?user=$postgres_user&password=$postgres_password\",
\"connector.class\":\"io.confluent.connect.jdbc.JdbcSourceConnector\",
\"tasks.max\":\"1\",
\"mode\":\"incrementing\",
\"incrementing.column.name\":\"id\",
\"topic.prefix\":\"test-postgres-jdbc-\"
}
}"
url=http://$kafka_connect_rest_url/connectors
ctype="Content-Type: application/json"
curl -X POST $url -H "$ctype" --data "$data"
==========================================================
{noformat}
- I exectute the script with correct connection settings, but incorrect
postgresql username / password.
- I receive the following answer from the REST API:
{noformat}
{"name":"projectx-postgres-test","config":{"connection.url":"jdbc:postgresql://localhost/connect_test?user=cloudera&password=wrongPW","connector.class":"io.confluent.connect.jdbc.JdbcSourceConnector","tasks.max":"1","mode":"incrementing","incrementing.column.name":"id","topic.prefix":"test-postgres-jdbc-","name":"projectx-postgres-test"},"tasks":[]}
{noformat}
Now the connect worker stops and I see the following error and stack trace:
{noformat}
[2016-05-23 05:53:43,966] INFO 127.0.0.1 - - [23/May/2016:12:53:41 +0000] "POST
/connectors HTTP/1.1" 201 343 2500
(org.apache.kafka.connect.runtime.rest.RestServer:60)
[2016-05-23 05:53:44,656] ERROR Couldn't open connection to
jdbc:postgresql://localhost/connect_test?user=cloudera&password=wrongPW:
org.postgresql.util.PSQLException: FATAL: password authentication failed for
user "cloudera" (io.confluent.connect.jdbc.JdbcSourceConnector:76)
[2016-05-23 05:53:44,663] ERROR Uncaught exception in herder work thread,
exiting: (org.apache.kafka.connect.runtime.distributed.DistributedHerder:166)
org.apache.kafka.connect.errors.ConnectException: Connector threw an exception
while starting
at org.apache.kafka.connect.runtime.Worker.addConnector(Worker.java:188)
at
org.apache.kafka.connect.runtime.distributed.DistributedHerder.startConnector(DistributedHerder.java:670)
at
org.apache.kafka.connect.runtime.distributed.DistributedHerder.startWork(DistributedHerder.java:642)
at
org.apache.kafka.connect.runtime.distributed.DistributedHerder.handleRebalanceCompleted(DistributedHerder.java:600)
at
org.apache.kafka.connect.runtime.distributed.DistributedHerder.tick(DistributedHerder.java:184)
at
org.apache.kafka.connect.runtime.distributed.DistributedHerder.run(DistributedHerder.java:159)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.kafka.connect.errors.ConnectException:
org.postgresql.util.PSQLException: FATAL: password authentication failed for
user "cloudera"
at
io.confluent.connect.jdbc.JdbcSourceConnector.start(JdbcSourceConnector.java:77)
at org.apache.kafka.connect.runtime.Worker.addConnector(Worker.java:186)
... 6 more
Caused by: org.postgresql.util.PSQLException: FATAL: password authentication
failed for user "cloudera"
at
org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:427)
at
org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:203)
at
org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:65)
at
org.postgresql.jdbc2.AbstractJdbc2Connection.<init>(AbstractJdbc2Connection.java:149)
at
org.postgresql.jdbc3.AbstractJdbc3Connection.<init>(AbstractJdbc3Connection.java:35)
at
org.postgresql.jdbc3g.AbstractJdbc3gConnection.<init>(AbstractJdbc3gConnection.java:22)
at
org.postgresql.jdbc4.AbstractJdbc4Connection.<init>(AbstractJdbc4Connection.java:47)
at org.postgresql.jdbc4.Jdbc4Connection.<init>(Jdbc4Connection.java:30)
at org.postgresql.Driver.makeConnection(Driver.java:414)
at org.postgresql.Driver.connect(Driver.java:282)
at java.sql.DriverManager.getConnection(DriverManager.java:571)
at java.sql.DriverManager.getConnection(DriverManager.java:233)
at
io.confluent.connect.jdbc.JdbcSourceConnector.start(JdbcSourceConnector.java:74)
... 7 more
[2016-05-23 05:53:44,706] INFO Kafka Connect stopping
(org.apache.kafka.connect.runtime.Connect:68)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
