[
https://issues.apache.org/jira/browse/NIFI-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew M. Lim updated NIFI-11519:
---------------------------------
Description:
When configuring a DBCPConnectionPool controller service, I created a dynamic
property {{PWD}} and selected "Sensitive". The value from this dynamic
property should be used in the PWD connection property in the Database
Connection URL, but it causes an error in the processor that uses the
controller service (see below).
WORKAROUND: If I create a dynamic property {{SENSITIVE.PWD}} (doesn't matter if
I select "Sensitive" setting), then the error does not occur.
Error (from ExecuteSQL processor using the DBCP Connection Pool):
16:04:12 UTCERRORef0a84d5-26f6-377a-af2c-bd9ddb098ea0
All NodesExecuteSQL[id=ef0a84d5-26f6-377a-af2c-bd9ddb098ea0] Unable to execute
SQL select query [CREATE EXTERNAL TABLE orders25 LIKE PARQUET
's3a://XXXXX/destination/parquet/XXXXX.parquet'
STORED AS PARQUET
LOCATION 's3a://XXXXX/destination/parquet/';] for
FlowFile[filename=XXXXX.parquet] routing to failure:
org.apache.nifi.processor.exception.ProcessException: Privileged action failed
due to: Cannot create PoolableConnectionFactory ( [JDBC](10100) Connection
Refused: [JDBC](11640) Required Connection Key(s): PWD; [JDBC](11480)
Optional Connection Key(s): AllowSelfSignedCerts, AsyncExecPollInterval,
AutomaticColumnRename, CAIssuedCertNamesMismatch, CatalogSchemaSwitch,
DefaultStringColumnLength, DelegationToken, DelegationUID, DnsResolver,
DnsResolverArg, FastConnection, krbJAASFile, LowerCaseResultSetColumnName,
NonSSPs, OptimizedInsert, PreparedMetaLimitZero, RowsFetchedPerBlock,
ServerVersion, ServiceDiscoveryMode, SocketFactory, SocketFactoryArg,
SocketTimeOut, SSLKeyStore, SSLKeyStorePwd, SSLTrustStore, SSLTrustStorePwd,
StripCatalogName, SupportTimeOnlyTimestamp, UseCustomTypeCoercionMap,
UseNativeQuery, UseSasl)
- Caused by: java.sql.SQLException: Cannot create PoolableConnectionFactory (
[JDBC](10100) Connection Refused: [JDBC](11640) Required Connection Key(s):
PWD; [JDBC](11480) Optional Connection Key(s): AllowSelfSignedCerts,
AsyncExecPollInterval, AutomaticColumnRename, CAIssuedCertNamesMismatch,
CatalogSchemaSwitch, DefaultStringColumnLength, DelegationToken, DelegationUID,
DnsResolver, DnsResolverArg, FastConnection, krbJAASFile,
LowerCaseResultSetColumnName, NonSSPs, OptimizedInsert, PreparedMetaLimitZero,
RowsFetchedPerBlock, ServerVersion, ServiceDiscoveryMode, SocketFactory,
SocketFactoryArg, SocketTimeOut, SSLKeyStore, SSLKeyStorePwd, SSLTrustStore,
SSLTrustStorePwd, StripCatalogName, SupportTimeOnlyTimestamp,
UseCustomTypeCoercionMap, UseNativeQuery, UseSasl)
- Caused by: java.sql.SQLNonTransientConnectionException: [JDBC](10100)
Connection Refused: [JDBC](11640) Required Connection Key(s): PWD;
[JDBC](11480) Optional Connection Key(s): AllowSelfSignedCerts,
AsyncExecPollInterval, AutomaticColumnRename, CAIssuedCertNamesMismatch,
CatalogSchemaSwitch, DefaultStringColumnLength, DelegationToken, DelegationUID,
DnsResolver, DnsResolverArg, FastConnection, krbJAASFile,
LowerCaseResultSetColumnName, NonSSPs, OptimizedInsert, PreparedMetaLimitZero,
RowsFetchedPerBlock, ServerVersion, ServiceDiscoveryMode, SocketFactory,
SocketFactoryArg, SocketTimeOut, SSLKeyStore, SSLKeyStorePwd, SSLTrustStore,
SSLTrustStorePwd, StripCatalogName, SupportTimeOnlyTimestamp,
UseCustomTypeCoercionMap, UseNativeQuery, UseSasl
was:
When configuring a DBCPConnectionPool controller service, I created a dynamic
property {{PWD}} and selected "Sensitive". The value from this dynamic
property should be used in the PWD connection property in the Database
Connection URL, but it causes an error in the processor that uses the
controller service (see below).
WORKAROUND: If I create a dynamic property {{SENSITIVE.PWD}} (doesn't matter if
I select "Sensitive" setting), then the error does not occur.
Error (from ExecuteSQL processor using the DBCP Connection Pool):
16:04:12 UTCERRORef0a84d5-26f6-377a-af2c-bd9ddb098ea0
All NodesExecuteSQL[id=ef0a84d5-26f6-377a-af2c-bd9ddb098ea0] Unable to execute
SQL select query [CREATE EXTERNAL TABLE orders25 LIKE PARQUET
's3a://alim2-mow-dev-aws/alim2-mow-dev-aws-dl/destination/parquet/s3-data25.parquet'
STORED AS PARQUET
LOCATION
's3a://alim2-mow-dev-aws/alim2-mow-dev-aws-dl/destination/parquet/';] for
FlowFile[filename=s3-data25.parquet] routing to failure:
org.apache.nifi.processor.exception.ProcessException: Privileged action failed
due to: Cannot create PoolableConnectionFactory ( [JDBC](10100) Connection
Refused: [JDBC](11640) Required Connection Key(s): PWD; [JDBC](11480)
Optional Connection Key(s): AllowSelfSignedCerts, AsyncExecPollInterval,
AutomaticColumnRename, CAIssuedCertNamesMismatch, CatalogSchemaSwitch,
DefaultStringColumnLength, DelegationToken, DelegationUID, DnsResolver,
DnsResolverArg, FastConnection, krbJAASFile, LowerCaseResultSetColumnName,
NonSSPs, OptimizedInsert, PreparedMetaLimitZero, RowsFetchedPerBlock,
ServerVersion, ServiceDiscoveryMode, SocketFactory, SocketFactoryArg,
SocketTimeOut, SSLKeyStore, SSLKeyStorePwd, SSLTrustStore, SSLTrustStorePwd,
StripCatalogName, SupportTimeOnlyTimestamp, UseCustomTypeCoercionMap,
UseNativeQuery, UseSasl)
- Caused by: java.sql.SQLException: Cannot create PoolableConnectionFactory (
[JDBC](10100) Connection Refused: [JDBC](11640) Required Connection Key(s):
PWD; [JDBC](11480) Optional Connection Key(s): AllowSelfSignedCerts,
AsyncExecPollInterval, AutomaticColumnRename, CAIssuedCertNamesMismatch,
CatalogSchemaSwitch, DefaultStringColumnLength, DelegationToken, DelegationUID,
DnsResolver, DnsResolverArg, FastConnection, krbJAASFile,
LowerCaseResultSetColumnName, NonSSPs, OptimizedInsert, PreparedMetaLimitZero,
RowsFetchedPerBlock, ServerVersion, ServiceDiscoveryMode, SocketFactory,
SocketFactoryArg, SocketTimeOut, SSLKeyStore, SSLKeyStorePwd, SSLTrustStore,
SSLTrustStorePwd, StripCatalogName, SupportTimeOnlyTimestamp,
UseCustomTypeCoercionMap, UseNativeQuery, UseSasl)
- Caused by: java.sql.SQLNonTransientConnectionException: [JDBC](10100)
Connection Refused: [JDBC](11640) Required Connection Key(s): PWD;
[JDBC](11480) Optional Connection Key(s): AllowSelfSignedCerts,
AsyncExecPollInterval, AutomaticColumnRename, CAIssuedCertNamesMismatch,
CatalogSchemaSwitch, DefaultStringColumnLength, DelegationToken, DelegationUID,
DnsResolver, DnsResolverArg, FastConnection, krbJAASFile,
LowerCaseResultSetColumnName, NonSSPs, OptimizedInsert, PreparedMetaLimitZero,
RowsFetchedPerBlock, ServerVersion, ServiceDiscoveryMode, SocketFactory,
SocketFactoryArg, SocketTimeOut, SSLKeyStore, SSLKeyStorePwd, SSLTrustStore,
SSLTrustStorePwd, StripCatalogName, SupportTimeOnlyTimestamp,
UseCustomTypeCoercionMap, UseNativeQuery, UseSasl
> Sensitive Dynamic Properties do not work with Sensitive Parameter Values in
> DBCP
> --------------------------------------------------------------------------------
>
> Key: NIFI-11519
> URL: https://issues.apache.org/jira/browse/NIFI-11519
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 1.21.0
> Reporter: Andrew M. Lim
> Priority: Major
>
> When configuring a DBCPConnectionPool controller service, I created a dynamic
> property {{PWD}} and selected "Sensitive". The value from this dynamic
> property should be used in the PWD connection property in the Database
> Connection URL, but it causes an error in the processor that uses the
> controller service (see below).
> WORKAROUND: If I create a dynamic property {{SENSITIVE.PWD}} (doesn't matter
> if I select "Sensitive" setting), then the error does not occur.
> Error (from ExecuteSQL processor using the DBCP Connection Pool):
> 16:04:12 UTCERRORef0a84d5-26f6-377a-af2c-bd9ddb098ea0
> All NodesExecuteSQL[id=ef0a84d5-26f6-377a-af2c-bd9ddb098ea0] Unable to
> execute SQL select query [CREATE EXTERNAL TABLE orders25 LIKE PARQUET
> 's3a://XXXXX/destination/parquet/XXXXX.parquet'
> STORED AS PARQUET
> LOCATION 's3a://XXXXX/destination/parquet/';] for
> FlowFile[filename=XXXXX.parquet] routing to failure:
> org.apache.nifi.processor.exception.ProcessException: Privileged action
> failed due to: Cannot create PoolableConnectionFactory ( [JDBC](10100)
> Connection Refused: [JDBC](11640) Required Connection Key(s): PWD;
> [JDBC](11480) Optional Connection Key(s): AllowSelfSignedCerts,
> AsyncExecPollInterval, AutomaticColumnRename, CAIssuedCertNamesMismatch,
> CatalogSchemaSwitch, DefaultStringColumnLength, DelegationToken,
> DelegationUID, DnsResolver, DnsResolverArg, FastConnection, krbJAASFile,
> LowerCaseResultSetColumnName, NonSSPs, OptimizedInsert,
> PreparedMetaLimitZero, RowsFetchedPerBlock, ServerVersion,
> ServiceDiscoveryMode, SocketFactory, SocketFactoryArg, SocketTimeOut,
> SSLKeyStore, SSLKeyStorePwd, SSLTrustStore, SSLTrustStorePwd,
> StripCatalogName, SupportTimeOnlyTimestamp, UseCustomTypeCoercionMap,
> UseNativeQuery, UseSasl)
> - Caused by: java.sql.SQLException: Cannot create PoolableConnectionFactory (
> [JDBC](10100) Connection Refused: [JDBC](11640) Required Connection Key(s):
> PWD; [JDBC](11480) Optional Connection Key(s): AllowSelfSignedCerts,
> AsyncExecPollInterval, AutomaticColumnRename, CAIssuedCertNamesMismatch,
> CatalogSchemaSwitch, DefaultStringColumnLength, DelegationToken,
> DelegationUID, DnsResolver, DnsResolverArg, FastConnection, krbJAASFile,
> LowerCaseResultSetColumnName, NonSSPs, OptimizedInsert,
> PreparedMetaLimitZero, RowsFetchedPerBlock, ServerVersion,
> ServiceDiscoveryMode, SocketFactory, SocketFactoryArg, SocketTimeOut,
> SSLKeyStore, SSLKeyStorePwd, SSLTrustStore, SSLTrustStorePwd,
> StripCatalogName, SupportTimeOnlyTimestamp, UseCustomTypeCoercionMap,
> UseNativeQuery, UseSasl)
> - Caused by: java.sql.SQLNonTransientConnectionException: [JDBC](10100)
> Connection Refused: [JDBC](11640) Required Connection Key(s): PWD;
> [JDBC](11480) Optional Connection Key(s): AllowSelfSignedCerts,
> AsyncExecPollInterval, AutomaticColumnRename, CAIssuedCertNamesMismatch,
> CatalogSchemaSwitch, DefaultStringColumnLength, DelegationToken,
> DelegationUID, DnsResolver, DnsResolverArg, FastConnection, krbJAASFile,
> LowerCaseResultSetColumnName, NonSSPs, OptimizedInsert,
> PreparedMetaLimitZero, RowsFetchedPerBlock, ServerVersion,
> ServiceDiscoveryMode, SocketFactory, SocketFactoryArg, SocketTimeOut,
> SSLKeyStore, SSLKeyStorePwd, SSLTrustStore, SSLTrustStorePwd,
> StripCatalogName, SupportTimeOnlyTimestamp, UseCustomTypeCoercionMap,
> UseNativeQuery, UseSasl
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
