Re: Flink 1.5.0 no more allow multiple program argument?

2018-06-19 Thread Siew Wai Yow
Thanks Chesnay! I guess it is related to StringJoiner(",") used in Flink 1.5 :(


From: Chesnay Schepler 
Sent: Tuesday, June 19, 2018 1:44 PM
To: user@flink.apache.org
Subject: Re: Flink 1.5.0 no more allow multiple program argument?

For now you'll have to replace all commas with some other delimiter.

On 19.06.2018 04:15, Siew Wai Yow wrote:

Hi,


I get the following error when upgrade flink from 1.3.2 to 1.5.0 when using 
REST api to upload and run a jar.


{"errors":["Expected only one value [--KAFKA_IN 
PREBLN_O@192.168.56.120:9092<mailto:PREBLN_O@192.168.56.120:9092>, 
192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_PREBLN_O_124 --KAFKA_OUT 
FX_AGGR_ASCII@192.168.56.120:9092<mailto:FX_AGGR_ASCII@192.168.56.120:9092>, 
192.168.56.121:9092, 
192.168.56.122:9092/BHARTI_FL_FX_AGGR_ASCII_181;FX_AGGREGATED@192.168.56.120:9092<mailto:192.168.56.122:9092/BHARTI_FL_FX_AGGR_ASCII_181;FX_AGGREGATED@192.168.56.120:9092>,
 192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_FX_AGGREGATED_181 
--KAFKA_REJECT INVALID@192.168.56.120:9092<mailto:INVALID@192.168.56.120:9092>, 
192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_INVALID_181 --KAFKA_AUDIT 
AUDIT@192.168.56.120:9092<mailto:AUDIT@192.168.56.120:9092>, 
192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_AUDIT_181 --KAFKA_REPROCESS 
REPROCESS@192.168.56.120:9092<mailto:REPROCESS@192.168.56.120:9092>, 
192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_REPROCESS_181 --OPTION 
--JOB_NAME POC_BHARTI_FLINK_AGGR  --AUDIT_WINDOWS_INTERVAL_MS 5000 --STATSD_URL 
192.168.56.200:8127  --STATSD_SAMPLING_DURATION 1000 --CHECK_POINT_INTERVAL 
2 --NODEID 181 --LS_SERVER LsServer --LS_TABLES Table1, Table2 --ZK_POLLING 
30 --ZK_URL 192.168.56.130, 192.168.56.131, 192.168.56.132 --LS_HOSTNAME  
--LS_ENABLE 0 --ZK_RETRY_COUNT 0 --ZK_RETRY_INTERVAL 0 
--LS_ABORT_ON_RELOAD_FAILURE 1 --ZK_SESSION_TIMEOUT 6 --ZK_KEEP_CONN_ALIVE 
1]."]}


Seems the program-argument no more allow multiple parameter? But the document 
tell different story,


"From the command line arguments"

https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/best_practices.html
<https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/best_practices.html>

Apache Flink 1.5 Documentation: Best 
Practices<https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/best_practices.html>
ci.apache.org
Almost all Flink applications, both batch and streaming, rely on external 
configuration parameters. They are used to specify input and output sources 
(like paths or addresses), system parameters (parallelism, runtime 
configuration), and application specific parameters (typically used within user 
...

Any advice please? thank you.


Regards,

Yow





Flink 1.5.0 no more allow multiple program argument?

2018-06-18 Thread Siew Wai Yow
Hi,


I get the following error when upgrade flink from 1.3.2 to 1.5.0 when using 
REST api to upload and run a jar.


{"errors":["Expected only one value [--KAFKA_IN PREBLN_O@192.168.56.120:9092, 
192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_PREBLN_O_124 --KAFKA_OUT 
FX_AGGR_ASCII@192.168.56.120:9092, 192.168.56.121:9092, 
192.168.56.122:9092/BHARTI_FL_FX_AGGR_ASCII_181;FX_AGGREGATED@192.168.56.120:9092,
 192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_FX_AGGREGATED_181 
--KAFKA_REJECT INVALID@192.168.56.120:9092, 192.168.56.121:9092, 
192.168.56.122:9092/BHARTI_FL_INVALID_181 --KAFKA_AUDIT 
AUDIT@192.168.56.120:9092, 192.168.56.121:9092, 
192.168.56.122:9092/BHARTI_FL_AUDIT_181 --KAFKA_REPROCESS 
REPROCESS@192.168.56.120:9092, 192.168.56.121:9092, 
192.168.56.122:9092/BHARTI_FL_REPROCESS_181 --OPTION --JOB_NAME 
POC_BHARTI_FLINK_AGGR  --AUDIT_WINDOWS_INTERVAL_MS 5000 --STATSD_URL 
192.168.56.200:8127  --STATSD_SAMPLING_DURATION 1000 --CHECK_POINT_INTERVAL 
2 --NODEID 181 --LS_SERVER LsServer --LS_TABLES Table1, Table2 --ZK_POLLING 
30 --ZK_URL 192.168.56.130, 192.168.56.131, 192.168.56.132 --LS_HOSTNAME  
--LS_ENABLE 0 --ZK_RETRY_COUNT 0 --ZK_RETRY_INTERVAL 0 
--LS_ABORT_ON_RELOAD_FAILURE 1 --ZK_SESSION_TIMEOUT 6 --ZK_KEEP_CONN_ALIVE 
1]."]}


Seems the program-argument no more allow multiple parameter? But the document 
tell different story,


"From the command line arguments"

https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/best_practices.html


Apache Flink 1.5 Documentation: Best 
Practices
ci.apache.org
Almost all Flink applications, both batch and streaming, rely on external 
configuration parameters. They are used to specify input and output sources 
(like paths or addresses), system parameters (parallelism, runtime 
configuration), and application specific parameters (typically used within user 
...

Any advice please? thank you.


Regards,

Yow