Thanks all for the inputs.
@Yogi: I do not have any operators that are dynamically partitioned. I have
not implemented any definePartition() in any of my operators.
@Bhupesh: I am not using the JSON parser operator from Malhar. I do use
jackson parser as an instance inside my operator that does s
Hi Ananth,
Do the containers that are getting killed belong to any specific operator?
Or are these getting killed randomly.
I'll suggest to have a look at the operator / container logs.
You can also check this using: yarn logs --applicationId
~Bhupesh
On Wed, May 18, 2016 at 12:22 AM, Ananth Gu
Hello Bhupesh,
The Kafka operator seems to be the one crashing. I am using the Kafka 0.9
operator from Malhar on a kafka broker cluster running CDH kafka 2.x.
Attaching the logs of this particular operator for reference.
Please note that there is an exception from the netty driver and I believe
Hello,
Thank you Shubam.
I have tried using AbstractJdbcInputOperator. Below is the Operator and the
error that I am getting. My observation is ‘store’ and ‘context’ objects are
null. Please help to solve this issue.
Error Logs:
java.lang.NullPointerException
at
com.datatorre
Hi,
The property on the store is not getting set since ".store." qualifier is
missing.Try the below for all store level properties.
dt.application.CountryNameScan.operator..prop
*.store.*databaseUrl
{databaseUrl}
Thanks,
Dev
On Wed, May 18, 2016 at 8:38 AM, Mukkamula, Suryavamsh
Hi ,
Hello,
When I have tried using below property as you suggested, my launch itself is
failing. When I don’t use store and directly assign
(‘dt.application.CountryNameScan.operator..prop.databaseUrl’)
launch is successful but application run is failing with null pointer exception
since ‘sto
Hi,
Can you try something like this,
JdbcPOJOInputOperator opr = dag.addOperator("JdbcPojo", new
JdbcPOJOInputOperator());
JdbcStore store = new JdbcStore();
opr.setStore(store);
The properties would then be set on this store object.
>From the code snippet provided earlier, the store
