Re: Storm topology using all the Max connections of db

Hi! Well is seems that you have to contact the team that created the jdbc storm project. It seems that the issue is deeper than my knowledge. I hope that my advises helped you. If you have a solution, please share it here that the others can benefit from your experience. Good luck! Regards,

Re: Storm topology using all the Max connections of db

Hi, my supervisor logs shows the following error : 2016-05-05T15:45:15.365+0530 b.s.d.executor [INFO] Prepared bolt __acker:(67) 2016-05-05T15:45:15.369+0530 b.s.d.executor [INFO] Prepared bolt __system:(-1) 2016-05-05T15:45:18.481+0530 c.z.h.HikariDataSource [INFO] HikariCP pool HikariPool-0 is

Re: Storm topology using all the Max connections of db

Hi, I'm closing up and opening the connections after execution of insert query by my bolt.Do I need to increase the max connections db to a level of 500 to 1000? Here in log file of supervisor it tells me the connection made by bolt is closed and again taking new connection.I think after

Re: Storm topology using all the Max connections of db

hi! you have 9 bolts with 50 max db connections. so for each bolt you get a conection pool. try to decresae this number for example to 5 and check if your performance if fine with your db regards, florin On Wednesday, May 4, 2016, Sai Dilip Reddy Kiralam < dkira...@aadhya-analytics.com> wrote:

Re: Storm topology using all the Max connections of db

sorry ! my db is not yet started, so it given me the error ! but when I gave that statement and run the topology then it is using more connections than the specified number. *Best regards,* *K.Sai Dilip Reddy.* On Wed, May 4, 2016 at 11:22 AM, Sai Dilip Reddy Kiralam <

Re: Storm topology using all the Max connections of db

Hi, I just added a statement * // config.setMaximumPoolSize(50);* public synchronized void prepare() { if(dataSource == null) { Properties properties = new Properties(); properties.putAll(configMap); HikariConfig config = new

Re: Storm topology using all the Max connections of db

Hi, Thank you Spico Florin. *Best regards,* *K.Sai Dilip Reddy.* On Wed, May 4, 2016 at 1:18 AM, Spico Florin wrote: > hi! > please have a look > https://github.com/apache/storm/tree/master/external/storm-jdbc where you > hve to implemnt thw interface

Re: Storm topology using all the Max connections of db

hi! please have a look https://github.com/apache/storm/tree/master/external/storm-jdbc where you hve to implemnt thw interface connectionprovider interface. you have to dins a third paty librry that provides conection pooloing for postgresql and use that library to implement the interface

Re: Storm topology using all the Max connections of db

I'm using storm jdbc for connecting to db.how can I use pooling on codes on topology.please share information on connection pooling used on storm topologies. *Best regards,* *K.Sai Dilip Reddy.* On Thu, Apr 28, 2016 at 12:28 PM, Sai Dilip Reddy Kiralam < dkira...@aadhya-analytics.com> wrote:

Re: Storm topology using all the Max connections of db

Hi Spico, I use 9 bolts with parallelism of 1 and with 1 task for each bolt(default) and I'm not using any ConnectionPool for connecting to postgres.Just using jdbc classe examples here is source example http://storm.apache.org/releases/2.0.0-SNAPSHOT/storm-jdbc.html. I will check by using the

Re: Storm topology using all the Max connections of db

Hello! How many tasks do you have for inserting the data to your database? Are you using ConnectionPool for connecting to Postgres? If your number of task superseeds the number of max connections provided in connection pool then your have a problem. Please also check the number of max

Storm topology using all the Max connections of db

Hi, I have topology that make connection with postgresdb and insert the fields into tables of a test db.my topology is working fine but when I submit the topology it is establishing all the connections of db.but I don’t know why it is taking all the max connections. below attached the pics of