[jira] [Created] (BAHIR-215) bump flink to 1.9.0
Joao Boto created BAHIR-215: --- Summary: bump flink to 1.9.0 Key: BAHIR-215 URL: https://issues.apache.org/jira/browse/BAHIR-215 Project: Bahir Issue Type: Improvement Reporter: Joao Boto Assignee: Joao Boto -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Closed] (BAHIR-209) bump kudu version to 1.10.0
[ https://issues.apache.org/jira/browse/BAHIR-209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto closed BAHIR-209. --- Resolution: Fixed Fix Version/s: Flink-Next > bump kudu version to 1.10.0 > --- > > Key: BAHIR-209 > URL: https://issues.apache.org/jira/browse/BAHIR-209 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Closed] (BAHIR-207) add suport for scala 2.12 on travis
[ https://issues.apache.org/jira/browse/BAHIR-207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto closed BAHIR-207. --- Resolution: Fixed Fix Version/s: Flink-Next > add suport for scala 2.12 on travis > --- > > Key: BAHIR-207 > URL: https://issues.apache.org/jira/browse/BAHIR-207 > Project: Bahir > Issue Type: Test > Components: Flink Streaming Connectors >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (BAHIR-214) Improve KuduConnector speed
Joao Boto created BAHIR-214: --- Summary: Improve KuduConnector speed Key: BAHIR-214 URL: https://issues.apache.org/jira/browse/BAHIR-214 Project: Bahir Issue Type: Improvement Components: Flink Streaming Connectors Reporter: Joao Boto Assignee: Joao Boto kudu connector has some issues on kudu sink with some flush modes that kill sink over time this is a refactor to resolve that issues and improve speed on eventual consistence -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (BAHIR-211) fix siddhi warning
Joao Boto created BAHIR-211: --- Summary: fix siddhi warning Key: BAHIR-211 URL: https://issues.apache.org/jira/browse/BAHIR-211 Project: Bahir Issue Type: Improvement Components: Flink Streaming Connectors Reporter: Joao Boto Assignee: Joao Boto siddhi as to many warning and is causing travis to fail, as we exceed de 4mb log limit -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work started] (BAHIR-210) bump flink version to 1.8.1
[ https://issues.apache.org/jira/browse/BAHIR-210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BAHIR-210 started by Joao Boto. --- > bump flink version to 1.8.1 > --- > > Key: BAHIR-210 > URL: https://issues.apache.org/jira/browse/BAHIR-210 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BAHIR-210) bump flink version to 1.8.1
Joao Boto created BAHIR-210: --- Summary: bump flink version to 1.8.1 Key: BAHIR-210 URL: https://issues.apache.org/jira/browse/BAHIR-210 Project: Bahir Issue Type: Improvement Components: Flink Streaming Connectors Reporter: Joao Boto Assignee: Joao Boto -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work started] (BAHIR-209) bump kudu version to 1.10.0
[ https://issues.apache.org/jira/browse/BAHIR-209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BAHIR-209 started by Joao Boto. --- > bump kudu version to 1.10.0 > --- > > Key: BAHIR-209 > URL: https://issues.apache.org/jira/browse/BAHIR-209 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BAHIR-209) bump kudu version to 1.10.0
Joao Boto created BAHIR-209: --- Summary: bump kudu version to 1.10.0 Key: BAHIR-209 URL: https://issues.apache.org/jira/browse/BAHIR-209 Project: Bahir Issue Type: Improvement Reporter: Joao Boto Assignee: Joao Boto -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (BAHIR-209) bump kudu version to 1.10.0
[ https://issues.apache.org/jira/browse/BAHIR-209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto updated BAHIR-209: Component/s: Flink Streaming Connectors > bump kudu version to 1.10.0 > --- > > Key: BAHIR-209 > URL: https://issues.apache.org/jira/browse/BAHIR-209 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BAHIR-207) add suport for scala 2.12 on travis
Joao Boto created BAHIR-207: --- Summary: add suport for scala 2.12 on travis Key: BAHIR-207 URL: https://issues.apache.org/jira/browse/BAHIR-207 Project: Bahir Issue Type: Test Components: Flink Streaming Connectors Reporter: Joao Boto Assignee: Joao Boto -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (BAHIR-153) Support flink-library-siddhi scala DSL
[ https://issues.apache.org/jira/browse/BAHIR-153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto closed BAHIR-153. --- Resolution: Fixed Fix Version/s: Flink-Next closed by merged PR > Support flink-library-siddhi scala DSL > -- > > Key: BAHIR-153 > URL: https://issues.apache.org/jira/browse/BAHIR-153 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Hao Chen >Assignee: Hao Chen >Priority: Major > Fix For: Flink-Next > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (BAHIR-158) Support control stream for managing multiple Siddhi CEP runtime dynamically
[ https://issues.apache.org/jira/browse/BAHIR-158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto closed BAHIR-158. --- Resolution: Fixed Fix Version/s: Flink-Next closing as exists a merged PR > Support control stream for managing multiple Siddhi CEP runtime dynamically > --- > > Key: BAHIR-158 > URL: https://issues.apache.org/jira/browse/BAHIR-158 > Project: Bahir > Issue Type: New Feature > Components: Flink Streaming Connectors >Reporter: Hao Chen >Assignee: Hao Chen >Priority: Major > Fix For: Flink-Next > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work started] (BAHIR-200) change from docker tests to kudu-test-utils
[ https://issues.apache.org/jira/browse/BAHIR-200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BAHIR-200 started by Joao Boto. --- > change from docker tests to kudu-test-utils > --- > > Key: BAHIR-200 > URL: https://issues.apache.org/jira/browse/BAHIR-200 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > > As of version 1.9.0, Kudu ships with an experimental feature called the > binary test JAR. This feature gives people who want to test against Kudu the > capability to start a Kudu "mini cluster" from Java or another JVM-based > language without having to first build Kudu locally > > https://kudu.apache.org/docs/developing.html#_jvm_based_integration_testing -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work started] (BAHIR-206) bump flink to 1.8.0
[ https://issues.apache.org/jira/browse/BAHIR-206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BAHIR-206 started by Joao Boto. --- > bump flink to 1.8.0 > --- > > Key: BAHIR-206 > URL: https://issues.apache.org/jira/browse/BAHIR-206 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > > bump flink version to 1.8.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BAHIR-206) bump flink to 1.8.0
Joao Boto created BAHIR-206: --- Summary: bump flink to 1.8.0 Key: BAHIR-206 URL: https://issues.apache.org/jira/browse/BAHIR-206 Project: Bahir Issue Type: Improvement Components: Flink Streaming Connectors Reporter: Joao Boto Assignee: Joao Boto bump flink version to 1.8.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (BAHIR-193) changes so scala version modifications are easier
[ https://issues.apache.org/jira/browse/BAHIR-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto closed BAHIR-193. --- Resolution: Won't Fix Fix Version/s: Flink-Next > changes so scala version modifications are easier > - > > Key: BAHIR-193 > URL: https://issues.apache.org/jira/browse/BAHIR-193 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > > remove scala version from artifact name on parent > on modules set scala version by parameter with ${scala.binary.version} > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (BAHIR-197) Add FlumeSink to Flume connector
[ https://issues.apache.org/jira/browse/BAHIR-197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto closed BAHIR-197. --- Resolution: Fixed Fix Version/s: Flink-Next > Add FlumeSink to Flume connector > > > Key: BAHIR-197 > URL: https://issues.apache.org/jira/browse/BAHIR-197 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Affects Versions: Flink-Next >Reporter: Luciano Resende >Priority: Major > Fix For: Flink-Next > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (BAHIR-200) change from docker tests to kudu-test-utils
[ https://issues.apache.org/jira/browse/BAHIR-200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto updated BAHIR-200: Component/s: Flink Streaming Connectors > change from docker tests to kudu-test-utils > --- > > Key: BAHIR-200 > URL: https://issues.apache.org/jira/browse/BAHIR-200 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > > As of version 1.9.0, Kudu ships with an experimental feature called the > binary test JAR. This feature gives people who want to test against Kudu the > capability to start a Kudu "mini cluster" from Java or another JVM-based > language without having to first build Kudu locally > > https://kudu.apache.org/docs/developing.html#_jvm_based_integration_testing -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BAHIR-200) change from docker tests to kudu-test-utils
Joao Boto created BAHIR-200: --- Summary: change from docker tests to kudu-test-utils Key: BAHIR-200 URL: https://issues.apache.org/jira/browse/BAHIR-200 Project: Bahir Issue Type: Improvement Reporter: Joao Boto Assignee: Joao Boto As of version 1.9.0, Kudu ships with an experimental feature called the binary test JAR. This feature gives people who want to test against Kudu the capability to start a Kudu "mini cluster" from Java or another JVM-based language without having to first build Kudu locally https://kudu.apache.org/docs/developing.html#_jvm_based_integration_testing -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (BAHIR-180) kudu connector improve real-time data performance
[ https://issues.apache.org/jira/browse/BAHIR-180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto closed BAHIR-180. --- Resolution: Fixed > kudu connector improve real-time data performance > - > > Key: BAHIR-180 > URL: https://issues.apache.org/jira/browse/BAHIR-180 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Affects Versions: Flink-Next >Reporter: mei jie >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > > kudu connector has poof performance to write real-time data with either > strong consistency or eventual consistency. at my environment(3server with > 250G memory, 5 disk, and the parallelism of flink is 60), the speed is about > 20,000/s. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (BAHIR-199) bump kudu version to 1.9.0
[ https://issues.apache.org/jira/browse/BAHIR-199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto updated BAHIR-199: Fix Version/s: Flink-Next > bump kudu version to 1.9.0 > -- > > Key: BAHIR-199 > URL: https://issues.apache.org/jira/browse/BAHIR-199 > Project: Bahir > Issue Type: Improvement >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (BAHIR-196) update to scala 2.12
[ https://issues.apache.org/jira/browse/BAHIR-196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto reassigned BAHIR-196: --- Assignee: Joao Boto > update to scala 2.12 > > > Key: BAHIR-196 > URL: https://issues.apache.org/jira/browse/BAHIR-196 > Project: Bahir > Issue Type: Improvement >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (BAHIR-196) update to scala 2.12
[ https://issues.apache.org/jira/browse/BAHIR-196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto updated BAHIR-196: Fix Version/s: Flink-Next > update to scala 2.12 > > > Key: BAHIR-196 > URL: https://issues.apache.org/jira/browse/BAHIR-196 > Project: Bahir > Issue Type: Improvement >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (BAHIR-196) update to scala 2.12
[ https://issues.apache.org/jira/browse/BAHIR-196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto closed BAHIR-196. --- Resolution: Fixed > update to scala 2.12 > > > Key: BAHIR-196 > URL: https://issues.apache.org/jira/browse/BAHIR-196 > Project: Bahir > Issue Type: Improvement >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (BAHIR-199) bump kudu version to 1.9.0
[ https://issues.apache.org/jira/browse/BAHIR-199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto reassigned BAHIR-199: --- Assignee: Joao Boto > bump kudu version to 1.9.0 > -- > > Key: BAHIR-199 > URL: https://issues.apache.org/jira/browse/BAHIR-199 > Project: Bahir > Issue Type: Improvement >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (BAHIR-199) bump kudu version to 1.9.0
[ https://issues.apache.org/jira/browse/BAHIR-199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto closed BAHIR-199. --- Resolution: Fixed > bump kudu version to 1.9.0 > -- > > Key: BAHIR-199 > URL: https://issues.apache.org/jira/browse/BAHIR-199 > Project: Bahir > Issue Type: Improvement >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (BAHIR-198) bump flink version to 1.7.2
[ https://issues.apache.org/jira/browse/BAHIR-198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto closed BAHIR-198. --- Resolution: Fixed > bump flink version to 1.7.2 > --- > > Key: BAHIR-198 > URL: https://issues.apache.org/jira/browse/BAHIR-198 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (BAHIR-198) bump flink version to 1.7.2
[ https://issues.apache.org/jira/browse/BAHIR-198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto updated BAHIR-198: Component/s: Flink Streaming Connectors > bump flink version to 1.7.2 > --- > > Key: BAHIR-198 > URL: https://issues.apache.org/jira/browse/BAHIR-198 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (BAHIR-198) bump flink version to 1.7.2
[ https://issues.apache.org/jira/browse/BAHIR-198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto updated BAHIR-198: Fix Version/s: Flink-Next > bump flink version to 1.7.2 > --- > > Key: BAHIR-198 > URL: https://issues.apache.org/jira/browse/BAHIR-198 > Project: Bahir > Issue Type: Improvement >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (BAHIR-198) bump flink version to 1.7.2
[ https://issues.apache.org/jira/browse/BAHIR-198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto reassigned BAHIR-198: --- Assignee: Joao Boto > bump flink version to 1.7.2 > --- > > Key: BAHIR-198 > URL: https://issues.apache.org/jira/browse/BAHIR-198 > Project: Bahir > Issue Type: Improvement >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BAHIR-199) bump kudu version to 1.9.0
Joao Boto created BAHIR-199: --- Summary: bump kudu version to 1.9.0 Key: BAHIR-199 URL: https://issues.apache.org/jira/browse/BAHIR-199 Project: Bahir Issue Type: Improvement Reporter: Joao Boto -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BAHIR-198) bump flink version to 1.7.2
Joao Boto created BAHIR-198: --- Summary: bump flink version to 1.7.2 Key: BAHIR-198 URL: https://issues.apache.org/jira/browse/BAHIR-198 Project: Bahir Issue Type: Improvement Reporter: Joao Boto -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (BAHIR-196) update to scala 2.12
[ https://issues.apache.org/jira/browse/BAHIR-196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto updated BAHIR-196: Summary: update to scala 2.12 (was: update parent pom libs) > update to scala 2.12 > > > Key: BAHIR-196 > URL: https://issues.apache.org/jira/browse/BAHIR-196 > Project: Bahir > Issue Type: Improvement >Reporter: Joao Boto >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BAHIR-196) update parent pom libs
Joao Boto created BAHIR-196: --- Summary: update parent pom libs Key: BAHIR-196 URL: https://issues.apache.org/jira/browse/BAHIR-196 Project: Bahir Issue Type: Improvement Reporter: Joao Boto -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BAHIR-194) update kudu version to 1.8.0
Joao Boto created BAHIR-194: --- Summary: update kudu version to 1.8.0 Key: BAHIR-194 URL: https://issues.apache.org/jira/browse/BAHIR-194 Project: Bahir Issue Type: Improvement Reporter: Joao Boto Assignee: Joao Boto -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BAHIR-195) bump flink version to 1.7.1
Joao Boto created BAHIR-195: --- Summary: bump flink version to 1.7.1 Key: BAHIR-195 URL: https://issues.apache.org/jira/browse/BAHIR-195 Project: Bahir Issue Type: Improvement Reporter: Joao Boto Assignee: Joao Boto -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (BAHIR-193) changes so scala version modifications are easier
[ https://issues.apache.org/jira/browse/BAHIR-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto reassigned BAHIR-193: --- Assignee: Joao Boto > changes so scala version modifications are easier > - > > Key: BAHIR-193 > URL: https://issues.apache.org/jira/browse/BAHIR-193 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > > remove scala version from artifact name on parent > on modules set scala version by parameter with ${scala.binary.version} > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BAHIR-193) changes so scala version modifications are easier
Joao Boto created BAHIR-193: --- Summary: changes so scala version modifications are easier Key: BAHIR-193 URL: https://issues.apache.org/jira/browse/BAHIR-193 Project: Bahir Issue Type: Improvement Components: Flink Streaming Connectors Reporter: Joao Boto remove scala version from artifact name on parent on modules set scala version by parameter with ${scala.binary.version} -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (BAHIR-180) kudu connector improve real-time data performance
[ https://issues.apache.org/jira/browse/BAHIR-180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto updated BAHIR-180: Affects Version/s: (was: Flink-1.0) Flink-Next > kudu connector improve real-time data performance > - > > Key: BAHIR-180 > URL: https://issues.apache.org/jira/browse/BAHIR-180 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Affects Versions: Flink-Next >Reporter: mei jie >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > > kudu connector has poof performance to write real-time data with either > strong consistency or eventual consistency. at my environment(3server with > 250G memory, 5 disk, and the parallelism of flink is 60), the speed is about > 20,000/s. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BAHIR-191) update flume version to 1.9.0
Joao Boto created BAHIR-191: --- Summary: update flume version to 1.9.0 Key: BAHIR-191 URL: https://issues.apache.org/jira/browse/BAHIR-191 Project: Bahir Issue Type: Improvement Reporter: Joao Boto Assignee: Joao Boto flume has new version.. update to last one https://flume.apache.org/releases/1.9.0.html -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (BAHIR-179) fail silently when tests need docker image to be running
[ https://issues.apache.org/jira/browse/BAHIR-179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto closed BAHIR-179. --- Resolution: Fixed Fix Version/s: Flink-Next > fail silently when tests need docker image to be running > > > Key: BAHIR-179 > URL: https://issues.apache.org/jira/browse/BAHIR-179 > Project: Bahir > Issue Type: Test > Components: Flink Streaming Connectors >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Minor > Fix For: Flink-Next > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work started] (BAHIR-188) update flink to 1.7.0
[ https://issues.apache.org/jira/browse/BAHIR-188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BAHIR-188 started by Joao Boto. --- > update flink to 1.7.0 > - > > Key: BAHIR-188 > URL: https://issues.apache.org/jira/browse/BAHIR-188 > Project: Bahir > Issue Type: Task >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > > Update Flink to last version (1.7.0) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (BAHIR-188) update flink to 1.7.0
[ https://issues.apache.org/jira/browse/BAHIR-188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto updated BAHIR-188: Description: Update Flink to last version (1.7.0) > update flink to 1.7.0 > - > > Key: BAHIR-188 > URL: https://issues.apache.org/jira/browse/BAHIR-188 > Project: Bahir > Issue Type: Task >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > > Update Flink to last version (1.7.0) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BAHIR-188) update flink to 1.7.0
Joao Boto created BAHIR-188: --- Summary: update flink to 1.7.0 Key: BAHIR-188 URL: https://issues.apache.org/jira/browse/BAHIR-188 Project: Bahir Issue Type: Task Reporter: Joao Boto Assignee: Joao Boto -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BAHIR-180) kudu connector improve real-time data performance
[ https://issues.apache.org/jira/browse/BAHIR-180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678600#comment-16678600 ] Joao Boto commented on BAHIR-180: - [~meijies] can you test this [https://github.com/eskabetxe/bahir-flink/tree/BAHIR-180] i change the "eventual consistence" and this should improve the writing speed > kudu connector improve real-time data performance > - > > Key: BAHIR-180 > URL: https://issues.apache.org/jira/browse/BAHIR-180 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Affects Versions: Flink-1.0 >Reporter: mei jie >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > > kudu connector has poof performance to write real-time data with either > strong consistency or eventual consistency. at my environment(3server with > 250G memory, 5 disk, and the parallelism of flink is 60), the speed is about > 20,000/s. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (BAHIR-180) kudu connector improve real-time data performance
[ https://issues.apache.org/jira/browse/BAHIR-180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto reassigned BAHIR-180: --- Assignee: Joao Boto > kudu connector improve real-time data performance > - > > Key: BAHIR-180 > URL: https://issues.apache.org/jira/browse/BAHIR-180 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Affects Versions: Flink-1.0 >Reporter: mei jie >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > > kudu connector has poof performance to write real-time data with either > strong consistency or eventual consistency. at my environment(3server with > 250G memory, 5 disk, and the parallelism of flink is 60), the speed is about > 20,000/s. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work started] (BAHIR-179) fail silently when tests need docker image to be running
[ https://issues.apache.org/jira/browse/BAHIR-179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BAHIR-179 started by Joao Boto. --- > fail silently when tests need docker image to be running > > > Key: BAHIR-179 > URL: https://issues.apache.org/jira/browse/BAHIR-179 > Project: Bahir > Issue Type: Test > Components: Flink Streaming Connectors >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Minor > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BAHIR-179) fail silently when tests need docker image to be running
Joao Boto created BAHIR-179: --- Summary: fail silently when tests need docker image to be running Key: BAHIR-179 URL: https://issues.apache.org/jira/browse/BAHIR-179 Project: Bahir Issue Type: Test Components: Flink Streaming Connectors Reporter: Joao Boto Assignee: Joao Boto -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (BAHIR-99) Kudu connector to read/write from/to Kudu
[ https://issues.apache.org/jira/browse/BAHIR-99?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622741#comment-16622741 ] Joao Boto edited comment on BAHIR-99 at 9/20/18 9:35 PM: - [~meijies] could you start a new issue with that.. i have created some tests (with strong consistency that is slower) and i'm getting less than 2s to write 1000 records was (Author: eskabetxe): [~meijies] could you start a new issue with that.. i have created some tests and i'm getting less than 2s to write 1000 records > Kudu connector to read/write from/to Kudu > - > > Key: BAHIR-99 > URL: https://issues.apache.org/jira/browse/BAHIR-99 > Project: Bahir > Issue Type: New Feature > Components: Flink Streaming Connectors >Affects Versions: Flink-1.0 >Reporter: Rubén Casado >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > > Java library to integrate Apache Kudu and Apache Flink. Main goal is to be > able to read/write data from/to Kudu using the DataSet and DataStream Flink's > APIs. > Data flows patterns: > Batch > - Kudu -> DataSet -> Kudu > - Kudu -> DataSet -> other source > - Other source -> DataSet -> other source > Stream > - Other source -> DataStream -> Kudu > Code is available in https://github.com/rubencasado/Flink-Kudu -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BAHIR-99) Kudu connector to read/write from/to Kudu
[ https://issues.apache.org/jira/browse/BAHIR-99?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622741#comment-16622741 ] Joao Boto commented on BAHIR-99: [~meijies] could you start a new issue with that.. i have created some tests and i'm getting less than 2s to write 1000 records > Kudu connector to read/write from/to Kudu > - > > Key: BAHIR-99 > URL: https://issues.apache.org/jira/browse/BAHIR-99 > Project: Bahir > Issue Type: New Feature > Components: Flink Streaming Connectors >Affects Versions: Flink-1.0 >Reporter: Rubén Casado >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > > Java library to integrate Apache Kudu and Apache Flink. Main goal is to be > able to read/write data from/to Kudu using the DataSet and DataStream Flink's > APIs. > Data flows patterns: > Batch > - Kudu -> DataSet -> Kudu > - Kudu -> DataSet -> other source > - Other source -> DataSet -> other source > Stream > - Other source -> DataStream -> Kudu > Code is available in https://github.com/rubencasado/Flink-Kudu -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (BAHIR-99) Kudu connector to read/write from/to Kudu
[ https://issues.apache.org/jira/browse/BAHIR-99?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16619630#comment-16619630 ] Joao Boto edited comment on BAHIR-99 at 9/18/18 7:57 PM: - [~meijies] try setting eventual consistency {code:java} KuduOutputFormat outputFormat = new KuduOutputFormat<>(hostsCluster, tableInfo) .withEventualConsistency(); {code} If you are using StrongConsistency (default) will be wait for the ok from kudu.. was (Author: eskabetxe): [~meijies] try setting eventual consistency {code:java} // code placeholder KuduOutputFormat outputFormat = new KuduOutputFormat<>(hostsCluster, tableInfo) .withEventualConsistency(); {code} If you are using StrongConsistency (default) will be wait for the ok from kudu.. > Kudu connector to read/write from/to Kudu > - > > Key: BAHIR-99 > URL: https://issues.apache.org/jira/browse/BAHIR-99 > Project: Bahir > Issue Type: New Feature > Components: Flink Streaming Connectors >Affects Versions: Flink-1.0 >Reporter: Rubén Casado >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > > Java library to integrate Apache Kudu and Apache Flink. Main goal is to be > able to read/write data from/to Kudu using the DataSet and DataStream Flink's > APIs. > Data flows patterns: > Batch > - Kudu -> DataSet -> Kudu > - Kudu -> DataSet -> other source > - Other source -> DataSet -> other source > Stream > - Other source -> DataStream -> Kudu > Code is available in https://github.com/rubencasado/Flink-Kudu -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (BAHIR-176) [FLINK] update flink to 1.6.0
[ https://issues.apache.org/jira/browse/BAHIR-176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto closed BAHIR-176. --- > [FLINK] update flink to 1.6.0 > - > > Key: BAHIR-176 > URL: https://issues.apache.org/jira/browse/BAHIR-176 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > > Update Flink to last version -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BAHIR-99) Kudu connector to read/write from/to Kudu
[ https://issues.apache.org/jira/browse/BAHIR-99?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16619630#comment-16619630 ] Joao Boto commented on BAHIR-99: [~meijies] try setting eventual consistency {code:java} // code placeholder KuduOutputFormat outputFormat = new KuduOutputFormat<>(hostsCluster, tableInfo) .withEventualConsistency(); {code} If you are using StrongConsistency (default) will be wait for the ok from kudu.. > Kudu connector to read/write from/to Kudu > - > > Key: BAHIR-99 > URL: https://issues.apache.org/jira/browse/BAHIR-99 > Project: Bahir > Issue Type: New Feature > Components: Flink Streaming Connectors >Affects Versions: Flink-1.0 >Reporter: Rubén Casado >Assignee: Joao Boto >Priority: Major > Fix For: Flink-Next > > > Java library to integrate Apache Kudu and Apache Flink. Main goal is to be > able to read/write data from/to Kudu using the DataSet and DataStream Flink's > APIs. > Data flows patterns: > Batch > - Kudu -> DataSet -> Kudu > - Kudu -> DataSet -> other source > - Other source -> DataSet -> other source > Stream > - Other source -> DataStream -> Kudu > Code is available in https://github.com/rubencasado/Flink-Kudu -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (BAHIR-114) Flink Flume connector missing automated unit tests
[ https://issues.apache.org/jira/browse/BAHIR-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto reassigned BAHIR-114: --- Assignee: Joao Boto > Flink Flume connector missing automated unit tests > -- > > Key: BAHIR-114 > URL: https://issues.apache.org/jira/browse/BAHIR-114 > Project: Bahir > Issue Type: Test > Components: Flink Streaming Connectors >Affects Versions: Flink-Next >Reporter: Christian Kadner >Assignee: Joao Boto >Priority: Major > > The module {{flink-connector-flume}} does not have any automated unit tests. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work started] (BAHIR-176) [FLINK] update flink to 1.6.0
[ https://issues.apache.org/jira/browse/BAHIR-176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BAHIR-176 started by Joao Boto. --- > [FLINK] update flink to 1.6.0 > - > > Key: BAHIR-176 > URL: https://issues.apache.org/jira/browse/BAHIR-176 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > > Update Flink to last version -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (BAHIR-176) [FLINK] update flink to 1.6.0
[ https://issues.apache.org/jira/browse/BAHIR-176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Boto updated BAHIR-176: Summary: [FLINK] update flink to 1.6.0 (was: update flink to 1.6.0) > [FLINK] update flink to 1.6.0 > - > > Key: BAHIR-176 > URL: https://issues.apache.org/jira/browse/BAHIR-176 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Joao Boto >Assignee: Joao Boto >Priority: Major > > Update Flink to last version -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BAHIR-176) update flink to 1.6.0
Joao Boto created BAHIR-176: --- Summary: update flink to 1.6.0 Key: BAHIR-176 URL: https://issues.apache.org/jira/browse/BAHIR-176 Project: Bahir Issue Type: Improvement Components: Flink Streaming Connectors Reporter: Joao Boto Assignee: Joao Boto Update Flink to last version -- This message was sent by Atlassian JIRA (v7.6.3#76005)