[jira] [Commented] (FLINK-25283) End-to-end application modules create oversized jars
[ https://issues.apache.org/jira/browse/FLINK-25283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17473237#comment-17473237 ] Dian Fu commented on FLINK-25283: - [~chesnay] Thanks. I'll take a look at this issue. > End-to-end application modules create oversized jars > > > Key: FLINK-25283 > URL: https://issues.apache.org/jira/browse/FLINK-25283 > Project: Flink > Issue Type: Technical Debt > Components: Tests >Affects Versions: 1.13.0 >Reporter: Chesnay Schepler >Assignee: Chesnay Schepler >Priority: Major > Fix For: 1.15.0 > > > Various modules that create jars for e2e tests (e.g., > flink-streaming-kinesis-test) create oversized jars (100mb+) because they > bundle their entire dependency tree, including many parts of Flink, along > with test dependencies and test resources. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (FLINK-25283) End-to-end application modules create oversized jars
[ https://issues.apache.org/jira/browse/FLINK-25283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471895#comment-17471895 ] Chesnay Schepler commented on FLINK-25283: -- [~dianfu] flink-end-to-end-tests/flink-python-test has a compile dependency on flink-python, and bundles it along with all of it's transitive dependencies. If I set it to provided the job fails, even if flink-python is added to lib/. That's where I'm stuck. > End-to-end application modules create oversized jars > > > Key: FLINK-25283 > URL: https://issues.apache.org/jira/browse/FLINK-25283 > Project: Flink > Issue Type: Technical Debt > Components: Tests >Affects Versions: 1.13.0 >Reporter: Chesnay Schepler >Assignee: Chesnay Schepler >Priority: Major > Fix For: 1.15.0 > > > Various modules that create jars for e2e tests (e.g., > flink-streaming-kinesis-test) create oversized jars (100mb+) because they > bundle their entire dependency tree, including many parts of Flink, along > with test dependencies and test resources. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (FLINK-25283) End-to-end application modules create oversized jars
[ https://issues.apache.org/jira/browse/FLINK-25283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463188#comment-17463188 ] Martijn Visser commented on FLINK-25283: I need to defer to [~chesnay] for more info :) > End-to-end application modules create oversized jars > > > Key: FLINK-25283 > URL: https://issues.apache.org/jira/browse/FLINK-25283 > Project: Flink > Issue Type: Technical Debt > Components: Tests >Affects Versions: 1.13.0 >Reporter: Chesnay Schepler >Assignee: Chesnay Schepler >Priority: Major > Fix For: 1.15.0 > > > Various modules that create jars for e2e tests (e.g., > flink-streaming-kinesis-test) create oversized jars (100mb+) because they > bundle their entire dependency tree, including many parts of Flink, along > with test dependencies and test resources. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (FLINK-25283) End-to-end application modules create oversized jars
[ https://issues.apache.org/jira/browse/FLINK-25283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461196#comment-17461196 ] Dian Fu commented on FLINK-25283: - [~chesnay] [~MartijnVisser] Could you share more information about this? For example, what you are trying to do in this ticket and the failure for the Python tests? > End-to-end application modules create oversized jars > > > Key: FLINK-25283 > URL: https://issues.apache.org/jira/browse/FLINK-25283 > Project: Flink > Issue Type: Technical Debt > Components: Tests >Affects Versions: 1.13.0 >Reporter: Chesnay Schepler >Assignee: Chesnay Schepler >Priority: Major > Fix For: 1.15.0 > > > Various modules that create jars for e2e tests (e.g., > flink-streaming-kinesis-test) create oversized jars (100mb+) because they > bundle their entire dependency tree, including many parts of Flink, along > with test dependencies and test resources. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (FLINK-25283) End-to-end application modules create oversized jars
[ https://issues.apache.org/jira/browse/FLINK-25283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460638#comment-17460638 ] Martijn Visser commented on FLINK-25283: [~dianfu] [~hxbks2ks] Do you know what's going on with the Python tests? > End-to-end application modules create oversized jars > > > Key: FLINK-25283 > URL: https://issues.apache.org/jira/browse/FLINK-25283 > Project: Flink > Issue Type: Technical Debt > Components: Tests >Affects Versions: 1.13.0 >Reporter: Chesnay Schepler >Assignee: Chesnay Schepler >Priority: Major > Fix For: 1.15.0 > > > Various modules that create jars for e2e tests (e.g., > flink-streaming-kinesis-test) create oversized jars (100mb+) because they > bundle their entire dependency tree, including many parts of Flink, along > with test dependencies and test resources. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (FLINK-25283) End-to-end application modules create oversized jars
[ https://issues.apache.org/jira/browse/FLINK-25283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460623#comment-17460623 ] Chesnay Schepler commented on FLINK-25283: -- I have already covered kinesis. The only thing I can't quite figure out is the python tests, which bundle flink-python in some sort of fat-jar, but the tests fail without it (even if flink-python is in lib/). > End-to-end application modules create oversized jars > > > Key: FLINK-25283 > URL: https://issues.apache.org/jira/browse/FLINK-25283 > Project: Flink > Issue Type: Technical Debt > Components: Tests >Affects Versions: 1.13.0 >Reporter: Chesnay Schepler >Assignee: Chesnay Schepler >Priority: Major > Fix For: 1.15.0 > > > Various modules that create jars for e2e tests (e.g., > flink-streaming-kinesis-test) create oversized jars (100mb+) because they > bundle their entire dependency tree, including many parts of Flink, along > with test dependencies and test resources. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (FLINK-25283) End-to-end application modules create oversized jars
[ https://issues.apache.org/jira/browse/FLINK-25283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460480#comment-17460480 ] Martijn Visser commented on FLINK-25283: [~dannycranmer] For Kinesis, is this something you could look into? > End-to-end application modules create oversized jars > > > Key: FLINK-25283 > URL: https://issues.apache.org/jira/browse/FLINK-25283 > Project: Flink > Issue Type: Technical Debt > Components: Tests >Affects Versions: 1.13.0 >Reporter: Chesnay Schepler >Assignee: Chesnay Schepler >Priority: Major > Fix For: 1.15.0 > > > Various modules that create jars for e2e tests (e.g., > flink-streaming-kinesis-test) create oversized jars (100mb+) because they > bundle their entire dependency tree, including many parts of Flink, along > with test dependencies and test resources. -- This message was sent by Atlassian Jira (v8.20.1#820001)
