[jira] [Updated] (FLINK-34420) Various YARN tests fail after failing to download hadoop.tar.gz

2024-02-27 Thread Matthias Pohl (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-34420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matthias Pohl updated FLINK-34420:
--
Fix Version/s: 1.17.3

> Various YARN tests fail after failing to download hadoop.tar.gz
> ---
>
> Key: FLINK-34420
> URL: https://issues.apache.org/jira/browse/FLINK-34420
> Project: Flink
>  Issue Type: Technical Debt
>  Components: Tests
>Affects Versions: 1.19.0, 1.18.2, 1.20.0
>Reporter: Roman Khachatryan
>Assignee: Roman Khachatryan
>Priority: Blocker
> Fix For: 1.19.0, 1.17.3, 1.18.2
>
>
> https://dev.azure.com/khachatryanroman/flink/_build/results?buildId=1702=logs=0e31ee24-31a6-528c-a4bf-45cde9b2a14e=696bc156-f753-5888-468e-42d78df39222=11334
> https://dev.azure.com/khachatryanroman/flink/_build/results?buildId=1700=logs=bbbd0720-137e-5f59-95a5-b5d332f196d3=4769aa47-e87b-5ecd-1fb2-14d52396866d=9937
> ```
> 2024-02-09T19:21:57.8947690Z Feb 09 19:21:57 Pre-downloading Hadoop tarball
> 2024-02-09T19:21:57.9250518Z   % Total% Received % Xferd  Average Speed   
> TimeTime Time  Current
> 2024-02-09T19:21:57.9250844Z  Dload  Upload   
> Total   SpentLeft  Speed
> 2024-02-09T19:21:57.9251910Z 
> 2024-02-09T19:21:58.0005684Z   0 00 00 0  0  0 
> --:--:-- --:--:-- --:--:-- 0
> 2024-02-09T19:21:58.0006583Z 100   288  100   2880 0   3789  0 
> --:--:-- --:--:-- --:--:--  3789
> ```
> which is way too small - meaning we got redirection 
> (https://dev.azure.com/khachatryanroman/flink/_build/results?buildId=1700=logs=bbbd0720-137e-5f59-95a5-b5d332f196d3=4769aa47-e87b-5ecd-1fb2-14d52396866d=8056
>  )
> Later, it can't be unpacked:
> https://dev.azure.com/khachatryanroman/flink/_build/results?buildId=1700=logs=bbbd0720-137e-5f59-95a5-b5d332f196d3=4769aa47-e87b-5ecd-1fb2-14d52396866d=9657
> ```
> #11 [ 7/28] COPY hadoop.tar.gz /tmp/hadoop.tar.gz
> #11 CACHED
> #12 [ 8/28] RUN set -x && mkdir -p /usr/local/hadoop && tar -xf 
> /tmp/hadoop.tar.gz --strip-components=1 -C /usr/local/hadoop && rm 
> /tmp/hadoop.tar.gz*
> #12 0.175 + mkdir -p /usr/local/hadoop
> #12 0.177 + tar -xf /tmp/hadoop.tar.gz --strip-components=1 -C 
> /usr/local/hadoop
> #12 0.178 tar: This does not look like a tar archive
> #12 0.179 
> #12 0.179 gzip: stdin: not in gzip format
> #12 0.179 tar: Child returned status 1
> #12 0.179 tar: Error is not recoverable: exiting now
> ```



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (FLINK-34420) Various YARN tests fail after failing to download hadoop.tar.gz

2024-02-11 Thread Chesnay Schepler (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-34420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chesnay Schepler updated FLINK-34420:
-
Issue Type: Technical Debt  (was: Bug)

> Various YARN tests fail after failing to download hadoop.tar.gz
> ---
>
> Key: FLINK-34420
> URL: https://issues.apache.org/jira/browse/FLINK-34420
> Project: Flink
>  Issue Type: Technical Debt
>  Components: Tests
>Affects Versions: 1.19.0, 1.18.2, 1.20.0
>Reporter: Roman Khachatryan
>Assignee: Roman Khachatryan
>Priority: Blocker
> Fix For: 1.19.0, 1.18.2
>
>
> https://dev.azure.com/khachatryanroman/flink/_build/results?buildId=1702=logs=0e31ee24-31a6-528c-a4bf-45cde9b2a14e=696bc156-f753-5888-468e-42d78df39222=11334
> https://dev.azure.com/khachatryanroman/flink/_build/results?buildId=1700=logs=bbbd0720-137e-5f59-95a5-b5d332f196d3=4769aa47-e87b-5ecd-1fb2-14d52396866d=9937
> ```
> 2024-02-09T19:21:57.8947690Z Feb 09 19:21:57 Pre-downloading Hadoop tarball
> 2024-02-09T19:21:57.9250518Z   % Total% Received % Xferd  Average Speed   
> TimeTime Time  Current
> 2024-02-09T19:21:57.9250844Z  Dload  Upload   
> Total   SpentLeft  Speed
> 2024-02-09T19:21:57.9251910Z 
> 2024-02-09T19:21:58.0005684Z   0 00 00 0  0  0 
> --:--:-- --:--:-- --:--:-- 0
> 2024-02-09T19:21:58.0006583Z 100   288  100   2880 0   3789  0 
> --:--:-- --:--:-- --:--:--  3789
> ```
> which is way too small - meaning we got redirection 
> (https://dev.azure.com/khachatryanroman/flink/_build/results?buildId=1700=logs=bbbd0720-137e-5f59-95a5-b5d332f196d3=4769aa47-e87b-5ecd-1fb2-14d52396866d=8056
>  )
> Later, it can't be unpacked:
> https://dev.azure.com/khachatryanroman/flink/_build/results?buildId=1700=logs=bbbd0720-137e-5f59-95a5-b5d332f196d3=4769aa47-e87b-5ecd-1fb2-14d52396866d=9657
> ```
> #11 [ 7/28] COPY hadoop.tar.gz /tmp/hadoop.tar.gz
> #11 CACHED
> #12 [ 8/28] RUN set -x && mkdir -p /usr/local/hadoop && tar -xf 
> /tmp/hadoop.tar.gz --strip-components=1 -C /usr/local/hadoop && rm 
> /tmp/hadoop.tar.gz*
> #12 0.175 + mkdir -p /usr/local/hadoop
> #12 0.177 + tar -xf /tmp/hadoop.tar.gz --strip-components=1 -C 
> /usr/local/hadoop
> #12 0.178 tar: This does not look like a tar archive
> #12 0.179 
> #12 0.179 gzip: stdin: not in gzip format
> #12 0.179 tar: Child returned status 1
> #12 0.179 tar: Error is not recoverable: exiting now
> ```



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (FLINK-34420) Various YARN tests fail after failing to download hadoop.tar.gz

2024-02-11 Thread Chesnay Schepler (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-34420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chesnay Schepler updated FLINK-34420:
-
Fix Version/s: (was: 1.20.0)

> Various YARN tests fail after failing to download hadoop.tar.gz
> ---
>
> Key: FLINK-34420
> URL: https://issues.apache.org/jira/browse/FLINK-34420
> Project: Flink
>  Issue Type: Bug
>  Components: Tests
>Affects Versions: 1.19.0, 1.18.2, 1.20.0
>Reporter: Roman Khachatryan
>Assignee: Roman Khachatryan
>Priority: Blocker
> Fix For: 1.19.0, 1.18.2
>
>
> https://dev.azure.com/khachatryanroman/flink/_build/results?buildId=1702=logs=0e31ee24-31a6-528c-a4bf-45cde9b2a14e=696bc156-f753-5888-468e-42d78df39222=11334
> https://dev.azure.com/khachatryanroman/flink/_build/results?buildId=1700=logs=bbbd0720-137e-5f59-95a5-b5d332f196d3=4769aa47-e87b-5ecd-1fb2-14d52396866d=9937
> ```
> 2024-02-09T19:21:57.8947690Z Feb 09 19:21:57 Pre-downloading Hadoop tarball
> 2024-02-09T19:21:57.9250518Z   % Total% Received % Xferd  Average Speed   
> TimeTime Time  Current
> 2024-02-09T19:21:57.9250844Z  Dload  Upload   
> Total   SpentLeft  Speed
> 2024-02-09T19:21:57.9251910Z 
> 2024-02-09T19:21:58.0005684Z   0 00 00 0  0  0 
> --:--:-- --:--:-- --:--:-- 0
> 2024-02-09T19:21:58.0006583Z 100   288  100   2880 0   3789  0 
> --:--:-- --:--:-- --:--:--  3789
> ```
> which is way too small - meaning we got redirection 
> (https://dev.azure.com/khachatryanroman/flink/_build/results?buildId=1700=logs=bbbd0720-137e-5f59-95a5-b5d332f196d3=4769aa47-e87b-5ecd-1fb2-14d52396866d=8056
>  )
> Later, it can't be unpacked:
> https://dev.azure.com/khachatryanroman/flink/_build/results?buildId=1700=logs=bbbd0720-137e-5f59-95a5-b5d332f196d3=4769aa47-e87b-5ecd-1fb2-14d52396866d=9657
> ```
> #11 [ 7/28] COPY hadoop.tar.gz /tmp/hadoop.tar.gz
> #11 CACHED
> #12 [ 8/28] RUN set -x && mkdir -p /usr/local/hadoop && tar -xf 
> /tmp/hadoop.tar.gz --strip-components=1 -C /usr/local/hadoop && rm 
> /tmp/hadoop.tar.gz*
> #12 0.175 + mkdir -p /usr/local/hadoop
> #12 0.177 + tar -xf /tmp/hadoop.tar.gz --strip-components=1 -C 
> /usr/local/hadoop
> #12 0.178 tar: This does not look like a tar archive
> #12 0.179 
> #12 0.179 gzip: stdin: not in gzip format
> #12 0.179 tar: Child returned status 1
> #12 0.179 tar: Error is not recoverable: exiting now
> ```



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (FLINK-34420) Various YARN tests fail after failing to download hadoop.tar.gz

2024-02-10 Thread Roman Khachatryan (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-34420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Roman Khachatryan updated FLINK-34420:
--
Priority: Blocker  (was: Major)

> Various YARN tests fail after failing to download hadoop.tar.gz
> ---
>
> Key: FLINK-34420
> URL: https://issues.apache.org/jira/browse/FLINK-34420
> Project: Flink
>  Issue Type: Bug
>  Components: Tests
>Affects Versions: 1.19.0, 1.18.2, 1.20.0
>Reporter: Roman Khachatryan
>Assignee: Roman Khachatryan
>Priority: Blocker
> Fix For: 1.19.0, 1.18.2, 1.20.0
>
>
> https://dev.azure.com/khachatryanroman/flink/_build/results?buildId=1702=logs=0e31ee24-31a6-528c-a4bf-45cde9b2a14e=696bc156-f753-5888-468e-42d78df39222=11334
> https://dev.azure.com/khachatryanroman/flink/_build/results?buildId=1700=logs=bbbd0720-137e-5f59-95a5-b5d332f196d3=4769aa47-e87b-5ecd-1fb2-14d52396866d=9937
> ```
> 2024-02-09T19:21:57.8947690Z Feb 09 19:21:57 Pre-downloading Hadoop tarball
> 2024-02-09T19:21:57.9250518Z   % Total% Received % Xferd  Average Speed   
> TimeTime Time  Current
> 2024-02-09T19:21:57.9250844Z  Dload  Upload   
> Total   SpentLeft  Speed
> 2024-02-09T19:21:57.9251910Z 
> 2024-02-09T19:21:58.0005684Z   0 00 00 0  0  0 
> --:--:-- --:--:-- --:--:-- 0
> 2024-02-09T19:21:58.0006583Z 100   288  100   2880 0   3789  0 
> --:--:-- --:--:-- --:--:--  3789
> ```
> which is way too small - meaning we got redirection 
> (https://dev.azure.com/khachatryanroman/flink/_build/results?buildId=1700=logs=bbbd0720-137e-5f59-95a5-b5d332f196d3=4769aa47-e87b-5ecd-1fb2-14d52396866d=8056
>  )
> Later, it can't be unpacked:
> https://dev.azure.com/khachatryanroman/flink/_build/results?buildId=1700=logs=bbbd0720-137e-5f59-95a5-b5d332f196d3=4769aa47-e87b-5ecd-1fb2-14d52396866d=9657
> ```
> #11 [ 7/28] COPY hadoop.tar.gz /tmp/hadoop.tar.gz
> #11 CACHED
> #12 [ 8/28] RUN set -x && mkdir -p /usr/local/hadoop && tar -xf 
> /tmp/hadoop.tar.gz --strip-components=1 -C /usr/local/hadoop && rm 
> /tmp/hadoop.tar.gz*
> #12 0.175 + mkdir -p /usr/local/hadoop
> #12 0.177 + tar -xf /tmp/hadoop.tar.gz --strip-components=1 -C 
> /usr/local/hadoop
> #12 0.178 tar: This does not look like a tar archive
> #12 0.179 
> #12 0.179 gzip: stdin: not in gzip format
> #12 0.179 tar: Child returned status 1
> #12 0.179 tar: Error is not recoverable: exiting now
> ```



--
This message was sent by Atlassian Jira
(v8.20.10#820010)