[
https://issues.apache.org/jira/browse/SPARK-25335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25335:
----------------------------------
Description:
Zinc is 23.5MB.
{code}
$ curl -LO https://downloads.lightbend.com/zinc/0.3.15/zinc-0.3.15.tgz
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 23.5M 100 23.5M 0 0 35.4M 0 --:--:-- --:--:-- --:--:-- 35.3M
{code}
Currently, Spark downloads Zinc once. However, it occurs too many times in
build systems. This issue aims to skip Zinc downloading when the system already
has it.
{code}
$ build/mvn clean
exec: curl --progress-bar -L
https://downloads.lightbend.com/zinc/0.3.15/zinc-0.3.15.tgz
######################################################################## 100.0%
{code}
This will reduce many resources(CPU/Networks/DISK) at least in Mac and
Docker-based build system.
was:
Zinc is 23.5MB.
{code}
$ curl -LO https://downloads.lightbend.com/zinc/0.3.15/zinc-0.3.15.tgz
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 23.5M 100 23.5M 0 0 35.4M 0 --:--:-- --:--:-- --:--:-- 35.3M
{code}
Currently, Spark downloads Zinc once. However, it occurs too many times in
build systems. This issue aims to skip Zinc downloading when the system already
has it.
{code}
$ build/mvn clean
exec: curl --progress-bar -L
https://downloads.lightbend.com/zinc/0.3.15/zinc-0.3.15.tgz
######################################################################## 100.0%
########################################################################
{code}
This will reduce many resources(CPU/Networks/DISK) at least in Mac and
Docker-based build system.
> Skip Zinc downloading if it's installed in the system
> -----------------------------------------------------
>
> Key: SPARK-25335
> URL: https://issues.apache.org/jira/browse/SPARK-25335
> Project: Spark
> Issue Type: Improvement
> Components: Build
> Affects Versions: 2.4.0
> Reporter: Dongjoon Hyun
> Priority: Minor
>
> Zinc is 23.5MB.
> {code}
> $ curl -LO https://downloads.lightbend.com/zinc/0.3.15/zinc-0.3.15.tgz
> % Total % Received % Xferd Average Speed Time Time Time
> Current
> Dload Upload Total Spent Left Speed
> 100 23.5M 100 23.5M 0 0 35.4M 0 --:--:-- --:--:-- --:--:-- 35.3M
> {code}
> Currently, Spark downloads Zinc once. However, it occurs too many times in
> build systems. This issue aims to skip Zinc downloading when the system
> already has it.
> {code}
> $ build/mvn clean
> exec: curl --progress-bar -L
> https://downloads.lightbend.com/zinc/0.3.15/zinc-0.3.15.tgz
> ########################################################################
> 100.0%
> {code}
> This will reduce many resources(CPU/Networks/DISK) at least in Mac and
> Docker-based build system.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
