This is an automated email from the ASF dual-hosted git repository.
roryqi pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-uniffle.git
The following commit(s) were added to refs/heads/master by this push:
new e53b1cf Minimize apache-rat excluded files (#11)
e53b1cf is described below
commit e53b1cf07db4f8a354c1d9a9b309b35eedc6726e
Author: Kaijie Chen <[email protected]>
AuthorDate: Mon Jul 4 18:47:15 2022 +0800
Minimize apache-rat excluded files (#11)
### What changes were proposed in this pull request?
Add license header to files so we can minimize files to exclude in
apache-rat check.
### Why are the changes needed?
Asf podding issues
### Does this PR introduce _any_ user-facing change?
License header is visible in docs, just like
[spark](https://github.com/apache/spark/blob/master/docs/index.md?plain=1), for
example:
https://github.com/kaijchen/incubator-uniffle/blob/rat-exclude/docs/index.md
### How was this patch tested?
CI:
https://github.com/kaijchen/incubator-uniffle/runs/7176341386?check_suite_focus=true
---
CONTRIBUTING.md | 17 +++++++++++++++++
README.md | 17 +++++++++++++++++
docs/client_guide.md | 17 ++++++++++++++++-
docs/coordinator_guide.md | 17 ++++++++++++++++-
docs/index.md | 17 ++++++++++++++++-
docs/server_guide.md | 17 ++++++++++++++++-
pom.xml | 19 -------------------
.../spark-2.4.6_dynamic_allocation_support.patch | 17 +++++++++++++++++
.../spark-3.1.2_dynamic_allocation_support.patch | 17 +++++++++++++++++
.../spark-3.2.1_dynamic_allocation_support.patch | 17 +++++++++++++++++
10 files changed, 149 insertions(+), 23 deletions(-)
diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md
index 2288ea0..edaf7f9 100644
--- a/CONTRIBUTING.md
+++ b/CONTRIBUTING.md
@@ -1,3 +1,20 @@
+<!--
+ ~ Licensed to the Apache Software Foundation (ASF) under one or more
+ ~ contributor license agreements. See the NOTICE file distributed with
+ ~ this work for additional information regarding copyright ownership.
+ ~ The ASF licenses this file to You under the Apache License, Version 2.0
+ ~ (the "License"); you may not use this file except in compliance with
+ ~ the License. You may obtain a copy of the License at
+ ~
+ ~ http://www.apache.org/licenses/LICENSE-2.0
+ ~
+ ~ Unless required by applicable law or agreed to in writing, software
+ ~ distributed under the License is distributed on an "AS IS" BASIS,
+ ~ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ ~ See the License for the specific language governing permissions and
+ ~ limitations under the License.
+ -->
+
# Contributing to Firestorm
Welcome to [report Issues](https://github.com/Tencent/Firestorm/issues) or
[pull requests](https://github.com/Tencent/Firestorm/pulls). It's recommended
to read the following Contributing Guide first before contributing.
diff --git a/README.md b/README.md
index eba4fd3..6237ed1 100644
--- a/README.md
+++ b/README.md
@@ -1,3 +1,20 @@
+<!--
+ ~ Licensed to the Apache Software Foundation (ASF) under one or more
+ ~ contributor license agreements. See the NOTICE file distributed with
+ ~ this work for additional information regarding copyright ownership.
+ ~ The ASF licenses this file to You under the Apache License, Version 2.0
+ ~ (the "License"); you may not use this file except in compliance with
+ ~ the License. You may obtain a copy of the License at
+ ~
+ ~ http://www.apache.org/licenses/LICENSE-2.0
+ ~
+ ~ Unless required by applicable law or agreed to in writing, software
+ ~ distributed under the License is distributed on an "AS IS" BASIS,
+ ~ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ ~ See the License for the specific language governing permissions and
+ ~ limitations under the License.
+ -->
+
# What is Firestorm
Firestorm is a Remote Shuffle Service, and provides the capability for Apache
Spark applications
diff --git a/docs/client_guide.md b/docs/client_guide.md
index 95b960b..ac0ec10 100644
--- a/docs/client_guide.md
+++ b/docs/client_guide.md
@@ -3,6 +3,21 @@ layout: page
displayTitle: Firestorm Shuffle Client Guide
title: Firestorm Shuffle Client Guide
description: Firestorm Shuffle Client Guide
+license: |
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
---
# Firestorm Shuffle Client Guide
@@ -145,4 +160,4 @@ The important configuration is listed as following.
|Property Name|Default|Description|
|---|---|---|
|mapreduce.rss.client.max.buffer.size|3k|The max buffer size in map side|
-|mapreduce.rss.client.batch.trigger.num|50|The max batch of buffers to send
data in map side|
\ No newline at end of file
+|mapreduce.rss.client.batch.trigger.num|50|The max batch of buffers to send
data in map side|
diff --git a/docs/coordinator_guide.md b/docs/coordinator_guide.md
index 049ec18..29fca32 100644
--- a/docs/coordinator_guide.md
+++ b/docs/coordinator_guide.md
@@ -3,6 +3,21 @@ layout: page
displayTitle: Firestorm Coordinator Guide
title: Firestorm Coordinator Guide
description: Firestorm Coordinator Guide
+license: |
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
---
-# Firestorm Coordinator Guide
\ No newline at end of file
+# Firestorm Coordinator Guide
diff --git a/docs/index.md b/docs/index.md
index 5d2599f..afe73eb 100644
--- a/docs/index.md
+++ b/docs/index.md
@@ -3,6 +3,21 @@ layout: page
displayTitle: Firestorm Overview
title: Overview
description: Firestorm documentation homepage
+license: |
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
---
Firestorm is a Remote Shuffle Service, and provides the capability for Apache
Spark applications
@@ -23,4 +38,4 @@ More advanced details for Firestorm users are available in
the following:
Here you can read API docs for Firestorm along with its submodules.
-- [Java API (Javadoc)](apidocs/index.html)
\ No newline at end of file
+- [Java API (Javadoc)](apidocs/index.html)
diff --git a/docs/server_guide.md b/docs/server_guide.md
index 3356f61..abd86f0 100644
--- a/docs/server_guide.md
+++ b/docs/server_guide.md
@@ -3,5 +3,20 @@ layout: page
displayTitle: Firestorm Shuffle Server Guide
title: Firestorm Shuffle Server Guide
description: Firestorm Shuffle Server Guide
+license: |
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
---
-# Firestorm Shuffle Server Guide
\ No newline at end of file
+# Firestorm Shuffle Server Guide
diff --git a/pom.xml b/pom.xml
index 8bca3a3..a7c6f1a 100644
--- a/pom.xml
+++ b/pom.xml
@@ -884,29 +884,10 @@
<artifactId>apache-rat-plugin</artifactId>
<configuration>
<excludes>
- <exclude>README.md</exclude>
- <exclude>CONTRIBUTING.md</exclude>
<exclude>LICENSE</exclude>
<exclude>**/target/**</exclude>
- <exclude>**/**/target/**</exclude>
- <exclude>tencent-bin/**</exclude>
- <exclude>*.iml</exclude>
- <exclude>**/*.iml</exclude>
- <exclude>**/**/*.iml</exclude>
- <exclude>dependency-reduced-pom.xml</exclude>
<exclude>src/test/resources/empty</exclude>
<exclude>**/dependency-reduced-pom.xml</exclude>
- <exclude>**/**/dependency-reduced-pom.xml</exclude>
- <exclude>**/pom.xml.versionsBackup</exclude>
- <exclude>**/**/pom.xml.versionsBackup</exclude>
- <exclude>pom.xml.versionsBackup</exclude>
- <exclude>*.log</exclude>
- <exclude>CovTemp/**</exclude>
- <exclude>coverage_ogid.txt</exclude>
- <exclude>quantity_temp.properties</exclude>
- <exclude>rss*/</exclude>
- <exclude>spark-patches/**</exclude>
- <exclude>docs/*.md</exclude>
<exclude>.github/PULL_REQUEST_TEMPLATE</exclude>
</excludes>
</configuration>
diff --git a/spark-patches/spark-2.4.6_dynamic_allocation_support.patch
b/spark-patches/spark-2.4.6_dynamic_allocation_support.patch
index 43da5fe..88f895c 100644
--- a/spark-patches/spark-2.4.6_dynamic_allocation_support.patch
+++ b/spark-patches/spark-2.4.6_dynamic_allocation_support.patch
@@ -1,3 +1,20 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed with
+# this work for additional information regarding copyright ownership.
+# The ASF licenses this file to You under the Apache License, Version 2.0
+# (the "License"); you may not use this file except in compliance with
+# the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+#
+
diff --git a/core/src/main/scala/org/apache/spark/Dependency.scala
b/core/src/main/scala/org/apache/spark/Dependency.scala
index 9ea6d2fa2f..d6101cdcef 100644
--- a/core/src/main/scala/org/apache/spark/Dependency.scala
diff --git a/spark-patches/spark-3.1.2_dynamic_allocation_support.patch
b/spark-patches/spark-3.1.2_dynamic_allocation_support.patch
index 728ebc2..c3431dc 100644
--- a/spark-patches/spark-3.1.2_dynamic_allocation_support.patch
+++ b/spark-patches/spark-3.1.2_dynamic_allocation_support.patch
@@ -1,3 +1,20 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed with
+# this work for additional information regarding copyright ownership.
+# The ASF licenses this file to You under the Apache License, Version 2.0
+# (the "License"); you may not use this file except in compliance with
+# the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+#
+
diff --git a/core/src/main/scala/org/apache/spark/Dependency.scala
b/core/src/main/scala/org/apache/spark/Dependency.scala
index d21b9d9833..fe4507f81f 100644
--- a/core/src/main/scala/org/apache/spark/Dependency.scala
diff --git a/spark-patches/spark-3.2.1_dynamic_allocation_support.patch
b/spark-patches/spark-3.2.1_dynamic_allocation_support.patch
index 1e195df..e170ae2 100644
--- a/spark-patches/spark-3.2.1_dynamic_allocation_support.patch
+++ b/spark-patches/spark-3.2.1_dynamic_allocation_support.patch
@@ -1,3 +1,20 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed with
+# this work for additional information regarding copyright ownership.
+# The ASF licenses this file to You under the Apache License, Version 2.0
+# (the "License"); you may not use this file except in compliance with
+# the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+#
+
diff --git a/core/src/main/scala/org/apache/spark/Dependency.scala
b/core/src/main/scala/org/apache/spark/Dependency.scala
index 1b4e7ba5106..95818ff72ca 100644
--- a/core/src/main/scala/org/apache/spark/Dependency.scala
