[GitHub] bigtop pull request #437: BIGTOP-3125: [provisioner] sbin/init is missed in ...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/437

BIGTOP-3125: [provisioner] sbin/init is missed in puppet:opensuse-42.3

The docker image, bigtop/puppet:opensuse-42.3 doesn't have /sbin/init 
installed.
This caused docker provisioner failed.

Change-Id: I48cbd25893c4d0008789335261ffecbc34175a13
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3125

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/437.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #437


commit ae8713c34ea902b6babd8112e8c0da7032bd2fea
Author: Jun He 
Date:   2019-01-04T07:10:23Z

BIGTOP-3125: [provisioner] sbin/init is missed in puppet:opensuse-42.3

The docker image, bigtop/puppet:opensuse-42.3 doesn't have /sbin/init 
installed.
This caused docker provisioner failed.

Change-Id: I48cbd25893c4d0008789335261ffecbc34175a13
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #424: BIGTOP-3106: Update links in download page

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/424


---

[GitHub] bigtop pull request #398: Add missing scala patch for flume

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/398


---

[GitHub] bigtop pull request #424: BIGTOP-3106: Update links in download page

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/424

BIGTOP-3106: Update links in download page

Links in download page should:
1. be links to release artifacts, not links to directories.
2. link to the asc and sha files should refer to archives only for 
non-current
   releases
3. current release links should point to apache.org/dist

Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3106

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/424.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #424


commit 4bd38a7195342403b525edc243ba416599493e0b
Author: Jun He 
Date:   2018-11-27T07:34:49Z

BIGTOP-3106: Update links in download page

Links in download page should:
1. be links to release artifacts, not links to directories.
2. link to the asc and sha files should refer to archives only for 
non-current
   releases
3. current release links should point to apache.org/dist

Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #387: BIGTOP-3074: Drop oozie packaging

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/387


---

[GitHub] bigtop pull request #407: BIGTOP-3103: Update download page to comply with A...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/407

BIGTOP-3103: Update download page to comply with Apache announcement …

…requirements

To comply with announcement requirement, the download page should contain 
links
to all current and archived releases along with links to KEYS, checksums, 
and
signatures for all releases.
Current download page only provides link to latest one.

Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3103

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/407.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #407


commit 324806625018f05ecf4e1d73051adcdde4c521a9
Author: Jun He 
Date:   2018-11-25T02:51:09Z

BIGTOP-3103: Update download page to comply with Apache announcement 
requirements

To comply with announcement requirement, the download page should contain 
links
to all current and archived releases along with links to KEYS, checksums, 
and
signatures for all releases.
Current download page only provides link to latest one.

Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #401: BIGTOP-3088: provisioner failed to run puppet depl...

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/401


---

[GitHub] bigtop issue #404: BIGTOP-3091: Set Bigtop repo to higher priority

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/404
  
Close this as it has been merged by upstream.


---

[GitHub] bigtop pull request #404: BIGTOP-3091: Set Bigtop repo to higher priority

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/404


---

[GitHub] bigtop issue #401: BIGTOP-3088: provisioner failed to run puppet deployment ...

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/401
  
Close this as it has been merged by upstream.


---

[GitHub] bigtop issue #403: BIGTOP-3090: provisioner failed on fedora-26 when deployi...

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/403
  
Close this as it has been merged by upstream.


---

[GitHub] bigtop pull request #403: BIGTOP-3090: provisioner failed on fedora-26 when ...

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/403


---

[GitHub] bigtop pull request #402: BIGTOP-3089: Update provision config files with ch...

[JunHe77]

Github user JunHe77 commented on a diff in the pull request:

https://github.com/apache/bigtop/pull/402#discussion_r222637627
  
--- Diff: provisioner/docker/config_fedora-26.yaml ---
@@ -14,10 +14,10 @@
 # limitations under the License.
 
 docker:
-memory_limit: "4g"
-image: "bigtop/puppet:trunk-centos-6"
+memory_limit: "8g"
+image: "bigtop/puppet:1.3.0-fedora-26"
 
-repo: "http://repos.bigtop.apache.org/releases/1.2.1/centos/6/x86_64;
+repo: "http://repos.bigtop.apache.org/releases/1.3.0/fedora/26/$basearch;
--- End diff --

Using $ARCH to automatically load different architecture repo on deb 
systems is verified on x86_64, aarch64 and ppc64le.
Patch is updated. "docker-hadoop.sh" is modified to load correct puppet 
image by detecting CPU arch. This makes only one config file is needed for a 
certain distro acrossing different architectures.
Pls review. Thanks.


---

[GitHub] bigtop pull request #402: BIGTOP-3089: Update provision config files with ch...

[JunHe77]

Github user JunHe77 commented on a diff in the pull request:

https://github.com/apache/bigtop/pull/402#discussion_r222602799
  
--- Diff: provisioner/docker/config_fedora-26.yaml ---
@@ -14,10 +14,10 @@
 # limitations under the License.
 
 docker:
-memory_limit: "4g"
-image: "bigtop/puppet:trunk-centos-6"
+memory_limit: "8g"
+image: "bigtop/puppet:1.3.0-fedora-26"
 
-repo: "http://repos.bigtop.apache.org/releases/1.2.1/centos/6/x86_64;
+repo: "http://repos.bigtop.apache.org/releases/1.3.0/fedora/26/$basearch;
--- End diff --

@epikhinm that's a good point. I didn't realize $ARCH can be used in repo 
url. Just thought I can only specify what kind of arch a certain repo supports, 
lie "arch=arch1,arch2".
Thanks for the suggestion and I will test and update new patch if it is OK 
for auto loading.


---

[GitHub] bigtop pull request #402: BIGTOP-3089: Update provision config files with ch...

[JunHe77]

Github user JunHe77 commented on a diff in the pull request:

https://github.com/apache/bigtop/pull/402#discussion_r222539413
  
--- Diff: provisioner/docker/config_fedora-26.yaml ---
@@ -14,10 +14,10 @@
 # limitations under the License.
 
 docker:
-memory_limit: "4g"
-image: "bigtop/puppet:trunk-centos-6"
+memory_limit: "8g"
+image: "bigtop/puppet:1.3.0-fedora-26"
 
-repo: "http://repos.bigtop.apache.org/releases/1.2.1/centos/6/x86_64;
+repo: "http://repos.bigtop.apache.org/releases/1.3.0/fedora/26/$basearch;
--- End diff --

rpm base distros support using $basearch to automatically load arch 
dependent repo:

https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/6/html/deployment_guide/sec-using_yum_variables
while for apt it doesn't use this way.

The target is to unified configurations/deployment across different 
architectures for a same distro. So this patch starts from rpm based distros 
(centos/fedora/opensuse)


---

[GitHub] bigtop pull request #401: BIGTOP-3088: provisioner failed to run puppet depl...

[JunHe77]

Github user JunHe77 commented on a diff in the pull request:

https://github.com/apache/bigtop/pull/401#discussion_r222516374
  
--- Diff: bigtop_toolchain/bin/puppetize.sh ---
@@ -40,7 +40,9 @@ case ${ID}-${VERSION_ID} in
 ;;
 centos-7*)
 rpm -ivh 
https://dl.fedoraproject.org/pub/epel/epel-release-latest-7.noarch.rpm
-yum -y install hostname curl sudo unzip wget puppet 
puppetlabs-stdlib
+yum updateinfo
+yum -y install hostname curl sudo unzip wget puppet
+puppet module install puppetlabs-stdlib --version 4.12.0
--- End diff --

Thanks. The suggestion reaaly helps. I used to run into similar case 
without knowing the code block's context.
Will update soon.


---

[GitHub] bigtop pull request #404: BIGTOP-3091: Set Bigtop repo to higher priority

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/404

BIGTOP-3091: Set Bigtop repo to higher priority

Bigtop repo file in deploy/puppet doesn't have "priority" field.
An example is on Fedora-26, zookeeper is 3.4.9 in distro repo, while
conflicts with 3.4.6 in Bigtop stack. Similiar to BIGTOP-2796.

Change-Id: I2b1231a2cf62a30401784780c92b31ab810fe34b
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3091

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/404.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #404


commit 1fed7039bffd846dcffac95cd5d1e0212df68d51
Author: Jun He 
Date:   2018-10-03T14:05:24Z

BIGTOP-3091: Set Bigtop repo to higher priority

Bigtop repo file in deploy/puppet doesn't have "priority" field.
An example is on Fedora-26, zookeeper is 3.4.9 in distro repo, while
conflicts with 3.4.6 in Bigtop stack. Similiar to BIGTOP-2796.

Change-Id: I2b1231a2cf62a30401784780c92b31ab810fe34b
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #403: BIGTOP-3090: provisioner failed on fedora-26 when ...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/403

BIGTOP-3090: provisioner failed on fedora-26 when deploying jdk

The puppet recipe of jdk intends to setup cacerts link with pki/java/cacerts
while jdk is not installed. This security failure will cause later bigtop
components installation failure.

Change-Id: Ib728cdf60db9feaddb3f65643ee2134158947254
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3090

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/403.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #403


commit f8b11c182090e2ea6efee268726246cd4b5f5464
Author: Jun He 
Date:   2018-10-03T13:56:48Z

BIGTOP-3090: provisioner failed on fedora-26 when deploying jdk

The puppet recipe of jdk intends to setup cacerts link with pki/java/cacerts
while jdk is not installed. This security failure will cause later bigtop
components installation failure.

Change-Id: Ib728cdf60db9feaddb3f65643ee2134158947254
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #402: BIGTOP-3089: Update provision config files with ch...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/402

BIGTOP-3089: Update provision config files with changes in 1.3.0 release

v1.3.0 supports: centos-7, fedora-26, debian-9, ubuntu-16.04, opensuse-42.3
config files in provisioner/docker should be updated to sync with these 
changes

Change-Id: Ic5d66cb837e78908fcf19c2e55f819db28866a55
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3089

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/402.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #402


commit 6e20d01f3fbfd6dee4487aea47405040fd15e25c
Author: Jun He 
Date:   2018-10-03T12:52:33Z

BIGTOP-3089: Update provision config files with changes in 1.3.0 release

v1.3.0 supports: centos-7, fedora-26, debian-9, ubuntu-16.04, opensuse-42.3
config files in provisioner/docker should be updated to sync with these 
changes

Change-Id: Ic5d66cb837e78908fcf19c2e55f819db28866a55
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #401: BIGTOP-3088: provisioner failed to run puppet depl...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/401

BIGTOP-3088: provisioner failed to run puppet deployment on CentOS-7

Deploy with puppet on centos-7 failed.
The root cause is puppet-stdlib (4.25) in distro is not compatible with
puppet <4. Pin stdlib to 4.12.0 should fix this problem.

Change-Id: I8ec557412b660cc51399da3c81014b47aa366d6a
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3088

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/401.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #401


commit bafa153d404fec04bfae3d600905f6f740bd5d3e
Author: Jun He 
Date:   2018-10-03T12:00:02Z

BIGTOP-3088: provisioner failed to run puppet deployment on CentOS-7

Deploy with puppet on centos-7 failed.
The root cause is puppet-stdlib (4.25) in distro is not compatible with
puppet <4. Pin stdlib to 4.12.0 should fix this problem.

Change-Id: I8ec557412b660cc51399da3c81014b47aa366d6a
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #398: Add missing scala patch for flume

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/398

Add missing scala patch for flume

The patch to fix flume/kafka build issue is missed in BIGTOP-3082.

Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop branch-1.3

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/398.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #398


commit da6fd1514b4c8ec98a1fe6b100ea26d66f1fb0c7
Author: Jun He 
Date:   2018-09-19T23:41:52Z

Add missing scala patch for flume

The patch to fix flume/kafka build issue is missed in BIGTOP-3082.

Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #397: BIGTOP-3082: Fix build failure with flume-1.8+kafk...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/397

BIGTOP-3082: Fix build failure with flume-1.8+kafka-0.10.2.2

When upgrading flume to 1.8 and kafka to 0.10.2.2, the build of flume
is failed due to API changes and scala upgrade in kafka.
This patch rebased FLUME-2662/FLUME-3026 patches to flume-1.8, and for
the scala conflicts, used Anton's patch which can be found here:

https://lists.apache.org/thread.html/%3CCAJZrK_tN49GM+vCCiB+rjLL==82U=7nswoapwWmyJbVAS5F=q...@mail.gmail.com%3E

Change-Id: Idf8d00c22ef60d82783056fea556e9a6f517054a
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3082

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/397.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #397


commit 57f148616a34ebd361cdd61a0703ad97cdcc19b0
Author: Jun He 
Date:   2018-09-19T17:48:25Z

BIGTOP-3082: Fix build failure with flume-1.8+kafka-0.10.2.2

When upgrading flume to 1.8 and kafka to 0.10.2.2, the build of flume
is failed due to API changes and scala upgrade in kafka.
This patch rebased FLUME-2662/FLUME-3026 patches to flume-1.8, and for
the scala conflicts, used Anton's patch which can be found here:

https://lists.apache.org/thread.html/%3CCAJZrK_tN49GM+vCCiB+rjLL==82U=7nswoapwWmyJbVAS5F=q...@mail.gmail.com%3E

Change-Id: Idf8d00c22ef60d82783056fea556e9a6f517054a
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #395: BIGTOP-3081: Update HBase/Ignite-hadoop arch info

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/395

BIGTOP-3081: Update HBase/Ignite-hadoop arch info

Both HBase and ignite-hadoop introduce arch dependency during build.
So the output packages should be arch dependent. The arch info in
package files should be updated to reflect these.

Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3081

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/395.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #395


commit f283c54f2d64214833ae036ee2c744c0805e7822
Author: Jun He 
Date:   2018-09-18T06:57:19Z

BIGTOP-3081: Update HBase/Ignite-hadoop arch info

Both HBase and ignite-hadoop introduce arch dependency during build.
So the output packages should be arch dependent. The arch info in
package files should be updated to reflect these.

Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #392: BIGTOP-3076: QFS build failed on ppc64le

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/392

BIGTOP-3076: QFS build failed on ppc64le

QFS build failed on ppc64le, this is caused by conflict definition of
gf_cpu_identify.

Change-Id: Ibc52b426a27c6ed27c71a0e8fabeaaa91577d000
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3076

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/392.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #392


commit 926a9e3aeae1830708a2140d11d035565a513eca
Author: Jun He 
Date:   2018-09-10T03:19:14Z

BIGTOP-3076: QFS build failed on ppc64le

QFS build failed on ppc64le, this is caused by conflict definition of
gf_cpu_identify.

Change-Id: Ibc52b426a27c6ed27c71a0e8fabeaaa91577d000
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #391: BIGTOP-3078: ignite-shmem failed to build on ppc64...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/391

BIGTOP-3078: ignite-shmem failed to build on ppc64le

Ignite-shmem build failed on ppc64le. This is caused by ppc64le is
not supported by its config.guess.

Change-Id: Ife8b1afe185e086034c1fd25fbb20906c0dc15be
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3078

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/391.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #391


commit ebf887041c340a0d787f489063a0b2e427c5f558
Author: Jun He 
Date:   2018-09-10T03:12:29Z

BIGTOP-3078: ignite-shmem failed to build on ppc64le

Ignite-shmem build failed on ppc64le. This is caused by ppc64le is
not supported by its config.guess.

Change-Id: Ife8b1afe185e086034c1fd25fbb20906c0dc15be
Signed-off-by: Jun He 




---

[GitHub] bigtop issue #390: BIGTOP-3077: OpenSuse-42.3 packages install error

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/390
  
Yes, seems this bug only affects aarch64 based distro.

https://ci.bigtop.apache.org/job/Docker-Toolchain-1.3.0/6/DISTRO=opensuse-42.3,PLATFORM=aarch64-slave/console
Both x86 and ppc64le are OK.


---

[GitHub] bigtop issue #390: BIGTOP-3077: OpenSuse-42.3 packages install error

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/390
  
On aarch64, these libraries require libncurses5-5.9-57.1.aarch64, while the 
distro installed is newer libncurses5-5.9-62.1.aarch64, so it has to be 
specified with "force-resolution" to downgrade libncurses5 to proceed 
installation.


---

[GitHub] bigtop issue #358: BIGTOP-2101: ignite-hadoop contains an arch-dependent sha...

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/358
  
Updated.


---

[GitHub] bigtop pull request #390: BIGTOP-3077: OpenSuse-42.3 packages install error

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/390

BIGTOP-3077: OpenSuse-42.3 packages install error

Update libapr1 to use distro version. Fixed packages dependency issue
on aarch64.

Change-Id: I043b701b4bd5b89eea7488e21ace939624528310
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3077

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/390.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #390


commit c5551a43285541ec70080a2aa2d3b71fe83a424a
Author: Jun He 
Date:   2018-09-04T03:25:14Z

BIGTOP-3077: OpenSuse-42.3 packages install error

Update libapr1 to use distro version. Fixed packages dependency issue
on aarch64.

Change-Id: I043b701b4bd5b89eea7488e21ace939624528310
Signed-off-by: Jun He 




---

[GitHub] bigtop issue #358: BIGTOP-2101: ignite-hadoop contains an arch-dependent sha...

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/358
  
The shmem source is included in ignite, see: 
https://github.com/apache/ignite/tree/master/ipc/shmem
So once we get ignite code, we get shmem source.


---

[GitHub] bigtop issue #358: BIGTOP-2101: ignite-hadoop contains an arch-dependent sha...

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/358
  
@evans-ye @oflebbe , updated the patch based on your comments and new 
findings:
1. the ignite-shmem source code is shipped with ignite itself, located in 
/ipc/shmem. I compared the source code with the one from 
ignite-shmem-1.0.0-sources.jar, they are identical.
2. Removed arch specific process. All platforms use the same way.

Pls review.


---

[GitHub] bigtop pull request #358: BIGTOP-2101: ignite-hadoop contains an arch-depend...

[JunHe77]

Github user JunHe77 commented on a diff in the pull request:

https://github.com/apache/bigtop/pull/358#discussion_r214793946
  
--- Diff: bigtop-packages/src/common/ignite-hadoop/do-component-build ---
@@ -21,4 +21,39 @@ set -ex
 export MAVEN_OPTS="-Xmx512M"
 
 sed -i '/asm-all/{n;s/4.2/5.0.2/}' modules/hadoop/pom.xml
+
+if [ "$HOSTTYPE" != "x86_64" ] ; then
+SAVED_MD5="8b92df116216298ea76a5165ed90ac1f"
+SAVED_SHA1="ecfa2478af45e2b4059a3a97686308041d220031"
+# download ignite-shmem from maven central
+mvn dependency:get 
-DremoteRepositories=https://repo1.maven.org/maven2/ -DgroupId=org.gridgain 
-DartifactId=ignite-shmem -Dversion=1.0.0
+mkdir tmp-build
+cd tmp-build
+# download source jar
+wget 
https://repo1.maven.org/maven2/org/gridgain/ignite-shmem/1.0.0/ignite-shmem-1.0.0-sources.jar
+# verify it
+md5sum=$(/usr/bin/md5sum ignite-shmem-1.0.0-sources.jar | cut -d ' ' 
-f 1)
+sha1sum=$(/usr/bin/sha1sum ignite-shmem-1.0.0-sources.jar | cut -d ' ' 
-f 1)
+if [ $md5sum != $SAVED_MD5 ] || [ $sha1sum != $SAVED_SHA1 ]; then
+echo "Downloaded file checksum doesn't match!"
--- End diff --

Got it and updated it.


---

[GitHub] bigtop pull request #358: BIGTOP-2101: ignite-hadoop contains an arch-depend...

[JunHe77]

Github user JunHe77 commented on a diff in the pull request:

https://github.com/apache/bigtop/pull/358#discussion_r214778482
  
--- Diff: bigtop-packages/src/common/ignite-hadoop/do-component-build ---
@@ -21,4 +21,30 @@ set -ex
 export MAVEN_OPTS="-Xmx512M"
 
 sed -i '/asm-all/{n;s/4.2/5.0.2/}' modules/hadoop/pom.xml
+
+if [ "$HOSTTYPE" != "x86_64" ] ; then
+# download ignite-shmem from maven central
+mvn dependency:get 
-DremoteRepositories=https://repo1.maven.org/maven2/ -DgroupId=org.gridgain 
-DartifactId=ignite-shmem -Dversion=1.0.0
+mkdir tmp-build
+cd tmp-build
+# download source jar
+wget 
https://repo1.maven.org/maven2/org/gridgain/ignite-shmem/1.0.0/ignite-shmem-1.0.0-sources.jar
--- End diff --

Updated with md5 and sha1 checksum verification. Pls review.


---

[GitHub] bigtop pull request #387: BIGTOP-3074: Drop oozie packaging

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/387

BIGTOP-3074: Drop oozie packaging

Change-Id: I92cb5256a7f51a04f0d859b6a812bc8fa0dfc669
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3074

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/387.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #387


commit 67217ca55b9ebd2bacec61a19d2d6b2c617bf4d5
Author: Jun He 
Date:   2018-08-29T08:12:05Z

BIGTOP-3074: Drop oozie packaging

Change-Id: I92cb5256a7f51a04f0d859b6a812bc8fa0dfc669
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #386: BIGTOP-3067: Bump Hive to 2.3.3

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/386

BIGTOP-3067: Bump Hive to 2.3.3

Bump to 2.3.3 for v1.3 release.

Change-Id: I0a2d0ab3d58bcac1aac79db1ebeb1d089f6f435b
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP3067

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/386.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #386


commit c5533c9ac5d0bf2e505e9c6f4d9f863c5c288133
Author: Jun He 
Date:   2018-08-27T03:22:21Z

BIGTOP-3067: Bump Hive to 2.3.3

Bump to 2.3.3 for v1.3 release.

Change-Id: I0a2d0ab3d58bcac1aac79db1ebeb1d089f6f435b
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #383: BIGTOP-3065: Bump Hadoop to 2.8.4

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/383


---

[GitHub] bigtop pull request #385: BIGTOP-3069: Bump crunch to 0.15.0

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/385

BIGTOP-3069: Bump crunch to 0.15.0

Bump to latest 0.15.0 release.

Change-Id: I76921880550a06efc00d55d1cdcff69817578c8f
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3069

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/385.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #385


commit 354f93daae9639197e19a68a5c1bb3b9c58d9698
Author: Jun He 
Date:   2018-08-15T07:01:59Z

BIGTOP-3069: Bump crunch to 0.15.0

Bump to latest 0.15.0 release.

Change-Id: I76921880550a06efc00d55d1cdcff69817578c8f
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #383: BIGTOP-3065: Bump Hadoop to 2.8.4

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/383

BIGTOP-3065: Bump Hadoop to 2.8.4

Bump to latest release  on 2.8 branch

Change-Id: I58e719ef66174312fd005b0bb0d11711aee69ad0
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop branch-1.3

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/383.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #383


commit 4fab5869449d34ccddfaf7e8aa45244bdff6af97
Author: Jun He 
Date:   2018-08-15T07:07:42Z

BIGTOP-3065: Bump Hadoop to 2.8.4

Bump to latest release  on 2.8 branch

Change-Id: I58e719ef66174312fd005b0bb0d11711aee69ad0
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #358: BIGTOP-2101: ignite-hadoop contains an arch-depend...

[JunHe77]

Github user JunHe77 commented on a diff in the pull request:

https://github.com/apache/bigtop/pull/358#discussion_r211515919
  
--- Diff: bigtop-packages/src/common/ignite-hadoop/do-component-build ---
@@ -21,4 +21,30 @@ set -ex
 export MAVEN_OPTS="-Xmx512M"
 
 sed -i '/asm-all/{n;s/4.2/5.0.2/}' modules/hadoop/pom.xml
+
+if [ "$HOSTTYPE" != "x86_64" ] ; then
+# download ignite-shmem from maven central
+mvn dependency:get 
-DremoteRepositories=https://repo1.maven.org/maven2/ -DgroupId=org.gridgain 
-DartifactId=ignite-shmem -Dversion=1.0.0
+mkdir tmp-build
+cd tmp-build
+# download source jar
+wget 
https://repo1.maven.org/maven2/org/gridgain/ignite-shmem/1.0.0/ignite-shmem-1.0.0-sources.jar
--- End diff --

@evans-ye @oflebbe Would it be OK to verify both sha1 and md5 checksum of 
the jar file, and compare them with hardcoded in our code base?


---

[GitHub] bigtop pull request #379: BIGTOP-3059: Bump Ambari to 2.6.1

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/379


---

[GitHub] bigtop pull request #379: BIGTOP-3059: Bump Ambari to 2.6.1

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/379

BIGTOP-3059: Bump Ambari to 2.6.1

Bump Ambari to 2.6.1 release.

Change-Id: I94e17d70bd78ec1d2ff59e914894ad8b0b3c5cae
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3059

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/379.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #379


commit cd9d8db9e022beed12767c16a4cbd4e77b237bec
Author: Jun He 
Date:   2018-08-15T07:05:43Z

BIGTOP-3059: Bump Ambari to 2.6.1

Bump Ambari to 2.6.1 release.

Change-Id: I94e17d70bd78ec1d2ff59e914894ad8b0b3c5cae
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #378: BIGTOP-3061: Fix ClassNotFound issue for crunch bu...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/378

BIGTOP-3061: Fix ClassNotFound issue for crunch build

Crunch build failed due to "ClassNotFound" in doxia.
This is caused by maven-project-info-reports-plugin updated to 3.0.0, and 
rely
on doxia-site-renderer 1.8 (which has 
org.apache.maven.doxia.siterenderer.DocumentContent
this class), but maven-site-plugin:3.3 rely on doxia-site-renderer:1.4 
(which
don't have org.apache.maven.doxia.siterenderer.DocumentContent)
Upgrade maven-site-plugin can resolve this.

Change-Id: I3c2a2bf717fa070b61b4c1788a52874361910dbc
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3061

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/378.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #378


commit 6cd7631f6637bb7562bb2b85c14a5d617efe24bb
Author: Jun He 
Date:   2018-08-08T04:51:49Z

BIGTOP-3061: Fix ClassNotFound issue for crunch build

Crunch build failed due to "ClassNotFound" in doxia.
This is caused by maven-project-info-reports-plugin updated to 3.0.0, and 
rely
on doxia-site-renderer 1.8 (which has 
org.apache.maven.doxia.siterenderer.DocumentContent
this class), but maven-site-plugin:3.3 rely on doxia-site-renderer:1.4 
(which
don't have org.apache.maven.doxia.siterenderer.DocumentContent)
Upgrade maven-site-plugin can resolve this.

Change-Id: I3c2a2bf717fa070b61b4c1788a52874361910dbc
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #376: BIGTOP-3054: Missing Spark archive caused Zeppelin...

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/376


---

[GitHub] bigtop issue #376: BIGTOP-3054: Missing Spark archive caused Zeppelin build ...

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/376
  
Close this as it has been merged by upstream.


---

[GitHub] bigtop pull request #376: BIGTOP-3054: Missing Spark archive caused Zeppelin...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/376

BIGTOP-3054: Missing Spark archive caused Zeppelin build failure

Zeppelin uses Spark-2.2.1 archive defined in bigtop.bom. This archive
is moved from www.apache.org to archive.apache.org.
So update zeppelin build script to point to Apache's archive site.

Change-Id: Ib637c36d3623fd856d50122875a0e65b1cc82723
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3054

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/376.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #376


commit 5f3cf58bf6eeae0302027a9f0b67853869deaf4c
Author: Jun He 
Date:   2018-07-24T06:34:40Z

BIGTOP-3054: Missing Spark archive caused Zeppelin build failure

Zeppelin uses Spark-2.2.1 archive defined in bigtop.bom. This archive
is moved from www.apache.org to archive.apache.org.
So update zeppelin build script to point to Apache's archive site.

Change-Id: Ib637c36d3623fd856d50122875a0e65b1cc82723
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #374: Add support ubuntu 18.04

[JunHe77]

Github user JunHe77 commented on a diff in the pull request:

https://github.com/apache/bigtop/pull/374#discussion_r204266547
  
--- Diff: bigtop_toolchain/bin/puppetize.sh ---
@@ -26,7 +26,7 @@ case ${ID}-${VERSION_ID} in
   dnf -y check-update
   dnf -y install hostname findutils curl sudo unzip wget puppet 
puppetlabs-stdlib
 ;;
-ubuntu-16.04)
+ubuntu-1[6,8].04)
 apt-get update
 apt-get -y install wget curl sudo unzip puppet 
software-properties-common puppet-module-puppetlabs-apt 
puppet-module-puppetlabs-stdlib
--- End diff --

On ubuntu-18.04 two extra packages need to be installed to get successful 
bigtop build:
rsync, dh-python


---

[GitHub] bigtop pull request #374: Add support ubuntu 18.04

[JunHe77]

Github user JunHe77 commented on a diff in the pull request:

https://github.com/apache/bigtop/pull/374#discussion_r204266456
  
--- Diff: bigtop_toolchain/bin/puppetize.sh ---
@@ -26,7 +26,7 @@ case ${ID}-${VERSION_ID} in
   dnf -y check-update
   dnf -y install hostname findutils curl sudo unzip wget puppet 
puppetlabs-stdlib
 ;;
-ubuntu-16.04)
+ubuntu-1[6,8].04)
--- End diff --

Would be better to create another entry for 18.04 as there are different 
packages to be installed.


---

[GitHub] bigtop pull request #375: BIGTOP-3053: Tez failed to build due to bower vers...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/375

BIGTOP-3053: Tez failed to build due to bower version is deprecated

Tez building failed due to the bower version is deprecated. Tez upstream 
uses
a workaround to upgrade it to 1.8.4.

Change-Id: Ib8ffa59fb4fdfc23599164fda7cbe8af30c44df7
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3053

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/375.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #375


commit e211b1fc7b43ae569c04254525a8de66f79cd9e2
Author: Jun He 
Date:   2018-07-19T02:46:19Z

BIGTOP-3053: Tez failed to build due to bower version is deprecated

Tez building failed due to the bower version is deprecated. Tez upstream 
uses
a workaround to upgrade it to 1.8.4.

Change-Id: Ib8ffa59fb4fdfc23599164fda7cbe8af30c44df7
Signed-off-by: Jun He 




---

[GitHub] bigtop issue #369: BIGTOP-3046: correct script to find lasted mvn version

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/369
  
@acmnu , I see. So the `sort` cmd is not needed.
@deart2k , great! Thank you for your efforts and contribution.
LGTM, +1.


---

[GitHub] bigtop issue #369: BIGTOP-3031: correct script to find lasted mvn version

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/369
  
Thanks for reporting this issue, @deart2k !
The previous implementation assumes that only one minor version is listed 
in the url, say, only one 3.5.x. But it is obviously not true, as there are 
3.5.3 and 3.5.4 on the link now. 😀 

Your patch LGTM, while I think there might be a little to add: it may not 
true to assume the last `` is the latest version. So an extra cmd can be 
added to make sure the output is ordered by version, like following:
`curl --stderr /dev/null 
'https://www.apache.org/dist/maven/maven-3/?F=0=1' | grep -o 
'.*href="3.5.[0-9]*/"' | grep -o '3.5.[0-9]*' | sort -V --field-separator=- 
| tail -1 | tr -d '\n'`

What do you think?

And could you pls create a JIRA to link with this PR so we can track this, 
just like https://issues.apache.org/jira/browse/BIGTOP-3031.

Thank you very much.


---

[GitHub] bigtop pull request #368: BIGTOP-3035: Provisioner failed because init is mi...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/368

BIGTOP-3035: Provisioner failed because init is missed in Debian-9

In provisioner/docker/docker-compose.yml, /sbin/init is used as entrypoint.
But this cmd is missed on Debian-9, which causes smoke test/provisioner
failure.

Change-Id: I4c3aac74f8299b23966ea8a5c30a1513c734f889
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3035

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/368.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #368


commit a1ec0b80988d95e2b3c03afaa0e0294ef52eaea1
Author: Jun He 
Date:   2018-06-08T06:26:11Z

BIGTOP-3035: Provisioner failed because init is missed in Debian-9

In provisioner/docker/docker-compose.yml, /sbin/init is used as entrypoint.
But this cmd is missed on Debian-9, which causes smoke test/provisioner
failure.

Change-Id: I4c3aac74f8299b23966ea8a5c30a1513c734f889
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #367: BIGTOP-2818: Ambari downloads jdk

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/367

BIGTOP-2818: Ambari downloads jdk

Ambari server uses jdk package from Hortonworks by default. This package
is not aligned with distro provided, and only x86 is supported.
Update Ambari server deploy script to use system JDK.

Change-Id: If062a9a4d689ed31276a944e68254b2fda9a264e
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-2818

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/367.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #367


commit e139f07eb16a26db6e26b9c30caed11f6632a18a
Author: Jun He 
Date:   2018-06-07T03:17:50Z

BIGTOP-2818: Ambari downloads jdk

Ambari server uses jdk package from Hortonworks by default. This package
is not aligned with distro provided, and only x86 is supported.
Update Ambari server deploy script to use system JDK.

Change-Id: If062a9a4d689ed31276a944e68254b2fda9a264e
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #366: BIGTOP-3042: HDFS TestHDFSQuota doesn't match Hado...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/366

BIGTOP-3042: HDFS TestHDFSQuota doesn't match Hadoop's definition

The smoke test case for HDFS, TestHDFSQuota:testInputValues, it asserts fail
on setSpaceQuota to 0, while this doesn't match Hadoop's definition for 
SpaceQuota.
This produces false failure, and should be removed from testcases.

Change-Id: I5e18a15e9b45a1057174717a37008b3c92bab0e9
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3042

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/366.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #366


commit 98b78d78eed4819412b3f417847ea65af9e895da
Author: Jun He 
Date:   2018-06-07T01:17:01Z

BIGTOP-3042: HDFS TestHDFSQuota doesn't match Hadoop's definition

The smoke test case for HDFS, TestHDFSQuota:testInputValues, it asserts fail
on setSpaceQuota to 0, while this doesn't match Hadoop's definition for 
SpaceQuota.
This produces false failure, and should be removed from testcases.

Change-Id: I5e18a15e9b45a1057174717a37008b3c92bab0e9
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #365: BIGTOP-3041: Failed to init hadoop hdfs using init...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/365

BIGTOP-3041: Failed to init hadoop hdfs using init-hdfs.sh

Failed to initialize hdfs using init-hdfs.sh script with 2.8.1.
The root cause is some jars are missed in CLASS_PATH

Change-Id: I6e3e1f42d437097ee122150aa94b41780346fb4f
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3041

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/365.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #365


commit 5bbbf1faf63642f71090190c239750d58450cfd0
Author: Jun He 
Date:   2018-06-05T07:09:48Z

BIGTOP-3041: Failed to init hadoop hdfs using init-hdfs.sh

Failed to initialize hdfs using init-hdfs.sh script with 2.8.1.
The root cause is some jars are missed in CLASS_PATH

Change-Id: I6e3e1f42d437097ee122150aa94b41780346fb4f
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #364: BIGTOP-3040: Solr's default configsets doesn't wor...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/364

BIGTOP-3040: Solr's default configsets doesn't work with smoke test c…

…ases

The default configsets used in solr is data_driven_schema_configs, which
doesn't work with solr smoke test, TestIndexing:testSearch. The reason is
in data_driven_schema_configs "name" is treated as StrField, not TextField,
so the words will not be tokenized, and lead to unexpected query result.
sample_techproducts_configs should be used.

Change-Id: I170c9530ed937410dcd99c975276c30777b24045
Signed-off-by: Jun He 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3040

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/364.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #364


commit 03f4e1fd8388ec8e7dac46551e9a59c568085b31
Author: Jun He 
Date:   2018-06-05T04:57:59Z

BIGTOP-3040: Solr's default configsets doesn't work with smoke test cases

The default configsets used in solr is data_driven_schema_configs, which
doesn't work with solr smoke test, TestIndexing:testSearch. The reason is
in data_driven_schema_configs "name" is treated as StrField, not TextField,
so the words will not be tokenized, and lead to unexpected query result.
sample_techproducts_configs should be used.

Change-Id: I170c9530ed937410dcd99c975276c30777b24045
Signed-off-by: Jun He 




---

[GitHub] bigtop pull request #361: BIGTOP-2886: Update solr smoke test to work with n...

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/361


---

[GitHub] bigtop pull request #361: BIGTOP-2886: Update solr smoke test to work with n...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/361

BIGTOP-2886: Update solr smoke test to work with new 6.6.0 version

Change-Id: Ib549231e3205bbd26881ce115e34d03018ff9b1c
Signed-off-by: Jun He <jun...@linaro.org>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-2886

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/361.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #361


commit 8769dd8aaefb8cad9b16a0439dc5af9865f038c2
Author: Jun He <jun.he@...>
Date:   2017-11-09T09:05:50Z

BIGTOP-2886: Update solr smoke test to work with new 6.6.0 version

Change-Id: Ib549231e3205bbd26881ce115e34d03018ff9b1c
Signed-off-by: Jun He <jun...@linaro.org>




---

[GitHub] bigtop pull request #360: BIGTOP-3027: Wrong Leveldbjni native binary for aa...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/360

BIGTOP-3027: Wrong Leveldbjni native binary for aarch64

Leveldbjni used in Hadoop is v1.8, which only includes x86-64 native 
binaries.
It needs to build from source when creating hadoop packages on aarch64, 
like what ppc does.

Change-Id: I4682e7885d9b5ac6d448d954ddffc78256fe0733
Signed-off-by: Jun He <jun...@linaro.org>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3027

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/360.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #360


commit a2bce4ef15744fa810e0bef8e2ccacc02c95b880
Author: Jun He <jun.he@...>
Date:   2018-05-09T08:01:29Z

BIGTOP-3027: Wrong Leveldbjni native binary for aarch64

Leveldbjni used in Hadoop is v1.8, which only includes x86-64 native 
binaries.
It needs to build from source when creating hadoop packages on aarch64, 
like what ppc does.

Change-Id: I4682e7885d9b5ac6d448d954ddffc78256fe0733
Signed-off-by: Jun He <jun...@linaro.org>




---

[GitHub] bigtop pull request #359: BIGTOP-3033: Spark build on OpenSUSE is failed

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/359

BIGTOP-3033: Spark build on OpenSUSE is failed

Spark building on OpenSUSE is failed as pdflatex is missing.
Add package to install list.

Change-Id: Ib3914ab05fd37418a5aa798fa37b88cb54e4079e
Signed-off-by: Jun He <jun...@linaro.org>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3033

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/359.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #359


commit c7eae733e0fb55b8aa504c8ea75a8779973b07d3
Author: Jun He <jun.he@...>
Date:   2018-05-18T03:08:49Z

BIGTOP-3033: Spark build on OpenSUSE is failed

Spark building on OpenSUSE is failed as pdflatex is missing.
Add package to install list.

Change-Id: Ib3914ab05fd37418a5aa798fa37b88cb54e4079e
Signed-off-by: Jun He <jun...@linaro.org>




---

[GitHub] bigtop pull request #358: BIGTOP-2101: ignite-hadoop contains an arch-depend...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/358

BIGTOP-2101: ignite-hadoop contains an arch-dependent shared lib

ignite-shmem contains x86 binary only. A build step is added to create
arch specific library for non-x86 platforms.

Change-Id: I9f4f03ec61250da21c13a915dc7efd5303e95d5b
Signed-off-by: Jun He <jun...@linaro.org>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-2101

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/358.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #358


commit 91a65820eef6a6b0ff88aa2a93938f8d3eaf3199
Author: Jun He <jun.he@...>
Date:   2017-11-13T10:11:31Z

BIGTOP-2101: ignite-hadoop contains an arch-dependent shared lib

ignite-shmem contains x86 binary only. A build step is added to create
arch specific library for non-x86 platforms.

Change-Id: I9f4f03ec61250da21c13a915dc7efd5303e95d5b
Signed-off-by: Jun He <jun...@linaro.org>




---

[GitHub] bigtop pull request #357: BIGTOP-3030: Remove phantomjs dependecy in build

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/357

BIGTOP-3030: Remove phantomjs dependecy in build

Upstream Ambari depends on phantomjs to build. And at present phantomjs 
provides
only x86* prebuilt binaries. This leads to build failure on non-x86 
platforms.

As phantomjs is used for test, no runtime dep, it can be removed from build 
to
solve this failure.

Change-Id: I06b4fa48705024bb5de9a9167c337db546abbc36
Signed-off-by: Jun He <jun...@linaro.org>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3030

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/357.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #357


commit 28ce19adc34f06caa973c9baeeae083d854abd2e
Author: Jun He <jun.he@...>
Date:   2018-05-10T09:29:32Z

BIGTOP-3030: Remove phantomjs dependecy in build

Upstream Ambari depends on phantomjs to build. And at present phantomjs 
provides
only x86* prebuilt binaries. This leads to build failure on non-x86 
platforms.

As phantomjs is used for test, no runtime dep, it can be removed from build 
to
solve this failure.

Change-Id: I06b4fa48705024bb5de9a9167c337db546abbc36
Signed-off-by: Jun He <jun...@linaro.org>




---

[GitHub] bigtop pull request #356: BIGTOP-3031: Auto find latest maven dist

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/356

BIGTOP-3031: Auto find latest maven dist

Similar to ant, maven dist binaries may get updated from time to time on
Apache mirrors. A better way is to auto find latest maven-3 binary release.
Used the same way in BIGTOP-3022.

Change-Id: I0384a656701f62bd7ef7fc40cd6ab85533ba49fc
Signed-off-by: Jun He <jun...@linaro.org>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3031

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/356.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #356


commit 5da8945bfc3a678c463b9a1f1e36bfa49d0275a7
Author: Jun He <jun.he@...>
Date:   2018-05-14T05:56:04Z

BIGTOP-3031: Auto find latest maven dist

Similar to ant, maven dist binaries may get updated from time to time on
Apache mirrors. A better way is to auto find latest maven-3 binary release.
Used the same way in BIGTOP-3022.

Change-Id: I0384a656701f62bd7ef7fc40cd6ab85533ba49fc
Signed-off-by: Jun He <jun...@linaro.org>




---

[GitHub] bigtop issue #258: BIGTOP-2848: Add provisioner for CentOS 7 AArch64

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/258
  
The image (bigtop/puppet:trunk-centos-7-aarch64) is not provided on 
dockhub. You need to build it locally. 
For all valid images at present, pls check here: 
https://hub.docker.com/r/bigtop/puppet/tags
To build a bigtop-* docker image, pls check by issuing: `./gradlew tasks`


---

[GitHub] bigtop pull request #355: BIGTOP-3024: Zeppelin build is failed after Spark ...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/355

BIGTOP-3024: Zeppelin build is failed after Spark is bumpped to 2.2.1

After Spark is bumpped to 2.2.1 by BIGTOP-2991, zeppelin build is failed.
The root cause is zeppelin now try to download spark-2.2.1.tgz and
spark-2.2.1-bin-without-hadoop.tgz from 
http://d3kbcqa49mib13.cloudfront.net.
This site currently doesn't offer spark 2.2.1 related packages.
So the download link need to be updated to apache site:
https://www.apache.org/dist/spark/

Change-Id: Icea4dc0ac6d65104c7a071e7b044161423dffec5
Signed-off-by: Jun He <jun...@linaro.org>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3024

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/355.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #355


commit feb88d88be3aaf884fbc78c5dd72d98dd01c511b
Author: Jun He <jun.he@...>
Date:   2018-05-03T03:06:14Z

BIGTOP-3024: Zeppelin build is failed after Spark is bumpped to 2.2.1

After Spark is bumpped to 2.2.1 by BIGTOP-2991, zeppelin build is failed.
The root cause is zeppelin now try to download spark-2.2.1.tgz and
spark-2.2.1-bin-without-hadoop.tgz from 
http://d3kbcqa49mib13.cloudfront.net.
This site currently doesn't offer spark 2.2.1 related packages.
So the download link need to be updated to apache site:
https://www.apache.org/dist/spark/

Change-Id: Icea4dc0ac6d65104c7a071e7b044161423dffec5
Signed-off-by: Jun He <jun...@linaro.org>




---

[GitHub] bigtop issue #354: BIGTOP-3023: Bump qfs to 2.0.0

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/354
  
Close it as upstream has merged this.


---

[GitHub] bigtop pull request #354: BIGTOP-3023: Bump qfs to 2.0.0

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/354


---

[GitHub] bigtop pull request #354: BIGTOP-3023: Bump qfs to 2.0.0

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/354

BIGTOP-3023: Bump qfs to 2.0.0

Prior to v2.0.0, qfs doesn't build with openssl-1.1.
This makes bigtop failed on debian-9.
Bump to v2.0.0 should solve this problem.

Change-Id: I4665e6de206ee928d1d8fbf21694bb92ef11752c
Signed-off-by: Jun He <jun...@linaro.org>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3023

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/354.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #354


commit e138a67b58d4aca1c71e93041b0c58970b9493fd
Author: Jun He <jun.he@...>
Date:   2018-04-24T06:11:34Z

BIGTOP-3023: Bump qfs to 2.0.0

Prior to v2.0.0, qfs doesn't build with openssl-1.1.
This makes bigtop failed on debian-9.
Bump to v2.0.0 should solve this problem.

Change-Id: I4665e6de206ee928d1d8fbf21694bb92ef11752c
Signed-off-by: Jun He <jun...@linaro.org>




---

[GitHub] bigtop pull request #353: BIGTOP-2991: Bump up Spark version to 2.2.1

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/353

BIGTOP-2991: Bump up Spark version to 2.2.1

Change-Id: I5e5b47db667206bd4a810b1015793d69c1223cde
Signed-off-by: Jun He <jun...@linaro.org>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-2991

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/353.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #353


commit 905ea9a366ebe3f19ae0d99a44be9ecd35b9c4fb
Author: Jun He <jun.he@...>
Date:   2018-04-24T04:59:30Z

BIGTOP-2991: Bump up Spark version to 2.2.1

Change-Id: I5e5b47db667206bd4a810b1015793d69c1223cde
Signed-off-by: Jun He <jun...@linaro.org>




---

[GitHub] bigtop issue #200: BIGTOP-2723:Fix asciidoctor-maven-plugin for HBase build ...

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/200
  
@guyuqi, could you pls rebase the patch as it has conflicts with HEAD and 
re-submit? Thanks.


---

[GitHub] bigtop pull request #342: BIGTOP-3004: Fix HBase build failure on Debian/Fed...

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/342


---

[GitHub] bigtop issue #342: BIGTOP-3004: Fix HBase build failure on Debian/Fedora

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/342
  
Close this as it has been merged.


---

[GitHub] bigtop pull request #340: BIGTOP-3003: Ant-1.9.9 tarball is removed from Apa...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/340

BIGTOP-3003: Ant-1.9.9 tarball is removed from Apache mirrors

As from 06-Feb, ant-1.9.10 is released and distributed
to Apache mirrors. Ant-1.9.9 is removed and can only
be found at Apache's archive. So update the download
base url.

Change-Id: I817568b08a1607ee04589f5d252dac5588e2
Signed-off-by: Jun He <jun...@linaro.org>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-3003

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/340.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #340


commit decf8932b239b17ef9c80a1d21295e87cec4b11e
Author: Jun He <jun.he@...>
Date:   2018-02-26T08:06:44Z

BIGTOP-3003: Ant-1.9.9 tarball is removed from Apache mirrors

As from 06-Feb, ant-1.9.10 is released and distributed
to Apache mirrors. Ant-1.9.9 is removed and can only
be found at Apache's archive. So update the download
base url.

Change-Id: I817568b08a1607ee04589f5d252dac5588e2
Signed-off-by: Jun He <jun...@linaro.org>




---

[GitHub] bigtop pull request #338: BIGTOP-2988: Incorrect use "dnf update" in puppeti...

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/338


---

[GitHub] bigtop issue #338: BIGTOP-2988: Incorrect use "dnf update" in puppetize.sh

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/338
  
Merged by upstream.


---

[GitHub] bigtop pull request #338: BIGTOP-2988: Incorrect use "dnf update" in puppeti...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/338

BIGTOP-2988: Incorrect use "dnf update" in puppetize.sh

The cmd "dnf -y update" is not correctly used as the
purpose here is to "synchronize the package index
files from their sources".
For this purpose the cmd should be "dnf check-update"

Change-Id: I9ed7b7b631f5fabc00a4ef679d30a68f5c68b539
Signed-off-by: Jun He <jun...@linaro.org>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-2988

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/338.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #338


commit 4e821550f2633d257b505f9cd0f669c702749f53
Author: Jun He <jun.he@...>
Date:   2018-02-01T09:56:33Z

BIGTOP-2988: Incorrect use "dnf update" in puppetize.sh

The cmd "dnf -y update" is not correctly used as the
purpose here is to "synchronize the package index
files from their sources".
For this purpose the cmd should be "dnf check-update"

Change-Id: I9ed7b7b631f5fabc00a4ef679d30a68f5c68b539
Signed-off-by: Jun He <jun...@linaro.org>




---

[GitHub] bigtop pull request #336: BIGTOP-2980: Hama does not build on DEB type syste...

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/336


---

[GitHub] bigtop issue #336: BIGTOP-2980: Hama does not build on DEB type systems

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/336
  
Close this as it has been merged.


---

[GitHub] bigtop pull request #336: BIGTOP-2980: Hama does not build on DEB type syste...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/336

BIGTOP-2980: Hama does not build on DEB type systems

The rules file doesn't specify patches to apply. Add
missing steps.

Change-Id: I5aaaf89eb6f0a043bac45f4a4a610cbbdef1b91c
Signed-off-by: Jun He <jun...@linaro.org>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-2980

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/336.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #336


commit ec9a96dc8b8c0986a3266af29bab02e0585c443a
Author: Jun He <jun.he@...>
Date:   2018-01-05T10:05:53Z

BIGTOP-2980: Hama does not build on DEB type systems

The rules file doesn't specify patches to apply. Add
missing steps.

Change-Id: I5aaaf89eb6f0a043bac45f4a4a610cbbdef1b91c
Signed-off-by: Jun He <jun...@linaro.org>




---

[GitHub] bigtop issue #270: BIGTOP-2862: Debian-8 doesn't provide puppet-3.8.*. Insta...

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/270
  
Debian-8 support is removed from bigtop.


---

[GitHub] bigtop pull request #254: BIGTOP-2840: Add param to control how to get puppe...

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/254


---

[GitHub] bigtop pull request #270: BIGTOP-2862: Debian-8 doesn't provide puppet-3.8.*...

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/270


---

[GitHub] bigtop pull request #278: BIGTOP-2869: Bump solr to 6.6.0

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/278


---

[GitHub] bigtop issue #278: BIGTOP-2869: Bump solr to 6.6.0

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/278
  
Close this as it has been merged.


---

[GitHub] bigtop pull request #300: BIGTOP-2917: Fix Ignite smoke test failure with JD...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/300

BIGTOP-2917: Fix Ignite smoke test failure with JDK8

Change-Id: I687a59386d5c9dfa4d7dff054bfdf16d2883e1ac
Signed-off-by: Jun He <jun...@linaro.org>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-2917

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/300.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #300


commit e36c37185f814aa526aad1dd456bb7e6bb72151c
Author: Jun He <jun...@linaro.org>
Date:   2017-11-09T09:28:31Z

BIGTOP-2917: Fix Ignite smoke test failure with JDK8

Change-Id: I687a59386d5c9dfa4d7dff054bfdf16d2883e1ac
Signed-off-by: Jun He <jun...@linaro.org>




---

[GitHub] bigtop issue #278: BIGTOP-2869: Bump solr to 6.6.0

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/278
  
Hi, Asanjar,

Could you pls point it? I didn't find it the conflict with master branch. 
Thanks.


---

[GitHub] bigtop pull request #273: BIGTOP-2865: HBase smoke test implementation

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/273


---

[GitHub] bigtop issue #273: BIGTOP-2865: HBase smoke test implementation

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/273
  
Thanks for merging, c0s.


---

[GitHub] bigtop issue #273: BIGTOP-2865: HBase smoke test implementation

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/273
  
Hi, c0s,
This smoke test is tested on ubuntu-16.04/amd64. 


---

[GitHub] bigtop pull request #255: BIGTOP-2841: Fix bigtop/slaves-ubuntu-16.04-aarch6...

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/255


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] bigtop pull request #278: BIGTOP-2869: Bump solr to 6.6.0

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/278

BIGTOP-2869: Bump solr to 6.6.0

Change-Id: I0b0f21e749d3638b69f9dcb9e0439cd9646ce804
Signed-off-by: Jun He <jun...@arm.com>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-2869

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/278.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #278


commit 161d73f9f3db5615c1a98a963e0713ec5921c31b
Author: Jun He <jun...@arm.com>
Date:   2017-08-14T07:22:44Z

BIGTOP-2869: Bump solr to 6.6.0

Change-Id: I0b0f21e749d3638b69f9dcb9e0439cd9646ce804
Signed-off-by: Jun He <jun...@arm.com>




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] bigtop pull request #273: BIGTOP-2865: HBase smoke test implementation

[JunHe77]

Github user JunHe77 commented on a diff in the pull request:

https://github.com/apache/bigtop/pull/273#discussion_r132095897
  
--- Diff: bigtop-tests/smoke-tests/hbase/build.gradle ---
@@ -0,0 +1,81 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ * 
+ * http://www.apache.org/licenses/LICENSE-2.0
+ * 
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+def tests_to_include() {
+  return [
--- End diff --

Got it. Thanks!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] bigtop pull request #273: BIGTOP-2865: HBase smoke test implementation

[JunHe77]

Github user JunHe77 commented on a diff in the pull request:

https://github.com/apache/bigtop/pull/273#discussion_r132075887
  
--- Diff: 
bigtop-tests/test-artifacts/hbase/src/main/groovy/org/apache/bigtop/itest/hbase/smoke/TestHBaseCompression.groovy
 ---
@@ -85,7 +85,7 @@ class TestHBaseCompression {
   }
 
   @Test
-  @Ignore("BIGTOP-218")
+  //@Ignore("BIGTOP-218")
--- End diff --

BIGTOP-218 is really very old(created on 2011). At that time snappy may not 
be included. And today bigtop already has libsnappy built-in, so this case can 
be enabled. And test passed on both x86 and aarch64.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] bigtop pull request #273: BIGTOP-2865: HBase smoke test implementation

[JunHe77]

Github user JunHe77 commented on a diff in the pull request:

https://github.com/apache/bigtop/pull/273#discussion_r132075654
  
--- Diff: 
bigtop-tests/test-artifacts/hbase/src/main/groovy/org/apache/bigtop/itest/hbase/smoke/TestImportTsv.groovy
 ---
@@ -89,7 +92,8 @@ public class TestImportTsv {
 // delete data and junk from HDFS
 sh.exec("hadoop fs -rmr -skipTrash $DATADIR1",
   "hadoop fs -rmr -skipTrash $DATADIR2",
-  "hadoop fs -rmr -skipTrash /user/$USER/partitions_*");
+  "hadoop fs -rmr -skipTrash /user/$USER/hbase*",
--- End diff --

Got it and updated. I'm not sure about the context of using 'rmr', so I 
leave it unchanged in initial commit. :P


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] bigtop pull request #273: BIGTOP-2865: HBase smoke test implementation

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/273

BIGTOP-2865: HBase smoke test implementation

Change-Id: I5731baebc41090903fee8b79d0f4013dbe62c5b7
Signed-off-by: Jun He <jun...@arm.com>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-2865

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/273.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #273


commit da2bde5c6421fb8c764ac374255f01b43f9e102d
Author: Jun He <jun...@arm.com>
Date:   2017-08-04T07:52:52Z

BIGTOP-2865: HBase smoke test implementation

Change-Id: I5731baebc41090903fee8b79d0f4013dbe62c5b7
Signed-off-by: Jun He <jun...@arm.com>




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] bigtop pull request #160: Added ARM64 support for levedb v1.8

[JunHe77]

Github user JunHe77 closed the pull request at:

https://github.com/apache/bigtop/pull/160


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] bigtop issue #271: BIGTOP-2863: Make doc format compatible with JDK-8

[JunHe77]

Github user JunHe77 commented on the issue:

https://github.com/apache/bigtop/pull/271
  
Build is OK. Still have problem to run test. I'm checking it now.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] bigtop pull request #271: BIGTOP-2863: Make doc format compatible with JDK-8

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/271

BIGTOP-2863: Make doc format compatible with JDK-8

Change-Id: Icbcd8a1da09b9416ef0dc56f5b42831b08747abc
Signed-off-by: Jun He <jun...@arm.com>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-2863

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/271.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #271


commit fa796443f44a2c1da7497ecf83b505d4a643738b
Author: Jun He <jun...@arm.com>
Date:   2017-08-03T02:02:46Z

BIGTOP-2863: Make doc format compatible with JDK-8

Change-Id: Icbcd8a1da09b9416ef0dc56f5b42831b08747abc
Signed-off-by: Jun He <jun...@arm.com>




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] bigtop pull request #270: BIGTOP-2862: Debian-8 doesn't provide puppet-3.8.*...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/270

BIGTOP-2862: Debian-8 doesn't provide puppet-3.8.*. Install it from t…

…arball.

Change-Id: Ifa351a2dee0d5778d1e2f1fe83c93b0bc9910cc5
Signed-off-by: Jun He <jun...@arm.com>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-2862

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/270.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #270


commit 721b3284b33686acb6d213fdc5e38617da659b36
Author: Jun He <jun...@arm.com>
Date:   2017-08-02T09:41:43Z

BIGTOP-2862: Debian-8 doesn't provide puppet-3.8.*. Install it from tarball.

Change-Id: Ifa351a2dee0d5778d1e2f1fe83c93b0bc9910cc5
Signed-off-by: Jun He <jun...@arm.com>




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] bigtop pull request #263: BIGTOP-2857: Add aarch64 support for fedora25

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/263

BIGTOP-2857: Add aarch64 support for fedora25

Change-Id: I00f8f6a9bb4c46cb93891477153f728ac945dff5
Signed-off-by: Jun He <jun...@arm.com>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-2857

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/263.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #263


commit dc49d39f6c0d85115be38c2ecd062c29a2e8f754
Author: Jun He <jun...@arm.com>
Date:   2017-07-24T02:08:37Z

BIGTOP-2857: Add aarch64 support for fedora25

Change-Id: I00f8f6a9bb4c46cb93891477153f728ac945dff5
Signed-off-by: Jun He <jun...@arm.com>




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] bigtop pull request #255: BIGTOP-2841: Fix bigtop/slaves-ubuntu-16.04-aarch6...

[JunHe77]

GitHub user JunHe77 opened a pull request:

https://github.com/apache/bigtop/pull/255

BIGTOP-2841: Fix bigtop/slaves-ubuntu-16.04-aarch64 build failure

Change-Id: Ibee5879191f27a0f04fb1aa71b0f1da01305cf8f
Signed-off-by: Jun He <jun...@arm.com>

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JunHe77/bigtop BIGTOP-2841

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/255.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #255


commit 843305d1f45106d1aa6116736d5ee3e397098cad
Author: Jun He <jun...@arm.com>
Date:   2017-07-13T05:27:19Z

BIGTOP-2841: Fix bigtop/slaves-ubuntu-16.04-aarch64 build failure

Change-Id: Ibee5879191f27a0f04fb1aa71b0f1da01305cf8f
Signed-off-by: Jun He <jun...@arm.com>




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---