[jira] [Resolved] (HUDI-579) Add border to table on hudi website

[ https://issues.apache.org/jira/browse/HUDI-579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-579. Resolution: Fixed Fixed via asf-site: 4670c026010b61d5bd591119902a19d64d2b8889 > Add border to table on hudi website

[GitHub] [incubator-hudi] haospotai commented on issue #1284: [SUPPORT]

haospotai commented on issue #1284: [SUPPORT] URL: https://github.com/apache/incubator-hudi/issues/1284#issuecomment-579637991 ``` df = spark.read.json("hdfs://namenode:8020/data/test.json") df.write.format("org.apache.hudi") \ .option("hoodie.datasource.write.pr

[GitHub] [incubator-hudi] haospotai commented on issue #1284: [SUPPORT]

haospotai commented on issue #1284: [SUPPORT] URL: https://github.com/apache/incubator-hudi/issues/1284#issuecomment-579637458 this is the branch ``` hadoop@huidi-evaluation:~/incubator-hudi$ git branch * release-0.5.1 ``` then use ``` pyspark --packages org.apache.

[jira] [Created] (HUDI-582) NOTICE year is incorrect

leesf created HUDI-582: -- Summary: NOTICE year is incorrect Key: HUDI-582 URL: https://issues.apache.org/jira/browse/HUDI-582 Project: Apache Hudi (incubating) Issue Type: Improvement Component

[jira] [Updated] (HUDI-580) Incorrect license header in docker/hoodie/hadoop/base/entrypoint.sh

[ https://issues.apache.org/jira/browse/HUDI-580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-580: --- Description: Issues pointed out in general@incubator ML, more context here:  [https://lists.apache.org/thread.html/rd3f

[jira] [Created] (HUDI-581) NOTICE need more work as it missing content form included 3rd party ALv2 licensed NOTICE files

leesf created HUDI-581: -- Summary: NOTICE need more work as it missing content form included 3rd party ALv2 licensed NOTICE files Key: HUDI-581 URL: https://issues.apache.org/jira/browse/HUDI-581 Project: Apache

[jira] [Created] (HUDI-580) Incorrect license header in docker/hoodie/hadoop/base/entrypoint.sh

leesf created HUDI-580: -- Summary: Incorrect license header in docker/hoodie/hadoop/base/entrypoint.sh Key: HUDI-580 URL: https://issues.apache.org/jira/browse/HUDI-580 Project: Apache Hudi (incubating)

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet

nsivabalan commented on a change in pull request #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet URL: https://github.com/apache/incubator-hudi/pull/1253#discussion_r372198618 ## File path: hudi-common/src/test/java/org/apache/hudi/common/util/

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet

nsivabalan commented on a change in pull request #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet URL: https://github.com/apache/incubator-hudi/pull/1253#discussion_r372198475 ## File path: hudi-common/src/test/java/org/apache/hudi/common/util/

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet

nsivabalan commented on a change in pull request #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet URL: https://github.com/apache/incubator-hudi/pull/1253#discussion_r372197069 ## File path: hudi-common/src/main/java/org/apache/hudi/common/bloom

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1288: [HUDI-117] Close file handle before throwing an exception due to append…

n3nash commented on a change in pull request #1288: [HUDI-117] Close file handle before throwing an exception due to append… URL: https://github.com/apache/incubator-hudi/pull/1288#discussion_r372190443 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/Hoodie

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1288: [HUDI-117] Close file handle before throwing an exception due to append…

n3nash commented on a change in pull request #1288: [HUDI-117] Close file handle before throwing an exception due to append… URL: https://github.com/apache/incubator-hudi/pull/1288#discussion_r372190536 ## File path: hudi-common/src/test/java/org/apache/hudi/common/table/log/TestHo

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1288: [HUDI-117] Close file handle before throwing an exception due to append…

n3nash commented on a change in pull request #1288: [HUDI-117] Close file handle before throwing an exception due to append… URL: https://github.com/apache/incubator-hudi/pull/1288#discussion_r372190260 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/Hoodie

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #173

See Changes: -- [...truncated 2.01 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4: bin boot conf lib LICENSE NOTICE README.txt /home/jenkins/tools/maven/apache-maven-3

[GitHub] [incubator-hudi] yanghua commented on issue #1285: [HUDI-562] Added a few test cases for class org.apache.hudi.WriteStatus

yanghua commented on issue #1285: [HUDI-562] Added a few test cases for class org.apache.hudi.WriteStatus URL: https://github.com/apache/incubator-hudi/pull/1285#issuecomment-579559795 > Thanks @bhasudha > > I don't have write access so I cannot start travis rebuild. Re-trigge

[GitHub] [incubator-hudi] nbalajee commented on issue #1288: [HUDI-117] Close file handle before throwing an exception due to append…

nbalajee commented on issue #1288: [HUDI-117] Close file handle before throwing an exception due to append… URL: https://github.com/apache/incubator-hudi/pull/1288#issuecomment-579556806 > @nbalajee It seems like the build is failing, can you check ? :: problems summary :: WA

[GitHub] [incubator-hudi] satishkotha commented on a change in pull request #1274: [HUDI-571] Add 'commits show archived' command to CLI

satishkotha commented on a change in pull request #1274: [HUDI-571] Add 'commits show archived' command to CLI URL: https://github.com/apache/incubator-hudi/pull/1274#discussion_r372151885 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableMetaClient.ja

[GitHub] [incubator-hudi] n3nash commented on issue #1288: [HUDI-117] Close file handle before throwing an exception due to append…

n3nash commented on issue #1288: [HUDI-117] Close file handle before throwing an exception due to append… URL: https://github.com/apache/incubator-hudi/pull/1288#issuecomment-579547411 @nbalajee It seems like the build is failing, can you check ? ---

[GitHub] [incubator-hudi] prashantwason opened a new pull request #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi.

prashantwason opened a new pull request #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi. URL: https://github.com/apache/incubator-hudi/pull/1289 ## What is the purpose of the pull request HUDI DAG stages do not have any names. The Spark History Server UI shows

[jira] [Updated] (HUDI-117) Write Unit-Test Case to test recovery lease handling in HoodieLogFormatWriter

[ https://issues.apache.org/jira/browse/HUDI-117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-117: Labels: pull-request-available (was: ) > Write Unit-Test Case to test recovery lease handling in Hoo

[GitHub] [incubator-hudi] nbalajee opened a new pull request #1288: HUDI-117 Close file handle before throwing an exception due to append…

nbalajee opened a new pull request #1288: HUDI-117 Close file handle before throwing an exception due to append… URL: https://github.com/apache/incubator-hudi/pull/1288 … failure. Add test cases to handle/verify stage failure scenarios. ## What is the purpose of the pull reque

[GitHub] [incubator-hudi] prashantwason commented on issue #1285: [HUDI-562] Added a few test cases for class org.apache.hudi.WriteStatus

prashantwason commented on issue #1285: [HUDI-562] Added a few test cases for class org.apache.hudi.WriteStatus URL: https://github.com/apache/incubator-hudi/pull/1285#issuecomment-579432882 Thanks @bhasudha I don't have write access so I cannot start travis rebuild. --

[GitHub] [incubator-hudi] bhasudha commented on issue #1285: [HUDI-562] Added a few test cases for class org.apache.hudi.WriteStatus

bhasudha commented on issue #1285: [HUDI-562] Added a few test cases for class org.apache.hudi.WriteStatus URL: https://github.com/apache/incubator-hudi/pull/1285#issuecomment-579430644 > Travis is green. @prashantwason I restarted the Travis build. It seemed like some transient is

[GitHub] [incubator-hudi] prashantwason commented on issue #1285: [HUDI-562] Added a few test cases for class org.apache.hudi.WriteStatus

prashantwason commented on issue #1285: [HUDI-562] Added a few test cases for class org.apache.hudi.WriteStatus URL: https://github.com/apache/incubator-hudi/pull/1285#issuecomment-579425065 Travis is green. This is an automa

[GitHub] [incubator-hudi] bhasudha commented on issue #1280: [MINOR] Remove junit-dep dependency

bhasudha commented on issue #1280: [MINOR] Remove junit-dep dependency URL: https://github.com/apache/incubator-hudi/pull/1280#issuecomment-579390641 Sounds good. Thanks for clarifications @yanghua and @hmatu . I dont have a strong opinion on the exclusion as well. Will merge this in. ---

[incubator-hudi] branch master updated (56a4e0d -> 362a9b9)

This is an automated email from the ASF dual-hosted git repository. bhavanisudha pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 56a4e0d [MINOR] Fix invalid issue url & quickstart url (#1282) add 362a9b9 [MINOR] Remove junit-

[GitHub] [incubator-hudi] bhasudha merged pull request #1280: [MINOR] Remove junit-dep dependency

bhasudha merged pull request #1280: [MINOR] Remove junit-dep dependency URL: https://github.com/apache/incubator-hudi/pull/1280 This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [incubator-hudi] n3nash commented on issue #1284: [SUPPORT]

n3nash commented on issue #1284: [SUPPORT] URL: https://github.com/apache/incubator-hudi/issues/1284#issuecomment-579387299 @lamber-ken let's have follow up discussions on JIRA if needed. We want to limit interactions of GH issues please

[GitHub] [incubator-hudi] n3nash commented on issue #1100: [HUDI-289] Implement a test suite to support long running test for Hudi writing and querying end-end

n3nash commented on issue #1100: [HUDI-289] Implement a test suite to support long running test for Hudi writing and querying end-end URL: https://github.com/apache/incubator-hudi/pull/1100#issuecomment-579386272 @yanghua please take a look at this PR once you are back from the new year ho

[GitHub] [incubator-hudi] n3nash commented on issue #1115: [HUDI-392] Introduce DIstributedTestDataSource to generate test data

n3nash commented on issue #1115: [HUDI-392] Introduce DIstributedTestDataSource to generate test data URL: https://github.com/apache/incubator-hudi/pull/1115#issuecomment-579385938 @yanghua please take a look at this after you are back from the new year holidays, we should probably merge o

[GitHub] [incubator-hudi] n3nash commented on issue #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module

n3nash commented on issue #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module URL: https://github.com/apache/incubator-hudi/pull/1191#issuecomment-579385642 @yanghua no worries, happy new year! please take a look at this once you're back from t

[GitHub] [incubator-hudi] bhasudha merged pull request #1283: [HUDI-579] Add border to table on hudi website

bhasudha merged pull request #1283: [HUDI-579] Add border to table on hudi website URL: https://github.com/apache/incubator-hudi/pull/1283 This is an automated message from the Apache Git Service. To respond to the message,

[incubator-hudi] branch asf-site updated: [HUDI-579] Add border to table on hudi website (#1283)

This is an automated email from the ASF dual-hosted git repository. bhavanisudha pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 4670c02 [HUDI-579] Add border

[GitHub] [incubator-hudi] prashantwason commented on issue #1286: [HUDI-564] Added new test cases for HoodieLogFormat and HoodieLogFormatVersion.

prashantwason commented on issue #1286: [HUDI-564] Added new test cases for HoodieLogFormat and HoodieLogFormatVersion. URL: https://github.com/apache/incubator-hudi/pull/1286#issuecomment-579381907 The failure is in hudi-integ-test which seems unrelated to my change. I will investigate th

[GitHub] [incubator-hudi] prashantwason commented on issue #1285: [HUDI-562] Added a few test cases for class org.apache.hudi.WriteStatus

prashantwason commented on issue #1285: [HUDI-562] Added a few test cases for class org.apache.hudi.WriteStatus URL: https://github.com/apache/incubator-hudi/pull/1285#issuecomment-579381438 The failure is in hudi-integ-test which seems unrelated to my change. I will investigate the cause.

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1284: [SUPPORT]

lamber-ken edited a comment on issue #1284: [SUPPORT] URL: https://github.com/apache/incubator-hudi/issues/1284#issuecomment-579204395 Hi @haospotai, give you a demo using python with `release-0.5.1` version. **Step1:** ``` git clone -b release-0.5.1 https://github.com/apache/in

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1284: [SUPPORT]

lamber-ken edited a comment on issue #1284: [SUPPORT] URL: https://github.com/apache/incubator-hudi/issues/1284#issuecomment-579204395 Hi @haospotai, give you a demo without sync to hive. When using the latest `release-0.5.1`, I met some error, I am tring to figure it out. ``` exp

[GitHub] [incubator-hudi] lamber-ken commented on issue #1284: [SUPPORT]

lamber-ken commented on issue #1284: [SUPPORT] URL: https://github.com/apache/incubator-hudi/issues/1284#issuecomment-579204395 Hi @haospotai, give you a demo without sync to hive. When using the latest `release-0.5.1`, I met some error, I am tring to figure it out. ``` export SPA

[GitHub] [incubator-hudi] yanghua commented on issue #1280: [MINOR] Remove junit-dep dependency

yanghua commented on issue #1280: [MINOR] Remove junit-dep dependency URL: https://github.com/apache/incubator-hudi/pull/1280#issuecomment-579181041 > No, `system-rules` can be deleted as a whole, it takes longer to compile project. If you can make sure we do not need the `system-rul