[jira] [Created] (HUDI-843) Support different time units in TimestampBasedKeyGenerator

2020-04-27 Thread Alexander Filipchik (Jira)
Alexander Filipchik created HUDI-843: Summary: Support different time units in TimestampBasedKeyGenerator Key: HUDI-843 URL: https://issues.apache.org/jira/browse/HUDI-843 Project: Apache Hudi (inc

[GitHub] [incubator-hudi] bhasudha commented on issue #1568: [SUPPORT] java.lang.reflect.InvocationTargetException when upsert

2020-04-27 Thread GitBox
bhasudha commented on issue #1568: URL: https://github.com/apache/incubator-hudi/issues/1568#issuecomment-620407768 @tieke1121 are you setting these configs ``` --hiveconf hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat \ --hiveconf hive.stats.autogather=false

[GitHub] [incubator-hudi] afilipchik commented on a change in pull request #1562: [HUDI-837]: implemented custom deserializer for AvroKafkaSource

2020-04-27 Thread GitBox
afilipchik commented on a change in pull request #1562: URL: https://github.com/apache/incubator-hudi/pull/1562#discussion_r416350367 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/serde/HoodieAvroKafkaDeserializer.java ## @@ -0,0 +1,78 @@ +/* + *

[GitHub] [incubator-hudi] afilipchik commented on a change in pull request #1565: [HUDI-73]: implemented vanilla AvroKafkaSource

2020-04-27 Thread GitBox
afilipchik commented on a change in pull request #1565: URL: https://github.com/apache/incubator-hudi/pull/1565#discussion_r416344601 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/serde/AbstractHoodieKafkaAvroDeserializer.java ## @@ -0,0 +1,97 @@ +/* + *

[GitHub] [incubator-hudi] afilipchik commented on pull request #1566: [HUDI-603]: DeltaStreamer can now fetch schema before every run in continuous mode

2020-04-27 Thread GitBox
afilipchik commented on pull request #1566: URL: https://github.com/apache/incubator-hudi/pull/1566#issuecomment-620394679 I think it is not enough. Example: when consuming from kafka, schema might change midway. Example: we are reading 1 messages, schema will be fetched on start. Star

[GitHub] [incubator-hudi] vinothchandar commented on pull request #1520: [HUDI-797] Small performance improvement for rewriting records.

2020-04-27 Thread GitBox
vinothchandar commented on pull request #1520: URL: https://github.com/apache/incubator-hudi/pull/1520#issuecomment-620386762 @prashantwason the reason for these is to additionally project out the _hoodie_record_key field needed to merge base and log files.. Hive will only hand the column

[GitHub] [incubator-hudi] vinothchandar commented on pull request #1520: [HUDI-797] Small performance improvement for rewriting records.

2020-04-27 Thread GitBox
vinothchandar commented on pull request #1520: URL: https://github.com/apache/incubator-hudi/pull/1520#issuecomment-620386911 Meta fields have to come first.. and I think its too late to change that in hudi , as lots of data have been written already :) --

[GitHub] [incubator-hudi] vinothchandar commented on pull request #1566: [HUDI-603]: DeltaStreamer can now fetch schema before every run in continuous mode

2020-04-27 Thread GitBox
vinothchandar commented on pull request #1566: URL: https://github.com/apache/incubator-hudi/pull/1566#issuecomment-620376125 Zooming out a bit, this seems like an artifact on how the different schema providers are implemented right... Most of them fetch the schema in the constructor (desi

[GitHub] [incubator-hudi] hddong commented on a change in pull request #1558: [HUDI-796]: added deduping logic for upserts case

2020-04-27 Thread GitBox
hddong commented on a change in pull request #1558: URL: https://github.com/apache/incubator-hudi/pull/1558#discussion_r416299956 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/RepairsCommand.java ## @@ -64,11 +64,15 @@ public String deduplicate( @Cli

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1566: [HUDI-603]: DeltaStreamer can now fetch schema before every run in continuous mode

2020-04-27 Thread GitBox
vinothchandar commented on a change in pull request #1566: URL: https://github.com/apache/incubator-hudi/pull/1566#discussion_r416319065 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java ## @@ -162,18 +162,23 @@ public DeltaSync(

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #261

2020-04-27 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.36 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml /home/jenkins/tools/maven/apache-maven-3.5.

[GitHub] [incubator-hudi] hddong commented on a change in pull request #1554: [HUDI-704]Add test for RepairsCommand

2020-04-27 Thread GitBox
hddong commented on a change in pull request #1554: URL: https://github.com/apache/incubator-hudi/pull/1554#discussion_r416285607 ## File path: hudi-cli/src/test/java/org/apache/hudi/cli/integ/ITTestRepairsCommand.java ## @@ -0,0 +1,170 @@ +/* + * Licensed to the Apache Softwa

[GitHub] [incubator-hudi] hddong commented on a change in pull request #1554: [HUDI-704]Add test for RepairsCommand

2020-04-27 Thread GitBox
hddong commented on a change in pull request #1554: URL: https://github.com/apache/incubator-hudi/pull/1554#discussion_r416283181 ## File path: hudi-cli/src/test/java/org/apache/hudi/cli/integ/ITTestRepairsCommand.java ## @@ -0,0 +1,170 @@ +/* + * Licensed to the Apache Softwa

[GitHub] [incubator-hudi] c-f-cooper commented on issue #1531: run example

2020-04-27 Thread GitBox
c-f-cooper commented on issue #1531: URL: https://github.com/apache/incubator-hudi/issues/1531#issuecomment-620336849 0.5 This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[GitHub] [incubator-hudi] tieke1121 commented on issue #1568: [SUPPORT] java.lang.reflect.InvocationTargetException when upsert

2020-04-27 Thread GitBox
tieke1121 commented on issue #1568: URL: https://github.com/apache/incubator-hudi/issues/1568#issuecomment-620330335 ``` 1 there is no 'default' directory after i set the DataSourceWriteOptions.KEYGENERATOR_CLASS_OPT_KEY 2 hadoop fs -ls /wap-olap/data/device/status/data_1/.ho

[GitHub] [incubator-hudi] bvaradar commented on issue #1568: [SUPPORT] java.lang.reflect.InvocationTargetException when upsert

2020-04-27 Thread GitBox
bvaradar commented on issue #1568: URL: https://github.com/apache/incubator-hudi/issues/1568#issuecomment-620328437 @tieke1121 : Is there a "default" directory under /wap-olap/data/device/status/data_1 Can you list /wap-olap/data/device/status/data_1/.hoodie folder and show the out

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1568: [SUPPORT] java.lang.reflect.InvocationTargetException when upsert

2020-04-27 Thread GitBox
lamber-ken edited a comment on issue #1568: URL: https://github.com/apache/incubator-hudi/issues/1568#issuecomment-620325288 hello @tieke1121, you can use ` ``` ` to wrap stackstrace, e.g ``` Exception in thread "main" java.lang.ArithmeticException: / by zero at com.huahuiyang.c

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1568: [SUPPORT] java.lang.reflect.InvocationTargetException when upsert

2020-04-27 Thread GitBox
lamber-ken edited a comment on issue #1568: URL: https://github.com/apache/incubator-hudi/issues/1568#issuecomment-620325288 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [incubator-hudi] tieke1121 edited a comment on issue #1568: [SUPPORT] java.lang.reflect.InvocationTargetException when upsert

2020-04-27 Thread GitBox
tieke1121 edited a comment on issue #1568: URL: https://github.com/apache/incubator-hudi/issues/1568#issuecomment-620324107 I've set it up ``` dataFrame.writeStream .format("org.apache.hudi") .option("path", conf.getString("hudi.basePath")) .option(DataSourc

[GitHub] [incubator-hudi] lamber-ken commented on issue #1568: [SUPPORT] java.lang.reflect.InvocationTargetException when upsert

2020-04-27 Thread GitBox
lamber-ken commented on issue #1568: URL: https://github.com/apache/incubator-hudi/issues/1568#issuecomment-620325288 hello @tieke1121, you can use ` ``` ` to wrap stackstrace, e.g ``` Error: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hado

[GitHub] [incubator-hudi] tieke1121 commented on issue #1568: [SUPPORT] java.lang.reflect.InvocationTargetException when upsert

2020-04-27 Thread GitBox
tieke1121 commented on issue #1568: URL: https://github.com/apache/incubator-hudi/issues/1568#issuecomment-620324107 I've set it up dataFrame.writeStream .format("org.apache.hudi") .option("path", conf.getString("hudi.basePath")) .option(DataSourceWriteOptions.

[GitHub] [incubator-hudi] bvaradar commented on issue #1569: [SUPPORT] Audit Feature In A PartitionPath

2020-04-27 Thread GitBox
bvaradar commented on issue #1569: URL: https://github.com/apache/incubator-hudi/issues/1569#issuecomment-620319666 With cleaning, you can setup cleaning parameters so that you have enough versions retained ( see https://hudi.apache.org/docs/configurations.html#retainCommits). You can also

[GitHub] [incubator-hudi] xushiyan commented on pull request #1553: [HUDI-810] Migrate ClientTestHarness to JUnit 5

2020-04-27 Thread GitBox
xushiyan commented on pull request #1553: URL: https://github.com/apache/incubator-hudi/pull/1553#issuecomment-620308695 @yanghua Fixed 2 new conflicts hudi-client/src/test/java/org/apache/hudi/execution/TestBoundedInMemoryExecutor.java hudi-client/src/test/java/org/apache/hudi/execu

[GitHub] [incubator-hudi] bvaradar commented on issue #1556: [SUPPORT] Input path in s3 doesn't exist if the write multiple datasets to s3 in a single execution

2020-04-27 Thread GitBox
bvaradar commented on issue #1556: URL: https://github.com/apache/incubator-hudi/issues/1556#issuecomment-620303776 @HariprasadAllaka1612 Not sure if I completely understand the context here. Questions inline related to your descriptions ? 1. Reading CDC table from hive (hoodi

[GitHub] [incubator-hudi] bvaradar commented on issue #1568: [SUPPORT] java.lang.reflect.InvocationTargetException when upsert

2020-04-27 Thread GitBox
bvaradar commented on issue #1568: URL: https://github.com/apache/incubator-hudi/issues/1568#issuecomment-620292854 @tieke1121 : For non-partitioned table, you would need to use NonpartitionedKeyGenerator as key-generator class. Can you set it up and give it a shot.

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1566: [HUDI-603]: DeltaStreamer can now fetch schema before every run in continuous mode

2020-04-27 Thread GitBox
bvaradar commented on a change in pull request #1566: URL: https://github.com/apache/incubator-hudi/pull/1566#discussion_r416220182 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java ## @@ -162,18 +162,23 @@ public DeltaSync(Hoodi

[GitHub] [incubator-hudi] bvaradar commented on issue #1550: Hudi 0.5.2 inability save complex type with nullable = true [SUPPORT]

2020-04-27 Thread GitBox
bvaradar commented on issue #1550: URL: https://github.com/apache/incubator-hudi/issues/1550#issuecomment-620254532 Closing this issue as it will be resolved in next release. This is an automated message from the Apache Git S

[GitHub] [incubator-hudi] bvaradar commented on issue #1549: Potential issue when using Deltastreamer with DMS

2020-04-27 Thread GitBox
bvaradar commented on issue #1549: URL: https://github.com/apache/incubator-hudi/issues/1549#issuecomment-620252568 @n3nash : Assigning this ticket to you This is an automated message from the Apache Git Service. To respond

[GitHub] [incubator-hudi] bvaradar commented on issue #1531: run example

2020-04-27 Thread GitBox
bvaradar commented on issue #1531: URL: https://github.com/apache/incubator-hudi/issues/1531#issuecomment-620251761 @c-f-cooper : Which version of hudi are you using ? This has been fixed in master ( https://github.com/apache/incubator-hudi/blob/master/hudi-client/src/test/java/HoodieClien

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1552: Time taken for upserting hudi table is increasing with increase in number of partitions

2020-04-27 Thread GitBox
lamber-ken edited a comment on issue #1552: URL: https://github.com/apache/incubator-hudi/issues/1552#issuecomment-620246831 ## The lastest spark log (master branch) ### Simplified origin spark log ``` // Upsert part Warning: Ignoring non-spark config property: "spark.sql.hi

[GitHub] [incubator-hudi] lamber-ken commented on issue #1552: Time taken for upserting hudi table is increasing with increase in number of partitions

2020-04-27 Thread GitBox
lamber-ken commented on issue #1552: URL: https://github.com/apache/incubator-hudi/issues/1552#issuecomment-620246831 ## The lastest spark log (master branch) ### Simplified origin spark log ``` // Upsert part Warning: Ignoring non-spark config property: "spark.sql.hive.conv

[GitHub] [incubator-hudi] nsivabalan commented on pull request #1402: [HUDI-407] Adding Simple Index

2020-04-27 Thread GitBox
nsivabalan commented on pull request #1402: URL: https://github.com/apache/incubator-hudi/pull/1402#issuecomment-620243226 > @nsivabalan is this still WIP.. please remove the prefix if its ready done. it is ready. Thi

[GitHub] [incubator-hudi] prashantwason commented on pull request #1520: [HUDI-797] Small performance improvement for rewriting records.

2020-04-27 Thread GitBox
prashantwason commented on pull request #1520: URL: https://github.com/apache/incubator-hudi/pull/1520#issuecomment-620241928 HoodieParquetRealtimeInputFormat has hardcoded the positions of the HUDI specific metadata fields. // These positions have to be deterministic across all ta

[GitHub] [incubator-hudi] vinothchandar commented on pull request #1402: [WIP][HUDI-407] Adding Simple Index

2020-04-27 Thread GitBox
vinothchandar commented on pull request #1402: URL: https://github.com/apache/incubator-hudi/pull/1402#issuecomment-620233014 @nsivabalan is this still WIP.. please remove the prefix if its ready This is an automated message

[GitHub] [incubator-hudi] vinothchandar commented on pull request #1558: [HUDI-796]: added deduping logic for upserts case

2020-04-27 Thread GitBox
vinothchandar commented on pull request #1558: URL: https://github.com/apache/incubator-hudi/pull/1558#issuecomment-620226161 cc @yanghua @hddong are you able to review this? This is an automated message from the Apache Git

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1433: [HUDI-728]: Implement custom key generator

2020-04-27 Thread GitBox
vinothchandar commented on a change in pull request #1433: URL: https://github.com/apache/incubator-hudi/pull/1433#discussion_r416123455 ## File path: hudi-spark/src/main/java/org/apache/hudi/keygen/CustomKeyGenerator.java ## @@ -0,0 +1,143 @@ +/* + * Licensed to the Apache So

[GitHub] [incubator-hudi] vinothchandar commented on pull request #1433: [HUDI-728]: Implement custom key generator

2020-04-27 Thread GitBox
vinothchandar commented on pull request #1433: URL: https://github.com/apache/incubator-hudi/pull/1433#issuecomment-620204439 >>Should I include that in this PR or should I go for a separate PR. Please suggest. Your call.. Doing it here is fine by me as well, since you are touching a

[GitHub] [incubator-hudi] vinothchandar commented on pull request #1512: [HUDI-763] Add hoodie.table.base.file.format option to hoodie.properties file

2020-04-27 Thread GitBox
vinothchandar commented on pull request #1512: URL: https://github.com/apache/incubator-hudi/pull/1512#issuecomment-620202899 Just 1 suggestion. LGTM otherwise . thanks @lamber-ken This is an automated message from the Apach

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1512: [HUDI-763] Add hoodie.table.base.file.format option to hoodie.properties file

2020-04-27 Thread GitBox
vinothchandar commented on a change in pull request #1512: URL: https://github.com/apache/incubator-hudi/pull/1512#discussion_r416109136 ## File path: hudi-spark/src/main/scala/org/apache/hudi/DataSourceOptions.scala ## @@ -142,6 +143,16 @@ object DataSourceWriteOptions { va

[GitHub] [incubator-hudi] bvaradar commented on issue #1555: [SUPPORT] Meet java.lang.IllegalAccessError: class org.apache.hadoop.hdfs.web.HftpFileSystem

2020-04-27 Thread GitBox
bvaradar commented on issue #1555: URL: https://github.com/apache/incubator-hudi/issues/1555#issuecomment-620201027 @allenzhg : Let me know if you were able to resolve this ? This is an automated message from the Apache Git S

[GitHub] [incubator-hudi] vinothchandar commented on pull request #1562: [HUDI-837]: implemented custom deserializer for AvroKafkaSource

2020-04-27 Thread GitBox
vinothchandar commented on pull request #1562: URL: https://github.com/apache/incubator-hudi/pull/1562#issuecomment-620199838 @afilipchik interested in reviewing this? This is an automated message from the Apache Git Service.

[GitHub] [incubator-hudi] vinothchandar commented on pull request #1566: [HUDI-603]: DeltaStreamer can now fetch schema before every run in continuous mode

2020-04-27 Thread GitBox
vinothchandar commented on pull request #1566: URL: https://github.com/apache/incubator-hudi/pull/1566#issuecomment-620199568 @afilipchik interested in taking a run at this? :) This is an automated message from the Apache Gi

[GitHub] [incubator-hudi] vinothchandar commented on pull request #1567: [HUDI-840]Clean blank file created by HoodieLogFormatWriter

2020-04-27 Thread GitBox
vinothchandar commented on pull request #1567: URL: https://github.com/apache/incubator-hudi/pull/1567#issuecomment-620198845 @n3nash could you also review this since it touches the common log format writer as well This is

[incubator-hudi] branch master updated: [HUDI-819] Fix a bug with MergeOnReadLazyInsertIterable.

2020-04-27 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 6de9f5d [HUDI-819] Fix a bug with Merge

[jira] [Created] (HUDI-842) Implementation plan for RFC 15 (File Listing and Query Planning Improvements))

2020-04-27 Thread Prashant Wason (Jira)
Prashant Wason created HUDI-842: --- Summary: Implementation plan for RFC 15 (File Listing and Query Planning Improvements)) Key: HUDI-842 URL: https://issues.apache.org/jira/browse/HUDI-842 Project: Apach

[GitHub] [incubator-hudi] satishkotha commented on pull request #1540: [HUDI-819] Fix a bug with MergeOnReadLazyInsertIterable.

2020-04-27 Thread GitBox
satishkotha commented on pull request #1540: URL: https://github.com/apache/incubator-hudi/pull/1540#issuecomment-620126939 @vinothchandar addressed your review comments. please take another look. This is an automated message

[GitHub] [incubator-hudi] prashantwason commented on pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-04-27 Thread GitBox
prashantwason commented on pull request #1457: URL: https://github.com/apache/incubator-hudi/pull/1457#issuecomment-620125502 1548 looks good. On Mon, Apr 27, 2020 at 9:54 AM vinoth chandar wrote: > @prashantwason >

[GitHub] [incubator-hudi] vingov commented on a change in pull request #1526: [HUDI-1526] Add pyspark example in quickstart

2020-04-27 Thread GitBox
vingov commented on a change in pull request #1526: URL: https://github.com/apache/incubator-hudi/pull/1526#discussion_r415994373 ## File path: docs/_docs/1_1_quick_start_guide.md ## @@ -204,6 +213,262 @@ spark.sql("select uuid, partitionPath from hudi_trips_snapshot").count()

[GitHub] [incubator-hudi] vingov commented on a change in pull request #1526: [HUDI-1526] Add pyspark example in quickstart

2020-04-27 Thread GitBox
vingov commented on a change in pull request #1526: URL: https://github.com/apache/incubator-hudi/pull/1526#discussion_r415994599 ## File path: docs/_docs/1_1_quick_start_guide.md ## @@ -204,6 +213,262 @@ spark.sql("select uuid, partitionPath from hudi_trips_snapshot").count()

[GitHub] [incubator-hudi] vingov commented on pull request #1526: [HUDI-1526] Add pyspark example in quickstart

2020-04-27 Thread GitBox
vingov commented on pull request #1526: URL: https://github.com/apache/incubator-hudi/pull/1526#issuecomment-620115770 I've validated the pyspark example code using the hudi demo docker setup, it looks good to me. This is an

[GitHub] [incubator-hudi] vinothchandar commented on pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-04-27 Thread GitBox
vinothchandar commented on pull request #1457: URL: https://github.com/apache/incubator-hudi/pull/1457#issuecomment-620107259 @prashantwason no worries.. I already fixed it here https://github.com/apache/incubator-hudi/pull/1548 . Please take a quick skim to confirm

[GitHub] [incubator-hudi] prashantwason commented on pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-04-27 Thread GitBox
prashantwason commented on pull request #1457: URL: https://github.com/apache/incubator-hudi/pull/1457#issuecomment-620105240 I guess its an oversight on my part. I will file another PR. This is an automated message from the

[GitHub] [incubator-hudi] n3nash commented on pull request #1100: [HUDI-289] Implement a test suite to support long running test for Hudi writing and querying end-end

2020-04-27 Thread GitBox
n3nash commented on pull request #1100: URL: https://github.com/apache/incubator-hudi/pull/1100#issuecomment-620099888 @yanghua can you go through this PR and approve it ? This is an automated message from the Apache Git Serv

[GitHub] [incubator-hudi] nandini57 opened a new issue #1569: [SUPPORT]

2020-04-27 Thread GitBox
nandini57 opened a new issue #1569: URL: https://github.com/apache/incubator-hudi/issues/1569 Is there a way/example to build audit queries within a partition path in COW/MOR mode.Sure,there are the commit times ,but due to inline compaction and cleanup(Last Commit), i don't get the view o

[GitHub] [incubator-hudi] tieke1121 commented on issue #1568: [SUPPORT]

2020-04-27 Thread GitBox
tieke1121 commented on issue #1568: URL: https://github.com/apache/incubator-hudi/issues/1568#issuecomment-619981921 spark structured streaming code : dataFrame.writeStream .format("org.apache.hudi") .option("path", conf.getString("hudi.basePath")) .option(

[GitHub] [incubator-hudi] tieke1121 opened a new issue #1568: [SUPPORT]

2020-04-27 Thread GitBox
tieke1121 opened a new issue #1568: URL: https://github.com/apache/incubator-hudi/issues/1568 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://cwiki.apache.org/confluence/display/HUDI/FAQ)? - Join the mailing list to engage in conversations and get

[GitHub] [incubator-hudi] EdwinGuo commented on a change in pull request #1526: [HUDI-1526] Add pyspark example in quickstart

2020-04-27 Thread GitBox
EdwinGuo commented on a change in pull request #1526: URL: https://github.com/apache/incubator-hudi/pull/1526#discussion_r415763475 ## File path: docs/_docs/1_1_quick_start_guide.md ## @@ -204,6 +213,262 @@ spark.sql("select uuid, partitionPath from hudi_trips_snapshot").count

[jira] [Updated] (HUDI-841) Abstract common meta sync module support multiple meta service

2020-04-27 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-841: --- Summary: Abstract common meta sync module support multiple meta service (was: abstract common meta sync module support

[jira] [Created] (HUDI-841) abstract common meta sync module support multiple meta service

2020-04-27 Thread liwei (Jira)
liwei created HUDI-841: -- Summary: abstract common meta sync module support multiple meta service Key: HUDI-841 URL: https://issues.apache.org/jira/browse/HUDI-841 Project: Apache Hudi (incubating) Issu

[GitHub] [incubator-hudi] Trevor-zhang commented on issue #143: Tracking ticket for folks to be added to slack group

2020-04-27 Thread GitBox
Trevor-zhang commented on issue #143: URL: https://github.com/apache/incubator-hudi/issues/143#issuecomment-619846548 Please add: 957029...@qq.com This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [incubator-hudi] hddong commented on pull request #1567: [HUDI-840]Clean blank file created by HoodieLogFormatWriter

2020-04-27 Thread GitBox
hddong commented on pull request #1567: URL: https://github.com/apache/incubator-hudi/pull/1567#issuecomment-619786382 @yanghua please have a review when free. This is an automated message from the Apache Git Service. To resp

[jira] [Updated] (HUDI-840) Clean blank file created by HoodieLogFormatWriter

2020-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-840: Labels: pull-request-available (was: ) > Clean blank file created by HoodieLogFormatWriter > ---

[GitHub] [incubator-hudi] hddong opened a new pull request #1567: [HUDI-840]Clean blank file created by HoodieLogFormatWriter

2020-04-27 Thread GitBox
hddong opened a new pull request #1567: URL: https://github.com/apache/incubator-hudi/pull/1567 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose o

[jira] [Updated] (HUDI-840) Clean blank file created by HoodieLogFormatWriter

2020-04-27 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-840: --- Description: When roll over is true,  HoodieLogFormatWriter will create next version log file. But it a

[jira] [Updated] (HUDI-840) Clean blank file created by HoodieLogFormatWriter

2020-04-27 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-840: --- Description: When roll over is true,  > Clean blank file created by HoodieLogFormatWriter > ---

[jira] [Created] (HUDI-840) Clean blank file created by HoodieLogFormatWriter

2020-04-27 Thread hong dongdong (Jira)
hong dongdong created HUDI-840: -- Summary: Clean blank file created by HoodieLogFormatWriter Key: HUDI-840 URL: https://issues.apache.org/jira/browse/HUDI-840 Project: Apache Hudi (incubating) Is