Liulietong commented on a change in pull request #2584:
URL: https://github.com/apache/hudi/pull/2584#discussion_r583434679
##
File path:
hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieLogFormatReader.java
##
@@ -104,7 +104,7 @@ public boolean hasNext() {
Liulietong commented on a change in pull request #2584:
URL: https://github.com/apache/hudi/pull/2584#discussion_r583434679
##
File path:
hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieLogFormatReader.java
##
@@ -104,7 +104,7 @@ public boolean hasNext() {
codecov-io edited a comment on pull request #2607:
URL: https://github.com/apache/hudi/pull/2607#issuecomment-786454326
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2607?src=pr&el=h1) Report
> Merging
[#2607](https://codecov.io/gh/apache/hudi/pull/2607?src=pr&el=desc) (ab93c26)
in
codecov-io commented on pull request #2607:
URL: https://github.com/apache/hudi/pull/2607#issuecomment-786454326
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2607?src=pr&el=h1) Report
> Merging
[#2607](https://codecov.io/gh/apache/hudi/pull/2607?src=pr&el=desc) (ab93c26)
into
[ma
t0il3ts0ap edited a comment on issue #2589:
URL: https://github.com/apache/hudi/issues/2589#issuecomment-786029402
@satishkotha Ran again on fresh table, still same issue.
SparkSubmit:
```
spark-submit
--master yarn
--packages
org.apache.spark:spark-avro_2.12:3.0.1,org
liujinhui1994 commented on pull request #2438:
URL: https://github.com/apache/hudi/pull/2438#issuecomment-786452099
I will add the unit test, and then please review
This is an automated message from the Apache Git Service.
To
[
https://issues.apache.org/jira/browse/HUDI-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1643:
-
Labels: pull-request-available (was: )
> [Hudi Observability] Framework for reporting stats from
yanghua commented on a change in pull request #2596:
URL: https://github.com/apache/hudi/pull/2596#discussion_r583407438
##
File path:
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java
##
@@ -258,4 +260,142 @@ public String getArchivelogFolder() {
nbalajee opened a new pull request #2607:
URL: https://github.com/apache/hudi/pull/2607
…tors
## What is the purpose of the pull request
Frame work for collecting Hudi Observability stats from the executors.
## Brief change log
- Using distributed registry, report sta
xushiyan commented on a change in pull request #2541:
URL: https://github.com/apache/hudi/pull/2541#discussion_r583403910
##
File path:
hudi-common/src/main/java/org/apache/hudi/common/util/DateTimeUtils.java
##
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundati
This is an automated email from the ASF dual-hosted git repository.
vinoth pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new c5d50f0 Travis CI build asf-site
c5d50f0 is d
Balajee Nagasubramaniam created HUDI-1643:
-
Summary: [Hudi Observability] Framework for reporting stats from
executors
Key: HUDI-1643
URL: https://issues.apache.org/jira/browse/HUDI-1643
Proje
This is an automated email from the ASF dual-hosted git repository.
vinoth pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 1dd7a41 [MINOR] Fixing slideshare link (#2606
vinothchandar merged pull request #2606:
URL: https://github.com/apache/hudi/pull/2606
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
xushiyan commented on a change in pull request #2541:
URL: https://github.com/apache/hudi/pull/2541#discussion_r583402182
##
File path:
hudi-common/src/main/java/org/apache/hudi/common/model/DefaultHoodieRecordPayload.java
##
@@ -37,6 +39,9 @@
*/
public class DefaultHoodieR
satishkotha commented on a change in pull request #2584:
URL: https://github.com/apache/hudi/pull/2584#discussion_r583398027
##
File path:
hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieLogFormatReader.java
##
@@ -104,7 +104,7 @@ public boolean hasNext() {
pengzhiwei2018 commented on a change in pull request #2596:
URL: https://github.com/apache/hudi/pull/2596#discussion_r583385132
##
File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/TableCommand.java
##
@@ -106,10 +106,13 @@ public String createTable(
throw n
n3nash commented on pull request #2606:
URL: https://github.com/apache/hudi/pull/2606#issuecomment-786408716
Verified locally that it works.
This is an automated message from the Apache Git Service.
To respond to the message,
n3nash opened a new pull request #2606:
URL: https://github.com/apache/hudi/pull/2606
Fixing broken link
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [
danny0405 commented on a change in pull request #2600:
URL: https://github.com/apache/hudi/pull/2600#discussion_r583369329
##
File path:
hudi-flink/src/main/java/org/apache/hudi/operator/partitioner/BucketAssignFunction.java
##
@@ -136,15 +137,10 @@ public void open(Configurat
hk-lrzy commented on a change in pull request #2600:
URL: https://github.com/apache/hudi/pull/2600#discussion_r583366344
##
File path:
hudi-flink/src/main/java/org/apache/hudi/operator/partitioner/BucketAssignFunction.java
##
@@ -136,15 +137,10 @@ public void open(Configuratio
hk-lrzy closed pull request #2604:
URL: https://github.com/apache/hudi/pull/2604
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
This is an automated email from the ASF dual-hosted git repository.
vinoth pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 1f101fe Travis CI build asf-site
1f101fe is d
codejoyan commented on issue #2592:
URL: https://github.com/apache/hudi/issues/2592#issuecomment-786379571
This is the spark version of the cluster being used at work so I will have
to use Spark 2.3 until there is an upgrade. Since the documentation says:
**Hudi works with Spark-2.x**, I w
This is an automated email from the ASF dual-hosted git repository.
lamberken pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new eeb146a [HUDI 1642] Adding Hudi Learning s
lamber-ken merged pull request #2602:
URL: https://github.com/apache/hudi/pull/2602
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
lamber-ken edited a comment on pull request #2602:
URL: https://github.com/apache/hudi/pull/2602#issuecomment-786378892
Thanks @n3nash 👍 LGTM
This is an automated message from the Apache Git Service.
To respond to the message
lamber-ken commented on pull request #2602:
URL: https://github.com/apache/hudi/pull/2602#issuecomment-786378892
Thanks @n3nash 👍
This is an automated message from the Apache Git Service.
To respond to the message, please lo
lamber-ken commented on a change in pull request #2602:
URL: https://github.com/apache/hudi/pull/2602#discussion_r583352619
##
File path: content/docs/0.5.3-powered_by.html
##
@@ -462,13 +462,17 @@ Talks &
Presentations
https://drive.google.com/open?id=1Pk_WdFxfEZxMMf
codecov-io edited a comment on pull request #2596:
URL: https://github.com/apache/hudi/pull/2596#issuecomment-784717451
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2596?src=pr&el=h1) Report
> Merging
[#2596](https://codecov.io/gh/apache/hudi/pull/2596?src=pr&el=desc) (c71fe74)
in
garyli1019 commented on issue #2498:
URL: https://github.com/apache/hudi/issues/2498#issuecomment-786364265
I am seeing the same problem when the compiled spark distribution is
different from the runtime spark distribution. Compile hudi jar against the
runtime spark distribution should fix
garyli1019 commented on pull request #2584:
URL: https://github.com/apache/hudi/pull/2584#issuecomment-786361769
hi @satishkotha , this PR seems related to #2583 , would you take a look?
This is an automated message from the
pengzhiwei2018 commented on a change in pull request #2596:
URL: https://github.com/apache/hudi/pull/2596#discussion_r583334728
##
File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/TableCommand.java
##
@@ -106,10 +106,13 @@ public String createTable(
throw n
yanghua commented on a change in pull request #2596:
URL: https://github.com/apache/hudi/pull/2596#discussion_r583313615
##
File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/TableCommand.java
##
@@ -106,10 +106,13 @@ public String createTable(
throw new Ille
n3nash merged pull request #2565:
URL: https://github.com/apache/hudi/pull/2565
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
This is an automated email from the ASF dual-hosted git repository.
nagarwal pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 022df0d [HUDI-1611] Added a configuration to al
This is an automated email from the ASF dual-hosted git repository.
nagarwal pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 9f5e8cc Fixing README for hudi test suite long
n3nash merged pull request #2578:
URL: https://github.com/apache/hudi/pull/2578
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
Nishith Agarwal created HUDI-1642:
-
Summary: Add Links to Uber engineering blog and meet up slides
Key: HUDI-1642
URL: https://issues.apache.org/jira/browse/HUDI-1642
Project: Apache Hudi
Iss
n3nash commented on a change in pull request #2602:
URL: https://github.com/apache/hudi/pull/2602#discussion_r583286829
##
File path: content/docs/0.5.3-powered_by.html
##
@@ -462,13 +462,17 @@ Talks &
Presentations
https://drive.google.com/open?id=1Pk_WdFxfEZxMMfAOn0
afeldman1 closed issue #2399:
URL: https://github.com/apache/hudi/issues/2399
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the sp
afeldman1 commented on issue #2399:
URL: https://github.com/apache/hudi/issues/2399#issuecomment-786204481
Apologies for the delayed response. And thank you to @bvaradar for the
initial hint. The issue turned out to be caused not by the keys but another one
of the configuration properties.
kpurella commented on issue #2240:
URL: https://github.com/apache/hudi/issues/2240#issuecomment-786183675
@vinothchandar Sure ,i will !!
This is an automated message from the Apache Git Service.
To respond to the message, ple
toninis commented on issue #2149:
URL: https://github.com/apache/hudi/issues/2149#issuecomment-786183618
@vinothchandar
Sorry I took so long to respond . It had worked and compiled successfully .
I probably had missed something at the time .
Thanks for your response at the time .
[
https://issues.apache.org/jira/browse/HUDI-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PRASHANT BHOSALE updated HUDI-1641:
---
Description:
I am trying to integrate Hudi with Kafka topic.
teps followed :
# Created Kafka
t0il3ts0ap edited a comment on issue #2589:
URL: https://github.com/apache/hudi/issues/2589#issuecomment-786029402
@satishkotha Ran again on fresh table, still same issue.
SparkSubmit:
```
spark-submit
--master yarn
--packages
org.apache.spark:spark-avro_2.12:3.0.1,org
t0il3ts0ap commented on issue #2589:
URL: https://github.com/apache/hudi/issues/2589#issuecomment-786029402
Ran again on fresh table, still same issue.
SparkSubmit:
```
spark-submit
--master yarn
--packages
org.apache.spark:spark-avro_2.12:3.0.1,org.apache.hudi:hudi-ut
[
https://issues.apache.org/jira/browse/HUDI-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan resolved HUDI-1269.
---
Fix Version/s: 0.8.0
Resolution: Fixed
> Make whether the failure of connect hi
This is an automated email from the ASF dual-hosted git repository.
sivabalan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 8c2197a [HUDI-1269] Make whether the failure o
[
https://issues.apache.org/jira/browse/HUDI-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-1269:
--
Status: Open (was: New)
> Make whether the failure of connect hive affects hudi ingest
[
https://issues.apache.org/jira/browse/HUDI-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-1269:
--
Status: In Progress (was: Open)
> Make whether the failure of connect hive affects hudi
nsivabalan merged pull request #2443:
URL: https://github.com/apache/hudi/pull/2443
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
Rap70r commented on issue #2586:
URL: https://github.com/apache/hudi/issues/2586#issuecomment-785941366
Hi nsivabalan,
Thank you for your reply.
* Incremental updates include both inserts and updates. Mostly updates.
* We can try increasing retention version to a higher valu
rubenssoto commented on issue #2588:
URL: https://github.com/apache/hudi/issues/2588#issuecomment-785933427
@bvaradar I think it is a hive issue, I'm trying to increase hive heap size,
I hope it helps.
I process the tables in threads, so I have almost 20 hive connections open.
bvaradar commented on issue #2448:
URL: https://github.com/apache/hudi/issues/2448#issuecomment-785932137
@root18039532923 : Please look at
https://hudi.apache.org/blog/async-compaction-deployment-model/ for running
async compactions
--
bvaradar commented on issue #2555:
URL: https://github.com/apache/hudi/issues/2555#issuecomment-785930358
For bulkinsert, you need to size the parallelism to control. Please see
https://cwiki.apache.org/confluence/display/HUDI/FAQ#FAQ-Whatperformance/ingestlatencycanIexpectforHudiwriting
bvaradar commented on issue #2588:
URL: https://github.com/apache/hudi/issues/2588#issuecomment-785928870
@rubenssoto : The stack-trace does not contain Hudi in it. So, I dont know
how to help in this regard. Regarding high cpu load on hive server, Are you
also running hive queries apart f
PRASHANT BHOSALE created HUDI-1641:
--
Summary: Issue for Integrating Hudi with Kafka using Avro Schema
Key: HUDI-1641
URL: https://issues.apache.org/jira/browse/HUDI-1641
Project: Apache Hudi
bvaradar commented on a change in pull request #2520:
URL: https://github.com/apache/hudi/pull/2520#discussion_r582853801
##
File path:
hudi-common/src/main/java/org/apache/hudi/common/bootstrap/index/DefaultBootstrapIndex.java
##
@@ -0,0 +1,82 @@
+/*
+ * Licensed to the Apach
bvaradar commented on issue #2605:
URL: https://github.com/apache/hudi/issues/2605#issuecomment-785906565
Ideally, spark data-source should provide that option (like
optionFromFile(...). Not sure if there is anything like that.
Created : https://issues.apache.org/jira/browse/HUDI-16
[
https://issues.apache.org/jira/browse/HUDI-1640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17290922#comment-17290922
]
Balaji Varadarajan commented on HUDI-1640:
--
[~shivnarayan]: Can you vet this and
Balaji Varadarajan created HUDI-1640:
Summary: Implement Spark Datasource option to read hudi configs
from properties file
Key: HUDI-1640
URL: https://issues.apache.org/jira/browse/HUDI-1640
Proje
bvaradar commented on issue #2592:
URL: https://github.com/apache/hudi/issues/2592#issuecomment-785896778
I was unable to setup spark-2.3.0 in my setup. But,with spark-2.4.4, this
works fine as below. Can you use spark-2.4.x version. spark-2.3 seems too old
though ?
`21/02/25 05:14
codecov-io edited a comment on pull request #2443:
URL: https://github.com/apache/hudi/pull/2443#issuecomment-760147630
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2443?src=pr&el=h1) Report
> Merging
[#2443](https://codecov.io/gh/apache/hudi/pull/2443?src=pr&el=desc) (7baf5de)
in
codecov-io edited a comment on pull request #2378:
URL: https://github.com/apache/hudi/pull/2378#issuecomment-751218636
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2378?src=pr&el=h1) Report
> Merging
[#2378](https://codecov.io/gh/apache/hudi/pull/2378?src=pr&el=desc) (ef2107f)
in
[
https://issues.apache.org/jira/browse/HUDI-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan resolved HUDI-1367.
---
Fix Version/s: 0.8.0
Resolution: Fixed
> Make delastreamer transition from dfsS
[
https://issues.apache.org/jira/browse/HUDI-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan reopened HUDI-1367:
---
> Make delastreamer transition from dfsSouce to kafkasouce
> -
[
https://issues.apache.org/jira/browse/HUDI-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-1367:
--
Status: Patch Available (was: In Progress)
> Make delastreamer transition from dfsSouce
[
https://issues.apache.org/jira/browse/HUDI-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-1367:
--
Status: Closed (was: Patch Available)
> Make delastreamer transition from dfsSouce to k
This is an automated email from the ASF dual-hosted git repository.
sivabalan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 617cc24 [HUDI-1367] Make deltaStreamer transit
nsivabalan merged pull request #2227:
URL: https://github.com/apache/hudi/pull/2227
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
codecov-io edited a comment on pull request #2519:
URL: https://github.com/apache/hudi/pull/2519#issuecomment-771782258
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2519?src=pr&el=h1) Report
> Merging
[#2519](https://codecov.io/gh/apache/hudi/pull/2519?src=pr&el=desc) (6f0fd84)
in
rakeshramakrishnan edited a comment on issue #2439:
URL: https://github.com/apache/hudi/issues/2439#issuecomment-785795722
@nsivabalan : There are no errors, however through hudi, the connection is
made to the local hive metastore (from spark). It doesn't connect to the
external hive metas
rakeshramakrishnan commented on issue #2439:
URL: https://github.com/apache/hudi/issues/2439#issuecomment-785795722
@nsivabalan : There are no errors, however through hudi, the connection is
made to the local hive metastore (from spark). It doesn't connect to the
external hive metastore.
Xoln commented on a change in pull request #2520:
URL: https://github.com/apache/hudi/pull/2520#discussion_r582717002
##
File path:
hudi-common/src/main/java/org/apache/hudi/common/bootstrap/index/DefaultBootstrapIndex.java
##
@@ -0,0 +1,61 @@
+package org.apache.hudi.common.b
codecov-io commented on pull request #2604:
URL: https://github.com/apache/hudi/pull/2604#issuecomment-785704660
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2604?src=pr&el=h1) Report
> Merging
[#2604](https://codecov.io/gh/apache/hudi/pull/2604?src=pr&el=desc) (fed6575)
into
[ma
76 matches
Mail list logo
