[I] [SUPPORT] Datadog Metrics reporter fails with null pointer exception using hudi 0.14.0 [hudi]

[via GitHub]

hpalaniswamy opened a new issue, #11278:
URL: https://github.com/apache/hudi/issues/11278

   **Describe the problem you faced**
   I am trying to setup the datadog metrics reporter with an api key for some 
hudi spark jobs and getting the following issue when using `0.14.0` and spark 
`3.1.3`  on dataproc gke. I am following the documentation outlined here, 
https://hudi.apache.org/docs/metrics/#datadogmetricsreporter. 
   
   I am getting a NullPointerException where it is returning null for the name 
of the Datadog api site.
   
   **To Reproduce**
   
   Steps to reproduce the behavior:
   
   1. Use hudi 0.14.0
   2. Use Spark 3.1.3
   3. Setup hoodies metrics config like so
   ```                
   # metrics
   "hoodie.metrics.on": "true",
   "hoodie.metrics.reporter.type": "DATADOG",
   "hoodie.metrics.datadog.api.site": "US",
   "hoodie.metrics.datadog.api.key": dd_api_key, # from vault
   "hoodie.metrics.datadog.metric.prefix": f"tracker_validated_{self.env}",
   "hoodie.metrics.datadog.metric.host": "api.datadoghq",
   ```
   
   **Expected behavior**
   
   Custom metrics should be reported to datadog with the spark job not running 
into any issues. 
   
   **Environment Description**
   
   * Hudi version : 0.14.0
   
   * Spark version : 3.1.3
   
   * Storage (HDFS/S3/GCS..) : S3
   
   * Running on Docker? (yes/no) : no
   
   **Stacktrace**
   
   ```
   py4j.protocol.Py4JJavaError: An error occurred while calling o255.save.
   : org.apache.hudi.exception.HoodieRollbackException: Failed to rollback 
s3a://thescore-datalake-enriched-uat/enriched/tracker/tracker_validated/sports/button
 commits 20240522021059764
        at 
org.apache.hudi.client.BaseHoodieTableServiceClient.rollback(BaseHoodieTableServiceClient.java:827)
        at 
org.apache.hudi.client.BaseHoodieTableServiceClient.rollbackFailedWrites(BaseHoodieTableServiceClient.java:731)
        at 
org.apache.hudi.client.BaseHoodieTableServiceClient.rollbackFailedWrites(BaseHoodieTableServiceClient.java:715)
        at 
org.apache.hudi.client.BaseHoodieTableServiceClient.rollbackFailedWrites(BaseHoodieTableServiceClient.java:710)
        at 
org.apache.hudi.client.BaseHoodieWriteClient.lambda$startCommitWithTime$97cdbdca$1(BaseHoodieWriteClient.java:839)
        at 
org.apache.hudi.common.util.CleanerUtils.rollbackFailedWrites(CleanerUtils.java:156)
        at 
org.apache.hudi.client.BaseHoodieWriteClient.startCommitWithTime(BaseHoodieWriteClient.java:838)
   .
   .
   .
   .
   Caused by: java.lang.NullPointerException: Name is null
        at java.lang.Enum.valueOf(Enum.java:236)
        at 
org.apache.hudi.metrics.datadog.DatadogHttpClient$ApiSite.valueOf(DatadogHttpClient.java:120)
        at 
org.apache.hudi.config.HoodieWriteConfig.getDatadogApiSite(HoodieWriteConfig.java:2090)
        at 
org.apache.hudi.metrics.datadog.DatadogMetricsReporter.<init>(DatadogMetricsReporter.java:48)
        at 
org.apache.hudi.metrics.MetricsReporterFactory.createReporter(MetricsReporterFactory.java:78)
        at org.apache.hudi.metrics.Metrics.<init>(Metrics.java:58)
        at org.apache.hudi.metrics.Metrics.getInstance(Metrics.java:82)
        at org.apache.hudi.metrics.HoodieMetrics.<init>(HoodieMetrics.java:72)
        at 
org.apache.hudi.client.BaseHoodieClient.<init>(BaseHoodieClient.java:91)
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org