ijokarumawak commented on issue #3592: NIFI-6407 - added support for 
useAvroLogicalTypes in PutBigQueryBatch
URL: https://github.com/apache/nifi/pull/3592#issuecomment-515363298
 
 
   Hi @pvillard31 
   
   This is my first time to use BigQuery but I tried reviewing the improvement 
since I know a bit of Avro logical types. Confirmed that logical 'date' type 
fields can be created as a 'DATE' column if I enabled the new option.
   
![image](https://user-images.githubusercontent.com/1107620/61938331-cd5a9b80-afcb-11e9-9f2b-74acaed755f3.png)
   
   
   New table can be created, but following exception is thrown. I've done a 
full clean NiFi build but still getting the error. Is the processor work for 
you without this error??
   Before applying this PR, the processor worked just fine.
   
   ```
   2019-07-26 16:41:35,062 WARN [Timer-Driven Process Thread-7] 
o.a.n.controller.tasks.ConnectableTask Administratively Yielding 
PutBigQueryBatch[id=2cd6bdc2-016c-1000-5e60-003def848e75] due to uncaught 
Exception: java.lang.NoSuchMethodError: 
com.google.api.client.http.HttpRequest.setResponseReturnRawInputStream(Z)Lcom/google/api/client/http/HttpRequest;
   java.lang.NoSuchMethodError: 
com.google.api.client.http.HttpRequest.setResponseReturnRawInputStream(Z)Lcom/google/api/client/http/HttpRequest;
           at 
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.buildHttpRequest(AbstractGoogleClientRequest.java:442)
           at 
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:549)
           at 
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:482)
           at 
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:599)
           at 
com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.getJob(HttpBigQueryRpc.java:491)
           at 
com.google.cloud.bigquery.BigQueryImpl$30.call(BigQueryImpl.java:1081)
           at 
com.google.cloud.bigquery.BigQueryImpl$30.call(BigQueryImpl.java:1078)
           at 
com.google.api.gax.retrying.DirectRetryingExecutor.submit(DirectRetryingExecutor.java:105)
           at com.google.cloud.RetryHelper.run(RetryHelper.java:76)
           at com.google.cloud.RetryHelper.runWithRetries(RetryHelper.java:50)
           at 
com.google.cloud.bigquery.BigQueryImpl.getJob(BigQueryImpl.java:1077)
           at com.google.cloud.bigquery.Job$3.call(Job.java:351)
           at com.google.cloud.bigquery.Job$3.call(Job.java:348)
           at 
com.google.api.gax.retrying.DirectRetryingExecutor.submit(DirectRetryingExecutor.java:105)
           at com.google.cloud.RetryHelper.run(RetryHelper.java:76)
           at com.google.cloud.RetryHelper.poll(RetryHelper.java:64)
           at com.google.cloud.bigquery.Job.waitForJob(Job.java:347)
           at com.google.cloud.bigquery.Job.waitFor(Job.java:245)
           at 
org.apache.nifi.processors.gcp.bigquery.PutBigQueryBatch.onTrigger(PutBigQueryBatch.java:317)
           at 
org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
           at 
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1161)
           at 
org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:213)
           at 
org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)
           at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
           at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
           at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
           at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
           at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
           at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
           at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
           at java.lang.Thread.run(Thread.java:745)
   ```
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to