Hello, I use docker apache/nifi 1.13.2 and try to POST data to the Power BI
Real Time REST API.
To the best of my understanding I get the exception described in NIFI-4970,
org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import
data from buffer(okio.GzipSource@51243efb).inputStream() for
StandardFlowFileRecord
Refer to the attached file created with,
nifi_home/conf/logback.xml
<logger name="org.apache.nifi.processors.standard.InvokeHTTP" level="DEBUG"/>
Setting 'Put Response Body In Attribute' in InvokeHTTP throws the exception in
NIFI-4970.
Test case (reproduced 10/10):
GenerateFlowfile
'Custom Text'
[
{
"timestamp" :"2021-08-16T11:18:39.271Z",
"metric" :98.6,
"label" :"AAAAA555555"
}
]
'Mime Type'
application/json
InvokeHTTP
'HTTP Method'
POST
'Remote URL'
https://api.powerbi.com/beta/REMOVED/datasets/REMOVED/rows?key=REMOVED
'Proxy Configuration Service'
Proxy Type HTTP, Squid port 3128
Grateful for any advice on how to solve this!
2021-08-16 12:04:09,418 DEBUG [Timer-Driven Process Thread-3]
o.a.nifi.processors.standard.InvokeHTTP
InvokeHTTP[id=60902365-3aed-1ad5-7129-a7e782fa04be]
Request to remote service:
https://api.powerbi.com/beta/REMOVEDFROMLOG/datasets/REMOVEDFROMLOG/rows?key=REMOVEDFROMLOG
date: Mon, 16 Aug 2021 12:04:09 GMT
user-agent:
2021-08-16 12:04:09,654 DEBUG [Timer-Driven Process Thread-3]
o.a.nifi.processors.standard.InvokeHTTP
InvokeHTTP[id=60902365-3aed-1ad5-7129-a7e782fa04be]
Response from remote service:
https://api.powerbi.com/beta/REMOVEDFROMLOG/datasets/REMOVEDFROMLOG/rows?key=REMOVEDFROMLOG
access-control-expose-headers: RequestId
cache-control: no-store, must-revalidate, no-cache
content-type: application/octet-stream
date: Mon, 16 Aug 2021 12:04:09 GMT
home-cluster-uri:
https://wabi-europe-north-b-redirect.analysis.windows.net/
pragma: no-cache
request-redirected: true
requestid: 41911af7-23c8-433f-a944-a901bd31b8b7
strict-transport-security: max-age=31536000; includeSubDomains
x-content-type-options: nosniff
x-frame-options: deny
2021-08-16 12:04:09,655 ERROR [Timer-Driven Process Thread-3]
o.a.nifi.processors.standard.InvokeHTTP
InvokeHTTP[id=60902365-3aed-1ad5-7129-a7e782fa04be] Routing to Failure due to
exception: org.apache.nifi.processor.exception.FlowFileAccessException: Failed
to import data from buffer(okio.GzipSource@51243efb).inputStream() for
StandardFlowFileRecord[uuid=43a8aeba-7845-4e90-a955-c5e61b87f952,claim=,offset=0,name=d3853221-72e2-47a9-937e-c62f82fd3e45,size=0]
due to org.apache.nifi.processor.exception.FlowFileAccessException: Unable to
create ContentClaim due to java.io.EOFException:
org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import
data from buffer(okio.GzipSource@51243efb).inputStream() for
StandardFlowFileRecord[uuid=43a8aeba-7845-4e90-a955-c5e61b87f952,claim=,offset=0,name=d3853221-72e2-47a9-937e-c62f82fd3e45,size=0]
due to org.apache.nifi.processor.exception.FlowFileAccessException: Unable to
create ContentClaim due to java.io.EOFException
org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import
data from buffer(okio.GzipSource@51243efb).inputStream() for
StandardFlowFileRecord[uuid=43a8aeba-7845-4e90-a955-c5e61b87f952,claim=,offset=0,name=d3853221-72e2-47a9-937e-c62f82fd3e45,size=0]
due to org.apache.nifi.processor.exception.FlowFileAccessException: Unable to
create ContentClaim due to java.io.EOFException
at
org.apache.nifi.controller.repository.StandardProcessSession.importFrom(StandardProcessSession.java:3174)
at
org.apache.nifi.processors.standard.InvokeHTTP.onTrigger(InvokeHTTP.java:946)
at
org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
at
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1173)
at
org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:214)
at
org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)
at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.nifi.processor.exception.FlowFileAccessException: Unable
to create ContentClaim due to java.io.EOFException
at
org.apache.nifi.controller.repository.StandardProcessSession.importFrom(StandardProcessSession.java:3167)
... 13 common frames omitted
Caused by: java.io.EOFException: null
at okio.RealBufferedSource.require(RealBufferedSource.kt:199)
at okio.GzipSource.consumeHeader(GzipSource.kt:104)
at okio.GzipSource.read(GzipSource.kt:62)
at okio.RealBufferedSource$inputStream$1.read(RealBufferedSource.kt:158)
at java.io.InputStream.read(InputStream.java:101)
at
org.apache.nifi.controller.repository.io.TaskTerminationInputStream.read(TaskTerminationInputStream.java:62)
at org.apache.nifi.stream.io.StreamUtils.copy(StreamUtils.java:35)
at
org.apache.nifi.controller.repository.FileSystemRepository.importFrom(FileSystemRepository.java:776)
at
org.apache.nifi.controller.repository.StandardProcessSession.importFrom(StandardProcessSession.java:3164)
... 13 common frames omitted