[ https://issues.apache.org/jira/browse/SPARK-24136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16459844#comment-16459844 ]
Apache Spark commented on SPARK-24136: -------------------------------------- User 'arunmahadevan' has created a pull request for this issue: https://github.com/apache/spark/pull/21207 > MemoryStreamDataReader.next should skip sleeping if record is available > ----------------------------------------------------------------------- > > Key: SPARK-24136 > URL: https://issues.apache.org/jira/browse/SPARK-24136 > Project: Spark > Issue Type: Improvement > Components: Structured Streaming > Affects Versions: 2.4.0 > Reporter: Arun Mahadevan > Priority: Minor > > Currently the code sleeps 10ms for each invocation of the next even if the > record is available. > {code:java} > override def next(): Boolean = { > current = None > while (current.isEmpty) { > Thread.sleep(10) > current = endpoint.askSync[Option[Row]]( > GetRecord(ContinuousMemoryStreamPartitionOffset(partition, currentOffset))) > }{code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org