[ https://issues.apache.org/jira/browse/SPARK-32664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182942#comment-17182942 ]
Daniel Moore commented on SPARK-32664: -------------------------------------- PR open - [https://github.com/apache/spark/pull/29527] > Getting local shuffle block clutters the executor logs > ------------------------------------------------------ > > Key: SPARK-32664 > URL: https://issues.apache.org/jira/browse/SPARK-32664 > Project: Spark > Issue Type: Bug > Components: Shuffle > Affects Versions: 3.1.0 > Reporter: Chandni Singh > Priority: Trivial > > The below log statement in {{BlockManager.getLocalBlockData}} should be at > debug level > {code:java} > logInfo(s"Getting local shuffle block ${blockId}") > {code} > Currently, the executor logs get cluttered with this > {code:java} > 20/08/20 02:07:52 INFO storage.BlockManager: Getting local shuffle block > shuffle_0_6103_4964 > 20/08/20 02:07:52 INFO storage.BlockManager: Getting local shuffle block > shuffle_0_6132_4964 > 20/08/20 02:07:52 INFO storage.BlockManager: Getting local shuffle block > shuffle_0_6137_4964 > 20/08/20 02:07:52 INFO storage.BlockManager: Getting local shuffle block > shuffle_0_6312_4964 > 20/08/20 02:07:52 INFO storage.BlockManager: Getting local shuffle block > shuffle_0_6323_4964 > 20/08/20 02:07:52 INFO storage.BlockManager: Getting local shuffle block > shuffle_0_6402_4964 > 20/08/20 02:07:52 INFO storage.BlockManager: Getting local shuffle block > shuffle_0_6413_4964 > 20/08/20 02:07:52 INFO storage.BlockManager: Getting local shuffle block > shuffle_0_6694_4964 > 20/08/20 02:07:52 INFO storage.BlockManager: Getting local shuffle block > shuffle_0_6709_4964 > 20/08/20 02:07:52 INFO storage.BlockManager: Getting local shuffle block > shuffle_0_6753_4964 > 20/08/20 02:07:52 INFO storage.BlockManager: Getting local shuffle block > shuffle_0_6822_4964 > 20/08/20 02:07:52 INFO storage.BlockManager: Getting local shuffle block > shuffle_0_6894_4964 > 20/08/20 02:07:52 INFO storage.BlockManager: Getting local shuffle block > shuffle_0_6913_4964 > 20/08/20 02:07:52 INFO storage.BlockManager: Getting local shuffle block > shuffle_0_7052_4964 > 20/08/20 02:07:52 INFO storage.BlockManager: Getting local shuffle block > shuffle_0_7073_4964 > 20/08/20 02:07:52 INFO storage.BlockManager: Getting local shuffle block > shuffle_0_7167_4964 > 20/08/20 02:07:52 INFO storage.BlockManager: Getting local shuffle block > shuffle_0_7194_4964 > {code} > This was added with SPARK-20629. > cc. [~holden] -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org