subject:"\[jira\] \[Comment Edited\] \(SPARK\-47578\) Spark core\: Migrate logWarn with variables to structured logging framework"

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-30 Thread Daniel (Jira)



[ 
https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552
 ] 

Daniel edited comment on SPARK-47578 at 4/30/24 7:11 PM:
-

Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
(X) deploy/client/StandaloneAppClient.scala
(X) deploy/history/ApplicationCache.scala
(X) deploy/history/EventLogFileCompactor.scala
(X) deploy/history/EventLogFileWriters.scala
(X) deploy/history/FsHistoryProvider.scala
(X) deploy/history/HistoryServerDiskManager.scala
(X) deploy/master/FileSystemPersistenceEngine.scala
(X) deploy/master/Master.scala
(X) deploy/master/MasterArguments.scala
(X) deploy/master/ZooKeeperPersistenceEngine.scala
(X) deploy/rest/RestSubmissionClient.scala
(X) deploy/security/HBaseDelegationTokenProvider.scala
(X) deploy/security/HadoopDelegationTokenManager.scala
(X) deploy/security/HadoopFSDelegationTokenProvider.scala
(X) deploy/worker/DriverRunner.scala
(X) deploy/worker/ExecutorRunner.scala
(X) deploy/worker/Worker.scala
(X) deploy/worker/WorkerWatcher.scala
(X) executor/CoarseGrainedExecutorBackend.scala
(X) executor/Executor.scala
(X) executor/ProcfsMetricsGetter.scala
(X) internal/io/HadoopMapReduceCommitProtocol.scala
(X) internal/io/SparkHadoopWriter.scala
(X) internal/plugin/PluginContextImpl.scala
(X) internal/plugin/PluginEndpoint.scala
(X) memory/ExecutionMemoryPool.scala
(X) memory/StorageMemoryPool.scala
(X) metrics/ExecutorMetricType.scala
(X) metrics/MetricsSystem.scala
(X) metrics/sink/StatsdReporter.scala
(X) network/netty/NettyBlockRpcServer.scala
(X) rdd/HadoopRDD.scala
(X) rdd/JdbcRDD.scala
(X) rdd/NewHadoopRDD.scala
(X) rdd/PairRDDFunctions.scala
(X) rdd/RDD.scala
(X) rdd/RDDOperationScope.scala
(X) rdd/ReliableCheckpointRDD.scala
(X) resource/ResourceProfile.scala
(X) resource/ResourceProfileManager.scala
(X) resource/ResourceUtils.scala
(X) rpc/netty/Dispatcher.scala
(X) rpc/netty/Inbox.scala
(X) rpc/netty/NettyRpcEnv.scala
(X) rpc/netty/Outbox.scala
(X) scheduler/AsyncEventQueue.scala
(X) scheduler/DAGScheduler.scala
(X) scheduler/HealthTracker.scala
(X) scheduler/JobWaiter.scala
(X) scheduler/ReplayListenerBus.scala
(X) scheduler/SchedulableBuilder.scala
(X) scheduler/TaskSchedulerImpl.scala
(X) scheduler/TaskSetManager.scala
(X) scheduler/cluster/CoarseGrainedSchedulerBackend.scala
(X) scheduler/cluster/StandaloneSchedulerBackend.scala
(X) security/CryptoStreamUtils.scala
(X) serializer/SerializationDebugger.scala
(X) shuffle/IndexShuffleBlockResolver.scala
(X) shuffle/ShuffleBlockPusher.scala
(X) shuffle/sort/SortShuffleManager.scala
(X) status/KVUtils.scala
(X) storage/BlockManager.scala
(X) storage/BlockManagerDecommissioner.scala
(X) storage/BlockManagerMaster.scala
(X) storage/BlockManagerMasterEndpoint.scala
(X) storage/BlockReplicationPolicy.scala
storage/DiskBlockManager.scala
storage/DiskBlockObjectWriter.scala
storage/DiskStore.scala
storage/FallbackStorage.scala
storage/PushBasedFetchHelper.scala
storage/ShuffleBlockFetcherIterator.scala
storage/TopologyMapper.scala
storage/memory/MemoryStore.scala
ui/JettyUtils.scala
ui/scope/RDDOperationGraph.scala
util/AccumulatorV2.scala
util/DependencyUtils.scala
util/HadoopFSUtils.scala
util/PeriodicCheckpointer.scala
util/SignalUtils.scala
util/SizeEstimator.scala
util/Utils.scala
util/collection/ExternalAppendOnlyMap.scala
util/logging/DriverLogger.scala
util/logging/FileAppender.scala
util/logging/RollingFileAppender.scala
util/logging/RollingPolicy.scala
util/random/StratifiedSamplingUtils.scala

 


was (Author: JIRAUSER285772):
Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X)

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-30 Thread Daniel (Jira)



[ 
https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552
 ] 

Daniel edited comment on SPARK-47578 at 4/30/24 6:57 PM:
-

Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
(X) deploy/client/StandaloneAppClient.scala
(X) deploy/history/ApplicationCache.scala
(X) deploy/history/EventLogFileCompactor.scala
(X) deploy/history/EventLogFileWriters.scala
(X) deploy/history/FsHistoryProvider.scala
(X) deploy/history/HistoryServerDiskManager.scala
(X) deploy/master/FileSystemPersistenceEngine.scala
(X) deploy/master/Master.scala
(X) deploy/master/MasterArguments.scala
(X) deploy/master/ZooKeeperPersistenceEngine.scala
(X) deploy/rest/RestSubmissionClient.scala
(X) deploy/security/HBaseDelegationTokenProvider.scala
(X) deploy/security/HadoopDelegationTokenManager.scala
(X) deploy/security/HadoopFSDelegationTokenProvider.scala
(X) deploy/worker/DriverRunner.scala
(X) deploy/worker/ExecutorRunner.scala
(X) deploy/worker/Worker.scala
(X) deploy/worker/WorkerWatcher.scala
(X) executor/CoarseGrainedExecutorBackend.scala
(X) executor/Executor.scala
(X) executor/ProcfsMetricsGetter.scala
(X) internal/io/HadoopMapReduceCommitProtocol.scala
(X) internal/io/SparkHadoopWriter.scala
(X) internal/plugin/PluginContextImpl.scala
(X) internal/plugin/PluginEndpoint.scala
(X) memory/ExecutionMemoryPool.scala
(X) memory/StorageMemoryPool.scala
(X) metrics/ExecutorMetricType.scala
(X) metrics/MetricsSystem.scala
(X) metrics/sink/StatsdReporter.scala
(X) network/netty/NettyBlockRpcServer.scala
(X) rdd/HadoopRDD.scala
(X) rdd/JdbcRDD.scala
(X) rdd/NewHadoopRDD.scala
(X) rdd/PairRDDFunctions.scala
(X) rdd/RDD.scala
(X) rdd/RDDOperationScope.scala
(X) rdd/ReliableCheckpointRDD.scala
(X) resource/ResourceProfile.scala
(X) resource/ResourceProfileManager.scala
(X) resource/ResourceUtils.scala
(X) rpc/netty/Dispatcher.scala
(X) rpc/netty/Inbox.scala
(X) rpc/netty/NettyRpcEnv.scala
(X) rpc/netty/Outbox.scala
(X) scheduler/AsyncEventQueue.scala
(X) scheduler/DAGScheduler.scala
(X) scheduler/HealthTracker.scala
(X) scheduler/JobWaiter.scala
(X) scheduler/ReplayListenerBus.scala
(X) scheduler/SchedulableBuilder.scala
(X) scheduler/TaskSchedulerImpl.scala
(X) scheduler/TaskSetManager.scala
(X) scheduler/cluster/CoarseGrainedSchedulerBackend.scala
(X) scheduler/cluster/StandaloneSchedulerBackend.scala
(X) security/CryptoStreamUtils.scala
(X) serializer/SerializationDebugger.scala
(X) shuffle/IndexShuffleBlockResolver.scala
(X) shuffle/ShuffleBlockPusher.scala
(X) shuffle/sort/SortShuffleManager.scala
(X) status/KVUtils.scala
(X) storage/BlockManager.scala
storage/BlockManagerDecommissioner.scala
storage/BlockManagerMaster.scala
storage/BlockManagerMasterEndpoint.scala
storage/BlockReplicationPolicy.scala
storage/DiskBlockManager.scala
storage/DiskBlockObjectWriter.scala
storage/DiskStore.scala
storage/FallbackStorage.scala
storage/PushBasedFetchHelper.scala
storage/ShuffleBlockFetcherIterator.scala
storage/TopologyMapper.scala
storage/memory/MemoryStore.scala
ui/JettyUtils.scala
ui/scope/RDDOperationGraph.scala
util/AccumulatorV2.scala
util/DependencyUtils.scala
util/HadoopFSUtils.scala
util/PeriodicCheckpointer.scala
util/SignalUtils.scala
util/SizeEstimator.scala
util/Utils.scala
util/collection/ExternalAppendOnlyMap.scala
util/logging/DriverLogger.scala
util/logging/FileAppender.scala
util/logging/RollingFileAppender.scala
util/logging/RollingPolicy.scala
util/random/StratifiedSamplingUtils.scala

 


was (Author: JIRAUSER285772):
Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X)

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-30 Thread Daniel (Jira)



[ 
https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552
 ] 

Daniel edited comment on SPARK-47578 at 4/30/24 6:43 PM:
-

Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
(X) deploy/client/StandaloneAppClient.scala
(X) deploy/history/ApplicationCache.scala
(X) deploy/history/EventLogFileCompactor.scala
(X) deploy/history/EventLogFileWriters.scala
(X) deploy/history/FsHistoryProvider.scala
(X) deploy/history/HistoryServerDiskManager.scala
(X) deploy/master/FileSystemPersistenceEngine.scala
(X) deploy/master/Master.scala
(X) deploy/master/MasterArguments.scala
(X) deploy/master/ZooKeeperPersistenceEngine.scala
(X) deploy/rest/RestSubmissionClient.scala
(X) deploy/security/HBaseDelegationTokenProvider.scala
(X) deploy/security/HadoopDelegationTokenManager.scala
(X) deploy/security/HadoopFSDelegationTokenProvider.scala
(X) deploy/worker/DriverRunner.scala
(X) deploy/worker/ExecutorRunner.scala
(X) deploy/worker/Worker.scala
(X) deploy/worker/WorkerWatcher.scala
(X) executor/CoarseGrainedExecutorBackend.scala
(X) executor/Executor.scala
(X) executor/ProcfsMetricsGetter.scala
(X) internal/io/HadoopMapReduceCommitProtocol.scala
(X) internal/io/SparkHadoopWriter.scala
(X) internal/plugin/PluginContextImpl.scala
(X) internal/plugin/PluginEndpoint.scala
(X) memory/ExecutionMemoryPool.scala
(X) memory/StorageMemoryPool.scala
(X) metrics/ExecutorMetricType.scala
(X) metrics/MetricsSystem.scala
(X) metrics/sink/StatsdReporter.scala
(X) network/netty/NettyBlockRpcServer.scala
(X) rdd/HadoopRDD.scala
(X) rdd/JdbcRDD.scala
(X) rdd/NewHadoopRDD.scala
(X) rdd/PairRDDFunctions.scala
(X) rdd/RDD.scala
(X) rdd/RDDOperationScope.scala
(X) rdd/ReliableCheckpointRDD.scala
(X) resource/ResourceProfile.scala
(X) resource/ResourceProfileManager.scala
(X) resource/ResourceUtils.scala
(X) rpc/netty/Dispatcher.scala
(X) rpc/netty/Inbox.scala
(X) rpc/netty/NettyRpcEnv.scala
(X) rpc/netty/Outbox.scala
(X) scheduler/AsyncEventQueue.scala
(X) scheduler/DAGScheduler.scala
(X) scheduler/HealthTracker.scala
(X) scheduler/JobWaiter.scala
(X) scheduler/ReplayListenerBus.scala
(X) scheduler/SchedulableBuilder.scala
(X) scheduler/TaskSchedulerImpl.scala
(X) scheduler/TaskSetManager.scala
(X) scheduler/cluster/CoarseGrainedSchedulerBackend.scala
(X) scheduler/cluster/StandaloneSchedulerBackend.scala
security/CryptoStreamUtils.scala
serializer/SerializationDebugger.scala
shuffle/IndexShuffleBlockResolver.scala
shuffle/ShuffleBlockPusher.scala
shuffle/sort/SortShuffleManager.scala
status/KVUtils.scala
storage/BlockManager.scala
storage/BlockManagerDecommissioner.scala
storage/BlockManagerMaster.scala
storage/BlockManagerMasterEndpoint.scala
storage/BlockReplicationPolicy.scala
storage/DiskBlockManager.scala
storage/DiskBlockObjectWriter.scala
storage/DiskStore.scala
storage/FallbackStorage.scala
storage/PushBasedFetchHelper.scala
storage/ShuffleBlockFetcherIterator.scala
storage/TopologyMapper.scala
storage/memory/MemoryStore.scala
ui/JettyUtils.scala
ui/scope/RDDOperationGraph.scala
util/AccumulatorV2.scala
util/DependencyUtils.scala
util/HadoopFSUtils.scala
util/PeriodicCheckpointer.scala
util/SignalUtils.scala
util/SizeEstimator.scala
util/Utils.scala
util/collection/ExternalAppendOnlyMap.scala
util/logging/DriverLogger.scala
util/logging/FileAppender.scala
util/logging/RollingFileAppender.scala
util/logging/RollingPolicy.scala
util/random/StratifiedSamplingUtils.scala

 


was (Author: JIRAUSER285772):
Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X)

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-30 Thread Daniel (Jira)



[ 
https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552
 ] 

Daniel edited comment on SPARK-47578 at 4/30/24 5:55 PM:
-

Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
(X) deploy/client/StandaloneAppClient.scala
(X) deploy/history/ApplicationCache.scala
(X) deploy/history/EventLogFileCompactor.scala
(X) deploy/history/EventLogFileWriters.scala
(X) deploy/history/FsHistoryProvider.scala
(X) deploy/history/HistoryServerDiskManager.scala
(X) deploy/master/FileSystemPersistenceEngine.scala
(X) deploy/master/Master.scala
(X) deploy/master/MasterArguments.scala
(X) deploy/master/ZooKeeperPersistenceEngine.scala
(X) deploy/rest/RestSubmissionClient.scala
(X) deploy/security/HBaseDelegationTokenProvider.scala
(X) deploy/security/HadoopDelegationTokenManager.scala
(X) deploy/security/HadoopFSDelegationTokenProvider.scala
(X) deploy/worker/DriverRunner.scala
(X) deploy/worker/ExecutorRunner.scala
(X) deploy/worker/Worker.scala
(X) deploy/worker/WorkerWatcher.scala
(X) executor/CoarseGrainedExecutorBackend.scala
(X) executor/Executor.scala
(X) executor/ProcfsMetricsGetter.scala
(X) internal/io/HadoopMapReduceCommitProtocol.scala
(X) internal/io/SparkHadoopWriter.scala
(X) internal/plugin/PluginContextImpl.scala
(X) internal/plugin/PluginEndpoint.scala
(X) memory/ExecutionMemoryPool.scala
(X) memory/StorageMemoryPool.scala
(X) metrics/ExecutorMetricType.scala
(X) metrics/MetricsSystem.scala
(X) metrics/sink/StatsdReporter.scala
(X) network/netty/NettyBlockRpcServer.scala
(X) rdd/HadoopRDD.scala
(X) rdd/JdbcRDD.scala
(X) rdd/NewHadoopRDD.scala
(X) rdd/PairRDDFunctions.scala
(X) rdd/RDD.scala
(X) rdd/RDDOperationScope.scala
(X) rdd/ReliableCheckpointRDD.scala
(X) resource/ResourceProfile.scala
(X) resource/ResourceProfileManager.scala
(X) resource/ResourceUtils.scala
(X) rpc/netty/Dispatcher.scala
(X) rpc/netty/Inbox.scala
(X) rpc/netty/NettyRpcEnv.scala
(X) rpc/netty/Outbox.scala
(X) scheduler/AsyncEventQueue.scala
(X) scheduler/DAGScheduler.scala
(X) scheduler/HealthTracker.scala
(X) scheduler/JobWaiter.scala
(X) scheduler/ReplayListenerBus.scala
scheduler/SchedulableBuilder.scala
scheduler/TaskSchedulerImpl.scala
scheduler/TaskSetManager.scala
scheduler/cluster/CoarseGrainedSchedulerBackend.scala
scheduler/cluster/StandaloneSchedulerBackend.scala
security/CryptoStreamUtils.scala
serializer/SerializationDebugger.scala
shuffle/IndexShuffleBlockResolver.scala
shuffle/ShuffleBlockPusher.scala
shuffle/sort/SortShuffleManager.scala
status/KVUtils.scala
storage/BlockManager.scala
storage/BlockManagerDecommissioner.scala
storage/BlockManagerMaster.scala
storage/BlockManagerMasterEndpoint.scala
storage/BlockReplicationPolicy.scala
storage/DiskBlockManager.scala
storage/DiskBlockObjectWriter.scala
storage/DiskStore.scala
storage/FallbackStorage.scala
storage/PushBasedFetchHelper.scala
storage/ShuffleBlockFetcherIterator.scala
storage/TopologyMapper.scala
storage/memory/MemoryStore.scala
ui/JettyUtils.scala
ui/scope/RDDOperationGraph.scala
util/AccumulatorV2.scala
util/DependencyUtils.scala
util/HadoopFSUtils.scala
util/PeriodicCheckpointer.scala
util/SignalUtils.scala
util/SizeEstimator.scala
util/Utils.scala
util/collection/ExternalAppendOnlyMap.scala
util/logging/DriverLogger.scala
util/logging/FileAppender.scala
util/logging/RollingFileAppender.scala
util/logging/RollingPolicy.scala
util/random/StratifiedSamplingUtils.scala

 


was (Author: JIRAUSER285772):
Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)



[ 
https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552
 ] 

Daniel edited comment on SPARK-47578 at 4/29/24 11:11 PM:
--

Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
(X) deploy/client/StandaloneAppClient.scala
(X) deploy/history/ApplicationCache.scala
(X) deploy/history/EventLogFileCompactor.scala
(X) deploy/history/EventLogFileWriters.scala
(X) deploy/history/FsHistoryProvider.scala
(X) deploy/history/HistoryServerDiskManager.scala
(X) deploy/master/FileSystemPersistenceEngine.scala
(X) deploy/master/Master.scala
(X) deploy/master/MasterArguments.scala
(X) deploy/master/ZooKeeperPersistenceEngine.scala
(X) deploy/rest/RestSubmissionClient.scala
(X) deploy/security/HBaseDelegationTokenProvider.scala
(X) deploy/security/HadoopDelegationTokenManager.scala
(X) deploy/security/HadoopFSDelegationTokenProvider.scala
(X) deploy/worker/DriverRunner.scala
(X) deploy/worker/ExecutorRunner.scala
(X) deploy/worker/Worker.scala
(X) deploy/worker/WorkerWatcher.scala
(X) executor/CoarseGrainedExecutorBackend.scala
(X) executor/Executor.scala
(X) executor/ProcfsMetricsGetter.scala
(X) internal/io/HadoopMapReduceCommitProtocol.scala
(X) internal/io/SparkHadoopWriter.scala
(X) internal/plugin/PluginContextImpl.scala
(X) internal/plugin/PluginEndpoint.scala
(X) memory/ExecutionMemoryPool.scala
(X) memory/StorageMemoryPool.scala
(X) metrics/ExecutorMetricType.scala
(X) metrics/MetricsSystem.scala
(X) metrics/sink/StatsdReporter.scala
(X) network/netty/NettyBlockRpcServer.scala
(X) rdd/HadoopRDD.scala
(X) rdd/JdbcRDD.scala
(X) rdd/NewHadoopRDD.scala
(X) rdd/PairRDDFunctions.scala
(X) rdd/RDD.scala
(X) rdd/RDDOperationScope.scala
(X) rdd/ReliableCheckpointRDD.scala
(X) resource/ResourceProfile.scala
(X) resource/ResourceProfileManager.scala
(X) resource/ResourceUtils.scala
rpc/netty/Dispatcher.scala
rpc/netty/Inbox.scala
rpc/netty/NettyRpcEnv.scala
rpc/netty/Outbox.scala
scheduler/AsyncEventQueue.scala
scheduler/DAGScheduler.scala
scheduler/HealthTracker.scala
scheduler/JobWaiter.scala
scheduler/ReplayListenerBus.scala
scheduler/SchedulableBuilder.scala
scheduler/TaskSchedulerImpl.scala
scheduler/TaskSetManager.scala
scheduler/cluster/CoarseGrainedSchedulerBackend.scala
scheduler/cluster/StandaloneSchedulerBackend.scala
security/CryptoStreamUtils.scala
serializer/SerializationDebugger.scala
shuffle/IndexShuffleBlockResolver.scala
shuffle/ShuffleBlockPusher.scala
shuffle/sort/SortShuffleManager.scala
status/KVUtils.scala
storage/BlockManager.scala
storage/BlockManagerDecommissioner.scala
storage/BlockManagerMaster.scala
storage/BlockManagerMasterEndpoint.scala
storage/BlockReplicationPolicy.scala
storage/DiskBlockManager.scala
storage/DiskBlockObjectWriter.scala
storage/DiskStore.scala
storage/FallbackStorage.scala
storage/PushBasedFetchHelper.scala
storage/ShuffleBlockFetcherIterator.scala
storage/TopologyMapper.scala
storage/memory/MemoryStore.scala
ui/JettyUtils.scala
ui/scope/RDDOperationGraph.scala
util/AccumulatorV2.scala
util/DependencyUtils.scala
util/HadoopFSUtils.scala
util/PeriodicCheckpointer.scala
util/SignalUtils.scala
util/SizeEstimator.scala
util/Utils.scala
util/collection/ExternalAppendOnlyMap.scala
util/logging/DriverLogger.scala
util/logging/FileAppender.scala
util/logging/RollingFileAppender.scala
util/logging/RollingPolicy.scala
util/random/StratifiedSamplingUtils.scala

 


was (Author: JIRAUSER285772):
Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X)

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)



[ 
https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552
 ] 

Daniel edited comment on SPARK-47578 at 4/29/24 10:21 PM:
--

Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
(X) deploy/client/StandaloneAppClient.scala
(X) deploy/history/ApplicationCache.scala
(X) deploy/history/EventLogFileCompactor.scala
(X) deploy/history/EventLogFileWriters.scala
(X) deploy/history/FsHistoryProvider.scala
(X) deploy/history/HistoryServerDiskManager.scala
(X) deploy/master/FileSystemPersistenceEngine.scala
(X) deploy/master/Master.scala
(X) deploy/master/MasterArguments.scala
(X) deploy/master/ZooKeeperPersistenceEngine.scala
(X) deploy/rest/RestSubmissionClient.scala
(X) deploy/security/HBaseDelegationTokenProvider.scala
(X) deploy/security/HadoopDelegationTokenManager.scala
(X) deploy/security/HadoopFSDelegationTokenProvider.scala
(X) deploy/worker/DriverRunner.scala
(X) deploy/worker/ExecutorRunner.scala
(X) deploy/worker/Worker.scala
(X) deploy/worker/WorkerWatcher.scala
(X) executor/CoarseGrainedExecutorBackend.scala
(X) executor/Executor.scala
(X) executor/ProcfsMetricsGetter.scala
(X) internal/io/HadoopMapReduceCommitProtocol.scala
(X) internal/io/SparkHadoopWriter.scala
(X) internal/plugin/PluginContextImpl.scala
(X) internal/plugin/PluginEndpoint.scala
(X) memory/ExecutionMemoryPool.scala
(X) memory/StorageMemoryPool.scala
(X) metrics/ExecutorMetricType.scala
(X) metrics/MetricsSystem.scala
(X) metrics/sink/StatsdReporter.scala
(X) network/netty/NettyBlockRpcServer.scala
(X) rdd/HadoopRDD.scala
(X) rdd/JdbcRDD.scala
(X) rdd/NewHadoopRDD.scala
rdd/PairRDDFunctions.scala
rdd/RDD.scala
rdd/RDDOperationScope.scala
rdd/ReliableCheckpointRDD.scala
resource/ResourceProfile.scala
resource/ResourceProfileManager.scala
resource/ResourceUtils.scala
rpc/netty/Dispatcher.scala
rpc/netty/Inbox.scala
rpc/netty/NettyRpcEnv.scala
rpc/netty/Outbox.scala
scheduler/AsyncEventQueue.scala
scheduler/DAGScheduler.scala
scheduler/HealthTracker.scala
scheduler/JobWaiter.scala
scheduler/ReplayListenerBus.scala
scheduler/SchedulableBuilder.scala
scheduler/TaskSchedulerImpl.scala
scheduler/TaskSetManager.scala
scheduler/cluster/CoarseGrainedSchedulerBackend.scala
scheduler/cluster/StandaloneSchedulerBackend.scala
security/CryptoStreamUtils.scala
serializer/SerializationDebugger.scala
shuffle/IndexShuffleBlockResolver.scala
shuffle/ShuffleBlockPusher.scala
shuffle/sort/SortShuffleManager.scala
status/KVUtils.scala
storage/BlockManager.scala
storage/BlockManagerDecommissioner.scala
storage/BlockManagerMaster.scala
storage/BlockManagerMasterEndpoint.scala
storage/BlockReplicationPolicy.scala
storage/DiskBlockManager.scala
storage/DiskBlockObjectWriter.scala
storage/DiskStore.scala
storage/FallbackStorage.scala
storage/PushBasedFetchHelper.scala
storage/ShuffleBlockFetcherIterator.scala
storage/TopologyMapper.scala
storage/memory/MemoryStore.scala
ui/JettyUtils.scala
ui/scope/RDDOperationGraph.scala
util/AccumulatorV2.scala
util/DependencyUtils.scala
util/HadoopFSUtils.scala
util/PeriodicCheckpointer.scala
util/SignalUtils.scala
util/SizeEstimator.scala
util/Utils.scala
util/collection/ExternalAppendOnlyMap.scala
util/logging/DriverLogger.scala
util/logging/FileAppender.scala
util/logging/RollingFileAppender.scala
util/logging/RollingPolicy.scala
util/random/StratifiedSamplingUtils.scala

 


was (Author: JIRAUSER285772):
Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X)

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)



[ 
https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552
 ] 

Daniel edited comment on SPARK-47578 at 4/29/24 10:19 PM:
--

Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
(X) deploy/client/StandaloneAppClient.scala
(X) deploy/history/ApplicationCache.scala
(X) deploy/history/EventLogFileCompactor.scala
(X) deploy/history/EventLogFileWriters.scala
(X) deploy/history/FsHistoryProvider.scala
(X) deploy/history/HistoryServerDiskManager.scala
(X) deploy/master/FileSystemPersistenceEngine.scala
(X) deploy/master/Master.scala
(X) deploy/master/MasterArguments.scala
(X) deploy/master/ZooKeeperPersistenceEngine.scala
(X) deploy/rest/RestSubmissionClient.scala
(X) deploy/security/HBaseDelegationTokenProvider.scala
(X) deploy/security/HadoopDelegationTokenManager.scala
(X) deploy/security/HadoopFSDelegationTokenProvider.scala
(X) deploy/worker/DriverRunner.scala
(X) deploy/worker/ExecutorRunner.scala
(X) deploy/worker/Worker.scala
(X) deploy/worker/WorkerWatcher.scala
(X) executor/CoarseGrainedExecutorBackend.scala
(X) executor/Executor.scala
(X) executor/ProcfsMetricsGetter.scala
(X) internal/io/HadoopMapReduceCommitProtocol.scala
(X) internal/io/SparkHadoopWriter.scala
(X) internal/plugin/PluginContextImpl.scala
(X) internal/plugin/PluginEndpoint.scala
(X) memory/ExecutionMemoryPool.scala
(X) memory/StorageMemoryPool.scala
(X) metrics/ExecutorMetricType.scala
(X) metrics/MetricsSystem.scala
(X) metrics/sink/StatsdReporter.scala
(X) network/netty/NettyBlockRpcServer.scala
(X) rdd/HadoopRDD.scala
rdd/JdbcRDD.scala
rdd/NewHadoopRDD.scala
rdd/PairRDDFunctions.scala
rdd/RDD.scala
rdd/RDDOperationScope.scala
rdd/ReliableCheckpointRDD.scala
resource/ResourceProfile.scala
resource/ResourceProfileManager.scala
resource/ResourceUtils.scala
rpc/netty/Dispatcher.scala
rpc/netty/Inbox.scala
rpc/netty/NettyRpcEnv.scala
rpc/netty/Outbox.scala
scheduler/AsyncEventQueue.scala
scheduler/DAGScheduler.scala
scheduler/HealthTracker.scala
scheduler/JobWaiter.scala
scheduler/ReplayListenerBus.scala
scheduler/SchedulableBuilder.scala
scheduler/TaskSchedulerImpl.scala
scheduler/TaskSetManager.scala
scheduler/cluster/CoarseGrainedSchedulerBackend.scala
scheduler/cluster/StandaloneSchedulerBackend.scala
security/CryptoStreamUtils.scala
serializer/SerializationDebugger.scala
shuffle/IndexShuffleBlockResolver.scala
shuffle/ShuffleBlockPusher.scala
shuffle/sort/SortShuffleManager.scala
status/KVUtils.scala
storage/BlockManager.scala
storage/BlockManagerDecommissioner.scala
storage/BlockManagerMaster.scala
storage/BlockManagerMasterEndpoint.scala
storage/BlockReplicationPolicy.scala
storage/DiskBlockManager.scala
storage/DiskBlockObjectWriter.scala
storage/DiskStore.scala
storage/FallbackStorage.scala
storage/PushBasedFetchHelper.scala
storage/ShuffleBlockFetcherIterator.scala
storage/TopologyMapper.scala
storage/memory/MemoryStore.scala
ui/JettyUtils.scala
ui/scope/RDDOperationGraph.scala
util/AccumulatorV2.scala
util/DependencyUtils.scala
util/HadoopFSUtils.scala
util/PeriodicCheckpointer.scala
util/SignalUtils.scala
util/SizeEstimator.scala
util/Utils.scala
util/collection/ExternalAppendOnlyMap.scala
util/logging/DriverLogger.scala
util/logging/FileAppender.scala
util/logging/RollingFileAppender.scala
util/logging/RollingPolicy.scala
util/random/StratifiedSamplingUtils.scala

 


was (Author: JIRAUSER285772):
Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X)

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)



[ 
https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552
 ] 

Daniel edited comment on SPARK-47578 at 4/29/24 10:01 PM:
--

Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
(X) deploy/client/StandaloneAppClient.scala
(X) deploy/history/ApplicationCache.scala
(X) deploy/history/EventLogFileCompactor.scala
(X) deploy/history/EventLogFileWriters.scala
(X) deploy/history/FsHistoryProvider.scala
(X) deploy/history/HistoryServerDiskManager.scala
(X) deploy/master/FileSystemPersistenceEngine.scala
(X) deploy/master/Master.scala
(X) deploy/master/MasterArguments.scala
(X) deploy/master/ZooKeeperPersistenceEngine.scala
(X) deploy/rest/RestSubmissionClient.scala
(X) deploy/security/HBaseDelegationTokenProvider.scala
(X) deploy/security/HadoopDelegationTokenManager.scala
(X) deploy/security/HadoopFSDelegationTokenProvider.scala
(X) deploy/worker/DriverRunner.scala
(X) deploy/worker/ExecutorRunner.scala
(X) deploy/worker/Worker.scala
(X) deploy/worker/WorkerWatcher.scala
(X) executor/CoarseGrainedExecutorBackend.scala
(X) executor/Executor.scala
(X) executor/ProcfsMetricsGetter.scala
(X) internal/io/HadoopMapReduceCommitProtocol.scala
(X) internal/io/SparkHadoopWriter.scala
(X) internal/plugin/PluginContextImpl.scala
(X) internal/plugin/PluginEndpoint.scala
(X) memory/ExecutionMemoryPool.scala
(X) memory/StorageMemoryPool.scala
metrics/ExecutorMetricType.scala
metrics/MetricsSystem.scala
metrics/sink/StatsdReporter.scala
network/netty/NettyBlockRpcServer.scala
rdd/HadoopRDD.scala
rdd/JdbcRDD.scala
rdd/NewHadoopRDD.scala
rdd/PairRDDFunctions.scala
rdd/RDD.scala
rdd/RDDOperationScope.scala
rdd/ReliableCheckpointRDD.scala
resource/ResourceProfile.scala
resource/ResourceProfileManager.scala
resource/ResourceUtils.scala
rpc/netty/Dispatcher.scala
rpc/netty/Inbox.scala
rpc/netty/NettyRpcEnv.scala
rpc/netty/Outbox.scala
scheduler/AsyncEventQueue.scala
scheduler/DAGScheduler.scala
scheduler/HealthTracker.scala
scheduler/JobWaiter.scala
scheduler/ReplayListenerBus.scala
scheduler/SchedulableBuilder.scala
scheduler/TaskSchedulerImpl.scala
scheduler/TaskSetManager.scala
scheduler/cluster/CoarseGrainedSchedulerBackend.scala
scheduler/cluster/StandaloneSchedulerBackend.scala
security/CryptoStreamUtils.scala
serializer/SerializationDebugger.scala
shuffle/IndexShuffleBlockResolver.scala
shuffle/ShuffleBlockPusher.scala
shuffle/sort/SortShuffleManager.scala
status/KVUtils.scala
storage/BlockManager.scala
storage/BlockManagerDecommissioner.scala
storage/BlockManagerMaster.scala
storage/BlockManagerMasterEndpoint.scala
storage/BlockReplicationPolicy.scala
storage/DiskBlockManager.scala
storage/DiskBlockObjectWriter.scala
storage/DiskStore.scala
storage/FallbackStorage.scala
storage/PushBasedFetchHelper.scala
storage/ShuffleBlockFetcherIterator.scala
storage/TopologyMapper.scala
storage/memory/MemoryStore.scala
ui/JettyUtils.scala
ui/scope/RDDOperationGraph.scala
util/AccumulatorV2.scala
util/DependencyUtils.scala
util/HadoopFSUtils.scala
util/PeriodicCheckpointer.scala
util/SignalUtils.scala
util/SizeEstimator.scala
util/Utils.scala
util/collection/ExternalAppendOnlyMap.scala
util/logging/DriverLogger.scala
util/logging/FileAppender.scala
util/logging/RollingFileAppender.scala
util/logging/RollingPolicy.scala
util/random/StratifiedSamplingUtils.scala

 


was (Author: JIRAUSER285772):
Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X)

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)



[ 
https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552
 ] 

Daniel edited comment on SPARK-47578 at 4/29/24 9:58 PM:
-

Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
(X) deploy/client/StandaloneAppClient.scala
(X) deploy/history/ApplicationCache.scala
(X) deploy/history/EventLogFileCompactor.scala
(X) deploy/history/EventLogFileWriters.scala
(X) deploy/history/FsHistoryProvider.scala
(X) deploy/history/HistoryServerDiskManager.scala
(X) deploy/master/FileSystemPersistenceEngine.scala
(X) deploy/master/Master.scala
(X) deploy/master/MasterArguments.scala
(X) deploy/master/ZooKeeperPersistenceEngine.scala
(X) deploy/rest/RestSubmissionClient.scala
(X) deploy/security/HBaseDelegationTokenProvider.scala
(X) deploy/security/HadoopDelegationTokenManager.scala
(X) deploy/security/HadoopFSDelegationTokenProvider.scala
(X) deploy/worker/DriverRunner.scala
(X) deploy/worker/ExecutorRunner.scala
(X) deploy/worker/Worker.scala
(X) deploy/worker/WorkerWatcher.scala
(X) executor/CoarseGrainedExecutorBackend.scala
(X) executor/Executor.scala
(X) executor/ProcfsMetricsGetter.scala
(X) internal/io/HadoopMapReduceCommitProtocol.scala
(X) internal/io/SparkHadoopWriter.scala
(X) internal/plugin/PluginContextImpl.scala
(X) internal/plugin/PluginEndpoint.scala
memory/ExecutionMemoryPool.scala
memory/StorageMemoryPool.scala
metrics/ExecutorMetricType.scala
metrics/MetricsSystem.scala
metrics/sink/StatsdReporter.scala
network/netty/NettyBlockRpcServer.scala
rdd/HadoopRDD.scala
rdd/JdbcRDD.scala
rdd/NewHadoopRDD.scala
rdd/PairRDDFunctions.scala
rdd/RDD.scala
rdd/RDDOperationScope.scala
rdd/ReliableCheckpointRDD.scala
resource/ResourceProfile.scala
resource/ResourceProfileManager.scala
resource/ResourceUtils.scala
rpc/netty/Dispatcher.scala
rpc/netty/Inbox.scala
rpc/netty/NettyRpcEnv.scala
rpc/netty/Outbox.scala
scheduler/AsyncEventQueue.scala
scheduler/DAGScheduler.scala
scheduler/HealthTracker.scala
scheduler/JobWaiter.scala
scheduler/ReplayListenerBus.scala
scheduler/SchedulableBuilder.scala
scheduler/TaskSchedulerImpl.scala
scheduler/TaskSetManager.scala
scheduler/cluster/CoarseGrainedSchedulerBackend.scala
scheduler/cluster/StandaloneSchedulerBackend.scala
security/CryptoStreamUtils.scala
serializer/SerializationDebugger.scala
shuffle/IndexShuffleBlockResolver.scala
shuffle/ShuffleBlockPusher.scala
shuffle/sort/SortShuffleManager.scala
status/KVUtils.scala
storage/BlockManager.scala
storage/BlockManagerDecommissioner.scala
storage/BlockManagerMaster.scala
storage/BlockManagerMasterEndpoint.scala
storage/BlockReplicationPolicy.scala
storage/DiskBlockManager.scala
storage/DiskBlockObjectWriter.scala
storage/DiskStore.scala
storage/FallbackStorage.scala
storage/PushBasedFetchHelper.scala
storage/ShuffleBlockFetcherIterator.scala
storage/TopologyMapper.scala
storage/memory/MemoryStore.scala
ui/JettyUtils.scala
ui/scope/RDDOperationGraph.scala
util/AccumulatorV2.scala
util/DependencyUtils.scala
util/HadoopFSUtils.scala
util/PeriodicCheckpointer.scala
util/SignalUtils.scala
util/SizeEstimator.scala
util/Utils.scala
util/collection/ExternalAppendOnlyMap.scala
util/logging/DriverLogger.scala
util/logging/FileAppender.scala
util/logging/RollingFileAppender.scala
util/logging/RollingPolicy.scala
util/random/StratifiedSamplingUtils.scala

 


was (Author: JIRAUSER285772):
Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
(X)

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)



[ 
https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552
 ] 

Daniel edited comment on SPARK-47578 at 4/29/24 9:44 PM:
-

Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
(X) deploy/client/StandaloneAppClient.scala
(X) deploy/history/ApplicationCache.scala
(X) deploy/history/EventLogFileCompactor.scala
(X) deploy/history/EventLogFileWriters.scala
(X) deploy/history/FsHistoryProvider.scala
(X) deploy/history/HistoryServerDiskManager.scala
(X) deploy/master/FileSystemPersistenceEngine.scala
(X) deploy/master/Master.scala
(X) deploy/master/MasterArguments.scala
(X) deploy/master/ZooKeeperPersistenceEngine.scala
(X) deploy/rest/RestSubmissionClient.scala
(X) deploy/security/HBaseDelegationTokenProvider.scala
(X) deploy/security/HadoopDelegationTokenManager.scala
(X) deploy/security/HadoopFSDelegationTokenProvider.scala
(X) deploy/worker/DriverRunner.scala
(X) deploy/worker/ExecutorRunner.scala
(X) deploy/worker/Worker.scala
(X) deploy/worker/WorkerWatcher.scala
(X) executor/CoarseGrainedExecutorBackend.scala
executor/Executor.scala
executor/ProcfsMetricsGetter.scala
internal/io/HadoopMapReduceCommitProtocol.scala
internal/io/SparkHadoopWriter.scala
internal/plugin/PluginContextImpl.scala
internal/plugin/PluginEndpoint.scala
memory/ExecutionMemoryPool.scala
memory/StorageMemoryPool.scala
metrics/ExecutorMetricType.scala
metrics/MetricsSystem.scala
metrics/sink/StatsdReporter.scala
network/netty/NettyBlockRpcServer.scala
rdd/HadoopRDD.scala
rdd/JdbcRDD.scala
rdd/NewHadoopRDD.scala
rdd/PairRDDFunctions.scala
rdd/RDD.scala
rdd/RDDOperationScope.scala
rdd/ReliableCheckpointRDD.scala
resource/ResourceProfile.scala
resource/ResourceProfileManager.scala
resource/ResourceUtils.scala
rpc/netty/Dispatcher.scala
rpc/netty/Inbox.scala
rpc/netty/NettyRpcEnv.scala
rpc/netty/Outbox.scala
scheduler/AsyncEventQueue.scala
scheduler/DAGScheduler.scala
scheduler/HealthTracker.scala
scheduler/JobWaiter.scala
scheduler/ReplayListenerBus.scala
scheduler/SchedulableBuilder.scala
scheduler/TaskSchedulerImpl.scala
scheduler/TaskSetManager.scala
scheduler/cluster/CoarseGrainedSchedulerBackend.scala
scheduler/cluster/StandaloneSchedulerBackend.scala
security/CryptoStreamUtils.scala
serializer/SerializationDebugger.scala
shuffle/IndexShuffleBlockResolver.scala
shuffle/ShuffleBlockPusher.scala
shuffle/sort/SortShuffleManager.scala
status/KVUtils.scala
storage/BlockManager.scala
storage/BlockManagerDecommissioner.scala
storage/BlockManagerMaster.scala
storage/BlockManagerMasterEndpoint.scala
storage/BlockReplicationPolicy.scala
storage/DiskBlockManager.scala
storage/DiskBlockObjectWriter.scala
storage/DiskStore.scala
storage/FallbackStorage.scala
storage/PushBasedFetchHelper.scala
storage/ShuffleBlockFetcherIterator.scala
storage/TopologyMapper.scala
storage/memory/MemoryStore.scala
ui/JettyUtils.scala
ui/scope/RDDOperationGraph.scala
util/AccumulatorV2.scala
util/DependencyUtils.scala
util/HadoopFSUtils.scala
util/PeriodicCheckpointer.scala
util/SignalUtils.scala
util/SizeEstimator.scala
util/Utils.scala
util/collection/ExternalAppendOnlyMap.scala
util/logging/DriverLogger.scala
util/logging/FileAppender.scala
util/logging/RollingFileAppender.scala
util/logging/RollingPolicy.scala
util/random/StratifiedSamplingUtils.scala

 


was (Author: JIRAUSER285772):
Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
(X)

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)



[ 
https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552
 ] 

Daniel edited comment on SPARK-47578 at 4/29/24 9:38 PM:
-

Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
(X) deploy/client/StandaloneAppClient.scala
(X) deploy/history/ApplicationCache.scala
(X) deploy/history/EventLogFileCompactor.scala
(X) deploy/history/EventLogFileWriters.scala
(X) deploy/history/FsHistoryProvider.scala
(X) deploy/history/HistoryServerDiskManager.scala
(X) deploy/master/FileSystemPersistenceEngine.scala
(X) deploy/master/Master.scala
(X) deploy/master/MasterArguments.scala
(X) deploy/master/ZooKeeperPersistenceEngine.scala
(X) deploy/rest/RestSubmissionClient.scala
(X) deploy/security/HBaseDelegationTokenProvider.scala
(X) deploy/security/HadoopDelegationTokenManager.scala
(X) deploy/security/HadoopFSDelegationTokenProvider.scala
(X) deploy/worker/DriverRunner.scala
(X) deploy/worker/ExecutorRunner.scala
deploy/worker/Worker.scala
deploy/worker/WorkerWatcher.scala
executor/CoarseGrainedExecutorBackend.scala
executor/Executor.scala
executor/ProcfsMetricsGetter.scala
internal/io/HadoopMapReduceCommitProtocol.scala
internal/io/SparkHadoopWriter.scala
internal/plugin/PluginContextImpl.scala
internal/plugin/PluginEndpoint.scala
memory/ExecutionMemoryPool.scala
memory/StorageMemoryPool.scala
metrics/ExecutorMetricType.scala
metrics/MetricsSystem.scala
metrics/sink/StatsdReporter.scala
network/netty/NettyBlockRpcServer.scala
rdd/HadoopRDD.scala
rdd/JdbcRDD.scala
rdd/NewHadoopRDD.scala
rdd/PairRDDFunctions.scala
rdd/RDD.scala
rdd/RDDOperationScope.scala
rdd/ReliableCheckpointRDD.scala
resource/ResourceProfile.scala
resource/ResourceProfileManager.scala
resource/ResourceUtils.scala
rpc/netty/Dispatcher.scala
rpc/netty/Inbox.scala
rpc/netty/NettyRpcEnv.scala
rpc/netty/Outbox.scala
scheduler/AsyncEventQueue.scala
scheduler/DAGScheduler.scala
scheduler/HealthTracker.scala
scheduler/JobWaiter.scala
scheduler/ReplayListenerBus.scala
scheduler/SchedulableBuilder.scala
scheduler/TaskSchedulerImpl.scala
scheduler/TaskSetManager.scala
scheduler/cluster/CoarseGrainedSchedulerBackend.scala
scheduler/cluster/StandaloneSchedulerBackend.scala
security/CryptoStreamUtils.scala
serializer/SerializationDebugger.scala
shuffle/IndexShuffleBlockResolver.scala
shuffle/ShuffleBlockPusher.scala
shuffle/sort/SortShuffleManager.scala
status/KVUtils.scala
storage/BlockManager.scala
storage/BlockManagerDecommissioner.scala
storage/BlockManagerMaster.scala
storage/BlockManagerMasterEndpoint.scala
storage/BlockReplicationPolicy.scala
storage/DiskBlockManager.scala
storage/DiskBlockObjectWriter.scala
storage/DiskStore.scala
storage/FallbackStorage.scala
storage/PushBasedFetchHelper.scala
storage/ShuffleBlockFetcherIterator.scala
storage/TopologyMapper.scala
storage/memory/MemoryStore.scala
ui/JettyUtils.scala
ui/scope/RDDOperationGraph.scala
util/AccumulatorV2.scala
util/DependencyUtils.scala
util/HadoopFSUtils.scala
util/PeriodicCheckpointer.scala
util/SignalUtils.scala
util/SizeEstimator.scala
util/Utils.scala
util/collection/ExternalAppendOnlyMap.scala
util/logging/DriverLogger.scala
util/logging/FileAppender.scala
util/logging/RollingFileAppender.scala
util/logging/RollingPolicy.scala
util/random/StratifiedSamplingUtils.scala

 


was (Author: JIRAUSER285772):
Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
(X)

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)



[ 
https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552
 ] 

Daniel edited comment on SPARK-47578 at 4/29/24 9:26 PM:
-

Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
(X) deploy/client/StandaloneAppClient.scala
(X) deploy/history/ApplicationCache.scala
(X) deploy/history/EventLogFileCompactor.scala
(X) deploy/history/EventLogFileWriters.scala
(X) deploy/history/FsHistoryProvider.scala
(X) deploy/history/HistoryServerDiskManager.scala
(X) deploy/master/FileSystemPersistenceEngine.scala
(X) deploy/master/Master.scala
(X) deploy/master/MasterArguments.scala
deploy/master/ZooKeeperPersistenceEngine.scala
deploy/rest/RestSubmissionClient.scala
deploy/security/HBaseDelegationTokenProvider.scala
deploy/security/HadoopDelegationTokenManager.scala
deploy/security/HadoopFSDelegationTokenProvider.scala
deploy/worker/DriverRunner.scala
deploy/worker/ExecutorRunner.scala
deploy/worker/Worker.scala
deploy/worker/WorkerWatcher.scala
executor/CoarseGrainedExecutorBackend.scala
executor/Executor.scala
executor/ProcfsMetricsGetter.scala
internal/io/HadoopMapReduceCommitProtocol.scala
internal/io/SparkHadoopWriter.scala
internal/plugin/PluginContextImpl.scala
internal/plugin/PluginEndpoint.scala
memory/ExecutionMemoryPool.scala
memory/StorageMemoryPool.scala
metrics/ExecutorMetricType.scala
metrics/MetricsSystem.scala
metrics/sink/StatsdReporter.scala
network/netty/NettyBlockRpcServer.scala
rdd/HadoopRDD.scala
rdd/JdbcRDD.scala
rdd/NewHadoopRDD.scala
rdd/PairRDDFunctions.scala
rdd/RDD.scala
rdd/RDDOperationScope.scala
rdd/ReliableCheckpointRDD.scala
resource/ResourceProfile.scala
resource/ResourceProfileManager.scala
resource/ResourceUtils.scala
rpc/netty/Dispatcher.scala
rpc/netty/Inbox.scala
rpc/netty/NettyRpcEnv.scala
rpc/netty/Outbox.scala
scheduler/AsyncEventQueue.scala
scheduler/DAGScheduler.scala
scheduler/HealthTracker.scala
scheduler/JobWaiter.scala
scheduler/ReplayListenerBus.scala
scheduler/SchedulableBuilder.scala
scheduler/TaskSchedulerImpl.scala
scheduler/TaskSetManager.scala
scheduler/cluster/CoarseGrainedSchedulerBackend.scala
scheduler/cluster/StandaloneSchedulerBackend.scala
security/CryptoStreamUtils.scala
serializer/SerializationDebugger.scala
shuffle/IndexShuffleBlockResolver.scala
shuffle/ShuffleBlockPusher.scala
shuffle/sort/SortShuffleManager.scala
status/KVUtils.scala
storage/BlockManager.scala
storage/BlockManagerDecommissioner.scala
storage/BlockManagerMaster.scala
storage/BlockManagerMasterEndpoint.scala
storage/BlockReplicationPolicy.scala
storage/DiskBlockManager.scala
storage/DiskBlockObjectWriter.scala
storage/DiskStore.scala
storage/FallbackStorage.scala
storage/PushBasedFetchHelper.scala
storage/ShuffleBlockFetcherIterator.scala
storage/TopologyMapper.scala
storage/memory/MemoryStore.scala
ui/JettyUtils.scala
ui/scope/RDDOperationGraph.scala
util/AccumulatorV2.scala
util/DependencyUtils.scala
util/HadoopFSUtils.scala
util/PeriodicCheckpointer.scala
util/SignalUtils.scala
util/SizeEstimator.scala
util/Utils.scala
util/collection/ExternalAppendOnlyMap.scala
util/logging/DriverLogger.scala
util/logging/FileAppender.scala
util/logging/RollingFileAppender.scala
util/logging/RollingPolicy.scala
util/random/StratifiedSamplingUtils.scala

 


was (Author: JIRAUSER285772):
Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
(X) deploy/client/StandaloneAppClient.scala
(X)

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)



[ 
https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552
 ] 

Daniel edited comment on SPARK-47578 at 4/29/24 9:15 PM:
-

Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
(X) deploy/client/StandaloneAppClient.scala
(X) deploy/history/ApplicationCache.scala
(X) deploy/history/EventLogFileCompactor.scala
(X) deploy/history/EventLogFileWriters.scala
(X) deploy/history/FsHistoryProvider.scala
(X) deploy/history/HistoryServerDiskManager.scala
deploy/master/FileSystemPersistenceEngine.scala
deploy/master/Master.scala
deploy/master/MasterArguments.scala
deploy/master/ZooKeeperPersistenceEngine.scala
deploy/rest/RestSubmissionClient.scala
deploy/security/HBaseDelegationTokenProvider.scala
deploy/security/HadoopDelegationTokenManager.scala
deploy/security/HadoopFSDelegationTokenProvider.scala
deploy/worker/DriverRunner.scala
deploy/worker/ExecutorRunner.scala
deploy/worker/Worker.scala
deploy/worker/WorkerWatcher.scala
executor/CoarseGrainedExecutorBackend.scala
executor/Executor.scala
executor/ProcfsMetricsGetter.scala
internal/io/HadoopMapReduceCommitProtocol.scala
internal/io/SparkHadoopWriter.scala
internal/plugin/PluginContextImpl.scala
internal/plugin/PluginEndpoint.scala
memory/ExecutionMemoryPool.scala
memory/StorageMemoryPool.scala
metrics/ExecutorMetricType.scala
metrics/MetricsSystem.scala
metrics/sink/StatsdReporter.scala
network/netty/NettyBlockRpcServer.scala
rdd/HadoopRDD.scala
rdd/JdbcRDD.scala
rdd/NewHadoopRDD.scala
rdd/PairRDDFunctions.scala
rdd/RDD.scala
rdd/RDDOperationScope.scala
rdd/ReliableCheckpointRDD.scala
resource/ResourceProfile.scala
resource/ResourceProfileManager.scala
resource/ResourceUtils.scala
rpc/netty/Dispatcher.scala
rpc/netty/Inbox.scala
rpc/netty/NettyRpcEnv.scala
rpc/netty/Outbox.scala
scheduler/AsyncEventQueue.scala
scheduler/DAGScheduler.scala
scheduler/HealthTracker.scala
scheduler/JobWaiter.scala
scheduler/ReplayListenerBus.scala
scheduler/SchedulableBuilder.scala
scheduler/TaskSchedulerImpl.scala
scheduler/TaskSetManager.scala
scheduler/cluster/CoarseGrainedSchedulerBackend.scala
scheduler/cluster/StandaloneSchedulerBackend.scala
security/CryptoStreamUtils.scala
serializer/SerializationDebugger.scala
shuffle/IndexShuffleBlockResolver.scala
shuffle/ShuffleBlockPusher.scala
shuffle/sort/SortShuffleManager.scala
status/KVUtils.scala
storage/BlockManager.scala
storage/BlockManagerDecommissioner.scala
storage/BlockManagerMaster.scala
storage/BlockManagerMasterEndpoint.scala
storage/BlockReplicationPolicy.scala
storage/DiskBlockManager.scala
storage/DiskBlockObjectWriter.scala
storage/DiskStore.scala
storage/FallbackStorage.scala
storage/PushBasedFetchHelper.scala
storage/ShuffleBlockFetcherIterator.scala
storage/TopologyMapper.scala
storage/memory/MemoryStore.scala
ui/JettyUtils.scala
ui/scope/RDDOperationGraph.scala
util/AccumulatorV2.scala
util/DependencyUtils.scala
util/HadoopFSUtils.scala
util/PeriodicCheckpointer.scala
util/SignalUtils.scala
util/SizeEstimator.scala
util/Utils.scala
util/collection/ExternalAppendOnlyMap.scala
util/logging/DriverLogger.scala
util/logging/FileAppender.scala
util/logging/RollingFileAppender.scala
util/logging/RollingPolicy.scala
util/random/StratifiedSamplingUtils.scala

 


was (Author: JIRAUSER285772):
Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
deploy/client/StandaloneAppClient.scala
deploy/history/ApplicationCache.scala

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)



[ 
https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552
 ] 

Daniel edited comment on SPARK-47578 at 4/29/24 8:54 PM:
-

Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
(X) deploy/Client.scala
(X) deploy/DriverTimeoutPlugin.scala
(X) deploy/ExternalShuffleService.scala
(X) deploy/FaultToleranceTest.scala
(X) deploy/RPackageUtils.scala
(X) deploy/SparkSubmit.scala
(X) deploy/SparkSubmitArguments.scala
deploy/client/StandaloneAppClient.scala
deploy/history/ApplicationCache.scala
deploy/history/EventLogFileCompactor.scala
deploy/history/EventLogFileWriters.scala
deploy/history/FsHistoryProvider.scala
deploy/history/HistoryServerDiskManager.scala
deploy/master/FileSystemPersistenceEngine.scala
deploy/master/Master.scala
deploy/master/MasterArguments.scala
deploy/master/ZooKeeperPersistenceEngine.scala
deploy/rest/RestSubmissionClient.scala
deploy/security/HBaseDelegationTokenProvider.scala
deploy/security/HadoopDelegationTokenManager.scala
deploy/security/HadoopFSDelegationTokenProvider.scala
deploy/worker/DriverRunner.scala
deploy/worker/ExecutorRunner.scala
deploy/worker/Worker.scala
deploy/worker/WorkerWatcher.scala
executor/CoarseGrainedExecutorBackend.scala
executor/Executor.scala
executor/ProcfsMetricsGetter.scala
internal/io/HadoopMapReduceCommitProtocol.scala
internal/io/SparkHadoopWriter.scala
internal/plugin/PluginContextImpl.scala
internal/plugin/PluginEndpoint.scala
memory/ExecutionMemoryPool.scala
memory/StorageMemoryPool.scala
metrics/ExecutorMetricType.scala
metrics/MetricsSystem.scala
metrics/sink/StatsdReporter.scala
network/netty/NettyBlockRpcServer.scala
rdd/HadoopRDD.scala
rdd/JdbcRDD.scala
rdd/NewHadoopRDD.scala
rdd/PairRDDFunctions.scala
rdd/RDD.scala
rdd/RDDOperationScope.scala
rdd/ReliableCheckpointRDD.scala
resource/ResourceProfile.scala
resource/ResourceProfileManager.scala
resource/ResourceUtils.scala
rpc/netty/Dispatcher.scala
rpc/netty/Inbox.scala
rpc/netty/NettyRpcEnv.scala
rpc/netty/Outbox.scala
scheduler/AsyncEventQueue.scala
scheduler/DAGScheduler.scala
scheduler/HealthTracker.scala
scheduler/JobWaiter.scala
scheduler/ReplayListenerBus.scala
scheduler/SchedulableBuilder.scala
scheduler/TaskSchedulerImpl.scala
scheduler/TaskSetManager.scala
scheduler/cluster/CoarseGrainedSchedulerBackend.scala
scheduler/cluster/StandaloneSchedulerBackend.scala
security/CryptoStreamUtils.scala
serializer/SerializationDebugger.scala
shuffle/IndexShuffleBlockResolver.scala
shuffle/ShuffleBlockPusher.scala
shuffle/sort/SortShuffleManager.scala
status/KVUtils.scala
storage/BlockManager.scala
storage/BlockManagerDecommissioner.scala
storage/BlockManagerMaster.scala
storage/BlockManagerMasterEndpoint.scala
storage/BlockReplicationPolicy.scala
storage/DiskBlockManager.scala
storage/DiskBlockObjectWriter.scala
storage/DiskStore.scala
storage/FallbackStorage.scala
storage/PushBasedFetchHelper.scala
storage/ShuffleBlockFetcherIterator.scala
storage/TopologyMapper.scala
storage/memory/MemoryStore.scala
ui/JettyUtils.scala
ui/scope/RDDOperationGraph.scala
util/AccumulatorV2.scala
util/DependencyUtils.scala
util/HadoopFSUtils.scala
util/PeriodicCheckpointer.scala
util/SignalUtils.scala
util/SizeEstimator.scala
util/Utils.scala
util/collection/ExternalAppendOnlyMap.scala
util/logging/DriverLogger.scala
util/logging/FileAppender.scala
util/logging/RollingFileAppender.scala
util/logging/RollingPolicy.scala
util/random/StratifiedSamplingUtils.scala

 


was (Author: JIRAUSER285772):
Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
deploy/Client.scala
deploy/DriverTimeoutPlugin.scala
deploy/ExternalShuffleService.scala
deploy/FaultToleranceTest.scala
deploy/RPackageUtils.scala
deploy/SparkSubmit.scala
deploy/SparkSubmitArguments.scala
deploy/client/StandaloneAppClient.scala
deploy/history/ApplicationCache.scala
deploy/history/EventLogFileCompactor.scala

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)



[ 
https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552
 ] 

Daniel edited comment on SPARK-47578 at 4/29/24 8:23 PM:
-

Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
(X) SparkContext.scala
(X) SparkEnv.scala
(X) api/python/PythonRunner.scala
(X) api/python/PythonWorkerFactory.scala
(X) api/python/SerDeUtil.scala
(X) api/r/RBackendHandler.scala
deploy/Client.scala
deploy/DriverTimeoutPlugin.scala
deploy/ExternalShuffleService.scala
deploy/FaultToleranceTest.scala
deploy/RPackageUtils.scala
deploy/SparkSubmit.scala
deploy/SparkSubmitArguments.scala
deploy/client/StandaloneAppClient.scala
deploy/history/ApplicationCache.scala
deploy/history/EventLogFileCompactor.scala
deploy/history/EventLogFileWriters.scala
deploy/history/FsHistoryProvider.scala
deploy/history/HistoryServerDiskManager.scala
deploy/master/FileSystemPersistenceEngine.scala
deploy/master/Master.scala
deploy/master/MasterArguments.scala
deploy/master/ZooKeeperPersistenceEngine.scala
deploy/rest/RestSubmissionClient.scala
deploy/security/HBaseDelegationTokenProvider.scala
deploy/security/HadoopDelegationTokenManager.scala
deploy/security/HadoopFSDelegationTokenProvider.scala
deploy/worker/DriverRunner.scala
deploy/worker/ExecutorRunner.scala
deploy/worker/Worker.scala
deploy/worker/WorkerWatcher.scala
executor/CoarseGrainedExecutorBackend.scala
executor/Executor.scala
executor/ProcfsMetricsGetter.scala
internal/io/HadoopMapReduceCommitProtocol.scala
internal/io/SparkHadoopWriter.scala
internal/plugin/PluginContextImpl.scala
internal/plugin/PluginEndpoint.scala
memory/ExecutionMemoryPool.scala
memory/StorageMemoryPool.scala
metrics/ExecutorMetricType.scala
metrics/MetricsSystem.scala
metrics/sink/StatsdReporter.scala
network/netty/NettyBlockRpcServer.scala
rdd/HadoopRDD.scala
rdd/JdbcRDD.scala
rdd/NewHadoopRDD.scala
rdd/PairRDDFunctions.scala
rdd/RDD.scala
rdd/RDDOperationScope.scala
rdd/ReliableCheckpointRDD.scala
resource/ResourceProfile.scala
resource/ResourceProfileManager.scala
resource/ResourceUtils.scala
rpc/netty/Dispatcher.scala
rpc/netty/Inbox.scala
rpc/netty/NettyRpcEnv.scala
rpc/netty/Outbox.scala
scheduler/AsyncEventQueue.scala
scheduler/DAGScheduler.scala
scheduler/HealthTracker.scala
scheduler/JobWaiter.scala
scheduler/ReplayListenerBus.scala
scheduler/SchedulableBuilder.scala
scheduler/TaskSchedulerImpl.scala
scheduler/TaskSetManager.scala
scheduler/cluster/CoarseGrainedSchedulerBackend.scala
scheduler/cluster/StandaloneSchedulerBackend.scala
security/CryptoStreamUtils.scala
serializer/SerializationDebugger.scala
shuffle/IndexShuffleBlockResolver.scala
shuffle/ShuffleBlockPusher.scala
shuffle/sort/SortShuffleManager.scala
status/KVUtils.scala
storage/BlockManager.scala
storage/BlockManagerDecommissioner.scala
storage/BlockManagerMaster.scala
storage/BlockManagerMasterEndpoint.scala
storage/BlockReplicationPolicy.scala
storage/DiskBlockManager.scala
storage/DiskBlockObjectWriter.scala
storage/DiskStore.scala
storage/FallbackStorage.scala
storage/PushBasedFetchHelper.scala
storage/ShuffleBlockFetcherIterator.scala
storage/TopologyMapper.scala
storage/memory/MemoryStore.scala
ui/JettyUtils.scala
ui/scope/RDDOperationGraph.scala
util/AccumulatorV2.scala
util/DependencyUtils.scala
util/HadoopFSUtils.scala
util/PeriodicCheckpointer.scala
util/SignalUtils.scala
util/SizeEstimator.scala
util/Utils.scala
util/collection/ExternalAppendOnlyMap.scala
util/logging/DriverLogger.scala
util/logging/FileAppender.scala
util/logging/RollingFileAppender.scala
util/logging/RollingPolicy.scala
util/random/StratifiedSamplingUtils.scala

 


was (Author: JIRAUSER285772):
Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
SparkContext.scala
SparkEnv.scala
api/python/PythonRunner.scala
api/python/PythonWorkerFactory.scala
api/python/SerDeUtil.scala
api/r/RBackendHandler.scala
deploy/Client.scala
deploy/DriverTimeoutPlugin.scala
deploy/ExternalShuffleService.scala
deploy/FaultToleranceTest.scala
deploy/RPackageUtils.scala
deploy/SparkSubmit.scala
deploy/SparkSubmitArguments.scala
deploy/client/StandaloneAppClient.scala
deploy/history/ApplicationCache.scala
deploy/history/EventLogFileCompactor.scala
deploy/history/EventLogFileWriters.scala

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)



[ 
https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552
 ] 

Daniel edited comment on SPARK-47578 at 4/29/24 8:07 PM:
-

Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

(X) BarrierTaskContext.scala
(X) Dependency.scala
(X) ExecutorAllocationManager.scala
(X) HeartbeatReceiver.scala
(X) MapOutputTracker.scala
(X) SecurityManager.scala
(X) SparkConf.scala
SparkContext.scala
SparkEnv.scala
api/python/PythonRunner.scala
api/python/PythonWorkerFactory.scala
api/python/SerDeUtil.scala
api/r/RBackendHandler.scala
deploy/Client.scala
deploy/DriverTimeoutPlugin.scala
deploy/ExternalShuffleService.scala
deploy/FaultToleranceTest.scala
deploy/RPackageUtils.scala
deploy/SparkSubmit.scala
deploy/SparkSubmitArguments.scala
deploy/client/StandaloneAppClient.scala
deploy/history/ApplicationCache.scala
deploy/history/EventLogFileCompactor.scala
deploy/history/EventLogFileWriters.scala
deploy/history/FsHistoryProvider.scala
deploy/history/HistoryServerDiskManager.scala
deploy/master/FileSystemPersistenceEngine.scala
deploy/master/Master.scala
deploy/master/MasterArguments.scala
deploy/master/ZooKeeperPersistenceEngine.scala
deploy/rest/RestSubmissionClient.scala
deploy/security/HBaseDelegationTokenProvider.scala
deploy/security/HadoopDelegationTokenManager.scala
deploy/security/HadoopFSDelegationTokenProvider.scala
deploy/worker/DriverRunner.scala
deploy/worker/ExecutorRunner.scala
deploy/worker/Worker.scala
deploy/worker/WorkerWatcher.scala
executor/CoarseGrainedExecutorBackend.scala
executor/Executor.scala
executor/ProcfsMetricsGetter.scala
internal/io/HadoopMapReduceCommitProtocol.scala
internal/io/SparkHadoopWriter.scala
internal/plugin/PluginContextImpl.scala
internal/plugin/PluginEndpoint.scala
memory/ExecutionMemoryPool.scala
memory/StorageMemoryPool.scala
metrics/ExecutorMetricType.scala
metrics/MetricsSystem.scala
metrics/sink/StatsdReporter.scala
network/netty/NettyBlockRpcServer.scala
rdd/HadoopRDD.scala
rdd/JdbcRDD.scala
rdd/NewHadoopRDD.scala
rdd/PairRDDFunctions.scala
rdd/RDD.scala
rdd/RDDOperationScope.scala
rdd/ReliableCheckpointRDD.scala
resource/ResourceProfile.scala
resource/ResourceProfileManager.scala
resource/ResourceUtils.scala
rpc/netty/Dispatcher.scala
rpc/netty/Inbox.scala
rpc/netty/NettyRpcEnv.scala
rpc/netty/Outbox.scala
scheduler/AsyncEventQueue.scala
scheduler/DAGScheduler.scala
scheduler/HealthTracker.scala
scheduler/JobWaiter.scala
scheduler/ReplayListenerBus.scala
scheduler/SchedulableBuilder.scala
scheduler/TaskSchedulerImpl.scala
scheduler/TaskSetManager.scala
scheduler/cluster/CoarseGrainedSchedulerBackend.scala
scheduler/cluster/StandaloneSchedulerBackend.scala
security/CryptoStreamUtils.scala
serializer/SerializationDebugger.scala
shuffle/IndexShuffleBlockResolver.scala
shuffle/ShuffleBlockPusher.scala
shuffle/sort/SortShuffleManager.scala
status/KVUtils.scala
storage/BlockManager.scala
storage/BlockManagerDecommissioner.scala
storage/BlockManagerMaster.scala
storage/BlockManagerMasterEndpoint.scala
storage/BlockReplicationPolicy.scala
storage/DiskBlockManager.scala
storage/DiskBlockObjectWriter.scala
storage/DiskStore.scala
storage/FallbackStorage.scala
storage/PushBasedFetchHelper.scala
storage/ShuffleBlockFetcherIterator.scala
storage/TopologyMapper.scala
storage/memory/MemoryStore.scala
ui/JettyUtils.scala
ui/scope/RDDOperationGraph.scala
util/AccumulatorV2.scala
util/DependencyUtils.scala
util/HadoopFSUtils.scala
util/PeriodicCheckpointer.scala
util/SignalUtils.scala
util/SizeEstimator.scala
util/Utils.scala
util/collection/ExternalAppendOnlyMap.scala
util/logging/DriverLogger.scala
util/logging/FileAppender.scala
util/logging/RollingFileAppender.scala
util/logging/RollingPolicy.scala
util/random/StratifiedSamplingUtils.scala

 


was (Author: JIRAUSER285772):
Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

BarrierTaskContext.scala
Dependency.scala
ExecutorAllocationManager.scala
HeartbeatReceiver.scala
MapOutputTracker.scala
SecurityManager.scala
SparkConf.scala
SparkContext.scala
SparkEnv.scala
api/python/PythonRunner.scala
api/python/PythonWorkerFactory.scala
api/python/SerDeUtil.scala
api/r/RBackendHandler.scala
deploy/Client.scala
deploy/DriverTimeoutPlugin.scala
deploy/ExternalShuffleService.scala
deploy/FaultToleranceTest.scala
deploy/RPackageUtils.scala
deploy/SparkSubmit.scala
deploy/SparkSubmitArguments.scala
deploy/client/StandaloneAppClient.scala
deploy/history/ApplicationCache.scala
deploy/history/EventLogFileCompactor.scala
deploy/history/EventLogFileWriters.scala
deploy/history/FsHistoryProvider.scala

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-29 Thread Daniel (Jira)



[ 
https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552
 ] 

Daniel edited comment on SPARK-47578 at 4/29/24 4:50 PM:
-

Edit: I updated this command to search within the Spark Core directory.

spark$ grep logWarning core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under core/src/main/scala/org/apache/spark/:

BarrierTaskContext.scala
Dependency.scala
ExecutorAllocationManager.scala
HeartbeatReceiver.scala
MapOutputTracker.scala
SecurityManager.scala
SparkConf.scala
SparkContext.scala
SparkEnv.scala
api/python/PythonRunner.scala
api/python/PythonWorkerFactory.scala
api/python/SerDeUtil.scala
api/r/RBackendHandler.scala
deploy/Client.scala
deploy/DriverTimeoutPlugin.scala
deploy/ExternalShuffleService.scala
deploy/FaultToleranceTest.scala
deploy/RPackageUtils.scala
deploy/SparkSubmit.scala
deploy/SparkSubmitArguments.scala
deploy/client/StandaloneAppClient.scala
deploy/history/ApplicationCache.scala
deploy/history/EventLogFileCompactor.scala
deploy/history/EventLogFileWriters.scala
deploy/history/FsHistoryProvider.scala
deploy/history/HistoryServerDiskManager.scala
deploy/master/FileSystemPersistenceEngine.scala
deploy/master/Master.scala
deploy/master/MasterArguments.scala
deploy/master/ZooKeeperPersistenceEngine.scala
deploy/rest/RestSubmissionClient.scala
deploy/security/HBaseDelegationTokenProvider.scala
deploy/security/HadoopDelegationTokenManager.scala
deploy/security/HadoopFSDelegationTokenProvider.scala
deploy/worker/DriverRunner.scala
deploy/worker/ExecutorRunner.scala
deploy/worker/Worker.scala
deploy/worker/WorkerWatcher.scala
executor/CoarseGrainedExecutorBackend.scala
executor/Executor.scala
executor/ProcfsMetricsGetter.scala
internal/io/HadoopMapReduceCommitProtocol.scala
internal/io/SparkHadoopWriter.scala
internal/plugin/PluginContextImpl.scala
internal/plugin/PluginEndpoint.scala
memory/ExecutionMemoryPool.scala
memory/StorageMemoryPool.scala
metrics/ExecutorMetricType.scala
metrics/MetricsSystem.scala
metrics/sink/StatsdReporter.scala
network/netty/NettyBlockRpcServer.scala
rdd/HadoopRDD.scala
rdd/JdbcRDD.scala
rdd/NewHadoopRDD.scala
rdd/PairRDDFunctions.scala
rdd/RDD.scala
rdd/RDDOperationScope.scala
rdd/ReliableCheckpointRDD.scala
resource/ResourceProfile.scala
resource/ResourceProfileManager.scala
resource/ResourceUtils.scala
rpc/netty/Dispatcher.scala
rpc/netty/Inbox.scala
rpc/netty/NettyRpcEnv.scala
rpc/netty/Outbox.scala
scheduler/AsyncEventQueue.scala
scheduler/DAGScheduler.scala
scheduler/HealthTracker.scala
scheduler/JobWaiter.scala
scheduler/ReplayListenerBus.scala
scheduler/SchedulableBuilder.scala
scheduler/TaskSchedulerImpl.scala
scheduler/TaskSetManager.scala
scheduler/cluster/CoarseGrainedSchedulerBackend.scala
scheduler/cluster/StandaloneSchedulerBackend.scala
security/CryptoStreamUtils.scala
serializer/SerializationDebugger.scala
shuffle/IndexShuffleBlockResolver.scala
shuffle/ShuffleBlockPusher.scala
shuffle/sort/SortShuffleManager.scala
status/KVUtils.scala
storage/BlockManager.scala
storage/BlockManagerDecommissioner.scala
storage/BlockManagerMaster.scala
storage/BlockManagerMasterEndpoint.scala
storage/BlockReplicationPolicy.scala
storage/DiskBlockManager.scala
storage/DiskBlockObjectWriter.scala
storage/DiskStore.scala
storage/FallbackStorage.scala
storage/PushBasedFetchHelper.scala
storage/ShuffleBlockFetcherIterator.scala
storage/TopologyMapper.scala
storage/memory/MemoryStore.scala
ui/JettyUtils.scala
ui/scope/RDDOperationGraph.scala
util/AccumulatorV2.scala
util/DependencyUtils.scala
util/HadoopFSUtils.scala
util/PeriodicCheckpointer.scala
util/SignalUtils.scala
util/SizeEstimator.scala
util/Utils.scala
util/collection/ExternalAppendOnlyMap.scala
util/logging/DriverLogger.scala
util/logging/FileAppender.scala
util/logging/RollingFileAppender.scala
util/logging/RollingPolicy.scala
util/random/StratifiedSamplingUtils.scala

 


was (Author: JIRAUSER285772):
spark-2$ grep logWarning sql/core/src/main/* -R | cut -d ':' -f 1 | sort -u

Under sql/core/src/main/scala/org/apache/spark/sql/ (excluding streaming):

Column.scala
SparkSession.scala
api/python/PythonSQLUtils.scala
api/r/SQLUtils.scala
catalyst/analysis/ResolveSessionCatalog.scala
execution/CacheManager.scala
execution/ExistingRDD.scala
execution/OptimizeMetadataOnlyQuery.scala
execution/QueryExecution.scala
execution/SparkSqlParser.scala
execution/SparkStrategies.scala
execution/WholeStageCodegenExec.scala
execution/adaptive/AdaptiveSparkPlanExec.scala
execution/adaptive/InsertAdaptiveSparkPlan.scala
execution/adaptive/ShufflePartitionsUtil.scala
execution/aggregate/HashAggregateExec.scala
execution/command/AnalyzeTablesCommand.scala
execution/command/CommandUtils.scala
execution/command/SetCommand.scala
execution/command/createDataSourceTables.scala
execution/command/ddl.scala
execution/datasources/BasicWriteStatsTracker.scala

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

[jira] [Comment Edited] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

17 matches

Site Navigation

Mail list logo

Footer information