SparkQA commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-812236425
**[Test build #136827 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136827/testReport)** for PR 32031 at commit [`af7a628`](https://github.com/apache/spark/commit/af7a628f44dee082aef0610f3131c30569007d0c). * This patch **fails RAT tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `public class RssBuildInfo ` * `public class StreamServer ` * `public class StreamServerConfig ` * `public class BusyStatusSocketClient extends ClientBase ` * `public abstract class ClientBase implements AutoCloseable ` * `public class ClientConstants ` * `public class ClientRetryOptions ` * `public class DataBlockSocketReadClient extends ClientBase ` * `public class DataBlockSyncWriteClient extends ClientBase ` * `public class HeartbeatSocketClient extends ClientBase ` * `public class MultiServerAsyncWriteClient implements MultiServerWriteClient ` * `public class MultiServerHeartbeatClient implements AutoCloseable ` * `public class MultiServerSocketReadClient implements MultiServerReadClient ` * `public class MultiServerSyncWriteClient implements MultiServerWriteClient ` * `public class NotifyClient extends ClientBase ` * `public class PlainShuffleDataSocketReadClient extends ShuffleDataSocketReadClient ` * `public class PlainShuffleDataSyncWriteClient extends ShuffleDataSyncWriteClientBase ` * `public class PooledShuffleDataSyncWriteClient implements ShuffleDataSyncWriteClient ` * `public class PooledWriteClientFactory implements WriteClientFactory ` * `public class ReadClientDataOptions ` * `public class RegistryClient extends ClientBase ` * `public class ReplicatedReadClient implements MultiServerReadClient ` * `public class ReplicatedWriteClient implements MultiServerWriteClient ` * `public class RetriableSocketReadClient implements SingleServerReadClient ` * `public class ServerConnectionStringCache ` * `public class ServerIdAwareSocketReadClient implements SingleServerReadClient ` * `public class ServerIdAwareSyncWriteClient implements SingleServerWriteClient ` * `public class ServerReplicationGroupUtil ` * `public class ShuffleDataSocketReadClient implements AutoCloseable, SingleServerReadClient ` * `public abstract class ShuffleDataSyncWriteClientBase implements ShuffleDataSyncWriteClient ` * `public class ShuffleWriteConfig ` * `public class TaskDataBlock ` * `public class UnpooledWriteClientFactory implements WriteClientFactory ` * `public class AppMapId ` * `public class AppShuffleId ` * `public class AppShufflePartitionId ` * `public class AppTaskAttemptId ` * `public class Compression ` * `public class DataBlock ` * `public class DataBlockHeader ` * `public class DownloadServerVerboseInfo ` * `public class FilePathAndLength ` * `public class FixedLengthInputStream extends InputStream ` * `public class MapTaskCommitStatus ` * `public class MapTaskRssInfo ` * `public class MemoryMonitor ` * `public class PartitionFilePathAndLength ` * `public class ServerCandidate ` * `public class ServerDetail ` * `public class ServerDetailCollection ` * `public class ServerList ` * `public class ServerReplicationGroup ` * `public class ShuffleMapTaskAttemptId ` * `public class StreamServerMessageDecoder extends ByteToMessageDecoder ` * `public class StreamServerVersionDecoder extends ByteToMessageDecoder ` * `public class ExceptionWrapper<T extends Throwable> ` * `public class RssAggregateException extends RuntimeException ` * `public class RssDiskSpaceException extends RssException ` * `public class RssDuplicateAppTaskAttemptException extends RssException ` * `public class RssEndOfStreamException extends RssException ` * `public class RssException extends RuntimeException ` * `public class RssFileCorruptedException extends RssException ` * `public class RssFinishUploadException extends RssException ` * `public class RssInconsistentReplicaException extends RssException ` * `public class RssInvalidDataException extends RssException ` * `public class RssInvalidMapStatusException extends RssException ` * `public class RssInvalidServerIdException extends RssException ` * `public class RssInvalidStateException extends RssException ` * `public class RssMaxConnectionsException extends Exception ` * `public class RssMissingShuffleWriteConfigException extends RssException ` * `public class RssNetworkException extends RssException ` * `public class RssNoActiveReadClientException extends RssException ` * `public class RssNoServerAvailableException extends RssException ` * `public class RssNonRecoverableException extends RssException ` * `public class RssOperationQueueFullException extends RssException ` * `public class RssQueueNotReadyException extends RssException ` * `public class RssRetryTimeoutException extends RssException ` * `public class RssRetryableSparkTaskException extends RssException ` * `public class RssServerBusyException extends RssException ` * `public class RssServerDownException extends RssException ` * `public class RssServerResolveException extends RssException ` * `public class RssShuffleCorruptedException extends RssException ` * `public class RssShuffleDataNotAvailableException extends RssException ` * `public class RssShuffleStageNotStartedException extends RssException ` * `public class RssStaleTaskAttemptException extends RssException ` * `public class RssStreamReadException extends RssException ` * `public class RssTooMuchDataException extends RssException ` * `public class RssUberEnvironmentException extends RssException ` * `public class RssUnsupportedCompressionException extends RssException ` * `public class RssWriteRecordException extends RssException ` * `public class ExecutorAppState ` * `public class ExecutorShuffleStageState ` * `public class LocalFileStateStore implements StateStore ` * `public class LocalFileStateStoreIterator implements Iterator<BaseMessage>, AutoCloseable ` * `public class ShuffleDataWrapper ` * `public class ShuffleExecutor ` * `public class ShufflePartitionWriter ` * `public class StagePersistentInfo ` * `public class StateStoreLoadResult ` * `public class TaskAttemptCollection ` * `public class TaskAttemptIdAndState ` * `public class ChannelFutureCloseListener implements ChannelFutureListener ` * `public class ChannelIdleCheck implements Runnable ` * `public class DownloadChannelInboundHandler extends ChannelInboundHandlerAdapter ` * `public class DownloadServerHandler ` * `public class HandlerUtil ` * `public class HttpChannelInboundHandler extends ChannelInboundHandlerAdapter ` * `public class NotifyChannelInboundHandler extends ChannelInboundHandlerAdapter ` * `public class NotifyServerHandler ` * `public class RegistryChannelInboundHandler extends ChannelInboundHandlerAdapter ` * `public class RegistryServerHandler ` * `public class ResponseStatusAndMessage<T> ` * `public class UploadChannelInboundHandler extends ChannelInboundHandlerAdapter ` * `public class UploadChannelManager ` * `public class UploadServerHandler ` * `public class AppDeletionStateItem extends BaseMessage ` * `public abstract class BaseMessage extends SerializableMessage ` * `public class ConnectDownloadRequest extends BaseMessage ` * `public class ConnectDownloadResponse extends ServerResponseMessage ` * `public class ConnectNotifyRequest extends BaseMessage ` * `public class ConnectNotifyResponse extends ServerResponseMessage ` * `public class ConnectRegistryRequest extends BaseMessage ` * `public class ConnectRegistryResponse extends ServerResponseMessage ` * `public class ConnectUploadRequest extends BaseMessage ` * `public class ConnectUploadResponse extends ServerResponseMessage ` * `public abstract class ControlMessage extends BaseMessage ` * `public class FinishApplicationAttemptRequestMessage extends ControlMessage ` * `public class FinishApplicationJobRequestMessage extends ControlMessage ` * `public class FinishUploadMessage extends BaseMessage ` * `public class GetBusyStatusRequest extends BaseMessage ` * `public class GetBusyStatusResponse extends BaseMessage ` * `public class GetDataAvailabilityRequest extends BaseMessage ` * `public class GetDataAvailabilityResponse extends BaseMessage ` * `public class GetServersRequestMessage extends ControlMessage ` * `public class GetServersResponseMessage extends ServerResponseMessage ` * `public class HeartbeatMessage extends BaseMessage ` * `public class MessageConstants ` * `public class RegisterServerRequestMessage extends ControlMessage ` * `public class RegisterServerResponseMessage extends ServerResponseMessage ` * `public abstract class SerializableMessage ` * `public abstract class ServerResponseMessage extends BaseMessage ` * `public class ShuffleDataWrapper ` * `public class ShuffleStageStatus extends SerializableMessage ` * `public class StageCorruptionStateItem extends BaseMessage ` * `public class StageInfoStateItem extends BaseMessage ` * `public class StartUploadMessage extends BaseMessage ` * `public class TaskAttemptCommitStateItem extends BaseMessage ` * `public class InMemoryServiceRegistry implements ServiceRegistry ` * `public class ServerSequenceServiceRegistry implements ServiceRegistry ` * `public class ServiceRegistryUtils ` * `public class ServiceRegistryWrapper implements ServiceRegistry ` * `public class StandaloneServiceRegistryClient implements ServiceRegistry ` * `public class ApplicationJobStatusMetrics extends MetricGroup<ApplicationJobStatusMetricsKey> ` * `public class ApplicationJobStatusMetricsKey ` * `public class ApplicationMetrics extends MetricGroup<ApplicationMetricsKey> ` * `public class ApplicationMetricsKey ` * `public class ClientConnectMetrics extends MetricGroup<ClientConnectMetricsKey> ` * `public class ClientConnectMetricsKey ` * `public class ExceptionMetricGroupContainer ` * `public class ExceptionMetrics extends MetricGroup<ExceptionMetricsKey> ` * `public class ExceptionMetricsKey ` * `public class M3DummyScope implements Scope ` * `public class M3DummyScopeBuilder extends RootScopeBuilder ` * `public class M3Stats ` * ` .format(\"Failed to create ScopeBuilder instance from class name %s\",` * `public class MetadataClientMetrics extends MetricGroup<MetadataClientMetricsKey> ` * `public class MetadataClientMetricsContainer ` * `public class MetadataClientMetricsKey ` * `public abstract class MetricGroup<K> implements AutoCloseable ` * `public class MetricGroupContainer<K, M extends MetricGroup<K>> ` * `public class NettyServerSideMetricGroupContainer<M extends MetricGroup<NettyServerSideMetricsKey>> ` * `public class NettyServerSideMetricsKey ` * `public class NotifyClientMetrics extends MetricGroup<NotifyClientMetricsKey> ` * `public class NotifyClientMetricsKey ` * `public class NotifyServerMetricsContainer ` * `public class ReadClientMetrics extends MetricGroup<ReadClientMetricsKey> ` * `public class ReadClientMetricsKey ` * `public class ScheduledMetricCollector ` * `public class ServerHandlerMetrics extends MetricGroup<NettyServerSideMetricsKey> ` * `public class ShuffleClientStageMetrics extends MetricGroup<ShuffleClientStageMetricsKey> ` * `public class ShuffleClientStageMetricsKey ` * `public class WriteClientMetrics extends MetricGroup<WriteClientMetricsKey> ` * `public class WriteClientMetricsKey ` * `public class ShuffleFileOutputStream implements ShuffleOutputStream ` * `public class ShuffleFileStorage implements ShuffleStorage ` * `public class ShuffleFileUtils ` * `public class FileDescriptorStressTest ` * `public class FsyncPerfTest ` * `public class PartitionFileChecker ` * `public class SerializerBenchmark ` * `public class StreamReadClientVerify ` * `public class StreamServerStressTool ` * `public class StreamServerStressToolLongRun ` * `public class StreamServerStressToolWrite64GB ` * `public class TestUtils ` * `public class AsyncSocketCompletionHandler implements CompletionHandler<Integer, AsyncSocketState> ` * `public class AsyncSocketState ` * `public class ByteBufUtils ` * `public class CountedOutputStream extends OutputStream ` * `public class ExceptionUtils ` * `public class FileUtils ` * `public class HttpUtils ` * `public class JsonUtils ` * `public class LogUtils ` * `public class MonitorUtils ` * `public class MovingAverageCalculator ` * `public class NettyUtils ` * `public class NetworkUtils ` * `public class ObjectWrapper<T> ` * `public class RateCounter ` * `public class RetryUtils ` * `public class ServerHostAndPort ` * `public class SocketUtils ` * `public class StreamUtils ` * `public class StringUtils ` * `public class SystemUtils ` * `public class ThreadUtils ` * `class MockTaskContext(val mockStageId: Int, val mockPartitionId: Int,` * `class RssEmptyShuffleReader[K, C](` * `case class RssServerSelectionResult(servers: Array[ServerDetail], replicas: Int,` * `class RssShuffleBlockResolver extends ShuffleBlockResolver ` * `class RssShuffleManager(conf: SparkConf) extends ShuffleManager with Logging ` * `class RssShuffleReader[K, C](` * `case class RssShuffleServerHandle(serverId: String, connectionString: String) ` * `class RssShuffleWriter[K, V, C](` * `class BlockDownloaderPartitionRangeRecordIterator[K, C](` * `class BlockDownloaderPartitionRecordIterator[K, C](` * `class EmptyRecordIterator[K, C]() extends Iterator[Product2[K, C]] with Logging ` * `case class MapOutputRssInfo(numMaps: Int, numRssServers: Int, taskAttemptIds: Array[Long]) ` * `class RssSparkListener(val user: String, val appId: String, val attemptId: String,` * `class RssStressTool extends Logging ` * `case class BufferManagerOptions(individualBufferSize: Int, individualBufferMax: Int,` * `case class WriterBufferManagerValue(serializeStream: SerializationStream, output: Output)` * `class WriteBufferManager(serializer: Serializer,` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
