This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/maven/org.apache.derby-derby-10.17.1.0
in repository https://gitbox.apache.org/repos/asf/systemds.git
discard 3c413a5768 choose 10.16.1.1 derby version for Java 11
discard c3e9b082dd Bump org.apache.derby:derby from 10.14.2.0 to 10.17.1.0
add f1f37e724c [MINOR] Update syntax and deprecated in docker
add b41eccbdd1 [MINOR] C++ Build parallel
add 9781e1069b [MINOR] 100% test coverage of Dense-Sparse conversion of
Matrices
add 70fec49b27 [MINOR] LOG4j test ignore native support of HDFS
add 41db04537d [MINOR] Add Federated Timeouts
add a2aea092a8 [SYSTEMDS-3659] Federated GitHub Actions Fail
add d01c61d7d5 [MINOR] Performance improvement of dist
add 7f795aebd8 Bump actions/upload-artifact from 3 to 4 (#1962)
add 4b0133f4f3 Bump actions/download-artifact from 3 to 4 (#1963)
add 5898293b8d [SYSTEMDS-3660] GPU cache eviction operator and related
rewrite This patch introduces a new operator, _evict, to clean up the free
pointer cached in the lineage cache. A shift in the allocation pattern leads to
large eviction overhead and memory fragmentation. To address that, we
speculatively clear a fraction of the free pointers. Currently, we place a
_evict before every mini-batch processing.
add 96c620674f [MINOR] Write compressed test fix
add e6b54129f3 [MINOR] Reduce Epochs PararmservTest
add 1c26e2d299 [SYSTEMDS-3636] Improved ultra-sparse TSMM left w/ sparse
output
add 3b48c4ae5b [SYSTEMDS-3545] Linearized Img Sample Shear & Rotate
add 246eea9784 [MINOR] Uncompressed ColGroup Outer TSMM
add cca92a9b29 Bump actions/setup-python from 4 to 5
add 61a385fc9d [SYSTEMDS-2985] Fix nested list cache management
add 17103e2fe7 [MINOR] Convert Spaces to Tabs
add c957a19fd2 [MINOR] Fix code quality issues (value types, imports,
casts)
add 8a52a6832c [SYSTEMDS-3661] New contains-vector parameterized built-in
function
add 543303d843 [MINOR] gitIgnore test files & refine javatest
add 1519123fd5 [MINOR] Fix logging in spoof compiler
add b1fb351f59 [MINOR] Lop Properties toString for Debugging
add efc843fab2 [MINOR] Fix Integer overflow in Metadata for rows and cols
add 0702c5518f [MINOR] add boolean flag for binary operators
add aefed8f945 [MINOR] LibMatrixAgg sum operator without KAHAN
add a9c29800e1 [MINOR] Split lineage and count distinct GitHub Actions
add b3aac0d95b [SYSTEMDS-3592] Frame Compress Sample based
add fdd60f6d10 [SYSTEMDS-3662] Parfor Merge Sparse
add 7ecdb38a20 [MINOR] Vectorized string memory cost
add d443178a0f [SYSTEMDS-3153] Missing value imputation using KNN
add 91291b6029 [MINOR] Sparse Block pushdown operations
add 23bcd6d2b2 [MINOR] Lazy write buffer optimization
add a83a17acbf [MINOR] Python set log4j
add 736060dcc6 [MINOR] Matrix Transpose optimizations
add 3b18f06fc8 [MINOR] log4j prop Python systemds Context
add b420bdf68c [MINOR] Matrix equals empty support
add ccb589056c [MINOR] MatrixBlock improved generic Unary Agg
add ab4ec284b9 [MINOR] Change CLA to normal SUM
add b0fc281cc6 [MINOR] Fix incorrect merge of MatrixBlock
add 3e6af1b814 [SYSTEMDS-3663] Low overhead join indexes
add 5ad424a3d3 [MINOR] Fix readme federated tutorial command
add 6ab8540206 [SYSTEMDS-3657] Improved word embedding encoder / dedup
blocks
add 65a8cabe56 [SYSTEMDS-3552] New double-compressed spark row block
add 02d4b01f29 [SYSTEMDS-3656] Update Hadoop 3.3.6
add 4f52f55b89 [SYSTEMDS-3655] Update Spark Dependencies
add d69723797a Bump actions/cache from 3 to 4
add ceb50a2d21 [SYSTEMDS-3665] New rewrite for mmult-add expressions
add e3ec921e0d Bump org.apache.derby:derby from 10.14.2.0 to 10.17.1.0
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (3c413a5768)
\
N -- N -- N
refs/heads/dependabot/maven/org.apache.derby-derby-10.17.1.0 (e3ec921e0d)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/documentation.yml | 4 +-
.github/workflows/javaTests.yml | 29 +-
.github/workflows/python.yml | 10 +-
.github/workflows/release-scripts.yml | 2 +-
.gitignore | 3 +
.../sysds/validation/ValidateLicAndNotice.java | 10 +-
docker/entrypoint.sh | 2 +-
docker/testsysds.Dockerfile | 3 +-
pom.xml | 22 +-
scripts/builtin/dist.dml | 5 +-
scripts/builtin/img_rotate_linearized.dml | 62 ++
...{dist.dml => img_sample_pairing_linearized.dml} | 32 +-
.../builtin/{dist.dml => img_shear_linearized.dml} | 24 +-
scripts/builtin/img_transform_linearized.dml | 3 -
scripts/perftest/KnnMissingValueImputation.sh | 54 ++
scripts/perftest/runAll.sh | 1 +
.../perftest/scripts/ImputeByKNN.dml | 38 +-
.../staging/SIMD-double-vectors/LibMatrixMult.java | 10 +-
scripts/tutorials/federated/README.md | 2 +-
src/assembly/bin.xml | 3 +-
src/main/cpp/build.sh | 61 +-
docker/entrypoint.sh => src/main/cpp/build_BLAS.sh | 31 +-
.../Contains.dml => main/cpp/build_HE.sh} | 18 +-
.../cpp/build_mkl.sh} | 30 +-
.../java/org/apache/sysds/common/Builtins.java | 3 +
src/main/java/org/apache/sysds/common/Types.java | 2 +-
.../apache/sysds/conf/ConfigurationManager.java | 4 +
src/main/java/org/apache/sysds/hops/LiteralOp.java | 1 +
.../java/org/apache/sysds/hops/OptimizerUtils.java | 6 +
.../apache/sysds/hops/ParameterizedBuiltinOp.java | 29 +
src/main/java/org/apache/sysds/hops/UnaryOp.java | 5 +-
.../apache/sysds/hops/codegen/SpoofCompiler.java | 4 +-
.../hops/fedplanner/PrivacyConstraintLoader.java | 14 +-
.../RewriteAlgebraicSimplificationDynamic.java | 68 +-
.../sysds/hops/rewrite/RewriteGPUSpecificOps.java | 14 +-
src/main/java/org/apache/sysds/lops/Data.java | 10 -
src/main/java/org/apache/sysds/lops/Lop.java | 6 +-
.../java/org/apache/sysds/lops/LopProperties.java | 37 +-
src/main/java/org/apache/sysds/lops/Unary.java | 8 +-
.../org/apache/sysds/lops/rewrite/LopRewriter.java | 1 +
.../sysds/lops/rewrite/RewriteAddGPUEvictLop.java | 115 +++
.../sysds/parser/BuiltinFunctionExpression.java | 13 +-
.../ParameterizedBuiltinFunctionExpression.java | 9 +-
.../sysds/runtime/compress/colgroup/APreAgg.java | 2 +-
.../compress/colgroup/ColGroupUncompressed.java | 35 +-
.../compress/colgroup/indexes/AColIndex.java | 56 +-
.../compress/colgroup/indexes/ColIndexFactory.java | 2 +
.../compress/colgroup/indexes/CombinedIndex.java | 246 ++++++
.../compress/colgroup/indexes/IColIndex.java | 80 +-
.../compress/colgroup/indexes/RangeIndex.java | 84 +-
.../compress/colgroup/indexes/TwoRangesIndex.java | 4 +-
.../compress/colgroup/mapping/MapToCharPByte.java | 2 +-
.../compress/colgroup/mapping/MapToFactory.java | 4 +-
.../colgroup/scheme/CompressionScheme.java | 2 +-
.../compress/colgroup/scheme/SDCSchemeSC.java | 2 +-
.../colgroup/scheme/UncompressedScheme.java | 56 +-
.../sysds/runtime/compress/io/DictWritable.java | 120 +--
.../runtime/compress/io/ReaderSparkCompressed.java | 156 ++--
.../sysds/runtime/compress/lib/CLALibCompAgg.java | 53 +-
.../sysds/runtime/compress/lib/CLALibMerge.java | 28 +-
.../runtime/compress/utils/ACountHashMap.java | 2 +-
.../runtime/controlprogram/ParForProgramBlock.java | 7 +-
.../controlprogram/caching/LazyWriteBuffer.java | 117 ++-
.../controlprogram/context/ExecutionContext.java | 69 +-
.../context/SparkExecutionContext.java | 7 +-
.../federated/FederatedStatistics.java | 8 +-
.../controlprogram/federated/FederationUtils.java | 12 +-
.../CompressionDecoderEndStatisticsHandler.java | 20 +-
.../CompressionDecoderStartStatisticsHandler.java | 16 +-
.../CompressionEncoderEndStatisticsHandler.java | 20 +-
.../CompressionEncoderStartStatisticsHandler.java | 16 +-
.../monitoring/services/StatisticsService.java | 14 +-
.../controlprogram/parfor/ResultMergeMatrix.java | 192 +++--
.../org/apache/sysds/runtime/data/DenseBlock.java | 19 +
.../apache/sysds/runtime/data/DenseBlockFP64.java | 2 +-
.../sysds/runtime/data/DenseBlockFP64DEDUP.java | 25 +-
.../apache/sysds/runtime/data/LibTensorAgg.java | 3 +-
.../org/apache/sysds/runtime/data/SparseBlock.java | 32 +-
.../apache/sysds/runtime/data/SparseBlockDCSR.java | 946 +++++++++++++++++++++
.../sysds/runtime/data/SparseBlockFactory.java | 6 +-
.../apache/sysds/runtime/data/SparseBlockMCSR.java | 25 +-
.../org/apache/sysds/runtime/data/SparseRow.java | 13 +-
.../apache/sysds/runtime/data/SparseRowScalar.java | 31 +-
.../apache/sysds/runtime/data/SparseRowVector.java | 30 +-
.../org/apache/sysds/runtime/data/TensorBlock.java | 3 +-
.../runtime/frame/data/columns/ABooleanArray.java | 18 +
.../sysds/runtime/frame/data/columns/Array.java | 124 ++-
.../runtime/frame/data/columns/ArrayFactory.java | 11 +-
.../runtime/frame/data/columns/BitSetArray.java | 4 +-
.../runtime/frame/data/columns/BooleanArray.java | 8 +-
.../runtime/frame/data/columns/CharArray.java | 6 +-
.../sysds/runtime/frame/data/columns/DDCArray.java | 165 +++-
.../runtime/frame/data/columns/DoubleArray.java | 10 +-
.../runtime/frame/data/columns/FloatArray.java | 21 +-
.../runtime/frame/data/columns/HashLongArray.java | 57 +-
.../runtime/frame/data/columns/IntegerArray.java | 8 +-
.../runtime/frame/data/columns/LongArray.java | 8 +-
.../runtime/frame/data/columns/OptionalArray.java | 95 ++-
.../runtime/frame/data/columns/RaggedArray.java | 4 +-
.../runtime/frame/data/columns/StringArray.java | 87 +-
.../data/compress/ArrayCompressionStatistics.java | 12 +-
.../data/compress/CompressedFrameBlockFactory.java | 28 +-
.../frame/data/lib/FrameLibApplySchema.java | 15 +-
.../frame/data/lib/FrameLibDetectSchema.java | 25 +-
.../sysds/runtime/frame/data/lib/FrameUtil.java | 4 +-
.../apache/sysds/runtime/functionobjects/And.java | 5 +
.../sysds/runtime/functionobjects/Equals.java | 5 +
.../sysds/runtime/functionobjects/GreaterThan.java | 5 +
.../runtime/functionobjects/GreaterThanEquals.java | 6 +
.../sysds/runtime/functionobjects/LessThan.java | 5 +
.../runtime/functionobjects/LessThanEquals.java | 5 +
.../apache/sysds/runtime/functionobjects/Not.java | 5 +
.../sysds/runtime/functionobjects/NotEquals.java | 5 +
.../apache/sysds/runtime/functionobjects/Or.java | 5 +
.../runtime/functionobjects/ValueFunction.java | 14 +-
.../apache/sysds/runtime/functionobjects/Xor.java | 5 +
.../runtime/instructions/CPInstructionParser.java | 5 +
.../runtime/instructions/cp/CPInstruction.java | 1 +
.../runtime/instructions/cp/CiphertextMatrix.java | 19 +-
.../sysds/runtime/instructions/cp/Encrypted.java | 48 +-
.../instructions/cp/EvictCPInstruction.java | 49 ++
.../instructions/cp/FunctionCallCPInstruction.java | 3 +-
.../sysds/runtime/instructions/cp/ListObject.java | 58 +-
.../cp/ParameterizedBuiltinCPInstruction.java | 12 +-
.../instructions/cp/UnaryScalarCPInstruction.java | 1 -
.../spark/AggregateUnarySPInstruction.java | 2 +-
.../spark/AggregateUnarySketchSPInstruction.java | 508 +++++------
.../spark/ParameterizedBuiltinSPInstruction.java | 66 +-
.../spark/utils/FrameRDDAggregateUtils.java | 6 +-
.../sysds/runtime/io/FrameWriterTextCSV.java | 6 +-
.../sysds/runtime/io/FrameWriterTextCell.java | 6 +-
.../sysds/runtime/io/WriterMatrixMarket.java | 2 +-
.../apache/sysds/runtime/lineage/LineageCache.java | 1 +
.../runtime/lineage/LineageGPUCacheEviction.java | 8 +-
.../sysds/runtime/matrix/data/CM_N_COVCell.java | 6 -
.../sysds/runtime/matrix/data/LibMatrixAgg.java | 265 +++++-
.../data/LibMatrixAggUnarySpecialization.java | 152 ++++
.../sysds/runtime/matrix/data/LibMatrixCuDNN.java | 5 +-
.../runtime/matrix/data/LibMatrixDatagen.java | 38 +-
.../matrix/data/LibMatrixDenseToSparse.java | 20 +-
.../sysds/runtime/matrix/data/LibMatrixEquals.java | 41 +-
.../sysds/runtime/matrix/data/LibMatrixMult.java | 118 ++-
.../runtime/matrix/data/LibMatrixOuterAgg.java | 173 ++--
.../sysds/runtime/matrix/data/LibMatrixReorg.java | 321 +++++--
.../sysds/runtime/matrix/data/LibMatrixSketch.java | 62 +-
.../matrix/data/LibMatrixSparseToDense.java | 10 +-
.../sysds/runtime/matrix/data/MatrixBlock.java | 267 ++----
.../sysds/runtime/matrix/data/MatrixCell.java | 39 +-
.../sysds/runtime/matrix/data/MatrixValue.java | 6 +-
.../sysds/runtime/matrix/data/TripleIndexes.java | 2 +-
.../sysds/runtime/matrix/data/WeightedCell.java | 9 +-
.../org/apache/sysds/runtime/meta/MetaDataAll.java | 6 +-
.../encode/ColumnEncoderWordEmbedding.java | 57 +-
.../transform/encode/MultiColumnEncoder.java | 25 +-
.../sysds/runtime/util/BinaryBlockInputFormat.java | 2 +-
.../apache/sysds/runtime/util/DataConverter.java | 4 +-
.../org/apache/sysds/runtime/util/HDFSTool.java | 10 +-
.../apache/sysds/runtime/util/PorterStemmer.java | 29 +-
.../org/apache/sysds/runtime/util/SortUtils.java | 749 ++++++++--------
.../java/org/apache/sysds/utils/JSONHelper.java | 2 +-
.../org/apache/sysds/utils/MemoryEstimates.java | 26 +-
.../stats/FederatedCompressionStatistics.java | 80 +-
.../python/systemds/context/systemds_context.py | 21 +-
.../python/systemds/operator/algorithm/__init__.py | 6 +
.../systemds/operator/algorithm/builtin/auc.py | 2 +-
.../builtin/{auc.py => img_rotate_linearized.py} | 27 +-
.../{auc.py => img_sample_pairing_linearized.py} | 25 +-
.../builtin/{auc.py => img_shear_linearized.py} | 29 +-
.../org/apache/sysds/test/AutomatedTestBase.java | 74 +-
src/test/java/org/apache/sysds/test/TestUtils.java | 6 +-
.../test/applications/ApplyTransformTest.java | 2 +-
.../BivariateCategoricalCategoricallTest.java | 2 +-
.../test/applications/BivariateScaleScaleTest.java | 6 +-
.../sysds/test/applications/LinearLogRegTest.java | 114 ++-
.../test/applications/MDABivariateStatsTest.java | 2 +-
.../sysds/test/applications/MultiClassSVMTest.java | 8 +-
.../sysds/test/applications/NaiveBayesTest.java | 10 +-
.../test/applications/OrderStatisticsTest.java | 120 ++-
.../applications/UnivariateCategoricalTest.java | 96 +--
.../apache/sysds/test/applications/WelchTTest.java | 52 +-
.../sysds/test/applications/nn/TestFolder.java | 10 +-
.../component/compress/CompressedLoggingTests.java | 10 +-
.../component/compress/colgroup/ColGroupTest.java | 21 +-
.../compress/colgroup/CustomColGroupTest.java | 47 +-
.../colgroup/scheme/UncompressedSchemeTest.java | 40 +-
.../sysds/test/component/compress/io/IOTest.java | 28 +-
.../compress/mapping/CustomMappingTest.java | 40 +-
.../compress/offset/CustomOffsetTest.java | 14 +-
.../component/compress/offset/OffsetTests.java | 14 +-
.../offset/OffsetTestsDefaultConstructor.java | 10 +-
.../test/component/compress/util/hashTest.java | 84 +-
.../component/frame/FrameSerializationTest.java | 5 +
.../sysds/test/component/frame/FrameUtilTest.java | 92 +-
.../component/frame/array/CustomArrayTests.java | 20 +-
.../component/frame/array/FrameArrayTests.java | 7 +-
.../frame/compress/FrameCompressTest.java | 17 +
.../frame/compress/FrameCompressTestUtils.java | 8 +-
.../test/component/matrix/DenseAndSparseTest.java | 212 +++++
.../test/component/matrix/MatrixMultiplyTest.java | 122 ++-
.../test/component/misc/NumPartsFilesTest.java | 92 +-
.../component/sparse/SparseBlockAlignment.java | 39 +-
.../component/sparse/SparseBlockAppendSort.java | 32 +
.../test/component/sparse/SparseBlockDelete.java | 17 +
.../component/sparse/SparseBlockGetFirstIndex.java | 47 +
.../test/component/sparse/SparseBlockGetSet.java | 70 +-
.../component/sparse/SparseBlockIndexRange.java | 32 +
.../test/component/sparse/SparseBlockIterator.java | 32 +
.../component/sparse/SparseBlockMemEstimate.java | 5 +
.../test/component/sparse/SparseBlockMerge.java | 140 +++
.../test/component/sparse/SparseBlockScan.java | 17 +
.../test/component/sparse/SparseBlockSize.java | 21 +-
.../test/functions/aggregate/ColStdDevsTest.java | 419 ++++-----
.../sysds/test/functions/aggregate/ColSumTest.java | 145 ++--
.../test/functions/aggregate/ColSumsSqTest.java | 364 ++++----
.../test/functions/aggregate/ColVariancesTest.java | 672 +++++++--------
.../test/functions/aggregate/ContainsTest.java | 127 ++-
.../sysds/test/functions/aggregate/LengthTest.java | 99 +--
.../sysds/test/functions/aggregate/MaxTest.java | 147 ++--
.../sysds/test/functions/aggregate/MinTest.java | 147 ++--
.../sysds/test/functions/aggregate/NColTest.java | 99 +--
.../sysds/test/functions/aggregate/NRowTest.java | 99 +--
.../sysds/test/functions/aggregate/ProdTest.java | 147 ++--
.../test/functions/aggregate/RowStdDevsTest.java | 419 ++++-----
.../sysds/test/functions/aggregate/RowSumTest.java | 137 +--
.../test/functions/aggregate/RowSumsSqTest.java | 364 ++++----
.../test/functions/aggregate/RowVariancesTest.java | 672 +++++++--------
.../sysds/test/functions/aggregate/StdDevTest.java | 417 ++++-----
.../sysds/test/functions/aggregate/SumSqTest.java | 364 ++++----
.../sysds/test/functions/aggregate/SumTest.java | 147 ++--
.../sysds/test/functions/aggregate/TraceTest.java | 97 +--
.../test/functions/aggregate/VarianceTest.java | 418 ++++-----
...llVectorVectorCellwiseCompareOperationTest.java | 2 +-
.../FullMatrixMultiplicationTransposeSelfTest.java | 27 +-
.../sysds/test/functions/blocks/VariableTest.java | 262 +++---
.../sysds/test/functions/blocks/WhileTest.java | 131 ++-
...> BuiltinImageSamplePairingLinearizedTest.java} | 79 +-
.../part1/BuiltinImageTranslateLinearizedTest.java | 181 ++--
.../builtin/part1/BuiltinImputeKNNTest.java | 75 +-
.../builtin/part1/BuiltinKNNGraphTest.java | 100 +--
.../test/functions/caching/PinVariablesTest.java | 152 ++++
.../federated/io/FederatedCompressionTest.java | 234 ++---
.../functions/federated/io/FederatedReaderCSV.java | 155 ++--
.../paramserv/EncryptedFederatedParamservTest.java | 34 +-
.../primitives/FederatedCovarianceTest.java | 180 ----
.../primitives/FederatedQuantileTest.java | 215 -----
.../primitives/FederatedQuantileWeightsTest.java | 203 -----
.../{ => part1}/FederatedBinaryMatrixTest.java | 73 +-
.../{ => part1}/FederatedBinaryVectorTest.java | 71 +-
.../{ => part1}/FederatedBroadcastTest.java | 46 +-
.../{ => part1}/FederatedCastToFrameTest.java | 59 +-
.../{ => part1}/FederatedCastToMatrixTest.java | 81 +-
.../{ => part1}/FederatedCentralMomentTest.java | 109 +--
.../{ => part1}/FederatedColAggregateTest.java | 149 ++--
.../{ => part1}/FederatedConstructionTest.java | 72 +-
.../{ => part1}/FederatedLeftIndexTest.java | 130 ++-
.../{ => part1}/FederatedMisAlignedTest.java | 134 +--
.../{ => part2}/FederatedMultiplyTest.java | 72 +-
.../{ => part2}/FederatedNegativeTest.java | 2 +-
.../primitives/{ => part2}/FederatedProdTest.java | 105 +--
.../primitives/part2/FederatedQuantileTest.java | 249 ++++++
.../part2/FederatedQuantileWeightsTest.java | 226 +++++
.../{ => part2}/FederatedRCBindTest.java | 113 +--
.../primitives/{ => part2}/FederatedRdiagTest.java | 117 +--
.../{ => part2}/FederatedRemoveEmptyTest.java | 87 +-
.../{ => part2}/FederatedReplaceTest.java | 101 +--
.../{ => part2}/FederatedReshapeTest.java | 107 ++-
.../primitives/{ => part2}/FederatedRevTest.java | 105 +--
.../{ => part2}/FederatedRightIndexTest.java | 103 +--
.../{ => part2}/FederatedRowIndexTest.java | 101 +--
.../primitives/{ => part3}/FederatedSplitTest.java | 77 +-
.../{ => part3}/FederatedStatisticsTest.java | 86 +-
.../primitives/{ => part3}/FederatedSumTest.java | 88 +-
.../{ => part3}/FederatedTokenizeTest.java | 101 ++-
.../FederatedTransferLocalDataTest.java | 76 +-
.../primitives/{ => part3}/FederatedTriTest.java | 98 ++-
.../FederatedWeightedCrossEntropyTest.java | 104 +--
.../FederatedWeightedDivMatrixMultTest.java | 97 ++-
.../{ => part3}/FederatedWeightedSigmoidTest.java | 84 +-
.../FederatedWeightedSquaredLossTest.java | 69 +-
.../FederatedWeightedUnaryMatrixMultTest.java | 69 +-
.../{ => part4}/FederatedLogicalTest.java | 254 +++---
.../{ => part4}/FederatedRowAggregateTest.java | 135 +--
.../primitives/part5/FederatedCovarianceTest.java | 193 +++++
.../{ => part5}/FederatedCtableTest.java | 119 +--
.../{ => part5}/FederatedFrameMapTest.java | 101 +--
.../{ => part5}/FederatedFullAggregateTest.java | 135 +--
.../{ => part5}/FederatedFullCumulativeTest.java | 151 ++--
.../{ => part5}/FederatedIfelseTest.java | 121 +--
.../{ => part5}/FederatedMMChainTest.java | 125 +--
.../FederatedMatrixScalarOperationsTest.java | 2 +-
.../functions/homomorphicEncryption/InOutTest.java | 144 ++--
.../lineage/GPULineageCacheEvictionTest.java | 16 +-
.../misc/InvalidFunctionSignatureTest.java | 14 +-
.../paramserv/ParamservLocalNNAveragingTest.java | 23 +-
.../ParForMultipleDataPartitioningTest.java | 2 +-
.../pipelines/BuiltinImageRotateLinTest.java | 116 +++
.../pipelines/BuiltinImageShearLinTest.java | 122 +++
.../pipelines/BuiltinImageTransformLinTest.java | 219 +++--
.../quaternary/WeightedSquaredLossTest.java | 337 ++++----
.../rewrite/RewriteDistributiveMatrixMultTest.java | 107 +++
.../test/functions/transform/TokenizeTest.java | 365 ++++----
.../TransformFrameEncodeWordEmbedding1Test.java | 5 +-
.../TransformFrameEncodeWordEmbedding2Test.java | 5 +
.../functions/unary/matrix/CastAsScalarTest.java | 47 +-
.../test/functions/unary/matrix/PrintTest.java | 8 +-
.../functions/unary/scalar/StopTestCtrlStr.java | 68 +-
.../java/org/apache/sysds/test/usertest/Base.java | 152 ++--
.../expected/ImageTransformLinRotated.csv | 1 +
.../expected/ImageTransformLinTransformed.csv | 1 -
src/test/resources/log4j.properties | 2 +-
.../aggregate/{Contains.dml => ContainsVal.dml} | 0
.../aggregate/{Contains.dml => ContainsVect.dml} | 13 +-
.../image_rotate_linearized.dml} | 19 +-
.../image_sample_pairing_linearized.dml} | 39 +-
.../image_shear_linearized.dml} | 20 +-
.../functions/builtin/image_transform_linearized.R | 1 +
.../functions/lineage/GPUCacheEviction6.dml | 746 ++++++++++++++++
.../rewrite/RewriteDistributiveMatrixMult.R | 31 +-
.../RewriteDistributiveMatrixMult.dml} | 18 +-
.../TransformFrameEncodeWordEmbeddings.dml | 10 +-
320 files changed, 14843 insertions(+), 9457 deletions(-)
create mode 100644 scripts/builtin/img_rotate_linearized.dml
copy scripts/builtin/{dist.dml => img_sample_pairing_linearized.dml} (56%)
copy scripts/builtin/{dist.dml => img_shear_linearized.dml} (58%)
create mode 100755 scripts/perftest/KnnMissingValueImputation.sh
copy
src/test/scripts/functions/transform/TransformFrameEncodeWordEmbeddings.dml =>
scripts/perftest/scripts/ImputeByKNN.dml (55%)
mode change 100644 => 100755
copy docker/entrypoint.sh => src/main/cpp/build_BLAS.sh (54%)
copy src/{test/scripts/functions/aggregate/Contains.dml =>
main/cpp/build_HE.sh} (76%)
mode change 100644 => 100755
copy
src/{test/scripts/functions/transform/TransformFrameEncodeWordEmbeddings.dml =>
main/cpp/build_mkl.sh} (56%)
mode change 100644 => 100755
create mode 100644
src/main/java/org/apache/sysds/lops/rewrite/RewriteAddGPUEvictLop.java
create mode 100644
src/main/java/org/apache/sysds/runtime/compress/colgroup/indexes/CombinedIndex.java
create mode 100644
src/main/java/org/apache/sysds/runtime/data/SparseBlockDCSR.java
create mode 100644
src/main/java/org/apache/sysds/runtime/instructions/cp/EvictCPInstruction.java
create mode 100644
src/main/java/org/apache/sysds/runtime/matrix/data/LibMatrixAggUnarySpecialization.java
copy src/main/python/systemds/operator/algorithm/builtin/{auc.py =>
img_rotate_linearized.py} (58%)
copy src/main/python/systemds/operator/algorithm/builtin/{auc.py =>
img_sample_pairing_linearized.py} (62%)
copy src/main/python/systemds/operator/algorithm/builtin/{auc.py =>
img_shear_linearized.py} (56%)
create mode 100644
src/test/java/org/apache/sysds/test/component/matrix/DenseAndSparseTest.java
copy
src/test/java/org/apache/sysds/test/functions/builtin/part1/{BuiltinImageTranslateLinearizedTest.java
=> BuiltinImageSamplePairingLinearizedTest.java} (59%)
create mode 100644
src/test/java/org/apache/sysds/test/functions/caching/PinVariablesTest.java
delete mode 100644
src/test/java/org/apache/sysds/test/functions/federated/primitives/FederatedCovarianceTest.java
delete mode 100644
src/test/java/org/apache/sysds/test/functions/federated/primitives/FederatedQuantileTest.java
delete mode 100644
src/test/java/org/apache/sysds/test/functions/federated/primitives/FederatedQuantileWeightsTest.java
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part1}/FederatedBinaryMatrixTest.java (71%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part1}/FederatedBinaryVectorTest.java (71%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part1}/FederatedBroadcastTest.java (73%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part1}/FederatedCastToFrameTest.java (70%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part1}/FederatedCastToMatrixTest.java (72%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part1}/FederatedCentralMomentTest.java (58%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part1}/FederatedColAggregateTest.java (66%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part1}/FederatedConstructionTest.java (78%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part1}/FederatedLeftIndexTest.java (65%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part1}/FederatedMisAlignedTest.java (69%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part2}/FederatedMultiplyTest.java (71%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part2}/FederatedNegativeTest.java (97%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part2}/FederatedProdTest.java (60%)
create mode 100644
src/test/java/org/apache/sysds/test/functions/federated/primitives/part2/FederatedQuantileTest.java
create mode 100644
src/test/java/org/apache/sysds/test/functions/federated/primitives/part2/FederatedQuantileWeightsTest.java
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part2}/FederatedRCBindTest.java (55%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part2}/FederatedRdiagTest.java (58%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part2}/FederatedRemoveEmptyTest.java (64%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part2}/FederatedReplaceTest.java (62%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part2}/FederatedReshapeTest.java (60%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part2}/FederatedRevTest.java (63%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part2}/FederatedRightIndexTest.java (73%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part2}/FederatedRowIndexTest.java (62%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part3}/FederatedSplitTest.java (70%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part3}/FederatedStatisticsTest.java (65%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part3}/FederatedSumTest.java (62%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part3}/FederatedTokenizeTest.java (61%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part3}/FederatedTransferLocalDataTest.java (61%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part3}/FederatedTriTest.java (61%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part3}/FederatedWeightedCrossEntropyTest.java (61%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part3}/FederatedWeightedDivMatrixMultTest.java (75%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part3}/FederatedWeightedSigmoidTest.java (74%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part3}/FederatedWeightedSquaredLossTest.java (72%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part3}/FederatedWeightedUnaryMatrixMultTest.java (75%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part4}/FederatedLogicalTest.java (62%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part4}/FederatedRowAggregateTest.java (70%)
create mode 100644
src/test/java/org/apache/sysds/test/functions/federated/primitives/part5/FederatedCovarianceTest.java
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part5}/FederatedCtableTest.java (70%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part5}/FederatedFrameMapTest.java (59%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part5}/FederatedFullAggregateTest.java (69%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part5}/FederatedFullCumulativeTest.java (60%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part5}/FederatedIfelseTest.java (70%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part5}/FederatedMMChainTest.java (59%)
rename src/test/java/org/apache/sysds/test/functions/federated/primitives/{ =>
part5}/FederatedMatrixScalarOperationsTest.java (99%)
create mode 100644
src/test/java/org/apache/sysds/test/functions/pipelines/BuiltinImageRotateLinTest.java
create mode 100644
src/test/java/org/apache/sysds/test/functions/pipelines/BuiltinImageShearLinTest.java
create mode 100644
src/test/java/org/apache/sysds/test/functions/rewrite/RewriteDistributiveMatrixMultTest.java
create mode 100644 src/test/resources/expected/ImageTransformLinRotated.csv
delete mode 100644 src/test/resources/expected/ImageTransformLinTransformed.csv
copy src/test/scripts/functions/aggregate/{Contains.dml => ContainsVal.dml}
(100%)
copy src/test/scripts/functions/aggregate/{Contains.dml => ContainsVect.dml}
(81%)
copy src/test/scripts/functions/{aggregate/Contains.dml =>
builtin/image_rotate_linearized.dml} (71%)
copy
src/test/scripts/functions/{transform/TransformFrameEncodeWordEmbeddings.dml =>
builtin/image_sample_pairing_linearized.dml} (56%)
copy src/test/scripts/functions/{aggregate/Contains.dml =>
builtin/image_shear_linearized.dml} (69%)
create mode 100644 src/test/scripts/functions/lineage/GPUCacheEviction6.dml
copy docker/entrypoint.sh =>
src/test/scripts/functions/rewrite/RewriteDistributiveMatrixMult.R (61%)
mode change 100755 => 100644
rename src/test/scripts/functions/{aggregate/Contains.dml =>
rewrite/RewriteDistributiveMatrixMult.dml} (84%)
