[GitHub] [spark] sarutak commented on a change in pull request #32631: [SPARK-35483][INFRA] Add docker-integration-tests to run-tests.py and GA.

2021-05-27 Thread GitBox
sarutak commented on a change in pull request #32631: URL: https://github.com/apache/spark/pull/32631#discussion_r641279731 ## File path: .github/workflows/build_and_test.yml ## @@ -625,3 +625,83 @@ jobs: with: name: unit-tests-log-tpcds--8-hadoop3.2-hive2.3

[GitHub] [spark] sarutak commented on a change in pull request #32631: [SPARK-35483][INFRA] Add docker-integration-tests to run-tests.py and GA.

2021-05-27 Thread GitBox
sarutak commented on a change in pull request #32631: URL: https://github.com/apache/spark/pull/32631#discussion_r640594017 ## File path: dev/sparktestsupport/modules.py ## @@ -743,6 +743,20 @@ def __hash__(self): ] ) +docker_integration_tests = Module( +

[GitHub] [spark] sarutak commented on a change in pull request #32631: [SPARK-35483][INFRA] Add docker-integration-tests to run-tests.py and GA.

2021-05-27 Thread GitBox
sarutak commented on a change in pull request #32631: URL: https://github.com/apache/spark/pull/32631#discussion_r640583869 ## File path: dev/run-tests.py ## @@ -122,19 +122,21 @@ def determine_modules_to_test(changed_modules, deduplicated=True): ['graphx', 'examples']

[GitHub] [spark] sarutak commented on a change in pull request #32631: [SPARK-35483][INFRA] Add docker-integration-tests to run-tests.py and GA.

2021-05-27 Thread GitBox
sarutak commented on a change in pull request #32631: URL: https://github.com/apache/spark/pull/32631#discussion_r640427313 ## File path: dev/run-tests.py ## @@ -687,6 +689,10 @@ def main(): test_modules = determine_modules_to_test(changed_modules)

[GitHub] [spark] sarutak commented on a change in pull request #32631: [SPARK-35483][INFRA] Add docker-integration-tests to run-tests.py and GA.

2021-05-26 Thread GitBox
sarutak commented on a change in pull request #32631: URL: https://github.com/apache/spark/pull/32631#discussion_r640255613 ## File path: dev/run-tests.py ## @@ -687,6 +689,10 @@ def main(): test_modules = determine_modules_to_test(changed_modules)

[GitHub] [spark] sarutak commented on a change in pull request #32631: [SPARK-35483][INFRA] Add docker-integration-tests to run-tests.py and GA.

2021-05-26 Thread GitBox
sarutak commented on a change in pull request #32631: URL: https://github.com/apache/spark/pull/32631#discussion_r640250798 ## File path: dev/run-tests.py ## @@ -687,6 +689,10 @@ def main(): test_modules = determine_modules_to_test(changed_modules)

[GitHub] [spark] sarutak commented on a change in pull request #32631: [SPARK-35483][INFRA] Add docker-integration-tests to run-tests.py and GA.

2021-05-26 Thread GitBox
sarutak commented on a change in pull request #32631: URL: https://github.com/apache/spark/pull/32631#discussion_r640251199 ## File path: external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/DockerKrbJDBCIntegrationSuite.scala ## @@ -107,7 +109,7 @@

[GitHub] [spark] sarutak commented on a change in pull request #32631: [SPARK-35483][INFRA] Add docker-integration-tests to run-tests.py and GA.

2021-05-26 Thread GitBox
sarutak commented on a change in pull request #32631: URL: https://github.com/apache/spark/pull/32631#discussion_r640250798 ## File path: dev/run-tests.py ## @@ -687,6 +689,10 @@ def main(): test_modules = determine_modules_to_test(changed_modules)

[GitHub] [spark] sarutak commented on a change in pull request #32631: [SPARK-35483][INFRA] Add docker-integration-tests to run-tests.py and GA.

2021-05-22 Thread GitBox
sarutak commented on a change in pull request #32631: URL: https://github.com/apache/spark/pull/32631#discussion_r637491302 ## File path: dev/run-tests.py ## @@ -687,6 +689,10 @@ def main(): test_modules = determine_modules_to_test(changed_modules)

[GitHub] [spark] sarutak commented on a change in pull request #32631: [SPARK-35483][INFRA] Add docker-integration-tests to run-tests.py and GA.

2021-05-22 Thread GitBox
sarutak commented on a change in pull request #32631: URL: https://github.com/apache/spark/pull/32631#discussion_r637490255 ## File path: .github/workflows/build_and_test.yml ## @@ -129,11 +135,21 @@ jobs: python3.8 -m pip install numpy 'pyarrow<3.0.0' pandas scipy

[GitHub] [spark] sarutak commented on a change in pull request #32631: [SPARK-35483][INFRA] Add docker-integration-tests to run-tests.py and GA.

2021-05-22 Thread GitBox
sarutak commented on a change in pull request #32631: URL: https://github.com/apache/spark/pull/32631#discussion_r637372632 ## File path: dev/sparktestsupport/modules.py ## @@ -743,6 +743,17 @@ def __hash__(self): ] ) +docker_integration_tests = Module( Review