[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2022-01-04 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 8:

Build Successful

https://jenkins.impala.io/job/gerrit-code-review-checks/9967/ : Initial code 
review checks passed. Use gerrit-verify-dryrun-external or gerrit-verify-dryrun 
to run full precommit tests.


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 8
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Wed, 05 Jan 2022 03:55:34 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2022-01-04 Thread Aman Sinha (Code Review)
Aman Sinha has submitted this change and it was merged. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..

IMPALA-10934 (Part 2): Enable table definition over a single file

This patch adds an end-to-end test to validate and characterize HMS'
behavior with respect to external table creation after HIVE-25569 via
which a user is allowed to create an external table associated with a
single file.

Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Reviewed-on: http://gerrit.cloudera.org:8080/18033
Tested-by: Impala Public Jenkins 
Reviewed-by: Aman Sinha 
---
M bin/rat_exclude_files.txt
A testdata/data/sfs_d1.parq
A testdata/data/sfs_d2.txt
A testdata/data/sfs_d3.parq
A testdata/data/sfs_d4.txt
A testdata/workloads/functional-query/queries/QueryTest/sfs.test
M tests/common/file_utils.py
A tests/query_test/test_sfs.py
8 files changed, 360 insertions(+), 6 deletions(-)

Approvals:
  Impala Public Jenkins: Verified
  Aman Sinha: Looks good to me, approved

--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: merged
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 9
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2022-01-04 Thread Aman Sinha (Code Review)
Aman Sinha has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 7: Code-Review+2

Carry forward prior +2


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 7
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Wed, 05 Jan 2022 03:23:49 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2022-01-04 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 7: Verified+1


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 7
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Wed, 05 Jan 2022 02:49:11 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2022-01-04 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 7:

Build Successful

https://jenkins.impala.io/job/gerrit-code-review-checks/9962/ : Initial code 
review checks passed. Use gerrit-verify-dryrun-external or gerrit-verify-dryrun 
to run full precommit tests.


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 7
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Tue, 04 Jan 2022 20:30:24 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2022-01-04 Thread Fang-Yu Rao (Code Review)
Fang-Yu Rao has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 7:

> Patch Set 7:
>
> > Patch Set 6:
> >
> > > Patch Set 6:
> > >
> > > (1 comment)
> > >
> > > > Patch Set 6: Verified-1
> > > >
> > > > Build failed: https://jenkins.impala.io/job/gerrit-verify-dryrun/7712/
> > >
> > > Fang-Yu, could you address the LOCATION related failure as mentioned 
> > > below?
> > > More details of the error: 
> > > https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/5080/
> >
> > Taking a closer look at the console output of the Jenkins job, I think I 
> > should use $DEFAULT_FS to replace each occurrence of 
> > "hdfs://localhost:20500" since $DEFAULT_FS is not necessarily 
> > "hdfs://localhost:20500" in every test environment.
>
> In the updated patch set (patch set 7), I replaced each occurrence of 
> "localhost" with $INTERNAL_LISTEN_HOST since this is a string that will be 
> replaced in our test framework according to 
> https://github.com/apache/impala/blob/master/tests/common/impala_test_suite.py#L534L535.

The link above was wrong. I think it should be 
https://github.com/apache/impala/blob/master/tests/common/impala_test_suite.py#L470
 instead. But the patch should still pass according to my current understanding.


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 7
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Tue, 04 Jan 2022 20:29:19 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2022-01-04 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 7:

Build started: https://jenkins.impala.io/job/gerrit-verify-dryrun/7714/ 
DRY_RUN=false


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 7
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Tue, 04 Jan 2022 20:27:49 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2022-01-04 Thread Fang-Yu Rao (Code Review)
Fang-Yu Rao has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 7:

Hi all, I have fixed sfs.test to not hardcode the host name to "localhost". 
Hopefully this time the pre-commit tests could pass.


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 7
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Tue, 04 Jan 2022 20:12:42 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2022-01-04 Thread Fang-Yu Rao (Code Review)
Fang-Yu Rao has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 7:

> Patch Set 6:
>
> > Patch Set 6:
> >
> > (1 comment)
> >
> > > Patch Set 6: Verified-1
> > >
> > > Build failed: https://jenkins.impala.io/job/gerrit-verify-dryrun/7712/
> >
> > Fang-Yu, could you address the LOCATION related failure as mentioned below?
> > More details of the error: 
> > https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/5080/
>
> Taking a closer look at the console output of the Jenkins job, I think I 
> should use $DEFAULT_FS to replace each occurrence of "hdfs://localhost:20500" 
> since $DEFAULT_FS is not necessarily "hdfs://localhost:20500" in every test 
> environment.

In the updated patch set (patch set 7), I replaced each occurrence of 
"localhost" with $INTERNAL_LISTEN_HOST since this is a string that will be 
replaced in our test framework according to 
https://github.com/apache/impala/blob/master/tests/common/impala_test_suite.py#L534L535.


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 7
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Tue, 04 Jan 2022 20:11:13 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2022-01-04 Thread Fang-Yu Rao (Code Review)
Fang-Yu Rao has uploaded a new patch set (#7). ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..

IMPALA-10934 (Part 2): Enable table definition over a single file

This patch adds an end-to-end test to validate and characterize HMS'
behavior with respect to external table creation after HIVE-25569 via
which a user is allowed to create an external table associated with a
single file.

Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
---
M bin/rat_exclude_files.txt
A testdata/data/sfs_d1.parq
A testdata/data/sfs_d2.txt
A testdata/data/sfs_d3.parq
A testdata/data/sfs_d4.txt
A testdata/workloads/functional-query/queries/QueryTest/sfs.test
M tests/common/file_utils.py
A tests/query_test/test_sfs.py
8 files changed, 360 insertions(+), 6 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/33/18033/7
--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 7
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2022-01-04 Thread Fang-Yu Rao (Code Review)
Fang-Yu Rao has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 6:

> Patch Set 6:
>
> (1 comment)
>
> > Patch Set 6: Verified-1
> >
> > Build failed: https://jenkins.impala.io/job/gerrit-verify-dryrun/7712/
>
> Fang-Yu, could you address the LOCATION related failure as mentioned below?
> More details of the error: 
> https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/5080/

Taking a closer look at the console output of the Jenkins job, I think I should 
use $DEFAULT_FS to replace each occurrence of "hdfs://localhost:20500" since 
$DEFAULT_FS is not necessarily "hdfs://localhost:20500" in every test 
environment.


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 6
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Tue, 04 Jan 2022 17:30:08 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2022-01-03 Thread Fang-Yu Rao (Code Review)
Fang-Yu Rao has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 6:

> Patch Set 6:
>
> (1 comment)
>
> > Patch Set 6: Verified-1
> >
> > Build failed: https://jenkins.impala.io/job/gerrit-verify-dryrun/7712/
>
> Fang-Yu, could you address the LOCATION related failure as mentioned below?
> More details of the error: 
> https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/5080/

Thanks Aman! I will take a closer look at this failed test and see how to fix 
the test.


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 6
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Tue, 04 Jan 2022 06:03:39 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2022-01-03 Thread Aman Sinha (Code Review)
Aman Sinha has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 6:

(1 comment)

> Patch Set 6: Verified-1
>
> Build failed: https://jenkins.impala.io/job/gerrit-verify-dryrun/7712/

Fang-Yu, could you address the LOCATION related failure as mentioned below?
More details of the error: 
https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/5080/

http://gerrit.cloudera.org:8080/#/c/18033/6/testdata/workloads/functional-query/queries/QueryTest/sfs.test
File testdata/workloads/functional-query/queries/QueryTest/sfs.test:

http://gerrit.cloudera.org:8080/#/c/18033/6/testdata/workloads/functional-query/queries/QueryTest/sfs.test@4
PS6, Line 4: LOCATION 
'sfs+hdfs://localhost:20500/test-warehouse/$DATABASE.db/sfs_d1.parq/#SINGLEFILE#'
The gerrit-verify run failed due to LOCATION pointing to localhost. I believe 
this should be using the $FILESYSTEM_PREFIX parameterized variable.



--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 6
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Tue, 04 Jan 2022 03:13:25 +
Gerrit-HasComments: Yes


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2022-01-03 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 6: Verified-1

Build failed: https://jenkins.impala.io/job/gerrit-verify-dryrun/7712/


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 6
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Tue, 04 Jan 2022 01:40:06 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2022-01-03 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 6:

Build Successful

https://jenkins.impala.io/job/gerrit-code-review-checks/9961/ : Initial code 
review checks passed. Use gerrit-verify-dryrun-external or gerrit-verify-dryrun 
to run full precommit tests.


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 6
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Mon, 03 Jan 2022 19:41:06 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2022-01-03 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 6:

Build started: https://jenkins.impala.io/job/gerrit-verify-dryrun/7712/ 
DRY_RUN=false


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 6
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Mon, 03 Jan 2022 19:20:39 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2021-12-20 Thread Joe McDonnell (Code Review)
Joe McDonnell has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 5: Code-Review+2

Thanks for adding the extra test cases, this looks good.


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 5
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Mon, 20 Dec 2021 18:48:10 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2021-12-19 Thread Aman Sinha (Code Review)
Aman Sinha has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 5: Code-Review+1

Test coverage and the test output looks good to me.


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 5
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Mon, 20 Dec 2021 02:24:07 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2021-12-16 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 5:

Build Successful

https://jenkins.impala.io/job/gerrit-code-review-checks/9941/ : Initial code 
review checks passed. Use gerrit-verify-dryrun-external or gerrit-verify-dryrun 
to run full precommit tests.


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 5
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Thu, 16 Dec 2021 19:26:38 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2021-12-16 Thread Fang-Yu Rao (Code Review)
Fang-Yu Rao has uploaded a new patch set (#5). ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..

IMPALA-10934 (Part 2): Enable table definition over a single file

This patch adds an end-to-end test to validate and characterize HMS'
behavior with respect to external table creation after HIVE-25569 via
which a user is allowed to create an external table associated with a
single file.

Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
---
M bin/rat_exclude_files.txt
A testdata/data/sfs_d1.parq
A testdata/data/sfs_d2.txt
A testdata/data/sfs_d3.parq
A testdata/data/sfs_d4.txt
A testdata/workloads/functional-query/queries/QueryTest/sfs.test
M tests/common/file_utils.py
A tests/query_test/test_sfs.py
8 files changed, 358 insertions(+), 6 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/33/18033/5
--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 5
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2021-12-16 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 4:

Build Failed

https://jenkins.impala.io/job/gerrit-code-review-checks/9940/ : Initial code 
review checks failed. See linked job for details on the failure.


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 4
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Thu, 16 Dec 2021 17:29:44 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2021-12-16 Thread Fang-Yu Rao (Code Review)
Fang-Yu Rao has uploaded a new patch set (#4). ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..

IMPALA-10934 (Part 2): Enable table definition over a single file

This patch adds an end-to-end test to validate and characterize HMS'
behavior with respect to external table creation after HIVE-25569 via
which a user is allowed to create an external table associated with a
single file.

Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
---
M bin/rat_exclude_files.txt
A testdata/data/sfs_d1.parq
A testdata/data/sfs_d2.txt
A testdata/data/sfs_d3.parq
A testdata/data/sfs_d4.txt
A testdata/workloads/functional-query/queries/QueryTest/sfs.test
M tests/common/file_utils.py
A tests/query_test/test_sfs.py
8 files changed, 358 insertions(+), 6 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/33/18033/4
--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 4
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2021-12-15 Thread Joe McDonnell (Code Review)
Joe McDonnell has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 3:

(2 comments)

These are useful tests. I have a couple small comments, but I think we can go 
forward with this and part 1.

http://gerrit.cloudera.org:8080/#/c/18033/3/testdata/workloads/functional-query/queries/QueryTest/sfs.test
File testdata/workloads/functional-query/queries/QueryTest/sfs.test:

http://gerrit.cloudera.org:8080/#/c/18033/3/testdata/workloads/functional-query/queries/QueryTest/sfs.test@38
PS3, Line 38:  QUERY
: INSERT INTO TABLE test_tbl_01 VALUES ('x', 100);
:  CATCH
: row_regex: .*Unable to INSERT into target table .+ because .+ is 
not a supported filesystem.*
: 
:  QUERY
: INSERT INTO TABLE test_tbl_02 VALUES ('x', 100);
:  CATCH
: row_regex: .*Unable to INSERT into target table .+ because .+ is 
not a supported filesystem.*
: 
:  QUERY
: LOAD DATA INPATH 
'hdfs://localhost:20500/test-warehouse/$DATABASE.db/sfs_d3.parq' INTO TABLE 
test_tbl_01
:  CATCH
: Unsupported SFS filesystem operation!
: 
:  QUERY
: LOAD DATA INPATH 
'hdfs://localhost:20500/test-warehouse/$DATABASE.db/sfs_d4.txt' INTO TABLE 
test_tbl_02
:  CATCH
: Unsupported SFS filesystem operation!
: 
:  QUERY
: LOAD DATA INPATH 
'sfs+hdfs://localhost:20500/test-warehouse/$DATABASE.db/sfs_d3.parq/#SINGLEFILE#'
 INTO TABLE test_tbl_01
:  CATCH
: row_regex: .*INPATH location .+ must point to one of the 
supported filesystem URI scheme.*
: 
:  QUERY
: LOAD DATA INPATH 
'sfs+hdfs://localhost:20500/test-warehouse/$DATABASE.db/sfs_d4.txt/#SINGLEFILE#'
 INTO TABLE test_tbl_02
:  CATCH
: row_regex: .*INPATH location .+ must point to one of the 
supported filesystem URI scheme.*
Let's add a case for TRUNCATE TABLE. I'm guessing it should fail and not delete 
the file?

https://impala.apache.org/docs/build/html/topics/impala_truncate_table.html

Let's also call COMPUTE STATS just to make sure it works.


http://gerrit.cloudera.org:8080/#/c/18033/3/testdata/workloads/functional-query/queries/QueryTest/sfs.test@157
PS3, Line 157:  QUERY
 : DROP TABLE test_tbl_03;
 : DROP TABLE test_tbl_04
It would be nice to have a test case that verifies that the files are still 
there. Maybe create another table that references the same location and select 
to show it is still there.



--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 3
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Wed, 15 Dec 2021 21:32:08 +
Gerrit-HasComments: Yes


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2021-11-17 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 3:

Build Successful

https://jenkins.impala.io/job/gerrit-code-review-checks/9800/ : Initial code 
review checks passed. Use gerrit-verify-dryrun-external or gerrit-verify-dryrun 
to run full precommit tests.


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 3
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Wed, 17 Nov 2021 22:15:17 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2021-11-17 Thread Fang-Yu Rao (Code Review)
Fang-Yu Rao has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 3:

I updated rat_exclude_files.txt so that sfs_d2.txt and sfs_d4.txt could be 
added.


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 3
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Wed, 17 Nov 2021 21:52:52 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2021-11-17 Thread Fang-Yu Rao (Code Review)
Hello Aman Sinha, k...@rxd.hu, Joe McDonnell, Impala Public Jenkins,

I'd like you to reexamine a change. Please visit

http://gerrit.cloudera.org:8080/18033

to look at the new patch set (#3).

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..

IMPALA-10934 (Part 2): Enable table definition over a single file

This patch adds an end-to-end test to validate and characterize HMS'
behavior with respect to external table creation after HIVE-25569 via
which a user is allowed to create an external table associated with a
single file.

Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
---
M bin/rat_exclude_files.txt
A testdata/data/sfs_d1.parq
A testdata/data/sfs_d2.txt
A testdata/data/sfs_d3.parq
A testdata/data/sfs_d4.txt
A testdata/workloads/functional-query/queries/QueryTest/sfs.test
M tests/common/file_utils.py
A tests/query_test/test_sfs.py
8 files changed, 296 insertions(+), 6 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/33/18033/3
--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 3
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2021-11-17 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 2:

Build Failed

https://jenkins.impala.io/job/gerrit-code-review-checks/9798/ : Initial code 
review checks failed. See linked job for details on the failure.


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 2
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Wed, 17 Nov 2021 21:40:38 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2021-11-17 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 1:

Build Failed

https://jenkins.impala.io/job/gerrit-code-review-checks/9797/ : Initial code 
review checks failed. See linked job for details on the failure.


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 1
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Wed, 17 Nov 2021 21:32:10 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2021-11-17 Thread Fang-Yu Rao (Code Review)
Fang-Yu Rao has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 2:

(4 comments)

I have revised the previous patch according to the comments from flake8.

http://gerrit.cloudera.org:8080/#/c/18033/1/tests/query_test/test_sfs.py
File tests/query_test/test_sfs.py:

http://gerrit.cloudera.org:8080/#/c/18033/1/tests/query_test/test_sfs.py@25
PS1, Line 25:
> flake8: E302 expected 2 blank lines, found 1
Done


http://gerrit.cloudera.org:8080/#/c/18033/1/tests/query_test/test_sfs.py@37
PS1, Line 37:
> flake8: E712 comparison to False should be 'if cond is False:' or 'if not c
Done


http://gerrit.cloudera.org:8080/#/c/18033/1/tests/query_test/test_sfs.py@45
PS1, Line 45:
> flake8: E501 line too long (91 > 90 characters)
Done


http://gerrit.cloudera.org:8080/#/c/18033/1/tests/query_test/test_sfs.py@50
PS1, Line 50: r
> flake8: W292 no newline at end of file
Done



--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 2
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Wed, 17 Nov 2021 21:21:52 +
Gerrit-HasComments: Yes


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2021-11-17 Thread Fang-Yu Rao (Code Review)
Hello Aman Sinha, k...@rxd.hu, Joe McDonnell, Impala Public Jenkins,

I'd like you to reexamine a change. Please visit

http://gerrit.cloudera.org:8080/18033

to look at the new patch set (#2).

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..

IMPALA-10934 (Part 2): Enable table definition over a single file

This patch adds an end-to-end test to validate and characterize HMS'
behavior with respect to external table creation after HIVE-25569 via
which a user is allowed to create an external table associated with a
single file.

Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
---
A testdata/data/sfs_d1.parq
A testdata/data/sfs_d2.txt
A testdata/data/sfs_d3.parq
A testdata/data/sfs_d4.txt
A testdata/workloads/functional-query/queries/QueryTest/sfs.test
M tests/common/file_utils.py
A tests/query_test/test_sfs.py
7 files changed, 294 insertions(+), 6 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/33/18033/2
--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 2
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2021-11-17 Thread Fang-Yu Rao (Code Review)
Fang-Yu Rao has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 1:

Hi all, please review this patch and let me know if you have any suggestion or 
comment. Thanks!


--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 1
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Aman Sinha 
Gerrit-Reviewer: Anonymous Coward 
Gerrit-Reviewer: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Reviewer: Joe McDonnell 
Gerrit-Comment-Date: Wed, 17 Nov 2021 21:11:01 +
Gerrit-HasComments: No


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2021-11-17 Thread Impala Public Jenkins (Code Review)
Impala Public Jenkins has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/18033 )

Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..


Patch Set 1:

(4 comments)

http://gerrit.cloudera.org:8080/#/c/18033/1/tests/query_test/test_sfs.py
File tests/query_test/test_sfs.py:

http://gerrit.cloudera.org:8080/#/c/18033/1/tests/query_test/test_sfs.py@25
PS1, Line 25: class TestSFS(ImpalaTestSuite):
flake8: E302 expected 2 blank lines, found 1


http://gerrit.cloudera.org:8080/#/c/18033/1/tests/query_test/test_sfs.py@37
PS1, Line 37: =
flake8: E712 comparison to False should be 'if cond is False:' or 'if not cond:'


http://gerrit.cloudera.org:8080/#/c/18033/1/tests/query_test/test_sfs.py@45
PS1, Line 45: )
flake8: E501 line too long (91 > 90 characters)


http://gerrit.cloudera.org:8080/#/c/18033/1/tests/query_test/test_sfs.py@50
PS1, Line 50:
flake8: W292 no newline at end of file



--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 1
Gerrit-Owner: Fang-Yu Rao 
Gerrit-Reviewer: Impala Public Jenkins 
Gerrit-Comment-Date: Wed, 17 Nov 2021 21:10:16 +
Gerrit-HasComments: Yes


[Impala-ASF-CR] IMPALA-10934 (Part 2): Enable table definition over a single file

2021-11-17 Thread Fang-Yu Rao (Code Review)
Fang-Yu Rao has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/18033


Change subject: IMPALA-10934 (Part 2): Enable table definition over a single 
file
..

IMPALA-10934 (Part 2): Enable table definition over a single file

This patch adds an end-to-end test to validate and characterize HMS'
behavior with respect to external table creation after HIVE-25569 via
which a user is allowed to create an external table associated with a
single file.

Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
---
A testdata/data/sfs_d1.parq
A testdata/data/sfs_d2.txt
A testdata/data/sfs_d3.parq
A testdata/data/sfs_d4.txt
A testdata/workloads/functional-query/queries/QueryTest/sfs.test
M tests/common/file_utils.py
A tests/query_test/test_sfs.py
7 files changed, 292 insertions(+), 6 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/33/18033/1
--
To view, visit http://gerrit.cloudera.org:8080/18033
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: Ia4f57f07a9f543c660b102ebf307a6cf590a6784
Gerrit-Change-Number: 18033
Gerrit-PatchSet: 1
Gerrit-Owner: Fang-Yu Rao