Re: Re: Re: Re: Load Data from HDFS to Parquet

I do not know of a way to get Impala to read data that it does not consider a table. Are you concerned about the overhead of Impala's maintenance of the metadata? On Mon, Aug 14, 2017 at 7:57 PM, sky wrote: > Thank you, > I am currently using this way. But is there any way

Re:Re: Re: Re: Load Data from HDFS to Parquet

Thank you, I am currently using this way. But is there any way to load data from hdfs to parquet table not via external table or internal table？ At 2017-08-15 10:53:55, "Jim Apple" wrote:

Re: Re: Re: Load Data from HDFS to Parquet

http://impala.apache.org/docs/build/html/topics/impala_create_table.html#create_table I think you can follow these two steps in order: 1. Make an external table referring to the CSV 2. Use CREATE TABLE AS SELECT to make a parquet table On Mon, Aug 14, 2017 at 7:48 PM, sky

Re:Re: Re: Load Data from HDFS to Parquet

csv file on the HDFS. At 2017-08-15 10:42:13, "Jim Apple" wrote: >Is the data in a format that Impala can read? > >On Mon, Aug 14, 2017 at 7:31 PM, sky wrote: >> Thank you, >> I read the document.But it only describes the conversion of internal

Re: Re: Load Data from HDFS to Parquet

Is the data in a format that Impala can read? On Mon, Aug 14, 2017 at 7:31 PM, sky wrote: > Thank you, > I read the document.But it only describes the conversion of internal and > external tables.How to directly load data to parquet table? Could you provide > an example?

Re:Re: Load Data from HDFS to Parquet

Thank you, I read the document.But it only describes the conversion of internal and external tables.How to directly load data to parquet table? Could you provide an example? Thank You ! At 2017-08-15 03:25:43, "Jim Apple" wrote: >Maybe this will help: >

Re: how to pass constant parameter to Init() function of UDAF

If you're running an older version of Impala you could be hitting https://issues.apache.org/jira/browse/IMPALA-2379 On Mon, Aug 14, 2017 at 1:49 PM, Tim Armstrong wrote: > Hi Santanu, > Thanks for your interest. I can probably help you out given a bit more > info.

Re: how to pass constant parameter to Init() function of UDAF

Hi Santanu, Thanks for your interest. I can probably help you out given a bit more info. Whether the arguments are constant or not is determined based on analysis of the input expression to your function. In your case 1 and 100 are definitely constant. What version of Impala are you running?

how to pass constant parameter to Init() function of UDAF

I am trying to develop a UDAF which takes three parameters. SQL syntax would look like this : select myudaf(col1, 1, 100) from mytab; Here col1 is from table mytab and of type numeric (double/int etc.). The other two parameters are constants. The third parameter determines memory allocation for

Re: Load Data from HDFS to Parquet

Maybe this will help: http://impala.apache.org/docs/build/html/topics/impala_create_table.html#create_table "Although the EXTERNAL and LOCATION clauses are often specified together, LOCATION is optional for external tables, and you can also specify LOCATION for internal tables. The difference is

Re: [DISCUSS] 2.10.0 release

Agreed Tim. On Mon, Aug 14, 2017 at 9:13 AM, Tim Armstrong wrote: > Sounds good to me. We should coordinate to make sure that all of > https://issues.apache.org/jira/browse/IMPALA-3200 (the buffer pool > changes) > and related fixes make it into the release. > > - Tim >

Re: [DISCUSS] 2.10.0 release

Sounds good to me. We should coordinate to make sure that all of https://issues.apache.org/jira/browse/IMPALA-3200 (the buffer pool changes) and related fixes make it into the release. - Tim On Mon, Aug 14, 2017 at 5:52 AM, Jim Apple wrote: > This sounds like a good idea

Re: [DISCUSS] 2.10.0 release

This sounds like a good idea to me. Thank you for volunteering! On Mon, Aug 14, 2017 at 12:37 AM, Bharath Vissapragada wrote: > Folks, > > It has been almost 2 months since we released Apache Impala (incubating) > 2.9.0 and there have been new feature improvements and a

[DISCUSS] 2.10.0 release

Folks, It has been almost 2 months since we released Apache Impala (incubating) 2.9.0 and there have been new feature improvements and a good number of bug fixes checked in since then. I propose that we release 2.10.0 soon and I volunteer to be its release manager. Please speak up and let the