Re: Null Pointer Exception with tez

2014-10-03 Thread anusha Mangina
Its fixed. - Union all is not yet supported on Tez Thanks On Fri, Oct 3, 2014 at 9:23 AM, anusha Mangina wrote: > Hey Nick, > > This is the query > > INSERT INTO TABLE abc > SELECT d.employee, max(d.employeesalary),d.employee_type FROM > (SELECT a.employee, a.emp

Re: Null Pointer Exception with tez

2014-10-03 Thread anusha Mangina
Hey Nick, This is the query INSERT INTO TABLE abc SELECT d.employee, max(d.employeesalary),d.employee_type FROM (SELECT a.employee, a.employeesalary,a.dept as employee_type from table1 a UNION ALL SELECT b.employee, b.value as employeesalary,b.dept as employee_type from table2 b UNION ALL SELECT

Simple Map-Reduce hangs at Map 100% Reduce 100% for 2GB input

2014-09-26 Thread anusha Mangina
Hello My simple mapreduce program takes text as input and outputs the same text to different directories depending on the values in each record using Multipleoutputs API where i specify the baseoutputpath. it works fine for small data sets. But when it takes 2 GB It strucks either at MAP 10

Split the output file and name them

2014-09-18 Thread anusha Mangina
My output file part-r- at hive/warehouse/path/to/output_table_name/part-r- has following content inside emp1_id emp1_name emp1_salary emp1_address emp1_dob emp1_joiningdate emp2_id emp2_name emp2_salary emp2_address emp2_dob emp2_joiningdate emp3_id emp3_name emp3_salary emp3_address em

error running a MapReduce Jar in HCatalog

2014-09-15 Thread anusha Mangina
I couldn't run a HCatalog MapReduce Jar in HDInsight Syntax is %hadoop_home%/bin > Hadoop jar -files %HCAT_JAR% -libjars %lib_jars% tableone tabletwo ERROR : Caused by: java.net.URISyntaxException: Illegal character in opaque part at inde x 2: C:\apps\dist\hive-0.13.0.2.1.3.2-0002

Re: Output File Path- Directory Structure

2014-09-09 Thread anusha Mangina
values and column names excluded) On Tue, Sep 9, 2014 at 11:58 AM, anusha Mangina wrote: > Thanks Nishanth.. I got thousands of records inserted into dynamically > partitioned Tables. > > 1)Do you think this is ideal solution to CONVERT the path for every record > or didnt i underst

Output File Path- Directory Structure

2014-09-09 Thread anusha Mangina
My Table has Dynamic Partitions and creates the File Path as s3://some-bucket/pageviews/dt=20120311/key=ACME1234/site= example.com/Output-file-1 Is there something i can do so i can have the path always as s3://some-bucket/pageviews/20120311/ACME1234/example.com/Output-file-1 Please help me

Dynamic Partitioning- Partition_Naming

2014-09-08 Thread anusha Mangina
I need a table partitioned by country and then city . I created a table and INSERTed data from another table using dynamic partition. CREATE TABLE invoice_details_hive _partitioned(Invoice_Id double,Invoice_Date string,Invoice_Amount double,Paid_Date string)PARTITIONED BY(pay_country STRING,pay_l

Collect_set() of non-primitive types

2014-09-03 Thread anusha Mangina
I have a table defined as: CREATE TABLE foo ( id INT, start_time STRING, name STRING, value STRING, type STRING ) The 'name', 'value' and 'type' fields actually describe another object, and I'd like to turn these into STRUCTs, something like: CREATE TABLE bar ( id INT, start_time S