Re: Copy data from Mainframe to HDFS

2013-07-23 Thread Mohammad Tariq
Hello Sandeep, You don't have to convert the data in order to copy it into the HDFS. But you might have to think about the MR processing of these files because of the format of these files. You could probably make use of Sqoop http://sqoop.apache.org/. I also came across DMX-H a few days ago

Re: Copy data from Mainframe to HDFS

2013-07-23 Thread Raj K Singh
in mainframe you can have 3 type of datasources --flat files --VSAM files --DB2/IMS DB2 or IMS supprt the export utilities to copy the data into flat file which you can get through ftp/sftp VSAM file can be exported using IDCAMS utility flat files can be get using the ftp/sftp

Re: Copy data from Mainframe to HDFS

2013-07-23 Thread Balamurali
Hi, I configured hadoop-1.0.3, hbase-0.92.1 and hive-0.10.0 . Created table in HBase.Inserted records.Processing the data using Hive. I have to show a graph with some points ( 7 - 7 days or 12 for one year).In one day records may include 1000 - lacks.I need to show average of these 1000 - lacks

RE: Copy data from Mainframe to HDFS

2013-07-23 Thread Devaraj k
, you can ask the same in Hive mailing list. Thanks Devaraj k From: Balamurali [mailto:balamurali...@gmail.com] Sent: 23 July 2013 12:42 To: user Subject: Re: Copy data from Mainframe to HDFS Hi, I configured hadoop-1.0.3, hbase-0.92.1 and hive-0.10.0 . Created table in HBase.Inserted

Re: Copy data from Mainframe to HDFS

2013-07-23 Thread Sandeep Nemuri
** ** *From:* Balamurali [mailto:balamurali...@gmail.com] *Sent:* 23 July 2013 12:42 *To:* user *Subject:* Re: Copy data from Mainframe to HDFS ** ** Hi, I configured hadoop-1.0.3, hbase-0.92.1 and hive-0.10.0 . Created table in HBase.Inserted records.Processing the data using

Re: Copy data from Mainframe to HDFS

2013-07-23 Thread Jun Ping Du
Message - From: Sandeep Nemuri nhsande...@gmail.com To: user@hadoop.apache.org Sent: Tuesday, July 23, 2013 7:04:56 PM Subject: Re: Copy data from Mainframe to HDFS Thanks for your reply guys , i am looking for open source do we have any ?? On Tue, Jul 23, 2013 at 12:53 PM, Devaraj k