Bhagaban,
First step is to ingest data into Hadoop using sqoop.
Teradata has powerful connectors to Hadoop where the connectors are to be
installed on all data nodes and then run imports using fast export etc.,
Challenge would be to create the same workflows in Hadoop that you had in
teradata.
>From TD perspective have a look at this - https://youtu.be/NTTQdAfZMJA They
are planning to opensource it. Perhaps you can get in touch with the team.
Let me know if you are interested. If you are TD contacts, ask about this,
they should be able to point to the right people.
Again, this is not
Hi,
I think Cloudera Navigator Optimizer is the tool you are looking for. It allows
you to transform SQL queries (TD) into Impala and Hive.
http://blog.cloudera.com/blog/2015/11/introducing-cloudera-navigator-optimizer-for-optimal-sql-workload-efficiency-on-apache-hadoop/
Sorry, I don't have much insight about this apart from basic Sqoop. AFAIK,
it is more of vendor specific, you may need to dig more into that line.
Thanks,
Rakesh
On Mon, Aug 1, 2016 at 11:38 PM, Bhagaban Khatai
wrote:
> Thanks Rakesh for the useful information. But we
Thanks Rakesh for the useful information. But we are using sqoop for data
transfer but all TD logic we are implementing thru Hive.
But it's taking time by using mapping provided by TD team and the same
logic we are implementing.
What I want some tool or ready-made framework so that development
I will suggest to also look at TPT from teradata which is much faster than
sqoop
On 01-Aug-2016 6:17 pm, "Gmail" wrote:
> Hi Bhagaban
>
> I have seen more efficient way of data transfer by fast exporting the data
> and put them directly in HDFS. And then create structure as
Hi Bhagaban
I have seen more efficient way of data transfer by fast exporting the data and
put them directly in HDFS. And then create structure as per the data in HIVE or
PIG. We have developed DDL transformation script using shell script which can
convert the TERADATA DDL to Hive DDL. This
rg>
Subject: Re: Teradata into hadoop Migration
Hi Bhagaban,
Perhaps, you can try "Apache Sqoop" to transfer data to Hadoop from Teradata.
Apache Sqoop provides an efficient approach for transferring large data between
Hadoop related systems and structured data stores. It allows
Hi Bhagaban,
Perhaps, you can try "Apache Sqoop" to transfer data to Hadoop from
Teradata. Apache Sqoop provides an efficient approach for transferring
large data between Hadoop related systems and structured data stores. It
allows support for a data store to be added as a so-called connector and
Hi Guys-
I need a quick help if anybody done any migration project in TD into hadoop.
We have very tight deadline and I am trying to find any tool (online or
paid) for quick development.
Please help us here and guide me if any other way is available to do the
development fast.
Bhagaban
10 matches
Mail list logo