I have tested the import into hive via Kite connector as Parquet file. Here are
some hints.
1. hive-*.jar (hive-core.jar, hive-exec.jar etc.) are needed. You could
config the common.loader parameter in file server/conf/catalina.properties, or
copy jars directly into folder server/webapps/sqoop/WEB-INF/lib/.
2. libfb303-0.9.0.jar, datanucleus-api-jdo-3.2.6.jar,
datanucleus-core-3.2.10.jar, datanucleus-rdbms-3.2.9.jar are also needed.
3. Kite link information:
sqoop:000> show link -lid 4
1 link(s) to show:
link with id 4 and name kite-hive (Enabled: true, Created by root at 7/8/15
11:21 AM, Updated by root at 7/8/15 12:45 PM)
Using Connector kite-connector with id 2
Link Configuration
HDFS host and port: server-654:9083
4. Job information:
sqoop:000> show job -jid 6
1 job(s) to show:
Job with id 6 and name mysql->kite-hive (Enabled: true, Created by root at
7/8/15 11:22 AM, Updated by root at 7/8/15 3:31 PM)
Throttling resources
Extractors:
Loaders:
From link: 2
From database configuration
Schema name:
Table name: test
Table SQL statement:
Table column names:
Partition column name: id
Null value allowed for the partition column:
Boundary query:
Incremental read
Check column:
Last value:
To link: 4
To Kite Dataset Configuration
Dataset URI: dataset:hive:tmp/aaa
File format: PARQUET
5. After imported, use beeline: beeline -u
'jdbc:hive2://server-654:10000/tmp' -n root -p 123456
6. The data is correct
0: jdbc:hive2://server-654:10000/tmp> show tables;
+-----------+--+
| tab_name |
+-----------+--+
| aaa |
+-----------+--+
1 row selected (0.182 seconds)
Regards
Richard
From: Zhou, Richard [mailto:[email protected]]
Sent: Wednesday, July 08, 2015 10:27 AM
To: [email protected]
Subject: RE: Does sqoop2 surpport import from database to hive?
It is supported in 1.99.6, which has already released.
You could use Kite connector to import data to hive.
Regards
Richard
From: Lee S [mailto:[email protected]]
Sent: Wednesday, July 08, 2015 10:18 AM
To: [email protected]<mailto:[email protected]>
Subject: Re: Does sqoop2 surpport import from database to hive?
It's fixed on version 1.99.6,when will 1.99.6 be released?
On Wed, Jul 8, 2015 at 6:32 AM, Abraham Elmahrek
<[email protected]<mailto:[email protected]>> wrote:
For Sqoop2, check out this Jira:
https://issues.apache.org/jira/browse/SQOOP-1998.
If you're using the latest version of Sqoop, it's included.
-Abe
On Tue, Jul 7, 2015 at 3:19 AM, rudra tripathy
<[email protected]<mailto:[email protected]>> wrote:
Hi Leo,
There is no meaning to import data to hive as hive understand only HDFS to load
and one has to load data into hdfs.
<font face="arial black">Thanks and Regards,</font>
<font face="arial black">Rudra Prasad Tripathy</font>
<strong>Sr Technical Architect</strong>
<strong></strong>
<strong></strong>
On Tuesday, 7 July 2015 3:30 PM, Lee S
<[email protected]<mailto:[email protected]>> wrote:
Hi all:
Does hive jdbc can be used as a jdbc connector which can support importing
data to hive?
