Hadoop和數據庫數據遷移工具 Apache Sqoop 1.4.2 發布

Sqoop是一個用來將Hadoop和關系型數據庫中的數據相互轉移的工具，可以將一個關系型數據庫（例如 ： MySQL ,Oracle ,Postgres等）中的數據導入到Hadoop的HDFS中，也可以將HDFS的數據導入到關系型數據庫中。

Sub-task

• [SQOOP-470] - Create tests for blob support for Avro import

Bug

• [SQOOP-352] - Export of avro data imported from database table (using sqoop import) fails on year
• [SQOOP-410] - Direct modes can't import views
• [SQOOP-425] - Sqoop invokes ResultSet.isLast() which causes Sybase JDBC driver to hang
• [SQOOP-445] - Wrong query for getListColumnsQuery in PostgresqlManager
• [SQOOP-448] - boolean fields get nullified during postgres direct import into hive.
• [SQOOP-450] - Direct MySQL import can fail when using mysqldump version 5.1.14 or above.
• [SQOOP-452] - Mysql free form queries fail if alias is not used.
• [SQOOP-453] - Oozie does not work with Sqoop metastore
• [SQOOP-454] - Upgrade dependency on HBase version 0.92.0-SNAPSHOT as it was already released
• [SQOOP-460] - Verbose logging does not turn the level for correct logger
• [SQOOP-468] - Oracle free form queries fail.
• [SQOOP-473] - Sqoop import-all-tables fails with MySQL connector
• [SQOOP-474] - Split-by specification incorrectly triggers bounding value query
• [SQOOP-476] - If table name is a qualified name, Sqoop import fails in DB2
• [SQOOP-480] - MS SQL server connector and OraOop connector are incompatible with Sqoop-1.4
• [SQOOP-481] - Sqoop import with --hive-import using wrong column names in --columns throws a NPE
• [SQOOP-482] - import tool for mysql direct mode reports wrong record number
• [SQOOP-488] - Parameter for extended verbose is not working due to migrated code to different module
• [SQOOP-489] - Cannot define partition keys for Hive tables created through Sqoop
• [SQOOP-490] - Style error in the trunk
• [SQOOP-503] - --columns argument support for export
• [SQOOP-505] - Trailing space after jar in managers.d/connectors causes file not found
• [SQOOP-508] - Sqoop metastore cannot be started due to missing hsqldb jar file
• [SQOOP-521] - Import fails on tables with names containing hyphens ( - )
• [SQOOP-524] - hsqldb jar update regression
• [SQOOP-528] - Remove references to incubator from sources
• [SQOOP-536] - Blob import doesn't work with avro 1.7.1
• [SQOOP-539] - getPrimaryKeyQuery is very slow in mysql 5.0.77
• [SQOOP-571] - Revert SQOOP-519 and SQOOP-524

新版本改進記錄請看：ReleaseNotes