Sqoop Supported Databases


1. Objective

Basically, we can not use every database out of the box, also some databases may be used in an inefficient manner in Sqoop. So, in this article, we will study Sqoop supported databases. Also, we mention the specific versions of databases for which Sqoop supports.

 Introduction to Sqoop Supported Databases

Sqoop Supported Databases – Introduction

2. Introduction to Sqoop Supported Databases

Basically, JDBC is a compatibility layer. However, that allows a program to access many different databases through a common API. Although slight differences in the SQL language spoken by each database may mean that we can not use every database out of the box, also some databases may be used in an inefficient manner in Sqoop.

To be more specific, while we offer a connect string to Sqoop, it inspects the protocol scheme to determine appropriate vendor-specific logic to use. Moreover, Sqoop works automatically if Sqoop knows about a given database. Instead, we may need to specify the driver class to load –driver. Basically, this will use a generic code path Although, that will use standard SQL to access the database. Likewise, It offers some databases with faster, non-JDBC-based access mechanisms. Though, these can be enabled by specifying the –direct parameter.

Let’s revise Sqoop Features & Sqoop Architecture 

Moreover, for the several Sqoop Supported databases, includes vendor-specific support:

Databaseversion–direct support?connect string matches
HSQLDB1.8.0+Nojdbc:hsqldb:*//
MySQL5.0+Yesjdbc:mysql://
Oracle10.2.0+Nojdbc:oracle:*//
PostgreSQL8.3+Yes (import only)jdbc:postgresql://
CUBRID9.2+NOjdbc:cubrid:*

Although, we would like to specify that Sqoop may work with older versions of the databases listed. Since we have only tested it with the versions specified above.

Make sure you need to install the database vendor’s JDBC driver in your $SQOOP_HOME/lib path on your clientEen even if it Sqoop supports database internally. Moreover, Sqoop can load classes from any jars in $SQOOP_HOME/lib on the client. Also, will use them as part of any MapReduce jobs it runs. However, we no longer need to install JDBC jars in the Hadoop library path on your servers, unlike older versions.

3. Conclusion

As a result, we have seen all possible Sqoop supported databases. Also, with information of specific versions. So, if you want to ask any query regarding, feel free to ask. we will definitely respond.

See Also- Sqoop Jobs & Sqoop Codegen

For reference

Leave a comment

Your email address will not be published. Required fields are marked *