Free Online Certification Courses – Learn Today. Lead Tomorrow. › Forums › Apache Hadoop › how to provide validation in sqoop command
- This topic has 1 reply, 1 voice, and was last updated 5 years, 7 months ago by DataFlair Team.
-
AuthorPosts
-
-
September 20, 2018 at 12:40 pm #4894DataFlair TeamSpectator
how to provide validation in sqoop command
-
September 20, 2018 at 12:40 pm #4895DataFlair TeamSpectator
Syntax of Sqoop Validation
$ sqoop import (generic-args) (import-args)$ sqoop export (generic-args) (export-args)
Well, validation argument is part of import as well as export argument.
Sqoop Validation Configuration
The validation framework in Sqoop is extensible as well as pluggable. Though, it comes along with default implementations. Also, we can extend the interfaces in order to allow custom implementations which is possible by passing them as part of the command line arguments, like:
a. Validator
Property – Validator
Description – Basically, for validation, Validator is a Driver, though it must implement org.apache.sqoop.validation.Validator
Supported values – Also, make sure that the value must be a fully qualified class name
Default value – org.apache.sqoop.validation.RowCountValidatorb. Validation Threshold
Property- Validation-threshold
Description- It drives the decision on the basis of validation meeting the threshold or not. Must implement
org.apache.sqoop. validation.ValidationThreshold
Supported values- Here, also it is important that the value has to be a fully qualified class name.
Default value- org.apache.sqoop.validation.AbsoluteValidationThresholdc. Validation Failure Handler
Property- Validation-failurehandler
Description- Basically, it is responsible for handling failures, must implement org.apache.sqoop.validation.ValidationFailureHandler
Supported values- Make sure that the value has to be a fully qualified class name
Default value- org.apache.sqoop.validation.AbortOnFailureHandlerAlthough, we can learn more on Sqoop Validation, for that follow the link: Sqoop Validation – Interfaces & Limitations of Sqoop Validate
-
-
AuthorPosts
- You must be logged in to reply to this topic.