how to provide validation in sqoop command

Free Online Certification Courses – Learn Today. Lead Tomorrow. Forums Apache Hadoop how to provide validation in sqoop command

Viewing 1 reply thread
  • Author
    Posts
    • #4894
      DataFlair TeamDataFlair Team
      Spectator

      how to provide validation in sqoop command

    • #4895
      DataFlair TeamDataFlair Team
      Spectator

      Syntax of Sqoop Validation
      $ sqoop import (generic-args) (import-args)

      $ sqoop export (generic-args) (export-args)

      Well, validation argument is part of import as well as export argument.

      Sqoop Validation Configuration

      The validation framework in Sqoop is extensible as well as pluggable. Though, it comes along with default implementations. Also, we can extend the interfaces in order to allow custom implementations which is possible by passing them as part of the command line arguments, like:

      a. Validator
      Property – Validator
      Description – Basically, for validation, Validator is a Driver, though it must implement org.apache.sqoop.validation.Validator
      Supported values – Also, make sure that the value must be a fully qualified class name
      Default value – org.apache.sqoop.validation.RowCountValidator

      b. Validation Threshold
      Property- Validation-threshold
      Description- It drives the decision on the basis of validation meeting the threshold or not. Must implement
      org.apache.sqoop. validation.ValidationThreshold
      Supported values- Here, also it is important that the value has to be a fully qualified class name.
      Default value- org.apache.sqoop.validation.AbsoluteValidationThreshold

      c. Validation Failure Handler
      Property- Validation-failurehandler
      Description- Basically, it is responsible for handling failures, must implement org.apache.sqoop.validation.ValidationFailureHandler
      Supported values- Make sure that the value has to be a fully qualified class name
      Default value- org.apache.sqoop.validation.AbortOnFailureHandler

      Although, we can learn more on Sqoop Validation, for that follow the link: Sqoop Validation – Interfaces & Limitations of Sqoop Validate

Viewing 1 reply thread
  • You must be logged in to reply to this topic.