apiHdfsReplicationArguments
Replication arguments for HDFS.
JSON
| property | type | description |
|---|---|---|
| sourceService | sourceService (apiServiceRef) | The service to replicate from. |
| sourcePath | sourcePath (string) | The path to replicate. |
| destinationPath | destinationPath (string) | The destination to replicate to. |
| mapreduceServiceName | mapreduceServiceName (string) | The mapreduce service to use for the replication job. |
| schedulerPoolName | schedulerPoolName (string) | Name of the scheduler pool to use when submitting the MapReduce job. If using the fair scheduler, the MapReduce service needs to be configured so that the fair scheduler pool property name is not the default "user.name". If the default property name is being used, the "proxyUser" will be used to control the pool for the job. |
| userName | userName (string) | The user which will execute the MapReduce job. Required if running with Kerberos enabled. |
| numMaps | numMaps (int) | The number of mappers to use for the mapreduce replication job. |
| dryRun | dryRun (boolean) | Whether to perform a dry run. Defaults to false. |
| bandwidthPerMap | bandwidthPerMap (int) | The maximum bandwidth (in MB) per mapper in the mapreduce replication job. |
| abortOnError | abortOnError (boolean) | Whether to abort on a replication failure. Defaults to false. |
| removeMissingFiles | removeMissingFiles (boolean) | Whether to delete destination files that are missing in source. Defaults to false. |
| preserveReplicationCount | preserveReplicationCount (boolean) | Whether to preserve the HDFS replication count. Defaults to false. |
| preserveBlockSize | preserveBlockSize (boolean) | Whether to preserve the HDFS block size. Defaults to false. |
| preservePermissions | preservePermissions (boolean) | Whether to preserve the HDFS owner, group and permissions. Defaults to false. |
| logPath | logPath (string) | The HDFS path where the replication log files should be written to. |
| skipChecksumChecks | skipChecksumChecks (boolean) | Whether to skip checksum based file validation/comparison during replication. Defaults to false. |