Overview

Create and manage replication policies using Cloudera Replication Manager.

Version information

Version : 0.9.113 (BETA)

License information

URI scheme

Schemes : HTTPS

Consumes

  • application/json

Produces

  • application/json

Paths

Abort replication policy.

POST /api/v1/replicationmanager/abortPolicy

Description

Abort all running instances of the replication policy.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Resume a suspended HBase replication policy.

POST /api/v1/replicationmanager/activateHbasePolicy

Description

Resumes an HBase replication policy if it has previously been suspended. Note that if the destination cluster’s Cloudera Manager API version is higher than 50 then it resumes all HBase replication policies between the same source and destination cluster, while if it is less than 45 then it only resumes the selected policy. Resume is not available for versions between 45 and 50.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Resume all replication tasks defined by the policy.

POST /api/v1/replicationmanager/activatePolicy

Description

Resumes all replication tasks defined by the policy if the policy is currently suspended.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Resume snapshot policy.

POST /api/v1/replicationmanager/activateSnapshotPolicy

Description

Resumes a specific snapshot policy.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Collect diagnostic bundle for a policy.

POST /api/v1/replicationmanager/collectDiagnosticBundle

Description

Triggers the collection of diagnostic bundle for a policy.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Continue the setup of an HBase policy.

POST /api/v1/replicationmanager/continueHbaseSetup

Description

Continues the setup of an HBase policy. If an HBase policy has a Classic Cluster source, the HBase service on the source will not be restarted automatically. The restart on the source needs to be executed manually, and then the continue setup step has to be called. There is no need to call this command if the source cluster is not a Classic Cluster.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Create an ABFS Cloud Credential.

POST /api/v1/replicationmanager/createAbfsCredential

Description

Creates a new ABFS cloud credential.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Create an AWS Cloud Credential.

POST /api/v1/replicationmanager/createAwsCredential

Description

Creates a new AWS cloud credential.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Create a GCS Cloud Credential.

POST /api/v1/replicationmanager/createGcsCredential

Description

Creates a new GCS cloud credential.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Create an HBase Replication Policy.

POST /api/v1/replicationmanager/createHbasePolicy

Description

Creates a new HBase replication policy with the given name on a specific cluster.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Create a Replication Policy.

POST /api/v1/replicationmanager/createPolicy

Description

Creates a new replication policy with the given name on a specific cluster.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Create snapshot policy.

POST /api/v1/replicationmanager/createSnapshotPolicy

Description

Creates a snapshot policy.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Delete Cloud Credential.

POST /api/v1/replicationmanager/deleteCredential

Description

Permanently deletes a specific cloud credential.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Delete an HBase Replication Policy.

POST /api/v1/replicationmanager/deleteHbasePolicy

Description

Permanently deletes a specific HBase replication policy.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Delete Replication Policy.

POST /api/v1/replicationmanager/deletePolicy

Description

Permanently deletes a specific replication policy.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Delete snapshot policy.

POST /api/v1/replicationmanager/deleteSnapshotPolicy

Description

Permanently deletes a specific snapshot policy.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Download diagnostic bundle for a policy.

POST /api/v1/replicationmanager/downloadDiagnosticBundle

Description

Downloads the previously collected diagnostic bundle if available. Before calling, the get-command-status command shall be polled until the command’s status shows 'DOWNLOADABLE_WITH_CLI'. If the status is 'DOWNLOADABLE_WITH_URL', the result can be downloaded with the given result data URL only.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Get configuration of a cluster.

POST /api/v1/replicationmanager/getClusterConfig

Description

Retrieves configuration of a specific cluster.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Get the status of the given CM command.

POST /api/v1/replicationmanager/getCommandStatus

Description

Return the current status of the given CM command.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Get Cloud Credentials from a Cluster.

POST /api/v1/replicationmanager/getCredentials

Description

Returns cloud credentials on a specific cluster.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Retrieve time series data for an HBase replication peer.

POST /api/v1/replicationmanager/getHbaseTimeSeries

Description

Returns time series data for an HBase replication peer based on the provided parameters.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Get Snapshot Policy.

POST /api/v1/replicationmanager/getSnapshotPolicy

Description

Retrieves a specific snapshot policy from the cluster specified in the request.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Lists Cloud Credentials.

POST /api/v1/replicationmanager/listAllCredentials

Description

Provides a detailed list of cloud credentials across all available clusters.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Lists Cluster Service Statuses.

POST /api/v1/replicationmanager/listClusterServiceStatuses

Description

Provides a list of cluster service (e.g. HDFS, Hive, YARN, etc.) statuses.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Lists all clusters.

POST /api/v1/replicationmanager/listClusters

Description

Provides a detailed list of all available clusters.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

List cluster CRNs which have an active HBase policy.

POST /api/v1/replicationmanager/listPairedHbaseClusters

Description

Provides a list of cluster CRNs with active HBase policies.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Get All Replication Policies.

POST /api/v1/replicationmanager/listPolicies

Description

Provides a list of all replication policies across all available clusters.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

List policy jobs.

POST /api/v1/replicationmanager/listPolicyJobs

Description

Returns a list of jobs triggered by a replication policy.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Get All Snapshot Policies.

POST /api/v1/replicationmanager/listSnapshotPolicies

Description

Provides a list of all snapshot policies across all available clusters.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

List snapshot policy jobs.

POST /api/v1/replicationmanager/listSnapshotPolicyJobs

Description

Lists jobs triggered by a snapshot policy.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Repair a failed HBase policy.

POST /api/v1/replicationmanager/repairHbasePolicy

Description

Attempts to repair an HBase policy in failed update state by resending the last update.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Rerun policy job.

POST /api/v1/replicationmanager/rerunPolicy

Description

Instantly starts a new job of a provided policy.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Restore snapshot.

POST /api/v1/replicationmanager/restoreSnapshot

Description

Restores a specific snapshot.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Retry failed first time setup for an HBase policy.

POST /api/v1/replicationmanager/retryFailedHbaseFirstTimeSetup

Description

Runs the first time setup configuration between the source and destination clusters if the first time setup has failed for the given policy.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Retry failed snapshots for an HBase policy.

POST /api/v1/replicationmanager/retryFailedHbaseSnapshots

Description

Reruns the failed initial snapshots (and only the failed ones) in the replication policy if it has failed to replicate the existing data of some or all tables.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Suspend an HBase replication policy.

POST /api/v1/replicationmanager/suspendHbasePolicy

Description

Pauses an active HBase replication policy. Note that if the destination cluster’s Cloudera Manager API version is higher than 50 then it suspends all HBase replication policies between the same source and destination cluster, while if it is less than 45 then it only suspends the selected policy. Suspend is not available for versions between 45 and 50.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Stop all replication tasks defined by the policy.

POST /api/v1/replicationmanager/suspendPolicy

Description

Stops all replication tasks defined by the policy. Replication will resume after activating the policy.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Suspend snapshot policy.

POST /api/v1/replicationmanager/suspendSnapshotPolicy

Description

Suspends a specific snapshot policy.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Update an ABFS Cloud Credential.

POST /api/v1/replicationmanager/updateAbfsCredential

Description

Updates an existing ABFS cloud credential.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Update an AWS Cloud Credential.

POST /api/v1/replicationmanager/updateAwsCredential

Description

Updates an existing AWS cloud credential.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Update a GCS Cloud Credential.

POST /api/v1/replicationmanager/updateGcsCredential

Description

Updates an existing GCS cloud credential.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Update an HBase Replication Policy.

POST /api/v1/replicationmanager/updateHbasePolicy

Description

Updates an existing HBase replication policy with the given parameters on a specific cluster.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Update a Replication Policy.

POST /api/v1/replicationmanager/updatePolicy

Description

Updates an existing replication policy with the given parameters on a specific cluster.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Update snapshot policy.

POST /api/v1/replicationmanager/updateSnapshotPolicy

Description

Updates a snapshot policy.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Verify a source-destination cluster pair for HBase policy creation.

POST /api/v1/replicationmanager/verifyHbaseClusterPair

Description

Returns whether the cluster pair is ready for policy creation, or if there are some manual steps that need to be performed before.

Parameters

Type Name Schema

Body

input
required

Responses

HTTP Code Description Schema

200

Describes a successful response to a valid request.

default

The default response on an error.

Definitions

AbfsCloudCredentialType

ABFS cloud credential type.

Type : enum (ACCESSKEY, CLIENTKEY)

AbortPolicyRequest

Request object for abortPolicy.

Name Description Schema

clusterCrn
required

The CRN of the cluster where the replication policy is.

string

policyId
required

The ID of the policy.

string

AbortPolicyResponse

Response object for abortPolicy.

Name Description Schema

clusterCrn
optional

The CRN of the input cluster.

string

message
optional

The detailed description of the action taken.

string

requestId
optional

The ID of the request. Populated only for Ambari backend.

string

status
optional

The status of the request.

string

ActivateHbasePolicyRequest

Activate an HBase replication policy.

Name Description Schema

clusterCrn
required

CRN of the destination cluster.

string

policyId
required

ID of the HBase policy.

string

ActivateHbasePolicyResponse

Response object for activateHbasePolicy.

Name Description Schema

clusterCrn
optional

The CRN of the input cluster.

string

message
optional

The detailed description of the action taken.

string

status
optional

The status of the request.

string

ActivatePolicyRequest

Activate a replication policy.

Name Description Schema

clusterCrn
required

CRN of the cluster where the policy is.

string

policyName
required

Policy name to resume.

string

ActivatePolicyResponse

Response object for resumePolicy.

Type : object

ActivateSnapshotPolicyRequest

Request object for activateSnapshotPolicy.

Name Description Schema

clusterCrn
required

CRN of the cluster where the snapshot policy is.

string

name
required

The name of the snapshot policy to be resumed.

string

ActivateSnapshotPolicyResponse

Response object for activateSnapshotPolicy.

Name Description Schema

clusterCrn
optional

CRN of the cluster where the snapshot policy is.

string

message
optional

The detailed description of the action taken.

string

status
optional

The status of the request.

string

Alert

Cloudera Manager alerting behavior.

Name Description Schema

onAbort
required

Alert on abort.

boolean

onFailure
required

Alert on failure.

boolean

onStart
required

Alert on start.

boolean

onSuccess
required

ALert on success.

boolean

ApiError

API error.

Name Description Schema

clusterUrl
optional

Cluster URL.

string

code
required

Error code.

integer (int32)

message
required

Error message.

string

requestId
optional

Request ID.

string

status
required

Error status.

string

AwsCloudCredentialType

AWS cloud credential type.

Type : enum (IAM, ACCESSKEY)

Cluster

Describes a Datalake, Datahub or Classic cluster.

Name Description Schema

cloudAccountProvider
optional

Cloud account provider.

enum (AWS, ADLS, WASB, ABFS, GCS)

clusterManagerType
required

Cluster Manager type.

enum (CLOUDERA_MANAGER, AMBARI)

clusterManagerUrl
required

Cluster Manager URL.

string

clusterType
required

Cluster type.

enum (CLASSIC, SDX, DISTROX)

clusterUrl
required

Cluster URL.

string

cmName
optional

Cloudera Manager name.

string

codProperties
optional

Additional properties for operational databases.

crn
required

Cluster CRN.

string

dataCenter
required

Cluster data center.

string

description
optional

Cluster description.

string

environmentCrn
optional

CRN of the cluster’s environment.

string

knoxUrl
optional

Knox URL if the cluster was registered with one, null otherwise.

string

location
optional

Cluster location.

name
required

Cluster name.

string

replicationEngineType
required

Replication engine type.

enum (CM, DLM_ENGINE)

stackCrn
optional

Stack CRN.

string

stackMajorVersion
optional

Stack major version.

string

stackVersion
optional

Stack version.

string

totalHosts
optional

Total hosts on the cluster.

integer (int32)

uuid
optional

Cluster UUID from Cloudera Manager if the cluster has CM backend.

string

ClusterServiceStatuses

Describes the status of services running on a cluster.

Name Description Schema

clusterCrn
required

Cluster CRN.

string

serviceStatuses
required

List of service statuses.

< ServiceInfo > array

CmPolicySubmitUser

CM Policy submit user.

Name Description Schema

sourceUser
optional

Source user.

string

userName
optional

Username.

string

CodProperties

Additional properties for operational databases.

Name Description Schema

operationalDatabaseName
optional

Name of the corresponding operational database..

string

CollectDiagnosticBundleRequest

Triggers a diagnostic bundle collect command for the given cluster and policyName.

Name Description Schema

clusterCrn
required

The CRN of the target cluster.

string

policyName
required

Name of the policy.

string

CollectDiagnosticBundleResponse

Response object for collect-diagnostic-bundle.

Name Description Schema

active
optional

Whether the diagnostic bundle command is active.

boolean

commandId
required

ID of the diagnostic bundle collection command issued against the CM. Polling get-command-status with this command id returns the current state of the command.

integer (int64)

name
optional

Name of the policy.

string

resultMessage
optional

Diagnostic bundle collection command result message.

string

startTime
optional

Start time of the diagnostic bundle collection command.

string

ContinueHbaseSetupRequest

Continue an HBase setup for Classic Cluster source.

Name Description Schema

clusterCrn
required

The CRN of the destination cluster.

string

policyId
required

The ID of the HBase policy.

string

ContinueHbaseSetupResponse

Response object for continueHbaseSetup.

Name Description Schema

clusterCrn
optional

The CRN of the input cluster.

string

message
optional

The detailed description of the action taken.

string

status
optional

The status of the request.

string

CreateAbfsCredentialRequest

Request object for creating ABFS cloud credentials. Currently supported cloud credentials: ABFS Access Key for Ambari clusters, ABFS Client Secret for CM clusters.

Name Description Schema

accessKey
optional

ABFS access key.

string

clientId
optional

Client ID of an Active Directory service principal account.

string

clientSecretKey
optional

Client Key of an Active Directory service principal account.

string

clusters
required

List of cluster CRNs where the credential should be created.

< string > array

name
required

Name of the credential.

string

storageAccountName
optional

ABFS storage account name.

string

tenantId
optional

Tenant ID of an Active Directory service principal account.

string

type
required

Type of the credential. Additional required parameters by type: ACCESSKEY: storageAccountName, accessKey; CLIENTKEY: clientId, clientSecretKey, tenantId. Superfluous parameters are ignored. Providing ACCESSKEY will create an ABFS Access Key based account in Ambari. Providing CLIENTKEY will create an Azure Active Directory Service Principal account in Cloudera Manager. ACCESSKEY is only supported on Ambari, while CLIENTKEY is only supported on Cloudera Manager.

CreateAbfsCredentialResponse

Response object for creating ABFS credentials.

Name Description Schema

errors
optional

The list of response errors in case of a partial failure while creating the credential.

< ApiError > array

CreateAwsCredentialRequest

Request object for creating AWS IAM or Access & Secret Key cloud credentials.

Name Description Schema

accessKey
optional

AWS access key.

string

clusters
required

List of cluster CRNs where the credential should be created.

< string > array

name
required

Name of the credential.

string

secretKey
optional

AWS secret key.

string

type
required

Type of the credential. Additional required parameters by type: IAM: none; ACCESSKEY: accessKey, secretKey. Superfluous parameters are ignored. Providing IAM will create an IAM Role-based Authentication account in Cloudera Manager. Providing ACCESSKEY will create an AWS Access Key Authentication account in Cloudera Manager.

CreateAwsCredentialResponse

Response object for creating AWS credentials.

Name Description Schema

errors
optional

The list of response errors in case of a partial failure while creating the credential.

< ApiError > array

CreateGcsCredentialRequest

Request object for creating GCS cloud credentials.

Name Description Schema

clientEmail
optional

Client email.

string

clusters
required

List of cluster CRNs where the credential should be created.

< string > array

name
required

Name of the credential.

string

privateKey
optional

GCS private key.

string

privateKeyId
optional

GCS private key ID.

string

type
required

Type of the credential. Additional accepted parameters by type: PRIVATEKEY: clientEmail, privateKeyId, privateKey. Superfluous parameters are ignored.

CreateGcsCredentialResponse

Response object for creating GCS credentials.

Name Description Schema

errors
optional

The list of response errors in case of a partial failure while creating the credential.

< ApiError > array

CreateHbasePolicyRequest

Create an HBase replication policy.

Name Description Schema

clusterCrn
required

CRN of the destination cluster.

string

policyDefinition
required

Policy definition.

policyName
required

Name of the new policy.

string

CreateHbasePolicyResponse

Response object for createHbasePolicy.

Name Description Schema

clusterCrn
optional

The CRN of the input cluster.

string

message
optional

The detailed description of the action taken.

string

status
optional

The status of the request.

string

CreatePolicyRequest

Create a replication policy.

Name Description Schema

clusterCrn
required

CRN of the cluster where the policy will be created.

string

policyDefinition
required

Policy definition.

policyName
required

Name of the new policy.

string

CreatePolicyResponse

Response object for createPolicy.

Type : object

CreateSnapshotPolicyRequest

Request object for createSnapshotPolicy.

Name Description Schema

clusterCrn
required

CRN of the cluster where the snapshot policy will be created.

string

snapshotPolicyDefinition
required

The details of the snapshot policy to be created.

CreateSnapshotPolicyResponse

Response object for createSnapshotPolicy.

Name Description Schema

clusterCrn
optional

The CRN of the cluster from where the snapshot policy has been created.

string

message
optional

The detailed description of the action taken.

string

status
optional

The status of the request.

string

CredentialCollection

Cloud Credentials listing.

Name Description Schema

credentials
required

Cloud credential details.

< CredentialDetails > array

results
required

Number of cloud credentials in the response.

integer (int64)

totalResults
required

Total number cloud credentials.

integer (int64)

CredentialDetails

Cloud credential details for by-name or by-id cloud credential request.

Name Description Schema

authType
required

Authentication type.

string

configs
optional

Configurations.

< string, string > map

creationTime
required

Creation time.

string (date-time)

customConfigs
optional

Custom configurations.

< CustomConfigs > array

id
required

Credential id.

string

lastModifiedTime
required

Last modified time.

string (date-time)

name
required

Credential name.

string

provider
required

Credential provider.

string

CredentialsResponse

Response object for cloud credentials.

Name Description Schema

clusterCrn
required

Cluster CRN.

string

clusterUrl
required

Cluster URL.

string

credentials
required

Cloud credentials.

replicationEngineType
required

Replication engine type.

enum (CM, DLMENGINE)

CustomConfigs

Custom key/value configurations.

Name Description Schema

confidential
required

Whether the value is confidential.

boolean

name
required

Name.

string

value
required

Value.

string

DeleteCredentialRequest

Request object for deleting a credential.

Name Description Schema

name
required

Name of the cloud credential to delete.

string

DeleteCredentialResponse

Response object for delete credential operation.

Name Description Schema

errors
optional

The list of response errors in case of a partial failure while deleting the credential.

< ApiError > array

DeleteHbasePolicyRequest

Request object to delete an HBase replication policy.

Name Description Schema

clusterCrn
required

CRN of the destination cluster.

string

force
optional

Option to force delete an Hbase policy. It should be used if the normal delete fails (e.g. when the source cluster is unreachable).

boolean

policyId
required

ID of the HBase policy.

string

DeleteHbasePolicyResponse

Response object for deleteHbasePolicy.

Name Description Schema

clusterCrn
optional

The CRN of the input cluster.

string

message
optional

The detailed description of the action taken.

string

status
optional

The status of the request.

string

DeletePolicyRequest

Delete a replication policy.

Name Description Schema

clusterCrn
required

CRN of the cluster where the policy is.

string

policyName
required

Policy name to delete.

string

DeletePolicyResponse

Response object for deletePolicy.

Type : object

DeleteSnapshotPolicyRequest

Request object for deleteSnapshotPolicy.

Name Description Schema

clusterCrn
required

CRN of the cluster where the snapshot policy is.

string

name
required

The name of the snapshot policy to be deleted.

string

DeleteSnapshotPolicyResponse

Response object for deleteSnapshotPolicy.

Name Description Schema

clusterCrn
optional

The CRN of the cluster from where the snapshot policy was deleted.

string

message
optional

The detailed description of the action taken.

string

status
optional

The status of the request.

string

DownloadDiagnosticBundleRequest

Request to download the diagnostic bundle for the given cluster and command id.

Name Description Schema

clusterCrn
required

The CRN of the target cluster.

string

commandId
required

The command ID from the response of collect-diagnostic-bundle command.

string

DownloadDiagnosticBundleResponse

Response object for download-diagnostic-bundle. On certain clusters this response will show if the download is only available directly from CM.

Name Description Schema

bundleFile
optional

Base64 encoded content of the diagnostic bundle zip file. A script like this can be used to save the response as file 'cat response.json | jq -r '.bundleFile' | base64 -D > bundle.zip'
Pattern : "^(?:[A-Za-z0-9+/]{4})*(?:[A-Za-z0-9+/]{2}==|[A-Za-z0-9+/]{3}=)?$"

string (byte)

Error

An object returned on an error.

Name Description Schema

code
optional

The error code.

string

message
optional

The error message.

string

ErrorHandling

Error handling behavior.

Name Description Schema

abortOnError
required

Abort policy on error.

boolean

abortOnSnapshotDiffFailures
required

Abort policy if there are snapshot diff failures.

boolean

skipChecksumChecks
required

Skip checksum checks.

boolean

skipListingChecksumChecks
required

Skip checksum checks for copy-listing.

boolean

GcsCloudCredentialType

GCS cloud credential type.

Type : enum (PRIVATEKEY)

GetClusterConfigRequest

Request object for getClusterConfig.

Name Description Schema

clusterCrn
required

The CRN of the cluster.

string

GetClusterConfigResponse

Response object for getClusterConfig.

Name Description Schema

clusterCrn
optional

The CRN of the cluster.

string

cmApiVersion
optional

Cloudera Manager API version.

integer (int32)

dmx
optional

Configuration related to DMX.

dmx

featureSupport
optional

A map of available features and whether they are supported on the cluster.

< string, boolean > map

services
optional

A list of service configurations.

underlyingFsForHive
optional

Underlying file system for Hive.

enum (HDFS, S3, WASB, ABFS, GCS)

dmx

Name Description Schema

hbaseSuspend
optional

Suspend type for HBase policies.

GetCommandStatusRequest

Get the current status of any CM command.

Name Description Schema

clusterCrn
required

The CRN of the target cluster.

string

commandId
required

ID of a CM command on the cluster.

string

GetCommandStatusResponse

Response object for get command status.

Name Description Schema

active
optional

Whether the command is still active.

boolean

bundleStatus
optional

The current status of the command.

enum (IN_PROGRESS, DOWNLOADABLE_WITH_URL, DOWNLOADABLE_WITH_CLI, FAILED)

bundleStatusMessage
optional

Further information about the current command status.

string

commandId
required

Id of the CM command.

integer (int64)

endTime
optional

End time of the CM command.

string

name
optional

Name of the policy.

string

resultDataUrl
optional

Some commands have result data URL for downloading the diagnostic bundle. On certain CM versions the bundle download is only available through this URL, but not with download-diagnostic-bundle operation.

string

resultMessage
optional

Result message of the command.

string

startTime
optional

Start time of the CM command.

string

success
optional

Whether the diagnostic collection is successful.

boolean

GetCredentialsRequest

Request object to retrieve specific cloud credentials.

Name Description Schema

clusterCrn
required

CRN of the cluster where the credential is.

string

credentialId
optional

Id of the credential. If both name and Id are specified, the Id is considered.

string

credentialName
optional

Name of the credential. If both name and Id are specified, the Id is considered.

string

GetCredentialsResponse

Response for credential request.

Name Description Schema

credentials
optional

List of credentials.

< CredentialDetails > array

GetHbaseTimeSeriesRequest

Request to retrieve time series data for an HBase replication peer.

Name Description Schema

clusterCrn
required

CRN of the destination cluster of the policy.

string

endTime
optional

End time of the time series data. Defaults to current time.

string (date-time)

metric
required

Name of the HBase replication peer metric.

enum (age_of_last_shipped_operation, log_edits_filtered_rate, log_edits_read_rate, log_queue_size, log_read_in_bytes_rate, shipped_batches_rate, shipped_ops_rate, shipped_size_in_kb_rate, age_of_last_shipped_operation_25th_percentile, age_of_last_shipped_operation_75th_percentile, age_of_last_shipped_operation_90th_percentile, age_of_last_shipped_operation_98th_percentile, age_of_last_shipped_operation_99th_percentile, age_of_last_shipped_operation_999th_percentile, age_of_last_shipped_operation_max, age_of_last_shipped_operation_mean, age_of_last_shipped_operation_median, age_of_last_shipped_operation_min, age_of_last_shipped_operation_rate, shipped_hfiles_rate, size_of_hfile_refs_queue)

policyId
required

ID of the policy that the time series data is requested for.

string

rollup
optional

Aggregate rollup level for time series data. Defaults to RAW data.

enum (RAW, TEN_MINUTELY, HOURLY, SIX_HOURLY, DAILY, WEEKLY)

startTime
optional

Start time of the time series data. Defaults to 5 minutes before end time.

string (date-time)

GetHbaseTimeSeriesResponse

Response object for getHbaseTimeSeries.

Name Description Schema

hbasePeerName
optional

Name of the HBase peer used for replication.

string

sourceCluster
optional

Name of source cluster in the format: "dataCenterName$cluster name", for example "DC-Europe$My Source 42".

string

targetCluster
optional

Name of destination cluster in the format: "dataCenterName$cluster name", for example "DC-US$My Destination 17".

string

timeSeries
optional

Time series data with additional metadata.

GetSnapshotPolicyRequest

Request object for getSnapshotPolicy.

Name Description Schema

clusterCrn
required

CRN of the cluster where the snapshot policy is.

string

name
required

The name of the snapshot policy to be retrieved.

string

GetSnapshotPolicyResponse

Response object for getSnapshotPolicy.

Name Description Schema

alert
required

Alerting behaviour of the snapshot policy.

cluster
required

The cluster that stores that snapshot policy.

string

description
optional

The description of the snapshot policy.

string

hbaseArguments
optional

Arguments specific to HBase snapshot policies.

hdfsArguments
optional

Arguments specific to HDFS snapshot policies.

lastCommand
optional

Latest command of the snapshot policy. The command might still be active.

lastSuccessfulCommand
optional

Last successful command of the snapshot policy.

name
required

The name of the snapshot policy.

string

paused
required

Whether the snapshot policy is suspended.

boolean

schedule
required

The schedule of the snapshot policy.

scope
required

Defines the datasets that are covered by the snapshot policy. Contains path patterns for HDFS snapshot policies and table regular expressions for HBase snapshot policies.

< string > array

snapshotRetentionCount
required

The number of snapshots to be retained for snapshot policies.

state
required

The current state of the snapshot policy.

type
required

The type of the snapshot policy.

HBaseSnapshotStorageType

The location where the HBase shapshot is stored.

Type : enum (LOCAL, REMOTE_S3)

HbaseCrnPairs

HBase CRN pairs.

Name Description Schema

pairedCrns
optional

The list of CRNs which are peers of each other.

< string > array

HbaseDatabaseArguments

HBase database replication arguments.

Name Description Schema

replicationStrategy
optional

Whether to replicate all tables or only the ones where the replication scope has been set. Defaults to ALL_TABLES.

enum (ALL_TABLES, TABLES_WITH_REPLICATION_SCOPE_SET)

HbasePolicyArguments

HBase replication parameters.

Name Description Schema

cloudCredential
optional

Cloud credentials to use to replicate the initial snapshot if the credential location is specified as 'EXTERNAL_ACCOUNT'.

string

credentialLocation
optional

Location of the credentials provided for initial snapshots. Setting it to 'SAFETY_VALVE' indicates that the credentials are available in safety valves on the source cluster, otherwise credentials have to be defined in the 'cloudCredential' property. Defaults to 'EXTERNAL_ACCOUNT'.

enum (EXTERNAL_ACCOUNT, SAFETY_VALVE)

databaseArguments
optional

Optional parameters used for HBase database replication.

forceSetup
optional

Whether setup should be forced if one of the clusters is already paired with another cluster. Forced setup is only possible if either there are no HBase replication policies between the pair or if the other cluster in the pair is currently unreachable. Note that when set to 'true' the existing pairing for the selected source or target cluster will be cleared and the first-time setup will be initiated with the chosen new source or destination cluster.

boolean

tables
optional

List of tables to be replicated. The key should be in "namespace:tablename" format. If this list is empty, then the whole database will be replicated.

< string > array

validateReplicationSetup
optional

Whether to validate replication setup after policy creation.

boolean

HbasePolicyDefinition

HBase policy definition.

Name Description Schema

description
optional

Description of the policy.

string

distcpMapBandwidth
optional

Maximum bandwidth per mapper to use for initial snapshot.

integer (int64)

distcpMaxMaps
optional

Maximum Map jobs to use for initial snapshot.

integer (int64)

hbasePolicyArguments
required

HBase policy arguments.

initialSnapshot
required

If set to true, the current data in the table will be replicated before the HBase replication peer gets enabled. If set to false, only the data changed after the policy creation will be replicated.

boolean

machineUser
optional

Machine user details to use for the replication. If not specified, an internal machine user will be created and synchronized to the required environments.

queueName
optional

YARN queue name to use for initial snapshot if not default.

string

sourceCluster
required

Name of source cluster in the format: "dataCenterName$cluster name", for example "DC-Europe$My Source 42."

string

sourceRestartType
optional

Type of restart for the source cluster. This is only accepted if the source is not a Classic Cluster and the destination has restart-type support. Default is ROLLING_RESTART.

targetCluster
required

Name of destination cluster in the format: "dataCenterName$cluster name", for example "DC-US$My Destination 17".

string

targetRestartType
optional

Type of restart for the destination cluster. This is only accepted if the cluster has restart-type support. Default is ROLLING_RESTART.

HbaseSnapshotPolicyArgumentsRequest

Arguments specific to HBase snapshot policies.

Name Description Schema

storage
required

The location where the snapshots should be stored.

tableRegExps
required

The regular expressions specifying the tables. Tables matching any of them will be eligible for snapshot creation.

< string > array

HbaseSnapshotPolicyArgumentsResponse

Arguments specific to HBase snapshot policies.

Name Description Schema

storage
required

The location where the snapshots should be stored.

tableRegExps
required

The regular expressions specifying the tables. Tables matching any of them will be eligible for snapshot creation.

< string > array

HbaseSuspendType

Describes how suspend and resume affects HBase policies on the cluster. 'ALL' means that suspend/resume affects all HBase policies with the same source and destination cluster, while 'POLICY' means that only the selected policy gets suspended/resumed. 'NOT_SUPPORTED' means that this feature is not available on the cluster.

Type : enum (POLICY, ALL, NOT_SUPPORTED)

HbaseTimeSeries

HBase time series data and metadata.

Name Description Schema

data
optional

List of time series data points.

metadata
optional

Metadata regarding the time series data.

HbaseTimeSeriesData

Time series data point.

Name Description Schema

timestamp
optional

Timestamp of the data point.

string (date-time)

value
optional

Value of the data point.

number (double)

HbaseTimeSeriesMetadata

Time series metadata.

Name Description Schema

attributes
optional

Attributes of the resource providing time series data.

endTime
optional

End time of the time series data.

string (date-time)

metricName
optional

Name of the metric.

string

startTime
optional

Start time of the time series data.

string (date-time)

unitDenominator
optional

Unit denominator.

string

unitNumerator
optional

Unit numerator.

string

HbaseTimeSeriesMetadataAttributes

Attributes of the resource providing time series data.

Name Description Schema

clusterName
optional

Cluster name.

string

serviceName
optional

Service name.

string

HdfsArguments

Extra properties for HDFS.

Name Description Schema

alert
optional

Alerting behavior.

deletePolicy
optional

Deletion behavior.

enum (KEEP_DELETED_FILES, DELETE_TO_TRASH, DELETE_PERMANENTLY)

errorHandling
optional

Error handling strategy.

exclusionFilters
optional

Exclusion filters in glob format.

< string > array

logPath
optional

Job log path.

string

mapReduceService
optional

Name of the mapreduce service.

string

path
optional

HDFS path. Mandatory for HDFS policies, otherwise optional.

string

preserve
optional

Properties to preserve.

replicationStrategy
optional

Replication strategy.

enum (DYNAMIC, STATIC)

HdfsDistCpArgs

The distcp arguments for restoring a HDFS snapshot.

Name Description Schema

abortOnError
optional

Whether to abort the job on an error. If selected, files copied up to that point remain in the destination, but no additional files are copied.

boolean

bandwidthPerMap
optional

The maximum bandwidth (in MB) per mapper in the mapreduce job restoring the snapshot.

integer (int64)

logPath
optional

An alternate path for logs.

string

mapreduceServiceName
optional

The MapReduce or YARN service to use.

string

numMaps
optional

The number of mappers to use for the mapreduce job restoring the snapshot.

integer (int64)

preserveBlockSize
optional

Whether to preserve the HDFS block size.

boolean

preservePermissions
optional

Whether to preserve the HDFS owner, group and permissions.

boolean

preserveReplicationCount
optional

Whether to preserve the HDFS replication count.

boolean

removeMissingFiles
optional

Whether to delete destination files that are missing in source.

boolean

replicationStrategy
optional

Replication strategy.

enum (DYNAMIC, STATIC)

schedulerPoolName
optional

The name of a resource pool in the field. The value entered is used by the MapReduce Service you specified when Cloudera Manager executes the MapReduce job for restoring the snapshot.

string

skipChecksumChecks
optional

Whether to skip checksum checks. If set to true, checksum validation will not be performed.

boolean

skipTrash
optional

Whether to permanently delete destination files that are missing in source.

boolean

userName
optional

The CM user used to run the job restoring the snapshot.

string

HdfsSnapshotPolicyArgumentsRequest

Arguments specific to HDFS snapshot policies.

Name Description Schema

pathPatterns
required

The path patterns specifying the paths. Paths matching any of them will be eligible for snapshot creation. The pattern matching characters that can be specific are those supported by HDFS.

< string > array

HdfsSnapshotPolicyArgumentsResponse

Arguments specific to HDFS snapshot policies.

Name Description Schema

pathPatterns
required

The path patterns specifying the paths. Paths matching any of them will be eligible for snapshot creation. The pattern matching characters that can be specific are those supported by HDFS.

< string > array

HdfsUpdateArguments

Updatable HDFS properties.

Name Description Schema

alert
optional

Alerting behavior.

deletePolicy
optional

Deletion behavior for the target side when files are removed on the source side. KEEP_DELETED_FILES:Keep deleted source files on the target, DELETE_TO_TRASH:Remove the deleted source files to trash on the target, DELETE_PERMANENTLY:Permanently remove deleted files on the target.

enum (KEEP_DELETED_FILES, DELETE_TO_TRASH, DELETE_PERMANENTLY)

errorHandling
optional

Error handling strategy.

exclusionFilters
optional

Exclusion filters in glob format.

< string > array

logPath
optional

The HDFS path where the replication log files should be written to.

string

mapReduceService
optional

The name of the MapReduce service.

string

preserve
optional

Properties to preserve.

replicationStrategy
optional

Replication strategy.

enum (DYNAMIC, STATIC)

HiveArguments

Hive replication arguments.

Name Description Schema

databasesAndTables
optional

Scope of the replication.

numThreads
optional

Number of threads to use during replication.

integer (int64)

sentryPermissions
optional

Include or exclude Sentry permissions.

enum (INCLUDE, EXCLUDE)

skipUrlPermissions
optional

Skip URL permissions.

boolean

HiveDatabaseAndTables

Hive replication scope.

Name Description Schema

database
required

Database to replicate.

string

tablesExcludeRegex
optional

Regex to match excluded tables.

string

tablesIncludeRegex
optional

Regex to match included tables.

string

ListAllCredentialsRequest

Request object for listing all cloud credentials on all clusters.

Type : object

ListAllCredentialsResponse

Response object for list credentials request.

Name Description Schema

credentials
required

List of credentials by cluster.

unreachableClusters
required

List of errors for unreachable clusters.

< ApiError > array

ListClusterServiceStatusesRequest

Request object to list cluster statuses.

Type : object

ListClusterServiceStatusesResponse

Response object for listing of cluster statuses.

Name Description Schema

statuses
optional

List of statuses by cluster.

ListClustersRequest

Request to list clusters.

Type : object

ListClustersResponse

Response object for list clusters request.

Name Description Schema

clusters
required

List of clusters.

< Cluster > array

unreachableClusters
required

List of errors for unreachable clusters.

< ApiError > array

ListPairedHbaseClustersRequest

Request to list all paired HBase cluster CRNs.

Type : object

ListPairedHbaseClustersResponse

Response object for listPairedHbaseClusters.

Name Description Schema

crnsMissingHbaseService
optional

Cluster CRNs where the HBase service was missing and pairing status could not be determined.

< string > array

pairings
optional

The list of CRN pairings.

< HbaseCrnPairs > array

unreachableClusters
optional

The list of errors for unreachable clusters.

< ApiError > array

ListPoliciesRequest

Request object for listing all policies.

Name Description Schema

clusterCrn
optional

CRN of the cluster where the policies are stored.

string

ListPoliciesResponse

Response object for a list policies request.

Name Description Schema

policies
required

List of policies.

< Policy > array

policyErrors
required

List of policy errors.

< ApiError > array

unreachableClusters
required

List of errors for unreachable clusters.

< ApiError > array

ListPolicyJobsRequest

Request object for listing policy jobs.

Name Description Schema

clusterCrn
required

The CRN of the cluster where the replication policy is.

string

pageSize
optional

The size of each page. Defaults to 10.
Default : 10
Minimum value : 1
Maximum value : 100

integer (int32)

policyId
required

The ID of the policy.

string

startingToken
optional

A token to specify where to start paginating. This is the nextToken from a previously truncated response. 1 or empty for first page.

string

ListPolicyJobsResponse

Response object for listPolicyJobs.

Name Description Schema

jobs
optional

List of policy jobs.

nextToken
optional

The token to use when requesting the next set of results. If not present, there are no additional results.

string

results
optional

Number of jobs in the response.

integer (int64)

totalResults
optional

Total number of jobs for the policy.

integer (int64)

ListSnapshotPoliciesRequest

Request object for listing all snapshot policies.

Type : object

ListSnapshotPoliciesResponse

Response object for a list snapshot policies request.

Name Description Schema

errorResponses
required

List of snapshot policy errors.

< ApiError > array

snapshotPolicyResponses
required

List of snapshot policies.

ListSnapshotPolicyJobsRequest

Request object for listSnapshotPolicyJobs.

Name Description Schema

clusterCrn
required

CRN of the cluster where the snapshot policy is.

string

name
required

The name of the snapshot policy whose snapshot history will be retrieved.

string

ListSnapshotPolicyJobsResponse

Response object for listSnapshotPolicyJobs.

Name Description Schema

errorResponses
required

List of snapshot policy errors.

< ApiError > array

jobs
required

The list of snapshot jobs that ran for the snapshot policy.

< SnapshotJob > array

Location

Location object.

Name Description Schema

city
required

City.

string

country
required

Country.

string

id
required

Location ID.

integer (int64)

latitude
required

Latitude.

number (double)

longitude
required

Longitude.

number (double)

MachineUser

Username and password for the machine user.

Name Description Schema

createUser
required

This option has no effect if the machine user already exists. Otherwise if 'true', a new machine user is created. If 'false', an error is returned indicating that the user does not exist.

boolean

password
required

Password.

string

user
required

Username.

string

Policy

Replication policy definition.

Name Description Schema

creationTime
optional

Policy creation time.

string (date-time)

customProperties
optional

Custom replication properties.

< string, string > map

description
optional

Policy description.

string

endTime
required

End time of policy run or when it repeats.

string (date-time)

executionType
optional

Policy execution type.

string

frequency
required

Frequency in seconds when the policy runs.

integer (int64)

jobs
required

List of policy runs.

name
required

Policy name.

string

nextRun
optional

Next expected run of the policy.

string

plugins
optional

Plugins.

< string > array

policyId
required

Policy id.

string

report
required

Policy report.

sourceCluster
optional

Source cluster of replication.

string

sourceClusterCrn
optional

CRN of the source cluster.

string

sourceDataset
optional

Source dataset of replication.

< string > array

startTime
optional

Policy start time.

string (date-time)

status
required

Current status of the policy.

string

target
optional

Replication target details.

targetCluster
optional

Target cluster of replication if not cloud.

string

targetClusterCrn
optional

CRN of the target cluster.

string

targetDataset
optional

Target dataset of replication.

< string > array

type
required

Policy type.

string

PolicyDefinition

Policy creation request definition.

Name Description Schema

cloudCredential
optional

Cloud credentials to use if replicating to Cloud.

string

cloudEncryptionAlgorithm
optional

The type of cloud encryption algorithm. Can be used only for HDP/Ambari managed clusters. Supported values are AES256,SSE-KMS.

string

cloudEncryptionKey
optional

Cloud encryption key.

string

cmPolicySubmitUser
optional

CM policy submit user.

description
optional

Description of the policy.

string

distcpMapBandwidth
optional

Maximum bandwidth to use for replication.

integer (int64)

distcpMaxMaps
optional

Maximum Map jobs to use for replication.

integer (int64)

enableSnapshotBasedReplication
optional

Enable snapshot based replication.

boolean

endTime
optional

End time.

string (date-time)

frequencyInSec
required

Policy’s frequency in seconds.

integer (int64)

hiveExternalTableBaseDirectory
optional

Hive external table base directory.

string

name
required

Name of the new policy.

string

plugins
optional

Plugins.

< string > array

queueName
optional

YARN queue name if not default.

string

sourceCluster
optional

Name of source cluster in the format: "dataCenterName$cluster name", for example "DC-Europe$My Source 42.

string

sourceDataset
required

Source dataset to replicate.

startTime
optional

Start time.

string (date-time)

targetCluster
optional

Name of destination cluster in the format: "dataCenterName$cluster name", for example "DC-US$My Destination 17".

string

targetDataset
optional

Dataset to replicate to.

string

tdeSameKey
optional

TDE same key.

boolean

type
required

Policy replication type.

enum (FS, HIVE, HBASE)

PolicyInstanceResponse

Policy execution details.

Name Description Schema

completedSteps
optional

Number of completed steps.

integer (int32)

endTime
optional

Command end time.

string (date-time)

id
required

Policy instance command id.

string

jobType
optional

Job type.

string

message
optional

Output of the policy command.

string

policyId
required

Policy id.

string

startTime
required

Command start time.

string (date-time)

status
required

Policy command status.

string

totalSteps
optional

Total number of steps.

integer (int32)

trackingInfo
optional

JSON data to track polciy status.

string

PolicyReport

Policy report.

Name Description Schema

lastFailedInstance
optional

Last failed instance.

lastSucceededInstance
optional

Last successful instance.

PolicyReportDetails

Policy report details.

Name Description Schema

endTime
required

End time.

string (date-time)

status
required

Status of the command.

string

Preserve

Properties to preserve after replication.

Name Description Schema

blockSize
required

Block size.

boolean

extendedAttributes
required

Extended attributes.

boolean

permissions
required

Permissions.

boolean

replicationCount
required

Replication count.

boolean

RepairHbasePolicyRequest

Attempt to repair an HBase replication policy.

Name Description Schema

clusterCrn
required

CRN of the destination cluster.

string

policyId
required

ID of the HBase policy.

string

RepairHbasePolicyResponse

Response object for repairHbasePolicy.

Name Description Schema

clusterCrn
optional

The CRN of the input cluster.

string

message
optional

The detailed description of the action taken.

string

status
optional

The status of the request.

string

RerunPolicyRequest

Request object for rerun policy.

Name Description Schema

clusterCrn
required

The CRN of the cluster where the replication policy run gets executed.

string

policyId
required

The ID of the policy to rerun.

string

RerunPolicyResponse

Response object for rerun policy.

Name Description Schema

clusterCrn
optional

The CRN of the cluster where the replication policy run gets executed.

string

message
optional

The output of rerun policy command.

string

requestId
optional

The ID of the request. Populated only for Ambari backend.

string

status
optional

The status of the request.

string

RestartType

Type of restart for a cluster.

Type : enum (RESTART, ROLLING_RESTART)

RestoreHBaseSnapshotArgs

Arguments for restoring a HBase snapshot.

Name Description Schema

creationTime
required

The time when the snapshot to be restored was created. This value should equal the 'endTime' attribute of the snapshot restore command that created the snapshot.

string (date-time)

isClone
required

Whether to restore or clone the snapshot. Cloning a snapshot creates a new read/write table that serves the data kept at the time of the snapshot. The original table and the cloned table can be modified independently; new data written to one table does not show up on the other. Restoring a snapshot replaces the current version of a table with different version based on the snapshot.

boolean

snapshotName
required

The name of the snapshot to be restored.

string

storageType
required

Whether the snapshot is stored locally or remotely.

tableName
optional

If the hbase operation is 'clone', a table name should be provided, which will be the name of the new table created when cloning the snapshot. If the hbase operation is 'restore', the table name should be empty.

string

RestoreHdfsSnapshotArgs

Arguments for restoring a HDFS snapshot.

Name Description Schema

destinationPath
required

The path to restore the snapshot into.

string

distCpArgs
optional

The distcp arguments for restoring the snapshot. When this attribute is set, disctp will be used to restore the snapshot. When unset, the HDFS copy command will be used to restore the snapshot.

path
required

The snapshotted path.

string

snapshotName
required

The name of the snapshot to be restored.

string

snapshotPath
required

The absolute path of the snapshot to be restored.

string

RestoreSnapshotArguments

Arguments for restoring a HDFS or HBase snapshot.

Name Description Schema

restoreHBaseSnapshotArgs
optional

Arguments for restoring a HBase snapshot.

restoreHdfsSnapshotArgs
optional

Arguments for restoring a HDFS snapshot.

snapshotType
required

The type of the snapshot to be restored.

RestoreSnapshotRequest

Request object for restoreSnapshot.

Name Description Schema

clusterCrn
required

CRN of the cluster where the snapshot policy is.

string

restoreSnapshotArguments
required

Arguments for restoring a specific snapshot.

RestoreSnapshotResponse

Response object for restoreSnapshot.

Name Description Schema

restoreSnapshotCommand
optional

Details of the CM command that was created to restore the snapshot.

RetryFailedHbaseFirstTimeSetupRequest

Request object to retry first time setup for an HBase policy.

Name Description Schema

clusterCrn
required

CRN of the destination cluster.

string

machineUser
optional

Machine user details to use for the replication. If not specified, an internal machine user will be created and synchronized to the required environments.

policyId
required

ID of the HBase policy.

string

sourceRestartType
optional

Type of restart for the source cluster. This is only accepted if the source is not a Classic Cluster and the destination has restart-type support. Default is ROLLING_RESTART.

targetRestartType
optional

Type of restart for the destination cluster. This is only accepted if the cluster has restart-type support. Default is ROLLING_RESTART.

RetryFailedHbaseFirstTimeSetupResponse

Response object for retryFailedHbaseFirstTimeSetup.

Name Description Schema

clusterCrn
optional

The CRN of the input cluster.

string

message
optional

The detailed description of the action taken.

string

status
optional

The status of the request.

string

RetryFailedHbaseSnapshotsRequest

Request object to retry failed snapshots for an HBase policy.

Name Description Schema

clusterCrn
required

CRN of the destination cluster.

string

policyId
required

ID of the HBase policy.

string

RetryFailedHbaseSnapshotsResponse

Response object for retryFailedHbaseSnapshots.

Name Description Schema

clusterCrn
optional

The CRN of the input cluster.

string

message
optional

The detailed description of the action taken.

string

status
optional

The status of the request.

string

ServiceConfiguration

Configuration related to a service.

Name Description Schema

configs
optional

Service configuration map.

< string, string > map

name
optional

The name of the service.

string

ServiceInfo

Service status definition.

Name Description Schema

serviceName
required

Service name.

string

status
required

Service status.

string

SnapshotCommand

Detailed information about a snapshot command.

Name Description Schema

active
required

Whether the command is currenlty active.

boolean

children
optional

List of references to the child commands.

endTime
required

The end time of the command, if the command is finished.

string (date-time)

id
required

The id of the command.

integer (int64)

name
required

The name of the command.

string

parent
optional

Reference to the parent command, if any.

resultMessage
required

The result message of the command, if the command has finished.

string

startTime
required

The start time of the command.

string (date-time)

success
required

Whether the command was successful, if the command has finished.

boolean

SnapshotJob

Detailed information about a snapshot job.

Name Description Schema

clusterId
required

The crn of the cluster where the snapshot is.

string

endTime
required

The end time of the snapshot command.

string (date-time)

estimatedExpiration
optional

The estimated expiration time of the snapshot created by the snapshot command.

string (date-time)

hbaseResult
optional

Detailed results for snapshot commands for HBase tables.

hdfsResult
optional

Detaileds results for snapshot commands for HDFS paths.

id
required

The id of the snapshot command.

integer (int64)

name
required

The name of the snapshot command.

string

resultDataUrl
required

The URL to the command’s downloadable result data.

string

resultMessage
required

The result message for a finished command.

string

schedule
required

The schedule of the snapshot policy.

snapshotName
required

The name of the snapshot.

string

snapshotRetentionCount
required

The number of snapshots to be retained for the snapshot policy.

startTime
required

The start time of the snapshot command.

string (date-time)

state
required

The state of the snapshot created by the snapshot command.

string

SnapshotPolicyAlertRequest

Alerting behaviour for snapshot policy activities. Defines whether an alert is sent on certain events related to snapshot policies.

Name Description Schema

onAbort
required

Whether to alert on abort of snapshot creation/deletion activity.

boolean

onFail
required

Whether to alert on failure of snapshot creation/deletion activity.

boolean

onStart
required

Whether to alert on start of snapshot creation/deletion activity.

boolean

onSuccess
required

Whether to alert on successful completion of snapshot creation/deletion activity.

boolean

SnapshotPolicyAlertResponse

Alerting behaviour for snapshot policy activities. Defines whether an alert is sent on certain events related to snapshot policies.

Name Description Schema

onAbort
required

Whether to alert on abort of snapshot creation/deletion activity.

boolean

onFail
required

Whether to alert on failure of snapshot creation/deletion activity.

boolean

onStart
required

Whether to alert on start of snapshot creation/deletion activity.

boolean

onSuccess
required

Whether to alert on successful completion of snapshot creation/deletion activity.

boolean

SnapshotPolicyDefinition

Details of the snapshot policy to be created.

Name Description Schema

alert
optional

Alerting behaviour of the snapshot policy.

hbaseArguments
optional

Arguments specific to HBase snapshot policies.

hdfsArguments
optional

Arguments specific to HDFS snapshot policies.

name
required

The name of the snapshot policy.

string

paused
optional

Whether to pause the snapshot policy.

boolean

schedule
required

The schedule of the snapshot policy.

snapshotRetentionCount
required

The number of snapshots to be retained for the snapshot policy.

type
required

The type of the snapshot policy.

SnapshotPolicyScheduleRequest

Defines the schedule of a snapshot policy.

Name Description Schema

dayOfMonth
required

Day of the month that monthly and yearly snapshots will be created. Valid values are 1 to 31. Additionally 0 to -30 can be used to specify offsets from the last day of the month.

integer (int32)

dayOfWeek
required

Day of the week that weekly snapshots will be created. Valid values are 1 to 7, 1 representing Sunday.

integer (int32)

hourOfDay
required

Hour of the day that daily, weekly, monthly and yearly snapshots will be created. Valid values are 0 to 23.

integer (int32)

hoursForHourly
optional

Hours of the day that hourly snapshots will be created. Valid values are 0 to 23. If this list is null or empty, then hourly snapshots are created for every hour.

< integer (int32) > array

minuteOfHour
required

Minute of the hour that hourly, daily, weekly, monthly and yearly snapshots will be created. Valid values are 0 to 59.

integer (int32)

monthOfYear
required

Month of the year that yearly snapshots will be created. Valid values are 1 to 12, 1 representing January.

integer (int32)

SnapshotPolicyScheduleResponse

Defines the schedule of a snapshot policy.

Name Description Schema

dayOfMonth
required

Day of the month that monthly and yearly snapshots will be created. Valid values are 1 to 31. Additionally 0 to -30 can be used to specify offsets from the last day of the month.

integer (int32)

dayOfWeek
required

Day of the week that weekly snapshots will be created. Valid values are 1 to 7, 1 representing Sunday.

integer (int32)

hourOfDay
required

Hour of the day that daily, weekly, monthly and yearly snapshots will be created. Valid values are 0 to 23.

integer (int32)

hoursForHourly
optional

Hours of the day that hourly snapshots will be created. Valid values are 0 to 23. If this list is null or empty, then hourly snapshots are created for every hour.

< integer (int32) > array

minuteOfHour
required

Minute of the hour that hourly, daily, weekly, monthly and yearly snapshots will be created. Valid values are 0 to 59.

integer (int32)

monthOfYear
required

Month of the year that yearly snapshots will be created. Valid values are 1 to 12, 1 representing January.

integer (int32)

SnapshotPolicyType

The snapshot type of snapshot policies.

Type : enum (HDFS, HBASE)

SnapshotResult

The detailed results of a snapshot command.

Name Description Schema

createdSnapshotCount
required

The number of snapshots created.

integer (int64)

createdSnapshots
optional

The list of snapshots created.

< StoredSnapshot > array

creationErrorCount
required

The number of errors encountered when creating snapshots.

integer (int64)

creationErrors
optional

The list of errors encountered when creating snapshots.

< SnapshotStoreError > array

deletedSnapshotCount
required

The number of snapshots deleted.

integer (int64)

deletedSnapshots
optional

The list of snapshots deleted.

< StoredSnapshot > array

deletionErrorCount
required

The number of errors encountered when deleting snapshots.

integer (int64)

deletionErrors
optional

The list of errors encountered when deleting snapshots.

< SnapshotStoreError > array

processedEntities
optional

The list of processed entities. Processed tables for HBase, paths for HDFS snapshots.

< string > array

processedEntityCount
required

The number of processed entities. Processed tables for HBase, paths for HDFS snapshots.

integer (int64)

unprocessedEntities
optional

The list of unprocessed entities. Unprocessed tables for HBase, paths for HDFS snapshots.

< string > array

unprocessedEntityCount
required

The number of unprocessed entities. Unprocessed tables for HBase, paths for HDFS snapshots.

integer (int64)

SnapshotRetentionCountRequest

Defines the number of snapshots to be retained for snapshot policies.

Name Description Schema

dailySnapshots
required

The number of daily snapshots to be retained.

integer (int64)

hourlySnapshots
required

The number of hourly snapshots to be retained.

integer (int64)

monthlySnapshots
required

The number of monthly snapshots to be retained.

integer (int64)

weeklySnapshots
required

The number of weekly snapshots to be retained.

integer (int64)

yearlySnapshots
required

The number of yearly snapshots to be retained.

integer (int64)

SnapshotRetentionCountResponse

Defines the number of snapshots to be retained for snapshot policies.

Name Description Schema

dailySnapshots
required

The number of daily snapshots to be retained.

integer (int64)

hourlySnapshots
required

The number of hourly snapshots to be retained.

integer (int64)

monthlySnapshots
required

The number of monthly snapshots to be retained.

integer (int64)

weeklySnapshots
required

The number of weekly snapshots to be retained.

integer (int64)

yearlySnapshots
required

The number of yearly snapshots to be retained.

integer (int64)

SnapshotState

The current state of a snapshot policy.

Type : enum (RUNNING, ACTIVE, SUSPENDED, ERROR)

SnapshotStoreError

Detailed description about a snapshot operation error.

Name Description Schema

error
required

The description of the error.

string

path
required

The HDFS path/HBase table name for which the snapshot error occurred.

string

snapshotName
required

The name of the snapshot.

string

SourceDataset

Extra properties for the source dataset.

Name Description Schema

hdfsArguments
optional

HDFS arguments for HDFS and Hive replication.

hiveArguments
optional

Arguments for Hive replication, null if HDFS replication.

SourceUpdateDataset

Extra properties for updating the source dataset.

Name Description Schema

hdfsArguments
optional

Updatable arguments for HDFS replication.

hiveArguments
optional

Updatable arguments for Hive replication, null if HDFS replication.

StoredSnapshot

Detailed description about a snapshot.

Name Description Schema

creationTime
optional

The creation time of the snapshot.

string (date-time)

path
required

The snapshotted HDFS path/HBase table.

string

snapshotName
required

The name of the snapshot.

string

snapshotPath
optional

The fully qualified path of the snapshot.

string

storage
optional

Whether the snapshot is stored locally or remotely.

SuspendHbasePolicyRequest

Suspend an HBase replication policy.

Name Description Schema

clusterCrn
required

CRN of the destination cluster.

string

policyId
required

ID of the HBase policy.

string

SuspendHbasePolicyResponse

Response object for suspendHbasePolicy.

Name Description Schema

clusterCrn
optional

The CRN of the input cluster.

string

message
optional

The detailed description of the action taken.

string

status
optional

The status of the request.

string

SuspendPolicyRequest

Suspend a replication policy.

Name Description Schema

clusterCrn
required

CRN of the cluster where the policy is.

string

policyName
required

Policy name to suspend.

string

SuspendPolicyResponse

Response object for suspendPolicy.

Type : object

SuspendSnapshotPolicyRequest

Request object for suspendSnapshotPolicy.

Name Description Schema

clusterCrn
required

CRN of the cluster where the snapshot policy is.

string

name
required

The name of the snapshot policy to be suspended.

string

SuspendSnapshotPolicyResponse

Response object for suspendSnapshotPolicy.

Name Description Schema

clusterCrn
optional

CRN of the cluster where the snapshot policy is.

string

message
optional

The detailed description of the action taken.

string

status
optional

The status of the request.

string

TargetDetails

Target details.

Name Description Schema

environmentCrn
required

Target’s environment CRN.

string

warehouseCrn
optional

Target’s warehouse CRN.

string

UpdateAbfsCredentialRequest

Request object for updating ABFS cloud credentials.

Name Description Schema

accessKey
optional

ABFS access key.

string

clientId
optional

Client ID of an Active Directory service principal account.

string

clientSecretKey
optional

Client Key of an Active Directory service principal account.

string

name
required

Name of the credential to update.

string

storageAccountName
optional

ABFS storage account name.

string

tenantId
optional

Tenant ID of an Active Directory service principal account.

string

type
required

Type of the credential. Additional accepted parameters by type: ACCESSKEY: storageAccountName, accessKey; CLIENTKEY: clientId, clientSecretKey, tenantId. Superfluous parameters are ignored. ACCESSKEY is only supported on Ambari, while CLIENTKEY is only supported on Cloudera Manager.

UpdateAbfsCredentialResponse

Response object for updating ABFS credentials.

Name Description Schema

errors
optional

List of response errors in case of partial failure (e.g. updating the credential failed on one of three clusters).

< ApiError > array

UpdateAwsCredentialRequest

Request object for updating AWS cloud credentials.

Name Description Schema

accessKey
optional

AWS access key.

string

name
required

Name of the credential to update.

string

secretKey
optional

AWS secret key.

string

type
required

Type of the credential. Additional accepted parameters by type: IAM: none; ACCESSKEY: accessKey, secretKey. Superfluous parameters are ignored.

UpdateAwsCredentialResponse

Response object for updating AWS credentials.

Name Description Schema

errors
optional

The list of response errors in case of partial failure (e.g. updating the credential failed on one of three clusters).

< ApiError > array

UpdateGcsCredentialRequest

Request object for updating GCS cloud credentials.

Name Description Schema

clientEmail
optional

Client email.

string

name
required

Name of the credential to update.

string

privateKey
optional

GCS private key.

string

privateKeyId
optional

GCS private key ID.

string

type
required

Type of the credential. Additional accepted parameters by type: PRIVATEKEY: clientEmail, privateKeyId, privateKey. Superfluous parameters are ignored.

UpdateGcsCredentialResponse

Response object for updating GCS credentials.

Name Description Schema

errors
optional

List of response errors in case of partial failure (e.g. updating the credential failed on one of three clusters).

< ApiError > array

UpdateHbasePolicyDefinition

HBase policy update request definition.

Name Description Schema

description
optional

Description of the policy.

string

name
optional

The policy name.

string

tables
optional

List of tables to be replicated. The items should be in "namespace:tablename" format.

< string > array

UpdateHbasePolicyRequest

Update HBase replication policy request.

Name Description Schema

clusterCrn
required

The CRN of the cluster where the policy will be updated.

string

policyId
required

The ID of the policy to be updated.

string

updateHbasePolicyDefinition
required

The policy definition.

UpdateHbasePolicyResponse

Response object for updateHbasePolicy.

Name Description Schema

clusterCrn
optional

The CRN of the input cluster.

string

message
optional

The detailed description of the action taken.

string

requestId
optional

The ID of the request. Populated only for Ambari backend.

string

status
optional

The status of the request (Successful or an error).

string

UpdatePolicyDefinition

Policy update request definition.

Name Description Schema

cloudEncryptionAlgorithm
optional

The type of cloud encryption algorithm. Can be used only for HDP/Ambari managed clusters. Supported values are AES256,SSE-KMS.

string

cloudEncryptionKey
optional

The encryption key for the selected cloud encryption algorithm.

string

cmPolicySubmitUser
optional

CM policy submit user.

description
optional

Description of the policy.

string

distcpMapBandwidth
optional

Maximum bandwidth to use for replication.

integer (int64)

distcpMaxMaps
optional

Maximum Map jobs to use for replication.

integer (int64)

enableSnapshotBasedReplication
optional

Whether to enable snapshot based replication.

boolean

endTime
optional

Policy end time.

string (date-time)

frequencyInSec
optional

Policy’s frequency in seconds.

integer (int64)

hiveExternalTableBaseDirectory
optional

The base directory path on the target where to put the replicated Hive external tables.

string

name
optional

The policy name.

string

plugins
optional

The list of plugins.

< string > array

queueName
optional

YARN queue name if not default.

string

sourceUpdateDataset
optional

The source dataset to replicate.

startTime
optional

Policy start time.

string (date-time)

suspend
optional

Whether to suspend the policy. Changing this is the same as using suspend-policy (suspend = true) and activate-policy (suspend = false).

boolean

targetDataset
optional

The path of the dataset to replicate to.

string

tdeSameKey
optional

Whether to use TDE same key.

boolean

UpdatePolicyRequest

Update a replication policy request.

Name Description Schema

clusterCrn
required

The CRN of the cluster where the policy will be updated.

string

policyId
required

The ID of the policy to be updated.

string

updatePolicyDefinition
required

The policy definition.

UpdatePolicyResponse

Response object for updatePolicy.

Type : object

UpdateSnapshotPolicyRequest

Request object for updateSnapshotPolicy.

Name Description Schema

clusterCrn
required

CRN of the cluster where the snapshot policy will be updated.

string

name
required

The name of the snapshot policy to be updated.

string

snapshotPolicyDefinition
required

The details of the snapshot policy to be updated.

UpdateSnapshotPolicyResponse

Response object for updateSnapshotPolicy.

Name Description Schema

clusterCrn
optional

The CRN of the cluster from where the snapshot policy has been updated.

string

message
optional

The detailed description of the action taken.

string

status
optional

The status of the request.

string

VerificationSteps

Verification steps.

Name Description Schema

clusterManagerUrl
optional

The cluster manager URL to reach the cluster’s UI.

string

steps
optional

The list of manual steps to perform or verify.

< string > array

VerifyHbaseClusterPairRequest

Request to verify a cluster pairing for HBase policy creation prerequisites.

Name Description Schema

destinationClusterCrn
required

CRN of the destination cluster.

string

sourceClusterCrn
required

CRN of the source cluster.

string

VerifyHbaseClusterPairResponse

Response object for verifyHbaseClusterPair.

Name Description Schema

afterPolicySteps
optional

Manual steps to perform after HBase policy creation.

beforePolicySteps
optional

Manual steps to perform before HBase policy creation.

pairedStatus
optional

Substatus of an active pairing. Indicates if a pairing is resettable or in an erroneous state.

string

pairingMessage
optional

Description of the pairing status.

string

pairingStatus
optional

The current status of pairing.

string

afterPolicySteps

Name Description Schema

destination
optional

Steps to perform for the destination cluster.

source
optional

Steps to perform for the source cluster.

summary
optional

Summary of the steps to perform.

string

beforePolicySteps

Name Description Schema

destination
optional

Steps to perform for the destination cluster.

documentationLink
optional

Link to the HBase replication manual steps documentation.

string

source
optional

Steps to perform for the source cluster.

summary
optional

Summary of the steps to perform.

string


Copyright © 2024 Cloudera, Inc. All rights reserved.