Full name:

com.cloudera.cdk:cdk-maven-plugin:0.9.0:update-dataset

Description:

Update a dataset's schema.

Attributes:

  • Requires dependency resolution of artifacts in scope: compile.

Required Parameters

Name Type Since Description
datasetName String - The name of the dataset to update.
User property is: cdk.datasetName.

Optional Parameters

Name Type Since Description
avroSchemaFile String - The file containing the Avro schema. If no file with the specified name is found on the local filesystem, then the classpath is searched for a matching resource. One of either this property or cdk.avroSchemaReflectClass must be specified.
User property is: cdk.avroSchemaFile.
avroSchemaReflectClass String - The fully-qualified classname of the Avro reflect class to use to generate a schema. The class must be available on the classpath. One of either this property or cdk.avroSchemaFile must be specified.
User property is: cdk.avroSchemaReflectClass.
hadoopConfiguration Properties - Hadoop configuration properties.
User property is: cdk.hadoopConfiguration.
hcatalog boolean - If true, store dataset metadata in HCatalog, otherwise store it on the filesystem.
User property is: cdk.hcatalog.
repositoryUri String - The URI specifying the dataset repository, e.g. repo:hdfs://host:8020/data. Optional, but if specified then cdk.rootDirectory and cdk.hcatalog are ignored.
User property is: cdk.repositoryUri.
rootDirectory String - The root directory of the dataset repository. Optional if using HCatalog for metadata storage.
User property is: cdk.rootDirectory.

Parameter Details

avroSchemaFile:

The file containing the Avro schema. If no file with the specified name is found on the local filesystem, then the classpath is searched for a matching resource. One of either this property or cdk.avroSchemaReflectClass must be specified.
  • Type: java.lang.String
  • Required: No
  • User Property: cdk.avroSchemaFile

avroSchemaReflectClass:

The fully-qualified classname of the Avro reflect class to use to generate a schema. The class must be available on the classpath. One of either this property or cdk.avroSchemaFile must be specified.
  • Type: java.lang.String
  • Required: No
  • User Property: cdk.avroSchemaReflectClass

datasetName:

The name of the dataset to update.
  • Type: java.lang.String
  • Required: Yes
  • User Property: cdk.datasetName

hadoopConfiguration:

Hadoop configuration properties.
  • Type: java.util.Properties
  • Required: No
  • User Property: cdk.hadoopConfiguration

hcatalog:

If true, store dataset metadata in HCatalog, otherwise store it on the filesystem.
  • Type: boolean
  • Required: No
  • User Property: cdk.hcatalog

repositoryUri:

The URI specifying the dataset repository, e.g. repo:hdfs://host:8020/data. Optional, but if specified then cdk.rootDirectory and cdk.hcatalog are ignored.
  • Type: java.lang.String
  • Required: No
  • User Property: cdk.repositoryUri

rootDirectory:

The root directory of the dataset repository. Optional if using HCatalog for metadata storage.
  • Type: java.lang.String
  • Required: No
  • User Property: cdk.rootDirectory

Back to top

Version: 0.9.0. Last Published: 2013-12-05.

Reflow Maven skin by Andrius Velykis.