Dependency Information
To use the CDK modules in a Java project add the Cloudera repository to your Maven POM:
<repository> <id>cdh.repo</id> <url>https://repository.cloudera.com/artifactory/cloudera-repos</url> <name>Cloudera Repositories</name> <snapshots> <enabled>false</enabled> </snapshots> </repository>
Then add a dependency for each module you want to use by referring to the information listed on the Dependency Information pages listed below. You can also view the transitive dependencies for each module.
Hadoop Component Dependencies
As a general rule, CDK modules mark Hadoop component dependencies as having provided scope, since in many cases the dependencies are provided by the container that the code is running in.
For example,
- CDK Data has a provided dependency on the core Hadoop libraries
- CDK Crunch has a provided dependency on Crunch and the core Hadoop libraries
- CDK HCatalog has a provided dependency on HCatalog
The following containers provide the dependencies listed:
- The CDK Maven Plugin goal cdk:run-tool provides the Hadoop and HCatalog dependencies.
- The CDK Maven Plugin goal cdk:run-job provides the Hadoop dependencies. HCatalog should be added as a runtime dependency (example).
- The hadoop jar command provides the Hadoop dependencies.
However, there are some cases where you may have to provide the relevant Hadoop component dependencies yourself:
CDK Data Modules
- CDK Data Core Dependency Information, Dependencies
- CDK Data Crunch Dependency Information, Dependencies
- CDK Data Flume Dependency Information, Dependencies
- CDK Data HCatalog Dependency Information, Dependencies
CDK Morphlines Modules
- CDK Morphlines Core Dependency Information, Dependencies
- CDK Morphlines Avro Dependency Information, Dependencies
- CDK Morphlines JSON Dependency Information, Dependencies
- CDK Morphlines Hadoop Core Dependency Information, Dependencies
- CDK Morphlines Hadoop Sequence File Dependency Information, Dependencies
- CDK Morphlines Metrics Servlets Dependency Information, Dependencies
- CDK Morphlines Saxon Dependency Information, Dependencies
- CDK Morphlines Solr Core Dependency Information, Dependencies
- CDK Morphlines Solr Cell Dependency Information, Dependencies
- CDK Morphlines Tika Core Dependency Information, Dependencies
- CDK Morphlines Tika Decompress Dependency Information, Dependencies
- CDK Morphlines Twitter Dependency Information, Dependencies
- CDK Morphlines All Dependency Information, Dependencies
CDK Tools Modules
- CDK Tools Dependency Information, Dependencies