|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Command
classes.builder
, constructs a command rooted at the given morphline JSON
config
.
System.currentTimeMillis()
to a given output field.value
.
Dataset
as a Crunch ReadableSource
.
Dataset
as a Crunch Target
.
config
.
FileSystem
.FieldPartitioner
.Dataset
.Configuration
used to find the FileSystem
(optional).
Configuration
used to find the FileSystem
.
Configuration
used to find the FileSystem
.
Dataset
with the supplied descriptor
.
DatasetDescriptor
for the dataset named name
.
ReadableSource
or Target
.Dataset
.DatasetDescriptor
s.descriptor
, if it is not
modified.
DatasetRepository
instances.Dataset
s.Dataset
.
name
.
PartitionKey
.
Record
referred to by the given field expression
Dataset
in this repository named name
.
DatasetDescriptor
for the dataset named
name
.
Record
referred to by a field expression,
which is a String of the form @{fieldname}
.FileSystem
to store metadata and dataset files in (optional).
DatasetRepository
that stores data in a Hadoop FileSystem
.FileSystemDatasetRepository
instances.MetadataProvider
that stores dataset metadata in a Hadoop
FileSystem
.FileSystemMetadataProvider
instances.Dataset
when stored in a
DatasetRepository
.Format
instances supported
by the library.baseIdField
record field, followed by a running count of the record number within
the current session.PartitionStrategy
instance.
DatasetDescriptor
associated with this dataset.
Format
that the data is stored in.
Dataset
is stored
(optional).
URI
with this pattern.
URI
with this pattern.
Dataset
.
PartitionKey
, possibly creating the partition
if it doesn't already exist.
PartitionStrategy
, if this dataset is partitioned.
DatasetReader
implementation based on the
underlying Dataset
implementation.
Schema
.
Schema
may be retrieved (optional).
DatasetWriter
implementation based on the
underlying Dataset
implementation.
buckets
.
buckets
.
DatasetRepository
that uses the Hive/HCatalog metastore for metadata,
and stores data in a Hadoop FileSystem
.HCatalogDatasetRepository
instances.PartitionFunctions.identity(String, Class, int)
.
PartitionStrategy.Builder.identity(String, Class, int)
.
buckets
size.
PartitionStrategy
), false otherwise.
Dataset
s in this DatasetRepository
.
Dataset
s managed by this
MetadataProvider
.
Dataset
.
name
.
ServiceLoader
.Dataset
's location (optional).
Dataset
's location (optional).
Dataset
's location (optional).
URI
matches this pattern.
URI
String matches this pattern.
MetadataProvider
for metadata storage (optional).
MorphlineContext.Builder.build()
instead
MorphlineContext
instance.DatasetRepositories.open(java.net.URI)
for String URIs.
DatasetRepository} for the given URI.
hash("username", 2)
in
JEXL.Dataset
.PartitionKey
corresponding to a partition's filesystem path
represented as a URI
.
PartitionStrategy
s.upperBounds
.
upperBounds
.
Fields.ATTACHMENT_BODY
.Fields.ATTACHMENT_BODY
.Fields.ATTACHMENT_BODY
.URIPattern
and an OptionBuilder
to create
instances of DatasetRepository from the pattern's match options.
File
.
InputStream
.
DatasetDescriptor.Builder.schemaUri(java.net.URI)
String
.
Dataset
's schema from a URI.
Dataset
's schema from a String URI.
DocumentLoader
.SolrMorphlineContext.Builder.build()
instead
SolrMorphlineContext
instance.SolrServer
.com.codahale.metrics.MetricRegistry
of the
morphline context to a set of CSV files, configured via a
com.codahale.metrics.CsvReporter.Builder
.com.codahale.metrics.MetricRegistry
of the morphline context
to JMX, configured via a com.codahale.metrics.JmxReporter.Builder
.com.codahale.metrics.MetricRegistry
of the
morphline context to SLF4j, configured via a
com.codahale.metrics.Slf4jReporter.Builder
.Object.toString()
to
their string representation, and then via String.getBytes(Charset)
to their byte
array representation.Object.toString()
to
their string representation, and optionally also applies String.trim()
.Dataset
to reflect the supplied descriptor
.
DatasetDescriptor
for the dataset named name
.
String
.
E
to the associated dataset.
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |