|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Command
classes.builder
, constructs a command rooted at the given morphline JSON
config
.
System.currentTimeMillis()
to a given output field.value
.
Dataset
as a Crunch ReadableSource
.
Dataset
as a Crunch Target
.
FileSystemDatasetRepository
.
FileSystemMetadataProvider
.
HCatalogDatasetRepository
.
PartitionStrategy
instance.
config
.
FileSystem
.FieldPartitioner
.Dataset
.Configuration
used to find the FileSystem
(optional).
Configuration
used to find the FileSystem
.
Configuration
used to find the FileSystem
.
Dataset
with the supplied descriptor
.
DatasetDescriptor
for the dataset named name
.
ReadableSource
or Target
.Dataset
.Schema
,
optional URL, Format
, optional location URL, and optional
PartitionStrategy
.
DatasetDescriptor
s.descriptor
, if it is not
modified.
DatasetRepository
instances.Dataset
s.System.currentTimeMillis()
, using
SimpleDateFormat
.DateFormatPartitioner
for Universal Coordinated
Time, UTC (+00:00), and cardinality 1095 (3 years, 1 day = 1 partition).
DateFormatPartitioner
for Universal Coordinated
Time, UTC (+00:00).
Dataset
.
name
.
Key
key
.
PartitionKey
.
Record
referred to by the given field expression
Dataset
in this repository named name
.
DatasetDescriptor
for the dataset named
name
.
Record
referred to by a field expression,
which is a String of the form @{fieldname}
.FileSystem
to store metadata and dataset files in (optional).
DatasetRepository
that stores data in a Hadoop FileSystem
.FileSystemDatasetRepository
for the given
MetadataProvider
for metadata storage.
FileSystemDatasetRepository
instances.MetadataProvider
that stores dataset metadata in a Hadoop
FileSystem
.FileSystemMetadataProvider
instances.Dataset
when stored in a
DatasetRepository
.Format
instances supported
by the library.Format
for the format name specified.
baseIdField
record field, followed by a running count of the record number within
the current session.index
.
Key
key
.
Dataset
that this is a View
of.
DatasetDescriptor
associated with this dataset.
Format
that the data is stored in.
Dataset
is stored
(optional).
Dataset
.
PartitionKey
, possibly creating the partition
if it doesn't already exist.
PartitionStrategy
, if this dataset is partitioned.
View.newReader()
Schema
.
Schema
may be retrieved (optional).
View.newWriter()
buckets
.
buckets
.
DatasetRepository
that uses the Hive/HCatalog metastore for metadata,
and stores data in a Hadoop FileSystem
.HCatalogDatasetRepository
instances.PartitionFunctions.identity(String, Class, int)
.
PartitionStrategy.Builder.identity(String, Class, int)
.
buckets
size.
fieldName
on the entity by the
specified amount.
PartitionStrategy
), false otherwise.
RandomAccessDataset
.Key
objects.Key.Builder
for a RandomAccessDataset
.
Dataset
s in this DatasetRepository
.
Dataset
s managed by this
MetadataProvider
.
Dataset
.
name
.
Dataset
's location (optional).
Dataset
's location (optional).
Dataset
's location (optional).
MetadataProvider
for metadata storage (optional).
MorphlineContext.Builder.build()
instead
MorphlineContext
instance.DatasetReader
implementation based on this
View
of the underlying Dataset
implementation.
DatasetWriter
implementation based on this
View
of the underlying Dataset
implementation.
DatasetNotFoundException
insteadDatasetRepositories.open(java.net.URI)
for String URIs.
DatasetRepository
for the given URI.
DatasetRepositories.openRandomAccess(java.net.URI)
for String URIs.
DatasetRepositories.open(java.net.URI)
for RandomAccessDatasetRepository
s
hash("username", 2)
in
JEXL.Dataset
.PartitionKey
corresponding to a partition's filesystem path
represented as a URI
.
PartitionStrategy
s.Dataset
that supports random access operations on entities.RandomAccessDataset
s.upperBounds
.
upperBounds
.
Fields.ATTACHMENT_BODY
.Fields.ATTACHMENT_BODY
.Fields.ATTACHMENT_BODY
.File
.
InputStream
.
String
.
Dataset
's schema from a URI.
Dataset
's schema from a String URI.
DocumentLoader
.SolrMorphlineContext.Builder.build()
instead
SolrMorphlineContext
instance.SolrServer
.com.codahale.metrics.MetricRegistry
of the
morphline context to a set of CSV files, configured via a
com.codahale.metrics.CsvReporter.Builder
.com.codahale.metrics.MetricRegistry
of the morphline context
to JMX, configured via a com.codahale.metrics.JmxReporter.Builder
.com.codahale.metrics.MetricRegistry
of the
morphline context to SLF4j, configured via a
com.codahale.metrics.Slf4jReporter.Builder
.Object.toString()
to
their string representation, and then via String.getBytes(Charset)
to their byte
array representation.Object.toString()
to
their string representation, and optionally also applies String.trim()
.Dataset
to reflect the supplied descriptor
.
DatasetDescriptor
for the dataset named name
.
View
is a subset of a Dataset
.E
to the associated dataset.
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |