Package com.cloudera.cdp.dw.model
Class ImpalaOptionsCreateRequest
- java.lang.Object
-
- com.cloudera.cdp.dw.model.ImpalaOptionsCreateRequest
-
@Generated(value="com.cloudera.cdp.client.codegen.CdpSDKJavaCodegen", date="2023-09-27T13:27:51.717-07:00") public class ImpalaOptionsCreateRequest extends Object
Impala specific options. It cannot be provided for Virtual Warehouse types other than Impala.
-
-
Constructor Summary
Constructors Constructor Description ImpalaOptionsCreateRequest()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description boolean
equals(Object o)
Integer
getScratchSpaceLimit()
Getter for scratchSpaceLimit.String
getSpillToS3Uri()
Getter for spillToS3Uri.int
hashCode()
void
setScratchSpaceLimit(Integer scratchSpaceLimit)
Setter for scratchSpaceLimit.void
setSpillToS3Uri(String spillToS3Uri)
Setter for spillToS3Uri.String
toString()
-
-
-
Method Detail
-
getSpillToS3Uri
public String getSpillToS3Uri()
Getter for spillToS3Uri. Set S3 URI in \"s3://bucket/path\" format and enable spilling to S3. If this is set, \"scratchSpaceLimit\" cannot be set. Spilling to a remote storage is not supported on Azure, it is available on AWS and PvC platforms. If your workload results in large volumes of intermediate data being written, it is recommended to configure the heavy spilling queries to use a remote storage location rather than the local one since Impala occasionally needs to use persistent storage for writing intermediate files during large sorts, joins, aggregations, or analytic function operations. Note that this value is ignored if the Impala version does not support spilling to S3.
-
setSpillToS3Uri
public void setSpillToS3Uri(String spillToS3Uri)
Setter for spillToS3Uri. Set S3 URI in \"s3://bucket/path\" format and enable spilling to S3. If this is set, \"scratchSpaceLimit\" cannot be set. Spilling to a remote storage is not supported on Azure, it is available on AWS and PvC platforms. If your workload results in large volumes of intermediate data being written, it is recommended to configure the heavy spilling queries to use a remote storage location rather than the local one since Impala occasionally needs to use persistent storage for writing intermediate files during large sorts, joins, aggregations, or analytic function operations. Note that this value is ignored if the Impala version does not support spilling to S3.
-
getScratchSpaceLimit
public Integer getScratchSpaceLimit()
Getter for scratchSpaceLimit. Defines the limit for scratch space in GiB needed by Impala for spilling queries. If this is set, \"spillToS3Uri\" cannot be set. The valid values are between 1-16000 for AWS and 1-16684 for Azure. It will choose the first valid value for which the total disk space is greater than or equal to the specified scratch space limit. The valid scratch space limit values per node in GiBs for AWS are [300, 634, 968, 1302, 1636, 1970, 2304, 2638, 2972, 6550, 7000, 8000, 9000, 10000, 11000, 12000, 13000, 14000, 15000, 16000]. Valid values for Azure are [300, 684, 812, 1068, 1324, 1836, 2348, 3372, 4396, 8492, 16684].
-
setScratchSpaceLimit
public void setScratchSpaceLimit(Integer scratchSpaceLimit)
Setter for scratchSpaceLimit. Defines the limit for scratch space in GiB needed by Impala for spilling queries. If this is set, \"spillToS3Uri\" cannot be set. The valid values are between 1-16000 for AWS and 1-16684 for Azure. It will choose the first valid value for which the total disk space is greater than or equal to the specified scratch space limit. The valid scratch space limit values per node in GiBs for AWS are [300, 634, 968, 1302, 1636, 1970, 2304, 2638, 2972, 6550, 7000, 8000, 9000, 10000, 11000, 12000, 13000, 14000, 15000, 16000]. Valid values for Azure are [300, 684, 812, 1068, 1324, 1836, 2348, 3372, 4396, 8492, 16684].
-
-