Package com.cloudera.cdp.dw.model

Class ImpalaOptionsCreateRequest

java.lang.Object

com.cloudera.cdp.dw.model.ImpalaOptionsCreateRequest

@Generated(value="com.cloudera.cdp.client.codegen.CdpSDKJavaCodegen",
           date="2024-03-13T13:08:45.683-07:00")
public class ImpalaOptionsCreateRequest
extends Object

Impala specific options. It cannot be provided for Virtual Warehouse types other than Impala.

Constructor Summary

Constructors

Constructor	Description
ImpalaOptionsCreateRequest()

Method Summary

Modifier and Type	Method	Description
boolean	equals(Object o)
Integer	getScratchSpaceLimit()	Getter for scratchSpaceLimit.
String	getSpillToS3Uri()	Getter for spillToS3Uri.
int	hashCode()
void	setScratchSpaceLimit(Integer scratchSpaceLimit)	Setter for scratchSpaceLimit.
void	setSpillToS3Uri(String spillToS3Uri)	Setter for spillToS3Uri.
String	toString()

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

ImpalaOptionsCreateRequest

public ImpalaOptionsCreateRequest()

Method Detail

getSpillToS3Uri

public String getSpillToS3Uri()

Getter for spillToS3Uri. Set S3 URI in \"s3://bucket/path\" format and enable spilling to S3. If this is set, \"scratchSpaceLimit\" cannot be set. Spilling to a remote storage is not supported on Azure, it is available on AWS and PvC platforms. If your workload results in large volumes of intermediate data being written, it is recommended to configure the heavy spilling queries to use a remote storage location rather than the local one since Impala occasionally needs to use persistent storage for writing intermediate files during large sorts, joins, aggregations, or analytic function operations. Note that this value is ignored if the Impala version does not support spilling to S3.

setSpillToS3Uri

public void setSpillToS3Uri(String spillToS3Uri)

Setter for spillToS3Uri. Set S3 URI in \"s3://bucket/path\" format and enable spilling to S3. If this is set, \"scratchSpaceLimit\" cannot be set. Spilling to a remote storage is not supported on Azure, it is available on AWS and PvC platforms. If your workload results in large volumes of intermediate data being written, it is recommended to configure the heavy spilling queries to use a remote storage location rather than the local one since Impala occasionally needs to use persistent storage for writing intermediate files during large sorts, joins, aggregations, or analytic function operations. Note that this value is ignored if the Impala version does not support spilling to S3.

getScratchSpaceLimit

public Integer getScratchSpaceLimit()

Getter for scratchSpaceLimit. Defines the limit for scratch space in GiB needed by Impala for spilling queries. If this is set, \"spillToS3Uri\" cannot be set. The valid values are between 1-16000 for AWS and 1-16684 for Azure. It will choose the first valid value for which the total disk space is greater than or equal to the specified scratch space limit. The valid scratch space limit values per node in GiBs for AWS are [300, 634, 968, 1302, 1636, 1970, 2304, 2638, 2972, 6550, 7000, 8000, 9000, 10000, 11000, 12000, 13000, 14000, 15000, 16000]. Valid values for Azure are [300, 684, 812, 1068, 1324, 1836, 2348, 3372, 4396, 8492, 16684].

setScratchSpaceLimit

public void setScratchSpaceLimit(Integer scratchSpaceLimit)

Setter for scratchSpaceLimit. Defines the limit for scratch space in GiB needed by Impala for spilling queries. If this is set, \"spillToS3Uri\" cannot be set. The valid values are between 1-16000 for AWS and 1-16684 for Azure. It will choose the first valid value for which the total disk space is greater than or equal to the specified scratch space limit. The valid scratch space limit values per node in GiBs for AWS are [300, 634, 968, 1302, 1636, 1970, 2304, 2638, 2972, 6550, 7000, 8000, 9000, 10000, 11000, 12000, 13000, 14000, 15000, 16000]. Valid values for Azure are [300, 684, 812, 1068, 1324, 1836, 2348, 3372, 4396, 8492, 16684].

equals

public boolean equals(Object o)

Overrides:

equals in class Object

hashCode

public int hashCode()

Overrides:

hashCode in class Object

toString

public String toString()

Overrides:

toString in class Object