Package com.cloudera.cdp.dw.model

Class ImpalaOptionsCreateRequest

java.lang.Object
com.cloudera.cdp.dw.model.ImpalaOptionsCreateRequest
@Generated(value="com.cloudera.cdp.client.codegen.CdpSDKJavaCodegen", date="2024-09-27T08:40:25.071-07:00") public class ImpalaOptionsCreateRequest extends Object
Impala specific options. It cannot be provided for Virtual Warehouse types other than Impala.

  • Constructor Details

    • ImpalaOptionsCreateRequest

      public ImpalaOptionsCreateRequest()

  • Method Details

    • getSpillToS3Uri

      public String getSpillToS3Uri()
      Getter for spillToS3Uri. Set S3 URI in \"s3://bucket/path\" format and enable spilling to S3. If this is set, \"scratchSpaceLimit\" cannot be set. Spilling to a remote storage is not supported on Azure, it is available on AWS and PvC platforms. If your workload results in large volumes of intermediate data being written, it is recommended to configure the heavy spilling queries to use a remote storage location rather than the local one since Impala occasionally needs to use persistent storage for writing intermediate files during large sorts, joins, aggregations, or analytic function operations. Note that this value is ignored if the Impala version does not support spilling to S3.

    • setSpillToS3Uri

      public void setSpillToS3Uri(String spillToS3Uri)
      Setter for spillToS3Uri. Set S3 URI in \"s3://bucket/path\" format and enable spilling to S3. If this is set, \"scratchSpaceLimit\" cannot be set. Spilling to a remote storage is not supported on Azure, it is available on AWS and PvC platforms. If your workload results in large volumes of intermediate data being written, it is recommended to configure the heavy spilling queries to use a remote storage location rather than the local one since Impala occasionally needs to use persistent storage for writing intermediate files during large sorts, joins, aggregations, or analytic function operations. Note that this value is ignored if the Impala version does not support spilling to S3.

    • getScratchSpaceLimit

      public Integer getScratchSpaceLimit()
      Getter for scratchSpaceLimit. Defines the limit for scratch space in GiB needed by Impala for spilling queries. If this is set, \"spillToS3Uri\" cannot be set. The valid values are between 1-16000 for AWS and 1-16684 for Azure. It will choose the first valid value for which the total disk space is greater than or equal to the specified scratch space limit. The valid scratch space limit values per node in GiBs for AWS are [300, 634, 968, 1302, 1636, 1970, 2304, 2638, 2972, 6550, 7000, 8000, 9000, 10000, 11000, 12000, 13000, 14000, 15000, 16000]. Valid values for Azure are [300, 684, 812, 1068, 1324, 1836, 2348, 3372, 4396, 8492, 16684].

    • setScratchSpaceLimit

      public void setScratchSpaceLimit(Integer scratchSpaceLimit)
      Setter for scratchSpaceLimit. Defines the limit for scratch space in GiB needed by Impala for spilling queries. If this is set, \"spillToS3Uri\" cannot be set. The valid values are between 1-16000 for AWS and 1-16684 for Azure. It will choose the first valid value for which the total disk space is greater than or equal to the specified scratch space limit. The valid scratch space limit values per node in GiBs for AWS are [300, 634, 968, 1302, 1636, 1970, 2304, 2638, 2972, 6550, 7000, 8000, 9000, 10000, 11000, 12000, 13000, 14000, 15000, 16000]. Valid values for Azure are [300, 684, 812, 1068, 1324, 1836, 2348, 3372, 4396, 8492, 16684].

    • equals

      public boolean equals(Object o)
      Overrides:
      equals in class Object

    • hashCode

      public int hashCode()
      Overrides:
      hashCode in class Object

    • toString

      public String toString()
      Overrides:
      toString in class Object