auto_ml_job_v2s
Creates, updates, deletes, gets or lists an auto_ml_job_v2s resource.
Overview
| Name | auto_ml_job_v2s |
| Type | Resource |
| Id | aws.sagemaker.auto_ml_job_v2s |
Fields
The following fields are returned by SELECT queries:
- describe_auto_ml_job_v2
| Name | Datatype | Description |
|---|---|---|
auto_ml_compute_config | object | The compute configuration used for the AutoML job V2. |
auto_ml_job_arn | string | Returns the Amazon Resource Name (ARN) of the AutoML job V2. (pattern: <code>arn:aws[a-z-]:sagemaker:[a-z0-9-]:[0-9]{12}:automl-job/.*</code>) |
auto_ml_job_artifacts | object | The artifacts that are generated during an AutoML job. |
auto_ml_job_input_data_config | array | Returns an array of channel objects describing the input data and their location. |
auto_ml_job_name | string | Returns the name of the AutoML job V2. (pattern: <code>[a-zA-Z0-9](-*[a-zA-Z0-9]){0,31}</code>) |
auto_ml_job_objective | object | Specifies a metric to minimize or maximize as the objective of an AutoML job. |
auto_ml_job_secondary_status | string | Returns the secondary status of the AutoML job V2. (Starting, MaxCandidatesReached, Failed, Stopped, MaxAutoMLJobRuntimeReached, Stopping, CandidateDefinitionsGenerated, Completed, ExplainabilityError, DeployingModel, ModelDeploymentError, GeneratingModelInsightsReport, ModelInsightsError, AnalyzingData, FeatureEngineering, ModelTuning, GeneratingExplainabilityReport, TrainingModels, PreTraining) |
auto_ml_job_status | string | Returns the status of the AutoML job V2. (Completed, InProgress, Failed, Stopped, Stopping) |
auto_ml_problem_type_config | object | Returns the configuration settings of the problem type set for the AutoML job V2. |
auto_ml_problem_type_config_name | string | Returns the name of the problem type configuration set for the AutoML job V2. (ImageClassification, TextClassification, TimeSeriesForecasting, Tabular, TextGeneration) |
best_candidate | object | Information about the candidate produced by an AutoML training job V2, including its status, steps, and other properties. |
creation_time | string (date-time) | Returns the creation time of the AutoML job V2. |
data_split_config | object | Returns the configuration settings of how the data are split into train and validation datasets. |
end_time | string (date-time) | Returns the end time of the AutoML job V2. |
failure_reason | string | Returns the reason for the failure of the AutoML job V2, when applicable. |
last_modified_time | string (date-time) | Returns the job's last modified time. |
model_deploy_config | object | Indicates whether the model was deployed automatically to an endpoint and the name of that endpoint if deployed automatically. |
model_deploy_result | object | Provides information about endpoint for the model deployment. |
output_data_config | object | Returns the job's output data config. |
partial_failure_reasons | array | Returns a list of reasons for partial failures within an AutoML job V2. |
resolved_attributes | object | Returns the resolved attributes used by the AutoML job V2. |
role_arn | string | The ARN of the IAM role that has read permission to the input data location and write permission to the output data location in Amazon S3. (pattern: <code>arn:aws[a-z-]*:iam::\d{12}:role/?[a-zA-Z_0-9+=,.@-_/]+</code>) |
security_config | object | Returns the security configuration for traffic encryption or Amazon VPC settings. |
Methods
The following methods are available for this resource:
| Name | Accessible by | Required Params | Optional Params | Description |
|---|---|---|---|---|
describe_auto_ml_job_v2 | select | region | Returns information about an AutoML job created by calling CreateAutoMLJobV2 or CreateAutoMLJob. | |
create_auto_ml_job_v2 | insert | region, AutoMLJobName, AutoMLJobInputDataConfig, OutputDataConfig, AutoMLProblemTypeConfig, RoleArn | Creates an Autopilot job also referred to as Autopilot experiment or AutoML job V2. An AutoML job in SageMaker AI is a fully automated process that allows you to build machine learning models with minimal effort and machine learning expertise. When initiating an AutoML job, you provide your data and optionally specify parameters tailored to your use case. SageMaker AI then automates the entire model development lifecycle, including data preprocessing, model training, tuning, and evaluation. AutoML jobs are designed to simplify and accelerate the model building process by automating various tasks and exploring different combinations of machine learning algorithms, data preprocessing techniques, and hyperparameter values. The output of an AutoML job comprises one or more trained models ready for deployment and inference. Additionally, SageMaker AI AutoML jobs generate a candidate model leaderboard, allowing you to select the best-performing model for deployment. For more information about AutoML jobs, see https://docs.aws.amazon.com/sagemaker/latest/dg/autopilot-automate-model-development.html in the SageMaker AI developer guide. AutoML jobs V2 support various problem types such as regression, binary, and multiclass classification with tabular data, text and image classification, time-series forecasting, and fine-tuning of large language models (LLMs) for text generation. CreateAutoMLJobV2 and DescribeAutoMLJobV2 are new versions of CreateAutoMLJob and DescribeAutoMLJob which offer backward compatibility. CreateAutoMLJobV2 can manage tabular problem types identical to those of its previous version CreateAutoMLJob, as well as time-series forecasting, non-tabular problem types such as image or text classification, and text generation (LLMs fine-tuning). Find guidelines about how to migrate a CreateAutoMLJob to CreateAutoMLJobV2 in Migrate a CreateAutoMLJob to CreateAutoMLJobV2. For the list of available problem types supported by CreateAutoMLJobV2, see AutoMLProblemTypeConfig. You can find the best-performing model after you run an AutoML job V2 by calling DescribeAutoMLJobV2. |
Parameters
Parameters can be passed in the WHERE clause of a query. Check the Methods section to see which parameters are required or optional for each operation.
| Name | Datatype | Description |
|---|---|---|
region | string | AWS region (default: us-east-1) |
SELECT examples
- describe_auto_ml_job_v2
Returns information about an AutoML job created by calling CreateAutoMLJobV2 or CreateAutoMLJob.
SELECT
auto_ml_compute_config,
auto_ml_job_arn,
auto_ml_job_artifacts,
auto_ml_job_input_data_config,
auto_ml_job_name,
auto_ml_job_objective,
auto_ml_job_secondary_status,
auto_ml_job_status,
auto_ml_problem_type_config,
auto_ml_problem_type_config_name,
best_candidate,
creation_time,
data_split_config,
end_time,
failure_reason,
last_modified_time,
model_deploy_config,
model_deploy_result,
output_data_config,
partial_failure_reasons,
resolved_attributes,
role_arn,
security_config
FROM aws.sagemaker.auto_ml_job_v2s
WHERE region = '{{ region }}' -- required
;
INSERT examples
- create_auto_ml_job_v2
- Manifest
Creates an Autopilot job also referred to as Autopilot experiment or AutoML job V2. An AutoML job in SageMaker AI is a fully automated process that allows you to build machine learning models with minimal effort and machine learning expertise. When initiating an AutoML job, you provide your data and optionally specify parameters tailored to your use case. SageMaker AI then automates the entire model development lifecycle, including data preprocessing, model training, tuning, and evaluation. AutoML jobs are designed to simplify and accelerate the model building process by automating various tasks and exploring different combinations of machine learning algorithms, data preprocessing techniques, and hyperparameter values. The output of an AutoML job comprises one or more trained models ready for deployment and inference. Additionally, SageMaker AI AutoML jobs generate a candidate model leaderboard, allowing you to select the best-performing model for deployment. For more information about AutoML jobs, see https://docs.aws.amazon.com/sagemaker/latest/dg/autopilot-automate-model-development.html in the SageMaker AI developer guide. AutoML jobs V2 support various problem types such as regression, binary, and multiclass classification with tabular data, text and image classification, time-series forecasting, and fine-tuning of large language models (LLMs) for text generation. CreateAutoMLJobV2 and DescribeAutoMLJobV2 are new versions of CreateAutoMLJob and DescribeAutoMLJob which offer backward compatibility. CreateAutoMLJobV2 can manage tabular problem types identical to those of its previous version CreateAutoMLJob, as well as time-series forecasting, non-tabular problem types such as image or text classification, and text generation (LLMs fine-tuning). Find guidelines about how to migrate a CreateAutoMLJob to CreateAutoMLJobV2 in Migrate a CreateAutoMLJob to CreateAutoMLJobV2. For the list of available problem types supported by CreateAutoMLJobV2, see AutoMLProblemTypeConfig. You can find the best-performing model after you run an AutoML job V2 by calling DescribeAutoMLJobV2.
INSERT INTO aws.sagemaker.auto_ml_job_v2s (
AutoMLJobName,
AutoMLJobInputDataConfig,
OutputDataConfig,
AutoMLProblemTypeConfig,
RoleArn,
Tags,
SecurityConfig,
AutoMLJobObjective,
ModelDeployConfig,
DataSplitConfig,
AutoMLComputeConfig,
region
)
SELECT
'{{ AutoMLJobName }}' /* required */,
'{{ AutoMLJobInputDataConfig }}' /* required */,
'{{ OutputDataConfig }}' /* required */,
'{{ AutoMLProblemTypeConfig }}' /* required */,
'{{ RoleArn }}' /* required */,
'{{ Tags }}',
'{{ SecurityConfig }}',
'{{ AutoMLJobObjective }}',
'{{ ModelDeployConfig }}',
'{{ DataSplitConfig }}',
'{{ AutoMLComputeConfig }}',
'{{ region }}'
RETURNING
auto_ml_job_arn
;
# Description fields are for documentation purposes
- name: auto_ml_job_v2s
props:
- name: region
value: "{{ region }}"
description: Required parameter for the auto_ml_job_v2s resource.
- name: AutoMLJobName
value: "{{ AutoMLJobName }}"
description: |
Identifies an Autopilot job. The name must be unique to your account and is case insensitive.
- name: AutoMLJobInputDataConfig
description: |
An array of channel objects describing the input data and their location. Each channel is a named input source. Similar to the InputDataConfig attribute in the CreateAutoMLJob input parameters. The supported formats depend on the problem type: For tabular problem types: S3Prefix, ManifestFile. For image classification: S3Prefix, ManifestFile, AugmentedManifestFile. For text classification: S3Prefix. For time-series forecasting: S3Prefix. For text generation (LLMs fine-tuning): S3Prefix.
value:
- ChannelType: "{{ ChannelType }}"
ContentType: "{{ ContentType }}"
CompressionType: "{{ CompressionType }}"
DataSource:
S3DataSource:
S3DataType: "{{ S3DataType }}"
S3Uri: "{{ S3Uri }}"
- name: OutputDataConfig
description: |
Provides information about encryption and the Amazon S3 output path needed to store artifacts from an AutoML job.
value:
KmsKeyId: "{{ KmsKeyId }}"
S3OutputPath: "{{ S3OutputPath }}"
- name: AutoMLProblemTypeConfig
description: |
Defines the configuration settings of one of the supported problem types.
value:
ImageClassificationJobConfig:
CompletionCriteria:
MaxCandidates: {{ MaxCandidates }}
MaxRuntimePerTrainingJobInSeconds: {{ MaxRuntimePerTrainingJobInSeconds }}
MaxAutoMLJobRuntimeInSeconds: {{ MaxAutoMLJobRuntimeInSeconds }}
TextClassificationJobConfig:
CompletionCriteria:
MaxCandidates: {{ MaxCandidates }}
MaxRuntimePerTrainingJobInSeconds: {{ MaxRuntimePerTrainingJobInSeconds }}
MaxAutoMLJobRuntimeInSeconds: {{ MaxAutoMLJobRuntimeInSeconds }}
ContentColumn: "{{ ContentColumn }}"
TargetLabelColumn: "{{ TargetLabelColumn }}"
TimeSeriesForecastingJobConfig:
FeatureSpecificationS3Uri: "{{ FeatureSpecificationS3Uri }}"
CompletionCriteria:
MaxCandidates: {{ MaxCandidates }}
MaxRuntimePerTrainingJobInSeconds: {{ MaxRuntimePerTrainingJobInSeconds }}
MaxAutoMLJobRuntimeInSeconds: {{ MaxAutoMLJobRuntimeInSeconds }}
ForecastFrequency: "{{ ForecastFrequency }}"
ForecastHorizon: {{ ForecastHorizon }}
ForecastQuantiles:
- "{{ ForecastQuantiles }}"
Transformations:
Filling: "{{ Filling }}"
Aggregation: "{{ Aggregation }}"
TimeSeriesConfig:
TargetAttributeName: "{{ TargetAttributeName }}"
TimestampAttributeName: "{{ TimestampAttributeName }}"
ItemIdentifierAttributeName: "{{ ItemIdentifierAttributeName }}"
GroupingAttributeNames:
- "{{ GroupingAttributeNames }}"
HolidayConfig:
- CountryCode: "{{ CountryCode }}"
CandidateGenerationConfig:
AlgorithmsConfig:
- AutoMLAlgorithms: "{{ AutoMLAlgorithms }}"
TabularJobConfig:
CandidateGenerationConfig:
AlgorithmsConfig:
- AutoMLAlgorithms: "{{ AutoMLAlgorithms }}"
CompletionCriteria:
MaxCandidates: {{ MaxCandidates }}
MaxRuntimePerTrainingJobInSeconds: {{ MaxRuntimePerTrainingJobInSeconds }}
MaxAutoMLJobRuntimeInSeconds: {{ MaxAutoMLJobRuntimeInSeconds }}
FeatureSpecificationS3Uri: "{{ FeatureSpecificationS3Uri }}"
Mode: "{{ Mode }}"
GenerateCandidateDefinitionsOnly: {{ GenerateCandidateDefinitionsOnly }}
ProblemType: "{{ ProblemType }}"
TargetAttributeName: "{{ TargetAttributeName }}"
SampleWeightAttributeName: "{{ SampleWeightAttributeName }}"
TextGenerationJobConfig:
CompletionCriteria:
MaxCandidates: {{ MaxCandidates }}
MaxRuntimePerTrainingJobInSeconds: {{ MaxRuntimePerTrainingJobInSeconds }}
MaxAutoMLJobRuntimeInSeconds: {{ MaxAutoMLJobRuntimeInSeconds }}
BaseModelName: "{{ BaseModelName }}"
TextGenerationHyperParameters: "{{ TextGenerationHyperParameters }}"
ModelAccessConfig:
AcceptEula: {{ AcceptEula }}
- name: RoleArn
value: "{{ RoleArn }}"
description: |
The ARN of the role that is used to access the data.
- name: Tags
description: |
An array of key-value pairs. You can use tags to categorize your Amazon Web Services resources in different ways, such as by purpose, owner, or environment. For more information, see Tagging Amazon Web ServicesResources. Tag keys must be unique per resource.
value:
- Key: "{{ Key }}"
Value: "{{ Value }}"
- name: SecurityConfig
description: |
The security configuration for traffic encryption or Amazon VPC settings.
value:
VolumeKmsKeyId: "{{ VolumeKmsKeyId }}"
EnableInterContainerTrafficEncryption: {{ EnableInterContainerTrafficEncryption }}
VpcConfig:
SecurityGroupIds:
- "{{ SecurityGroupIds }}"
Subnets:
- "{{ Subnets }}"
- name: AutoMLJobObjective
description: |
Specifies a metric to minimize or maximize as the objective of a job. If not specified, the default objective metric depends on the problem type. For the list of default values per problem type, see AutoMLJobObjective. For tabular problem types: You must either provide both the AutoMLJobObjective and indicate the type of supervised learning problem in AutoMLProblemTypeConfig (TabularJobConfig.ProblemType), or none at all. For text generation problem types (LLMs fine-tuning): Fine-tuning language models in Autopilot does not require setting the AutoMLJobObjective field. Autopilot fine-tunes LLMs without requiring multiple candidates to be trained and evaluated. Instead, using your dataset, Autopilot directly fine-tunes your target model to enhance a default objective metric, the cross-entropy loss. After fine-tuning a language model, you can evaluate the quality of its generated text using different metrics. For a list of the available metrics, see Metrics for fine-tuning LLMs in Autopilot.
value:
MetricName: "{{ MetricName }}"
- name: ModelDeployConfig
description: |
Specifies how to generate the endpoint name for an automatic one-click Autopilot model deployment.
value:
AutoGenerateEndpointName: {{ AutoGenerateEndpointName }}
EndpointName: "{{ EndpointName }}"
- name: DataSplitConfig
description: |
This structure specifies how to split the data into train and validation datasets. The validation and training datasets must contain the same headers. For jobs created by calling CreateAutoMLJob, the validation dataset must be less than 2 GB in size. This attribute must not be set for the time-series forecasting problem type, as Autopilot automatically splits the input dataset into training and validation sets.
value:
ValidationFraction: {{ ValidationFraction }}
- name: AutoMLComputeConfig
description: |
Specifies the compute configuration for the AutoML job V2.
value:
EmrServerlessComputeConfig:
ExecutionRoleARN: "{{ ExecutionRoleARN }}"