What does Atlan crawl from SageMaker

Atlan crawls comprehensive metadata from your Amazon SageMaker AI platform, including models, training jobs, and datasets information.

Asset

Atlan crawls the following SageMaker assets, each with specific metadata fields.

Model

SageMaker models represent trained machine learning models that can be deployed for inference. Atlan maps models from Amazon SageMaker to its SageMakerModel asset type.

Source field	Atlan field	Description
ModelName	name	Model name
ModelArn	sageMakerArn	AWS ARN of the model
CreationTime	sourceCreatedAt	When the model was created
ContainerImage	sageMakerModelContainerImage	Docker container image for the model
ContainerModelData	sageMakerS3Uri	S3 URI of model artifacts
ExecutionRoleArn	sageMakerModelExecutionRoleArn	IAM role for model execution
ModelStatus	aiModelStatus	Current status of the model
ModelPackageGroupName	sageMakerModelModelGroupName	Name of the parent Model Group
ModelPackageGroupArn	sageMakerModelModelGroupQualifiedName	Qualified name of the parent Model Group
ExternalUrl	sourceURL	Link to AWS SageMaker console

Model Group

SageMaker model groups represent collections of versioned model packages that can be organized and managed together. Atlan maps model package groups from Amazon SageMaker to its SageMakerModelGroup asset type.

Source field	Atlan field	Description
ModelPackageGroupName	name	Model package group name
ModelPackageGroupArn	sageMakerArn	AWS ARN of the model package group
ModelPackageGroupDescription	description	Description of the model package group
CreationTime	sourceCreatedAt	When the model package group was created
CreationTime	sourceUpdatedAt	Last update time (defaults to creation time)
ModelPackageGroupStatus	sageMakerModelGroupStatus	Current status of the model package group

Job

SageMaker jobs represent various types of ML job executions including training, processing, and transform jobs. Atlan maps jobs from Amazon SageMaker to its SageMakerJob asset type.

Source field	Atlan field	Description
TrainingJobName	name	Job name
TrainingJobArn	sageMakerArn	AWS ARN of the job
JobType	sageMakerJobType	Type of job (training, processing, transform)
TrainingJobStatus	flowStatus	Current status of the job
CreationTime	sourceCreatedAt	When the job was created
TrainingStartTime	flowStartedAt	When the job started
TrainingEndTime	flowFinishedAt	When the job completed
ExternalUrl	sourceURL	Link to AWS SageMaker console

Dataset

SageMaker datasets represent curated/intermediate datasets (Glue table or S3 prefix) used by SageMaker for training and inference. Atlan maps datasets from Amazon SageMaker to its SageMakerDataset asset type.

Source field	Atlan field	Description
DatasetName	name	Dataset name
DatasetArn	sageMakerArn	AWS ARN of the dataset
Platform	sageMakerDatasetPlatform	Platform where dataset is stored (S3, Glue)
OfflineStoreS3Uri	sageMakerS3Uri	S3 URI of offline store data
DatabaseName	databaseName	Database name

Feature Group

SageMaker Feature Groups represent collections of related features for machine learning training and inference. Atlan maps feature groups from Amazon SageMaker to its SageMakerFeatureGroup asset type.

Source field	Atlan field	Description
FeatureGroupName	name	Feature group name
FeatureGroupArn	sageMakerArn	AWS ARN of the feature group
Description	description	Feature group description
CreationTime	sourceCreatedAt	When the feature group was created
FeatureGroupStatus	sageMakerFeatureGroupStatus	Current status of the feature group
RecordIdName	sageMakerFeatureGroupRecordIdName	Name of the record identifier feature
OfflineStoreS3Uri	sageMakerS3Uri	S3 URI of offline store data
GlueDatabase	sageMakerFeatureGroupGlueDatabase	AWS Glue database name
GlueTable	sageMakerFeatureGroupGlueTable	AWS Glue table name
ExternalUrl	sourceURL	Link to AWS SageMaker console

Model Deployment

SageMaker endpoints represent deployed models that serve real-time inference requests. Atlan maps model deployments from Amazon SageMaker to its SageMakerModelDeployment asset type.

Source field	Atlan field	Description
EndpointName	name	Endpoint name
EndpointArn	sageMakerArn	AWS ARN of the endpoint
CreatedAt	sourceCreatedAt	When the endpoint was created
ModelDeploymentStatus	sageMakerModelDeploymentStatus	Current status of the endpoint
EndpointConfigName	sageMakerModelDeploymentEndpointConfigName	Associated endpoint configuration
ModelName	sageMakerModelDeploymentModelName	Name of the parent Model
ModelArn	sageMakerModelDeploymentModelQualifiedName	Qualified name of the parent Model
ExternalUrl	sourceURL	Link to AWS SageMaker console

Feature

SageMaker features represent individual features within Feature Groups, including their data type and metadata. Atlan maps features from Amazon SageMaker to its SageMakerFeature asset type.

Source field	Atlan field	Description
FeatureName	name	Feature name
FeatureGroupArn	sageMakerArn	AWS ARN of the feature group
FeatureGroupName	sageMakerFeatureFeatureGroupName	Name of the containing feature group
FeatureGroupQualifiedName	sageMakerFeatureFeatureGroupQualifiedName	Qualified name of the containing feature group
DataType	sageMakerFeatureDataType	Data type of the feature
IsRecordIdentifier	sageMakerFeatureIsRecordIdentifier	Whether this feature serves as record identifier

Dataset column

SageMaker dataset columns represent individual columns within SageMaker datasets. Atlan maps dataset columns from Amazon SageMaker to its SageMakerDatasetColumn asset type.

Source field	Atlan field	Description
ColumnName	name	Column name
ColumnArn	sageMakerArn	AWS ARN of the column
DataType	dataType	Column data type
IsNullable	isNullable	Whether the column accepts null values
IsPartitionColumn	isPartitionColumn	Whether this is a partition column
IsPrimaryKey	isPrimaryKey	Whether this is a primary key column
OrdinalPosition	ordinalPosition	Column position in the dataset
Precision	precision	Precision for numeric columns
Scale	scale	Scale for numeric columns

See also

• Preflight checks for SageMaker: