Skip to main content

Troubleshooting AWS Glue connectivity

What are known limitations of AWS Glue connector?​

Atlan currently doesn't support the following:

  • Parsing MAP type objects for columns and nested columns.
  • Tables stored in Amazon S3 Table Buckets display an Iceberg Table subtype label in Atlan. This reflects the table's storage format and is expected behavior. These assets are cataloged as standard Glue Table entities and support pipeline lineage through Open Lineage.

What does sizeBytes property mean in AWS Glue crawls?​

In Atlan, the sizeBytes property is derived from the SizeKey parameter returned by AWS Glue. This value represents the total size of all files associated with a table, in bytes. For example, if a Glue table points to an S3 location with three files, each 1 MB in size, sizeBytes shows 3,145,728 bytes (3 × 1,048,576). For more information, see Parameters set on Data Catalog tables by crawler - AWS Glue.