Troubleshooting AWS Glue connectivity
What are the known limitations of the AWS Glue connector?
Atlan currently does not support the following:
- Parsing
MAP
type objects for columns and nested columns.
What does the sizeBytes property mean in AWS Glue crawls?
In Atlan, the sizeBytes property is derived from the SizeKey parameter returned by AWS Glue. This value represents the total size of all files associated with a table, in bytes. For example, if a Glue table points to an S3 location with three files, each 1 MB in size, sizeBytes shows 3,145,728 bytes (3 × 1,048,576). For more information, see Parameters set on Data Catalog tables by crawler - AWS Glue.