In glue Schema, Partition key expects similar Data type for all partitions, to pass set expression in GetPartitions api ? #2417
Unanswered
Sach1nAgarwal
asked this question in
Q&A
Replies: 1 comment 2 replies
-
If let suppose two partitions are there in schema:- Column name | Data Type
GetPartitions fails, if setting expression ( c1 > 20 ) . Now if change data type of c2 to int or bigint or char, get partition passes. |
Beta Was this translation helpful? Give feedback.
2 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
After running the glue crawler, it generates schema, when all partition_key in the generated schema have same data type,
then get_partitions api after set_expression passes,
If any one partition_key have different data type in schema, then after setting set_expression, get_partitions api throwing an error "InvalidInputException"
Is this expected behavior or not?
Beta Was this translation helpful? Give feedback.
All reactions