Question
How does Okera handle tables where some files are invalid? For example, where an avro file that doesn't match the schema. i.e. table is declared as map for this field but data is string.
Answer
Many data "correctness" issues fail queries, as opposed to silently ignoring them (for example, when converting data into NULL). To revert the behavior, add --abort_on_error to RS_ARGS.
This behavior is documented here.
Comments
0 comments
Please sign in to leave a comment.