Problem
DDL fails to load metadata. Planner log shows an error similar to
AnalysisException: Failed to load metadata for table: DB.TB\nCAUSED BY: TableLoadingException: Failed to load metadata for table: DB.TB\nCAUSED BY: AnalysisException: Comment of column 'COLUMN' exceeds maximum length of 256 characters
Answer
Early versions of Okera had a 256 character limit for columns in HMS. In later versions, a setting can be toggled to disable the soft limit.
- Check the cerebro-planner deployment to confirm the following setting is not set to "false". If it is, either remove the entry or explicitly set to "true". Editing the deployment will restart the pods, after which HMS can process columns wider than 256 characters.
HMS_REMOVE_LENGTH_RESTRICTION=false
- Setting the above specifically removes the 256 character limitation.
Comments
0 comments
Please sign in to leave a comment.