[GitHub] [hudi] harishchanderramesh commented on issue #1936: Hudi Query Error

2020-08-12 Thread GitBox
harishchanderramesh commented on issue #1936: URL: https://github.com/apache/hudi/issues/1936#issuecomment-672828200 Just a question before we close this issue. @umehrot2 When is EMR going to support latest version of Hudi? I think it is still supporting only 0.5.2.

[GitHub] [hudi] harishchanderramesh commented on issue #1936: Hudi Query Error

2020-08-12 Thread GitBox
harishchanderramesh commented on issue #1936: URL: https://github.com/apache/hudi/issues/1936#issuecomment-672783166 tried with both. No difference. Have reached out to aws support. Thanks @umehrot2 This is an automated m

[GitHub] [hudi] harishchanderramesh commented on issue #1936: Hudi Query Error

2020-08-10 Thread GitBox
harishchanderramesh commented on issue #1936: URL: https://github.com/apache/hudi/issues/1936#issuecomment-671719305 Hi @umehrot2 , Are you able to do a simple aws s3 ls and list or get anything from your cluster on S3 ? - Yes,I am able to. Are you configuring to use S3A inst

[GitHub] [hudi] harishchanderramesh commented on issue #1936: Hudi Query Error

2020-08-09 Thread GitBox
harishchanderramesh commented on issue #1936: URL: https://github.com/apache/hudi/issues/1936#issuecomment-671154630 Yes, I pass this `spark.sql.hive.convertMetastoreParquet=false`. Here is my spark submit command, if that may help. ``` export PYTHONIOENCODING=utf8 export YAR

[GitHub] [hudi] harishchanderramesh commented on issue #1936: Hudi Query Error

2020-08-09 Thread GitBox
harishchanderramesh commented on issue #1936: URL: https://github.com/apache/hudi/issues/1936#issuecomment-671019129 Yes, This happens all the time. I am unable to run 'read queries' on the hudi tables. Is there a better way to read? Am I doing it wrong? ``` from pyspark i