vinothchandar commented on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync URL: https://github.com/apache/incubator-hudi/issues/894#issuecomment-533596837 Got it. To run from IDE what I do is to add spark jars to the class path of my module in IntelliJ. You dont have to mess with your sbt and bring in avro etc . The idea here is that when you actually submit your application using spark-submit then these jars are there already. On transitive dependencies it would be based. on scope . Avro, parquet etc are in provided scope and so the expectation is that they are supplied by the actual runtime (IDE or spark-submit). This way we can keep hudi thinner and be able to support multiples spark hive hadoop versions
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
