Re: Compare hadoop and ytsaurus

2023-09-28 Thread Wei-Chiu Chuang
Hey Kirill, Thanks for sharing! I wasn't aware of this project. According to the blog post https://medium.com/yandex/ytsaurus-exabyte-scale-storage-and-processing-system-is-now-open-source-42e7f5fa5fc6 It was released in public earlier this year by Yandex. It was inspired by Google's MapReduce, s

use http simple auth only for Web UIs and not for webhdfs

2023-09-28 Thread anup ahire
Hello Team, I see that in hadoop 3.3.6, setting hadoop.http.authentication.type to simple sets simple auth to webhdfs unlike previous verison like 3.1 I have a use case where I only want to skip spnego for web ui access and not for webhdfs. In HttpServer2.java, I see this if (this.securityEnabl

Compare hadoop and ytsaurus

2023-09-28 Thread Kirill
Hi everyone! Have you seen this platform https://ytsaurus.tech/platform-overview ? What do you think? Has somebody tried it? Is it based on Hadoop source code? It is claimed that there is also a MapReduce in it. Is it possible to run Hadoop programs and Hive queries on ytsaurus? Regards, Kirill