Running on Mac (Catalina 10.15.2) with JDK 8 ________________________________ From: Xiang Fu <[email protected]> Sent: Thursday, March 5, 2020 12:08 AM To: [email protected] <[email protected]> Subject: Re: [VOTE] Apache Pinot (incubating) 0.3.0 RC0
Which environment you are running this from? Current batch/stream/hybrid QuickStarts are passed from Travis for OracleJDK 8 & 11 and OpenJDK 8 & 11. https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftravis-ci.org%2Fapache%2Fincubator-pinot%2Fbuilds%2F658378180%3Futm_medium%3Dnotification%26utm_source%3Dgithub_status&data=02%7C01%7Csteotia%40linkedin.com%7Cdb30b49f3dd54a7ebb2108d7c0dc7d35%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637189925537456673&sdata=i5Uvt1nd9v6pUajFVemEhkUKT2IQJDDKGNYYjpyQ7T0%3D&reserved=0 <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftravis-ci.org%2Fapache%2Fincubator-pinot%2Fbuilds%2F658378180%3Futm_medium%3Dnotification%26utm_source%3Dgithub_status&data=02%7C01%7Csteotia%40linkedin.com%7Cdb30b49f3dd54a7ebb2108d7c0dc7d35%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637189925537456673&sdata=i5Uvt1nd9v6pUajFVemEhkUKT2IQJDDKGNYYjpyQ7T0%3D&reserved=0> I tried to run this on my Mac and works. ➜ bin/quick-start-batch.sh ***** Starting Zookeeper, controller, broker and server ***** Executing command: StartZookeeper -zkPort 2123 -dataDir /var/folders/kp/v8smb2f11tg6q2grpwkq7qnh0000gn/T//PinotAdmin/zkData Start zookeeper at localhost:2123 in thread main Executing command: StartController -clusterName QuickStartCluster -controllerHost 127.0.0.1 -controllerPort 9000 -dataDir /var/folders/kp/v8smb2f11tg6q2grpwkq7qnh0000gn/T//PinotController -zkAddress localhost:2123 Invalid instance setup, missing znode path: /QuickStartCluster/CONFIGS/PARTICIPANT/Controller_127.0.0.1_9000 Invalid instance setup, missing znode path: /QuickStartCluster/INSTANCES/Controller_127.0.0.1_9000/MESSAGES Invalid instance setup, missing znode path: /QuickStartCluster/INSTANCES/Controller_127.0.0.1_9000/CURRENTSTATES Invalid instance setup, missing znode path: /QuickStartCluster/INSTANCES/Controller_127.0.0.1_9000/STATUSUPDATES Invalid instance setup, missing znode path: /QuickStartCluster/INSTANCES/Controller_127.0.0.1_9000/ERRORS Mar 05, 2020 12:01:46 AM org.glassfish.grizzly.http.server.NetworkListener start INFO: Started listener bound to [0.0.0.0:9000] Mar 05, 2020 12:01:46 AM org.glassfish.grizzly.http.server.HttpServer start INFO: [HttpServer] Started. Executing command: StartBroker -brokerHost null -brokerPort 8000 -zkAddress localhost:2123 Mar 05, 2020 12:01:50 AM org.glassfish.grizzly.http.server.NetworkListener start INFO: Started listener bound to [0.0.0.0:8000] Mar 05, 2020 12:01:50 AM org.glassfish.grizzly.http.server.HttpServer start INFO: [HttpServer-1] Started. Invalid instance setup, missing znode path: /QuickStartCluster/CONFIGS/PARTICIPANT/Broker_127.0.0.1_8000 Invalid instance setup, missing znode path: /QuickStartCluster/INSTANCES/Broker_127.0.0.1_8000/MESSAGES Invalid instance setup, missing znode path: /QuickStartCluster/INSTANCES/Broker_127.0.0.1_8000/CURRENTSTATES Invalid instance setup, missing znode path: /QuickStartCluster/INSTANCES/Broker_127.0.0.1_8000/STATUSUPDATES Invalid instance setup, missing znode path: /QuickStartCluster/INSTANCES/Broker_127.0.0.1_8000/ERRORS Executing command: StartServer -clusterName QuickStartCluster -serverHost 127.0.0.1 -serverPort 7000 -serverAdminPort 7500 -dataDir /tmp/1583395302452/PinotServerData0 -segmentDir /tmp/1583395302452/PinotServerSegment0 -zkAddress localhost:2123 Invalid instance setup, missing znode path: /QuickStartCluster/CONFIGS/PARTICIPANT/Server_127.0.0.1_7000 Invalid instance setup, missing znode path: /QuickStartCluster/INSTANCES/Server_127.0.0.1_7000/MESSAGES Invalid instance setup, missing znode path: /QuickStartCluster/INSTANCES/Server_127.0.0.1_7000/CURRENTSTATES Invalid instance setup, missing znode path: /QuickStartCluster/INSTANCES/Server_127.0.0.1_7000/STATUSUPDATES Invalid instance setup, missing znode path: /QuickStartCluster/INSTANCES/Server_127.0.0.1_7000/ERRORS Mar 05, 2020 12:01:54 AM org.glassfish.grizzly.http.server.NetworkListener start INFO: Started listener bound to [0.0.0.0:7500] Mar 05, 2020 12:01:54 AM org.glassfish.grizzly.http.server.HttpServer start INFO: [HttpServer-2] Started. ***** Adding baseballStats table ***** Executing command: AddTable -tableConfigFile /private/tmp/rc0-test/rc-test/apache-pinot-incubating-0.3.0-bin/quickStartData1583395302399/baseballStats_offline_table_config.json -schemaFile /private/tmp/rc0-test/rc-test/apache-pinot-incubating-0.3.0-bin/quickStartData1583395302399/baseballStats_schema.json -controllerHost 127.0.0.1 -controllerPort 9000 -exec ***** Launch data ingestion job to build index segment for baseballStats and push to controller ***** {"status":"Table baseballStats_OFFLINE succesfully added"} ***** Waiting for 5 seconds for the server to fetch the assigned segment ***** ***** Offline quickstart setup complete ***** Total number of documents in the table Query : select count(*) from baseballStats limit 0 Executing command: PostQuery -brokerHost 127.0.0.1 -brokerPort 8000 -queryType pql -query select count(*) from baseballStats limit 0 count_star 97889 *************************************************** Top 5 run scorers of all time Query : select sum('runs') from baseballStats group by playerName top 5 limit 0 Executing command: PostQuery -brokerHost 127.0.0.1 -brokerPort 8000 -queryType pql -query select sum('runs') from baseballStats group by playerName top 5 limit 0 sum_runs playerName 11581.00000 John Joseph 7981.00000 Michael Joseph 6083.00000 James Edward 5933.00000 William Henry 5547.00000 William Joseph *************************************************** Top 5 run scorers of the year 2000 Query : select sum('runs') from baseballStats where yearID=2000 group by playerName top 5 limit 0 Executing command: PostQuery -brokerHost 127.0.0.1 -brokerPort 8000 -queryType pql -query select sum('runs') from baseballStats where yearID=2000 group by playerName top 5 limit 0 sum_runs playerName 231.00000 Jose Antonio 205.00000 Mark David 189.00000 Rafael 152.00000 Jeffrey Robert 140.00000 Fernando *************************************************** Top 10 run scorers after 2000 Query : select sum('runs') from baseballStats where yearID>=2000 group by playerName limit 0 Executing command: PostQuery -brokerHost 127.0.0.1 -brokerPort 8000 -queryType pql -query select sum('runs') from baseballStats where yearID>=2000 group by playerName limit 0 sum_runs playerName 1820.00000 Adrian 1692.00000 Jose Antonio 1565.00000 Rafael 1500.00000 Brian Michael 1426.00000 Jose Alberto 1426.00000 Alexander Emmanuel 1390.00000 Derek Sanderson 1314.00000 Carlos 1300.00000 Johnny David 1261.00000 Ichiro *************************************************** Print playerName,runs,homeRuns for 10 records from the table and order them by yearID Query : select playerName,runs,homeRuns from baseballStats order by yearID limit 10 Executing command: PostQuery -brokerHost 127.0.0.1 -brokerPort 8000 -queryType pql -query select playerName,runs,homeRuns from baseballStats order by yearID limit 10 playerName runs homeRuns Alfred L. 0 0 Charles Roscoe 66 0 Adrian Constantine 29 0 Robert 9 0 Arthur Algernon 28 0 Douglas L. 28 2 Francis Patterson 0 0 Robert Edward 30 0 Franklin Lee 13 0 William 1 0 *************************************************** You can always go to http://localhost:9000/query to play around in the query console > On Mar 4, 2020, at 11:37 PM, Siddharth Teotia <[email protected]> > wrote: > > Seeing this exception on running quick-start-batch demo. Anyone else seeing > this? > > > ***** Adding baseballStats table ***** > > Executing command: AddTable -tableConfigFile > /Users/steotia/rc_test/apache-pinot-incubating-0.3.0-bin/bin/quickStartData1583393440027/baseballStats_offline_table_config.json > -schemaFile > /Users/steotia/rc_test/apache-pinot-incubating-0.3.0-bin/bin/quickStartData1583393440027/baseballStats_schema.json > -controllerHost 192.168.0.16 -controllerPort 9000 -exec > > ***** Launch data ingestion job to build index segment for baseballStats and > push to controller ***** > > {"status":"Table baseballStats_OFFLINE succesfully added"} > > Exception in thread "main" java.lang.IllegalStateException: PinotFS for > scheme: jar has not been initialized > > at > shaded.com.google.common.base.Preconditions.checkState(Preconditions.java:518) > > at > org.apache.pinot.spi.filesystem.PinotFSFactory.create(PinotFSFactory.java:78) > > at > > org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner.run(SegmentGenerationJobRunner.java:115) > > at > org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.kickoffIngestionJob(IngestionJobLauncher.java:96) > > at > org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.runIngestionJob(IngestionJobLauncher.java:77) > > at > org.apache.pinot.tools.admin.command.QuickstartRunner.launchDataIngestionJob(QuickstartRunner.java:183) > > at org.apache.pinot.tools.Quickstart.execute(Quickstart.java:154) > > at org.apache.pinot.tools.Quickstart.main(Quickstart.java:209) > > ________________________________ > From: H <[email protected] <mailto:[email protected]>> > Sent: Wednesday, March 4, 2020 11:04 PM > To: [email protected] <mailto:[email protected]> <[email protected] > <mailto:[email protected]>> > Subject: Re: [VOTE] Apache Pinot (incubating) 0.3.0 RC0 > > +1 > > On Wed, Mar 4, 2020 at 11:02 PM kishore g <[email protected]> wrote: > >> +1 >> >> On Tue, Mar 3, 2020 at 1:29 AM Fu Xiang <[email protected]> wrote: >> >>> Hi Pinot Community, >>> >>> This is a call for vote to the release Apache Pinot (incubating) version >>> 0.3.0. >>> >>> The release candidate: >>> >>> >> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fincubator%2Fpinot%2Fapache-pinot-incubating-0.3.0-rc0&data=02%7C01%7Csteotia%40linkedin.com%7Cdb30b49f3dd54a7ebb2108d7c0dc7d35%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637189925537456673&sdata=0FS46z18QU5BeV25ygN7XwNYgMxTOE2vTpAAetqtYdo%3D&reserved=0 >> >> <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fincubator%2Fpinot%2Fapache-pinot-incubating-0.3.0-rc0&data=02%7C01%7Csteotia%40linkedin.com%7Cdb30b49f3dd54a7ebb2108d7c0dc7d35%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637189925537456673&sdata=0FS46z18QU5BeV25ygN7XwNYgMxTOE2vTpAAetqtYdo%3D&reserved=0> >>> >>> Git tag for this release: >>> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fincubator-pinot%2Ftree%2Frelease-0.3.0-rc0&data=02%7C01%7Csteotia%40linkedin.com%7Cdb30b49f3dd54a7ebb2108d7c0dc7d35%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637189925537456673&sdata=vLfRJoLMGHEkPWGkNP2SSQ%2BXEQ41ZJ9vmQPJF%2BQkbzs%3D&reserved=0 >>> >>> <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fincubator-pinot%2Ftree%2Frelease-0.3.0-rc0&data=02%7C01%7Csteotia%40linkedin.com%7Cdb30b49f3dd54a7ebb2108d7c0dc7d35%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637189925537456673&sdata=vLfRJoLMGHEkPWGkNP2SSQ%2BXEQ41ZJ9vmQPJF%2BQkbzs%3D&reserved=0> >>> >>> Git hash for this release: >>> ca35bc64929ff27683e5f72ec2691a5dff6e89cf >>> >>> The artifacts have been signed with key: CDEDB21B862F6C66, which can be >>> found in the following KEYS file. >>> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Frelease%2Fincubator%2Fpinot%2FKEYS&data=02%7C01%7Csteotia%40linkedin.com%7Cdb30b49f3dd54a7ebb2108d7c0dc7d35%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637189925537466629&sdata=428jTnUI9xOmcOyVnRlf%2BWaVCYqEo%2B8MoKISn%2B1GRw4%3D&reserved=0 >>> >>> <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Frelease%2Fincubator%2Fpinot%2FKEYS&data=02%7C01%7Csteotia%40linkedin.com%7Cdb30b49f3dd54a7ebb2108d7c0dc7d35%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637189925537466629&sdata=428jTnUI9xOmcOyVnRlf%2BWaVCYqEo%2B8MoKISn%2B1GRw4%3D&reserved=0> >>> >>> Release notes: >>> GitHub: >>> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fincubator-pinot%2Freleases%2Ftag%2Frelease-0.3.0-rc0&data=02%7C01%7Csteotia%40linkedin.com%7Cdb30b49f3dd54a7ebb2108d7c0dc7d35%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637189925537466629&sdata=juqkqGoh%2FwbV8aEalSoZhp4gPKvWQxS70%2F6D%2FFAhY1U%3D&reserved=0 >>> >>> <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fincubator-pinot%2Freleases%2Ftag%2Frelease-0.3.0-rc0&data=02%7C01%7Csteotia%40linkedin.com%7Cdb30b49f3dd54a7ebb2108d7c0dc7d35%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637189925537466629&sdata=juqkqGoh%2FwbV8aEalSoZhp4gPKvWQxS70%2F6D%2FFAhY1U%3D&reserved=0> >>> GitBook: >>> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fapache-pinot.gitbook.io%2Fapache-pinot-cookbook%2Freleases%2F0.3.0&data=02%7C01%7Csteotia%40linkedin.com%7Cdb30b49f3dd54a7ebb2108d7c0dc7d35%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637189925537466629&sdata=OUcBC4ZSAjeROP0UOmQ5kDxbsiJkMxcOPcIUm5GvyIA%3D&reserved=0 >>> >>> <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fapache-pinot.gitbook.io%2Fapache-pinot-cookbook%2Freleases%2F0.3.0&data=02%7C01%7Csteotia%40linkedin.com%7Cdb30b49f3dd54a7ebb2108d7c0dc7d35%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637189925537466629&sdata=OUcBC4ZSAjeROP0UOmQ5kDxbsiJkMxcOPcIUm5GvyIA%3D&reserved=0> >>> >>> Staging repository: >>> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachepinot-1006&data=02%7C01%7Csteotia%40linkedin.com%7Cdb30b49f3dd54a7ebb2108d7c0dc7d35%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637189925537466629&sdata=OGMbRya58UjgBisVs1hmP2vYv5TzIjqJhvsPFZehJuw%3D&reserved=0 >>> >>> <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachepinot-1006&data=02%7C01%7Csteotia%40linkedin.com%7Cdb30b49f3dd54a7ebb2108d7c0dc7d35%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637189925537466629&sdata=OGMbRya58UjgBisVs1hmP2vYv5TzIjqJhvsPFZehJuw%3D&reserved=0> >>> >>> Documentation on verifying a release candidate: >>> >>> >> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FPINOT%2FValidating%2Ba%2Brelease%2Bcandidate&data=02%7C01%7Csteotia%40linkedin.com%7Cdb30b49f3dd54a7ebb2108d7c0dc7d35%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637189925537466629&sdata=%2Ff6wjlDWiuAnBpGvH9LnAZpB3GdGN44AUdcMY8fEAeg%3D&reserved=0 >> >> <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FPINOT%2FValidating%2Ba%2Brelease%2Bcandidate&data=02%7C01%7Csteotia%40linkedin.com%7Cdb30b49f3dd54a7ebb2108d7c0dc7d35%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637189925537466629&sdata=%2Ff6wjlDWiuAnBpGvH9LnAZpB3GdGN44AUdcMY8fEAeg%3D&reserved=0> >>> >>> >>> The vote will be open for at least 72 hours or until necessary number of >>> votes are reached. >>> >>> Please vote accordingly, >>> >>> [ ] +1 approve >>> [ ] +0 no opinion >>> [ ] -1 disapprove with the reason >>> >>> Thanks, >>> Apache Pinot (incubating) team
