Call for features you want to listed in Pinot 0.5 release
As I plan to release Pinot 0.5 in the coming 1 or 2 weeks, can you send me any major feature you want to announce in the release note? Please reply to this email thread with a short 1-3 sentence summary of the features added. Thanks, Ting Chen
Apache Pinot Daily Email Digest (2020-07-31)
#general@mayanks: Hello Pinot community, we at LinkedIn, are planning to host a Virtual Meetup for Apache Pinot on Aug 27. We would like to have one presenter from the community share their success-story/journey/etc with Pinot. Please reply to this thread if you would be interested in speaking, with a brief on what you would like to talk about.@christian: @christian has joined the channel@qiaochu: @qiaochu has joined the channel#random@christian: @christian has joined the channel@qiaochu: @qiaochu has joined the channel#feat-text-search@christian: @christian has joined the channel#troubleshooting@sosyalmedya.oguzhan: can someone help me about maven enforcer rules? :disappointed:@yash.agarwal: I am getting the following exception when querying the controller with a specific sql query. ```Caught exception while sending query request java.io.IOException: Failed : HTTP error code : 500 at org.apache.pinot.controller.api.resources.PinotQueryResource.sendPostRaw(PinotQueryResource.java:284) ~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-0fc081157c88734af0433c3cd30f310474d177f0] at org.apache.pinot.controller.api.resources.PinotQueryResource.sendRequestRaw(PinotQueryResource.java:322) ~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-0fc081157c88734af0433c3cd30f310474d177f0] at org.apache.pinot.controller.api.resources.PinotQueryResource.getQueryResponse(PinotQueryResource.java:204) ~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-0fc081157c88734af0433c3cd30f310474d177f0] at org.apache.pinot.controller.api.resources.PinotQueryResource.handlePostSql(PinotQueryResource.java:131) ~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-0fc081157c88734af0433c3cd30f310474d177f0]``` If I directly query the broker I am getting ```Grizzly 2.4.4 Request failed.Request failed.``` I have recently added a config in broker ```pinot.broker.timeoutMs=12``` Any Ideas ?@yash.agarwal: There are no logs in broker. Other queries are working fine, this query would scan 1.7 Bil recods and do a sum of 3 metrics and distinctcount of 1 dimension@yash.agarwal: It might be because of high memory usage on broker. as i am seeing usage spikes upto 60 - 80 %@mayanks: Yes, distinctcount on 1.7B records may the likely issue. Have you considered using HLL based approximate distinctcount?@yash.agarwal: We have tried HLL in the past. We are not looking for approximations.@yash.agarwal: Also seems like that is the problem, I tried without the distinctcount and it is returning successfully in 2 secs.@mailtobuchi: @mailtobuchi has left the channel@christian: @christian has joined the channel#pinot-dev@mayanks: `mvn clean install -DskipTests -Pbin-dist` takes awfully long time, it seems to have creeped up quite a bit over the years. Any ideas on how to make the build faster?@dlavoie: ~ 10 minutes on my own CI server. ```[INFO] Pinot .. SUCCESS [ 22.428 s] [INFO] Pinot Service Provider Interface ... SUCCESS [ 7.931 s] [INFO] Pinot Common ... SUCCESS [ 32.668 s] [INFO] Pinot Plugins .. SUCCESS [ 0.563 s] [INFO] Pinot Input Format . SUCCESS [ 0.510 s] [INFO] Pinot Avro Base SUCCESS [ 1.694 s] [INFO] Pinot Avro . SUCCESS [ 5.284 s] [INFO] Pinot Csv .. SUCCESS [ 0.844 s] [INFO] Pinot JSON . SUCCESS [ 0.738 s] [INFO] Pinot Core . SUCCESS [ 22.112 s] [INFO] Pinot Server ... SUCCESS [ 9.760 s] [INFO] Pinot Controller .
Re: Podling Pinot Report Reminder - August 2020
Another reminder From: Felix Cheung Sent: Sunday, July 26, 2020 5:09:32 PM To: dev@pinot.apache.org ; d...@pinot.incubator.apache.org Subject: Re: Podling Pinot Report Reminder - August 2020 Reminder on the report. https://cwiki.apache.org/confluence/display/INCUBATOR/August2020 From: jmcl...@apache.org Sent: Thursday, July 23, 2020 1:21:50 AM To: d...@pinot.incubator.apache.org Subject: Podling Pinot Report Reminder - August 2020 Dear podling, This email was sent by an automated system on behalf of the Apache Incubator PMC. It is an initial reminder to give you plenty of time to prepare your quarterly board report. The board meeting is scheduled for Wed, 19 August 2020. The report for your podling will form a part of the Incubator PMC report. The Incubator PMC requires your report to be submitted 2 weeks before the board meeting, to allow sufficient time for review and submission (Wed, August 05). Please submit your report with sufficient time to allow the Incubator PMC, and subsequently board members to review and digest. Again, the very latest you should submit your report is 2 weeks prior to the board meeting. Candidate names should not be made public before people are actually elected, so please do not include the names of potential committers or PPMC members in your report. Thanks, The Apache Incubator PMC Submitting your Report -- Your report should contain the following: * Your project name * A brief description of your project, which assumes no knowledge of the project or necessarily of its field * A list of the three most important issues to address in the move towards graduation. * Any issues that the Incubator PMC or ASF Board might wish/need to be aware of * How has the community developed since the last report * How has the project developed since the last report. * How does the podling rate their own maturity. This should be appended to the Incubator Wiki page at: https://cwiki.apache.org/confluence/display/INCUBATOR/August2020 Note: This is manually populated. You may need to wait a little before this page is created from a template. Note: The format of the report has changed to use markdown. Mentors --- Mentors should review reports for their project(s) and sign them off on the Incubator wiki page. Signing off reports shows that you are following the project - projects that are not signed may raise alarms for the Incubator PMC. Incubator PMC - To unsubscribe, e-mail: dev-unsubscr...@pinot.apache.org For additional commands, e-mail: dev-h...@pinot.apache.org