Apache Pinot Daily Email Digest (2020-07-26)

2020-07-26 Thread Pinot Slack Email Digest 
#general@moghey.apoorv: A simple question:

Does it make sense to keep segment retention 4 years in case of realtime 
tables? 
Shall we go for a hybrid table? 
What is the recommendation? 
or is this decision depend upon other factors? 

In our case, we will always be ingesting data via 
Kafka.@techlabassociates: @techlabassociates has joined 
the channel@moghey.apoorv: Another simple question

I was following this doc. 


it mentioned `*pinot.server.instance.realtime.alloc.offheap: true*.`
But I am not able to get the format of Pinot server configuration, is it YAML 
or JSON?

There is a parameter called  -configFileName. But it's description says `Broker 
Starter Config file`. I am little confused here. Can anybody 
help?@g.kishore: It’s a key value 
pairs@g.kishore: @npawar will be presenting Pinot at Kafka 
Summit. 

 aug 24 1pm pst. This years Kafka Summit virtual and free. 
#random@techlabassociates: 
@techlabassociates has joined the 
channel#troubleshooting@pradeepgv42: 
Sorry I am facing another issue while querying the table, after fixing 
the above issue with this code-change 
().
 KafkaConsumer seems to be working fine now based on the logs on server node.

```Caught exception while processing instance request
java.lang.NoSuchMethodError: 
java.nio.ByteBuffer.position(I)Ljava/nio/ByteBuffer;
at 
org.apache.pinot.core.common.datatable.DataTableBuilder.setColumn(DataTableBuilder.java:157)
 
~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-39a78f3df43ac613663975844e598f07b18bf623]
at 
org.apache.pinot.core.query.selection.SelectionOperatorUtils.getDataTableFromRows(SelectionOperatorUtils.java:261)
 
~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-39a78f3df43ac613663975844e598f07b18bf623]
at 
org.apache.pinot.core.operator.blocks.IntermediateResultsBlock.getSelectionResultDataTable(IntermediateResultsBlock.java:348)
 
~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-39a78f3df43ac613663975844e598f07b18bf623]
at 
org.apache.pinot.core.operator.blocks.IntermediateResultsBlock.getDataTable(IntermediateResultsBlock.java:262)
 
~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-39a78f3df43ac613663975844e598f07b18bf623]
at 
org.apache.pinot.core.operator.blocks.InstanceResponseBlock.init(InstanceResponseBlock.java:43)
 
~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-39a78f3df43ac613663975844e598f07b18bf623]
at 
org.apache.pinot.core.operator.InstanceResponseOperator.getNextBlock(InstanceResponseOperator.java:37)
 
~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-39a78f3df43ac613663975844e598f07b18bf623]
at 
org.apache.pinot.core.operator.InstanceResponseOperator.getNextBlock(InstanceResponseOperator.java:26)
 
~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-39a78f3df43ac613663975844e598f07b18bf623]
at 
org.apache.pinot.core.operator.BaseOperator.nextBlock(BaseOperator.java:49) 
~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-39a78f3df43ac613663975844e598f07b18bf623]
at 
org.apache.pinot.core.plan.GlobalPlanImplV0.execute(GlobalPlanImplV0.java:48) 
~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-39a78f3df43ac613663975844e598f07b18bf623]
 ```

Re: Podling Pinot Report Reminder - August 2020

2020-07-26 Thread Felix Cheung 
Reminder on the report.

https://cwiki.apache.org/confluence/display/INCUBATOR/August2020


From: jmcl...@apache.org 
Sent: Thursday, July 23, 2020 1:21:50 AM
To: d...@pinot.incubator.apache.org 
Subject: Podling Pinot Report Reminder - August 2020

Dear podling,

This email was sent by an automated system on behalf of the Apache
Incubator PMC. It is an initial reminder to give you plenty of time to
prepare your quarterly board report.

The board meeting is scheduled for Wed, 19 August 2020.
The report for your podling will form a part of the Incubator PMC
report. The Incubator PMC requires your report to be submitted 2 weeks
before the board meeting, to allow sufficient time for review and
submission (Wed, August 05).

Please submit your report with sufficient time to allow the Incubator
PMC, and subsequently board members to review and digest. Again, the
very latest you should submit your report is 2 weeks prior to the board
meeting.

Candidate names should not be made public before people are actually
elected, so please do not include the names of potential committers or
PPMC members in your report.

Thanks,

The Apache Incubator PMC

Submitting your Report

--

Your report should contain the following:

*   Your project name
*   A brief description of your project, which assumes no knowledge of
the project or necessarily of its field
*   A list of the three most important issues to address in the move
towards graduation.
*   Any issues that the Incubator PMC or ASF Board might wish/need to be
aware of
*   How has the community developed since the last report
*   How has the project developed since the last report.
*   How does the podling rate their own maturity.

This should be appended to the Incubator Wiki page at:

https://cwiki.apache.org/confluence/display/INCUBATOR/August2020

Note: This is manually populated. You may need to wait a little before
this page is created from a template.

Note: The format of the report has changed to use markdown.

Mentors
---

Mentors should review reports for their project(s) and sign them off on
the Incubator wiki page. Signing off reports shows that you are
following the project - projects that are not signed may raise alarms
for the Incubator PMC.

Incubator PMC

-
To unsubscribe, e-mail: dev-unsubscr...@pinot.apache.org
For additional commands, e-mail: dev-h...@pinot.apache.org