#general
@zsolt: The docs say: > Pinot only allows adding new columns to the schema. In order to drop a column, change the column name or data type, a new table has to be created. Does this also mean that moving a field i.e. from dimensions to metrics is not possible?
@xiangfu0: If the data type doesn’t change, then pinot won’t throw exception, but your default null value will change e.g. INT default null value is INTEGER.NEGATIVE_MAX for dimension field and 0 for metric field.
@zsolt: So if I apply the schema with the moved field and reload the tables older segments will continue to work? The consuming realtime segments will work too?
@xiangfu0: Yes, just the default null value won’t change for persisted segments.
@xiangfu0: Also, You need to reload consuming segment with a flag
@luis.muniz: @luis.muniz has joined the channel
@sajjan: @sajjan has joined the channel
@karinwolok1: :wave: Heyyyyy to all out new community members! :wave: Welcome! We're happy to have you! Curious who you are and what got found Pinot? :wine_glass: @luis.muniz @sajjan @r.clark @naga.suhinthan916 @bandewarrahul @mertaydin. @satyamkrishna92 @rayokota @pabc55684 @ajithreddy118 @pingkarthickselvaraj @mark
@satyamkrishna92: Hey Karin, we are building some near realtime alerting and reporting for our supply chain requirements at Grofers. We are still in early phases of exploring right now. It is good to be here with everyone :raised_hands:
@luis.muniz: Hi Karin, we are building a highly responsive website and need sub-second query performance on OLAP data. We are studying aspects of the different technologies and Pinot seems like a very strong candidate on paper
@luis.muniz: I asked a question in <#C01H1S9J5BJ|getting-started> but I'm not sure that was the appropriate channel
@luis.muniz: Why is Pinot not represented in the Wikipedia comparison page of OLAP servers?
@g.kishore: I can't think of any good reason.
@g.kishore: looks like we need to first have a page for Apache Pinot and only then we can add an entry
@g.kishore: @kennybastani I know you added some content for Pinot in wikipedia. Can you please help us here
@kennybastani: Sure
@kennybastani: I'll work on creating the page. It's up to the Wikipedia admins to approve it.
@kennybastani: I'll then go through the comparison of OLAP servers and add context.
@sunny.arora: @sunny.arora has joined the channel
@mertaydin: Hello everyone. It’s so awesome to be here with you. Looking forward to jumping in after a quick review of threads :wink:
@kennybastani: Hello!
@karinwolok1: In case you missed it! :slightly_smiling_face: :wine_glass: Here is the recording from StarTree's launch event last week. _Pushing the Boundaries of Real-Time Analytics_ We had an amazing line-up of speakers from companies like LinkedIn, Stripe, DoorDash, Decodable, Conlfuent, Microsoft and more! Big shoutout to our dedicated community members that attended and answered questioned, shared thoughts, etc. We were really happy to see those familiar faces. :heart:
@hemanth.bm12: @hemanth.bm12 has joined the channel
@leon.liu: @leon.liu has joined the channel
#random
@luis.muniz: @luis.muniz has joined the channel
@sajjan: @sajjan has joined the channel
@sunny.arora: @sunny.arora has joined the channel
@hemanth.bm12: @hemanth.bm12 has joined the channel
@leon.liu: @leon.liu has joined the channel
#fraud
@patidar.rahul8392: @patidar.rahul8392 has joined the channel
#troubleshooting
@luis.muniz: @luis.muniz has joined the channel
@sajjan: @sajjan has joined the channel
@sunny.arora: @sunny.arora has joined the channel
@patidar.rahul8392: Hi Everyone, Is there any way to Ingest Data from Kerberous Kafka in Pinot?.I have started Pinot with quick-start-batch.sh file and added jaas file location in quick-start-batch.sh. -Djava.security.auth.login.config="/home/hdfs/client_jaas.conf" \ -Dapp.name="quick-start-batch" \ and it worked as expected.Now I am Starting all Pinot Components seprately with the help of config file and added -Djava.security.auth.login.config="/home/hdfs/client_jaas.conf" in all existing Pinot component files (start-broker.sh,start-controller.sh,start-server.sh) and trying to create table but getting below error message. 2021/06/29 22:29:03.708 INFO [AddTableCommand] [main] {"code":500,"error":"org.apache.kafka.common.KafkaException: Failed to construct kafka consumer"}. Someone Kindly suggest how should i use client_jaas.conf to start pinot in clusterd mode so it can read data from kerberous kafka also. @xiangfu0 @jackie.jxt
@xiangfu0: I haven’t tried this before. I thought you can set extra kafka configs in your table config
@xiangfu0:
@xiangfu0: for step 4, can you try add ```security.protocol=SASL_PLAINTEXT (or SASL_SSL) sasl.kerberos.service.name="kafka"``` into your stream configs in your table conf
@patidar.rahul8392: Okay @xiangfu0 security.protocol is already added in config file.let me add Kerberos service name also
@xiangfu0: also add those configs into your table config
@xiangfu0: under streaming config section, where you config your kafka topics etc
@hemanth.bm12: @hemanth.bm12 has joined the channel
@leon.liu: @leon.liu has joined the channel
#aggregators
@patidar.rahul8392: @patidar.rahul8392 has joined the channel
#pinot-dev
@rayokota: @rayokota has joined the channel
@ssubrama: quickstart jdk12 is failing intermittently on PR github actions. Did anything change recently?
#announcements
@patidar.rahul8392: @patidar.rahul8392 has joined the channel
#getting-started
@luis.muniz: @luis.muniz has joined the channel
@luis.muniz: Hi new user in the community investigating Pinot as a backend for our real-time user-facing analytics site. Are there any plans to support Apache Pulsar for stream ingestion? Thanks :)
@g.kishore: Yes. @kharekartik is working on adding support for pulsar
@mayanks: @mayanks has joined the channel
@rayokota: @rayokota has joined the channel
@bandewarrahul: @bandewarrahul has joined the channel
@patidar.rahul8392: @patidar.rahul8392 has joined the channel
#releases
@luis.muniz: @luis.muniz has joined the channel
#pinot-docsrus
@miliang: @miliang has joined the channel
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
