#general
@kanishka: @kanishka has joined the channel
@linjiabao001: @linjiabao001 has joined the channel
#random
@kanishka: @kanishka has joined the channel
@linjiabao001: @linjiabao001 has joined the channel
#troubleshooting
@deemish2: Hi Team , I am working on backfill data using spark ingestion job and the segment name should be same which is stored under offline table (which is moved from realtime table using minion) , segment name is like tablename_wxc_18924_18924_0. while pushing backfill data using spark ingestion job , segment name is like tablename _OFFLINE_18924_18924_0 . In spark ingestion YAML file , for segmentNameGeneratorSpec: type :simple , i can’t use type- normalizedDate becuase it gives in different format. Is there any way to remove OFFLINE(tablename _OFFLINE_18924_18924_0) text from segment name
@kanishka: @kanishka has joined the channel
@vibhor.jain: Hi Team, We are facing one issue in the query where one of our col values contains single quotes and we are getting CalciteSqlToPinotQuery exception. For example, one of the values is *L'hôp Test*. Since it contains a single quote, how to handle this and query the data for this value?
@mayanks: Have you tried escaping the single quote? If I am not wrong it would be something like `L''hop Test`?
@vibhor.jain: Hi @mayanks, I see putting 2 single quotes is working. Is this the recommended way?
@mark.needham: Yeh, that's the way to escape quotes. Have updated the documentation -
@vibhor.jain: Awesome, thanks @mark.needham and @mayanks
@linjiabao001: @linjiabao001 has joined the channel
@lrhadoop143: Hi Team, I'm not able to run controller and server of pinot in docker with config file ,i have to read data from s3 for that i have to run server and controller with config file .i'm trying to run the server and controller by using this commands.sudo docker run --rm -ti \ --network=pinot-demo \ --name pinot-controller \ -p 9010:9010 \ -e JAVA_OPTS="-Dplugins.dir=/opt/pinot/plugins -Xms1G -Xmx4G -XX:+UseG1GC -XX:MaxGCPauseMillis=200 -Xloggc:gc-pinot-controller.log" \ -d apachepinot/pinot:latest StartController -configFileName "/home/mahesh/Documents/pinot/s3-pinot/controller.conf" \ -zkAddress pinot-zookeeper:2181
@xiangfu0: You need to mount your local disk t docker container
@xiangfu0: docker run --rm -ti \ --name pinot-controller \ --network=pinot-demo \ -p 9000:9000 \ --env AWS_ACCESS_KEY_ID=<aws-access-key-id> \ --env AWS_SECRET_ACCESS_KEY=<aws-secret-access-key> \ --mount type=bind,source=/tmp/pinot-s3-docker,target=/tmp \ apachepinot/pinot:0.6.0-SNAPSHOT-ca8545b29-20201105-jdk11 StartController \ -configFileName /tmp/controller.conf
@xiangfu0:
@xiangfu0: See that -mount option on docker
@alihaydar.atil: Hi, when upsert functionality enabled, would it update the records in the segments of the offline table for hybrid tables?
@mark.needham: I think upsert is only for real-time tables, it won't affect offline tables
@alihaydar.atil: @mark.needham thank you, i realized that RealtimeToOffline task and upsert configs are not allowed at the same time in table config
#pinot-dev
@atri.sharma: Folks, please review:
@ashish: @ashish has joined the channel
#getting-started
@linjiabao001: @linjiabao001 has joined the channel
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@pinot.apache.org For additional commands, e-mail: dev-h...@pinot.apache.org
