[jira] [Updated] (CARBONDATA-4125) SI compatability issue fix
[ https://issues.apache.org/jira/browse/CARBONDATA-4125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Indhumathi Muthu Murugesh updated CARBONDATA-4125: -- Description: Refer [http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/Bug-SI-Compatibility-Issue-td105485.html] for this issue > SI compatability issue fix > -- > > Key: CARBONDATA-4125 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4125 > Project: CarbonData > Issue Type: Bug >Reporter: Indhumathi Muthu Murugesh >Priority: Major > > Refer > [http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/Bug-SI-Compatibility-Issue-td105485.html] > for this issue -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (CARBONDATA-4125) SI compatability issue fix
Indhumathi Muthu Murugesh created CARBONDATA-4125: - Summary: SI compatability issue fix Key: CARBONDATA-4125 URL: https://issues.apache.org/jira/browse/CARBONDATA-4125 Project: CarbonData Issue Type: Bug Reporter: Indhumathi Muthu Murugesh -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (CARBONDATA-4124) Refresh MV which does not exist is not throwing proper message
Indhumathi Muthu Murugesh created CARBONDATA-4124: - Summary: Refresh MV which does not exist is not throwing proper message Key: CARBONDATA-4124 URL: https://issues.apache.org/jira/browse/CARBONDATA-4124 Project: CarbonData Issue Type: Bug Reporter: Indhumathi Muthu Murugesh -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4122) Support Writing Flink Stage data into Hdfs file system
[ https://issues.apache.org/jira/browse/CARBONDATA-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Indhumathi Muthu Murugesh updated CARBONDATA-4122: -- Issue Type: Improvement (was: New Feature) > Support Writing Flink Stage data into Hdfs file system > -- > > Key: CARBONDATA-4122 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4122 > Project: CarbonData > Issue Type: Improvement >Reporter: Indhumathi Muthu Murugesh >Priority: Major > Time Spent: 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [carbondata] Indhumathi27 commented on a change in pull request #4090: [CARBONDATA-4122] Use CarbonFile API instead of java File API for Flink CarbonLocalWriter
Indhumathi27 commented on a change in pull request #4090: URL: https://github.com/apache/carbondata/pull/4090#discussion_r573488319 ## File path: docs/flink-integration-guide.md ## @@ -78,7 +78,7 @@ limitations under the License. val carbonProperties = new Properties // Set the carbon properties here, such as date format, store location, etc. -// Create carbon bulk writer factory. Two writer types are supported: 'Local' and 'S3'. +// Create carbon bulk writer factory. Three writer types are supported: 'Local', Hdfs' and 'S3'. Review comment: Chaned code to use CarbonLocalWriter itself to handle Local and Hdfs FileSystems. Please review This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4081: [WIP]Secondary Index based pruning without spark query plan modification
CarbonDataQA2 commented on pull request #4081: URL: https://github.com/apache/carbondata/pull/4081#issuecomment-776134616 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12444/job/ApacheCarbon_PR_Builder_2.4.5/3688/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4081: [WIP]Secondary Index based pruning without spark query plan modification
CarbonDataQA2 commented on pull request #4081: URL: https://github.com/apache/carbondata/pull/4081#issuecomment-776133890 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12444/job/ApacheCarbonPRBuilder2.3/5449/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4081: [WIP]Secondary Index based pruning without spark query plan modification
CarbonDataQA2 commented on pull request #4081: URL: https://github.com/apache/carbondata/pull/4081#issuecomment-776020699 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12444/job/ApacheCarbon_PR_Builder_2.4.5/3687/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4081: [WIP]Scan best Fix Secondary Index table on Index Server and prune main table
CarbonDataQA2 commented on pull request #4081: URL: https://github.com/apache/carbondata/pull/4081#issuecomment-776017835 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12444/job/ApacheCarbonPRBuilder2.3/5448/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] Indhumathi27 commented on a change in pull request #4090: [CARBONDATA-4122] Support HDFS Carbon writer for Flink Carbon Streaming
Indhumathi27 commented on a change in pull request #4090: URL: https://github.com/apache/carbondata/pull/4090#discussion_r572968625 ## File path: docs/flink-integration-guide.md ## @@ -78,7 +78,7 @@ limitations under the License. val carbonProperties = new Properties // Set the carbon properties here, such as date format, store location, etc. -// Create carbon bulk writer factory. Two writer types are supported: 'Local' and 'S3'. +// Create carbon bulk writer factory. Three writer types are supported: 'Local', Hdfs' and 'S3'. Review comment: yes. i also thought about the same. But since, already they have implemented writers for LOCAL and S3 type, i have implemented for HDFS. But i can see, there are some differences only for S3 writer, some extra configurations are needed and they are not creating directory while writing stage directories in S3. you can check CarbonS3Writer.commit. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] ajantha-bhat commented on a change in pull request #4090: [CARBONDATA-4122] Support HDFS Carbon writer for Flink Carbon Streaming
ajantha-bhat commented on a change in pull request #4090: URL: https://github.com/apache/carbondata/pull/4090#discussion_r572953288 ## File path: docs/flink-integration-guide.md ## @@ -78,7 +78,7 @@ limitations under the License. val carbonProperties = new Properties // Set the carbon properties here, such as date format, store location, etc. -// Create carbon bulk writer factory. Two writer types are supported: 'Local' and 'S3'. +// Create carbon bulk writer factory. Three writer types are supported: 'Local', Hdfs' and 'S3'. Review comment: Everywhere if we use file factory API and support HDFS conf input, only one writer is enough right ? do we need 3 writers ? Because in carbon table or SDK we don't create multiple type of writers to handle this kind of scenario. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4092: [WIP] Clean stale files in success segments
CarbonDataQA2 commented on pull request #4092: URL: https://github.com/apache/carbondata/pull/4092#issuecomment-775972308 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12444/job/ApacheCarbon_PR_Builder_2.4.5/3684/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4092: [WIP] Clean stale files in success segments
CarbonDataQA2 commented on pull request #4092: URL: https://github.com/apache/carbondata/pull/4092#issuecomment-775969824 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12444/job/ApacheCarbonPRBuilder2.3/5445/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4092: [WIP] Clean stale files in success segments
CarbonDataQA2 commented on pull request #4092: URL: https://github.com/apache/carbondata/pull/4092#issuecomment-775877799 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12444/job/ApacheCarbonPRBuilder2.3/5444/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4092: [WIP] Clean stale files in success segments
CarbonDataQA2 commented on pull request #4092: URL: https://github.com/apache/carbondata/pull/4092#issuecomment-775877278 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12444/job/ApacheCarbon_PR_Builder_2.4.5/3683/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] vikramahuja1001 opened a new pull request #4092: [WIP] Clean stale files in success segments
vikramahuja1001 opened a new pull request #4092: URL: https://github.com/apache/carbondata/pull/4092 ### Why is this PR needed? ### What changes were proposed in this PR? ### Does this PR introduce any user interface change? - No - Yes. (please explain the change and update document) ### Is any new testcase added? - No - Yes This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4089: [CARBONDATA-4117][[CARBONDATA-4123] cg index and bloom index query issue with Index server
CarbonDataQA2 commented on pull request #4089: URL: https://github.com/apache/carbondata/pull/4089#issuecomment-775826770 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12444/job/ApacheCarbon_PR_Builder_2.4.5/3682/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4089: [CARBONDATA-4117][[CARBONDATA-4123] cg index and bloom index query issue with Index server
CarbonDataQA2 commented on pull request #4089: URL: https://github.com/apache/carbondata/pull/4089#issuecomment-775826315 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12444/job/ApacheCarbonPRBuilder2.3/5443/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org