[jira] [Updated] (CARBONDATA-4125) SI compatability issue fix

2021-02-09 Thread Indhumathi Muthu Murugesh (Jira)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-4125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Indhumathi Muthu Murugesh updated CARBONDATA-4125:
--
Description: Refer 
[http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/Bug-SI-Compatibility-Issue-td105485.html]
 for this issue

> SI compatability issue fix
> --
>
> Key: CARBONDATA-4125
> URL: https://issues.apache.org/jira/browse/CARBONDATA-4125
> Project: CarbonData
>  Issue Type: Bug
>Reporter: Indhumathi Muthu Murugesh
>Priority: Major
>
> Refer 
> [http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/Bug-SI-Compatibility-Issue-td105485.html]
>  for this issue



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (CARBONDATA-4125) SI compatability issue fix

2021-02-09 Thread Indhumathi Muthu Murugesh (Jira)
Indhumathi Muthu Murugesh created CARBONDATA-4125:
-

 Summary: SI compatability issue fix
 Key: CARBONDATA-4125
 URL: https://issues.apache.org/jira/browse/CARBONDATA-4125
 Project: CarbonData
  Issue Type: Bug
Reporter: Indhumathi Muthu Murugesh






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (CARBONDATA-4124) Refresh MV which does not exist is not throwing proper message

2021-02-09 Thread Indhumathi Muthu Murugesh (Jira)
Indhumathi Muthu Murugesh created CARBONDATA-4124:
-

 Summary: Refresh MV which does not exist is not throwing proper 
message
 Key: CARBONDATA-4124
 URL: https://issues.apache.org/jira/browse/CARBONDATA-4124
 Project: CarbonData
  Issue Type: Bug
Reporter: Indhumathi Muthu Murugesh






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (CARBONDATA-4122) Support Writing Flink Stage data into Hdfs file system

2021-02-09 Thread Indhumathi Muthu Murugesh (Jira)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Indhumathi Muthu Murugesh updated CARBONDATA-4122:
--
Issue Type: Improvement  (was: New Feature)

> Support Writing Flink Stage data into Hdfs file system
> --
>
> Key: CARBONDATA-4122
> URL: https://issues.apache.org/jira/browse/CARBONDATA-4122
> Project: CarbonData
>  Issue Type: Improvement
>Reporter: Indhumathi Muthu Murugesh
>Priority: Major
>  Time Spent: 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [carbondata] Indhumathi27 commented on a change in pull request #4090: [CARBONDATA-4122] Use CarbonFile API instead of java File API for Flink CarbonLocalWriter

2021-02-09 Thread GitBox


Indhumathi27 commented on a change in pull request #4090:
URL: https://github.com/apache/carbondata/pull/4090#discussion_r573488319



##
File path: docs/flink-integration-guide.md
##
@@ -78,7 +78,7 @@ limitations under the License.
 val carbonProperties = new Properties
 // Set the carbon properties here, such as date format, store location, 
etc.
  
-// Create carbon bulk writer factory. Two writer types are supported: 
'Local' and 'S3'.
+// Create carbon bulk writer factory. Three writer types are supported: 
'Local', Hdfs' and 'S3'.

Review comment:
   Chaned code to use  CarbonLocalWriter itself to handle Local and Hdfs 
FileSystems. Please review





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4081: [WIP]Secondary Index based pruning without spark query plan modification

2021-02-09 Thread GitBox


CarbonDataQA2 commented on pull request #4081:
URL: https://github.com/apache/carbondata/pull/4081#issuecomment-776134616


   Build Failed  with Spark 2.4.5, Please check CI 
http://121.244.95.60:12444/job/ApacheCarbon_PR_Builder_2.4.5/3688/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4081: [WIP]Secondary Index based pruning without spark query plan modification

2021-02-09 Thread GitBox


CarbonDataQA2 commented on pull request #4081:
URL: https://github.com/apache/carbondata/pull/4081#issuecomment-776133890


   Build Failed  with Spark 2.3.4, Please check CI 
http://121.244.95.60:12444/job/ApacheCarbonPRBuilder2.3/5449/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4081: [WIP]Secondary Index based pruning without spark query plan modification

2021-02-09 Thread GitBox


CarbonDataQA2 commented on pull request #4081:
URL: https://github.com/apache/carbondata/pull/4081#issuecomment-776020699


   Build Failed  with Spark 2.4.5, Please check CI 
http://121.244.95.60:12444/job/ApacheCarbon_PR_Builder_2.4.5/3687/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4081: [WIP]Scan best Fix Secondary Index table on Index Server and prune main table

2021-02-09 Thread GitBox


CarbonDataQA2 commented on pull request #4081:
URL: https://github.com/apache/carbondata/pull/4081#issuecomment-776017835


   Build Failed  with Spark 2.3.4, Please check CI 
http://121.244.95.60:12444/job/ApacheCarbonPRBuilder2.3/5448/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] Indhumathi27 commented on a change in pull request #4090: [CARBONDATA-4122] Support HDFS Carbon writer for Flink Carbon Streaming

2021-02-09 Thread GitBox


Indhumathi27 commented on a change in pull request #4090:
URL: https://github.com/apache/carbondata/pull/4090#discussion_r572968625



##
File path: docs/flink-integration-guide.md
##
@@ -78,7 +78,7 @@ limitations under the License.
 val carbonProperties = new Properties
 // Set the carbon properties here, such as date format, store location, 
etc.
  
-// Create carbon bulk writer factory. Two writer types are supported: 
'Local' and 'S3'.
+// Create carbon bulk writer factory. Three writer types are supported: 
'Local', Hdfs' and 'S3'.

Review comment:
   yes. i also thought about the same. But since, already they have 
implemented writers for LOCAL and S3 type, i have implemented for HDFS. But i 
can see, there are some differences only for S3 writer, some extra 
configurations are needed and they are not creating directory while writing 
stage directories in S3. you can check  CarbonS3Writer.commit. 





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] ajantha-bhat commented on a change in pull request #4090: [CARBONDATA-4122] Support HDFS Carbon writer for Flink Carbon Streaming

2021-02-09 Thread GitBox


ajantha-bhat commented on a change in pull request #4090:
URL: https://github.com/apache/carbondata/pull/4090#discussion_r572953288



##
File path: docs/flink-integration-guide.md
##
@@ -78,7 +78,7 @@ limitations under the License.
 val carbonProperties = new Properties
 // Set the carbon properties here, such as date format, store location, 
etc.
  
-// Create carbon bulk writer factory. Two writer types are supported: 
'Local' and 'S3'.
+// Create carbon bulk writer factory. Three writer types are supported: 
'Local', Hdfs' and 'S3'.

Review comment:
   Everywhere if we use file factory API and support HDFS conf input, only 
one writer is enough right ? do we need 3 writers ?
   Because in carbon table or SDK we don't create multiple type of writers to 
handle this kind of scenario.





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4092: [WIP] Clean stale files in success segments

2021-02-09 Thread GitBox


CarbonDataQA2 commented on pull request #4092:
URL: https://github.com/apache/carbondata/pull/4092#issuecomment-775972308


   Build Failed  with Spark 2.4.5, Please check CI 
http://121.244.95.60:12444/job/ApacheCarbon_PR_Builder_2.4.5/3684/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4092: [WIP] Clean stale files in success segments

2021-02-09 Thread GitBox


CarbonDataQA2 commented on pull request #4092:
URL: https://github.com/apache/carbondata/pull/4092#issuecomment-775969824


   Build Success with Spark 2.3.4, Please check CI 
http://121.244.95.60:12444/job/ApacheCarbonPRBuilder2.3/5445/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4092: [WIP] Clean stale files in success segments

2021-02-09 Thread GitBox


CarbonDataQA2 commented on pull request #4092:
URL: https://github.com/apache/carbondata/pull/4092#issuecomment-775877799


   Build Failed  with Spark 2.3.4, Please check CI 
http://121.244.95.60:12444/job/ApacheCarbonPRBuilder2.3/5444/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4092: [WIP] Clean stale files in success segments

2021-02-09 Thread GitBox


CarbonDataQA2 commented on pull request #4092:
URL: https://github.com/apache/carbondata/pull/4092#issuecomment-775877278


   Build Failed  with Spark 2.4.5, Please check CI 
http://121.244.95.60:12444/job/ApacheCarbon_PR_Builder_2.4.5/3683/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] vikramahuja1001 opened a new pull request #4092: [WIP] Clean stale files in success segments

2021-02-09 Thread GitBox


vikramahuja1001 opened a new pull request #4092:
URL: https://github.com/apache/carbondata/pull/4092


### Why is this PR needed?


### What changes were proposed in this PR?
   
   
### Does this PR introduce any user interface change?
- No
- Yes. (please explain the change and update document)
   
### Is any new testcase added?
- No
- Yes
   
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4089: [CARBONDATA-4117][[CARBONDATA-4123] cg index and bloom index query issue with Index server

2021-02-09 Thread GitBox


CarbonDataQA2 commented on pull request #4089:
URL: https://github.com/apache/carbondata/pull/4089#issuecomment-775826770


   Build Success with Spark 2.4.5, Please check CI 
http://121.244.95.60:12444/job/ApacheCarbon_PR_Builder_2.4.5/3682/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4089: [CARBONDATA-4117][[CARBONDATA-4123] cg index and bloom index query issue with Index server

2021-02-09 Thread GitBox


CarbonDataQA2 commented on pull request #4089:
URL: https://github.com/apache/carbondata/pull/4089#issuecomment-775826315


   Build Success with Spark 2.3.4, Please check CI 
http://121.244.95.60:12444/job/ApacheCarbonPRBuilder2.3/5443/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org