[jira] [Resolved] (GOBBLIN-1221) Preserve ModTime by configuration in distcpNg

2020-07-30 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1221.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #3069
[https://github.com/apache/incubator-gobblin/pull/3069]

> Preserve ModTime by configuration in distcpNg
> -
>
> Key: GOBBLIN-1221
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1221
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1221) Preserve ModTime by configuration in distcpNg

2020-07-23 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1221:


 Summary: Preserve ModTime by configuration in distcpNg
 Key: GOBBLIN-1221
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1221
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1216) Embedded Hive Distcp

2020-07-16 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1216:


 Summary: Embedded Hive Distcp
 Key: GOBBLIN-1216
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1216
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (GOBBLIN-1214) Move fallback of un-eligible shuffleKey into driver level

2020-07-16 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1214.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #3062
[https://github.com/apache/incubator-gobblin/pull/3062]

> Move fallback of un-eligible shuffleKey into driver level
> -
>
> Key: GOBBLIN-1214
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1214
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 1h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (GOBBLIN-1212) Handle shuffle-key eligibility check properly

2020-07-15 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1212.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #3060
[https://github.com/apache/incubator-gobblin/pull/3060]

> Handle shuffle-key eligibility check properly 
> --
>
> Key: GOBBLIN-1212
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1212
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1214) Move fallback of un-eligible shuffleKey into driver level

2020-07-15 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1214:


 Summary: Move fallback of un-eligible shuffleKey into driver level
 Key: GOBBLIN-1214
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1214
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1212) Handle shuffle-key eligibility check properly

2020-07-15 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1212:


 Summary: Handle shuffle-key eligibility check properly 
 Key: GOBBLIN-1212
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1212
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (GOBBLIN-1203) Adding configuration for user-specified static staging directory

2020-07-01 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1203.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #3050
[https://github.com/apache/incubator-gobblin/pull/3050]

> Adding configuration for user-specified static staging directory
> 
>
> Key: GOBBLIN-1203
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1203
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (GOBBLIN-1206) Populate storageParam only if source table has it in copy-job

2020-06-25 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1206.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #3051
[https://github.com/apache/incubator-gobblin/pull/3051]

> Populate storageParam only if source table has it in copy-job
> -
>
> Key: GOBBLIN-1206
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1206
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1206) Populate storageParam only if source table has it in copy-job

2020-06-25 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1206:


 Summary: Populate storageParam only if source table has it in 
copy-job
 Key: GOBBLIN-1206
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1206
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1203) Adding configuration for user-specified static staging directory

2020-06-19 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1203:


 Summary: Adding configuration for user-specified static staging 
directory
 Key: GOBBLIN-1203
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1203
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (GOBBLIN-1201) Populate dataset Urn in GTE for MRCompactionTask

2020-06-18 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1201.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #3048
[https://github.com/apache/incubator-gobblin/pull/3048]

> Populate dataset Urn in GTE for MRCompactionTask
> 
>
> Key: GOBBLIN-1201
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1201
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1201) Populate dataset Urn in GTE for MRCompactionTask

2020-06-17 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1201:


 Summary: Populate dataset Urn in GTE for MRCompactionTask
 Key: GOBBLIN-1201
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1201
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (GOBBLIN-1197) Fix race contention among different tests for port allocation

2020-06-17 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1197.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #3043
[https://github.com/apache/incubator-gobblin/pull/3043]

> Fix race contention among different tests for port allocation
> -
>
> Key: GOBBLIN-1197
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1197
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1197) Fix race contention among different tests for port allocation

2020-06-16 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1197:


 Summary: Fix race contention among different tests for port 
allocation
 Key: GOBBLIN-1197
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1197
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1192) Container commit suicide if Helix task creation failed after retry

2020-06-11 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1192:


 Summary: Container commit suicide if Helix task creation failed 
after retry
 Key: GOBBLIN-1192
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1192
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1190) Fallback to full schema as shuffle key is configured one is not available in ORC compaction

2020-06-11 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1190:


 Summary: Fallback to full schema as shuffle key is configured one 
is not available in ORC compaction
 Key: GOBBLIN-1190
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1190
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (GOBBLIN-1178) Propagate task creation failure to Helix

2020-06-04 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1178.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #3024
[https://github.com/apache/incubator-gobblin/pull/3024]

> Propagate task creation failure to Helix 
> -
>
> Key: GOBBLIN-1178
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1178
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1178) Propagate task creation failure to Helix

2020-06-02 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1178:


 Summary: Propagate task creation failure to Helix 
 Key: GOBBLIN-1178
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1178
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (GOBBLIN-1078) Coordination between task cancel and task initialization in Helix

2020-06-02 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1078.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #2919
[https://github.com/apache/incubator-gobblin/pull/2919]

> Coordination between task cancel and task initialization in Helix
> -
>
> Key: GOBBLIN-1078
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1078
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 3h 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (GOBBLIN-1170) Add missing booleanWraible in ORC upconversion

2020-06-01 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1170.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #3013
[https://github.com/apache/incubator-gobblin/pull/3013]

> Add missing booleanWraible in ORC upconversion
> --
>
> Key: GOBBLIN-1170
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1170
> Project: Apache Gobblin
>  Issue Type: Bug
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1170) Add missing booleanWraible in ORC upconversion

2020-05-29 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1170:


 Summary: Add missing booleanWraible in ORC upconversion
 Key: GOBBLIN-1170
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1170
 Project: Apache Gobblin
  Issue Type: Bug
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (GOBBLIN-1126) Supporting Column Projection in OrcStruct in compaction for making shuffle key slimmer

2020-05-12 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1126.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #2966
[https://github.com/apache/incubator-gobblin/pull/2966]

> Supporting Column Projection in OrcStruct in compaction for making shuffle 
> key slimmer
> --
>
> Key: GOBBLIN-1126
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1126
> Project: Apache Gobblin
>  Issue Type: Bug
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 2h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1131) Bump up ORC version to pick up ORC-616

2020-04-27 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1131:


 Summary: Bump up ORC version to pick up ORC-616
 Key: GOBBLIN-1131
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1131
 Project: Apache Gobblin
  Issue Type: Bug
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1126) Supporting Column Projection in OrcStruct in compaction for making shuffle key slimmer

2020-04-23 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1126:


 Summary: Supporting Column Projection in OrcStruct in compaction 
for making shuffle key slimmer
 Key: GOBBLIN-1126
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1126
 Project: Apache Gobblin
  Issue Type: Bug
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (GOBBLIN-1117) Fix hard-code avro suffix in record-count verification process for re-compaction

2020-04-16 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1117.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #2957
[https://github.com/apache/incubator-gobblin/pull/2957]

> Fix hard-code avro suffix in record-count verification process for 
> re-compaction
> 
>
> Key: GOBBLIN-1117
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1117
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 1h 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (GOBBLIN-1119) Flush quality-checker-err-file in streaming pipeline

2020-04-16 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1119.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #2959
[https://github.com/apache/incubator-gobblin/pull/2959]

> Flush quality-checker-err-file in streaming pipeline
> 
>
> Key: GOBBLIN-1119
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1119
> Project: Apache Gobblin
>  Issue Type: Bug
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1119) Flush quality-checker-err-file in streaming pipeline

2020-04-16 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1119:


 Summary: Flush quality-checker-err-file in streaming pipeline
 Key: GOBBLIN-1119
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1119
 Project: Apache Gobblin
  Issue Type: Bug
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (GOBBLIN-1118) Upgrade ORC version to 1.6.2 for picking up fix in ORC-569

2020-04-15 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1118.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #2958
[https://github.com/apache/incubator-gobblin/pull/2958]

> Upgrade ORC version to 1.6.2 for picking up fix in ORC-569
> --
>
> Key: GOBBLIN-1118
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1118
> Project: Apache Gobblin
>  Issue Type: Bug
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1118) Upgrade ORC version to 1.6.2 for picking up fix in ORC-569

2020-04-14 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1118:


 Summary: Upgrade ORC version to 1.6.2 for picking up fix in ORC-569
 Key: GOBBLIN-1118
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1118
 Project: Apache Gobblin
  Issue Type: Bug
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1117) Fix hard-code avro suffix in record-count verification process for re-compaction

2020-04-14 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1117:


 Summary: Fix hard-code avro suffix in record-count verification 
process for re-compaction
 Key: GOBBLIN-1117
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1117
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (GOBBLIN-1114) ORC-mapred schema evolution enhancement

2020-04-12 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1114.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #2954
[https://github.com/apache/incubator-gobblin/pull/2954]

> ORC-mapred schema evolution enhancement
> ---
>
> Key: GOBBLIN-1114
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1114
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 3h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1114) ORC-mapred schema evolution enhancement

2020-04-10 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1114:


 Summary: ORC-mapred schema evolution enhancement
 Key: GOBBLIN-1114
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1114
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (GOBBLIN-1104) Change access modifiers for generateTagsForPartitions

2020-03-31 Thread Lei Sun (Jira)


[ 
https://issues.apache.org/jira/browse/GOBBLIN-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072015#comment-17072015
 ] 

Lei Sun commented on GOBBLIN-1104:
--

This is to accommodate with changes in Gobblin-1100.

> Change access modifiers for generateTagsForPartitions
> -
>
> Key: GOBBLIN-1104
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1104
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1104) Change access modifiers for generateTagsForPartitions

2020-03-31 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1104:


 Summary: Change access modifiers for generateTagsForPartitions
 Key: GOBBLIN-1104
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1104
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (GOBBLIN-1089) Refactor RowLevelPolicyChecker for extensibility

2020-03-19 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1089.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #2930
[https://github.com/apache/incubator-gobblin/pull/2930]

> Refactor RowLevelPolicyChecker for extensibility
> 
>
> Key: GOBBLIN-1089
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1089
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1089) Refactor RowLevelPolicyChecker for extensibility

2020-03-17 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1089:


 Summary: Refactor RowLevelPolicyChecker for extensibility
 Key: GOBBLIN-1089
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1089
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1083) Maximize helix retry by returning failure when cancel

2020-03-11 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1083:


 Summary: Maximize helix retry by returning failure when cancel
 Key: GOBBLIN-1083
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1083
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1078) Coordination between task cancel and task initialization in Helix

2020-03-10 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1078:


 Summary: Coordination between task cancel and task initialization 
in Helix
 Key: GOBBLIN-1078
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1078
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (GOBBLIN-1072) Being more conservative on releasing YARN containers

2020-03-09 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1072.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #2912
[https://github.com/apache/incubator-gobblin/pull/2912]

> Being more conservative on releasing YARN containers
> 
>
> Key: GOBBLIN-1072
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1072
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 2h 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (GOBBLIN-1071) Retry Task Initialization

2020-03-08 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1071.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #2909
[https://github.com/apache/incubator-gobblin/pull/2909]

> Retry Task Initialization
> -
>
> Key: GOBBLIN-1071
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1071
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 2h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1072) Being more conservative on releasing YARN containers

2020-03-05 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1072:


 Summary: Being more conservative on releasing YARN containers
 Key: GOBBLIN-1072
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1072
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1071) Retry Task Initialization

2020-03-04 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1071:


 Summary: Retry Task Initialization
 Key: GOBBLIN-1071
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1071
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1068) Clean cyclic logic in task cancellation in Gobblin Task

2020-03-03 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1068:


 Summary: Clean cyclic logic in task cancellation in Gobblin Task
 Key: GOBBLIN-1068
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1068
 Project: Apache Gobblin
  Issue Type: Bug
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (GOBBLIN-1054) Refactor HiveSource to make partition filter extensible

2020-02-27 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-1054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-1054.
--
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #2894
[https://github.com/apache/incubator-gobblin/pull/2894]

> Refactor HiveSource to make partition filter extensible
> ---
>
> Key: GOBBLIN-1054
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1054
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 2h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1065) Fix Merge Script failure for SSL in MacOS

2020-02-27 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1065:


 Summary: Fix Merge Script failure for SSL in MacOS
 Key: GOBBLIN-1065
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1065
 Project: Apache Gobblin
  Issue Type: Bug
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1060) Fix YarnAppLauncher resource existence checking with wrong fs object

2020-02-25 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1060:


 Summary: Fix YarnAppLauncher resource existence checking with 
wrong fs object
 Key: GOBBLIN-1060
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1060
 Project: Apache Gobblin
  Issue Type: Bug
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1058) Make emitTrackingEvents method accept additional PartitionsToTags map for ease of extension on metrics

2020-02-24 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1058:


 Summary: Make emitTrackingEvents method accept additional 
PartitionsToTags map for ease of extension on metrics
 Key: GOBBLIN-1058
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1058
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1054) Refactor HiveSource to make partition filter extensible

2020-02-17 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1054:


 Summary: Refactor HiveSource to make partition filter extensible
 Key: GOBBLIN-1054
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1054
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Closed] (GOBBLIN-250) Template assignment in Flow Compiler

2020-02-10 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun closed GOBBLIN-250.
---
Resolution: Won't Fix

> Template assignment in Flow Compiler
> 
>
> Key: GOBBLIN-250
> URL: https://issues.apache.org/jira/browse/GOBBLIN-250
> Project: Apache Gobblin
>  Issue Type: Task
>Reporter: Lei Sun
>Assignee: Lei Sun
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1046) Make ORC-Conversion output subdirectory configurable

2020-02-10 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1046:


 Summary: Make ORC-Conversion output subdirectory configurable
 Key: GOBBLIN-1046
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1046
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1044) Enrich fork-failure information when task failed

2020-02-06 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1044:


 Summary:  Enrich fork-failure information when task failed
 Key: GOBBLIN-1044
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1044
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1042) ForkMetrics generates parent metric object with incorrect type

2020-02-06 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1042:


 Summary: ForkMetrics generates parent metric object with incorrect 
type
 Key: GOBBLIN-1042
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1042
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1031) Making Gobblin-Streaming runnable with Azkaban configuration locally

2020-01-17 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1031:


 Summary: Making Gobblin-Streaming runnable with Azkaban 
configuration locally
 Key: GOBBLIN-1031
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1031
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1024) Support logical types in Avro-to-ORC

2020-01-14 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1024:


 Summary: Support logical types in Avro-to-ORC
 Key: GOBBLIN-1024
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1024
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-1006) Configurable case-preserving in ORC-conversion

2019-12-17 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1006:


 Summary: Configurable case-preserving in ORC-conversion
 Key: GOBBLIN-1006
 URL: https://issues.apache.org/jira/browse/GOBBLIN-1006
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-999) Refactor Hive-Avro related constants to make it reusable

2019-12-06 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-999:
---

 Summary: Refactor Hive-Avro related constants to make it reusable
 Key: GOBBLIN-999
 URL: https://issues.apache.org/jira/browse/GOBBLIN-999
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-992) Make timeout of ParallelRunner configurable

2019-12-03 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-992:
---

 Summary: Make timeout of ParallelRunner configurable
 Key: GOBBLIN-992
 URL: https://issues.apache.org/jira/browse/GOBBLIN-992
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-971) Enable speculative execution awareness for RowQualityChecker

2019-11-19 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-971:
---

 Summary: Enable speculative execution awareness for 
RowQualityChecker
 Key: GOBBLIN-971
 URL: https://issues.apache.org/jira/browse/GOBBLIN-971
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-960) Enable multiple top-level job templates resolution

2019-11-12 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-960:
---

 Summary: Enable multiple top-level job templates resolution 
 Key: GOBBLIN-960
 URL: https://issues.apache.org/jira/browse/GOBBLIN-960
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-940) Synchronization between workunit persistency and Helix job launching

2019-10-31 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-940:
---

 Summary: Synchronization between workunit persistency and Helix 
job launching
 Key: GOBBLIN-940
 URL: https://issues.apache.org/jira/browse/GOBBLIN-940
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (GOBBLIN-931) Fixing Gobblin Documentation typos

2019-10-31 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun updated GOBBLIN-931:

Issue Type: Task  (was: Improvement)

> Fixing Gobblin Documentation typos
> --
>
> Key: GOBBLIN-931
> URL: https://issues.apache.org/jira/browse/GOBBLIN-931
> Project: Apache Gobblin
>  Issue Type: Task
>Reporter: Lei Sun
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (GOBBLIN-931) Fixing Gobblin Documentation typos

2019-10-31 Thread Lei Sun (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun updated GOBBLIN-931:

Summary: Fixing Gobblin Documentation typos  (was: Update 
Hive-Avro-To-ORC-Converter.md for typos)

> Fixing Gobblin Documentation typos
> --
>
> Key: GOBBLIN-931
> URL: https://issues.apache.org/jira/browse/GOBBLIN-931
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-938) Extend template-resolution in all JobLauncher

2019-10-30 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-938:
---

 Summary: Extend template-resolution in all JobLauncher
 Key: GOBBLIN-938
 URL: https://issues.apache.org/jira/browse/GOBBLIN-938
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-931) Update Hive-Avro-To-ORC-Converter.md for typos

2019-10-29 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-931:
---

 Summary: Update Hive-Avro-To-ORC-Converter.md for typos
 Key: GOBBLIN-931
 URL: https://issues.apache.org/jira/browse/GOBBLIN-931
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-928) Bump up ORC to 1.6.0 to get more compression algorithms

2019-10-25 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-928:
---

 Summary:  Bump up ORC to 1.6.0 to get more compression algorithms
 Key: GOBBLIN-928
 URL: https://issues.apache.org/jira/browse/GOBBLIN-928
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-911) Add Gobblin-Conf in HiveWriter for Profiling convenience

2019-10-15 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-911:
---

 Summary: Add Gobblin-Conf in HiveWriter for Profiling convenience
 Key: GOBBLIN-911
 URL: https://issues.apache.org/jira/browse/GOBBLIN-911
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-908) Customize progress report to enable accurate speculative execution

2019-10-14 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-908:
---

 Summary: Customize progress report to enable accurate speculative 
execution
 Key: GOBBLIN-908
 URL: https://issues.apache.org/jira/browse/GOBBLIN-908
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-893) Make ORC-format checking optional in ORC-registration

2019-10-02 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-893:
---

 Summary: Make ORC-format checking optional in ORC-registration
 Key: GOBBLIN-893
 URL: https://issues.apache.org/jira/browse/GOBBLIN-893
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-890) Make ExtractID timezone configurable

2019-09-30 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-890:
---

 Summary: Make ExtractID timezone configurable
 Key: GOBBLIN-890
 URL: https://issues.apache.org/jira/browse/GOBBLIN-890
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-887) Generalize UniversalKafkaSource to accept Extractor that not extending KafkaExtractor

2019-09-25 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-887:
---

 Summary: Generalize UniversalKafkaSource  to accept Extractor that 
not extending KafkaExtractor
 Key: GOBBLIN-887
 URL: https://issues.apache.org/jira/browse/GOBBLIN-887
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-885) Fix ORC-Compaction bug in type-casting

2019-09-22 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-885:
---

 Summary: Fix ORC-Compaction bug in type-casting
 Key: GOBBLIN-885
 URL: https://issues.apache.org/jira/browse/GOBBLIN-885
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-884) Support schema evolution for ORC across multiple mappers in MR mode

2019-09-18 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-884:
---

 Summary: Support schema evolution for ORC across multiple mappers 
in MR mode
 Key: GOBBLIN-884
 URL: https://issues.apache.org/jira/browse/GOBBLIN-884
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-879) Refactor on BinPacker for better code reuse

2019-09-09 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-879:
---

 Summary: Refactor on BinPacker for better code reuse
 Key: GOBBLIN-879
 URL: https://issues.apache.org/jira/browse/GOBBLIN-879
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Created] (GOBBLIN-874) Make KafkaWUPacker and SizeEstimator pluggable

2019-09-09 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-874:
---

 Summary: Make KafkaWUPacker and SizeEstimator pluggable 
 Key: GOBBLIN-874
 URL: https://issues.apache.org/jira/browse/GOBBLIN-874
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Created] (GOBBLIN-857) Extending getTopicsFromConfigStore to accept topicName directly

2019-08-14 Thread Lei Sun (JIRA)
Lei Sun created GOBBLIN-857:
---

 Summary: Extending getTopicsFromConfigStore to accept topicName 
directly
 Key: GOBBLIN-857
 URL: https://issues.apache.org/jira/browse/GOBBLIN-857
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Resolved] (GOBBLIN-848) Make initialization of CompactionSource extensible

2019-08-09 Thread Lei Sun (JIRA)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-848.
-
Resolution: Fixed

> Make initialization of CompactionSource extensible 
> ---
>
> Key: GOBBLIN-848
> URL: https://issues.apache.org/jira/browse/GOBBLIN-848
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
>  Time Spent: 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Resolved] (GOBBLIN-786) GaaS SerDe Libaray

2019-08-09 Thread Lei Sun (JIRA)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-786.
-
Resolution: Fixed

> GaaS SerDe Libaray
> --
>
> Key: GOBBLIN-786
> URL: https://issues.apache.org/jira/browse/GOBBLIN-786
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
>  Time Spent: 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Resolved] (GOBBLIN-833) Make SFTP connection subject to timeout

2019-08-09 Thread Lei Sun (JIRA)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-833.
-
Resolution: Fixed

> Make SFTP connection subject to timeout
> ---
>
> Key: GOBBLIN-833
> URL: https://issues.apache.org/jira/browse/GOBBLIN-833
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Resolved] (GOBBLIN-838) Improve ConfigStoreUtils' unit test and fix implementation-specific methods

2019-08-09 Thread Lei Sun (JIRA)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-838.
-
Resolution: Fixed

> Improve ConfigStoreUtils' unit test and fix implementation-specific methods
> ---
>
> Key: GOBBLIN-838
> URL: https://issues.apache.org/jira/browse/GOBBLIN-838
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
>  Time Spent: 3h 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Resolved] (GOBBLIN-731) Make deserialization of FlowSpec more robust

2019-08-09 Thread Lei Sun (JIRA)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-731.
-
Resolution: Fixed

> Make deserialization of FlowSpec more robust
> 
>
> Key: GOBBLIN-731
> URL: https://issues.apache.org/jira/browse/GOBBLIN-731
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
>  Time Spent: 1h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Created] (GOBBLIN-848) Make initialization of CompactionSource extensible

2019-08-09 Thread Lei Sun (JIRA)
Lei Sun created GOBBLIN-848:
---

 Summary: Make initialization of CompactionSource extensible 
 Key: GOBBLIN-848
 URL: https://issues.apache.org/jira/browse/GOBBLIN-848
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Created] (GOBBLIN-838) Improve ConfigStoreUtils' unit test and fix implementation-specific methods

2019-07-31 Thread Lei Sun (JIRA)
Lei Sun created GOBBLIN-838:
---

 Summary: Improve ConfigStoreUtils' unit test and fix 
implementation-specific methods
 Key: GOBBLIN-838
 URL: https://issues.apache.org/jira/browse/GOBBLIN-838
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Created] (GOBBLIN-833) Make SFTP connection subject to timeout

2019-07-25 Thread Lei Sun (JIRA)
Lei Sun created GOBBLIN-833:
---

 Summary: Make SFTP connection subject to timeout
 Key: GOBBLIN-833
 URL: https://issues.apache.org/jira/browse/GOBBLIN-833
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Created] (GOBBLIN-829) Fix codecov

2019-07-15 Thread Lei Sun (JIRA)
Lei Sun created GOBBLIN-829:
---

 Summary: Fix codecov
 Key: GOBBLIN-829
 URL: https://issues.apache.org/jira/browse/GOBBLIN-829
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Created] (GOBBLIN-826) Refactor topic-specific WU configuration in kafka source

2019-07-15 Thread Lei Sun (JIRA)
Lei Sun created GOBBLIN-826:
---

 Summary: Refactor topic-specific WU configuration in kafka source
 Key: GOBBLIN-826
 URL: https://issues.apache.org/jira/browse/GOBBLIN-826
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Created] (GOBBLIN-821) Create Code Coverage Report for Gobblin

2019-07-09 Thread Lei Sun (JIRA)
Lei Sun created GOBBLIN-821:
---

 Summary: Create Code Coverage Report for Gobblin
 Key: GOBBLIN-821
 URL: https://issues.apache.org/jira/browse/GOBBLIN-821
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (GOBBLIN-803) Adding record count metadata into Hive Partition

2019-06-11 Thread Lei Sun (JIRA)
Lei Sun created GOBBLIN-803:
---

 Summary: Adding record count metadata into Hive Partition
 Key: GOBBLIN-803
 URL: https://issues.apache.org/jira/browse/GOBBLIN-803
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (GOBBLIN-754) Craftsmanship cleaning on redundancy of different versions of FlowCompiler

2019-06-11 Thread Lei Sun (JIRA)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-754.
-
Resolution: Fixed

> Craftsmanship cleaning on redundancy of different versions of FlowCompiler 
> ---
>
> Key: GOBBLIN-754
> URL: https://issues.apache.org/jira/browse/GOBBLIN-754
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> There are a lot of redundant interfaces/implementation of FlowCompiler 
> existed in codebase. Should do a cleaning to avoid confusion. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (GOBBLIN-801) Reimplement FsDagStateStore to use MysqlStateStore

2019-06-10 Thread Lei Sun (JIRA)
Lei Sun created GOBBLIN-801:
---

 Summary: Reimplement FsDagStateStore to use MysqlStateStore
 Key: GOBBLIN-801
 URL: https://issues.apache.org/jira/browse/GOBBLIN-801
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (GOBBLIN-797) Refactor ConfigStoreUtils to make it not implementation specific

2019-06-06 Thread Lei Sun (JIRA)
Lei Sun created GOBBLIN-797:
---

 Summary: Refactor ConfigStoreUtils to make it not implementation 
specific
 Key: GOBBLIN-797
 URL: https://issues.apache.org/jira/browse/GOBBLIN-797
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (GOBBLIN-790) Mysql Implementation of DagStateStore

2019-05-30 Thread Lei Sun (JIRA)
Lei Sun created GOBBLIN-790:
---

 Summary: Mysql Implementation of DagStateStore
 Key: GOBBLIN-790
 URL: https://issues.apache.org/jira/browse/GOBBLIN-790
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (GOBBLIN-786) GaaS SerDe Libaray

2019-05-28 Thread Lei Sun (JIRA)
Lei Sun created GOBBLIN-786:
---

 Summary: GaaS SerDe Libaray
 Key: GOBBLIN-786
 URL: https://issues.apache.org/jira/browse/GOBBLIN-786
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (GOBBLIN-781) Clean Flow execution state when DR is enabled: Skeleton

2019-05-24 Thread Lei Sun (JIRA)
Lei Sun created GOBBLIN-781:
---

 Summary: Clean Flow execution state when DR is enabled: Skeleton
 Key: GOBBLIN-781
 URL: https://issues.apache.org/jira/browse/GOBBLIN-781
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (GOBBLIN-761) Fix runtime property like Topic.name not available in Compaction when fetching configStore object

2019-05-01 Thread Lei Sun (JIRA)
Lei Sun created GOBBLIN-761:
---

 Summary: Fix runtime property like Topic.name not available in 
Compaction when fetching configStore object
 Key: GOBBLIN-761
 URL: https://issues.apache.org/jira/browse/GOBBLIN-761
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (GOBBLIN-753) Refactor HiveRegistrationPolicyBase to make ConfigStore object available in extending class

2019-04-24 Thread Lei Sun (JIRA)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-753.
-
Resolution: Fixed

> Refactor HiveRegistrationPolicyBase to make ConfigStore object available in 
> extending class
> ---
>
> Key: GOBBLIN-753
> URL: https://issues.apache.org/jira/browse/GOBBLIN-753
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (GOBBLIN-748) Craftsmanship code cleaning in GaaS

2019-04-24 Thread Lei Sun (JIRA)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-748.
-
Resolution: Fixed

> Craftsmanship code cleaning in GaaS 
> 
>
> Key: GOBBLIN-748
> URL: https://issues.apache.org/jira/browse/GOBBLIN-748
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
>  Time Spent: 2h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (GOBBLIN-746) Loading FlowSpecs asynchronously while initializing GobblinServiceManager

2019-04-24 Thread Lei Sun (JIRA)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Sun resolved GOBBLIN-746.
-
Resolution: Fixed

> Loading FlowSpecs asynchronously while initializing GobblinServiceManager
> -
>
> Key: GOBBLIN-746
> URL: https://issues.apache.org/jira/browse/GOBBLIN-746
> Project: Apache Gobblin
>  Issue Type: Improvement
>Reporter: Lei Sun
>Priority: Major
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (GOBBLIN-754) Craftsmanship cleaning on redundancy of different versions of FlowCompiler

2019-04-24 Thread Lei Sun (JIRA)
Lei Sun created GOBBLIN-754:
---

 Summary: Craftsmanship cleaning on redundancy of different 
versions of FlowCompiler 
 Key: GOBBLIN-754
 URL: https://issues.apache.org/jira/browse/GOBBLIN-754
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun


There are a lot of redundant interfaces/implementation of FlowCompiler existed 
in codebase. Should do a cleaning to avoid confusion. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (GOBBLIN-753) Refactor HiveRegistrationPolicyBase to make ConfigStore object available in extending class

2019-04-23 Thread Lei Sun (JIRA)
Lei Sun created GOBBLIN-753:
---

 Summary: Refactor HiveRegistrationPolicyBase to make ConfigStore 
object available in extending class
 Key: GOBBLIN-753
 URL: https://issues.apache.org/jira/browse/GOBBLIN-753
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Lei Sun






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


  1   2   >