[jira] [Created] (GOBBLIN-1205) restarting gobblin on yarn fails with error

2020-06-20 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-1205: Summary: restarting gobblin on yarn fails with error Key: GOBBLIN-1205 URL: https://issues.apache.org/jira/browse/GOBBLIN-1205 Project: Apache Gobblin Issue Type: Bu

[jira] [Created] (GOBBLIN-1204) stopping yarn does not stop application master or containers

2020-06-20 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-1204: Summary: stopping yarn does not stop application master or containers Key: GOBBLIN-1204 URL: https://issues.apache.org/jira/browse/GOBBLIN-1204 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-1194) add Google cloud connector

2020-06-13 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-1194: Summary: add Google cloud connector Key: GOBBLIN-1194 URL: https://issues.apache.org/jira/browse/GOBBLIN-1194 Project: Apache Gobblin Issue Type: New Feature Aff

[jira] [Created] (GOBBLIN-1182) Incorrect datetime value error on mysql 5.7

2020-06-04 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-1182: Summary: Incorrect datetime value error on mysql 5.7 Key: GOBBLIN-1182 URL: https://issues.apache.org/jira/browse/GOBBLIN-1182 Project: Apache Gobblin Issue Type: Im

[jira] [Created] (GOBBLIN-1161) Hadoop 3.x support

2020-05-26 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-1161: Summary: Hadoop 3.x support Key: GOBBLIN-1161 URL: https://issues.apache.org/jira/browse/GOBBLIN-1161 Project: Apache Gobblin Issue Type: New Feature Rep

[jira] [Updated] (GOBBLIN-1139) Basic Aerospike key value writer with Avro schema

2020-05-01 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-1139: - Summary: Basic Aerospike key value writer with Avro schema (was: Basic Aerospike writer with Avro sche

[jira] [Created] (GOBBLIN-1138) AeroSpike Writer

2020-05-01 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-1138: Summary: AeroSpike Writer Key: GOBBLIN-1138 URL: https://issues.apache.org/jira/browse/GOBBLIN-1138 Project: Apache Gobblin Issue Type: New Feature Compone

[jira] [Created] (GOBBLIN-1139) Basic Aerospike writer with Avro schema

2020-05-01 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-1139: Summary: Basic Aerospike writer with Avro schema Key: GOBBLIN-1139 URL: https://issues.apache.org/jira/browse/GOBBLIN-1139 Project: Apache Gobblin Issue Type: Sub-ta

[jira] [Created] (GOBBLIN-1128) Gobblin JobStore on MySQL with CRUD API

2020-04-25 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-1128: Summary: Gobblin JobStore on MySQL with CRUD API Key: GOBBLIN-1128 URL: https://issues.apache.org/jira/browse/GOBBLIN-1128 Project: Apache Gobblin Issue Type: Improv

[jira] [Updated] (GOBBLIN-1128) Gobblin JobStore on MySQL with CRUD API

2020-04-25 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-1128: - Description: [details: https://cwiki.apache.org/confluence/display/GOBBLIN/GIP+4%3A+MySQL+backed+job+c

[jira] [Closed] (GOBBLIN-1095) jcenter only supports https now

2020-03-23 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen closed GOBBLIN-1095. Resolution: Duplicate > jcenter only supports https now > --- > >

[jira] [Created] (GOBBLIN-1095) jcenter only supports https now

2020-03-23 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-1095: Summary: jcenter only supports https now Key: GOBBLIN-1095 URL: https://issues.apache.org/jira/browse/GOBBLIN-1095 Project: Apache Gobblin Issue Type: Improvement

[jira] [Commented] (GOBBLIN-984) Get Gobblin log outputting to work

2019-11-27 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983968#comment-16983968 ] Jay Sen commented on GOBBLIN-984: - Pls feel free to revert. > Get Gobblin log outputti

[jira] [Commented] (GOBBLIN-984) Get Gobblin log outputting to work

2019-11-27 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983967#comment-16983967 ] Jay Sen commented on GOBBLIN-984: - Sure. Didnt know you guys r using master branch. I w

[jira] [Commented] (GOBBLIN-984) Get Gobblin log outputting to work

2019-11-27 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983963#comment-16983963 ] Jay Sen commented on GOBBLIN-984: - Can we meet later today anytime after 4pm? I will sen

[jira] [Commented] (GOBBLIN-984) Get Gobblin log outputting to work

2019-11-27 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983958#comment-16983958 ] Jay Sen commented on GOBBLIN-984: - We can work that out with slf4j integration Lets try

[jira] [Created] (GOBBLIN-985) upgrade Guava libs

2019-11-26 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-985: --- Summary: upgrade Guava libs Key: GOBBLIN-985 URL: https://issues.apache.org/jira/browse/GOBBLIN-985 Project: Apache Gobblin Issue Type: Sub-task Affects Versions:

[jira] [Commented] (GOBBLIN-984) Get Gobblin log outputting to work

2019-11-26 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982927#comment-16982927 ] Jay Sen commented on GOBBLIN-984: - created this PR: [https://github.com/apache/incubator

[jira] [Commented] (GOBBLIN-984) Get Gobblin log outputting to work

2019-11-26 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982766#comment-16982766 ] Jay Sen commented on GOBBLIN-984: - Sure, I will create PR in sometime, Thanks > Get Gob

[jira] [Comment Edited] (GOBBLIN-984) Get Gobblin log outputting to work

2019-11-26 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982753#comment-16982753 ] Jay Sen edited comment on GOBBLIN-984 at 11/26/19 6:31 PM: --- Hi

[jira] [Commented] (GOBBLIN-984) Get Gobblin log outputting to work

2019-11-26 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982753#comment-16982753 ] Jay Sen commented on GOBBLIN-984: - Hi [~wlo], I have this ready, i can create PR, pls le

[jira] [Comment Edited] (GOBBLIN-984) Get Gobblin log outputting to work

2019-11-26 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982753#comment-16982753 ] Jay Sen edited comment on GOBBLIN-984 at 11/26/19 6:30 PM: --- Hi

[jira] [Issue Comment Deleted] (GOBBLIN-824) upgrade component and dependency library versions

2019-11-25 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-824: Comment: was deleted (was: GOBBLIN-818 does minor upgrades.) > upgrade component and dependency library v

[jira] [Updated] (GOBBLIN-824) upgrade component and dependency library versions

2019-11-25 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-824: Summary: upgrade component and dependency library versions (was: upgrade to latest libraries in Gobblin)

[jira] [Updated] (GOBBLIN-741) update influxdb-java dependency to latest (> 2.15)

2019-11-25 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-741: Parent: GOBBLIN-824 Issue Type: Sub-task (was: Improvement) > update influxdb-java dependency to

[jira] [Updated] (GOBBLIN-823) upgrade or remove lombok usage

2019-11-25 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-823: Parent: GOBBLIN-824 Issue Type: Sub-task (was: Improvement) > upgrade or remove lombok usage > --

[jira] [Updated] (GOBBLIN-979) upgrade Hive version

2019-11-25 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-979: Parent: GOBBLIN-824 Issue Type: Sub-task (was: Bug) > upgrade Hive version >

[jira] [Updated] (GOBBLIN-818) upgrade default hadoop versions to 2.7.x

2019-11-25 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-818: Parent: GOBBLIN-824 Issue Type: Sub-task (was: Improvement) > upgrade default hadoop versions to

[jira] [Updated] (GOBBLIN-979) upgrade Hive version

2019-11-25 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-979: Parent: (was: GOBBLIN-818) Issue Type: Bug (was: Sub-task) > upgrade Hive version > -

[jira] [Updated] (GOBBLIN-979) upgrade Hive version

2019-11-25 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-979: Parent: GOBBLIN-818 Issue Type: Sub-task (was: Bug) > upgrade Hive version >

[jira] [Created] (GOBBLIN-979) upgrade Hive version

2019-11-25 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-979: --- Summary: upgrade Hive version Key: GOBBLIN-979 URL: https://issues.apache.org/jira/browse/GOBBLIN-979 Project: Apache Gobblin Issue Type: Bug Reporter: Jay

[jira] [Updated] (GOBBLIN-979) upgrade Hive version

2019-11-25 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-979: Component/s: hive-registration Fix Version/s: 0.15.0 Affects Version/s: 0.14.0 > upgrade

[jira] [Updated] (GOBBLIN-818) upgrade default hadoop versions to 2.7.x

2019-11-25 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-818: Description: Gobblin should also upgrade Hadoop from 2.3 to 2.7.x at least, which is very stable. (was: G

[jira] [Updated] (GOBBLIN-818) upgrade default hadoop versions to 2.7.x

2019-11-25 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-818: Summary: upgrade default hadoop versions to 2.7.x (was: upgrade default hadoop versions to 2.7.x and hive

[jira] [Created] (GOBBLIN-959) gobblin-http module fails to compile due to missing dependency

2019-11-12 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-959: --- Summary: gobblin-http module fails to compile due to missing dependency Key: GOBBLIN-959 URL: https://issues.apache.org/jira/browse/GOBBLIN-959 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-952) PathAlerationListner needs to picks up only modified job

2019-11-08 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-952: --- Summary: PathAlerationListner needs to picks up only modified job Key: GOBBLIN-952 URL: https://issues.apache.org/jira/browse/GOBBLIN-952 Project: Apache Gobblin Issue

[jira] [Created] (GOBBLIN-949) add dry run in gobblin.sh script

2019-11-06 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-949: --- Summary: add dry run in gobblin.sh script Key: GOBBLIN-949 URL: https://issues.apache.org/jira/browse/GOBBLIN-949 Project: Apache Gobblin Issue Type: Bug Affects V

[jira] [Created] (GOBBLIN-943) remove pid file only when it exists

2019-11-01 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-943: --- Summary: remove pid file only when it exists Key: GOBBLIN-943 URL: https://issues.apache.org/jira/browse/GOBBLIN-943 Project: Apache Gobblin Issue Type: Sub-task

[jira] [Updated] (GOBBLIN-942) use HOCON for job configurations instead of Java Properties

2019-10-31 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-942: Summary: use HOCON for job configurations instead of Java Properties (was: HOCON vs Java Prop for job con

[jira] [Created] (GOBBLIN-942) HOCON vs Java Prop for job configurations

2019-10-31 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-942: --- Summary: HOCON vs Java Prop for job configurations Key: GOBBLIN-942 URL: https://issues.apache.org/jira/browse/GOBBLIN-942 Project: Apache Gobblin Issue Type: Sub-task

[jira] [Updated] (GOBBLIN-939) Integrate usage of env variables in gobblin scripts and configs

2019-10-31 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-939: Description: 1. standardize config with ENV variables  2. define default env variables in gobblin-env.sh

[jira] [Updated] (GOBBLIN-939) Integrate usage of env variables in gobblin scripts and configs

2019-10-31 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-939: Summary: Integrate usage of env variables in gobblin scripts and configs (was: standardize the ability to

[jira] [Created] (GOBBLIN-939) standardize the ability to override gobblin variables via env variable with new gobblin.sh script

2019-10-31 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-939: --- Summary: standardize the ability to override gobblin variables via env variable with new gobblin.sh script Key: GOBBLIN-939 URL: https://issues.apache.org/jira/browse/GOBBLIN-939

[jira] [Created] (GOBBLIN-937) fix help text and align it with variable names

2019-10-30 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-937: --- Summary: fix help text and align it with variable names Key: GOBBLIN-937 URL: https://issues.apache.org/jira/browse/GOBBLIN-937 Project: Apache Gobblin Issue Type: Sub

[jira] [Created] (GOBBLIN-936) check id job disabled first before parsing and scheduling job

2019-10-30 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-936: --- Summary: check id job disabled first before parsing and scheduling job Key: GOBBLIN-936 URL: https://issues.apache.org/jira/browse/GOBBLIN-936 Project: Apache Gobblin

[jira] [Closed] (GOBBLIN-935) reloading job config throws NPE

2019-10-30 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen closed GOBBLIN-935. --- Resolution: Duplicate > reloading job config throws NPE > > >

[jira] [Commented] (GOBBLIN-935) reloading job config throws NPE

2019-10-30 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963199#comment-16963199 ] Jay Sen commented on GOBBLIN-935: - I just saw, once i rebased the repo, that @William Lo

[jira] [Created] (GOBBLIN-935) reloading job config throws NPE

2019-10-30 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-935: --- Summary: reloading job config throws NPE Key: GOBBLIN-935 URL: https://issues.apache.org/jira/browse/GOBBLIN-935 Project: Apache Gobblin Issue Type: Improvement

[jira] [Created] (GOBBLIN-934) scheduling job logic is broken in PathAlterationListenerAdaptorForMonitor

2019-10-29 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-934: --- Summary: scheduling job logic is broken in PathAlterationListenerAdaptorForMonitor Key: GOBBLIN-934 URL: https://issues.apache.org/jira/browse/GOBBLIN-934 Project: Apache Gobbl

[jira] [Created] (GOBBLIN-929) create ZookeeperCommitSequenceStore

2019-10-26 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-929: --- Summary: create ZookeeperCommitSequenceStore Key: GOBBLIN-929 URL: https://issues.apache.org/jira/browse/GOBBLIN-929 Project: Apache Gobblin Issue Type: Improvement

[jira] [Updated] (GOBBLIN-927) config to properties fails to convert configObject to string

2019-10-25 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-927: Description: if you specify source.schema = \{\} then {{ConfigUtils.configToProperties}} would fail to co

[jira] [Created] (GOBBLIN-927) config to properties fails to convert configObject to string

2019-10-25 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-927: --- Summary: config to properties fails to convert configObject to string Key: GOBBLIN-927 URL: https://issues.apache.org/jira/browse/GOBBLIN-927 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-926) use typesafe config consistently everywhere

2019-10-25 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-926: --- Summary: use typesafe config consistently everywhere Key: GOBBLIN-926 URL: https://issues.apache.org/jira/browse/GOBBLIN-926 Project: Apache Gobblin Issue Type: Improv

[jira] [Created] (GOBBLIN-920) simple json example is missing Apache Commons VFS dep.

2019-10-21 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-920: --- Summary: simple json example is missing Apache Commons VFS dep. Key: GOBBLIN-920 URL: https://issues.apache.org/jira/browse/GOBBLIN-920 Project: Apache Gobblin Issue T

[jira] [Created] (GOBBLIN-901) add some info logging to FsDataWriter

2019-10-03 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-901: --- Summary: add some info logging to FsDataWriter Key: GOBBLIN-901 URL: https://issues.apache.org/jira/browse/GOBBLIN-901 Project: Apache Gobblin Issue Type: Bug

[jira] [Closed] (GOBBLIN-900) FsDataWriter dont use writer config for FileSystem

2019-10-03 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen closed GOBBLIN-900. --- Resolution: Duplicate > FsDataWriter dont use writer config for FileSystem > ---

[jira] [Commented] (GOBBLIN-900) FsDataWriter dont use writer config for FileSystem

2019-10-03 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16944156#comment-16944156 ] Jay Sen commented on GOBBLIN-900: - Looks like GOBBLIN-889 was filed for the same but sol

[jira] [Created] (GOBBLIN-898) successful Job completion wrongly calls onJobFailure

2019-10-03 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-898: --- Summary: successful Job completion wrongly calls onJobFailure Key: GOBBLIN-898 URL: https://issues.apache.org/jira/browse/GOBBLIN-898 Project: Apache Gobblin Issue Typ

[jira] [Created] (GOBBLIN-900) FsDataWriter dont use writer config for FileSystem

2019-10-03 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-900: --- Summary: FsDataWriter dont use writer config for FileSystem Key: GOBBLIN-900 URL: https://issues.apache.org/jira/browse/GOBBLIN-900 Project: Apache Gobblin Issue Type:

[jira] [Created] (GOBBLIN-867) use logger from class instead of passing it around

2019-09-05 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-867: --- Summary: use logger from class instead of passing it around Key: GOBBLIN-867 URL: https://issues.apache.org/jira/browse/GOBBLIN-867 Project: Apache Gobblin Issue Type:

[jira] [Updated] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

2019-09-03 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-707: Description: gobblin supports multiple modes of executions ( CLI, Standalone, cluster-master, cluster-wor

[jira] [Updated] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

2019-09-03 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-707: Description: gobblin supports multiple modes of executions ( CLI, Standalone, cluster-master, cluster-wor

[jira] [Updated] (GOBBLIN-818) upgrade default hadoop versions to 2.7.x and hive version to 1.2

2019-09-02 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-818: Description: Gobblin uses old hive 1.0, compiling against Hive 1.2 is not compatible due to backward inco

[jira] [Updated] (GOBBLIN-818) upgrade default hadoop versions to 2.7.x and hive version to 1.2

2019-09-02 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-818: Description: Gobblin uses old hive 1.0, compiling against Hive 1.2 is not compatible due to backward incom

[jira] [Created] (GOBBLIN-866) Re-Arrange Gobblin Modules and Classes as per GIP 2

2019-09-02 Thread Jay Sen (Jira)
Jay Sen created GOBBLIN-866: --- Summary: Re-Arrange Gobblin Modules and Classes as per GIP 2 Key: GOBBLIN-866 URL: https://issues.apache.org/jira/browse/GOBBLIN-866 Project: Apache Gobblin Issue Type

[jira] [Commented] (GOBBLIN-830) update config key to define job launcher type

2019-09-02 Thread Jay Sen (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921056#comment-16921056 ] Jay Sen commented on GOBBLIN-830: - To support both `launcher.type` and `job.launcher.typ

[jira] [Updated] (GOBBLIN-822) upgrade log4j to log4j2

2019-08-12 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-822: Description: log4j2 has routing appender that would be super useful and probably only way to achieve " jo

[jira] [Updated] (GOBBLIN-854) update config reader in standalone mode

2019-08-12 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-854: Description: standalone mode {{SchedulerDaemon}} uses java properties, this ticket is to use  TypeSafe Con

[jira] [Created] (GOBBLIN-854) update config reader in standalone mode

2019-08-12 Thread Jay Sen (JIRA)
Jay Sen created GOBBLIN-854: --- Summary: update config reader in standalone mode Key: GOBBLIN-854 URL: https://issues.apache.org/jira/browse/GOBBLIN-854 Project: Apache Gobblin Issue Type: Improvemen

[jira] [Updated] (GOBBLIN-854) update config reader in standalone mode

2019-08-12 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-854: Affects Version/s: 0.14.0 > update config reader in standalone mode >

[jira] [Updated] (GOBBLIN-854) update config reader in standalone mode

2019-08-12 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-854: Fix Version/s: 0.15.0 > update config reader in standalone mode > ---

[jira] [Commented] (GOBBLIN-824) upgrade to latest libraries in Gobblin

2019-08-12 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905621#comment-16905621 ] Jay Sen commented on GOBBLIN-824: - GOBBLIN-818 does minor upgrades. > upgrade to latest

[jira] [Updated] (GOBBLIN-824) upgrade to latest libraries in Gobblin

2019-08-12 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-824: Summary: upgrade to latest libraries in Gobblin (was: upgrade libs versions in Gobblin) > upgrade to lat

[jira] [Updated] (GOBBLIN-824) upgrade libs versions in Gobblin

2019-08-12 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-824: Description: lot of libs are old, like hadoop, hive, etc... it wont be easy to just comile gobblin with

[jira] [Updated] (GOBBLIN-818) upgrade default hadoop versions to 2.7.x and hive version to 1.2

2019-08-12 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-818: Description: Gobblin uses old hive 1.0, compiling against Hive 1.2 is not compatible due to backward inco

[jira] [Updated] (GOBBLIN-818) upgrade default hadoop versions to 2.7.x and hive version to 1.2

2019-08-12 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-818: Summary: upgrade default hadoop versions to 2.7.x and hive version to 1.2 (was: MIgrate to Hive 2.x as de

[jira] [Created] (GOBBLIN-850) remove duplicated buildFileSystem method

2019-08-11 Thread Jay Sen (JIRA)
Jay Sen created GOBBLIN-850: --- Summary: remove duplicated buildFileSystem method Key: GOBBLIN-850 URL: https://issues.apache.org/jira/browse/GOBBLIN-850 Project: Apache Gobblin Issue Type: Improveme

[jira] [Created] (GOBBLIN-845) upgrade to latest gradle

2019-08-04 Thread Jay Sen (JIRA)
Jay Sen created GOBBLIN-845: --- Summary: upgrade to latest gradle Key: GOBBLIN-845 URL: https://issues.apache.org/jira/browse/GOBBLIN-845 Project: Apache Gobblin Issue Type: Improvement R

[jira] [Updated] (GOBBLIN-845) upgrade to latest gradle

2019-08-04 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-845: Affects Version/s: 0.14.0 > upgrade to latest gradle > > > Key: G

[jira] [Updated] (GOBBLIN-845) upgrade to latest gradle

2019-08-04 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-845: Fix Version/s: 0.15.0 > upgrade to latest gradle > > > Key: GOBBL

[jira] [Created] (GOBBLIN-844) centralize all graddle scripts

2019-08-04 Thread Jay Sen (JIRA)
Jay Sen created GOBBLIN-844: --- Summary: centralize all graddle scripts Key: GOBBLIN-844 URL: https://issues.apache.org/jira/browse/GOBBLIN-844 Project: Apache Gobblin Issue Type: Improvement Aff

[jira] [Created] (GOBBLIN-843) Separately startable Admin UI & REST Server

2019-08-04 Thread Jay Sen (JIRA)
Jay Sen created GOBBLIN-843: --- Summary: Separately startable Admin UI & REST Server Key: GOBBLIN-843 URL: https://issues.apache.org/jira/browse/GOBBLIN-843 Project: Apache Gobblin Issue Type: New F

[jira] [Updated] (GOBBLIN-842) remove redundent TestAppender class

2019-08-01 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-842: Affects Version/s: 0.14.0 Fix Version/s: 0.15.0 > remove redundent TestAppender class > --

[jira] [Commented] (GOBBLIN-842) remove redundent TestAppender class

2019-08-01 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898361#comment-16898361 ] Jay Sen commented on GOBBLIN-842: - can find reference and context of this change in GOBB

[jira] [Created] (GOBBLIN-842) remove redundent TestAppender class

2019-08-01 Thread Jay Sen (JIRA)
Jay Sen created GOBBLIN-842: --- Summary: remove redundent TestAppender class Key: GOBBLIN-842 URL: https://issues.apache.org/jira/browse/GOBBLIN-842 Project: Apache Gobblin Issue Type: New Feature

[jira] [Created] (GOBBLIN-835) add date transformation converter

2019-07-26 Thread Jay Sen (JIRA)
Jay Sen created GOBBLIN-835: --- Summary: add date transformation converter Key: GOBBLIN-835 URL: https://issues.apache.org/jira/browse/GOBBLIN-835 Project: Apache Gobblin Issue Type: New Feature

[jira] [Created] (GOBBLIN-832) get specific tables instead of all tables from Hive DB

2019-07-21 Thread Jay Sen (JIRA)
Jay Sen created GOBBLIN-832: --- Summary: get specific tables instead of all tables from Hive DB Key: GOBBLIN-832 URL: https://issues.apache.org/jira/browse/GOBBLIN-832 Project: Apache Gobblin Issue T

[jira] [Created] (GOBBLIN-830) update config key to define job launcher type

2019-07-16 Thread Jay Sen (JIRA)
Jay Sen created GOBBLIN-830: --- Summary: update config key to define job launcher type Key: GOBBLIN-830 URL: https://issues.apache.org/jira/browse/GOBBLIN-830 Project: Apache Gobblin Issue Type: Impr

[jira] [Created] (GOBBLIN-824) upgrade libs versions in Gobblin

2019-07-11 Thread Jay Sen (JIRA)
Jay Sen created GOBBLIN-824: --- Summary: upgrade libs versions in Gobblin Key: GOBBLIN-824 URL: https://issues.apache.org/jira/browse/GOBBLIN-824 Project: Apache Gobblin Issue Type: Improvement A

[jira] [Updated] (GOBBLIN-822) upgrade log4j to log4j2

2019-07-11 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-822: Summary: upgrade log4j to log4j2 (was: update log4j to log4j2) > upgrade log4j to log4j2 > --

[jira] [Updated] (GOBBLIN-822) update log4j to log4j2

2019-07-11 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-822: Description: log4j2 has routing appender that would be super useful and probably only way to achieve " jo

[jira] [Created] (GOBBLIN-823) upgrade or remove lombok usage

2019-07-11 Thread Jay Sen (JIRA)
Jay Sen created GOBBLIN-823: --- Summary: upgrade or remove lombok usage Key: GOBBLIN-823 URL: https://issues.apache.org/jira/browse/GOBBLIN-823 Project: Apache Gobblin Issue Type: Improvement Aff

[jira] [Updated] (GOBBLIN-788) job specific log files

2019-07-11 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-788: Affects Version/s: 0.14.0 > job specific log files > -- > > Key: GOBBL

[jira] [Updated] (GOBBLIN-788) job specific log files

2019-07-11 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-788: Fix Version/s: 0.15.0 > job specific log files > -- > > Key: GOBBLIN-7

[jira] [Created] (GOBBLIN-822) update log4j to log4j2

2019-07-11 Thread Jay Sen (JIRA)
Jay Sen created GOBBLIN-822: --- Summary: update log4j to log4j2 Key: GOBBLIN-822 URL: https://issues.apache.org/jira/browse/GOBBLIN-822 Project: Apache Gobblin Issue Type: Sub-task Affects Versio

[jira] [Created] (GOBBLIN-818) MIgrate to Hive 2.x as default

2019-07-03 Thread Jay Sen (JIRA)
Jay Sen created GOBBLIN-818: --- Summary: MIgrate to Hive 2.x as default Key: GOBBLIN-818 URL: https://issues.apache.org/jira/browse/GOBBLIN-818 Project: Apache Gobblin Issue Type: Improvement

[jira] [Commented] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

2019-07-03 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16878203#comment-16878203 ] Jay Sen commented on GOBBLIN-707: - [~ibuenros], pls take a look. > combine & standardiz

[jira] [Updated] (GOBBLIN-788) job specific log files

2019-06-28 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-788: Description: Each job or task running on individual node should create separate log file (with some stand

[jira] [Updated] (GOBBLIN-811) non gobblin job files should not throw exception

2019-06-28 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-811: Description: any other files, other than .pull or .conf under job dir should be ignored with DEBUG or WAR

[jira] [Commented] (GOBBLIN-613) Use the Hadoop tokens provided by WormholePushJob, instead of negotiating them via Gobblin

2019-06-28 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16875162#comment-16875162 ] Jay Sen commented on GOBBLIN-613: - [~rakeshmalladi2018], can u provide some more detail

  1   2   >