[jira] [Updated] (ATLAS-835) Falcon Integration with Atlas

2016-06-17 Thread Shwetha G S (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S updated ATLAS-835:
--
Attachment: ATLAS-835-v3.patch

Fixed storm error

> Falcon Integration with Atlas
> -
>
> Key: ATLAS-835
> URL: https://issues.apache.org/jira/browse/ATLAS-835
> Project: Atlas
>  Issue Type: New Feature
>Reporter: Sowmya Ramesh
>Assignee: Sowmya Ramesh
> Fix For: trunk
>
> Attachments: ATLAS-835-v1.patch, ATLAS-835-v2.patch, 
> ATLAS-835-v3.patch, ATLAS-835.patch
>
>
> Currently only Falcon process registration is supported in Atlas. Extend this 
> to support Falcon feed, replication feed, cluster entity addition and updates.
> Here are the types to be defined:
> {noformat}
> falcon_cluster - models falcon cluster
> falcon_feed - extends Dataset - models falcon feed
> falcon_process - extends Process - models falcon process with inputs and 
> outputs as falcon_feed
> falcon_feed_creation - extends Process - input as hive_table or hdfs_path, 
> output as falcon_feed
> falcon_replication - extends Process - input as falcon_feed in source 
> cluster, output as falcon_feed in target cluster
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-835) Falcon Integration with Atlas

2016-06-17 Thread Shwetha G S (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S updated ATLAS-835:
--
Attachment: ATLAS-835-v2.patch

> Falcon Integration with Atlas
> -
>
> Key: ATLAS-835
> URL: https://issues.apache.org/jira/browse/ATLAS-835
> Project: Atlas
>  Issue Type: New Feature
>Reporter: Sowmya Ramesh
>Assignee: Sowmya Ramesh
> Fix For: trunk
>
> Attachments: ATLAS-835-v1.patch, ATLAS-835-v2.patch, ATLAS-835.patch
>
>
> Currently only Falcon process registration is supported in Atlas. Extend this 
> to support Falcon feed, replication feed, cluster entity addition and updates.
> Here are the types to be defined:
> {noformat}
> falcon_cluster - models falcon cluster
> falcon_feed - extends Dataset - models falcon feed
> falcon_process - extends Process - models falcon process with inputs and 
> outputs as falcon_feed
> falcon_feed_creation - extends Process - input as hive_table or hdfs_path, 
> output as falcon_feed
> falcon_replication - extends Process - input as falcon_feed in source 
> cluster, output as falcon_feed in target cluster
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-835) Falcon Integration with Atlas

2016-06-17 Thread Shwetha G S (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S updated ATLAS-835:
--
Attachment: ATLAS-835-v1.patch

re-based patch

> Falcon Integration with Atlas
> -
>
> Key: ATLAS-835
> URL: https://issues.apache.org/jira/browse/ATLAS-835
> Project: Atlas
>  Issue Type: New Feature
>Reporter: Sowmya Ramesh
>Assignee: Sowmya Ramesh
> Fix For: trunk
>
> Attachments: ATLAS-835-v1.patch, ATLAS-835.patch
>
>
> Currently only Falcon process registration is supported in Atlas. Extend this 
> to support Falcon feed, replication feed, cluster entity addition and updates.
> Here are the types to be defined:
> {noformat}
> falcon_cluster - models falcon cluster
> falcon_feed - extends Dataset - models falcon feed
> falcon_process - extends Process - models falcon process with inputs and 
> outputs as falcon_feed
> falcon_feed_creation - extends Process - input as hive_table or hdfs_path, 
> output as falcon_feed
> falcon_replication - extends Process - input as falcon_feed in source 
> cluster, output as falcon_feed in target cluster
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-835) Falcon Integration with Atlas

2016-06-17 Thread Shwetha G S (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S updated ATLAS-835:
--
Attachment: ATLAS-835.patch

Attached patch with test fixes, tests added and other fixes:
1. In hooks, messages was a global variable. Moved to local variable per 
invocation
2. Added falcon tests

> Falcon Integration with Atlas
> -
>
> Key: ATLAS-835
> URL: https://issues.apache.org/jira/browse/ATLAS-835
> Project: Atlas
>  Issue Type: New Feature
>Reporter: Sowmya Ramesh
>Assignee: Sowmya Ramesh
> Fix For: trunk
>
> Attachments: ATLAS-835.patch
>
>
> Currently only Falcon process registration is supported in Atlas. Extend this 
> to support Falcon feed, replication feed, cluster entity addition and updates.
> Here are the types to be defined:
> {noformat}
> falcon_cluster - models falcon cluster
> falcon_feed - extends Dataset - models falcon feed
> falcon_process - extends Process - models falcon process with inputs and 
> outputs as falcon_feed
> falcon_feed_creation - extends Process - input as hive_table or hdfs_path, 
> output as falcon_feed
> falcon_replication - extends Process - input as falcon_feed in source 
> cluster, output as falcon_feed in target cluster
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-835) Falcon Integration with Atlas

2016-05-27 Thread Suma Shivaprasad (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suma Shivaprasad updated ATLAS-835:
---
Assignee: Sowmya Ramesh

> Falcon Integration with Atlas
> -
>
> Key: ATLAS-835
> URL: https://issues.apache.org/jira/browse/ATLAS-835
> Project: Atlas
>  Issue Type: New Feature
>Reporter: Sowmya Ramesh
>Assignee: Sowmya Ramesh
> Fix For: trunk
>
>
> Currently only Falcon process registration is supported in Atlas. Extend this 
> to support Falcon feed, replication feed, cluster entity addition and updates.
> Here are the types to be defined:
> {noformat}
> falcon_cluster - models falcon cluster
> falcon_feed - extends Dataset - models falcon feed
> falcon_process - extends Process - models falcon process with inputs and 
> outputs as falcon_feed
> falcon_feed_creation - extends Process - input as hive_table or hdfs_path, 
> output as falcon_feed
> falcon_replication - extends Process - input as falcon_feed in source 
> cluster, output as falcon_feed in target cluster
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)