[ https://issues.apache.org/jira/browse/ATLAS-536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ayub Khan updated ATLAS-536: ---------------------------- Attachment: Adding_atlas_conf_path_to_falcon_server_opts-3.patch [~shwethags] I have made the changes accordingly. Thanks for reviewing the patch. > Falcon hook loads incorrect configuration when -Datlas.conf is not given when > falcon server startup. this needs to be documented. > --------------------------------------------------------------------------------------------------------------------------------- > > Key: ATLAS-536 > URL: https://issues.apache.org/jira/browse/ATLAS-536 > Project: Atlas > Issue Type: Bug > Affects Versions: trunk > Reporter: Ayub Khan > Assignee: Ayub Khan > Priority: Critical > Labels: patch > Fix For: trunk > > Attachments: Adding_atlas_conf_path_to_falcon_server_opts-2.patch, > Adding_atlas_conf_path_to_falcon_server_opts-3.patch, > Adding_atlas_conf_path_to_falcon_server_opts.patch > > > Problem: > Falcon server startup expects "-Datlas.conf=<path to atlas conf dir>" to read > the atlas configuration file(application.properties), if this is not > provided, then falcon hook tries to read the default values from the > atlas-typesystem jar file. > *Basically falcon hook depends on "atlas.rest.address" config option present > in application.properties to post the entity create/update to atlas. But in > the above the scenario, when "atlas.conf" option is not provided at falcon > server startup, this will read the atlas.rest.address as localhost which is > incorrect and all the subsequent falcon hook updates will fail.* > This also needs to be documented. > Falcon applicaiton log showing the conf file is read from jar file which has > default values > {noformat} > 2016-02-25 08:29:13,131 INFO - [main:] ~ Initiated backend operations thread > pool of size 2 (Backend:148) > 2016-02-25 08:29:13,510 INFO - [main:] ~ Indexes already exist for graph > (MetadataMappingService:143) > 2016-02-25 08:29:13,510 INFO - [main:] ~ Initialized graph db: > titangraph[berkeleyje:/grid/0/hadoop/falcon/data/lineage/graphdb] > (MetadataMappingService:88) > 2016-02-25 08:29:13,511 INFO - [main:] ~ Init vertex property keys: [name, > type, version, timestamp] (MetadataMappingService:91) > 2016-02-25 08:29:13,511 INFO - [main:] ~ Init edge property keys: [name] > (MetadataMappingService:94) > 2016-02-25 08:29:13,515 INFO - [main:] ~ Service initialized: > org.apache.falcon.metadata.MetadataMappingService (ServiceInitializer:52) > 2016-02-25 08:29:13,517 INFO - [main:] ~ Initializing service: > org.apache.falcon.atlas.service.AtlasService (ServiceInitializer:45) > 2016-02-25 08:29:13,522 INFO - [main:] ~ Loading application.properties from > jar:file:/grid/0/hdp/2.3.99.0-196/falcon/webapp/falcon/WEB-INF/lib/atlas-typesystem-0.6.0.2.3.99.0-196.jar!/application.properties > (ApplicationProperties:62) > 2016-02-25 08:29:13,539 INFO - [main:] ~ Loading client.properties from > file:/grid/0/hdp/2.3.99.0-196/falcon/webapp/falcon/WEB-INF/classes/client.properties > (ApplicationProperties:62) > 2016-02-25 08:29:13,914 INFO - [main:] ~ Real User: falcon (auth:SIMPLE), is > from ticket cache? false (SecureClientUtils:90) > 2016-02-25 08:29:13,915 INFO - [main:] ~ doAsUser: falcon > (SecureClientUtils:93) > 2016-02-25 08:29:14,780 INFO - [main:] ~ Created Atlas Hook for Falcon > (FalconHook:144) > 2016-02-25 08:29:14,780 INFO - [main:] ~ Service initialized: > org.apache.falcon.atlas.service.AtlasService (ServiceInitializer:52) > 2016-02-25 08:29:14,782 INFO - [main:] ~ FalconAuditFilter initialization > started (FalconAuditFilter:49) > 2016-02-25 08:29:14,785 INFO - [main:] ~ FalconAuthenticationFilter > initialization started (FalconAuthenticationFilter:83) > 2016-02-25 08:29:14,802 INFO - [main:] ~ Falcon is running with > authorization enabled (FalconAuthorizationFilter:62) > {noformat} > Falcon application log showing conf file read from /etc/atlas/conf when > -Datlas.conf is provided > {noformat} > 2016-02-25 11:36:52,605 INFO - [main:] ~ Initiated backend operations thread > pool of size 2 (Backend:148) > 2016-02-25 11:36:53,119 INFO - [main:] ~ Indexes already exist for graph > (MetadataMappingService:143) > 2016-02-25 11:36:53,120 INFO - [main:] ~ Initialized graph db: > titangraph[berkeleyje:/grid/0/hadoop/falcon/data/lineage/graphdb] > (MetadataMappingService:88) > 2016-02-25 11:36:53,122 INFO - [main:] ~ Init vertex property keys: [name, > type, version, timestamp] (MetadataMappingService:91) > 2016-02-25 11:36:53,123 INFO - [main:] ~ Init edge property keys: [name] > (MetadataMappingService:94) > 2016-02-25 11:36:53,128 INFO - [main:] ~ Service initialized: > org.apache.falcon.metadata.MetadataMappingService (ServiceInitializer:52) > 2016-02-25 11:36:53,130 INFO - [main:] ~ Initializing service: > org.apache.falcon.atlas.service.AtlasService (ServiceInitializer:45) > 2016-02-25 11:36:53,135 INFO - [main:] ~ Loading application.properties from > file:/etc/atlas/conf/application.properties (ApplicationProperties:62) > 2016-02-25 11:36:53,163 INFO - [main:] ~ Loading client.properties from > file:/etc/atlas/conf/client.properties (ApplicationProperties:62) > 2016-02-25 11:36:53,396 INFO - [main:] ~ Real User: falcon (auth:SIMPLE), is > from ticket cache? false (SecureClientUtils:90) > 2016-02-25 11:36:53,396 INFO - [main:] ~ doAsUser: falcon > (SecureClientUtils:93) > 2016-02-25 11:36:54,178 INFO - [main:] ~ Created Atlas Hook for Falcon > (FalconHook:144) > 2016-02-25 11:36:54,178 INFO - [main:] ~ Service initialized: > org.apache.falcon.atlas.service.AtlasService (ServiceInitializer:52) > 2016-02-25 11:36:54,180 INFO - [main:] ~ FalconAuditFilter initialization > started (FalconAuditFilter:49) > 2016-02-25 11:36:54,184 INFO - [main:] ~ FalconAuthenticationFilter > initialization started (FalconAuthenticationFilter:83) > 2016-02-25 11:36:54,214 INFO - [main:] ~ Falcon is running with > authorization enabled (FalconAuthorizationFilter:62) > 2016-02-25 11:36:55,389 INFO - [main:] ~ Started > SocketConnector@0.0.0.0:15000 (log:67) > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)