[
https://issues.apache.org/jira/browse/FALCON-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pragya Mittal updated FALCON-1560:
----------------------------------
Description:
While submitting feed with optional lifecycle frequency it fails with following
error :
{noformat}
<?xml version="1.0" encoding="UTF-8"?><result>
<status>FAILED</status>
<message>ua1/Retention can not be more frequent than data availability.
</message>
<requestId>ua1/1309176095@qtp-2030538903-0 -
83c96042-fb26-4b3a-8f47-f855581a5f97
</requestId>
</result>
{noformat}
Feed definition is :
{noformat}
<?xml version="1.0" encoding="UTF-8"?><feed xmlns="uri:falcon:feed:0.1"
name="A520c018d-439b98aa" description="clicks log">
<frequency>days(2)</frequency>
<timezone>UTC</timezone>
<late-arrival cut-off="days(2)"/>
<clusters>
<cluster name="A520c018d-699dd88a" type="source">
<validity start="2012-01-30T00:00Z" end="2099-03-31T23:59Z"/>
<retention limit="days(6)" action="delete"/>
</cluster>
</clusters>
<locations>
<location type="data"
path="/tmp/falcon-regression/LifecycleHourlyTest/testFolders/${YEAR}/${MONTH}/${DAY}"/>
<location type="stats" path="/projects/falcon/clicksStats"/>
<location type="meta" path="/projects/falcon/clicksMetaData"/>
</locations>
<ACL owner="pragya" group="dataqa" permission="*"/>
<schema location="/schema/clicks" provider="protobuf"/>
<properties/>
<lifecycle>
<retention-stage>
<queue>default</queue>
<priority>HIGH</priority>
<properties>
<property name="retention.policy.agebaseddelete.limit"
value="days(10)"/>
</properties>
</retention-stage>
</lifecycle>
</feed>
{noformat}
Same behaviour goes for feed having frequency > hours(6)
was:
While submitting feed with optional lifecycle frequency it fails with following
error :
{noformat}
<?xml version="1.0" encoding="UTF-8"?><result>
<status>FAILED</status>
<message>ua1/Retention can not be more frequent than data availability.
</message>
<requestId>ua1/1309176095@qtp-2030538903-0 -
83c96042-fb26-4b3a-8f47-f855581a5f97
</requestId>
</result>
{noformat}
Feed definition is :
{noformat}
<?xml version="1.0" encoding="UTF-8"?><feed xmlns="uri:falcon:feed:0.1"
name="A520c018d-439b98aa" description="clicks log">
<frequency>days(2)</frequency>
<timezone>UTC</timezone>
<late-arrival cut-off="days(2)"/>
<clusters>
<cluster name="A520c018d-699dd88a" type="source">
<validity start="2012-01-30T00:00Z" end="2099-03-31T23:59Z"/>
<retention limit="days(6)" action="delete"/>
</cluster>
</clusters>
<locations>
<location type="data"
path="/tmp/falcon-regression/LifecycleHourlyTest/testFolders/${YEAR}/${MONTH}/${DAY}"/>
<location type="stats" path="/projects/falcon/clicksStats"/>
<location type="meta" path="/projects/falcon/clicksMetaData"/>
</locations>
<ACL owner="pragya" group="dataqa" permission="*"/>
<schema location="/schema/clicks" provider="protobuf"/>
<properties/>
<lifecycle>
<retention-stage>
<queue>default</queue>
<priority>HIGH</priority>
<properties>
<property name="retention.policy.agebaseddelete.limit"
value="days(10)"/>
</properties>
</retention-stage>
</lifecycle>
</feed>
{noformat}
> Lifecycle does not allow feed with frequency greater than days(1)
> -----------------------------------------------------------------
>
> Key: FALCON-1560
> URL: https://issues.apache.org/jira/browse/FALCON-1560
> Project: Falcon
> Issue Type: Bug
> Affects Versions: 0.8
> Reporter: Pragya Mittal
> Assignee: Ajay Yadava
> Fix For: 0.8
>
> Attachments: FALCON-1560.patch
>
>
> While submitting feed with optional lifecycle frequency it fails with
> following error :
> {noformat}
> <?xml version="1.0" encoding="UTF-8"?><result>
> <status>FAILED</status>
> <message>ua1/Retention can not be more frequent than data availability.
> </message>
> <requestId>ua1/1309176095@qtp-2030538903-0 -
> 83c96042-fb26-4b3a-8f47-f855581a5f97
> </requestId>
> </result>
> {noformat}
> Feed definition is :
> {noformat}
> <?xml version="1.0" encoding="UTF-8"?><feed xmlns="uri:falcon:feed:0.1"
> name="A520c018d-439b98aa" description="clicks log">
> <frequency>days(2)</frequency>
> <timezone>UTC</timezone>
> <late-arrival cut-off="days(2)"/>
> <clusters>
> <cluster name="A520c018d-699dd88a" type="source">
> <validity start="2012-01-30T00:00Z" end="2099-03-31T23:59Z"/>
> <retention limit="days(6)" action="delete"/>
> </cluster>
> </clusters>
> <locations>
> <location type="data"
> path="/tmp/falcon-regression/LifecycleHourlyTest/testFolders/${YEAR}/${MONTH}/${DAY}"/>
> <location type="stats" path="/projects/falcon/clicksStats"/>
> <location type="meta" path="/projects/falcon/clicksMetaData"/>
> </locations>
> <ACL owner="pragya" group="dataqa" permission="*"/>
> <schema location="/schema/clicks" provider="protobuf"/>
> <properties/>
> <lifecycle>
> <retention-stage>
> <queue>default</queue>
> <priority>HIGH</priority>
> <properties>
> <property name="retention.policy.agebaseddelete.limit"
> value="days(10)"/>
> </properties>
> </retention-stage>
> </lifecycle>
> </feed>
> {noformat}
> Same behaviour goes for feed having frequency > hours(6)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
