You can archive jobs now:
https://cloud.google.com/dataflow/docs/guides/stopping-a-pipeline#archive
On Tue, Jan 2, 2024 at 8:47 AM Svetak Sundhar via user
wrote:
> Hello Sumit,
>
> There is no requirement to delete old jobs, though you can archive
> completed jobs via a recently released feature [1]. There is no limit to
> the number of old jobs that are accumulated. Further, the UI will show all
> running Dataflow jobs and all jobs run in the last 30 days [2].
>
> Hope this helps!
>
> [1]
> https://cloud.google.com/dataflow/docs/guides/stopping-a-pipeline#archive
>
> [2]
> https://cloud.google.com/dataflow/docs/guides/monitoring-overview
>
>
>
> Svetak Sundhar
>
> Data Engineer
> s vetaksund...@google.com
>
>
>
> On Tue, Jan 2, 2024 at 6:11 AM Sumit Desai via user
> wrote:
>
>> Hi all,
>>
>> I have integrated Google Dataflow with my application. After every run,
>> there is one job created under Dataflow as shown in the screenshot.
>>
>> Do I need to delete the old jobs? Is there any restriction on the number
>> of old jobs that can get accumulated here?
>>
>> Thanks & Regards,
>> Sumit Desai
>>
>
