[jira] [Updated] (HUDI-616) Parquet files not getting created on DFS docker instance but on local FS in TestHoodieDeltaStreamer
[ https://issues.apache.org/jira/browse/HUDI-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha updated HUDI-616: --- Fix Version/s: 0.5.3 > Parquet files not getting created on DFS docker instance but on local FS in > TestHoodieDeltaStreamer > --- > > Key: HUDI-616 > URL: https://issues.apache.org/jira/browse/HUDI-616 > Project: Apache Hudi (incubating) > Issue Type: Bug > Components: DeltaStreamer, Testing >Reporter: Pratyaksh Sharma >Assignee: Pratyaksh Sharma >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0, 0.5.3 > > Time Spent: 20m > Remaining Estimate: 0h > > In TestHoodieDeltaStreamer, > PARQUET_SOURCE_ROOT gets initialised even before function annotated with > @BeforeClass gets called as below - > private static final String PARQUET_SOURCE_ROOT = dfsBasePath + > "/parquetFiles"; > At this point, dfsBasePath variable is null and as a result, parquet files > get created on local FS which need to be cleared manually after testing. This > needs to be rectified. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-616) Parquet files not getting created on DFS docker instance but on local FS in TestHoodieDeltaStreamer
[ https://issues.apache.org/jira/browse/HUDI-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-616: Labels: pull-request-available (was: ) > Parquet files not getting created on DFS docker instance but on local FS in > TestHoodieDeltaStreamer > --- > > Key: HUDI-616 > URL: https://issues.apache.org/jira/browse/HUDI-616 > Project: Apache Hudi (incubating) > Issue Type: Bug > Components: DeltaStreamer, Testing >Reporter: Pratyaksh Sharma >Assignee: Pratyaksh Sharma >Priority: Major > Labels: pull-request-available > Fix For: 0.6.0 > > > In TestHoodieDeltaStreamer, > PARQUET_SOURCE_ROOT gets initialised even before function annotated with > @BeforeClass gets called as below - > private static final String PARQUET_SOURCE_ROOT = dfsBasePath + > "/parquetFiles"; > At this point, dfsBasePath variable is null and as a result, parquet files > get created on local FS which need to be cleared manually after testing. This > needs to be rectified. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-616) Parquet files not getting created on DFS docker instance but on local FS in TestHoodieDeltaStreamer
[ https://issues.apache.org/jira/browse/HUDI-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi updated HUDI-616: --- Fix Version/s: (was: 0.5.2) 0.6.0 > Parquet files not getting created on DFS docker instance but on local FS in > TestHoodieDeltaStreamer > --- > > Key: HUDI-616 > URL: https://issues.apache.org/jira/browse/HUDI-616 > Project: Apache Hudi (incubating) > Issue Type: Bug > Components: DeltaStreamer, Testing >Reporter: Pratyaksh Sharma >Assignee: Pratyaksh Sharma >Priority: Major > Fix For: 0.6.0 > > > In TestHoodieDeltaStreamer, > PARQUET_SOURCE_ROOT gets initialised even before function annotated with > @BeforeClass gets called as below - > private static final String PARQUET_SOURCE_ROOT = dfsBasePath + > "/parquetFiles"; > At this point, dfsBasePath variable is null and as a result, parquet files > get created on local FS which need to be cleared manually after testing. This > needs to be rectified. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-616) Parquet files not getting created on DFS docker instance but on local FS in TestHoodieDeltaStreamer
[ https://issues.apache.org/jira/browse/HUDI-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-616: -- Status: In Progress (was: Open) > Parquet files not getting created on DFS docker instance but on local FS in > TestHoodieDeltaStreamer > --- > > Key: HUDI-616 > URL: https://issues.apache.org/jira/browse/HUDI-616 > Project: Apache Hudi (incubating) > Issue Type: Bug > Components: DeltaStreamer, Testing >Reporter: Pratyaksh Sharma >Assignee: Pratyaksh Sharma >Priority: Major > Fix For: 0.5.2 > > > In TestHoodieDeltaStreamer, > PARQUET_SOURCE_ROOT gets initialised even before function annotated with > @BeforeClass gets called as below - > private static final String PARQUET_SOURCE_ROOT = dfsBasePath + > "/parquetFiles"; > At this point, dfsBasePath variable is null and as a result, parquet files > get created on local FS which need to be cleared manually after testing. This > needs to be rectified. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-616) Parquet files not getting created on DFS docker instance but on local FS in TestHoodieDeltaStreamer
[ https://issues.apache.org/jira/browse/HUDI-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-616: -- Status: Open (was: New) > Parquet files not getting created on DFS docker instance but on local FS in > TestHoodieDeltaStreamer > --- > > Key: HUDI-616 > URL: https://issues.apache.org/jira/browse/HUDI-616 > Project: Apache Hudi (incubating) > Issue Type: Bug > Components: DeltaStreamer, Testing >Reporter: Pratyaksh Sharma >Assignee: Pratyaksh Sharma >Priority: Major > Fix For: 0.5.2 > > > In TestHoodieDeltaStreamer, > PARQUET_SOURCE_ROOT gets initialised even before function annotated with > @BeforeClass gets called as below - > private static final String PARQUET_SOURCE_ROOT = dfsBasePath + > "/parquetFiles"; > At this point, dfsBasePath variable is null and as a result, parquet files > get created on local FS which need to be cleared manually after testing. This > needs to be rectified. -- This message was sent by Atlassian Jira (v8.3.4#803005)
