[jira] [Created] (FLINK-29409) Add Transformer and Estimator for VarianceThresholdSelector

2022-09-25 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-29409:
-

 Summary: Add Transformer and Estimator for 
VarianceThresholdSelector 
 Key: FLINK-29409
 URL: https://issues.apache.org/jira/browse/FLINK-29409
 Project: Flink
  Issue Type: New Feature
  Components: Library / Machine Learning
Reporter: Jiang Xin


Add Transformer and Estimator for VarianceThresholdSelector 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (FLINK-29408) HiveCatalogITCase failed with NPE

2022-09-25 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-29408:


 Summary: HiveCatalogITCase failed with NPE
 Key: FLINK-29408
 URL: https://issues.apache.org/jira/browse/FLINK-29408
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Hive
Affects Versions: 1.17.0
Reporter: Huang Xingbo



{code:java}
2022-09-25T03:41:07.4212129Z Sep 25 03:41:07 [ERROR] 
org.apache.flink.table.catalog.hive.HiveCatalogUdfITCase.testFlinkUdf  Time 
elapsed: 0.098 s  <<< ERROR!
2022-09-25T03:41:07.4212662Z Sep 25 03:41:07 java.lang.NullPointerException
2022-09-25T03:41:07.4213189Z Sep 25 03:41:07at 
org.apache.flink.table.catalog.hive.HiveCatalogUdfITCase.testFlinkUdf(HiveCatalogUdfITCase.java:109)
2022-09-25T03:41:07.4213753Z Sep 25 03:41:07at 
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2022-09-25T03:41:07.4224643Z Sep 25 03:41:07at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2022-09-25T03:41:07.4225311Z Sep 25 03:41:07at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2022-09-25T03:41:07.4225879Z Sep 25 03:41:07at 
java.lang.reflect.Method.invoke(Method.java:498)
2022-09-25T03:41:07.4226405Z Sep 25 03:41:07at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
2022-09-25T03:41:07.4227201Z Sep 25 03:41:07at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
2022-09-25T03:41:07.4227807Z Sep 25 03:41:07at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
2022-09-25T03:41:07.4228394Z Sep 25 03:41:07at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
2022-09-25T03:41:07.4228966Z Sep 25 03:41:07at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
2022-09-25T03:41:07.4229514Z Sep 25 03:41:07at 
org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
2022-09-25T03:41:07.4230066Z Sep 25 03:41:07at 
org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
2022-09-25T03:41:07.4230587Z Sep 25 03:41:07at 
org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
2022-09-25T03:41:07.4231258Z Sep 25 03:41:07at 
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
2022-09-25T03:41:07.4231823Z Sep 25 03:41:07at 
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
2022-09-25T03:41:07.4232384Z Sep 25 03:41:07at 
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
2022-09-25T03:41:07.4232930Z Sep 25 03:41:07at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
2022-09-25T03:41:07.4233511Z Sep 25 03:41:07at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
2022-09-25T03:41:07.4234039Z Sep 25 03:41:07at 
org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
2022-09-25T03:41:07.4234546Z Sep 25 03:41:07at 
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
2022-09-25T03:41:07.4235057Z Sep 25 03:41:07at 
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
2022-09-25T03:41:07.4235573Z Sep 25 03:41:07at 
org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
2022-09-25T03:41:07.4236087Z Sep 25 03:41:07at 
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
2022-09-25T03:41:07.4236635Z Sep 25 03:41:07at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
2022-09-25T03:41:07.4237314Z Sep 25 03:41:07at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
2022-09-25T03:41:07.4238211Z Sep 25 03:41:07at 
org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
2022-09-25T03:41:07.4238775Z Sep 25 03:41:07at 
org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
2022-09-25T03:41:07.4239277Z Sep 25 03:41:07at 
org.junit.rules.RunRules.evaluate(RunRules.java:20)
2022-09-25T03:41:07.4239769Z Sep 25 03:41:07at 
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
2022-09-25T03:41:07.4240265Z Sep 25 03:41:07at 
org.junit.runners.ParentRunner.run(ParentRunner.java:413)
2022-09-25T03:41:07.4240731Z Sep 25 03:41:07at 
org.junit.runner.JUnitCore.run(JUnitCore.java:137)
2022-09-25T03:41:07.4241196Z Sep 25 03:41:07at 
org.junit.runner.JUnitCore.run(JUnitCore.java:115)
2022-09-25T03:41:07.4241715Z Sep 25 03:41:07at 
org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:42)
2022-09-25T03:41:07.4242316Z Sep 25 03:41:07at 
org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:80)
2022-09-25T03:41:07.4242904Z Sep 25 03:41:07at 
org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:72)
2022-09-25T03:41:07.4243528Z 

[jira] [Created] (FLINK-29407) HiveCatalogITCase.testCsvTableViaSQL failed with FileNotFoundException

2022-09-25 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-29407:


 Summary: HiveCatalogITCase.testCsvTableViaSQL failed with 
FileNotFoundException
 Key: FLINK-29407
 URL: https://issues.apache.org/jira/browse/FLINK-29407
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Hive
Affects Versions: 1.16.0
Reporter: Huang Xingbo



{code:java}
2022-09-25T04:37:47.3992924Z Sep 25 04:37:47 [ERROR] Tests run: 14, Failures: 
0, Errors: 1, Skipped: 0, Time elapsed: 65.785 s <<< FAILURE! - in 
org.apache.flink.table.catalog.hive.HiveCatalogITCase
2022-09-25T04:37:47.4025795Z Sep 25 04:37:47 [ERROR] 
org.apache.flink.table.catalog.hive.HiveCatalogITCase.testCsvTableViaSQL  Time 
elapsed: 5.584 s  <<< ERROR!
2022-09-25T04:37:47.4026393Z Sep 25 04:37:47 java.lang.RuntimeException: Failed 
to fetch next result
2022-09-25T04:37:47.4027006Z Sep 25 04:37:47at 
org.apache.flink.streaming.api.operators.collect.CollectResultIterator.nextResultFromFetcher(CollectResultIterator.java:109)
2022-09-25T04:37:47.4046427Z Sep 25 04:37:47at 
org.apache.flink.streaming.api.operators.collect.CollectResultIterator.hasNext(CollectResultIterator.java:80)
2022-09-25T04:37:47.4047674Z Sep 25 04:37:47at 
org.apache.flink.table.planner.connectors.CollectDynamicSink$CloseableRowIteratorWrapper.hasNext(CollectDynamicSink.java:222)
2022-09-25T04:37:47.4048848Z Sep 25 04:37:47at 
java.util.Iterator.forEachRemaining(Iterator.java:115)
2022-09-25T04:37:47.4051301Z Sep 25 04:37:47at 
org.apache.flink.util.CollectionUtil.iteratorToList(CollectionUtil.java:115)
2022-09-25T04:37:47.4052042Z Sep 25 04:37:47at 
org.apache.flink.table.catalog.hive.HiveCatalogITCase.testCsvTableViaSQL(HiveCatalogITCase.java:140)
2022-09-25T04:37:47.4052654Z Sep 25 04:37:47at 
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2022-09-25T04:37:47.4053295Z Sep 25 04:37:47at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2022-09-25T04:37:47.4053909Z Sep 25 04:37:47at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2022-09-25T04:37:47.4054470Z Sep 25 04:37:47at 
java.lang.reflect.Method.invoke(Method.java:498)
2022-09-25T04:37:47.4055022Z Sep 25 04:37:47at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
2022-09-25T04:37:47.4055655Z Sep 25 04:37:47at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
2022-09-25T04:37:47.4056250Z Sep 25 04:37:47at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
2022-09-25T04:37:47.4056855Z Sep 25 04:37:47at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
2022-09-25T04:37:47.4057453Z Sep 25 04:37:47at 
org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
2022-09-25T04:37:47.4058013Z Sep 25 04:37:47at 
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
2022-09-25T04:37:47.4058592Z Sep 25 04:37:47at 
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
2022-09-25T04:37:47.4059176Z Sep 25 04:37:47at 
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
2022-09-25T04:37:47.4059731Z Sep 25 04:37:47at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
2022-09-25T04:37:47.4060350Z Sep 25 04:37:47at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
2022-09-25T04:37:47.4060907Z Sep 25 04:37:47at 
org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
2022-09-25T04:37:47.4061441Z Sep 25 04:37:47at 
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
2022-09-25T04:37:47.4062200Z Sep 25 04:37:47at 
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
2022-09-25T04:37:47.4062736Z Sep 25 04:37:47at 
org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
2022-09-25T04:37:47.4063261Z Sep 25 04:37:47at 
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
2022-09-25T04:37:47.4063821Z Sep 25 04:37:47at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
2022-09-25T04:37:47.4064407Z Sep 25 04:37:47at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
2022-09-25T04:37:47.4064971Z Sep 25 04:37:47at 
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
2022-09-25T04:37:47.4065503Z Sep 25 04:37:47at 
org.junit.runners.ParentRunner.run(ParentRunner.java:413)
2022-09-25T04:37:47.4066162Z Sep 25 04:37:47at 
org.junit.runner.JUnitCore.run(JUnitCore.java:137)
2022-09-25T04:37:47.4066640Z Sep 25 04:37:47at 
org.junit.runner.JUnitCore.run(JUnitCore.java:115)
2022-09-25T04:37:47.4067195Z Sep 25 04:37:47at 

[jira] [Created] (FLINK-29406) Expose Finish Method For TableFunction

2022-09-25 Thread lincoln lee (Jira)
lincoln lee created FLINK-29406:
---

 Summary: Expose Finish Method For TableFunction
 Key: FLINK-29406
 URL: https://issues.apache.org/jira/browse/FLINK-29406
 Project: Flink
  Issue Type: Improvement
Affects Versions: 1.15.2, 1.16.0
Reporter: lincoln lee
 Fix For: 1.17.0


FLIP-260: Expose Finish Method For TableFunction
https://cwiki.apache.org/confluence/display/FLINK/FLIP-260%3A+Expose+Finish+Method+For+TableFunction



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [VOTE] FLIP-260: Expose Finish Method For TableFunction

2022-09-25 Thread Lincoln Lee
Hi Timo,
Thanks for reminding this, currently ExpressionReducer doesn't support
TableFunction, so it's not mentioned in the flip, but this should be
covered when we start to support it.

Best,
Lincoln Lee


Jingsong Li  于2022年9月23日周五 09:47写道:

> +1 (binding)
>
> Best,
> Jingsong
>
> On Thu, Sep 22, 2022 at 9:45 PM Timo Walther  wrote:
> >
> > +1 (binding)
> >
> > Please make also sure to update ExpressionReducer during implementation.
> > This is not mentioned in the FLIP yet.
> >
> > Thanks,
> > Timo
> >
> > On 22.09.22 10:41, Piotr Nowojski wrote:
> > > +1 (binding)
> > >
> > > czw., 22 wrz 2022 o 08:21 Lincoln Lee 
> napisał(a):
> > >
> > >> Hi everyone,
> > >>
> > >> Thanks for all your feedback for FLIP-260[1] in the discussion
> thread[2],
> > >> I'd
> > >> like to start a vote for it.
> > >>
> > >> The vote will be open for at least 72 hours.
> > >>
> > >> [1]
> > >>
> > >>
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-260%3A+Expose+Finish+Method+For+TableFunction
> > >> [2] https://lists.apache.org/thread/m9hj60p3mntyctkbxrksm8l4d0s4q9dw
> > >>
> > >> Best,
> > >> Lincoln Lee
> > >>
> > >
> >
>


[RESULT][VOTE]FLIP-260: Expose Finish Method For TableFunction

2022-09-25 Thread Lincoln Lee
Hi everyone,

FLIP-260[1] has been accepted.

There are 3 approving votes which are all binding[2]

- Binding: Piotr Nowojski
- Binding: Timo Walther
- Binding: Jingsong Li

None against.

Thanks again to everyone!

[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-260%3A+Expose+Finish+Method+For+TableFunction
[2] https://lists.apache.org/thread/nr9wwf98fkw1tk7ycgbcfjjo5g4x8pmz

Best,
Lincoln Lee


[jira] [Created] (FLINK-29405) InputFormatCacheLoaderTest is unstable

2022-09-25 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-29405:


 Summary: InputFormatCacheLoaderTest is unstable
 Key: FLINK-29405
 URL: https://issues.apache.org/jira/browse/FLINK-29405
 Project: Flink
  Issue Type: Technical Debt
  Components: Table SQL / Runtime
Affects Versions: 1.17.0
Reporter: Chesnay Schepler


#testExceptionDuringReload/#testCloseAndInterruptDuringReload fail reliably 
when run in a loop.

{code}
java.lang.AssertionError: 
Expecting AtomicInteger(0) to have value:
  0
but did not.

at 
org.apache.flink.table.runtime.functions.table.fullcache.inputformat.InputFormatCacheLoaderTest.testCloseAndInterruptDuringReload(InputFormatCacheLoaderTest.java:161)
{code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)