[jira] [Created] (FLINK-9651) Add a Kafka table source factory with Protobuf format support

2018-06-23 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9651: --- Summary: Add a Kafka table source factory with Protobuf format support Key: FLINK-9651 URL: https://issues.apache.org/jira/browse/FLINK-9651 Project: Flink

[jira] [Created] (FLINK-9650) Support Protocol Buffers formats

2018-06-23 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9650: --- Summary: Support Protocol Buffers formats Key: FLINK-9650 URL: https://issues.apache.org/jira/browse/FLINK-9650 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-9625) Enrich the error information to user

2018-06-20 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9625: --- Summary: Enrich the error information to user Key: FLINK-9625 URL: https://issues.apache.org/jira/browse/FLINK-9625 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-9614) Improve the error message for Compiler#compile

2018-06-19 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9614: --- Summary: Improve the error message for Compiler#compile Key: FLINK-9614 URL: https://issues.apache.org/jira/browse/FLINK-9614 Project: Flink Issue Type

[jira] [Created] (FLINK-9609) Add bucket ready notification mechanism for BucketingSink when checkpoint complete

2018-06-18 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9609: --- Summary: Add bucket ready notification mechanism for BucketingSink when checkpoint complete Key: FLINK-9609 URL: https://issues.apache.org/jira/browse/FLINK-9609

[jira] [Created] (FLINK-9607) Support ParquetTableSink

2018-06-17 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9607: --- Summary: Support ParquetTableSink Key: FLINK-9607 URL: https://issues.apache.org/jira/browse/FLINK-9607 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-9606) Support ParquetTableSource

2018-06-17 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9606: --- Summary: Support ParquetTableSource Key: FLINK-9606 URL: https://issues.apache.org/jira/browse/FLINK-9606 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-9605) Support KafkaProtoBufTableSink

2018-06-17 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9605: --- Summary: Support KafkaProtoBufTableSink Key: FLINK-9605 URL: https://issues.apache.org/jira/browse/FLINK-9605 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-9604) Support KafkaProtoBufTableSource

2018-06-17 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9604: --- Summary: Support KafkaProtoBufTableSource Key: FLINK-9604 URL: https://issues.apache.org/jira/browse/FLINK-9604 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-9411) Support parquet rolling sink writer

2018-05-22 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9411: --- Summary: Support parquet rolling sink writer Key: FLINK-9411 URL: https://issues.apache.org/jira/browse/FLINK-9411 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-9407) Support orc rolling sink writer

2018-05-22 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9407: --- Summary: Support orc rolling sink writer Key: FLINK-9407 URL: https://issues.apache.org/jira/browse/FLINK-9407 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-9230) WebFrontendITCase.testStopYarn is unstable

2018-04-20 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9230: --- Summary: WebFrontendITCase.testStopYarn is unstable Key: FLINK-9230 URL: https://issues.apache.org/jira/browse/FLINK-9230 Project: Flink Issue Type

[jira] [Created] (FLINK-9227) Add Bucketing e2e test script to run-nightly-tests.sh

2018-04-20 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9227: --- Summary: Add Bucketing e2e test script to run-nightly-tests.sh Key: FLINK-9227 URL: https://issues.apache.org/jira/browse/FLINK-9227 Project: Flink Issue Type

[jira] [Created] (FLINK-9226) Add Bucketing e2e test script to run-nightly-tests.sh

2018-04-20 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9226: --- Summary: Add Bucketing e2e test script to run-nightly-tests.sh Key: FLINK-9226 URL: https://issues.apache.org/jira/browse/FLINK-9226 Project: Flink Issue Type

[jira] [Created] (FLINK-9224) Add Bucketing e2e test script to run-pre-commit-tests.sh

2018-04-19 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9224: --- Summary: Add Bucketing e2e test script to run-pre-commit-tests.sh Key: FLINK-9224 URL: https://issues.apache.org/jira/browse/FLINK-9224 Project: Flink Issue

[jira] [Created] (FLINK-9092) End to end test for elasticsearch2.x

2018-03-26 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9092: --- Summary: End to end test for elasticsearch2.x Key: FLINK-9092 URL: https://issues.apache.org/jira/browse/FLINK-9092 Project: Flink Issue Type: Task

Re:[DISCUSS] Inverted (child-first) class loading

2018-03-09 Thread mingleizhang
Hi, Stephan It is a great change, keep it and polish it. nice nice nice I think the more fewer NoClassDefFoundError or ClassNotFoundException the user will encounter in the future. But I would like to two question about this functionality. If Im am wrong, please helps me out. Thank you in adv

Re:Re: Re: Change build-target to a specific folder

2018-03-09 Thread mingleizhang
re precisely) > >If will not work on Windows, through. Are you running Windows? > >On Fri, Mar 9, 2018 at 11:34 AM, mingleizhang >wrote: > >> Yes. It is. and I might do a little change for this. >> >> >> >> >> >> >> At 2018-03-09 17:35:

[jira] [Created] (FLINK-8907) Unable to start the process by start-cluster.sh

2018-03-09 Thread mingleizhang (JIRA)
mingleizhang created FLINK-8907: --- Summary: Unable to start the process by start-cluster.sh Key: FLINK-8907 URL: https://issues.apache.org/jira/browse/FLINK-8907 Project: Flink Issue Type: Bug

Re:Re: Error : Temporary failure in name resolutionost

2018-03-09 Thread mingleizhang
st, >Aljoscha > >> On 9. Mar 2018, at 09:49, mingleizhang wrote: >> >> Hi, >> >> >> I build a flink based on the new code from master branch. And I get the >> flink binary of flink-1.6-SNAPSHOT. When I run ./start-cluster.sh by the >

Re:Re: Change build-target to a specific folder

2018-03-09 Thread mingleizhang
Yes. It is. and I might do a little change for this. At 2018-03-09 17:35:42, "Aljoscha Krettek" wrote: >Is this from the "building Flink" quickstart? I don't mind too much but you >can open a PR if you want to change that. > >> On 9. Mar 2018,

Error : Temporary failure in name resolutionost

2018-03-09 Thread mingleizhang
Hi, I build a flink based on the new code from master branch. And I get the flink binary of flink-1.6-SNAPSHOT. When I run ./start-cluster.sh by the default flink-conf.yaml. I can not start the process and get the error below: [root@ricezhang-pjhzf bin]# ./start-cluster.sh Starting cluster.

Change build-target to a specific folder

2018-03-08 Thread mingleizhang
Hi, Anyway, the line of cd build-target below confused me for a while at the first time since there is not a folder called build-target. So I would suggest change this stuff to a more reasonable representation for the beginner to flink. What do you think of that ? Like cd flink-dist/target

Re:Re: Incorrect Rest URL

2018-03-08 Thread mingleizhang
hot >version. >While I tested the feature, I discovered another bug in 1.5, though [2]. > >Best, >Gary > >[1] https://issues.apache.org/jira/browse/FLINK-7806 >[2] https://issues.apache.org/jira/browse/FLINK-8894 > > >On Wed, Mar 7, 2018 at 4:18 AM, mingleizhang wrote

Re:Re: Incorrect Rest URL

2018-03-08 Thread mingleizhang
pache.org/jira/browse/FLINK-7806 >[2] https://issues.apache.org/jira/browse/FLINK-8894 > > >On Wed, Mar 7, 2018 at 4:18 AM, mingleizhang wrote: > >> >> >> I expect it response me like the following as the doc say. But does not. >> >> >> >

Re:Incorrect Rest URL

2018-03-06 Thread mingleizhang
"running": 0, "finished": 6, "canceling": 0, "canceled": 0, "failed": 0 } }, { "jid": "49306f94d0920216b636e8dd503a6409", "name": "Flink Java Job at Wed

Incorrect Rest URL

2018-03-06 Thread mingleizhang
I am not sure about whether it is a incorrect rest url, but i think it is. https://ci.apache.org/projects/flink/flink-docs-master/monitoring/rest_api.html Overview of Jobs /jobs/overview And I access the url with : http://10.201.202.217:9081//jobs/overview It gives me : java.lang.RuntimeExc

HAQueryableStateRocksDBBackendITCase test cause outofmemoryerror and never stop

2018-02-21 Thread mingleizhang
Hi, I run HAQueryableStateRocksDBBackendITCase#testValueStateDefault test class on my local machine. And it hangs always and in the end gives me a outofmemory error. Cheers Minglei.

Re:Re: Confused about method naming in heartbeatFromJobManager or heartbeatFromResourceManager

2018-02-08 Thread mingleizhang
#x27;s why they are called >heartbeatFrom. The TaskExecutor is only responding to heartbeat requests >but not actively sending them out. > >Cheers, >Till > >On Thu, Feb 8, 2018 at 1:06 PM, mingleizhang wrote: > >> Attached is the taskmanager design picture. And fr

Confused about method naming in heartbeatFromJobManager or heartbeatFromResourceManager

2018-02-08 Thread mingleizhang
Attached is the taskmanager design picture. And from the picturen, I know taskmanager send heartbeat to jobmanager ( also called jobmaster in flip6 now) and resourcesmanager periodically. But when I watched the source code below in TaskExecutor.java. I feel confused about the function name. Shou

Why does jobmanager running needs slot ?

2018-02-04 Thread mingleizhang
I find some codes in flink does not make sense to me. Like in some classes below: JobMasterGateway.java has a offerSlots method which means Offers the given slots to the job manager. I was wondering why a jobmanager running should need slots ? TaskExecutor.java has a offerSlotsToJobManager met

[jira] [Created] (FLINK-8276) Annotation for Kafka connector

2017-12-18 Thread mingleizhang (JIRA)
mingleizhang created FLINK-8276: --- Summary: Annotation for Kafka connector Key: FLINK-8276 URL: https://issues.apache.org/jira/browse/FLINK-8276 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-8199) Annotation for Elasticsearch connector

2017-12-04 Thread mingleizhang (JIRA)
mingleizhang created FLINK-8199: --- Summary: Annotation for Elasticsearch connector Key: FLINK-8199 URL: https://issues.apache.org/jira/browse/FLINK-8199 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-7573) Introduce Http protocol connector for Elasticsearch2

2017-09-04 Thread mingleizhang (JIRA)
mingleizhang created FLINK-7573: --- Summary: Introduce Http protocol connector for Elasticsearch2 Key: FLINK-7573 URL: https://issues.apache.org/jira/browse/FLINK-7573 Project: Flink Issue Type

[jira] [Created] (FLINK-7302) Failed to run CorrelateITCase class under windows environment

2017-07-31 Thread mingleizhang (JIRA)
mingleizhang created FLINK-7302: --- Summary: Failed to run CorrelateITCase class under windows environment Key: FLINK-7302 URL: https://issues.apache.org/jira/browse/FLINK-7302 Project: Flink

[jira] [Created] (FLINK-7162) Tests should not write outside 'target' directory.

2017-07-12 Thread mingleizhang (JIRA)
mingleizhang created FLINK-7162: --- Summary: Tests should not write outside 'target' directory. Key: FLINK-7162 URL: https://issues.apache.org/jira/browse/FLINK-7162 Project: Flink

[jira] [Created] (FLINK-7139) Refine currentTimeMillis to nanoTime

2017-07-08 Thread mingleizhang (JIRA)
mingleizhang created FLINK-7139: --- Summary: Refine currentTimeMillis to nanoTime Key: FLINK-7139 URL: https://issues.apache.org/jira/browse/FLINK-7139 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-7134) Remove hadoop1.x code in mapreduce.utils.HadoopUtils

2017-07-07 Thread mingleizhang (JIRA)
mingleizhang created FLINK-7134: --- Summary: Remove hadoop1.x code in mapreduce.utils.HadoopUtils Key: FLINK-7134 URL: https://issues.apache.org/jira/browse/FLINK-7134 Project: Flink Issue Type

[jira] [Created] (FLINK-7121) Remove the hardcoded way in core

2017-07-06 Thread mingleizhang (JIRA)
mingleizhang created FLINK-7121: --- Summary: Remove the hardcoded way in core Key: FLINK-7121 URL: https://issues.apache.org/jira/browse/FLINK-7121 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-7120) Remove the hardcoded way in Utils

2017-07-06 Thread mingleizhang (JIRA)
mingleizhang created FLINK-7120: --- Summary: Remove the hardcoded way in Utils Key: FLINK-7120 URL: https://issues.apache.org/jira/browse/FLINK-7120 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-7119) Remove the hardcoded way in HadoopUtils

2017-07-06 Thread mingleizhang (JIRA)
mingleizhang created FLINK-7119: --- Summary: Remove the hardcoded way in HadoopUtils Key: FLINK-7119 URL: https://issues.apache.org/jira/browse/FLINK-7119 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-7118) Remove hadoop1.x code in HadoopUtils

2017-07-06 Thread mingleizhang (JIRA)
mingleizhang created FLINK-7118: --- Summary: Remove hadoop1.x code in HadoopUtils Key: FLINK-7118 URL: https://issues.apache.org/jira/browse/FLINK-7118 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-7114) Remove the hardcoded way in flink

2017-07-06 Thread mingleizhang (JIRA)
mingleizhang created FLINK-7114: --- Summary: Remove the hardcoded way in flink Key: FLINK-7114 URL: https://issues.apache.org/jira/browse/FLINK-7114 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-7104) AccessDeniedException get when FileUtilsTest#testDeleteDirectoryConcurrently call

2017-07-04 Thread mingleizhang (JIRA)
mingleizhang created FLINK-7104: --- Summary: AccessDeniedException get when FileUtilsTest#testDeleteDirectoryConcurrently call Key: FLINK-7104 URL: https://issues.apache.org/jira/browse/FLINK-7104

[jira] [Created] (FLINK-7094) Update outdated doc release 1.2 to latest stable release 1.3

2017-07-04 Thread mingleizhang (JIRA)
mingleizhang created FLINK-7094: --- Summary: Update outdated doc release 1.2 to latest stable release 1.3 Key: FLINK-7094 URL: https://issues.apache.org/jira/browse/FLINK-7094 Project: Flink

[jira] [Created] (FLINK-6991) Inaccessible link under Gelly document

2017-06-22 Thread mingleizhang (JIRA)
mingleizhang created FLINK-6991: --- Summary: Inaccessible link under Gelly document Key: FLINK-6991 URL: https://issues.apache.org/jira/browse/FLINK-6991 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6934) Consider moving LRUCache class

2017-06-15 Thread mingleizhang (JIRA)
mingleizhang created FLINK-6934: --- Summary: Consider moving LRUCache class Key: FLINK-6934 URL: https://issues.apache.org/jira/browse/FLINK-6934 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-6932) Update the inaccessible Dataflow Model paper link

2017-06-15 Thread mingleizhang (JIRA)
mingleizhang created FLINK-6932: --- Summary: Update the inaccessible Dataflow Model paper link Key: FLINK-6932 URL: https://issues.apache.org/jira/browse/FLINK-6932 Project: Flink Issue Type

[jira] [Created] (FLINK-6381) Unnecessary synchronizing object in BucketingSink

2017-04-25 Thread mingleizhang (JIRA)
mingleizhang created FLINK-6381: --- Summary: Unnecessary synchronizing object in BucketingSink Key: FLINK-6381 URL: https://issues.apache.org/jira/browse/FLINK-6381 Project: Flink Issue Type

[jira] [Created] (FLINK-6351) Refactoring YarnFlinkApplicationMasterRunner by combining AbstractYarnFlinkApplicationMasterRunner in one class

2017-04-20 Thread mingleizhang (JIRA)
mingleizhang created FLINK-6351: --- Summary: Refactoring YarnFlinkApplicationMasterRunner by combining AbstractYarnFlinkApplicationMasterRunner in one class Key: FLINK-6351 URL: https://issues.apache.org/jira/browse

[jira] [Created] (FLINK-6313) Some words was spelled wrong and incorrect LOG.error without print

2017-04-17 Thread mingleizhang (JIRA)
mingleizhang created FLINK-6313: --- Summary: Some words was spelled wrong and incorrect LOG.error without print Key: FLINK-6313 URL: https://issues.apache.org/jira/browse/FLINK-6313 Project: Flink