• Home
  • Categories
  • WIKI
  • LANGUAGE: en
    • flink的example程序无法运行
    Experiences and Insight 2008 views · 3 replies ·
    Tofloor
    poster avatar
    naple
    deepin
    2018-12-15 09:15
    Author
    1. ./bin/flink run examples/streaming/SocketWindowWordCount.jar --port 9000
    Copy the Code
    flink官方的example程序，运行后如下，看原因是java.net.ConnectException: 拒绝连接 (Connection refused)
    1. root@maple-PC:/home/maple/Downloads/flink-1.4.2# ./bin/flink run examples/streaming/SocketWindowWordCount.jar --port 9000
    2. Cluster configuration: Standalone cluster with JobManager at localhost/127.0.0.1:6123
    3. Using address localhost:6123 to connect to JobManager.
    4. JobManager web interface address http://localhost:8081
    5. Starting execution of program
    6. Submitting job with JobID: b371f7847302f8930115f093c7e32d3d. Waiting for job completion.
    7. Connected to JobManager at Actor[akka.tcp://flink@localhost:6123/user/jobmanager#-198847679] with leader session id 00000000-0000-0000-0000-000000000000.
    8. 12/15/2018 01:06:20        Job execution switched to status RUNNING.
    9. 12/15/2018 01:06:20        Source: Socket Stream -> Flat Map(1/1) switched to SCHEDULED
    10. 12/15/2018 01:06:20        TriggerWindow(TumblingProcessingTimeWindows(5000), ReducingStateDescriptor{serializer=org.apache.flink.api.java.typeutils.runtime.PojoSerializer@9cfdeb73, reduceFunction=org.apache.flink.streaming.examples.socket.SocketWindowWordCount$1@71687585}, ProcessingTimeTrigger(), WindowedStream.reduce(WindowedStream.java:241)) -> Sink: Unnamed(1/1) switched to SCHEDULED
    11. 12/15/2018 01:06:20        Source: Socket Stream -> Flat Map(1/1) switched to DEPLOYING
    12. 12/15/2018 01:06:20        TriggerWindow(TumblingProcessingTimeWindows(5000), ReducingStateDescriptor{serializer=org.apache.flink.api.java.typeutils.runtime.PojoSerializer@9cfdeb73, reduceFunction=org.apache.flink.streaming.examples.socket.SocketWindowWordCount$1@71687585}, ProcessingTimeTrigger(), WindowedStream.reduce(WindowedStream.java:241)) -> Sink: Unnamed(1/1) switched to DEPLOYING
    13. 12/15/2018 01:06:21        TriggerWindow(TumblingProcessingTimeWindows(5000), ReducingStateDescriptor{serializer=org.apache.flink.api.java.typeutils.runtime.PojoSerializer@9cfdeb73, reduceFunction=org.apache.flink.streaming.examples.socket.SocketWindowWordCount$1@71687585}, ProcessingTimeTrigger(), WindowedStream.reduce(WindowedStream.java:241)) -> Sink: Unnamed(1/1) switched to RUNNING
    14. 12/15/2018 01:06:21        Source: Socket Stream -> Flat Map(1/1) switched to RUNNING
    15. 12/15/2018 01:06:21        Source: Socket Stream -> Flat Map(1/1) switched to FAILED
    16. java.net.ConnectException: 拒绝连接 (Connection refused)
    17.         at java.net.PlainSocketImpl.socketConnect(Native Method)
    18.         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
    19.         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
    20.         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
    21.         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
    22.         at java.net.Socket.connect(Socket.java:589)
    23.         at org.apache.flink.streaming.api.functions.source.SocketTextStreamFunction.run(SocketTextStreamFunction.java:96)
    24.         at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:86)
    25.         at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:55)
    26.         at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:94)
    27.         at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:264)
    28.         at org.apache.flink.runtime.taskmanager.Task.run(Task.java:718)
    29.         at java.lang.Thread.run(Thread.java:748)

    31. 12/15/2018 01:06:21        Job execution switched to status FAILING.
    32. java.net.ConnectException: 拒绝连接 (Connection refused)
    33.         at java.net.PlainSocketImpl.socketConnect(Native Method)
    34.         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
    35.         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
    36.         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
    37.         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
    38.         at java.net.Socket.connect(Socket.java:589)
    39.         at org.apache.flink.streaming.api.functions.source.SocketTextStreamFunction.run(SocketTextStreamFunction.java:96)
    40.         at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:86)
    41.         at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:55)
    42.         at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:94)
    43.         at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:264)
    44.         at org.apache.flink.runtime.taskmanager.Task.run(Task.java:718)
    45.         at java.lang.Thread.run(Thread.java:748)
    46. 12/15/2018 01:06:21        TriggerWindow(TumblingProcessingTimeWindows(5000), ReducingStateDescriptor{serializer=org.apache.flink.api.java.typeutils.runtime.PojoSerializer@9cfdeb73, reduceFunction=org.apache.flink.streaming.examples.socket.SocketWindowWordCount$1@71687585}, ProcessingTimeTrigger(), WindowedStream.reduce(WindowedStream.java:241)) -> Sink: Unnamed(1/1) switched to CANCELING
    47. 12/15/2018 01:06:21        TriggerWindow(TumblingProcessingTimeWindows(5000), ReducingStateDescriptor{serializer=org.apache.flink.api.java.typeutils.runtime.PojoSerializer@9cfdeb73, reduceFunction=org.apache.flink.streaming.examples.socket.SocketWindowWordCount$1@71687585}, ProcessingTimeTrigger(), WindowedStream.reduce(WindowedStream.java:241)) -> Sink: Unnamed(1/1) switched to CANCELED

    49. ------------------------------------------------------------
    50. The program finished with the following exception:

    52. org.apache.flink.client.program.ProgramInvocationException: The program execution failed: Job execution failed.
    53.         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:492)
    54.         at org.apache.flink.client.program.StandaloneClusterClient.submitJob(StandaloneClusterClient.java:105)
    55.         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:456)
    56.         at org.apache.flink.streaming.api.environment.StreamContextEnvironment.execute(StreamContextEnvironment.java:66)
    57.         at org.apache.flink.streaming.examples.socket.SocketWindowWordCount.main(SocketWindowWordCount.java:92)
    58.         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    59.         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    60.         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    61.         at java.lang.reflect.Method.invoke(Method.java:498)
    62.         at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:525)
    63.         at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:417)
    64.         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:396)
    65.         at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:802)
    66.         at org.apache.flink.client.CliFrontend.run(CliFrontend.java:282)
    67.         at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1054)
    68.         at org.apache.flink.client.CliFrontend$1.call(CliFrontend.java:1101)
    69.         at org.apache.flink.client.CliFrontend$1.call(CliFrontend.java:1098)
    70.         at java.security.AccessController.doPrivileged(Native Method)
    71.         at javax.security.auth.Subject.doAs(Subject.java:422)
    72.         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1807)
    73.         at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
    74.         at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1098)
    75. Caused by: org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
    76.         at org.apache.flink.runtime.jobmanager.JobManager$anonfun$handleMessage$1$anonfun$applyOrElse$6.apply$mcV$sp(JobManager.scala:897)
    77.         at org.apache.flink.runtime.jobmanager.JobManager$anonfun$handleMessage$1$anonfun$applyOrElse$6.apply(JobManager.scala:840)
    78.         at org.apache.flink.runtime.jobmanager.JobManager$anonfun$handleMessage$1$anonfun$applyOrElse$6.apply(JobManager.scala:840)
    79.         at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
    80.         at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
    81.         at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
    82.         at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
    83.         at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
    84.         at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
    85.         at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
    86.         at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
    87. Caused by: java.net.ConnectException: 拒绝连接 (Connection refused)
    88.         at java.net.PlainSocketImpl.socketConnect(Native Method)
    89.         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
    90.         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
    91.         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
    92.         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
    93.         at java.net.Socket.connect(Socket.java:589)
    94.         at org.apache.flink.streaming.api.functions.source.SocketTextStreamFunction.run(SocketTextStreamFunction.java:96)
    95.         at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:86)
    96.         at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:55)
    97.         at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:94)
    98.         at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:264)
    99.         at org.apache.flink.runtime.taskmanager.Task.run(Task.java:718)
    100.         at java.lang.Thread.run(Thread.java:748)
    Copy the Code
    有juju解释一下码
    Reply Favorite View the author
    All Replies
    avatar
    naple
    deepin
    2018-12-15 09:20
    #1
    lsof查看端口未被占用
    Reply View the author
    avatar
    naple
    deepin
    2018-12-16 01:39
    #2
    已解决，nc加入-p选项即可。。。。
    Reply View the author
    avatar
    shandianlala
    deepin
    2019-12-06 08:01
    #3
    you can fix it just use this command replace the original command  
    nc -l -p 9000.
    Reply View the author