Hi, I apologize that I forgot the attachments in my last post. I'll repost my question with attachments this time:
*I have successfully run the project "table-walkthrough" on IDEA (w/t errors but warnings)*, *I'm now trying to build this project by using the "docker-compose" command* as the tutorial does. However, when I run the "docker-compose build" command in the directory of project "table-walkthrough", *it returns me the following error messages:* [AkatsukiG5@localhost table-walkthrough]$ docker-compose build Traceback (most recent call last): File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 670, in urlopen httplib_response = self._make_request( File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 392, in _make_request conn.request(method, url, **httplib_request_kw) File "/usr/lib64/python3.9/http/client.py", line 1253, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib64/python3.9/http/client.py", line 1299, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib64/python3.9/http/client.py", line 1248, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib64/python3.9/http/client.py", line 1008, in _send_output self.send(msg) File "/usr/lib64/python3.9/http/client.py", line 948, in send self.connect() File "/usr/lib/python3.9/site-packages/docker/transport/unixconn.py", line 43, in connect sock.connect(self.unix_socket) FileNotFoundError: [Errno 2] No such file or directory During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.9/site-packages/requests/adapters.py", line 439, in send resp = conn.urlopen( File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 726, in urlopen retries = retries.increment( File "/usr/lib/python3.9/site-packages/urllib3/util/retry.py", line 403, in increment raise six.reraise(type(error), error, _stacktrace) File "/usr/lib/python3.9/site-packages/urllib3/packages/six.py", line 708, in reraise raise value.with_traceback(tb) File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 670, in urlopen httplib_response = self._make_request( File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 392, in _make_request conn.request(method, url, **httplib_request_kw) File "/usr/lib64/python3.9/http/client.py", line 1253, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib64/python3.9/http/client.py", line 1299, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib64/python3.9/http/client.py", line 1248, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib64/python3.9/http/client.py", line 1008, in _send_output self.send(msg) File "/usr/lib64/python3.9/http/client.py", line 948, in send self.connect() File "/usr/lib/python3.9/site-packages/docker/transport/unixconn.py", line 43, in connect sock.connect(self.unix_socket) urllib3.exceptions.ProtocolError: ('Connection aborted.', FileNotFoundError(2, 'No such file or directory')) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.9/site-packages/docker/api/client.py", line 214, in _retrieve_server_version return self.version(api_version=False)["ApiVersion"] File "/usr/lib/python3.9/site-packages/docker/api/daemon.py", line 181, in version return self._result(self._get(url), json=True) File "/usr/lib/python3.9/site-packages/docker/utils/decorators.py", line 46, in inner return f(self, *args, **kwargs) File "/usr/lib/python3.9/site-packages/docker/api/client.py", line 237, in _get return self.get(url, **self._set_request_timeout(kwargs)) File "/usr/lib/python3.9/site-packages/requests/sessions.py", line 555, in get return self.request('GET', url, **kwargs) File "/usr/lib/python3.9/site-packages/requests/sessions.py", line 542, in request resp = self.send(prep, **send_kwargs) File "/usr/lib/python3.9/site-packages/requests/sessions.py", line 655, in send r = adapter.send(request, **kwargs) File "/usr/lib/python3.9/site-packages/requests/adapters.py", line 498, in send raise ConnectionError(err, request=request) requests.exceptions.ConnectionError: ('Connection aborted.', FileNotFoundError(2, 'No such file or directory')) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/bin/docker-compose", line 33, in <module> sys.exit(load_entry_point('docker-compose==1.28.6', 'console_scripts', 'docker-compose')()) File "/usr/lib/python3.9/site-packages/compose/cli/main.py", line 81, in main command_func() File "/usr/lib/python3.9/site-packages/compose/cli/main.py", line 198, in perform_command project = project_from_options('.', options) File "/usr/lib/python3.9/site-packages/compose/cli/command.py", line 60, in project_from_options return get_project( File "/usr/lib/python3.9/site-packages/compose/cli/command.py", line 152, in get_project client = get_client( File "/usr/lib/python3.9/site-packages/compose/cli/docker_client.py", line 41, in get_client client = docker_client( File "/usr/lib/python3.9/site-packages/compose/cli/docker_client.py", line 170, in docker_client client = APIClient(use_ssh_client=not use_paramiko_ssh, **kwargs) File "/usr/lib/python3.9/site-packages/docker/api/client.py", line 197, in __init__ self._version = self._retrieve_server_version() File "/usr/lib/python3.9/site-packages/docker/api/client.py", line 221, in _retrieve_server_version raise DockerException( docker.errors.DockerException: Error while fetching server API version: ('Connection aborted.', FileNotFoundError(2, 'No such file or directory')) *My host environment info shows below:* 1. OS: Fedora 34; 2. Flink ver: 1.13.1; 3. Java ver: 1.8; 4. Maven ver: 3.6.3; 5. Docker ver: 20.10.7; 6. Python ver: 3.9.5; 7. Scala ver: 2.11. I'll attach the modified pom.xml and original docker-compose.yml within this mail. If anyone could help me with this issue, I'll appreciate it :) Best regards, On Fri, Jun 11, 2021 at 8:44 AM Lingfeng Pu <p...@mtu.edu> wrote: > Hi, > > *I have successfully run the project "table-walkthrough" on IDEA (w/t > errors but warnings)*, *I'm now trying to build this project by using the > "docker-compose" command* as the tutorial does. However, when I run the > "docker-compose build" command in the directory of project > "table-walkthrough", *it returns me the following error messages:* > > [AkatsukiG5@localhost table-walkthrough]$ docker-compose build > Traceback (most recent call last): > File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line > 670, in urlopen > httplib_response = self._make_request( > File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line > 392, in _make_request > conn.request(method, url, **httplib_request_kw) > File "/usr/lib64/python3.9/http/client.py", line 1253, in request > self._send_request(method, url, body, headers, encode_chunked) > File "/usr/lib64/python3.9/http/client.py", line 1299, in _send_request > self.endheaders(body, encode_chunked=encode_chunked) > File "/usr/lib64/python3.9/http/client.py", line 1248, in endheaders > self._send_output(message_body, encode_chunked=encode_chunked) > File "/usr/lib64/python3.9/http/client.py", line 1008, in _send_output > self.send(msg) > File "/usr/lib64/python3.9/http/client.py", line 948, in send > self.connect() > File "/usr/lib/python3.9/site-packages/docker/transport/unixconn.py", > line 43, in connect > sock.connect(self.unix_socket) > FileNotFoundError: [Errno 2] No such file or directory > > During handling of the above exception, another exception occurred: > > Traceback (most recent call last): > File "/usr/lib/python3.9/site-packages/requests/adapters.py", line 439, > in send > resp = conn.urlopen( > File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line > 726, in urlopen > retries = retries.increment( > File "/usr/lib/python3.9/site-packages/urllib3/util/retry.py", line 403, > in increment > raise six.reraise(type(error), error, _stacktrace) > File "/usr/lib/python3.9/site-packages/urllib3/packages/six.py", line > 708, in reraise > raise value.with_traceback(tb) > File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line > 670, in urlopen > httplib_response = self._make_request( > File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line > 392, in _make_request > conn.request(method, url, **httplib_request_kw) > File "/usr/lib64/python3.9/http/client.py", line 1253, in request > self._send_request(method, url, body, headers, encode_chunked) > File "/usr/lib64/python3.9/http/client.py", line 1299, in _send_request > self.endheaders(body, encode_chunked=encode_chunked) > File "/usr/lib64/python3.9/http/client.py", line 1248, in endheaders > self._send_output(message_body, encode_chunked=encode_chunked) > File "/usr/lib64/python3.9/http/client.py", line 1008, in _send_output > self.send(msg) > File "/usr/lib64/python3.9/http/client.py", line 948, in send > self.connect() > File "/usr/lib/python3.9/site-packages/docker/transport/unixconn.py", > line 43, in connect > sock.connect(self.unix_socket) > urllib3.exceptions.ProtocolError: ('Connection aborted.', > FileNotFoundError(2, 'No such file or directory')) > > During handling of the above exception, another exception occurred: > > Traceback (most recent call last): > File "/usr/lib/python3.9/site-packages/docker/api/client.py", line 214, > in _retrieve_server_version > return self.version(api_version=False)["ApiVersion"] > File "/usr/lib/python3.9/site-packages/docker/api/daemon.py", line 181, > in version > return self._result(self._get(url), json=True) > File "/usr/lib/python3.9/site-packages/docker/utils/decorators.py", line > 46, in inner > return f(self, *args, **kwargs) > File "/usr/lib/python3.9/site-packages/docker/api/client.py", line 237, > in _get > return self.get(url, **self._set_request_timeout(kwargs)) > File "/usr/lib/python3.9/site-packages/requests/sessions.py", line 555, > in get > return self.request('GET', url, **kwargs) > File "/usr/lib/python3.9/site-packages/requests/sessions.py", line 542, > in request > resp = self.send(prep, **send_kwargs) > File "/usr/lib/python3.9/site-packages/requests/sessions.py", line 655, > in send > r = adapter.send(request, **kwargs) > File "/usr/lib/python3.9/site-packages/requests/adapters.py", line 498, > in send > raise ConnectionError(err, request=request) > requests.exceptions.ConnectionError: ('Connection aborted.', > FileNotFoundError(2, 'No such file or directory')) > > During handling of the above exception, another exception occurred: > > Traceback (most recent call last): > File "/usr/bin/docker-compose", line 33, in <module> > sys.exit(load_entry_point('docker-compose==1.28.6', 'console_scripts', > 'docker-compose')()) > File "/usr/lib/python3.9/site-packages/compose/cli/main.py", line 81, in > main > command_func() > File "/usr/lib/python3.9/site-packages/compose/cli/main.py", line 198, > in perform_command > project = project_from_options('.', options) > File "/usr/lib/python3.9/site-packages/compose/cli/command.py", line 60, > in project_from_options > return get_project( > File "/usr/lib/python3.9/site-packages/compose/cli/command.py", line > 152, in get_project > client = get_client( > File "/usr/lib/python3.9/site-packages/compose/cli/docker_client.py", > line 41, in get_client > client = docker_client( > File "/usr/lib/python3.9/site-packages/compose/cli/docker_client.py", > line 170, in docker_client > client = APIClient(use_ssh_client=not use_paramiko_ssh, **kwargs) > File "/usr/lib/python3.9/site-packages/docker/api/client.py", line 197, > in __init__ > self._version = self._retrieve_server_version() > File "/usr/lib/python3.9/site-packages/docker/api/client.py", line 221, > in _retrieve_server_version > raise DockerException( > docker.errors.DockerException: Error while fetching server API version: > ('Connection aborted.', FileNotFoundError(2, 'No such file or directory')) > *My host environment info shows below:* > 1. OS: Fedora 34; 2. Flink ver: 1.13.1; 3. Java ver: 1.8; > 4. Maven ver: 3.6.3; 5. Docker ver: 20.10.7; 6. Python ver: 3.9.5; > 7. Scala ver: 2.11. > > I'll attach the modified pom.xml and original docker-compose.yml within > this mail. If anyone could help me with this issue, I'll appreciate it :) > > Best regards, >
<!-- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelVersion>4.0.0</modelVersion> <groupId>org.apache.flink</groupId> <artifactId>spend-report</artifactId> <version>1.0.0</version> <packaging>jar</packaging> <name>Flink Walkthrough Table Java</name> <url>https://flink.apache.org</url> <properties> <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding> <flink.version>1.12.1</flink.version> <java.version>1.8</java.version> <scala.binary.version>2.11</scala.binary.version> <maven.compiler.source>${java.version}</maven.compiler.source> <maven.compiler.target>${java.version}</maven.compiler.target> </properties> <repositories> <repository> <id>apache.snapshots</id> <name>Apache Development Snapshot Repository</name> <url>https://repository.apache.org/content/repositories/snapshots/</url> <releases> <enabled>false</enabled> </releases> <snapshots> <enabled>true</enabled> </snapshots> </repository> </repositories> <dependencies> <!-- These dependencies are provided, because they should not be packaged into the JAR file. --> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-table-api-java</artifactId> <version>${flink.version}</version> <scope>provided</scope> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-table-api-java-bridge_${scala.binary.version}</artifactId> <version>${flink.version}</version> <scope>provided</scope> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-scala_${scala.binary.version}</artifactId> <version>${flink.version}</version> <scope>test</scope> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-table-planner-blink_${scala.binary.version}</artifactId> <version>${flink.version}</version> <scope>test</scope> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_${scala.binary.version}</artifactId> <version>${flink.version}</version> <scope>test</scope> </dependency> <dependency> <groupId>junit</groupId> <artifactId>junit</artifactId> <version>4.12</version> <scope>test</scope> </dependency> <dependency> <groupId>org.hamcrest</groupId> <artifactId>hamcrest-all</artifactId> <version>1.3</version> <scope>test</scope> </dependency> <!-- Add logging framework, to produce console output when running in the IDE. --> <!-- These dependencies are excluded from the application JAR by default. --> <dependency> <groupId>org.slf4j</groupId> <artifactId>slf4j-log4j12</artifactId> <version>1.7.7</version> <scope>runtime</scope> </dependency> <dependency> <groupId>log4j</groupId> <artifactId>log4j</artifactId> <version>1.2.17</version> <scope>runtime</scope> </dependency> <!-- Add additional dependencies to see if the factory error resolved --> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-csv</artifactId> <version>${flink.version}</version> <scope>test</scope> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-connector-jdbc_2.11</artifactId> <version>${flink.version}</version> <scope>test</scope> </dependency> <!-- Additional dependencies ends here --> <!-- Add additional test dependencies to see if the connector error resolved --> <!--<dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-sql-connector-hive-3.1.2_2.11</artifactId> <version>1.14-SNAPSHOT</version> <scope>runtime</scope>--> <!--</dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-parquet_2.11</artifactId> <version>1.14-SNAPSHOT</version> <scope>runtime</scope>--> <!--</dependency>--> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-sql-connector-kafka_${scala.binary.version}</artifactId> <version>${flink.version}</version> <scope>test</scope> </dependency> <!-- Additional dependencies ends here --> </dependencies> <build> <plugins> <!-- Java Compiler --> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-compiler-plugin</artifactId> <version>3.1</version> <configuration> <source>${java.version}</source> <target>${java.version}</target> </configuration> </plugin> <!-- We use the maven-shade plugin to create a fat jar that contains all necessary dependencies. --> <!-- Change the value of <mainClass>...</mainClass> if your program entry point changes. --> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-shade-plugin</artifactId> <version>3.0.0</version> <executions> <!-- Run shade goal on package phase --> <execution> <phase>package</phase> <goals> <goal>shade</goal> </goals> <configuration> <artifactSet> <excludes> <exclude>org.apache.flink:force-shading</exclude> <exclude>com.google.code.findbugs:jsr305</exclude> <exclude>org.slf4j:*</exclude> <exclude>log4j:*</exclude> </excludes> </artifactSet> <filters> <filter> <!-- Do not copy the signatures in the META-INF folder. Otherwise, this might cause SecurityExceptions when using the JAR. --> <artifact>*:*</artifact> <excludes> <exclude>META-INF/*.SF</exclude> <exclude>META-INF/*.DSA</exclude> <exclude>META-INF/*.RSA</exclude> </excludes> </filter> </filters> <transformers> <transformer implementation="org.apache.maven.plugins.shade.resource.ManifestResourceTransformer"> <mainClass>org.apache.flink.playgrounds.spendreport.SpendReport</mainClass> </transformer> </transformers> </configuration> </execution> </executions> </plugin> </plugins> <pluginManagement> <plugins> <!-- This improves the out-of-the-box experience in Eclipse by resolving some warnings. --> <plugin> <groupId>org.eclipse.m2e</groupId> <artifactId>lifecycle-mapping</artifactId> <version>1.0.0</version> <configuration> <lifecycleMappingMetadata> <pluginExecutions> <pluginExecution> <pluginExecutionFilter> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-shade-plugin</artifactId> <versionRange>[3.0.0,)</versionRange> <goals> <goal>shade</goal> </goals> </pluginExecutionFilter> <action> <ignore/> </action> </pluginExecution> <pluginExecution> <pluginExecutionFilter> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-compiler-plugin</artifactId> <versionRange>[3.1,)</versionRange> <goals> <goal>testCompile</goal> <goal>compile</goal> </goals> </pluginExecutionFilter> <action> <ignore/> </action> </pluginExecution> </pluginExecutions> </lifecycleMappingMetadata> </configuration> </plugin> <plugin> <groupId>org.apache.rat</groupId> <artifactId>apache-rat-plugin</artifactId> <version>0.13</version> <inherited>false</inherited> <executions> <execution> <phase>verify</phase> <goals> <goal>check</goal> </goals> </execution> </executions> <configuration> <excludes> <!-- Additional files like .gitignore etc.--> <exclude>**/.*/**</exclude> <exclude>**/*.prefs</exclude> <exclude>**/*.log</exclude> <!-- Administrative files in the main trunk. --> <exclude>**/README.md</exclude> <exclude>**/CODE_OF_CONDUCT.md</exclude> <exclude>.github/**</exclude> <!-- IDE files. --> <exclude>**/*.iml</exclude> <!-- Generated content --> <exclude>**/target/**</exclude> <exclude>**/dependency-reduced-pom.xml</exclude> </excludes> </configuration> </plugin> </plugins> </pluginManagement> </build> </project>
docker-compose.yml
Description: application/yaml