[ https://issues.apache.org/jira/browse/FLINK-8432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16341098#comment-16341098 ]
ASF GitHub Bot commented on FLINK-8432: --------------------------------------- Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5296#discussion_r164119372 --- Diff: flink-filesystems/flink-openstack-fs-hadoop/src/test/java/org/apache/flink/fs/openstackhadoop/HadoopSwiftFileSystemITCase.java --- @@ -0,0 +1,208 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NOTICE file + * distributed with this work for additional information + * regarding copyright ownership. The ASF licenses this file + * to you under the Apache License, Version 2.0 (the + * "License"); you may not use this file except in compliance + * with the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.flink.fs.openstackhadoop; + +import org.apache.flink.configuration.Configuration; +import org.apache.flink.core.fs.FSDataInputStream; +import org.apache.flink.core.fs.FSDataOutputStream; +import org.apache.flink.core.fs.FileStatus; +import org.apache.flink.core.fs.FileSystem; +import org.apache.flink.core.fs.FileSystem.WriteMode; +import org.apache.flink.core.fs.Path; +import org.apache.flink.util.TestLogger; + +import org.junit.AfterClass; +import org.junit.Assume; +import org.junit.BeforeClass; +import org.junit.Test; + +import java.io.BufferedReader; +import java.io.IOException; +import java.io.InputStreamReader; +import java.io.OutputStreamWriter; +import java.nio.charset.StandardCharsets; +import java.util.UUID; + +import static org.junit.Assert.assertEquals; +import static org.junit.Assert.assertFalse; +import static org.junit.Assert.assertNotNull; +import static org.junit.Assert.assertTrue; + +/** + * Integration tests for the Swift file system support. + */ +public class HadoopSwiftFileSystemITCase extends TestLogger { --- End diff -- I assume yo run these tests locally on OpenStack, right? > Add openstack swift filesystem > ------------------------------ > > Key: FLINK-8432 > URL: https://issues.apache.org/jira/browse/FLINK-8432 > Project: Flink > Issue Type: Improvement > Components: filesystem-connector > Affects Versions: 1.4.0 > Reporter: Jelmer Kuperus > Priority: Major > Labels: features > > At ebay classifieds we started running our infrastructure on top of OpenStack. > The openstack project comes with its own amazon-s3-like filesystem, known as > Swift. It's built for scale and optimized for durability, availability, and > concurrency across the entire data set. Swift is ideal for storing > unstructured data that can grow without bound. > We would really like to be able to use it within flink without Hadoop > dependencies, as a sink or for storing savepoints etc > I've prepared a pull request that adds support for it. It wraps the hadoop > support for swift in a way that is very similar to the way the s3 connector > works. > You can find out more about the underlying hadoop implementation at > [https://hadoop.apache.org/docs/stable/hadoop-openstack/index.html] > Pull request : [https://github.com/apache/flink/pull/5296] -- This message was sent by Atlassian JIRA (v7.6.3#76005)