981433814 opened a new issue, #3703:
URL: https://github.com/apache/incubator-seatunnel/issues/3703

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22)
 and found no similar issues.
   
   
   ### What happened
   
   The current version of es is 7.9.3. The following error will be displayed 
when using Elasticsearch source connector. Is Elasticsearch 7.x supported now
   
   
   
![image](https://user-images.githubusercontent.com/45874392/206979432-0a814d27-a4bb-49dc-8ce4-680569f4b4ad.png)
   
   
   ### SeaTunnel Version
   
   2.1.0
   
   ### SeaTunnel Config
   
   ```conf
   source {
   elasticsearch {
       hosts = ["xxxxx:9200"]
       index = "xxxxxx"
       es.net.http.header.Authorization = "xxxxxxxxx"
       es.read.field.include = "xxxx, xxxx"
       result_table_name = "xxxxx"
   }
   }
   ```
   
   
   ### Running Command
   
   ```shell
   $SEATUNNEL_HOME/bin/start-seatunnel-spark.sh --master local[4] --deploy-mode 
client --config $SEATUNNEL_HOME/config/$CONF_NAME.conf
   ```
   
   
   ### Error Exception
   
   ```log
   Exception in thread "main" 
org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: Cannot detect ES 
version - typically this happens if the network/Elasticsearch cluster is not 
accessible or when targeting a WAN/Cloud instance without the proper setting 
'es.nodes.wan.only'
           at 
org.elasticsearch.hadoop.rest.InitializationUtils.discoverClusterInfo(InitializationUtils.java:344)
           at 
org.elasticsearch.spark.sql.ElasticsearchRelation.cfg$lzycompute(DefaultSource.scala:225)
           at 
org.elasticsearch.spark.sql.ElasticsearchRelation.cfg(DefaultSource.scala:223)
           at 
org.elasticsearch.spark.sql.ElasticsearchRelation.lazySchema$lzycompute(DefaultSource.scala:229)
           at 
org.elasticsearch.spark.sql.ElasticsearchRelation.lazySchema(DefaultSource.scala:229)
           at 
org.elasticsearch.spark.sql.ElasticsearchRelation$$anonfun$schema$1.apply(DefaultSource.scala:233)
           at 
org.elasticsearch.spark.sql.ElasticsearchRelation$$anonfun$schema$1.apply(DefaultSource.scala:233)
           at scala.Option.getOrElse(Option.scala:121)
           at 
org.elasticsearch.spark.sql.ElasticsearchRelation.schema(DefaultSource.scala:233)
           at 
org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:417)
           at 
org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:242)
           at 
org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:230)
           at 
org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:197)
           at 
org.apache.seatunnel.spark.source.Elasticsearch.getData(Elasticsearch.scala:62)
           at 
org.apache.seatunnel.spark.source.Elasticsearch.getData(Elasticsearch.scala:28)
           at 
org.apache.seatunnel.spark.batch.SparkBatchExecution.registerInputTempView(SparkBatchExecution.java:54)
           at 
org.apache.seatunnel.spark.batch.SparkBatchExecution.lambda$start$0(SparkBatchExecution.java:95)
           at java.util.ArrayList.forEach(ArrayList.java:1257)
           at 
org.apache.seatunnel.spark.batch.SparkBatchExecution.start(SparkBatchExecution.java:95)
           at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:107)
           at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:65)
           at org.apache.seatunnel.SeatunnelSpark.main(SeatunnelSpark.java:29)
           at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
           at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
           at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
           at java.lang.reflect.Method.invoke(Method.java:498)
           at 
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
           at 
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:845)
           at 
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
           at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
           at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
           at 
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920)
           at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929)
           at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
   Caused by: org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: 
Unsupported/Unknown Elasticsearch version 7.9.3
           at 
org.elasticsearch.hadoop.util.EsMajorVersion.parse(EsMajorVersion.java:87)
           at 
org.elasticsearch.hadoop.rest.RestClient.mainInfo(RestClient.java:703)
           at 
org.elasticsearch.hadoop.rest.InitializationUtils.discoverClusterInfo(InitializationUtils.java:334)
           ... 33 more
   ```
   
   
   ### Flink or Spark Version
   
   _No response_
   
   ### Java or Scala Version
   
   _No response_
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to