[GitHub] [incubator-sedona] jiayuasu merged pull request #537: [SEDONA-59] Make pyspark dependency of sedona python optional

jiayuasu merged pull request #537: URL: https://github.com/apache/incubator-sedona/pull/537 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-un

Re: Will publish Sedona new version 1.1.0 soon

Hi, About https://issues.apache.org/jira/browse/SEDONA-59, first option seems most reasonable, we can assume that spark is already installed and does not cause any confusion while installing with tools like poetry and pipenv. Best Regards, Paweł śr., 25 sie 2021 o 11:18 Jia Yu napisał(a): > Sed

[GitHub] [incubator-sedona] jiayuasu commented on pull request #537: [SEDONA-59] Make pyspark dependency of sedona python optional

jiayuasu commented on pull request #537: URL: https://github.com/apache/incubator-sedona/pull/537#issuecomment-905821127 This is great. I just recalled one thing: Sedona Python also works for Spark 2.3 although we have no plan to officially support it whatsoever. But can you please also ch

Issues migrating to Sedona from Geospark

Hello! My name is Brandon Graybeal and I am a Data Engineer at Arity, which is a Telematics company owned by Allstate. We have been using the Geospark library in our production pipelines for a year now, and it has been great. However, we are migrating to EMR and Spark 3, so I need to upgrade al

[jira] [Commented] (SEDONA-59) Remove explicit pyspark dependency

[ https://issues.apache.org/jira/browse/SEDONA-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404403#comment-17404403 ] Sebastian Eckweiler commented on SEDONA-59: --- I created [https://github.com/apach

[GitHub] [incubator-sedona] sebbegg commented on pull request #537: Make pyspark dependency of sedona python optional

sebbegg commented on pull request #537: URL: https://github.com/apache/incubator-sedona/pull/537#issuecomment-905448291 Note: I also bumped the pyspark dependency in `setup.py` to 2.4, so it's consistent with the `Pipfile`. -- This is an automated message from the Apache Git Service. To

[GitHub] [incubator-sedona] sebbegg opened a new pull request #537: Make pyspark dependency of sedona python optional

sebbegg opened a new pull request #537: URL: https://github.com/apache/incubator-sedona/pull/537 ## Is this PR related to a proposed Issue? Yes - this implements https://issues.apache.org/jira/browse/SEDONA-59 ## What changes were proposed in this PR? This PR moves the `

[GitHub] [incubator-sedona] swamirishi commented on pull request #536: [SEDONA-36] Parquet reader & Writers

swamirishi commented on pull request #536: URL: https://github.com/apache/incubator-sedona/pull/536#issuecomment-905344497 @Imbruced I have addressed the review comments. Can you check if I need to change something else -- This is an automated message from the Apache Git Service. To resp

[GitHub] [incubator-sedona] swamirishi commented on a change in pull request #536: [SEDONA-36] Parquet reader & Writers

swamirishi commented on a change in pull request #536: URL: https://github.com/apache/incubator-sedona/pull/536#discussion_r695577641 ## File path: core/src/main/java/org/apache/sedona/core/formatMapper/ParquetReader.java ## @@ -0,0 +1,38 @@ +package org.apache.sedona.core.for

Will publish Sedona new version 1.1.0 soon

Sedona committers, contributors and users, The new Sedona version is long overdue because of this PySpark <= 3.0.1 bug in Pipfile. I promise I will roll out the new version in the next 1 or 2 weeks regardless of the progress of all pending PRs. The new version will be 1.1.0 which contains the majo

Re: Py4JError

This is most likely because you didn't include Sedona Java Jars. Please read: https://sedona.apache.org/download/overview/#prepare-python-adapter-jar On Tue, Aug 17, 2021 at 7:54 PM BEHNAZ NIKKHAH wrote: > Hi > It is my first project using Apache Sedona and I get the following error > when I wan

[jira] [Commented] (SEDONA-55) Publish Python artifact 1.0.2

[ https://issues.apache.org/jira/browse/SEDONA-55?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404295#comment-17404295 ] Jia Yu commented on SEDONA-55: -- We will roll out this version in one or two weeks. > Publish

[jira] [Commented] (SEDONA-59) Remove explicit pyspark dependency

[ https://issues.apache.org/jira/browse/SEDONA-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404294#comment-17404294 ] Jia Yu commented on SEDONA-59: -- This is an awesome solution. Can you create this PR at your e

[jira] [Closed] (SEDONA-51) Build fails: /packages cannot be represented as URI

[ https://issues.apache.org/jira/browse/SEDONA-51?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jia Yu closed SEDONA-51. Resolution: Won't Fix We currently only focus on widely used Java versions such as Java 8 11 13 > Build fails: /pac

[jira] [Commented] (SEDONA-51) Build fails: /packages cannot be represented as URI

[ https://issues.apache.org/jira/browse/SEDONA-51?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404291#comment-17404291 ] Jia Yu commented on SEDONA-51: -- It seems that you can fix it by changing Java version to 1.8

[GitHub] [incubator-sedona] jiayuasu edited a comment on pull request #536: [SEDONA-36] Parquet reader & Writers

jiayuasu edited a comment on pull request #536: URL: https://github.com/apache/incubator-sedona/pull/536#issuecomment-905314053 @swamirishi Thank you again for your patience! I traveled back to WSU and the new semester just started. So I was kind of overwhelmed by many things on my

[GitHub] [incubator-sedona] jiayuasu commented on pull request #536: [SEDONA-36] Parquet reader & Writers

jiayuasu commented on pull request #536: URL: https://github.com/apache/incubator-sedona/pull/536#issuecomment-905314053 @swamirishi Thank you again for your patience! I traveled back to WSU and the new semester just started. So I was kind of overwhelmed by many things on my plate.

[GitHub] [incubator-sedona] jiayuasu commented on a change in pull request #536: [SEDONA-36] Parquet reader & Writers

jiayuasu commented on a change in pull request #536: URL: https://github.com/apache/incubator-sedona/pull/536#discussion_r695540349 ## File path: core/src/main/java/org/apache/sedona/core/spatialRDD/SpatialRDD.java ## @@ -129,9 +138,24 @@ * The sample number. */