Re: [DISCUSS] Graduate Apache Sedona to a Top Level Project

2022-12-03 Thread Netanel Malka
t;>>> > >>>>> ** Project ** > >>>>> > >>>>> * releases: 7 > >>>>> > >>>>> * number of release managers: 3 (Jia Yu, Paweł Kociński, Kanchan > >>>> Chowdhury) > >>>>>

Re: [DISCUSS] First Apache Sedona Community Call

2022-10-07 Thread Netanel Malka
I am sorry, but I am unable to attend. Will it be recorded? On Fri, Oct 7, 2022, 05:28 Jia Yu wrote: > Dear all, > > So far, we have 25 responses from the survey. The majority chose (1) Oct > 22 7 AM Pacific Time = 3 PM London = 11 PM Tokyo and (2) Zoom software for > the meeting. So let's have

[jira] [Created] (SEDONA-134) Some Binder contrib notebooks are not working

2022-07-22 Thread Netanel Malka (Jira)
Netanel Malka created SEDONA-134: Summary: Some Binder contrib notebooks are not working Key: SEDONA-134 URL: https://issues.apache.org/jira/browse/SEDONA-134 Project: Apache Sedona Issue

Re: [VOTE] Graduate Apache Sedona (incubating) to a Top Level Project

2022-06-18 Thread Netanel Malka
n. > > > > - number of contributors (and growth since incubation) > > 40 > > Overall: 74 > > 54% of the contributors joined since incubation > > > > - email discussions since incubation: 798 threads on > dev@sedona.apache.org > > > > - releases: 5

[jira] [Created] (SEDONA-121) Add equivalent constructors left over from Spark to Flink

2022-04-30 Thread Netanel Malka (Jira)
Netanel Malka created SEDONA-121: Summary: Add equivalent constructors left over from Spark to Flink Key: SEDONA-121 URL: https://issues.apache.org/jira/browse/SEDONA-121 Project: Apache Sedona

[jira] [Commented] (SEDONA-92) Build failed using Intellij IDEA

2022-04-18 Thread Netanel Malka (Jira)
[ https://issues.apache.org/jira/browse/SEDONA-92?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523892#comment-17523892 ] Netanel Malka commented on SEDONA-92: - I tried it, but I still have those issues. The workaround

Re: [VOTE] Release Apache Sedona 1.2.0-incubating-rc1

2022-03-24 Thread Netanel Malka
+1 Thanks, Netanel Malka On Wed, 23 Mar 2022 at 20:40, Mo Sarwat wrote: > +1 > > On Wed, Mar 23, 2022 at 11:38 AM Jia Yu wrote: > > > Dear all, > > > > +1 (binding) > > > > Thanks, > > Jia > > > > On Tue, Mar 22,

[jira] [Commented] (SEDONA-85) Add ST_GeoHash to Sedona flink streaming.

2022-03-20 Thread Netanel Malka (Jira)
[ https://issues.apache.org/jira/browse/SEDONA-85?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17509468#comment-17509468 ] Netanel Malka commented on SEDONA-85: - I can help with that. Do you think we shall create another

[jira] [Created] (SEDONA-93) Add ST_GeomFromGeoJSON to Sedona flink

2022-03-20 Thread Netanel Malka (Jira)
Netanel Malka created SEDONA-93: --- Summary: Add ST_GeomFromGeoJSON to Sedona flink Key: SEDONA-93 URL: https://issues.apache.org/jira/browse/SEDONA-93 Project: Apache Sedona Issue Type: Task

[jira] [Created] (SEDONA-92) Build failed using Intellij IDEA

2022-03-18 Thread Netanel Malka (Jira)
Netanel Malka created SEDONA-92: --- Summary: Build failed using Intellij IDEA Key: SEDONA-92 URL: https://issues.apache.org/jira/browse/SEDONA-92 Project: Apache Sedona Issue Type: Task

[jira] [Commented] (SEDONA-85) Add ST_GeoHash to Sedona flink streaming.

2022-03-10 Thread Netanel Malka (Jira)
[ https://issues.apache.org/jira/browse/SEDONA-85?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504399#comment-17504399 ] Netanel Malka commented on SEDONA-85: - [~jiayu]  I am wondering if we can generalize the SQL

[jira] [Commented] (SEDONA-85) Add ST_GeoHash to Sedona flink streaming.

2022-03-09 Thread Netanel Malka (Jira)
[ https://issues.apache.org/jira/browse/SEDONA-85?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17503365#comment-17503365 ] Netanel Malka commented on SEDONA-85: - [~imbruced] [~jiayu]  Would we like to add all the functions

[jira] [Commented] (SEDONA-52) Create Osm pbf loader for Apache Sedona.

2021-12-24 Thread Netanel Malka (Jira)
[ https://issues.apache.org/jira/browse/SEDONA-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464953#comment-17464953 ] Netanel Malka commented on SEDONA-52: - [~jiayu] , [~imbruced]  Both of the projects are using the MIT

[jira] [Commented] (SEDONA-52) Create Osm pbf loader for Apache Sedona.

2021-12-10 Thread Netanel Malka (Jira)
[ https://issues.apache.org/jira/browse/SEDONA-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17456964#comment-17456964 ] Netanel Malka commented on SEDONA-52: - [~imbruced]  Are you working on that? I found those packages

[jira] [Commented] (SEDONA-28) Add WKB serializer in RDD and SQL API and let the user choose the SerDe

2021-12-10 Thread Netanel Malka (Jira)
[ https://issues.apache.org/jira/browse/SEDONA-28?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17456960#comment-17456960 ] Netanel Malka commented on SEDONA-28: - [~jiayu]  I saw that:   {code:java} Reverts #516 PR 516

Re: [VOTE] Release Apache Sedona 1.1.1-incubating-rc1

2021-11-14 Thread Netanel Malka
+1 Great work! On Sun, Nov 14, 2021, 20:13 Adam Binford wrote: > +1 (non-binding) > > On Sun, Nov 14, 2021, 3:00 AM Jia Yu wrote: > >> Hi all, This is a call for vote on Apache Sedona 1.1.1-incubating-rc1. >> Please refer to the changes listed at the bottom of this email. Release >> notes: >>

Re: [VOTE] Release Apache Sedona 1.1.0-incubating-rc1

2021-10-01 Thread Netanel Malka
;> > Changes according to the comments on the previous release >>> > Original comment (Permalink from https://lists.apache.org/list.html): >>> > >>> > >>> https://lists.apache.org/thread.html/rcc3252c2afda7761afb205eb00a2f8a5d71256fc7f4d631efc879629%40%3Cgeneral.incubator.apache.org%3E >>> > >>> > 1. Fix the header issue in the BSD license >>> > This has been fixed. >>> > >>> > [1] >>> > >>> https://github.com/apache/incubator-sedona/blob/sedona-1.1.0-incubating-rc1/zeppelin/index.js >>> > [2] >>> > >>> https://github.com/apache/incubator-sedona/blob/sedona-1.1.0-incubating-rc1/licenses/LICENSE-zeppelin-helium-plugin >>> > >>> > 2. Add the license for scalastyle_config.xml >>> > >>> > [3] >>> > >>> https://github.com/apache/incubator-sedona/blob/sedona-1.1.0-incubating-rc1/LICENSE#L210 >>> > >>> > 3. Replace NASA HDF data with some alternatives to avoid the legal >>> issue >>> > >>> > All NASA data has been removed from the repo. >>> > >>> >> -- Best regards, Netanel Malka.

Re: [VOTE] Release Apache Sedona 1.0.1-incubating-rc1

2021-05-22 Thread Netanel Malka
2019-2020, > > Apache Sedona” in it? > > > > The issue has been fixed. The license for zeppelin plugin has been added > to > > LICENSE as well. > > > > > https://github.com/apache/incubator-sedona/blob/sedona-1.0.1-incubating-rc1/LICENSE > > > > 3. Please put instructions on how to build in the release, instructions > can > > change over time so pointing to a URL may not be helpful when trying to > > build older versions. > > > > Build instruction has been added to svn/dist/dev > > > > > https://dist.apache.org/repos/dist/dev/incubator/sedona/1.0.1-incubating-rc1/ > > > -- Best regards, Netanel Malka.

[jira] [Closed] (SEDONA-17) Replace geometry serializer in RDD API with the WKB serializer

2021-03-29 Thread Netanel Malka (Jira)
[ https://issues.apache.org/jira/browse/SEDONA-17?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Netanel Malka closed SEDONA-17. --- Resolution: Won't Do Will be part of SEDONA-28 > Replace geometry serializer in RDD API with the

[jira] [Commented] (SEDONA-17) Replace geometry serializer in RDD API with the WKB serializer

2021-03-29 Thread Netanel Malka (Jira)
[ https://issues.apache.org/jira/browse/SEDONA-17?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17310987#comment-17310987 ] Netanel Malka commented on SEDONA-17: - Close this issue and open SEDONA-28 as we decided to implement

[jira] [Created] (SEDONA-28) Add WKB serializer in RDD and SQL API and let the user choose the SerDe

2021-03-29 Thread Netanel Malka (Jira)
Netanel Malka created SEDONA-28: --- Summary: Add WKB serializer in RDD and SQL API and let the user choose the SerDe Key: SEDONA-28 URL: https://issues.apache.org/jira/browse/SEDONA-28 Project: Apache

[jira] [Created] (SEDONA-17) Replace geometry serializer in RDD API with the WKB serializer

2021-02-20 Thread Netanel Malka (Jira)
Netanel Malka created SEDONA-17: --- Summary: Replace geometry serializer in RDD API with the WKB serializer Key: SEDONA-17 URL: https://issues.apache.org/jira/browse/SEDONA-17 Project: Apache Sedona

Re: Develop new features/fix bugs

2021-02-20 Thread Netanel Malka
wel was working on some improvements for GeoJSON loading. So we can > > leave it for him. > > > > Do you have any other issues you want to work on? > > > > Thanks, > > Jia > > > > On Wed, Feb 17, 2021 at 5:35 AM Netanel Malka wrote: > > > >> Hi Jia, > >> Are there any features that we want to develop? or fix some bugs? > >> > >> My free time now allows me to make some contributions to the project. > >> > >> Thanks, > >> > >> > -- Best regards, Netanel Malka.

Develop new features/fix bugs

2021-02-17 Thread Netanel Malka
Hi Jia, Are there any features that we want to develop? or fix some bugs? My free time now allows me to make some contributions to the project. Thanks,

Re: [Bug][Python] Missing Java Class?

2021-02-11 Thread Netanel Malka
Hi Gregory, Can you please try to install the jars on the Databricks Cluster? For example: On clusters -> choose your cluster -> libraries -> install new: 1.Coordinates: org.geotools:gt-main:24.0 2.repo: https://repo.osgeo.org/repository/release/ I successfully did it. Please let me know if

Re: [DISCUSS] Put all GeoTools jars into a package on Maven Central

2021-02-11 Thread Netanel Malka
to update the website and let the users > know how to call it. > > Any better ideas? > > Thanks, > Jia > > > -- Best regards, Netanel Malka.

Re: [VOTE] Apache Sedona (incubating) rc1

2021-01-27 Thread Netanel Malka
urrent > >> release. > >> > > >> > For a detailed checklist please refer to: > >> > > >> > > >> > https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist > >> > > >> > Changes from the last failed vote (let's call it rc0 :-) ): > >> > 1. Version changed from "1.0.0-incubator" to "1.0.0-incubating" > >> > 2. Source code and binary now hosted on dist/dev/incubator/sedona/ > >> > 3. Source code and binary now are signed by RSA-4096 key with > >> > ji...@apache.org > >> > 4. Source code and binary now use sha512 checksum > >> > 5. Binaries are not staged on repository.apache.org yet. I will stage > >> them > >> > after the vote passes. > >> > 6. The compressed source code size changed from 600+ MB to 100+ MB, by > >> > remove duplicate test data. Will find a way to further in the future > >> > releases. > >> > 7. GeoTools (LGPL license, ASF Category X license) binaries have been > >> > completed removed from Sedona binaries. Users have to compile the > source > >> > code by themselves if they want to use ShapefileReader and CRS > >> > Transformation. > >> > > >> > @fengji...@gmail.com Von, the GitHub tag is > >> called > >> > "sedona-1.0.0-incubating-rc1" which has "sedona" prefix. This is > because > >> > our GitHub tags include old tags for GeoSpark. To differentiate Sedona > >> tags > >> > from old tags, I intend to add the "sedona" prefix. > >> > > >> > Thank you very much! > >> > Jia > >> > > >> > > > -- Best regards, Netanel Malka.

Re: [VOTE] Release Apache Sedona (incubating) 1.0.0

2021-01-11 Thread Netanel Malka
Great Job!! +1 Netanel Malka On 2021/01/07 10:16:11, Jia Yu wrote: > Hi All, > > After a fruitful discussion about our first Apache Sedona release > 1.0.0-incubator, the release has been created. This is a call for vote to > release Apache Sedona (incubating) 1

Re: Sedona 1.0 Maven release is staged

2021-01-06 Thread Netanel Malka
f you can get it done, I will start a vote > thread in our community and then pass it to the incubator. > > Jia > > On Mon, Jan 4, 2021 at 10:38 AM Netanel Malka > wrote: > > > I tried it again with no success. > > Now, I want to try to remove the .iv2 folder and

Re: Sedona 1.0 Maven release is staged

2021-01-04 Thread Netanel Malka
and run the three projects in CLI > and IntelliJ? See > > https://github.com/apache/incubator-sedona/blob/master/.github/workflows/example.yml#L35 > > Thanks, > Jia > > > > > On Fri, Jan 1, 2021 at 1:14 AM Netanel Malka wrote: > > > Hi Jia

Re: Sedona 1.0 Maven release is staged

2021-01-01 Thread Netanel Malka
scroll down to the bottom, you will see the section. > > >> > > >> @Felix Cheung Felix, does Pawel need to be > > >> aware of anything else, besides the incubator PyPi guideline? > > >> > > >> Thank you very much! > > >> Jia >

Re: Sedona 1.0 Maven release is staged

2020-12-30 Thread Netanel Malka
Hi Jia, That's great news! Happy and healthy New Year to everyone. They look fine to me. Do you think it will be worth to use them within a demo project? (to eliminate dependency issues) I can test it if we need it. BR, Netanel Malka, Big Data Consultant [Description: Description

Re: First Sedona release

2020-12-21 Thread Netanel Malka
Succeeded to push the snapshots. On Mon, 21 Dec 2020 at 12:04, Netanel Malka wrote: > Thanks. but unfortunately, it's not working. > I got the prompt for the PGP passphrase at the release:prepare phase. > > It looks like I don't have permission to push to the Sedona > nexus art

Re: First Sedona release

2020-12-21 Thread Netanel Malka
Thanks. but unfortunately, it's not working. I got the prompt for the PGP passphrase at the release:prepare phase. It looks like I don't have permission to push to the Sedona nexus artifactory. I will try to fix that later. On Mon, 21 Dec 2020 at 11:55, Jia Yu wrote: > @Netanel Ma

Re: First Sedona release

2020-12-21 Thread Netanel Malka
Hi Jia, I tried to deploy but I got a 401 Unauthorized error, full error: https://gist.github.com/netanel246/04c5be423d242a3bb9ef9a300c8817c8 I created a settings.xml file with my apache user and an encrypted password. I also have a GPG key. Did you encounter this problem? Thanks, Netanel Malka

Re: First Sedona release

2020-12-20 Thread Netanel Malka
l be documentation and stage the first release. > Although I really want to resolve the ST_Transform lock contention issue, > it requires a new ST_FlipCoordinate which may take a few days. I will see > whether I can finish this by Christmas but not sure. > > @Netanel Malka Could you p

Re: First Sedona release

2020-12-04 Thread Netanel Malka
4 >> >>>>>> >> >>>>>> Please feel free to comment if you have any suggestions! >> >>>>>> >> >>>>>> Jia >> >>>>>> >> >>>>>> On Sun, Nov 22, 2020 at 9:51 AM

JTS 1.16.2

2020-11-16 Thread Netanel Malka
Hi Jia, I tried to use the branch sedona-1.0-doc but the artifact for 1.16.2 is not in the Maven Central so I cannot compile the project. I got: The POM for org.locationtech.jts:jts-core:jar:1.16.2 is missing, no dependency information available I searched for the artifact here:

Re: Support Spark 2.4 in Sedona 1.0

2020-11-11 Thread Netanel Malka
What do you mean by compile target? ? Iv'e found Apache Zeppelin handle multiple Spark versions here using profile for each Spark version: https://github.com/apache/zeppelin/blob/master/spark/pom.xml#L185 Do you think this method is better? Netanel Malka, Big Data Consultant [Description

Re: Support Spark 2.4 in Sedona 1.0

2020-11-11 Thread Netanel Malka
xpect another maintenance release in the first half of 2021 at least. I'd also guess it wouldn't be maintained by 2022." ?BR, Netanel Malka, Big Data Consultant [Description: Description: Description: Description: cid:image001.jpg@01C85203.36A2AF30] From: Pawe

Re: First Sedona release

2020-11-09 Thread Netanel Malka
pe to create a PR soon for adjusting the build to deploy to the ASF Nexus repository * The key that signs the artifacts were created and tested. Do we want to create a candidate release for the current master branch? ​ Netanel Malka, Big Data Consultant [Description: Description: Description:

Re: First Sedona release

2020-11-04 Thread Netanel Malka
th that name? (Also for the *release*) 3. Do we need to push the artifacts also to ASF Nexus Repository (beside Maven Central)? Thanks. On Mon, 2 Nov 2020 at 19:21, Netanel Malka wrote: > Thanks Felix. > > I would be delighted to help. > I can start with the GPG. > Can I

Re: First Sedona release

2020-11-02 Thread Netanel Malka
, 2020 at 10:08 PM Jia Yu wrote: > > > > > Hi folks, > > > > > > We will be working on the first Sedona. Please see the JIRA ticket > here: > > > > > > https://issues.apache.org/jira/projects/SEDONA/issues/SEDONA-3?filter=allopenissues > > > > > > Do you think there are any outstanding issues to be fixed as well? > > > > > > Thanks, > > > Jia > > > > > > -- Best regards, Netanel Malka.

JTSplus fork status

2020-10-14 Thread Netanel Malka
Hi Jia, I saw that you merge the PR about make Sedona depend on JTS. Did you also try to open a PR in the JTS project? I wondered if they agreed to accept your changes. BR, Netanel Malka.

Re: Apache Sedona

2020-08-24 Thread Netanel Malka
>>>> GitHub repo (https://github.com/apache/incubator-sedona). But one >>>> committer (Masha from Facebook) who made thousands of lines of contribution >>>> to GeoSpark still didn't submit her CLA. The entire process is currently >>>> blocked by this. >>>> >>>> Mohamed and I have been trying to reach her a couple of times in the >>>> past 3 weeks but got no reply. I have asked the champion about how we can >>>> proceed in this case. Let's see what will happen. >>>> >>>> Thanks, >>>> Jia >>>> >>>> >>>> On Sun, Aug 16, 2020 at 9:06 AM Paweł Kociński < >>>> pawel93kocin...@gmail.com> wrote: >>>> >>>>> Hi Jia, >>>>> Do we know when the first release of Apache Sedona will occur ? Can I >>>>> help with something to make it happen? I have few ideas and some code >>>>> which >>>>> will be useful in the future. >>>>> >>>>> Regards, >>>>> Pawel >>>>> >>>> -- Best regards, Netanel Malka.

Re: Use JTS as a dependency instead of JTSPlus

2020-08-21 Thread Netanel Malka
Sedona-dev >>>> >>>> I think reflection would be a neat solution but it may bring >>>> technical debt in the future and cause problems to the python API. >>>> >>>> In the long run, a wrapper around JTS geometry would be a better >>&g