Hi Gregory,
Can you please try to install the jars on the Databricks Cluster?
For example:
On clusters -> choose your cluster -> libraries -> install new:
1.Coordinates: org.geotools:gt-main:24.0
2.repo: https://repo.osgeo.org/repository/release/
I successfully did it.
Please let me know if
Honestly, not the worst thing I had to compile on Windows. Aside from the
Javadoc step and that weird issue with the dynamic versioning, it went
pretty smoothly; it just took a while because every try was taking a fair
bit of time.
I'll keep an eye on further announcements to see what comes next!
Thanks for letting us know. Yes, our source code is not supposed to be
compiled on Windows. I didn't expect so much trouble to get this jar. We
will figure a better way to solve this issue soon.
On Thu, Feb 11, 2021 at 1:46 AM Grégory Dugernier wrote:
> In fact, you should let us know about
>
> In fact, you should let us know about your situation early on. In fact,
> you can download the GeoTools jars manually and copy to SPARK_HOME/jars/
> folder... You don't have to compile the code. Download links are given in
> the comments:
>
Thanks, Gregory. I think this behavior is not expected. We will look into
this.
In fact, you should let us know about your situation early on. In fact, you
can download the GeoTools jars manually and copy to SPARK_HOME/jars/
folder... You don't have to compile the code. Download links are given
Hi Jia,
After much sweat and tears, I went the long road and compiled the code
locally. I'm working on Windows so I had to change a few things in the
POM.xml:
- When trying to compile just the python-adapter lib, Maven didn't like
the dynamic versioning of sedona-core and sedona-sql, so I
Hi Gregory,
Please let us know if you get your issue fixed. I know many of our users
are also using Databricks cluster. We are also interested in the solution.
Thanks,
Jia
On Wed, Feb 10, 2021 at 5:17 AM Grégory Dugernier wrote:
> Thank you for the quick reply!
>
> It seems my particular
Thank you for the quick reply!
It seems my particular situation is a bit more complex than that, since I'm
running the notebook on a Databricks cluster, and the default spark config
doesn't seem to allow for more jar repositories (GeoTools isn't on Maven
Central), nor does creating a new
Hi Gregory,
Thanks for letting us know. This is not a bug. We cannot include GeoTools
jars due to license issues. But indeed we forgot to update the docs and
jupyter notebook examples. I just updated them. Please read them here:
Hello,
I've been trying to run Sedona for Python on Databricks for 2 days and I
think I've stumbled upon a bug.
*Configuration*:
- Spark 3.0.1
- Scala 2.12
- Python 3.7
*Librairies*:
- apache-sedona (from PyPi)
- org.apache.sedona:sedona-python-adapter-3.0_2.12:1.0.0-incubating
10 matches
Mail list logo
