Numerical libraries for data science

Hi, I had a look on Tensor class from scinim, which is very close to Numpy in Python. I tried to use Nimpy with Tensor class and called the exported function with numpy class. I receive memory segmentation error. Do you have perhaps a code snippet how you export things in Nim side via Nimpy an

Numerical libraries for data science

Thanks a lot. I need to check this; If it works, it would be perfect.

Numerical libraries for data science

I aggree. Publish lot of Nim library to Python with nimporter/nimpy is a very good, the best for me, to attract developers. I think that a SciNim Python version that expose some data science libraries can be very good to highlight the Nim language.

Numerical libraries for data science

that's why you should use arraymancer Tensor on the Nim side, and numpy on the python side. you can convert the two with scinim and keep the internal data type consistent.

Numerical libraries for data science

Thanks a lot. I tried nimpy + nimporter and it worked very well for me. The only thing I was worried was that some time one does not know how data is mapped between Python and Nim. For example, I had a binary signal and used `int8` in Nim but what I received on the python side with `int64`. I g

Numerical libraries for data science

thanks a lot for your response. I started playing with Nim and I really like it. There are a variety of tools in data science such as numpy, pandas, torch, jax, etc. where all do part of the job. I guess the main potential of Nim would be in writing parts of code for better efficiency. I belie

Numerical libraries for data science

Do you have some examples to share?

Numerical libraries for data science

I'm using nimpy to export nim functions as python native module, and scinim+arraymancer / numpy as cross-boundary agents to move buffers back and forth. It works nice. I've been using this to run scientific models since an year'ish

Numerical libraries for data science

Nimporter v2 released soon.

Numerical libraries for data science

that is Arraymancer's Tensor, not a concept. There is though this open issue/dsicussion by @Vindaar which is definitely relevant:

Numerical libraries for data science

It looks like SciNim has a `Tensor` concept, which would seem to be the `ArrayLike` interface.

Numerical libraries for data science

> Nim would be a good option to produce fast python packages? I think it has the potential to be a great option to produce fast python packages for scientific computing! But to be fair I have not seen that realized too much (at least in the open, in the data science context, the only lib for py

Numerical libraries for data science

There is also for connecting with R.

Numerical libraries for data science

There is also for connecting with R.

Numerical libraries for data science

use this to mix Python and Nim in a Jupyter notebook: See: and

Numerical libraries for data science

Have a look at genny to automate python bindings to nim: And weave for parallel processing:

Numerical libraries for data science

Thank you so much for the references. I will start taking a look and see if I can find an easy way.

Numerical libraries for data science

I need to take a look. If it is that simple, it would be great!

Numerical libraries for data science

haha I like that. The only things is that nowadays in data science everything happens under Python cover so this is very important to keep the interface python.

Numerical libraries for data science

tries to be useful for Nim/Python

Numerical libraries for data science

I do use nim with python daily. On the nim side, you have all the scinim stuff Then use nimpy to creative a native .so/.dll python module Import your native module in python and enjoy full speed

Numerical libraries for data science

> Nim would be a good option to produce fast python packages? Not really. While it is possible - there are package like `nimporter` who can export Nim code to Python - it's overly complicated for little benefit. If you start using Nim, it's best to work entirely in Nim and use C++ library throug

Numerical libraries for data science

Why use Nim to make packages for Python when you can make packages for Nim?

Numerical libraries for data science

Yeah I mean I think this is exactly where nim shines as opposed to Rust, as you pick out; Nim keeps the simple things simple and the hard things possible, Rust instead is trying to market a lego brick with 3.46 dimensions. Nimpy is operatively intuitive, fast, 2-way, etc. So use that for 98% of

Numerical libraries for data science

Hi everyone I am mainly working on data science with Python. It is a tradition that nowadays people implement everything in other languages for speed reasons and wrap them in python to get simple code and other utilities of python. I was looking for good languages for this. C++ with Pybind11 is