**UPDATED BENCHMARK**
Task: read 1.5 million price bars off disk and total the volume values
Platform: Win 10 Pro Workstation, 2x Xeon X5675 CPUs, 24 gigs memory, SSD
@treeform approach - marshalling with flatty and supersnappy libs
**Average: 0.14 secs**
@cblake approach - using the memfiles
> What more does one want?
As I said, as an individual the promise of performance coupled with elegant and
legible code is a compelling reason to learn the language.
As an organisation, not so much. I'd be more concerned with:
1. Accessing a pool of experienced developers
2. Access to exten
Been there - tried that. Pretty slow for big data sets. Though for read-only,
if you set up their in-memory table you can slice and dice the data pretty
effectively once you do heave it off the disk. For my use-case, querying the
data is not a priority.
For what I'm doing (trading backtesting)
@cblake
Many thanks for your intriguing post. It certainly makes sense, and opens up
the prospect of very low-cost and rapid caching to disk which might change my
design somewhat.
I will cogitate and digest and try to understand the code you have linked.
But more broadly I'd ask you to reflect
Very new to Nim, but not new to marketing. Haven't read the whole thread, but
one issue stands out for me.
For small market entrants, concentration of forces is everything. You have to
focus on a specific niche you can dominate - a niche too small for the big
gorillas to compete in.
For langua
**Treeform** \- brilliant advice - I'd never have gotten to such an effective
solution on my own.
For 1.5 million records to and from HDD on my HP Z600 Win 10 Pro workstation,
the average benchmarks were:
* Json serialisation: 11.6 secs
* Flatty serialisation: 1.7 secs
* Flatty+Snappy ser
Hi folks
Newbie question here. I've figured out everything I need for my project except
for one showstopping issue, and would very much appreciate a hand.
I need a fast way to serialize and deserialize a seq of a relatively simple
object to a binary file. The typical sequence will contain a few
I've had the same issue. If you control security on the PC it's relatively
trivial to fix.
To download, I temporarily disabled Defender real-time protection.
But it was also blocking Nim from running. You solve that by whitelisting the
Nim folder in Defender's settings.
Just google for the det
@ynfle
Great catch! I should have realised there was something suspicious about that
figure.
The problem isn't my hardware, it's my wetware. I somehow managed to install
the 32 bit version of Nim. I was having a wrestle with a false positive from
Defender as I tried to download, and it must ha
I very much appreciate your efforts to help. But it really can't be the
specific row in the file that is causing the crash.
I've inspected it in Vim, and it's well formed as I said. There are no strange
characters, and the length is only 40 chars, so I can't see how it could have
anything to do
I was sceptical that the data would be the issue - I harvested it myself and
know the quality.
But I did another run and caught the precise line where it occurred. There is
nothing wrong with the line - it's well formed and only 40 chars long. I've
visually inspected the file and there's nothin
Hi
Just rolling up my sleeves to learn Nim, but have run into an immediate
roadblock.
I though I'd stress-test it by reading in a large .csv file, as this will be a
common requirement.
My code is crashing after reading around 51,000,000 lines. It was only a test
so all I'm doing is counting t
It's quite well known in the finance industry in London. At least one recent
survey showed that F# developers have the highest average salary of any
language - so you may be missing out on something :-)
It's basically a modern ML with an expressive algebraic type system. It's
cross-platform, op
On the circular imports issue, I'm coming from f#, where the lack of circular
imports is seen as a feature rather than a bug. It encourages (even forces) a
good onion design with the pure code at the centre of the project and the
impure code (files/databases/networks) on the periphery.
Given th
Many thanks - I rather suspected it might be a naive question. I'm only give
the docs a quick skim so far and haven't even downloaded yet.
I've never seen a deque with accessible internals before - guess I was just
making assumptions.
In the very early stages of evaluating Nim for a side project - liking what I'm
seeing!
But I'd be grateful for any tips about how to meet a key requirement before I
invest the time in digging in too deeply.
The app is a trading backtester. So I need to maintain lists of price quotes
and indic
16 matches
Mail list logo
