e
> know, but I imagine that updating the implementation matrix, for example,
> can be done afterwards as follow up.
>
> Excited to have Julia more officially integrated here!
>
> Cheers,
>
> -Jacob
> https://github.com/quinnj
> https://twitter.com/quinn_jacobd
--
Regards,
Kenta Murata
Hi Wes,
Thank you very much giving us the detail explanation of your thoughts.
I need the knowledge of the SOTA of query engine you pointed out if I’ll
contribute to C++ Query Engine or just write the binding of it. I’m
studying the article and the codes.
Regards,
Kenta Murata
On Thu, Aug 6
Hi folks,
Red Arrow, the Ruby binding of Arrow GLib, implements grouped aggregation
features for RecordBatch and Table. Because these features are written in
Ruby, they are too slow for large size data. We need to make them much
faster.
To improve their calculation speed, they should be
t width when overflowing the smaller integer types.
>
> On Sun, Aug 2, 2020 at 9:32 PM Kenta Murata wrote:
> >
> > Hi folks,
> >
> > arrow::MakeBuilder function with a dictionary type creates a
> > dictionary builder with AdaptiveIntBuilder by ignoring the bit-widt
x type.
I guess most people expect they get `indices=int32` here.
--
Kenta Murata
tps://docs.google.com/document/d/16UKZtvL49o8nCDN8JU3Ut6y76Y9d8-4qXv5vFv7aNvs/edit#heading=h.kqqacbm2lpv8
> >
> > Please fill in the details for the parts of the project you're close to.
> > I'll handle wrapping this up in the usual boilerplate when we're done.
> >
> > Thanks,
> > Neal
--
Regards,
Kenta Murata
Kenta Murata created ARROW-8343:
---
Summary: [GLib] Add GArrowRecordBatchIterator
Key: ARROW-8343
URL: https://issues.apache.org/jira/browse/ARROW-8343
Project: Apache Arrow
Issue Type: New
Kenta Murata created ARROW-8073:
---
Summary: [GLib] Add binding of arrow::fs::PathForest
Key: ARROW-8073
URL: https://issues.apache.org/jira/browse/ARROW-8073
Project: Apache Arrow
Issue Type
Kenta Murata created ARROW-7739:
---
Summary: [GLib] Use placement new to initialize shared_ptr object
in private structs
Key: ARROW-7739
URL: https://issues.apache.org/jira/browse/ARROW-7739
Project
Kenta Murata created ARROW-7730:
---
Summary: [GLib] Add Duration type support
Key: ARROW-7730
URL: https://issues.apache.org/jira/browse/ARROW-7730
Project: Apache Arrow
Issue Type: New Feature
Kenta Murata created ARROW-7698:
---
Summary: [Format][C++] Add tensor and sparse tensor supports in
File metadata
Key: ARROW-7698
URL: https://issues.apache.org/jira/browse/ARROW-7698
Project: Apache
Kenta Murata created ARROW-7515:
---
Summary: [C++] Rename nonexistent and non_existent to not_found
Key: ARROW-7515
URL: https://issues.apache.org/jira/browse/ARROW-7515
Project: Apache Arrow
Kenta Murata created ARROW-7504:
---
Summary: [GLib] Introduce value-returning garrow::check
Key: ARROW-7504
URL: https://issues.apache.org/jira/browse/ARROW-7504
Project: Apache Arrow
Issue Type
Kenta Murata created ARROW-7445:
---
Summary: [GLib] Add HadoopFileSystem support
Key: ARROW-7445
URL: https://issues.apache.org/jira/browse/ARROW-7445
Project: Apache Arrow
Issue Type: Sub-task
Kenta Murata created ARROW-7444:
---
Summary: [GLib] Add LocalFileSystem support
Key: ARROW-7444
URL: https://issues.apache.org/jira/browse/ARROW-7444
Project: Apache Arrow
Issue Type: Sub-task
Kenta Murata created ARROW-7443:
---
Summary: [GLib] Add binding of arrow::fs
Key: ARROW-7443
URL: https://issues.apache.org/jira/browse/ARROW-7443
Project: Apache Arrow
Issue Type: New Feature
Kenta Murata created ARROW-7421:
---
Summary: [C++] Support creating SparseCSRMatrix and
SparseCSCMatrix from 0d and 1d Tensors
Key: ARROW-7421
URL: https://issues.apache.org/jira/browse/ARROW-7421
Kenta Murata created ARROW-7420:
---
Summary: [C++] Migrate internal functions of SparseTensor to
Result-returning version
Key: ARROW-7420
URL: https://issues.apache.org/jira/browse/ARROW-7420
Project
Kenta Murata created ARROW-7419:
---
Summary: [Python] Support SparseCSCMatrix
Key: ARROW-7419
URL: https://issues.apache.org/jira/browse/ARROW-7419
Project: Apache Arrow
Issue Type: New Feature
Kenta Murata created ARROW-7371:
---
Summary: [GLib] Add Datasets binding
Key: ARROW-7371
URL: https://issues.apache.org/jira/browse/ARROW-7371
Project: Apache Arrow
Issue Type: New Feature
Kenta Murata created ARROW-7369:
---
Summary: [GLib] Add garrow_table_combine_chunks
Key: ARROW-7369
URL: https://issues.apache.org/jira/browse/ARROW-7369
Project: Apache Arrow
Issue Type: New
Kenta Murata created ARROW-7306:
---
Summary: [C++] Add Result-returning version of FileSystemFromUri
Key: ARROW-7306
URL: https://issues.apache.org/jira/browse/ARROW-7306
Project: Apache Arrow
Kenta Murata created ARROW-7297:
---
Summary: [C++] Add value accessor in sparse tensor class
Key: ARROW-7297
URL: https://issues.apache.org/jira/browse/ARROW-7297
Project: Apache Arrow
Issue
Kenta Murata created ARROW-7291:
---
Summary: [Dev]Fix FORMAT_DIR in update-flatbuffers.sh
Key: ARROW-7291
URL: https://issues.apache.org/jira/browse/ARROW-7291
Project: Apache Arrow
Issue Type
Kenta Murata created ARROW-7037:
---
Summary: [C++ ] Compile error on the combination of protobuf >=
3.9 and clang
Key: ARROW-7037
URL: https://issues.apache.org/jira/browse/ARROW-7037
Project: Apa
Kenta Murata created ARROW-7036:
---
Summary: [C++] Version up ORC to avoid compile errors
Key: ARROW-7036
URL: https://issues.apache.org/jira/browse/ARROW-7036
Project: Apache Arrow
Issue Type
Kenta Murata created ARROW-6814:
---
Summary: [C++] Resolve compiler warnings occurred on release build
Key: ARROW-6814
URL: https://issues.apache.org/jira/browse/ARROW-6814
Project: Apache Arrow
Kenta Murata created ARROW-6508:
---
Summary: [C++] Add Tensor and SparseTensor factory function with
validations
Key: ARROW-6508
URL: https://issues.apache.org/jira/browse/ARROW-6508
Project: Apache
Kenta Murata created ARROW-6505:
---
Summary: [Website] Add new committers
Key: ARROW-6505
URL: https://issues.apache.org/jira/browse/ARROW-6505
Project: Apache Arrow
Issue Type: Improvement
Kenta Murata created ARROW-6503:
---
Summary: [C++] Add an argument of memory pool object to
SparseTensorConverter
Key: ARROW-6503
URL: https://issues.apache.org/jira/browse/ARROW-6503
Project: Apache
Kenta Murata created ARROW-6501:
---
Summary: [Format][C++] Remove non_zero_length field from
SparseIndex
Key: ARROW-6501
URL: https://issues.apache.org/jira/browse/ARROW-6501
Project: Apache Arrow
Kenta Murata created ARROW-6489:
---
Summary: [Developer][Documentation]Fix merge script and readme
Key: ARROW-6489
URL: https://issues.apache.org/jira/browse/ARROW-6489
Project: Apache Arrow
Thanks for responding.
I understand ExtensionType is suitable for handling character encoding.
I'll try to make and propose draft specification and implementation of
an extension type.
Regards,
Kenta Murata
2019年9月5日(木) 7:56 Wes McKinney :
>
> I opened https://issues.apache.org/jira/
>
> > Thanks,
> > Ji Liu
> >
> >
> > --
> > From:Fan Liya
> > Send Time:2019年9月6日(星期五) 09:28
> > To:dev
> > Subject:Re: [ANNOUNCE] New committers: Ben Kietzman, Kenta Murata, and
> > Neal Richardson
> >
> > Big congratula
/1D0xlI5r2wJUV45aTY1q2TwqD__v7acmd8FOfr8xSOVQ/edit?usp=sharing
[2] https://tools.ietf.org/html/rfc3808
[3] https://www.iana.org/assignments/character-sets/character-sets.xhtml
[4] https://encoding.spec.whatwg.org/
--
Kenta Murata
_sparse method when the tensor
has a non-zero fill value.
So we should support fill value someday, I think.
> I'm ok with dropping this for now.
Yes, we can advance without it, and support it later.
And, I think supporting fill value is not difficult.
--
Kenta Murata
.
I didn't understand that Tensor and SparseTensor isn't restricted by a
versioning and compatibility policy.
OK, I'll send some pull-requests.
--
Kenta Murata
Kenta Murata created ARROW-6393:
---
Summary: [C++]Add EqualOptions support in SparseTensor::Equals
Key: ARROW-6393
URL: https://issues.apache.org/jira/browse/ARROW-6393
Project: Apache Arrow
n, what do you think this automation?
Regards,
Kenta Murata
Kenta Murata created ARROW-6319:
---
Summary: [C++] Extract the core of NumericTensor::Value as
Tensor::Value
Key: ARROW-6319
URL: https://issues.apache.org/jira/browse/ARROW-6319
Project: Apache Arrow
/sparse_tensor_index_value_type
Regards,
Kenta Murata
Kenta Murata created ARROW-5830:
---
Summary: [C++] Stop using memcmp in TensorEquals
Key: ARROW-5830
URL: https://issues.apache.org/jira/browse/ARROW-5830
Project: Apache Arrow
Issue Type
rror 2
make[4]: *** Waiting for unfinished jobs
make[3]: *** [all] Error 2
Regards,
Kenta Murata
2019年7月3日(水) 3:00 Yosuke Shiro :
>
> Ran dev/release/verify-release-candidate.sh source 0.14.0 0 on macOS Mojave.
> I got the following error, but it may be specific to my environment.
&
Kenta Murata created ARROW-5813:
---
Summary: [C++] Support checking the equality of the different
contiguous tensors
Key: ARROW-5813
URL: https://issues.apache.org/jira/browse/ARROW-5813
Project: Apache
Kenta Murata created ARROW-5754:
---
Summary: [C++]Missing override for ~GrpcStreamWriter?
Key: ARROW-5754
URL: https://issues.apache.org/jira/browse/ARROW-5754
Project: Apache Arrow
Issue Type
Kenta Murata created ARROW-5736:
---
Summary: [Format] Support small bit-width indices of sparse tensor
Key: ARROW-5736
URL: https://issues.apache.org/jira/browse/ARROW-5736
Project: Apache Arrow
Kenta Murata created ARROW-5704:
---
Summary: [C++] Stop using ARROW_TEMPLATE_EXPORT for
SparseTensorImpl class
Key: ARROW-5704
URL: https://issues.apache.org/jira/browse/ARROW-5704
Project: Apache Arrow
Kenta Murata created ARROW-5486:
---
Summary: [GLib] Add binding of gandiva::FunctionRegistry and
related things
Key: ARROW-5486
URL: https://issues.apache.org/jira/browse/ARROW-5486
Project: Apache Arrow
Kenta Murata created ARROW-5320:
---
Summary: [C++] Undefined symbol errors are occurred when linking
parquet executables
Key: ARROW-5320
URL: https://issues.apache.org/jira/browse/ARROW-5320
Project
Kenta Murata created ARROW-5155:
---
Summary: [GLib][Ruby] MakeDense and MakeSparse in UnionArray
should accept a vector of Field
Key: ARROW-5155
URL: https://issues.apache.org/jira/browse/ARROW-5155
Kenta Murata created ARROW-5150:
---
Summary: [Ruby] Add Arrow::Table#raw_records
Key: ARROW-5150
URL: https://issues.apache.org/jira/browse/ARROW-5150
Project: Apache Arrow
Issue Type: New
Kenta Murata created ARROW-5050:
---
Summary: [C++] cares_ep should build before grpc_ep
Key: ARROW-5050
URL: https://issues.apache.org/jira/browse/ARROW-5050
Project: Apache Arrow
Issue Type
Kenta Murata created ARROW-5032:
---
Summary: [C++] Headers in vendored/datetime directory aren't
installed
Key: ARROW-5032
URL: https://issues.apache.org/jira/browse/ARROW-5032
Project: Apache Arrow
Kenta Murata created ARROW-4942:
---
Summary: [Ruby] Remove needless omits
Key: ARROW-4942
URL: https://issues.apache.org/jira/browse/ARROW-4942
Project: Apache Arrow
Issue Type: Test
Kenta Murata created ARROW-4938:
---
Summary: [Glib] Undefined symbols error occurred when GIR file is
being generated.
Key: ARROW-4938
URL: https://issues.apache.org/jira/browse/ARROW-4938
Project
Kenta Murata created ARROW-4932:
---
Summary: [GLib] Use G_DECLARE_DERIVABLE_TYPE macro
Key: ARROW-4932
URL: https://issues.apache.org/jira/browse/ARROW-4932
Project: Apache Arrow
Issue Type
Kenta Murata created ARROW-4906:
---
Summary: [Format] Fix document to describe that
SparseMatrixIndexCSR assumes indptr is sorted for each row
Key: ARROW-4906
URL: https://issues.apache.org/jira/browse/ARROW-4906
e processing, I have no experience of
partitioning sparse matrices for distributed computing.
I think it's great that Arrow can handle such a use case, so I would
like to cooperate if there is something I can do for the realization.
Thanks,
Kenta Murata
2019年3月12日(火) 2:17 Jed Brown :
>
> Tha
Kenta Murata created ARROW-4775:
---
Summary: [Website] Site navbar cannot be expanded
Key: ARROW-4775
URL: https://issues.apache.org/jira/browse/ARROW-4775
Project: Apache Arrow
Issue Type: Bug
Kenta Murata created ARROW-4671:
---
Summary: [C++] MakBuilder must care Type::DICTIONARY
Key: ARROW-4671
URL: https://issues.apache.org/jira/browse/ARROW-4671
Project: Apache Arrow
Issue Type
Kenta Murata created ARROW-4662:
---
Summary: [Python] Add type_codes property in UnionType
Key: ARROW-4662
URL: https://issues.apache.org/jira/browse/ARROW-4662
Project: Apache Arrow
Issue Type
Kenta Murata created ARROW-4632:
---
Summary: [Ruby] Add BigDecimal#to_arrow
Key: ARROW-4632
URL: https://issues.apache.org/jira/browse/ARROW-4632
Project: Apache Arrow
Issue Type: New Feature
Kenta Murata created ARROW-4622:
---
Summary: MakeDense and MakeSparse in UnionArray should accept a
vector of Field
Key: ARROW-4622
URL: https://issues.apache.org/jira/browse/ARROW-4622
Project: Apache
Kenta Murata created ARROW-4600:
---
Summary: [Ruby] Arrow::DictionaryArray#[] should returns the item
in the indices array
Key: ARROW-4600
URL: https://issues.apache.org/jira/browse/ARROW-4600
Project
Kenta Murata created ARROW-4537:
---
Summary: [CI] Suppress shell warning on travis-ci
Key: ARROW-4537
URL: https://issues.apache.org/jira/browse/ARROW-4537
Project: Apache Arrow
Issue Type: Task
Kenta Murata created ARROW-4536:
---
Summary: Add data_type argument in garrow_list_array_new
Key: ARROW-4536
URL: https://issues.apache.org/jira/browse/ARROW-4536
Project: Apache Arrow
Issue
Kenta Murata created ARROW-4535:
---
Summary: [C++] Fix MakeBuilder to preserve ListType's field name
Key: ARROW-4535
URL: https://issues.apache.org/jira/browse/ARROW-4535
Project: Apache Arrow
Kenta Murata created ARROW-4506:
---
Summary: [Ruby] Add Arrow::RecordBatch#raw_records
Key: ARROW-4506
URL: https://issues.apache.org/jira/browse/ARROW-4506
Project: Apache Arrow
Issue Type: New
Kenta Murata created ARROW-4397:
---
Summary: [C++] dim_names in Tensor and SparseTensor
Key: ARROW-4397
URL: https://issues.apache.org/jira/browse/ARROW-4397
Project: Apache Arrow
Issue Type
Kenta Murata created ARROW-4320:
---
Summary: [C++] Add tests for non-contiguous tensors
Key: ARROW-4320
URL: https://issues.apache.org/jira/browse/ARROW-4320
Project: Apache Arrow
Issue Type
Kenta Murata created ARROW-4318:
---
Summary: [C++] Add Tensor::CountNonZero
Key: ARROW-4318
URL: https://issues.apache.org/jira/browse/ARROW-4318
Project: Apache Arrow
Issue Type: New Feature
Kenta Murata created ARROW-4226:
---
Summary: [C++] Add CSF sparse tensor support
Key: ARROW-4226
URL: https://issues.apache.org/jira/browse/ARROW-4226
Project: Apache Arrow
Issue Type: New
Kenta Murata created ARROW-4225:
---
Summary: [C++] Add CSC sparse matrix support
Key: ARROW-4225
URL: https://issues.apache.org/jira/browse/ARROW-4225
Project: Apache Arrow
Issue Type: New
Kenta Murata created ARROW-4224:
---
Summary: [Python] Support integration with pydata/sparse library
Key: ARROW-4224
URL: https://issues.apache.org/jira/browse/ARROW-4224
Project: Apache Arrow
Kenta Murata created ARROW-4223:
---
Summary: [Python] Support scipy.sparse integration
Key: ARROW-4223
URL: https://issues.apache.org/jira/browse/ARROW-4223
Project: Apache Arrow
Issue Type
Kenta Murata created ARROW-4221:
---
Summary: [Format] Add canonical flag in COO sparse index
Key: ARROW-4221
URL: https://issues.apache.org/jira/browse/ARROW-4221
Project: Apache Arrow
Issue
Kenta Murata created ARROW-4222:
---
Summary: [C++] Support equality comparison between COO and CSR
sparse tensors in SparseTensorEquals
Key: ARROW-4222
URL: https://issues.apache.org/jira/browse/ARROW-4222
Kenta Murata created ARROW-3518:
---
Summary: Detect HOMEBREW_PREFIX automatically
Key: ARROW-3518
URL: https://issues.apache.org/jira/browse/ARROW-3518
Project: Apache Arrow
Issue Type
Kenta Murata created ARROW-3515:
---
Summary: Introduce NumericTensor class
Key: ARROW-3515
URL: https://issues.apache.org/jira/browse/ARROW-3515
Project: Apache Arrow
Issue Type: New Feature
on this thread too)
I’m also +1 for discourse because I’m managing https://discourse.ruby-data.org/
by this plan.
Regards,
Kenta Murata
80 matches
Mail list logo
