[jira] [Commented] (ARROW-616) [C++] Remove -g flag in release builds
[ https://issues.apache.org/jira/browse/ARROW-616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976180#comment-15976180 ] Uwe L. Korn commented on ARROW-616: --- Feel free to remove them, it's not that hard at least for me to produce wheels again that contain debug symbols that I could then hand out to users if there is a problem. > [C++] Remove -g flag in release builds > -- > > Key: ARROW-616 > URL: https://issues.apache.org/jira/browse/ARROW-616 > Project: Apache Arrow > Issue Type: New Feature > Components: C++ >Reporter: Wes McKinney >Assignee: Wes McKinney > Fix For: 0.3.0 > > > See SetupCxxFlags.cmake -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (ARROW-616) [C++] Remove -g flag in release builds
[
https://issues.apache.org/jira/browse/ARROW-616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976048#comment-15976048
]
Wes McKinney commented on ARROW-616:
Since conda packages for Arrow C++ libraries are now growing to about 15MB, I
think it may be good to strip debug symbols by default in release builds. They
can be added back with {{ARROW_CXXFLAGS}} -- [~xhochy] do you have opinions one
way or the other? The Linux wheels for 0.2.0 were about 13MB, so these would
get smaller, too (https://pypi.python.org/pypi/pyarrow)
> [C++] Remove -g flag in release builds
> --
>
> Key: ARROW-616
> URL: https://issues.apache.org/jira/browse/ARROW-616
> Project: Apache Arrow
> Issue Type: New Feature
> Components: C++
>Reporter: Wes McKinney
>Assignee: Wes McKinney
> Fix For: 0.3.0
>
>
> See SetupCxxFlags.cmake
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Updated] (ARROW-616) [C++] Remove -g flag in release builds
[ https://issues.apache.org/jira/browse/ARROW-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-616: --- Fix Version/s: 0.3.0 > [C++] Remove -g flag in release builds > -- > > Key: ARROW-616 > URL: https://issues.apache.org/jira/browse/ARROW-616 > Project: Apache Arrow > Issue Type: New Feature > Components: C++ >Reporter: Wes McKinney >Assignee: Wes McKinney > Fix For: 0.3.0 > > > See SetupCxxFlags.cmake -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (ARROW-855) Arrow Memory Leak
[ https://issues.apache.org/jira/browse/ARROW-855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975958#comment-15975958 ] xufusheng commented on ARROW-855: - In fact, it has nothing to do with HBase.Other data sources can also cause memory leaks > Arrow Memory Leak > - > > Key: ARROW-855 > URL: https://issues.apache.org/jira/browse/ARROW-855 > Project: Apache Arrow > Issue Type: Bug > Components: Java - Memory, Java - Vectors >Affects Versions: 0.1.0 > Environment: CentOS release 6.7+Indellij IDEA >Reporter: xufusheng >Priority: Critical > Labels: test > > we create a memory table by arrow and the source data come from HBase. > Create a memory table and then drop the table,there will be a memory leak. > Hundreds of times,There will be OutOfMemoryError. > anyone encounter similar problems? -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (ARROW-855) Arrow Memory Leak
[
https://issues.apache.org/jira/browse/ARROW-855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975954#comment-15975954
]
xufusheng commented on ARROW-855:
-
1.abstract class
abstract class ArrowPillar[V <: ValueVector](val field: FieldDescription, val
allocator: BufferAllocator)
extends CountablePillar {
val vector: V = ArrowPillar.getNewVector(mField.getName, allocator,
mField.getType()).asInstanceOf[V]
initialSize match {
case Some(v) => vector.isInstanceOf[FixedWidthVector] match {
case true =>
vector.asInstanceOf[FixedWidthVector].allocateNew(v)
vector.asInstanceOf[V]
case false => vector.allocateNew()
}
case None => vector.allocateNew()
}
..
def mutator():ValueVector.Mutator = vector.getMutator
def accessor():ValueVector.Accessor = vector.getAccessor
override def pureDel(index: Int): Unit = {
throw new MemoException("Don't support this operation now.")
}
override def close(): Unit = vector.close()
override def clear(): Unit = vector.clear()
}
2.one implementation
class ArrowNullableStringPillar(override val field: FieldDescription, override
val allocator: BufferAllocator)
extends ArrowPillar[NullableVarCharVector](field, allocator) {
override def pureSet(index: Int, value: Option[Any]): Unit = {
value match {
case None =>
mutator.asInstanceOf[NullableVarCharVector#Mutator].setNull(index)
case Some(v) =>
val value = v.asInstanceOf[String].getBytes
val length = v.asInstanceOf[String].getBytes.length
mutator.asInstanceOf[NullableVarCharVector#Mutator].setSafe(index,
value, 0, length)
}
}
override def pureGet(index: Int): Option[Any] = {
if (accessor.isNull(index)) None
else
Some(accessor.asInstanceOf[NullableVarCharVector#Accessor].get(index))
}
}
> Arrow Memory Leak
> -
>
> Key: ARROW-855
> URL: https://issues.apache.org/jira/browse/ARROW-855
> Project: Apache Arrow
> Issue Type: Bug
> Components: Java - Memory, Java - Vectors
>Affects Versions: 0.1.0
> Environment: CentOS release 6.7+Indellij IDEA
>Reporter: xufusheng
>Priority: Critical
> Labels: test
>
> we create a memory table by arrow and the source data come from HBase.
> Create a memory table and then drop the table,there will be a memory leak.
> Hundreds of times,There will be OutOfMemoryError.
> anyone encounter similar problems?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (ARROW-855) Arrow Memory Leak
[ https://issues.apache.org/jira/browse/ARROW-855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975938#comment-15975938 ] Wes McKinney commented on ARROW-855: Is it possible to post the implementation of the Arrow*Pillar classes? > Arrow Memory Leak > - > > Key: ARROW-855 > URL: https://issues.apache.org/jira/browse/ARROW-855 > Project: Apache Arrow > Issue Type: Bug > Components: Java - Memory, Java - Vectors >Affects Versions: 0.1.0 > Environment: CentOS release 6.7+Indellij IDEA >Reporter: xufusheng >Priority: Critical > Labels: test > > we create a memory table by arrow and the source data come from HBase. > Create a memory table and then drop the table,there will be a memory leak. > Hundreds of times,There will be OutOfMemoryError. > anyone encounter similar problems? -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Comment Edited] (ARROW-855) Arrow Memory Leak
[
https://issues.apache.org/jira/browse/ARROW-855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975929#comment-15975929
]
xufusheng edited comment on ARROW-855 at 4/20/17 2:28 AM:
--
Our programming language is scala.
1.Through HashMap to store pillar
private val entries = new util.LinkedHashMap[PillarId, Pillar](32, 0.75f, true)
2.Pillar encapsulates the data structure of arrow
entries.put(pillarId, newPillar(getFieldDesc(pillarId.tableId,
pillarId.colIdx)))
def newPillar(fieldDesc: FieldDescription): Pillar = {
ArrowPillar.getPillar(fieldDesc, root)
}
object ArrowPillar {
@NeedTest
def getPillar(field: FieldDescription, allocator: BufferAllocator): Pillar = {
field.desc.getType match {
case MemoType.Boolean => new ArrowNullableBoolPillar(field, allocator)
case MemoType.Short => new ArrowNullableShortPillar(field, allocator)
..
}
}
}
trait Pillar{
def append(value:Option[Any]):Unit
..
}
3.The following is our free memory function
def remove(pillarId: PillarId): Boolean = {
entries.synchronized {
var pillar = entries.remove(pillarId)
if (pillar != null) {
pillar.close()
pillar = null
true
} else {
false
}
}
}
was (Author: fushengxu):
Our programming language is scala.
1.Through HashMap to store pillar
private val entries = new util.LinkedHashMap[PillarId, Pillar](32, 0.75f, true)
2.Pillar encapsulates the data structure of arrow
entries.put(pillarId, newPillar(getFieldDesc(pillarId.tableId,
pillarId.colIdx)))
def newPillar(fieldDesc: FieldDescription): Pillar = {
ArrowPillar.getPillar(fieldDesc, root)
}
object ArrowPillar {
@NeedTest
def getPillar(field: FieldDescription, allocator: BufferAllocator): Pillar = {
field.desc.getType match {
case MemoType.Boolean => new ArrowNullableBoolPillar(field, allocator)
case MemoType.Short => new ArrowNullableShortPillar(field, allocator)
..
}
}
trait Pillar{
def append(value:Option[Any]):Unit
..
}
3.The following is our release function
def remove(pillarId: PillarId): Boolean = {
entries.synchronized {
var pillar = entries.remove(pillarId)
if (pillar != null) {
pillar.close()
pillar = null
true
} else {
false
}
}
}
> Arrow Memory Leak
> -
>
> Key: ARROW-855
> URL: https://issues.apache.org/jira/browse/ARROW-855
> Project: Apache Arrow
> Issue Type: Bug
> Components: Java - Memory, Java - Vectors
>Affects Versions: 0.1.0
> Environment: CentOS release 6.7+Indellij IDEA
>Reporter: xufusheng
>Priority: Critical
> Labels: test
>
> we create a memory table by arrow and the source data come from HBase.
> Create a memory table and then drop the table,there will be a memory leak.
> Hundreds of times,There will be OutOfMemoryError.
> anyone encounter similar problems?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (ARROW-855) Arrow Memory Leak
[
https://issues.apache.org/jira/browse/ARROW-855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975933#comment-15975933
]
Wes McKinney commented on ARROW-855:
[~fushengxu] this isn't enough information to advise on the memory leak. Most
likely you have code that has failed to call {{release()}} on ArrowBuf objects.
> Arrow Memory Leak
> -
>
> Key: ARROW-855
> URL: https://issues.apache.org/jira/browse/ARROW-855
> Project: Apache Arrow
> Issue Type: Bug
> Components: Java - Memory, Java - Vectors
>Affects Versions: 0.1.0
> Environment: CentOS release 6.7+Indellij IDEA
>Reporter: xufusheng
>Priority: Critical
> Labels: test
>
> we create a memory table by arrow and the source data come from HBase.
> Create a memory table and then drop the table,there will be a memory leak.
> Hundreds of times,There will be OutOfMemoryError.
> anyone encounter similar problems?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (ARROW-855) Arrow Memory Leak
[
https://issues.apache.org/jira/browse/ARROW-855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975929#comment-15975929
]
xufusheng commented on ARROW-855:
-
Our programming language is scala.
1.Through HashMap to store pillar
private val entries = new util.LinkedHashMap[PillarId, Pillar](32, 0.75f, true)
2.Pillar encapsulates the data structure of arrow
entries.put(pillarId, newPillar(getFieldDesc(pillarId.tableId,
pillarId.colIdx)))
def newPillar(fieldDesc: FieldDescription): Pillar = {
ArrowPillar.getPillar(fieldDesc, root)
}
object ArrowPillar {
@NeedTest
def getPillar(field: FieldDescription, allocator: BufferAllocator): Pillar = {
field.desc.getType match {
case MemoType.Boolean => new ArrowNullableBoolPillar(field, allocator)
case MemoType.Short => new ArrowNullableShortPillar(field, allocator)
..
}
}
trait Pillar{
def append(value:Option[Any]):Unit
..
}
3.The following is our release function
def remove(pillarId: PillarId): Boolean = {
entries.synchronized {
var pillar = entries.remove(pillarId)
if (pillar != null) {
pillar.close()
pillar = null
true
} else {
false
}
}
}
> Arrow Memory Leak
> -
>
> Key: ARROW-855
> URL: https://issues.apache.org/jira/browse/ARROW-855
> Project: Apache Arrow
> Issue Type: Bug
> Components: Java - Memory, Java - Vectors
>Affects Versions: 0.1.0
> Environment: CentOS release 6.7+Indellij IDEA
>Reporter: xufusheng
>Priority: Critical
> Labels: test
>
> we create a memory table by arrow and the source data come from HBase.
> Create a memory table and then drop the table,there will be a memory leak.
> Hundreds of times,There will be OutOfMemoryError.
> anyone encounter similar problems?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ARROW-862) [Python] Improve source build instructions in README
Wes McKinney created ARROW-862: -- Summary: [Python] Improve source build instructions in README Key: ARROW-862 URL: https://issues.apache.org/jira/browse/ARROW-862 Project: Apache Arrow Issue Type: Improvement Components: Python Reporter: Wes McKinney Fix For: 0.3.0 To go along with the conda quickstart, we should improve the README to help users getting started building from source -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (ARROW-860) [C++] Decide if typed Tensor subclasses are worthwhile
[ https://issues.apache.org/jira/browse/ARROW-860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975819#comment-15975819 ] Wes McKinney commented on ARROW-860: PR: https://github.com/apache/arrow/pull/571 > [C++] Decide if typed Tensor subclasses are worthwhile > -- > > Key: ARROW-860 > URL: https://issues.apache.org/jira/browse/ARROW-860 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Reporter: Wes McKinney >Assignee: Wes McKinney > Fix For: 0.3.0 > > > See discussion in https://github.com/apache/arrow/pull/560. Since this is > primarily a data container (only `arrow::Tensor` being used in Python, for > example), and the subclasses are quite a bit of work to wrap, it's unclear > whether they are of high value to maintain. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Assigned] (ARROW-859) [C++] Do not build unit tests by default?
[ https://issues.apache.org/jira/browse/ARROW-859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-859: -- Assignee: Wes McKinney > [C++] Do not build unit tests by default? > - > > Key: ARROW-859 > URL: https://issues.apache.org/jira/browse/ARROW-859 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Reporter: Wes McKinney >Assignee: Wes McKinney > Fix For: 0.3.0 > > > This is strictly a subjective call -- since more people are using Arrow as a > thirdparty library, it might be preferably to only opt-in to running the unit > tests (vs. currently: explicitly opting out) for Arrow development. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (ARROW-859) [C++] Do not build unit tests by default?
[ https://issues.apache.org/jira/browse/ARROW-859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975808#comment-15975808 ] Wes McKinney commented on ARROW-859: PR: https://github.com/apache/arrow/pull/570 > [C++] Do not build unit tests by default? > - > > Key: ARROW-859 > URL: https://issues.apache.org/jira/browse/ARROW-859 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Reporter: Wes McKinney >Assignee: Wes McKinney > Fix For: 0.3.0 > > > This is strictly a subjective call -- since more people are using Arrow as a > thirdparty library, it might be preferably to only opt-in to running the unit > tests (vs. currently: explicitly opting out) for Arrow development. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Assigned] (ARROW-860) [C++] Decide if typed Tensor subclasses are worthwhile
[ https://issues.apache.org/jira/browse/ARROW-860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-860: -- Assignee: Wes McKinney > [C++] Decide if typed Tensor subclasses are worthwhile > -- > > Key: ARROW-860 > URL: https://issues.apache.org/jira/browse/ARROW-860 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Reporter: Wes McKinney >Assignee: Wes McKinney > Fix For: 0.3.0 > > > See discussion in https://github.com/apache/arrow/pull/560. Since this is > primarily a data container (only `arrow::Tensor` being used in Python, for > example), and the subclasses are quite a bit of work to wrap, it's unclear > whether they are of high value to maintain. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Assigned] (ARROW-748) [Python] Pin runtime library versions in conda-forge packages to force upgrades
[
https://issues.apache.org/jira/browse/ARROW-748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wes McKinney reassigned ARROW-748:
--
Assignee: Wes McKinney
> [Python] Pin runtime library versions in conda-forge packages to force
> upgrades
> ---
>
> Key: ARROW-748
> URL: https://issues.apache.org/jira/browse/ARROW-748
> Project: Apache Arrow
> Issue Type: Task
>Affects Versions: 0.2.0
> Environment: OS X 10.12.3, Python 3.5.2
>Reporter: Sterling Paramore
>Assignee: Wes McKinney
> Fix For: 0.3.0
>
>
> Had been using PyArrow 0.1 ok. Uninstalled 0.1. Installed 0.2 using
> {code}
> conda install -c conda-forge pyarrow
> {code}
> But then, when I try {code}import pyarrow{code}, I get the following error
> {code}
> ImportError Traceback (most recent call last)
> in ()
> > 1 import pyarrow as pa
> /Users/gnilrets/miniconda3/envs/pyitketl/lib/python3.5/site-packages/pyarrow/__init__.py
> in ()
> 26
> 27
> ---> 28 import pyarrow.config
> 29 from pyarrow.config import cpu_count, set_cpu_count
> 30
> ImportError:
> dlopen(/Users/gnilrets/miniconda3/envs/pyitketl/lib/python3.5/site-packages/pyarrow/config.cpython-35m-darwin.so,
> 2): Symbol not found: __ZN5arrow2io9Writeable5FlushEv
> Referenced from:
> /Users/gnilrets/miniconda3/envs/pyitketl/lib/python3.5/site-packages/pyarrow/libpyarrow.dylib
> Expected in:
> /Users/gnilrets/miniconda3/envs/pyitketl/lib/python3.5/site-packages/pyarrow/../../../libarrow_io.dylib
> in
> /Users/gnilrets/miniconda3/envs/pyitketl/lib/python3.5/site-packages/pyarrow/libpyarrow.dylib
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Updated] (ARROW-850) C++: Some static boost builds require linking to libicui18n
[
https://issues.apache.org/jira/browse/ARROW-850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wes McKinney updated ARROW-850:
---
Fix Version/s: (was: 0.3.0)
> C++: Some static boost builds require linking to libicui18n
> ---
>
> Key: ARROW-850
> URL: https://issues.apache.org/jira/browse/ARROW-850
> Project: Apache Arrow
> Issue Type: Bug
>Reporter: Uwe L. Korn
>
> In some cases, boost-regex was build with ICU and thus we also need to
> include {libicui18n.a} in the linking process.
> We may need a cmake check to see if this is necessary.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (ARROW-850) C++: Some static boost builds require linking to libicui18n
[
https://issues.apache.org/jira/browse/ARROW-850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975740#comment-15975740
]
Wes McKinney commented on ARROW-850:
Since boost-regex was just removed from the build, I removed this from the
release JIRA list
> C++: Some static boost builds require linking to libicui18n
> ---
>
> Key: ARROW-850
> URL: https://issues.apache.org/jira/browse/ARROW-850
> Project: Apache Arrow
> Issue Type: Bug
>Reporter: Uwe L. Korn
>
> In some cases, boost-regex was build with ICU and thus we also need to
> include {libicui18n.a} in the linking process.
> We may need a cmake check to see if this is necessary.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ARROW-861) [Python] Move DEVELOPMENT.md to Sphinx docs
Wes McKinney created ARROW-861: -- Summary: [Python] Move DEVELOPMENT.md to Sphinx docs Key: ARROW-861 URL: https://issues.apache.org/jira/browse/ARROW-861 Project: Apache Arrow Issue Type: Improvement Components: Python Reporter: Wes McKinney Fix For: 0.3.0 Slight oversight on my part, should have done this originally. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ARROW-860) [C++] Decide if typed Tensor subclasses are worthwhile
Wes McKinney created ARROW-860: -- Summary: [C++] Decide if typed Tensor subclasses are worthwhile Key: ARROW-860 URL: https://issues.apache.org/jira/browse/ARROW-860 Project: Apache Arrow Issue Type: Improvement Components: C++ Reporter: Wes McKinney Fix For: 0.3.0 See discussion in https://github.com/apache/arrow/pull/560. Since this is primarily a data container (only `arrow::Tensor` being used in Python, for example), and the subclasses are quite a bit of work to wrap, it's unclear whether they are of high value to maintain. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Assigned] (ARROW-846) [GLib] Add GArrowTensor, GArrowInt8Tensor and GArrowUInt8Tensor
[ https://issues.apache.org/jira/browse/ARROW-846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-846: -- Assignee: Kouhei Sutou > [GLib] Add GArrowTensor, GArrowInt8Tensor and GArrowUInt8Tensor > --- > > Key: ARROW-846 > URL: https://issues.apache.org/jira/browse/ARROW-846 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib >Reporter: Kouhei Sutou >Assignee: Kouhei Sutou > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (ARROW-846) [GLib] Add GArrowTensor, GArrowInt8Tensor and GArrowUInt8Tensor
[ https://issues.apache.org/jira/browse/ARROW-846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-846. Resolution: Fixed Issue resolved by pull request 560 [https://github.com/apache/arrow/pull/560] > [GLib] Add GArrowTensor, GArrowInt8Tensor and GArrowUInt8Tensor > --- > > Key: ARROW-846 > URL: https://issues.apache.org/jira/browse/ARROW-846 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib >Reporter: Kouhei Sutou > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (ARROW-858) Remove dependency on boost regex
[ https://issues.apache.org/jira/browse/ARROW-858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-858: --- Fix Version/s: 0.3.0 > Remove dependency on boost regex > > > Key: ARROW-858 > URL: https://issues.apache.org/jira/browse/ARROW-858 > Project: Apache Arrow > Issue Type: Bug >Reporter: Phillip Cloud >Assignee: Phillip Cloud > Labels: decimal, dependency > Fix For: 0.3.0 > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (ARROW-858) Remove dependency on boost regex
[ https://issues.apache.org/jira/browse/ARROW-858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-858. Resolution: Fixed Issue resolved by pull request 567 [https://github.com/apache/arrow/pull/567] > Remove dependency on boost regex > > > Key: ARROW-858 > URL: https://issues.apache.org/jira/browse/ARROW-858 > Project: Apache Arrow > Issue Type: Bug >Reporter: Phillip Cloud >Assignee: Phillip Cloud > Labels: decimal, dependency > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ARROW-859) [C++] Do not build unit tests by default?
Wes McKinney created ARROW-859: -- Summary: [C++] Do not build unit tests by default? Key: ARROW-859 URL: https://issues.apache.org/jira/browse/ARROW-859 Project: Apache Arrow Issue Type: Improvement Components: C++ Reporter: Wes McKinney Fix For: 0.3.0 This is strictly a subjective call -- since more people are using Arrow as a thirdparty library, it might be preferably to only opt-in to running the unit tests (vs. currently: explicitly opting out) for Arrow development. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (ARROW-848) [Python] Improvements / fixes to conda quickstart guide
[ https://issues.apache.org/jira/browse/ARROW-848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-848. Resolution: Fixed Issue resolved by pull request 562 [https://github.com/apache/arrow/pull/562] > [Python] Improvements / fixes to conda quickstart guide > --- > > Key: ARROW-848 > URL: https://issues.apache.org/jira/browse/ARROW-848 > Project: Apache Arrow > Issue Type: Improvement > Components: Python >Reporter: Wes McKinney >Assignee: Wes McKinney > Fix For: 0.3.0 > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ARROW-858) Remove dependency on boost regex
Phillip Cloud created ARROW-858: --- Summary: Remove dependency on boost regex Key: ARROW-858 URL: https://issues.apache.org/jira/browse/ARROW-858 Project: Apache Arrow Issue Type: Bug Reporter: Phillip Cloud Assignee: Phillip Cloud -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975288#comment-15975288 ] Kazuaki Ishizaki commented on ARROW-300: [~wesmckinn] Thank you for your kindly and positive comment. I will work for preparing a proposal (It would take some time since I have to prepare a presentation for GTC, too). [~xhochy] IIUC, Parquet is used for a persistent file. Arrow is used for in-memory format. What level of proposal do you expect? For example, * What we want to do (e.g. RLE, Delta-encoding) * New meta data format to support new compression schemes (new .fbs file) * Data format for new compression schemes * Prototype implementation * others Also, will that proposal be posted into another JIRA entry or a comment in this JIRA entry? > [Format] Add buffer compression option to IPC file format > - > > Key: ARROW-300 > URL: https://issues.apache.org/jira/browse/ARROW-300 > Project: Apache Arrow > Issue Type: New Feature > Components: Format >Reporter: Wes McKinney > > It may be useful if data is to be sent over the wire to compress the data > buffers themselves as their being written in the file layout. > I would propose that we keep this extremely simple with a global buffer > compression setting in the file Footer. Probably only two compressors worth > supporting out of the box would be zlib (higher compression ratios) and lz4 > (better performance). > What does everyone think? -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (ARROW-853) [Python] It is no longer necessary to modify the RPATH of the Cython extensions on many environments
[ https://issues.apache.org/jira/browse/ARROW-853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved ARROW-853. --- Resolution: Fixed Issue resolved by pull request 564 [https://github.com/apache/arrow/pull/564] > [Python] It is no longer necessary to modify the RPATH of the Cython > extensions on many environments > > > Key: ARROW-853 > URL: https://issues.apache.org/jira/browse/ARROW-853 > Project: Apache Arrow > Issue Type: Bug > Components: Python >Reporter: Wes McKinney >Assignee: Wes McKinney > Fix For: 0.3.0 > > > Discovered in https://github.com/apache/arrow/pull/562 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (ARROW-824) Date and Time Vectors should reflect timezone-less semantics
[ https://issues.apache.org/jira/browse/ARROW-824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-824: --- Fix Version/s: 0.3.0 > Date and Time Vectors should reflect timezone-less semantics > > > Key: ARROW-824 > URL: https://issues.apache.org/jira/browse/ARROW-824 > Project: Apache Arrow > Issue Type: Bug > Components: Java - Vectors >Reporter: Julien Le Dem >Assignee: Julien Le Dem > Fix For: 0.3.0 > > > Currently getObject returns a Date|Time|DateTime and should return the Local* > equivalent: > https://github.com/apache/arrow/blob/b6033378c2533ed7b396f111cc5aed10450907fb/java/vector/src/main/codegen/templates/FixedValueVectors.java#L520 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Assigned] (ARROW-824) Date and Time Vectors should reflect timezone-less semantics
[ https://issues.apache.org/jira/browse/ARROW-824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem reassigned ARROW-824: --- Assignee: Julien Le Dem > Date and Time Vectors should reflect timezone-less semantics > > > Key: ARROW-824 > URL: https://issues.apache.org/jira/browse/ARROW-824 > Project: Apache Arrow > Issue Type: Bug > Components: Java - Vectors >Reporter: Julien Le Dem >Assignee: Julien Le Dem > Fix For: 0.3.0 > > > Currently getObject returns a Date|Time|DateTime and should return the Local* > equivalent: > https://github.com/apache/arrow/blob/b6033378c2533ed7b396f111cc5aed10450907fb/java/vector/src/main/codegen/templates/FixedValueVectors.java#L520 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (ARROW-856) CmakeError by Unknown compiler.
[
https://issues.apache.org/jira/browse/ARROW-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975146#comment-15975146
]
Wes McKinney commented on ARROW-856:
What CMake version are you using?
{code}
$ cmake --version
{code}
Can you add this line
{code}
message(INFO "COMPILER_VERSION_FULL: ${COMPILER_VERSION_FULL}")
{code}
to
https://github.com/apache/arrow/blob/master/cpp/cmake_modules/CompilerInfo.cmake
and let us know what it prints out? Thanks
> CmakeError by Unknown compiler.
>
>
> Key: ARROW-856
> URL: https://issues.apache.org/jira/browse/ARROW-856
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, Python
>Reporter: YJ
>
> From :https://github.com/ray-project/ray/issues/468
> [root@SZV1000268092 python]# LANG=C gcc -v
> Using built-in specs.
> COLLECT_GCC=gcc
> COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-redhat-linux/4.8.5/lto-wrapper
> Target: x86_64-redhat-linux
> Configured with: ../configure --prefix=/usr --mandir=/usr/share/man
> --infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla
> --enable-bootstrap --enable-shared --enable-threads=posix
> --enable-checking=release --with-system-zlib --enable-__cxa_atexit
> --disable-libunwind-exceptions --enable-gnu-unique-object
> --enable-linker-build-id --with-linker-hash-style=gnu
> --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin
> --enable-initfini-array --disable-libgcj
> --with-isl=/builddir/build/BUILD/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/isl-install
>
> --with-cloog=/builddir/build/BUILD/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/cloog-install
> --enable-gnu-indirect-function --with-tune=generic --with-arch_32=x86-64
> --build=x86_64-redhat-linux
> Thread model: posix
> gcc version 4.8.5 20150623 (Red Hat 4.8.5-11) (GCC)
> Result:
> INFO GNU
> CMake Error at cmake_modules/CompilerInfo.cmake:62 (message):
> Unknown compiler. Version info is just the above.
> Error
> /usr/bin/c++-g -O3 -march=native -mtune=native -DCXX_SUPPORTS_ALTIVEC
> -maltivec -o CMakeFiles/cmTryCompileExec1115247767.dir/src.cxx.o -c
> /home/dl/yangjie/ray/src/numbuf/thirdparty/arrow/cpp/build/CMakeFiles/CMakeTmp/src.cxx
> c++: error: unrecognized command line option '-maltivec'
> make[1]: *** [CMakeFiles/cmTryCompileExec1115247767.dir/src.cxx.o] Error 1
> make[1]: Leaving directory
> `/home/dl/yangjie/ray/src/numbuf/thirdparty/arrow/cpp/build/CMakeFiles/CMakeTmp'
> make: *** [cmTryCompileExec1115247767/fast] Error 2
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ARROW-857) [Python] Automate publishing Python documentation to arrow-site
Wes McKinney created ARROW-857: -- Summary: [Python] Automate publishing Python documentation to arrow-site Key: ARROW-857 URL: https://issues.apache.org/jira/browse/ARROW-857 Project: Apache Arrow Issue Type: Improvement Components: Python Reporter: Wes McKinney Fix For: 0.3.0 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (ARROW-841) [Python] Add pyarrow build to Appveyor
[ https://issues.apache.org/jira/browse/ARROW-841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-841. Resolution: Fixed Issue resolved by pull request 566 [https://github.com/apache/arrow/pull/566] > [Python] Add pyarrow build to Appveyor > -- > > Key: ARROW-841 > URL: https://issues.apache.org/jira/browse/ARROW-841 > Project: Apache Arrow > Issue Type: Improvement > Components: C++, Python >Reporter: Wes McKinney >Assignee: Wes McKinney > Fix For: 0.3.0 > > > Work to do after ARROW-734 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (ARROW-851) C++/Python: Check Boost/Arrow C++ABI for consistency
[
https://issues.apache.org/jira/browse/ARROW-851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15974780#comment-15974780
]
Uwe L. Korn commented on ARROW-851:
---
Yes, we should be able to check this automatically in CMake. For 0.3,
documentation should suffice but I can do a PR later on that does the check in
CMake.
> C++/Python: Check Boost/Arrow C++ABI for consistency
>
>
> Key: ARROW-851
> URL: https://issues.apache.org/jira/browse/ARROW-851
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, Python
>Reporter: Uwe L. Korn
> Fix For: 0.3.0
>
>
> When building with dependencies from conda-forge on a newer system with GCC,
> the C++ ABI versions can differ. We need to ensure that the versions match
> between Boost, arrow-cpp and pyarrow in our CMake scripts.
> Depending on this, we may need to pass {{-D_GLIBCXX_USE_CXX11_ABI=0}} to
> {{CMAKE_CXX_FLAGS}}.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (ARROW-855) Arrow Memory Leak
[ https://issues.apache.org/jira/browse/ARROW-855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15974753#comment-15974753 ] Uwe L. Korn commented on ARROW-855: --- Hello, [~fushengxu]. Can you provide a code sample how you interact with Arrow and HBase? From your message it is unclear how to reproduce the problem. > Arrow Memory Leak > - > > Key: ARROW-855 > URL: https://issues.apache.org/jira/browse/ARROW-855 > Project: Apache Arrow > Issue Type: Bug > Components: Java - Memory, Java - Vectors >Affects Versions: 0.1.0 > Environment: CentOS release 6.7+Indellij IDEA >Reporter: xufusheng >Priority: Critical > Labels: test > > we create a memory table by arrow and the source data come from HBase. > Create a memory table and then drop the table,there will be a memory leak. > Hundreds of times,There will be OutOfMemoryError. > anyone encounter similar problems? -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (ARROW-856) CmakeError by Unknown compiler.
[ https://issues.apache.org/jira/browse/ARROW-856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YJ updated ARROW-856: - Description: >From :https://github.com/ray-project/ray/issues/468 [root@SZV1000268092 python]# LANG=C gcc -v Using built-in specs. COLLECT_GCC=gcc COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-redhat-linux/4.8.5/lto-wrapper Target: x86_64-redhat-linux Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla --enable-bootstrap --enable-shared --enable-threads=posix --enable-checking=release --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-gnu-unique-object --enable-linker-build-id --with-linker-hash-style=gnu --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-initfini-array --disable-libgcj --with-isl=/builddir/build/BUILD/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/isl-install --with-cloog=/builddir/build/BUILD/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/cloog-install --enable-gnu-indirect-function --with-tune=generic --with-arch_32=x86-64 --build=x86_64-redhat-linux Thread model: posix gcc version 4.8.5 20150623 (Red Hat 4.8.5-11) (GCC) Result: INFO GNU CMake Error at cmake_modules/CompilerInfo.cmake:62 (message): Unknown compiler. Version info is just the above. Error /usr/bin/c++-g -O3 -march=native -mtune=native -DCXX_SUPPORTS_ALTIVEC -maltivec -o CMakeFiles/cmTryCompileExec1115247767.dir/src.cxx.o -c /home/dl/yangjie/ray/src/numbuf/thirdparty/arrow/cpp/build/CMakeFiles/CMakeTmp/src.cxx c++: error: unrecognized command line option '-maltivec' make[1]: *** [CMakeFiles/cmTryCompileExec1115247767.dir/src.cxx.o] Error 1 make[1]: Leaving directory `/home/dl/yangjie/ray/src/numbuf/thirdparty/arrow/cpp/build/CMakeFiles/CMakeTmp' make: *** [cmTryCompileExec1115247767/fast] Error 2 was: [root@SZV1000268092 python]# LANG=C gcc -v Using built-in specs. COLLECT_GCC=gcc COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-redhat-linux/4.8.5/lto-wrapper Target: x86_64-redhat-linux Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla --enable-bootstrap --enable-shared --enable-threads=posix --enable-checking=release --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-gnu-unique-object --enable-linker-build-id --with-linker-hash-style=gnu --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-initfini-array --disable-libgcj --with-isl=/builddir/build/BUILD/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/isl-install --with-cloog=/builddir/build/BUILD/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/cloog-install --enable-gnu-indirect-function --with-tune=generic --with-arch_32=x86-64 --build=x86_64-redhat-linux Thread model: posix gcc version 4.8.5 20150623 (Red Hat 4.8.5-11) (GCC) Result: INFO GNU CMake Error at cmake_modules/CompilerInfo.cmake:62 (message): Unknown compiler. Version info: Using built-in specs. COLLECT_GCC=gcc COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-redhat-linux/4.8.5/lto-wrapper Target: x86_64-redhat-linux Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla --enable-bootstrap --enable-shared --enable-threads=posix --enable-checking=release --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-gnu-unique-object --enable-linker-build-id --with-linker-hash-style=gnu --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-initfini-array --disable-libgcj --with-isl=/builddir/build/BUILD/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/isl-install --with-cloog=/builddir/build/BUILD/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/cloog-install --enable-gnu-indirect-function --with-tune=generic --with-arch_32=x86-64 --build=x86_64-redhat-linux Thread model: posix gcc version 4.8.5 20150623 (Red Hat 4.8.5-11) (GCC) Call Stack (most recent call first): CMakeLists.txt:156 (include) -- Configuring incomplete, errors occurred! See also "/root/yangjie/ray2/src/numbuf/thirdparty/arrow/cpp/build/CMakeFiles/CMakeOutput.log". See also "/root/yangjie/ray2/src/numbuf/thirdparty/arrow/cpp/build/CMakeFiles/CMakeError.log". Traceback (most recent call last): File "setup.py", line 46, in license="Apache 2.0") File "/root/anaconda2/lib/python2.7/distutils/core.py", line 151, in setup dist.run_commands() File "/root/anaconda2/lib/python2.7/distutils/dist.py", line 953, in run_commands self.run_command(cmd) File "/root/anaconda2/lib/python2.7/distutils/dist.py", line 972, in run_command cmd_obj.run() File "setup.py", line 13, in run subprocess.check_call(["../build.sh"]) File "/root/anaconda2/lib/python2.7/subprocess.py", line 541, in check_call raise CalledProcessError(retcode,
[jira] [Updated] (ARROW-856) CmakeError by Unknown compiler.
[ https://issues.apache.org/jira/browse/ARROW-856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YJ updated ARROW-856: - Description: [root@SZV1000268092 python]# LANG=C gcc -v Using built-in specs. COLLECT_GCC=gcc COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-redhat-linux/4.8.5/lto-wrapper Target: x86_64-redhat-linux Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla --enable-bootstrap --enable-shared --enable-threads=posix --enable-checking=release --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-gnu-unique-object --enable-linker-build-id --with-linker-hash-style=gnu --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-initfini-array --disable-libgcj --with-isl=/builddir/build/BUILD/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/isl-install --with-cloog=/builddir/build/BUILD/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/cloog-install --enable-gnu-indirect-function --with-tune=generic --with-arch_32=x86-64 --build=x86_64-redhat-linux Thread model: posix gcc version 4.8.5 20150623 (Red Hat 4.8.5-11) (GCC) Result: INFO GNU CMake Error at cmake_modules/CompilerInfo.cmake:62 (message): Unknown compiler. Version info: Using built-in specs. COLLECT_GCC=gcc COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-redhat-linux/4.8.5/lto-wrapper Target: x86_64-redhat-linux Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla --enable-bootstrap --enable-shared --enable-threads=posix --enable-checking=release --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-gnu-unique-object --enable-linker-build-id --with-linker-hash-style=gnu --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-initfini-array --disable-libgcj --with-isl=/builddir/build/BUILD/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/isl-install --with-cloog=/builddir/build/BUILD/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/cloog-install --enable-gnu-indirect-function --with-tune=generic --with-arch_32=x86-64 --build=x86_64-redhat-linux Thread model: posix gcc version 4.8.5 20150623 (Red Hat 4.8.5-11) (GCC) Call Stack (most recent call first): CMakeLists.txt:156 (include) -- Configuring incomplete, errors occurred! See also "/root/yangjie/ray2/src/numbuf/thirdparty/arrow/cpp/build/CMakeFiles/CMakeOutput.log". See also "/root/yangjie/ray2/src/numbuf/thirdparty/arrow/cpp/build/CMakeFiles/CMakeError.log". Traceback (most recent call last): File "setup.py", line 46, in license="Apache 2.0") File "/root/anaconda2/lib/python2.7/distutils/core.py", line 151, in setup dist.run_commands() File "/root/anaconda2/lib/python2.7/distutils/dist.py", line 953, in run_commands self.run_command(cmd) File "/root/anaconda2/lib/python2.7/distutils/dist.py", line 972, in run_command cmd_obj.run() File "setup.py", line 13, in run subprocess.check_call(["../build.sh"]) File "/root/anaconda2/lib/python2.7/subprocess.py", line 541, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['../build.sh']' returned non-zero exit status 1 Error Run Build Command:/usr/bin/make "cmTryCompileExec1115247767/fast" /usr/bin/make -f CMakeFiles/cmTryCompileExec1115247767.dir/build.make CMakeFiles/cmTryCompileExec1115247767.dir/build make[1]: Entering directory /home/dl/yangjie/ray/src/numbuf/thirdparty/arrow/cpp/build/CMakeFiles/CMakeTmp' /usr/bin/cmake -E cmake_progress_report /home/dl/yangjie/ray/src/numbuf/thirdparty/arrow/cpp/build/CMakeFiles/CMakeTmp/CMakeFiles 1 Building CXX object CMakeFiles/cmTryCompileExec1115247767.dir/src.cxx.o /usr/bin/c++ -g -O3 -march=native -mtune=native -DCXX_SUPPORTS_ALTIVEC -maltivec -o CMakeFiles/cmTryCompileExec1115247767.dir/src.cxx.o -c /home/dl/yangjie/ray/src/numbuf/thirdparty/arrow/cpp/build/CMakeFiles/CMakeTmp/src.cxx c++: error: unrecognized command line option '-maltivec' make[1]: *** [CMakeFiles/cmTryCompileExec1115247767.dir/src.cxx.o] Error 1 make[1]: Leaving directory/home/dl/yangjie/ray/src/numbuf/thirdparty/arrow/cpp/build/CMakeFiles/CMakeTmp' make: *** [cmTryCompileExec1115247767/fast] Error 2 was: [root@SZV1000268092 python]# LANG=C gcc -v Using built-in specs. COLLECT_GCC=gcc COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-redhat-linux/4.8.5/lto-wrapper Target: x86_64-redhat-linux Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla --enable-bootstrap --enable-shared --enable-threads=posix --enable-checking=release --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-gnu-unique-object --enable-linker-build-id --with-linker-hash-style=gnu --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-
[jira] [Created] (ARROW-856) CmakeError by Unknown compiler.
YJ created ARROW-856: Summary: CmakeError by Unknown compiler. Key: ARROW-856 URL: https://issues.apache.org/jira/browse/ARROW-856 Project: Apache Arrow Issue Type: Bug Components: C++, Python Reporter: YJ [root@SZV1000268092 python]# LANG=C gcc -v Using built-in specs. COLLECT_GCC=gcc COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-redhat-linux/4.8.5/lto-wrapper Target: x86_64-redhat-linux Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla --enable-bootstrap --enable-shared --enable-threads=posix --enable-checking=release --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-gnu-unique-object --enable-linker-build-id --with-linker-hash-style=gnu --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-initfini-array --disable-libgcj --with-isl=/builddir/build/BUILD/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/isl-install --with-cloog=/builddir/build/BUILD/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/cloog-install --enable-gnu-indirect-function --with-tune=generic --with-arch_32=x86-64 --build=x86_64-redhat-linux Thread model: posix gcc version 4.8.5 20150623 (Red Hat 4.8.5-11) (GCC) Compilation error on redHat: Result: INFO GNU CMake Error at cmake_modules/CompilerInfo.cmake:62 (message): Unknown compiler. Version info: Using built-in specs. COLLECT_GCC=gcc COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-redhat-linux/4.8.5/lto-wrapper Target: x86_64-redhat-linux Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla --enable-bootstrap --enable-shared --enable-threads=posix --enable-checking=release --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-gnu-unique-object --enable-linker-build-id --with-linker-hash-style=gnu --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-initfini-array --disable-libgcj --with-isl=/builddir/build/BUILD/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/isl-install --with-cloog=/builddir/build/BUILD/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/cloog-install --enable-gnu-indirect-function --with-tune=generic --with-arch_32=x86-64 --build=x86_64-redhat-linux Thread model: posix gcc version 4.8.5 20150623 (Red Hat 4.8.5-11) (GCC) Call Stack (most recent call first): CMakeLists.txt:156 (include) -- Configuring incomplete, errors occurred! See also "/root/yangjie/ray2/src/numbuf/thirdparty/arrow/cpp/build/CMakeFiles/CMakeOutput.log". See also "/root/yangjie/ray2/src/numbuf/thirdparty/arrow/cpp/build/CMakeFiles/CMakeError.log". Traceback (most recent call last): File "setup.py", line 46, in license="Apache 2.0") File "/root/anaconda2/lib/python2.7/distutils/core.py", line 151, in setup dist.run_commands() File "/root/anaconda2/lib/python2.7/distutils/dist.py", line 953, in run_commands self.run_command(cmd) File "/root/anaconda2/lib/python2.7/distutils/dist.py", line 972, in run_command cmd_obj.run() File "setup.py", line 13, in run subprocess.check_call(["../build.sh"]) File "/root/anaconda2/lib/python2.7/subprocess.py", line 541, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['../build.sh']' returned non-zero exit status 1 Error Run Build Command:/usr/bin/make "cmTryCompileExec1115247767/fast" /usr/bin/make -f CMakeFiles/cmTryCompileExec1115247767.dir/build.make CMakeFiles/cmTryCompileExec1115247767.dir/build make[1]: Entering directory /home/dl/yangjie/ray/src/numbuf/thirdparty/arrow/cpp/build/CMakeFiles/CMakeTmp' /usr/bin/cmake -E cmake_progress_report /home/dl/yangjie/ray/src/numbuf/thirdparty/arrow/cpp/build/CMakeFiles/CMakeTmp/CMakeFiles 1 Building CXX object CMakeFiles/cmTryCompileExec1115247767.dir/src.cxx.o /usr/bin/c++ -g -O3 -march=native -mtune=native -DCXX_SUPPORTS_ALTIVEC -maltivec -o CMakeFiles/cmTryCompileExec1115247767.dir/src.cxx.o -c /home/dl/yangjie/ray/src/numbuf/thirdparty/arrow/cpp/build/CMakeFiles/CMakeTmp/src.cxx c++: error: unrecognized command line option '-maltivec' make[1]: *** [CMakeFiles/cmTryCompileExec1115247767.dir/src.cxx.o] Error 1 make[1]: Leaving directory/home/dl/yangjie/ray/src/numbuf/thirdparty/arrow/cpp/build/CMakeFiles/CMakeTmp' make: *** [cmTryCompileExec1115247767/fast] Error 2 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ARROW-855) Arrow Memory Leak
xufusheng created ARROW-855: --- Summary: Arrow Memory Leak Key: ARROW-855 URL: https://issues.apache.org/jira/browse/ARROW-855 Project: Apache Arrow Issue Type: Bug Components: Java - Memory, Java - Vectors Affects Versions: 0.1.0 Environment: CentOS release 6.7+Indellij IDEA Reporter: xufusheng Priority: Critical we create a memory table by arrow and the source data come from HBase. Create a memory table and then drop the table,there will be a memory leak. Hundreds of times,There will be OutOfMemoryError. anyone encounter similar problems? -- This message was sent by Atlassian JIRA (v6.3.15#6346)
