http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.RecordBatch.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.RecordBatch.html b/docs/python/generated/pyarrow.RecordBatch.html index 0a2c2d9..62ad3b9 100644 --- a/docs/python/generated/pyarrow.RecordBatch.html +++ b/docs/python/generated/pyarrow.RecordBatch.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -176,13 +177,16 @@ methods instead.</p> <tr class="row-even"><td><a class="reference internal" href="#pyarrow.RecordBatch.from_pandas" title="pyarrow.RecordBatch.from_pandas"><code class="xref py py-obj docutils literal"><span class="pre">from_pandas</span></code></a>(type cls, df, ...)</td> <td>Convert pandas.DataFrame to an Arrow RecordBatch</td> </tr> -<tr class="row-odd"><td><a class="reference internal" href="#pyarrow.RecordBatch.slice" title="pyarrow.RecordBatch.slice"><code class="xref py py-obj docutils literal"><span class="pre">slice</span></code></a>(self[, offset, length])</td> +<tr class="row-odd"><td><a class="reference internal" href="#pyarrow.RecordBatch.replace_schema_metadata" title="pyarrow.RecordBatch.replace_schema_metadata"><code class="xref py py-obj docutils literal"><span class="pre">replace_schema_metadata</span></code></a>(self, dict metadata=None)</td> +<td>EXPERIMENTAL: Create shallow copy of record batch by replacing schema</td> +</tr> +<tr class="row-even"><td><a class="reference internal" href="#pyarrow.RecordBatch.slice" title="pyarrow.RecordBatch.slice"><code class="xref py py-obj docutils literal"><span class="pre">slice</span></code></a>(self[, offset, length])</td> <td>Compute zero-copy slice of this RecordBatch</td> </tr> -<tr class="row-even"><td><a class="reference internal" href="#pyarrow.RecordBatch.to_pandas" title="pyarrow.RecordBatch.to_pandas"><code class="xref py py-obj docutils literal"><span class="pre">to_pandas</span></code></a>(self[, nthreads])</td> +<tr class="row-odd"><td><a class="reference internal" href="#pyarrow.RecordBatch.to_pandas" title="pyarrow.RecordBatch.to_pandas"><code class="xref py py-obj docutils literal"><span class="pre">to_pandas</span></code></a>(self[, nthreads])</td> <td>Convert the arrow::RecordBatch to a pandas DataFrame</td> </tr> -<tr class="row-odd"><td><a class="reference internal" href="#pyarrow.RecordBatch.to_pydict" title="pyarrow.RecordBatch.to_pydict"><code class="xref py py-obj docutils literal"><span class="pre">to_pydict</span></code></a>(self)</td> +<tr class="row-even"><td><a class="reference internal" href="#pyarrow.RecordBatch.to_pydict" title="pyarrow.RecordBatch.to_pydict"><code class="xref py py-obj docutils literal"><span class="pre">to_pydict</span></code></a>(self)</td> <td>Converted the arrow::RecordBatch to an OrderedDict</td> </tr> </tbody> @@ -255,7 +259,7 @@ methods instead.</p> <tbody valign="top"> <tr class="field-odd field"><th class="field-name">Parameters:</th><td class="field-body"><ul class="first simple"> <li><strong>df</strong> (<em>pandas.DataFrame</em>) – </li> -<li><strong>schema</strong> (<a class="reference internal" href="pyarrow.Schema.html#pyarrow.Schema" title="pyarrow.Schema"><em>pyarrow.Schema</em></a><em>, </em><em>optional</em>) – The expected schema of the RecordBatch. This can be used to +<li><strong>schema</strong> (<em>pyarrow.Schema</em><em>, </em><em>optional</em>) – The expected schema of the RecordBatch. This can be used to indicate the type of columns if we cannot infer it automatically.</li> <li><strong>preserve_index</strong> (<em>bool</em><em>, </em><em>optional</em>) – Whether to store the index as an additional column in the resulting <code class="docutils literal"><span class="pre">RecordBatch</span></code>.</li> @@ -299,6 +303,24 @@ number of rows.</p> </table> </dd></dl> +<dl class="method"> +<dt id="pyarrow.RecordBatch.replace_schema_metadata"> +<code class="descname">replace_schema_metadata</code><span class="sig-paren">(</span><em>self</em>, <em>dict metadata=None</em><span class="sig-paren">)</span><a class="headerlink" href="#pyarrow.RecordBatch.replace_schema_metadata" title="Permalink to this definition">¶</a></dt> +<dd><p>EXPERIMENTAL: Create shallow copy of record batch by replacing schema +key-value metadata with the indicated new metadata (which may be None, +which deletes any existing metadata</p> +<table class="docutils field-list" frame="void" rules="none"> +<col class="field-name" /> +<col class="field-body" /> +<tbody valign="top"> +<tr class="field-odd field"><th class="field-name">Parameters:</th><td class="field-body"><strong>metadata</strong> (<em>dict</em><em>, </em><em>default None</em>) – </td> +</tr> +<tr class="field-even field"><th class="field-name">Returns:</th><td class="field-body"><strong>shallow_copy</strong> (<em>RecordBatch</em>)</td> +</tr> +</tbody> +</table> +</dd></dl> + <dl class="attribute"> <dt id="pyarrow.RecordBatch.schema"> <code class="descname">schema</code><a class="headerlink" href="#pyarrow.RecordBatch.schema" title="Permalink to this definition">¶</a></dt>
http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.RecordBatchFileReader.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.RecordBatchFileReader.html b/docs/python/generated/pyarrow.RecordBatchFileReader.html index e935e24..4a3871e 100644 --- a/docs/python/generated/pyarrow.RecordBatchFileReader.html +++ b/docs/python/generated/pyarrow.RecordBatchFileReader.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -101,7 +102,7 @@ <li> - <a href="pyarrow.MessageReader.html" title="Previous Chapter: pyarrow.MessageReader"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.MessageReader</span> + <a href="pyarrow.MessageReader.html" title="Previous Chapter: pyarrow.MessageReader"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.Messa...</span> </a> </li> <li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.RecordBatchFileWriter.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.RecordBatchFileWriter.html b/docs/python/generated/pyarrow.RecordBatchFileWriter.html index 7b0e569..e620c92 100644 --- a/docs/python/generated/pyarrow.RecordBatchFileWriter.html +++ b/docs/python/generated/pyarrow.RecordBatchFileWriter.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -152,7 +153,7 @@ <tbody valign="top"> <tr class="field-odd field"><th class="field-name">Parameters:</th><td class="field-body"><ul class="first last simple"> <li><strong>sink</strong> (<em>str</em><em>, </em><a class="reference internal" href="pyarrow.NativeFile.html#pyarrow.NativeFile" title="pyarrow.NativeFile"><em>pyarrow.NativeFile</em></a><em>, or </em><em>file-like Python object</em>) – Either a file path, or a writeable file object</li> -<li><strong>schema</strong> (<a class="reference internal" href="pyarrow.Schema.html#pyarrow.Schema" title="pyarrow.Schema"><em>pyarrow.Schema</em></a>) – The Arrow schema for data to be written to the file</li> +<li><strong>schema</strong> (<em>pyarrow.Schema</em>) – The Arrow schema for data to be written to the file</li> </ul> </td> </tr> @@ -174,22 +175,32 @@ <td></td> </tr> <tr class="row-even"><td><a class="reference internal" href="#pyarrow.RecordBatchFileWriter.close" title="pyarrow.RecordBatchFileWriter.close"><code class="xref py py-obj docutils literal"><span class="pre">close</span></code></a>(self)</td> -<td></td> +<td>Close stream and write end-of-stream 0 marker</td> </tr> <tr class="row-odd"><td><a class="reference internal" href="#pyarrow.RecordBatchFileWriter.write_batch" title="pyarrow.RecordBatchFileWriter.write_batch"><code class="xref py py-obj docutils literal"><span class="pre">write_batch</span></code></a>(self, RecordBatch batch)</td> -<td></td> +<td>Write RecordBatch to stream</td> </tr> </tbody> </table> <dl class="method"> <dt id="pyarrow.RecordBatchFileWriter.close"> <code class="descname">close</code><span class="sig-paren">(</span><em>self</em><span class="sig-paren">)</span><a class="headerlink" href="#pyarrow.RecordBatchFileWriter.close" title="Permalink to this definition">¶</a></dt> -<dd></dd></dl> +<dd><p>Close stream and write end-of-stream 0 marker</p> +</dd></dl> <dl class="method"> <dt id="pyarrow.RecordBatchFileWriter.write_batch"> <code class="descname">write_batch</code><span class="sig-paren">(</span><em>self</em>, <em>RecordBatch batch</em><span class="sig-paren">)</span><a class="headerlink" href="#pyarrow.RecordBatchFileWriter.write_batch" title="Permalink to this definition">¶</a></dt> -<dd></dd></dl> +<dd><p>Write RecordBatch to stream</p> +<table class="docutils field-list" frame="void" rules="none"> +<col class="field-name" /> +<col class="field-body" /> +<tbody valign="top"> +<tr class="field-odd field"><th class="field-name">Parameters:</th><td class="field-body"><strong>batch</strong> (<a class="reference internal" href="pyarrow.RecordBatch.html#pyarrow.RecordBatch" title="pyarrow.RecordBatch"><em>RecordBatch</em></a>) – </td> +</tr> +</tbody> +</table> +</dd></dl> </dd></dl> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.RecordBatchStreamReader.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.RecordBatchStreamReader.html b/docs/python/generated/pyarrow.RecordBatchStreamReader.html index 2c1f6cc..374693a 100644 --- a/docs/python/generated/pyarrow.RecordBatchStreamReader.html +++ b/docs/python/generated/pyarrow.RecordBatchStreamReader.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.RecordBatchStreamWriter.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.RecordBatchStreamWriter.html b/docs/python/generated/pyarrow.RecordBatchStreamWriter.html index 0429933..1847f86 100644 --- a/docs/python/generated/pyarrow.RecordBatchStreamWriter.html +++ b/docs/python/generated/pyarrow.RecordBatchStreamWriter.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -105,7 +106,7 @@ </a> </li> <li> - <a href="pyarrow.open_file.html" title="Next Chapter: pyarrow.open_file"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.open_file »</span> + <a href="pyarrow.open_file.html" title="Next Chapter: pyarrow.open_file"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.open_... »</span> </a> </li> @@ -152,7 +153,7 @@ <tbody valign="top"> <tr class="field-odd field"><th class="field-name">Parameters:</th><td class="field-body"><ul class="first last simple"> <li><strong>sink</strong> (<em>str</em><em>, </em><a class="reference internal" href="pyarrow.NativeFile.html#pyarrow.NativeFile" title="pyarrow.NativeFile"><em>pyarrow.NativeFile</em></a><em>, or </em><em>file-like Python object</em>) – Either a file path, or a writeable file object</li> -<li><strong>schema</strong> (<a class="reference internal" href="pyarrow.Schema.html#pyarrow.Schema" title="pyarrow.Schema"><em>pyarrow.Schema</em></a>) – The Arrow schema for data to be written to the file</li> +<li><strong>schema</strong> (<em>pyarrow.Schema</em>) – The Arrow schema for data to be written to the file</li> </ul> </td> </tr> @@ -174,22 +175,32 @@ <td></td> </tr> <tr class="row-even"><td><a class="reference internal" href="#pyarrow.RecordBatchStreamWriter.close" title="pyarrow.RecordBatchStreamWriter.close"><code class="xref py py-obj docutils literal"><span class="pre">close</span></code></a>(self)</td> -<td></td> +<td>Close stream and write end-of-stream 0 marker</td> </tr> <tr class="row-odd"><td><a class="reference internal" href="#pyarrow.RecordBatchStreamWriter.write_batch" title="pyarrow.RecordBatchStreamWriter.write_batch"><code class="xref py py-obj docutils literal"><span class="pre">write_batch</span></code></a>(self, RecordBatch batch)</td> -<td></td> +<td>Write RecordBatch to stream</td> </tr> </tbody> </table> <dl class="method"> <dt id="pyarrow.RecordBatchStreamWriter.close"> <code class="descname">close</code><span class="sig-paren">(</span><em>self</em><span class="sig-paren">)</span><a class="headerlink" href="#pyarrow.RecordBatchStreamWriter.close" title="Permalink to this definition">¶</a></dt> -<dd></dd></dl> +<dd><p>Close stream and write end-of-stream 0 marker</p> +</dd></dl> <dl class="method"> <dt id="pyarrow.RecordBatchStreamWriter.write_batch"> <code class="descname">write_batch</code><span class="sig-paren">(</span><em>self</em>, <em>RecordBatch batch</em><span class="sig-paren">)</span><a class="headerlink" href="#pyarrow.RecordBatchStreamWriter.write_batch" title="Permalink to this definition">¶</a></dt> -<dd></dd></dl> +<dd><p>Write RecordBatch to stream</p> +<table class="docutils field-list" frame="void" rules="none"> +<col class="field-name" /> +<col class="field-body" /> +<tbody valign="top"> +<tr class="field-odd field"><th class="field-name">Parameters:</th><td class="field-body"><strong>batch</strong> (<a class="reference internal" href="pyarrow.RecordBatch.html#pyarrow.RecordBatch" title="pyarrow.RecordBatch"><em>RecordBatch</em></a>) – </td> +</tr> +</tbody> +</table> +</dd></dl> </dd></dl> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.Scalar.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.Scalar.html b/docs/python/generated/pyarrow.Scalar.html index 512eb28..702be51 100644 --- a/docs/python/generated/pyarrow.Scalar.html +++ b/docs/python/generated/pyarrow.Scalar.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -105,7 +106,7 @@ </a> </li> <li> - <a href="pyarrow.ArrayValue.html" title="Next Chapter: pyarrow.ArrayValue"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.ArrayValue »</span> + <a href="pyarrow.ArrayValue.html" title="Next Chapter: pyarrow.ArrayValue"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.Array... »</span> </a> </li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.StringValue.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.StringValue.html b/docs/python/generated/pyarrow.StringValue.html index 77cf2a3..e8f0885 100644 --- a/docs/python/generated/pyarrow.StringValue.html +++ b/docs/python/generated/pyarrow.StringValue.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -101,7 +102,7 @@ <li> - <a href="pyarrow.BinaryValue.html" title="Previous Chapter: pyarrow.BinaryValue"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.BinaryValue</span> + <a href="pyarrow.BinaryValue.html" title="Previous Chapter: pyarrow.BinaryValue"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.Binar...</span> </a> </li> <li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.Table.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.Table.html b/docs/python/generated/pyarrow.Table.html index 9ea9fe8..86105ef 100644 --- a/docs/python/generated/pyarrow.Table.html +++ b/docs/python/generated/pyarrow.Table.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -101,7 +102,7 @@ <li> - <a href="pyarrow.RecordBatch.html" title="Previous Chapter: pyarrow.RecordBatch"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.RecordBatch</span> + <a href="pyarrow.RecordBatch.html" title="Previous Chapter: pyarrow.RecordBatch"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.Recor...</span> </a> </li> <li> @@ -170,7 +171,7 @@ methods instead.</p> <tr class="row-even"><td><a class="reference internal" href="#pyarrow.Table.append_column" title="pyarrow.Table.append_column"><code class="xref py py-obj docutils literal"><span class="pre">append_column</span></code></a>(self, Column column)</td> <td>Append column at end of columns.</td> </tr> -<tr class="row-odd"><td><a class="reference internal" href="#pyarrow.Table.column" title="pyarrow.Table.column"><code class="xref py py-obj docutils literal"><span class="pre">column</span></code></a>(self, int64_t i)</td> +<tr class="row-odd"><td><a class="reference internal" href="#pyarrow.Table.column" title="pyarrow.Table.column"><code class="xref py py-obj docutils literal"><span class="pre">column</span></code></a>(self, int i)</td> <td>Select a column by its numeric index.</td> </tr> <tr class="row-even"><td><a class="reference internal" href="#pyarrow.Table.equals" title="pyarrow.Table.equals"><code class="xref py py-obj docutils literal"><span class="pre">equals</span></code></a>(self, Table other)</td> @@ -191,10 +192,13 @@ methods instead.</p> <tr class="row-odd"><td><a class="reference internal" href="#pyarrow.Table.remove_column" title="pyarrow.Table.remove_column"><code class="xref py py-obj docutils literal"><span class="pre">remove_column</span></code></a>(self, int i)</td> <td>Create new Table with the indicated column removed</td> </tr> -<tr class="row-even"><td><a class="reference internal" href="#pyarrow.Table.to_pandas" title="pyarrow.Table.to_pandas"><code class="xref py py-obj docutils literal"><span class="pre">to_pandas</span></code></a>(self[, nthreads])</td> +<tr class="row-even"><td><a class="reference internal" href="#pyarrow.Table.replace_schema_metadata" title="pyarrow.Table.replace_schema_metadata"><code class="xref py py-obj docutils literal"><span class="pre">replace_schema_metadata</span></code></a>(self, dict metadata=None)</td> +<td>EXPERIMENTAL: Create shallow copy of table by replacing schema</td> +</tr> +<tr class="row-odd"><td><a class="reference internal" href="#pyarrow.Table.to_pandas" title="pyarrow.Table.to_pandas"><code class="xref py py-obj docutils literal"><span class="pre">to_pandas</span></code></a>(self[, nthreads, ...])</td> <td>Convert the arrow::Table to a pandas DataFrame</td> </tr> -<tr class="row-odd"><td><a class="reference internal" href="#pyarrow.Table.to_pydict" title="pyarrow.Table.to_pydict"><code class="xref py py-obj docutils literal"><span class="pre">to_pydict</span></code></a>(self)</td> +<tr class="row-even"><td><a class="reference internal" href="#pyarrow.Table.to_pydict" title="pyarrow.Table.to_pydict"><code class="xref py py-obj docutils literal"><span class="pre">to_pydict</span></code></a>(self)</td> <td>Converted the arrow::Table to an OrderedDict</td> </tr> </tbody> @@ -234,7 +238,7 @@ methods instead.</p> <dl class="method"> <dt id="pyarrow.Table.column"> -<code class="descname">column</code><span class="sig-paren">(</span><em>self</em>, <em>int64_t i</em><span class="sig-paren">)</span><a class="headerlink" href="#pyarrow.Table.column" title="Permalink to this definition">¶</a></dt> +<code class="descname">column</code><span class="sig-paren">(</span><em>self</em>, <em>int i</em><span class="sig-paren">)</span><a class="headerlink" href="#pyarrow.Table.column" title="Permalink to this definition">¶</a></dt> <dd><p>Select a column by its numeric index.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -313,7 +317,7 @@ inferred. If Arrays passed, this argument is required</li> <li><strong>timestamps_to_ms</strong> (<em>bool</em>) – Convert datetime columns to ms resolution. This is needed for compability with other functionality like Parquet I/O which only supports milliseconds.</li> -<li><strong>schema</strong> (<a class="reference internal" href="pyarrow.Schema.html#pyarrow.Schema" title="pyarrow.Schema"><em>pyarrow.Schema</em></a><em>, </em><em>optional</em>) – The expected schema of the Arrow Table. This can be used to +<li><strong>schema</strong> (<em>pyarrow.Schema</em><em>, </em><em>optional</em>) – The expected schema of the Arrow Table. This can be used to indicate the type of columns if we cannot infer it automatically.</li> <li><strong>preserve_index</strong> (<em>bool</em><em>, </em><em>optional</em>) – Whether to store the index as an additional column in the resulting <code class="docutils literal"><span class="pre">Table</span></code>.</li> @@ -362,7 +366,8 @@ indicate the type of columns if we cannot infer it automatically.</li> <dt id="pyarrow.Table.num_rows"> <code class="descname">num_rows</code><a class="headerlink" href="#pyarrow.Table.num_rows" title="Permalink to this definition">¶</a></dt> <dd><p>Number of rows in this table.</p> -<p>Due to the definition of a table, all columns have the same number of rows.</p> +<p>Due to the definition of a table, all columns have the same number of +rows.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> <col class="field-body" /> @@ -379,6 +384,24 @@ indicate the type of columns if we cannot infer it automatically.</li> <dd><p>Create new Table with the indicated column removed</p> </dd></dl> +<dl class="method"> +<dt id="pyarrow.Table.replace_schema_metadata"> +<code class="descname">replace_schema_metadata</code><span class="sig-paren">(</span><em>self</em>, <em>dict metadata=None</em><span class="sig-paren">)</span><a class="headerlink" href="#pyarrow.Table.replace_schema_metadata" title="Permalink to this definition">¶</a></dt> +<dd><p>EXPERIMENTAL: Create shallow copy of table by replacing schema +key-value metadata with the indicated new metadata (which may be None, +which deletes any existing metadata</p> +<table class="docutils field-list" frame="void" rules="none"> +<col class="field-name" /> +<col class="field-body" /> +<tbody valign="top"> +<tr class="field-odd field"><th class="field-name">Parameters:</th><td class="field-body"><strong>metadata</strong> (<em>dict</em><em>, </em><em>default None</em>) – </td> +</tr> +<tr class="field-even field"><th class="field-name">Returns:</th><td class="field-body"><strong>shallow_copy</strong> (<em>Table</em>)</td> +</tr> +</tbody> +</table> +</dd></dl> + <dl class="attribute"> <dt id="pyarrow.Table.schema"> <code class="descname">schema</code><a class="headerlink" href="#pyarrow.Table.schema" title="Permalink to this definition">¶</a></dt> @@ -409,17 +432,23 @@ indicate the type of columns if we cannot infer it automatically.</li> <dl class="method"> <dt id="pyarrow.Table.to_pandas"> -<code class="descname">to_pandas</code><span class="sig-paren">(</span><em>self</em>, <em>nthreads=None</em><span class="sig-paren">)</span><a class="headerlink" href="#pyarrow.Table.to_pandas" title="Permalink to this definition">¶</a></dt> +<code class="descname">to_pandas</code><span class="sig-paren">(</span><em>self</em>, <em>nthreads=None</em>, <em>strings_to_categorical=False</em>, <em>memory_pool=None</em><span class="sig-paren">)</span><a class="headerlink" href="#pyarrow.Table.to_pandas" title="Permalink to this definition">¶</a></dt> <dd><p>Convert the arrow::Table to a pandas DataFrame</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> <col class="field-body" /> <tbody valign="top"> -<tr class="field-odd field"><th class="field-name">Parameters:</th><td class="field-body"><strong>nthreads</strong> (<em>int</em><em>, </em><em>default max</em><em>(</em><em>1</em><em>, </em><em>multiprocessing.cpu_count</em><em>(</em><em></em><em>) </em><em>/ 2</em><em>)</em><em></em>) – For the default, we divide the CPU count by 2 because most modern +<tr class="field-odd field"><th class="field-name">Parameters:</th><td class="field-body"><ul class="first simple"> +<li><strong>nthreads</strong> (<em>int</em><em>, </em><em>default max</em><em>(</em><em>1</em><em>, </em><em>multiprocessing.cpu_count</em><em>(</em><em></em><em>) </em><em>/ 2</em><em>)</em><em></em>) – For the default, we divide the CPU count by 2 because most modern computers have hyperthreading turned on, so doubling the CPU count -beyond the number of physical cores does not help</td> +beyond the number of physical cores does not help</li> +<li><strong>strings_to_categorical</strong> (<em>boolean</em><em>, </em><em>default False</em>) – Encode string (UTF8) and binary types to pandas.Categorical</li> +<li><strong>memory_pool</strong> (<a class="reference internal" href="pyarrow.MemoryPool.html#pyarrow.MemoryPool" title="pyarrow.MemoryPool"><em>MemoryPool</em></a><em>, </em><em>optional</em>) – Specific memory pool to use to allocate casted columns</li> +</ul> +</td> </tr> -<tr class="field-even field"><th class="field-name">Returns:</th><td class="field-body"><em>pandas.DataFrame</em></td> +<tr class="field-even field"><th class="field-name">Returns:</th><td class="field-body"><p class="first last"><em>pandas.DataFrame</em></p> +</td> </tr> </tbody> </table> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.Tensor.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.Tensor.html b/docs/python/generated/pyarrow.Tensor.html index db758fe..71351d5 100644 --- a/docs/python/generated/pyarrow.Tensor.html +++ b/docs/python/generated/pyarrow.Tensor.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.TimestampValue.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.TimestampValue.html b/docs/python/generated/pyarrow.TimestampValue.html index 33118d4..7bec81b 100644 --- a/docs/python/generated/pyarrow.TimestampValue.html +++ b/docs/python/generated/pyarrow.TimestampValue.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -101,11 +102,11 @@ <li> - <a href="pyarrow.Date64Value.html" title="Previous Chapter: pyarrow.Date64Value"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.Date64Value</span> + <a href="pyarrow.Date64Value.html" title="Previous Chapter: pyarrow.Date64Value"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.Date6...</span> </a> </li> <li> - <a href="pyarrow.DecimalValue.html" title="Next Chapter: pyarrow.DecimalValue"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.DecimalValue »</span> + <a href="pyarrow.DecimalValue.html" title="Next Chapter: pyarrow.DecimalValue"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.Decim... »</span> </a> </li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.UInt16Value.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.UInt16Value.html b/docs/python/generated/pyarrow.UInt16Value.html index c1f1db3..966431c 100644 --- a/docs/python/generated/pyarrow.UInt16Value.html +++ b/docs/python/generated/pyarrow.UInt16Value.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -101,11 +102,11 @@ <li> - <a href="pyarrow.UInt8Value.html" title="Previous Chapter: pyarrow.UInt8Value"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.UInt8Value</span> + <a href="pyarrow.UInt8Value.html" title="Previous Chapter: pyarrow.UInt8Value"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.UInt8...</span> </a> </li> <li> - <a href="pyarrow.UInt32Value.html" title="Next Chapter: pyarrow.UInt32Value"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.UInt32Value »</span> + <a href="pyarrow.UInt32Value.html" title="Next Chapter: pyarrow.UInt32Value"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.UInt3... »</span> </a> </li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.UInt32Value.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.UInt32Value.html b/docs/python/generated/pyarrow.UInt32Value.html index dd60b30..eeb76cd 100644 --- a/docs/python/generated/pyarrow.UInt32Value.html +++ b/docs/python/generated/pyarrow.UInt32Value.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -101,11 +102,11 @@ <li> - <a href="pyarrow.UInt16Value.html" title="Previous Chapter: pyarrow.UInt16Value"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.UInt16Value</span> + <a href="pyarrow.UInt16Value.html" title="Previous Chapter: pyarrow.UInt16Value"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.UInt1...</span> </a> </li> <li> - <a href="pyarrow.UInt64Value.html" title="Next Chapter: pyarrow.UInt64Value"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.UInt64Value »</span> + <a href="pyarrow.UInt64Value.html" title="Next Chapter: pyarrow.UInt64Value"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.UInt6... »</span> </a> </li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.UInt64Value.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.UInt64Value.html b/docs/python/generated/pyarrow.UInt64Value.html index a3a52e2..6f705d8 100644 --- a/docs/python/generated/pyarrow.UInt64Value.html +++ b/docs/python/generated/pyarrow.UInt64Value.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -101,11 +102,11 @@ <li> - <a href="pyarrow.UInt32Value.html" title="Previous Chapter: pyarrow.UInt32Value"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.UInt32Value</span> + <a href="pyarrow.UInt32Value.html" title="Previous Chapter: pyarrow.UInt32Value"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.UInt3...</span> </a> </li> <li> - <a href="pyarrow.FloatValue.html" title="Next Chapter: pyarrow.FloatValue"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.FloatValue »</span> + <a href="pyarrow.FloatValue.html" title="Next Chapter: pyarrow.FloatValue"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.Float... »</span> </a> </li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.UInt8Value.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.UInt8Value.html b/docs/python/generated/pyarrow.UInt8Value.html index 173c38a..5539999 100644 --- a/docs/python/generated/pyarrow.UInt8Value.html +++ b/docs/python/generated/pyarrow.UInt8Value.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -101,11 +102,11 @@ <li> - <a href="pyarrow.Int64Value.html" title="Previous Chapter: pyarrow.Int64Value"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.Int64Value</span> + <a href="pyarrow.Int64Value.html" title="Previous Chapter: pyarrow.Int64Value"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.Int64...</span> </a> </li> <li> - <a href="pyarrow.UInt16Value.html" title="Next Chapter: pyarrow.UInt16Value"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.UInt16Value »</span> + <a href="pyarrow.UInt16Value.html" title="Next Chapter: pyarrow.UInt16Value"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.UInt1... »</span> </a> </li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.binary.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.binary.html b/docs/python/generated/pyarrow.binary.html index f598c81..e9e5161 100644 --- a/docs/python/generated/pyarrow.binary.html +++ b/docs/python/generated/pyarrow.binary.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.bool_.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.bool_.html b/docs/python/generated/pyarrow.bool_.html index d7e26b7..d140583 100644 --- a/docs/python/generated/pyarrow.bool_.html +++ b/docs/python/generated/pyarrow.bool_.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.create_memory_map.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.create_memory_map.html b/docs/python/generated/pyarrow.create_memory_map.html index 161de52..5fba697 100644 --- a/docs/python/generated/pyarrow.create_memory_map.html +++ b/docs/python/generated/pyarrow.create_memory_map.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -101,11 +102,11 @@ <li> - <a href="pyarrow.memory_map.html" title="Previous Chapter: pyarrow.memory_map"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.memory_map</span> + <a href="pyarrow.memory_map.html" title="Previous Chapter: pyarrow.memory_map"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.memor...</span> </a> </li> <li> - <a href="pyarrow.PythonFile.html" title="Next Chapter: pyarrow.PythonFile"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.PythonFile »</span> + <a href="pyarrow.PythonFile.html" title="Next Chapter: pyarrow.PythonFile"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.Pytho... »</span> </a> </li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.date32.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.date32.html b/docs/python/generated/pyarrow.date32.html index 8b31b47..fc36828 100644 --- a/docs/python/generated/pyarrow.date32.html +++ b/docs/python/generated/pyarrow.date32.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -101,7 +102,7 @@ <li> - <a href="pyarrow.timestamp.html" title="Previous Chapter: pyarrow.timestamp"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.timestamp</span> + <a href="pyarrow.timestamp.html" title="Previous Chapter: pyarrow.timestamp"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.times...</span> </a> </li> <li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.date64.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.date64.html b/docs/python/generated/pyarrow.date64.html index 2e13780..f93fe73 100644 --- a/docs/python/generated/pyarrow.date64.html +++ b/docs/python/generated/pyarrow.date64.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.decimal.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.decimal.html b/docs/python/generated/pyarrow.decimal.html index a1b7f71..affecf4 100644 --- a/docs/python/generated/pyarrow.decimal.html +++ b/docs/python/generated/pyarrow.decimal.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.default_memory_pool.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.default_memory_pool.html b/docs/python/generated/pyarrow.default_memory_pool.html index 02660db..7e20ffe 100644 --- a/docs/python/generated/pyarrow.default_memory_pool.html +++ b/docs/python/generated/pyarrow.default_memory_pool.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -101,7 +102,7 @@ <li> - <a href="pyarrow.MemoryPool.html" title="Previous Chapter: pyarrow.MemoryPool"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.MemoryPool</span> + <a href="pyarrow.MemoryPool.html" title="Previous Chapter: pyarrow.MemoryPool"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.Memor...</span> </a> </li> <li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.dictionary.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.dictionary.html b/docs/python/generated/pyarrow.dictionary.html index 4102e3a..c423069 100644 --- a/docs/python/generated/pyarrow.dictionary.html +++ b/docs/python/generated/pyarrow.dictionary.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -143,15 +144,15 @@ <h1>pyarrow.dictionary<a class="headerlink" href="#pyarrow-dictionary" title="Permalink to this headline">¶</a></h1> <dl class="function"> <dt id="pyarrow.dictionary"> -<code class="descclassname">pyarrow.</code><code class="descname">dictionary</code><span class="sig-paren">(</span><em>DataType index_type</em>, <em>Array dictionary</em><span class="sig-paren">)</span> → DictionaryType<a class="headerlink" href="#pyarrow.dictionary" title="Permalink to this definition">¶</a></dt> +<code class="descclassname">pyarrow.</code><code class="descname">dictionary</code><span class="sig-paren">(</span><em>DataType index_type</em>, <em>Array dictionary</em>, <em>bool ordered=False</em><span class="sig-paren">)</span> → DictionaryType<a class="headerlink" href="#pyarrow.dictionary" title="Permalink to this definition">¶</a></dt> <dd><p>Dictionary (categorical, or simply encoded) type</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> <col class="field-body" /> <tbody valign="top"> <tr class="field-odd field"><th class="field-name">Parameters:</th><td class="field-body"><ul class="first simple"> -<li><strong>index_type</strong> (<a class="reference internal" href="pyarrow.DataType.html#pyarrow.DataType" title="pyarrow.DataType"><em>DataType</em></a>) – </li> -<li><strong>dictionary</strong> (<a class="reference internal" href="pyarrow.Array.html#pyarrow.Array" title="pyarrow.Array"><em>Array</em></a>) – </li> +<li><strong>index_type</strong> (<a class="reference internal" href="pyarrow.lib.DataType.html#pyarrow.lib.DataType" title="pyarrow.lib.DataType"><em>DataType</em></a>) – </li> +<li><strong>dictionary</strong> (<a class="reference internal" href="pyarrow.lib.Array.html#pyarrow.lib.Array" title="pyarrow.lib.Array"><em>Array</em></a>) – </li> </ul> </td> </tr> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.field.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.field.html b/docs/python/generated/pyarrow.field.html index 35c8d17..6ff18d5 100644 --- a/docs/python/generated/pyarrow.field.html +++ b/docs/python/generated/pyarrow.field.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -101,7 +102,7 @@ <li> - <a href="pyarrow.dictionary.html" title="Previous Chapter: pyarrow.dictionary"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.dictionary</span> + <a href="pyarrow.dictionary.html" title="Previous Chapter: pyarrow.dictionary"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.dicti...</span> </a> </li> <li> @@ -151,7 +152,7 @@ <tbody valign="top"> <tr class="field-odd field"><th class="field-name">Parameters:</th><td class="field-body"><ul class="first simple"> <li><strong>name</strong> (<a class="reference internal" href="pyarrow.string.html#pyarrow.string" title="pyarrow.string"><em>string</em></a><em> or </em><em>bytes</em>) – </li> -<li><strong>type</strong> (<a class="reference internal" href="pyarrow.DataType.html#pyarrow.DataType" title="pyarrow.DataType"><em>pyarrow.DataType</em></a>) – </li> +<li><strong>type</strong> (<em>pyarrow.DataType</em>) – </li> <li><strong>nullable</strong> (<em>boolean</em><em>, </em><em>default True</em>) – </li> <li><strong>metadata</strong> (<em>dict</em><em>, </em><em>default None</em>) – Keys and values must be coercible to bytes</li> </ul> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.float16.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.float16.html b/docs/python/generated/pyarrow.float16.html index 562624f..8c8de45 100644 --- a/docs/python/generated/pyarrow.float16.html +++ b/docs/python/generated/pyarrow.float16.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.float32.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.float32.html b/docs/python/generated/pyarrow.float32.html index 7506c6b..3c0bdf2 100644 --- a/docs/python/generated/pyarrow.float32.html +++ b/docs/python/generated/pyarrow.float32.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.float64.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.float64.html b/docs/python/generated/pyarrow.float64.html index 9821c4b..e48e95f 100644 --- a/docs/python/generated/pyarrow.float64.html +++ b/docs/python/generated/pyarrow.float64.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.from_numpy_dtype.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.from_numpy_dtype.html b/docs/python/generated/pyarrow.from_numpy_dtype.html index dafdf90..4bd0788 100644 --- a/docs/python/generated/pyarrow.from_numpy_dtype.html +++ b/docs/python/generated/pyarrow.from_numpy_dtype.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.get_record_batch_size.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.get_record_batch_size.html b/docs/python/generated/pyarrow.get_record_batch_size.html index 57996cd..1c40fe4 100644 --- a/docs/python/generated/pyarrow.get_record_batch_size.html +++ b/docs/python/generated/pyarrow.get_record_batch_size.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -105,7 +106,7 @@ </a> </li> <li> - <a href="pyarrow.read_tensor.html" title="Next Chapter: pyarrow.read_tensor"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.read_tensor »</span> + <a href="pyarrow.read_tensor.html" title="Next Chapter: pyarrow.read_tensor"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.read_... »</span> </a> </li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.get_tensor_size.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.get_tensor_size.html b/docs/python/generated/pyarrow.get_tensor_size.html index 9231c4c..e47e23f 100644 --- a/docs/python/generated/pyarrow.get_tensor_size.html +++ b/docs/python/generated/pyarrow.get_tensor_size.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> @@ -101,11 +102,11 @@ <li> - <a href="pyarrow.write_tensor.html" title="Previous Chapter: pyarrow.write_tensor"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.write_tensor</span> + <a href="pyarrow.write_tensor.html" title="Previous Chapter: pyarrow.write_tensor"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« pyarrow.write...</span> </a> </li> <li> - <a href="pyarrow.MemoryPool.html" title="Next Chapter: pyarrow.MemoryPool"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.MemoryPool »</span> + <a href="pyarrow.MemoryPool.html" title="Next Chapter: pyarrow.MemoryPool"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.Memor... »</span> </a> </li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.hdfs.connect.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.hdfs.connect.html b/docs/python/generated/pyarrow.hdfs.connect.html new file mode 100644 index 0000000..3230527 --- /dev/null +++ b/docs/python/generated/pyarrow.hdfs.connect.html @@ -0,0 +1,202 @@ +<!DOCTYPE html> + + +<html xmlns="http://www.w3.org/1999/xhtml"> + <head> + <meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> + + <title>pyarrow.hdfs.connect — pyarrow documentation</title> + + <link rel="stylesheet" href="../_static/bootstrap-sphinx.css" type="text/css" /> + <link rel="stylesheet" href="../_static/pygments.css" type="text/css" /> + + <script type="text/javascript"> + var DOCUMENTATION_OPTIONS = { + URL_ROOT: '../', + VERSION: '', + COLLAPSE_INDEX: false, + FILE_SUFFIX: '.html', + HAS_SOURCE: true, + SOURCELINK_SUFFIX: '.txt' + }; + </script> + <script type="text/javascript" src="../_static/jquery.js"></script> + <script type="text/javascript" src="../_static/underscore.js"></script> + <script type="text/javascript" src="../_static/doctools.js"></script> + <script type="text/javascript" src="https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.0/MathJax.js?config=TeX-AMS-MML_HTMLorMML"></script> + <script type="text/javascript" src="../_static/js/jquery-1.11.0.min.js"></script> + <script type="text/javascript" src="../_static/js/jquery-fix.js"></script> + <script type="text/javascript" src="../_static/bootstrap-3.3.6/js/bootstrap.min.js"></script> + <script type="text/javascript" src="../_static/bootstrap-sphinx.js"></script> + <link rel="index" title="Index" href="../genindex.html" /> + <link rel="search" title="Search" href="../search.html" /> + <link rel="next" title="pyarrow.HadoopFileSystem.cat" href="pyarrow.HadoopFileSystem.cat.html" /> + <link rel="prev" title="File System Interfaces" href="../filesystems.html" /> +<meta charset='utf-8'> +<meta http-equiv='X-UA-Compatible' content='IE=edge,chrome=1'> +<meta name='viewport' content='width=device-width, initial-scale=1.0, maximum-scale=1'> +<meta name="apple-mobile-web-app-capable" content="yes"> + + </head> + <body role="document"> + + <div id="navbar" class="navbar navbar-default navbar-fixed-top"> + <div class="container"> + <div class="navbar-header"> + <!-- .btn-navbar is used as the toggle for collapsed navbar content --> + <button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".nav-collapse"> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + </button> + <a class="navbar-brand" href="../index.html"> + pyarrow</a> + <span class="navbar-text navbar-version pull-left"><b></b></span> + </div> + + <div class="collapse navbar-collapse nav-collapse"> + <ul class="nav navbar-nav"> + + + <li class="dropdown globaltoc-container"> + <a role="button" + id="dLabelGlobalToc" + data-toggle="dropdown" + data-target="#" + href="../index.html">Site <b class="caret"></b></a> + <ul class="dropdown-menu globaltoc" + role="menu" + aria-labelledby="dLabelGlobalToc"><p class="caption"><span class="caption-text">Getting Started</span></p> +<ul class="current"> +<li class="toctree-l1"><a class="reference internal" href="../install.html">Install PyArrow</a></li> +<li class="toctree-l1"><a class="reference internal" href="../development.html">Development</a></li> +<li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> +<li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> +<li class="toctree-l1 current"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> +<li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> +<li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> +<li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> +<li class="toctree-l1"><a class="reference internal" href="../getting_involved.html">Getting Involved</a></li> +</ul> +</ul> +</li> + + <li class="dropdown"> + <a role="button" + id="dLabelLocalToc" + data-toggle="dropdown" + data-target="#" + href="#">Page <b class="caret"></b></a> + <ul class="dropdown-menu localtoc" + role="menu" + aria-labelledby="dLabelLocalToc"><ul> +<li><a class="reference internal" href="#">pyarrow.hdfs.connect</a></li> +</ul> +</ul> +</li> + + + + + + <li> + <a href="../filesystems.html" title="Previous Chapter: File System Interfaces"><span class="glyphicon glyphicon-chevron-left visible-sm"></span><span class="hidden-sm hidden-tablet">« File System I...</span> + </a> + </li> + <li> + <a href="pyarrow.HadoopFileSystem.cat.html" title="Next Chapter: pyarrow.HadoopFileSystem.cat"><span class="glyphicon glyphicon-chevron-right visible-sm"></span><span class="hidden-sm hidden-tablet">pyarrow.Hadoo... »</span> + </a> + </li> + + + + + + <li class="hidden-sm"> +<div id="sourcelink"> + <a href="../_sources/generated/pyarrow.hdfs.connect.rst.txt" + rel="nofollow">Source</a> +</div></li> + + </ul> + + + +<form class="navbar-form navbar-right" action="../search.html" method="get"> + <div class="form-group"> + <input type="text" name="q" class="form-control" placeholder="Search" /> + </div> + <input type="hidden" name="check_keywords" value="yes" /> + <input type="hidden" name="area" value="default" /> +</form> + + </div> + </div> + </div> + +<div class="container"> + <div class="row"> + <div class="col-md-12 content"> + + <div class="section" id="pyarrow-hdfs-connect"> +<h1>pyarrow.hdfs.connect<a class="headerlink" href="#pyarrow-hdfs-connect" title="Permalink to this headline">¶</a></h1> +<dl class="function"> +<dt id="pyarrow.hdfs.connect"> +<code class="descclassname">pyarrow.hdfs.</code><code class="descname">connect</code><span class="sig-paren">(</span><em>host='default'</em>, <em>port=0</em>, <em>user=None</em>, <em>kerb_ticket=None</em>, <em>driver='libhdfs'</em><span class="sig-paren">)</span><a class="reference internal" href="../_modules/pyarrow/hdfs.html#connect"><span class="viewcode-link">[source]</span></a><a class="headerlink" href="#pyarrow.hdfs.connect" title="Permalink to this definition">¶</a></dt> +<dd><p>Connect to an HDFS cluster. All parameters are optional and should +only be set if the defaults need to be overridden.</p> +<p>Authentication should be automatic if the HDFS cluster uses Kerberos. +However, if a username is specified, then the ticket cache will likely +be required.</p> +<table class="docutils field-list" frame="void" rules="none"> +<col class="field-name" /> +<col class="field-body" /> +<tbody valign="top"> +<tr class="field-odd field"><th class="field-name">Parameters:</th><td class="field-body"><ul class="first last simple"> +<li><strong>host</strong> (<em>NameNode. Set to "default" for fs.defaultFS from core-site.xml.</em>) – </li> +<li><strong>port</strong> (<em>NameNode's port. Set to 0 for default</em><em> or </em><em>logical</em><em> (</em><em>HA</em><em>) </em><em>nodes.</em>) – </li> +<li><strong>user</strong> (<em>Username when connecting to HDFS; None implies login user.</em>) – </li> +<li><strong>kerb_ticket</strong> (<em>Path to Kerberos ticket cache.</em>) – </li> +<li><strong>driver</strong> (<em>{'libhdfs'</em><em>, </em><em>'libhdfs3'}</em><em>, </em><em>default 'libhdfs'</em>) – Connect using libhdfs (JNI-based) or libhdfs3 (3rd-party C++ +library from Apache HAWQ (incubating) )</li> +</ul> +</td> +</tr> +</tbody> +</table> +<p class="rubric">Notes</p> +<p>The first time you call this method, it will take longer than usual due +to JNI spin-up time.</p> +<table class="docutils field-list" frame="void" rules="none"> +<col class="field-name" /> +<col class="field-body" /> +<tbody valign="top"> +<tr class="field-odd field"><th class="field-name">Returns:</th><td class="field-body"><strong>filesystem</strong> (<em>HadoopFileSystem</em>)</td> +</tr> +</tbody> +</table> +</dd></dl> + +</div> + + + </div> + + </div> +</div> +<footer class="footer"> + <div class="container"> + <p class="pull-right"> + <a href="#">Back to top</a> + + </p> + <p> + © Copyright 2016-2017 Apache Software Foundation.<br/> + Created using <a href="http://sphinx-doc.org/">Sphinx</a> 1.5.5.<br/> + </p> + </div> +</footer> + </body> +</html> \ No newline at end of file http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.int16.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.int16.html b/docs/python/generated/pyarrow.int16.html index 7af3042..31ddc65 100644 --- a/docs/python/generated/pyarrow.int16.html +++ b/docs/python/generated/pyarrow.int16.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/4d4a3202/docs/python/generated/pyarrow.int32.html ---------------------------------------------------------------------- diff --git a/docs/python/generated/pyarrow.int32.html b/docs/python/generated/pyarrow.int32.html index 85b722e..ef91960 100644 --- a/docs/python/generated/pyarrow.int32.html +++ b/docs/python/generated/pyarrow.int32.html @@ -73,7 +73,8 @@ <li class="toctree-l1"><a class="reference internal" href="../memory.html">Memory and IO Interfaces</a></li> <li class="toctree-l1"><a class="reference internal" href="../data.html">In-Memory Data Model</a></li> <li class="toctree-l1"><a class="reference internal" href="../ipc.html">IPC: Fast Streaming and Serialization</a></li> -<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">Filesystem Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../filesystems.html">File System Interfaces</a></li> +<li class="toctree-l1"><a class="reference internal" href="../plasma.html">The Plasma In-Memory Object Store</a></li> <li class="toctree-l1"><a class="reference internal" href="../pandas.html">Using PyArrow with pandas</a></li> <li class="toctree-l1"><a class="reference internal" href="../parquet.html">Reading and Writing the Apache Parquet Format</a></li> <li class="toctree-l1 current"><a class="reference internal" href="../api.html">API Reference</a></li>