[GitHub] spark pull request: Python SQL Example Code
Github user jyotiska commented on the pull request: https://github.com/apache/spark/pull/2521#issuecomment-56822422 @davies I have made the changes you asked for. Can you verify this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Python SQL Example Code
Github user jyotiska commented on the pull request: https://github.com/apache/spark/pull/2521#issuecomment-56813029 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Python SQL Example Code
Github user jyotiska commented on the pull request: https://github.com/apache/spark/pull/2521#issuecomment-56800752 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Python SQL Example Code
Github user jyotiska commented on a diff in the pull request: https://github.com/apache/spark/pull/2521#discussion_r17987266 --- Diff: examples/src/main/python/sql.py --- @@ -0,0 +1,52 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements. See the NOTICE file distributed with +# this work for additional information regarding copyright ownership. +# The ASF licenses this file to You under the Apache License, Version 2.0 +# (the "License"); you may not use this file except in compliance with +# the License. You may obtain a copy of the License at +# +#http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. +# + +import sys + +from pyspark import SparkContext +from pyspark.sql import SQLContext + + +if __name__ == "__main__": +if len(sys.argv) != 2: +print >> sys.stderr, "Usage: sql " +exit(-1) +sc = SparkContext(appName="PythonSQL") +sqlContext = SQLContext(sc) + +# A JSON dataset is pointed to by path. +# The path can be either a single text file or a directory storing text files. +path = "examples/src/main/resources/people.json" --- End diff -- In that case, should the JSON file be supplied as sys.argv[1]? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Python SQL Example Code
GitHub user jyotiska opened a pull request: https://github.com/apache/spark/pull/2521 Python SQL Example Code SQL example code for Python, as shown on [SQL Programming Guide](https://spark.apache.org/docs/1.0.2/sql-programming-guide.html) You can merge this pull request into a Git repository by running: $ git pull https://github.com/jyotiska/spark sql_example Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/2521.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2521 commit 8f67b5b9152bbc4ab22de48198fdc2aa6f2fb6ab Author: jyotiska Date: 2014-09-24T16:25:54Z added python sql example commit 0b4614800a852bba709815a393dda0370049901e Author: jyotiska Date: 2014-09-24T16:27:56Z fixed appname for python sql example --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-1087] Move python traceback utilities i...
Github user jyotiska commented on the pull request: https://github.com/apache/spark/pull/2385#issuecomment-55517066 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Added doctest and method description in contex...
Github user jyotiska commented on the pull request: https://github.com/apache/spark/pull/187#issuecomment-38544024 Can one of the admins take a look at this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: Added doctest and method description in contex...
Github user jyotiska commented on the pull request: https://github.com/apache/spark/pull/187#issuecomment-38208110 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: Added doctest and method description in contex...
GitHub user jyotiska opened a pull request: https://github.com/apache/spark/pull/187 Added doctest and method description in context.py Added doctest for method textFile and description for methods _initialize_context and _ensure_initialized in context.py You can merge this pull request into a Git repository by running: $ git pull https://github.com/jyotiska/spark pyspark_context Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/187.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #187 commit 5b236869e45f61b000ae28659fc9bcfd7d17c1ca Author: Jyotiska NK Date: 2014-03-20T16:48:41Z Updated context.py with method descriptions Added descriptions for methods _initialize_context and _ensure_initialized commit 356f94591b4bf31281408f077f058d40868d4f58 Author: Jyotiska NK Date: 2014-03-20T17:21:37Z Added doctest for textFile method in context.py Doctest added for method textFile in context.py --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: Added doctest for map function in rdd.py
Github user jyotiska commented on the pull request: https://github.com/apache/spark/pull/177#issuecomment-38021413 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: Added doctest for map function in rdd.py
GitHub user jyotiska opened a pull request: https://github.com/apache/spark/pull/177 Added doctest for map function in rdd.py Doctest added for map in rdd.py You can merge this pull request into a Git repository by running: $ git pull https://github.com/jyotiska/spark pyspark_rdd_map_doctest Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/177.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #177 commit a38527fce73ce4744ca10e5376c4b6fe2c2ff93b Author: Jyotiska NK Date: 2014-03-19T05:26:02Z Added doctest for map function in rdd.py Doctest added for map in rdd.py --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: Added doctest for map function in rdd.py
Github user jyotiska closed the pull request at: https://github.com/apache/spark/pull/171 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: Added doctest for map function in rdd.py
GitHub user jyotiska opened a pull request: https://github.com/apache/spark/pull/171 Added doctest for map function in rdd.py You can merge this pull request into a Git repository by running: $ git pull https://github.com/jyotiska/spark pyspark_rdd_map_doctest Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/171.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #171 commit e77ff5d94568cbcad0024a8cff4b95e037214506 Author: jyotiska Date: 2014-03-18T14:12:00Z added doctest for map function in rdd.py --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
