[jira] [Commented] (SPARK-18218) Optimize BlockMatrix multiplication, which may cause OOM and low parallelism usage problem in several cases

[ https://issues.apache.org/jira/browse/SPARK-18218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15677367#comment-15677367 ] Burak Yavuz commented on SPARK-18218: - [~WeichenXu123] You are correct, this would be a problem

[jira] [Updated] (SPARK-18493) Add withWatermark and checkpoint to python dataframe

[ https://issues.apache.org/jira/browse/SPARK-18493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-18493: Component/s: PySpark > Add withWatermark and checkpoint to python datafr

[jira] [Created] (SPARK-18493) Add withWatermark and checkpoint to python dataframe

Burak Yavuz created SPARK-18493: --- Summary: Add withWatermark and checkpoint to python dataframe Key: SPARK-18493 URL: https://issues.apache.org/jira/browse/SPARK-18493 Project: Spark Issue

[jira] [Commented] (SPARK-18475) Be able to provide higher parallelization for StructuredStreaming Kafka Source

[ https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674535#comment-15674535 ] Burak Yavuz commented on SPARK-18475: - [~c...@koeninger.org] I don't see where you may need strict

[jira] [Commented] (SPARK-18475) Be able to provide higher parallelization for StructuredStreaming Kafka Source

[ https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674254#comment-15674254 ] Burak Yavuz commented on SPARK-18475: - [~ofirm] Thanks for your comment. I've seen significant

[jira] [Created] (SPARK-18475) Be able to provide higher parallelization for StructuredStreaming Kafka Source

Burak Yavuz created SPARK-18475: --- Summary: Be able to provide higher parallelization for StructuredStreaming Kafka Source Key: SPARK-18475 URL: https://issues.apache.org/jira/browse/SPARK-18475 Project

[jira] [Created] (SPARK-18465) Uncache Table shouldn't throw an exception when table doesn't exist

Burak Yavuz created SPARK-18465: --- Summary: Uncache Table shouldn't throw an exception when table doesn't exist Key: SPARK-18465 URL: https://issues.apache.org/jira/browse/SPARK-18465 Project: Spark

[phpMyAdmin Git] [phpmyadmin/localized_docs] 5abba2: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: 5abba275f3cb8217ad04d16cb2ce183495a8ea0d https://github.com/phpmyadmin/localized_docs/commit/5abba275f3cb8217ad04d16cb2ce183495a8ea0d Author: Burak Yavuz <hitowerdi...@hotmail.com> Date:

[phpMyAdmin Git] [phpmyadmin/localized_docs] da055b: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: da055b505a46afb351e0da018b64af28d81bd28a https://github.com/phpmyadmin/localized_docs/commit/da055b505a46afb351e0da018b64af28d81bd28a Author: Burak Yavuz <hitowerdi...@hotmail.com> Date:

[jira] [Created] (SPARK-18342) HDFSBackedStateStore can fail to rename files causing snapshotting and recovery to fail

Burak Yavuz created SPARK-18342: --- Summary: HDFSBackedStateStore can fail to rename files causing snapshotting and recovery to fail Key: SPARK-18342 URL: https://issues.apache.org/jira/browse/SPARK-18342

[jira] [Created] (SPARK-18339) Don't push down current_timestamp for filters in StructuredStreaming

Burak Yavuz created SPARK-18339: --- Summary: Don't push down current_timestamp for filters in StructuredStreaming Key: SPARK-18339 URL: https://issues.apache.org/jira/browse/SPARK-18339 Project: Spark

[jira] [Created] (SPARK-18337) Memory Sink should be able to recover from checkpoints in Complete OutputMode

Burak Yavuz created SPARK-18337: --- Summary: Memory Sink should be able to recover from checkpoints in Complete OutputMode Key: SPARK-18337 URL: https://issues.apache.org/jira/browse/SPARK-18337 Project

[jira] [Commented] (SPARK-18261) Add statistics to MemorySink for joining

[ https://issues.apache.org/jira/browse/SPARK-18261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15635014#comment-15635014 ] Burak Yavuz commented on SPARK-18261: - Go for it! > Add statistics to MemorySink for join

[jira] [Created] (SPARK-18261) Add statistics to MemorySink for joining

Burak Yavuz created SPARK-18261: --- Summary: Add statistics to MemorySink for joining Key: SPARK-18261 URL: https://issues.apache.org/jira/browse/SPARK-18261 Project: Spark Issue Type: New

[jira] [Created] (SPARK-18260) from_json can throw a better exception when it can't find the column or be nullSafe

Burak Yavuz created SPARK-18260: --- Summary: from_json can throw a better exception when it can't find the column or be nullSafe Key: SPARK-18260 URL: https://issues.apache.org/jira/browse/SPARK-18260

[jira] [Commented] (SPARK-17879) Don't compact metadata logs constantly into a single compacted file

[ https://issues.apache.org/jira/browse/SPARK-17879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627421#comment-15627421 ] Burak Yavuz commented on SPARK-17879: - We should be doing the second. What you said makes sense, we

[jira] [Created] (SPARK-18142) Spark Master tries to launch workers 145 times within 1 minute

Burak Yavuz created SPARK-18142: --- Summary: Spark Master tries to launch workers 145 times within 1 minute Key: SPARK-18142 URL: https://issues.apache.org/jira/browse/SPARK-18142 Project: Spark

[jira] [Updated] (SPARK-18142) Spark Master tries to launch workers 145 times within 1 minute

[ https://issues.apache.org/jira/browse/SPARK-18142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-18142: Component/s: Spark Core > Spark Master tries to launch workers 145 times within 1 min

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] b249cd: Translated using Weblate (Turkish)

Branch: refs/heads/QA_4_6 Home: https://github.com/phpmyadmin/phpmyadmin Commit: b249cdbc9554908fd709fcbd811c584c5b36939c https://github.com/phpmyadmin/phpmyadmin/commit/b249cdbc9554908fd709fcbd811c584c5b36939c Author: Burak Yavuz <hitowerdi...@hotmail.com> Date: 2016

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 3f2327: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: 3f23272d4520b5b8991337df5070e752e12eb49e https://github.com/phpmyadmin/phpmyadmin/commit/3f23272d4520b5b8991337df5070e752e12eb49e Author: Burak Yavuz <hitowerdi...@hotmail.com> Date: 2016

[phpMyAdmin Git] [phpmyadmin/localized_docs] 698e9d: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: 698e9da55c8e4bacbb37c6cbbfc349672ec8a026 https://github.com/phpmyadmin/localized_docs/commit/698e9da55c8e4bacbb37c6cbbfc349672ec8a026 Author: Burak Yavuz <hitowerdi...@hotmail.com> Date:

[jira] [Created] (SPARK-17921) checkpointLocation being set in memory streams fail after restart. Should fail fast

Burak Yavuz created SPARK-17921: --- Summary: checkpointLocation being set in memory streams fail after restart. Should fail fast Key: SPARK-17921 URL: https://issues.apache.org/jira/browse/SPARK-17921

[phpMyAdmin Git] [phpmyadmin/localized_docs] 6b4540: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: 6b45403033ea013c434148dbea9db82a95d23f48 https://github.com/phpmyadmin/localized_docs/commit/6b45403033ea013c434148dbea9db82a95d23f48 Author: Burak Yavuz <hitowerdi...@hotmail.com> Date:

[jira] [Created] (SPARK-17879) Don't compact metadata logs constantly into a single compacted file

Burak Yavuz created SPARK-17879: --- Summary: Don't compact metadata logs constantly into a single compacted file Key: SPARK-17879 URL: https://issues.apache.org/jira/browse/SPARK-17879 Project: Spark

[jira] [Created] (SPARK-17876) Write StructuredStreaming WAL to a stream instead of materializing all at once

Burak Yavuz created SPARK-17876: --- Summary: Write StructuredStreaming WAL to a stream instead of materializing all at once Key: SPARK-17876 URL: https://issues.apache.org/jira/browse/SPARK-17876 Project

[jira] [Updated] (SPARK-17754) DataFrame reader and writer don't show Input/Output metrics in Spark UI

[ https://issues.apache.org/jira/browse/SPARK-17754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-17754: Component/s: Web UI SQL > DataFrame reader and writer don't show Input/Out

[jira] [Created] (SPARK-17754) DataFrame reader and writer don't show Input/Output metrics in Spark UI

Burak Yavuz created SPARK-17754: --- Summary: DataFrame reader and writer don't show Input/Output metrics in Spark UI Key: SPARK-17754 URL: https://issues.apache.org/jira/browse/SPARK-17754 Project: Spark

Re: [VOTE] Release Apache Spark 2.0.1 (RC4)

+1 On Sep 29, 2016 4:33 PM, "Kyle Kelley" wrote: > +1 > > On Thu, Sep 29, 2016 at 4:27 PM, Yin Huai wrote: > >> +1 >> >> On Thu, Sep 29, 2016 at 4:07 PM, Luciano Resende >> wrote: >> >>> +1 (non-binding) >>> >>> On Wed, Sep 28,

Re: Spark SQL JSON Column Support

I would really love something like this! It would be great if it doesn't throw away corrupt_records like the Data Source. On Wed, Sep 28, 2016 at 11:02 AM, Nathan Lande wrote: > We are currently pulling out the JSON columns, passing them through > read.json, and then

[jira] [Created] (SPARK-17650) Adding a malformed URL to sc.addJar and/or sc.addFile bricks Executors

Burak Yavuz created SPARK-17650: --- Summary: Adding a malformed URL to sc.addJar and/or sc.addFile bricks Executors Key: SPARK-17650 URL: https://issues.apache.org/jira/browse/SPARK-17650 Project: Spark

[jira] [Created] (SPARK-17613) PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path at parent

Burak Yavuz created SPARK-17613: --- Summary: PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path at parent Key: SPARK-17613 URL: https://issues.apache.org/jira/browse/SPARK-17613

[jira] [Created] (SPARK-17599) Folder deletion after globbing may fail StructuredStreaming jobs

Burak Yavuz created SPARK-17599: --- Summary: Folder deletion after globbing may fail StructuredStreaming jobs Key: SPARK-17599 URL: https://issues.apache.org/jira/browse/SPARK-17599 Project: Spark

[jira] [Created] (SPARK-17569) Don't recheck existence of files when generating File Relation resolution in StructuredStreaming

Burak Yavuz created SPARK-17569: --- Summary: Don't recheck existence of files when generating File Relation resolution in StructuredStreaming Key: SPARK-17569 URL: https://issues.apache.org/jira/browse/SPARK-17569

[jira] [Updated] (SPARK-17531) Don't initialize Hive Listeners for the Execution Client

[ https://issues.apache.org/jira/browse/SPARK-17531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-17531: Description: If a user provides listeners inside the Hive Conf, the configuration

[jira] [Created] (SPARK-17531) Don't initialize Hive Listeners for the Execution Client

Burak Yavuz created SPARK-17531: --- Summary: Don't initialize Hive Listeners for the Execution Client Key: SPARK-17531 URL: https://issues.apache.org/jira/browse/SPARK-17531 Project: Spark Issue

[phpMyAdmin Git] [phpmyadmin/localized_docs] fa7275: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: fa7275603d4851330e5eb0b05287ae13ba3cbf56 https://github.com/phpmyadmin/localized_docs/commit/fa7275603d4851330e5eb0b05287ae13ba3cbf56 Author: Burak Yavuz <hitowerdi...@hotmail.com> Date:

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 5410e3: Translated using Weblate (Turkish)

Branch: refs/heads/QA_4_6 Home: https://github.com/phpmyadmin/phpmyadmin Commit: 5410e3859bc96f2ff3a45e8f627931937f9c81bc https://github.com/phpmyadmin/phpmyadmin/commit/5410e3859bc96f2ff3a45e8f627931937f9c81bc Author: Burak Yavuz <hitowerdi...@hotmail.com> Date: 2016

[phpMyAdmin Git] [phpmyadmin/localized_docs] e43d1a: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: e43d1a97cdaa28336bf87deb72f3e5314c4a4b0c https://github.com/phpmyadmin/localized_docs/commit/e43d1a97cdaa28336bf87deb72f3e5314c4a4b0c Author: Burak Yavuz <hitowerdi...@hotmail.com> Date:

[phpMyAdmin Git] [phpmyadmin/localized_docs] 49e997: Translated using Weblate (Estonian)

t 14.7% (335 of 2272 strings) [CI skip] Commit: fc86ec336a03fef8c6e1dd463a9d413b7e773391 https://github.com/phpmyadmin/localized_docs/commit/fc86ec336a03fef8c6e1dd463a9d413b7e773391 Author: Burak Yavuz <hitowerdi...@hotmail.com> Date: 2016-08-04 (Thu, 04 Aug 2016) Chang

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 7954c4: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: 7954c40c76aa6078c2added04e25c2265583e0d2 https://github.com/phpmyadmin/phpmyadmin/commit/7954c40c76aa6078c2added04e25c2265583e0d2 Author: Burak Yavuz <hitowerdi...@hotmail.com> Date: 2016

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 886ef5: Translated using Weblate (Interlingua)

] Commit: 3172b801ec154491d357ccffa4aca8da456179c7 https://github.com/phpmyadmin/phpmyadmin/commit/3172b801ec154491d357ccffa4aca8da456179c7 Author: Burak Yavuz <hitowerdi...@hotmail.com> Date: 2016-08-01 (Mon, 01 Aug 2016) Changed paths: M po/tr.po Log Message: ---

Re: Remove / update version in spark-packages.org

Hi, It's bad practice to change jars for the same version and is prohibited in Spark Packages. Please bump your version number and make a new release. Best regards, Burak On Tue, Jul 26, 2016 at 3:51 AM, Julio Antonio Soto de Vicente < ju...@esbet.es> wrote: > Hi all, > > Maybe I am missing

Re: spark-packages with maven

Hi Ismael and Jacek, If you use Maven for building your applications, you may use the spark-package command line tool ( https://github.com/databricks/spark-package-cmd-tool) to perform packaging. It requires you to build your jar using maven first, and then does all the extra magic that Spark

[jira] [Created] (SPARK-16531) Remove TimeZone from DataFrameTimeWindowingSuite

Burak Yavuz created SPARK-16531: --- Summary: Remove TimeZone from DataFrameTimeWindowingSuite Key: SPARK-16531 URL: https://issues.apache.org/jira/browse/SPARK-16531 Project: Spark Issue Type

[jira] [Created] (SPARK-16227) Json schema inference fails when `:` exists in file path

Burak Yavuz created SPARK-16227: --- Summary: Json schema inference fails when `:` exists in file path Key: SPARK-16227 URL: https://issues.apache.org/jira/browse/SPARK-16227 Project: Spark Issue

Re: How to cause a stage to fail (using spark-shell)?

Hi Jacek, Can't you simply have a mapPartitions task throw an exception or something? Are you trying to do something more esoteric? Best, Burak On Sat, Jun 18, 2016 at 5:35 AM, Jacek Laskowski wrote: > Hi, > > Following up on this question, is a stage considered failed only

[jira] [Created] (SPARK-16050) Flaky Test: Complete aggregation with Console sink

Burak Yavuz created SPARK-16050: --- Summary: Flaky Test: Complete aggregation with Console sink Key: SPARK-16050 URL: https://issues.apache.org/jira/browse/SPARK-16050 Project: Spark Issue Type

[jira] [Commented] (SPARK-15835) The read path of json doesn't support write path when schema contains Options

[ https://issues.apache.org/jira/browse/SPARK-15835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15321729#comment-15321729 ] Burak Yavuz commented on SPARK-15835: - cc [~cloud_fan] > The read path of json doesn't support wr

[jira] [Created] (SPARK-15835) The read path of json doesn't support write path when schema contains Options

Burak Yavuz created SPARK-15835: --- Summary: The read path of json doesn't support write path when schema contains Options Key: SPARK-15835 URL: https://issues.apache.org/jira/browse/SPARK-15835 Project

[jira] [Comment Edited] (SPARK-14767) Codegen "no constructor found" errors with Maps inside case classes in Datasets

[ https://issues.apache.org/jira/browse/SPARK-14767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316904#comment-15316904 ] Burak Yavuz edited comment on SPARK-14767 at 6/6/16 6:11 PM: - I still run

[jira] [Commented] (SPARK-14767) Codegen "no constructor found" errors with Maps inside case classes in Datasets

[ https://issues.apache.org/jira/browse/SPARK-14767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316904#comment-15316904 ] Burak Yavuz commented on SPARK-14767: - I still run into this > Codegen "no constructor found

[phpMyAdmin Git] [phpmyadmin/localized_docs] 7996d1: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: 7996d1cf36756ddb35894787fb16788e1f738bc6 https://github.com/phpmyadmin/localized_docs/commit/7996d1cf36756ddb35894787fb16788e1f738bc6 Author: Burak Yavuz <hitowerdi...@hotmail.com> Date:

[phpMyAdmin Git] [phpmyadmin/localized_docs] ffb04f: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: ffb04f74710adbbff079e7993311f5b75de90c0d https://github.com/phpmyadmin/localized_docs/commit/ffb04f74710adbbff079e7993311f5b75de90c0d Author: Burak Yavuz <hitowerdi...@hotmail.com> Date:

[phpMyAdmin Git] [phpmyadmin/localized_docs] 70aeda: Translated using Weblate (Portuguese (Brazil))

https://github.com/phpmyadmin/localized_docs/commit/ccbe33324b32a09e145d005a554750ea2e322b98 Author: Burak Yavuz <hitowerdi...@hotmail.com> Date: 2016-05-30 (Mon, 30 May 2016) Changed paths: M po/tr.mo M po/tr.po Log Message: --- Translated using Weblate (Turkish

[phpMyAdmin Git] [phpmyadmin/localized_docs] 4e6485: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: 4e6485c2f30f28e9ff469c9135a746383505751c https://github.com/phpmyadmin/localized_docs/commit/4e6485c2f30f28e9ff469c9135a746383505751c Author: Burak Yavuz <hitowerdi...@hotmail.com> Date:

[phpMyAdmin Git] [phpmyadmin/localized_docs] b45360: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: b45360526da44691bc047a70ed9e2b594e6fa500 https://github.com/phpmyadmin/localized_docs/commit/b45360526da44691bc047a70ed9e2b594e6fa500 Author: Burak Yavuz <hitowerdi...@hotmail.com> Date:

[phpMyAdmin Git] [phpmyadmin/localized_docs] 3a7091: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: 3a70917b430447a3ad284184ba6475b2b98f6cc8 https://github.com/phpmyadmin/localized_docs/commit/3a70917b430447a3ad284184ba6475b2b98f6cc8 Author: Burak Yavuz <hitowerdi...@hotmail.com> Date:

[jira] [Commented] (SPARK-14767) Codegen "no constructor found" errors with Maps inside case classes in Datasets

[ https://issues.apache.org/jira/browse/SPARK-14767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250540#comment-15250540 ] Burak Yavuz commented on SPARK-14767: - cc [~cloud_fan] [~marmbrus] > Codegen "no construct

[jira] [Updated] (SPARK-14767) Codegen "no constructor found" errors with Maps inside case classes in Datasets

[ https://issues.apache.org/jira/browse/SPARK-14767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-14767: Affects Version/s: 2.0.0 > Codegen "no constructor found" errors with Maps inside

[jira] [Created] (SPARK-14767) Codegen "no constructor found" errors with Maps inside case classes in Datasets

Burak Yavuz created SPARK-14767: --- Summary: Codegen "no constructor found" errors with Maps inside case classes in Datasets Key: SPARK-14767 URL: https://issues.apache.org/jira/browse/S

[jira] [Created] (SPARK-14766) Attribute reference mismatch with Dataset filter + mapPartitions

Burak Yavuz created SPARK-14766: --- Summary: Attribute reference mismatch with Dataset filter + mapPartitions Key: SPARK-14766 URL: https://issues.apache.org/jira/browse/SPARK-14766 Project: Spark

[jira] [Commented] (SPARK-14766) Attribute reference mismatch with Dataset filter + mapPartitions

[ https://issues.apache.org/jira/browse/SPARK-14766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250525#comment-15250525 ] Burak Yavuz commented on SPARK-14766: - cc [~cloud_fan] [~marmbrus] > Attribute reference misma

Re: Any NLP lib could be used on spark?

A quick search on spark-packages returns: http://spark-packages.org/package/databricks/spark-corenlp. You may need to build it locally and add it to your session by --jars. On Tue, Apr 19, 2016 at 10:47 AM, Gavin Yue wrote: > Hey, > > Want to try the NLP on the spark.

[jira] [Created] (SPARK-14555) Python API for methods introduced for Structured Streaming

Burak Yavuz created SPARK-14555: --- Summary: Python API for methods introduced for Structured Streaming Key: SPARK-14555 URL: https://issues.apache.org/jira/browse/SPARK-14555 Project: Spark

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 5ad6f3: Translated using Weblate (Turkish)

Branch: refs/heads/QA_4_6 Home: https://github.com/phpmyadmin/phpmyadmin Commit: 5ad6f3825dd40e47509436991efb4a77fea87c14 https://github.com/phpmyadmin/phpmyadmin/commit/5ad6f3825dd40e47509436991efb4a77fea87c14 Author: Burak Yavuz <hitowerdi...@hotmail.com> Date: 2016

[phpMyAdmin Git] [phpmyadmin/localized_docs] c35ae6: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: c35ae612220fec20b475619c957c4f3ed3f190ba https://github.com/phpmyadmin/localized_docs/commit/c35ae612220fec20b475619c957c4f3ed3f190ba Author: Burak Yavuz <hitowerdi...@hotmail.com> Date:

[phpMyAdmin Git] [phpmyadmin/localized_docs] 3c30a5: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: 3c30a5972087574880a53ab294ab31b85c72cb91 https://github.com/phpmyadmin/localized_docs/commit/3c30a5972087574880a53ab294ab31b85c72cb91 Author: Burak Yavuz <hitowerdi...@hotmail.com> Date:

[jira] [Created] (SPARK-14391) Flaky Test org.apache.spark.launcher.LauncherServerSuite.testCommunication

Burak Yavuz created SPARK-14391: --- Summary: Flaky Test org.apache.spark.launcher.LauncherServerSuite.testCommunication Key: SPARK-14391 URL: https://issues.apache.org/jira/browse/SPARK-14391 Project

[jira] [Created] (SPARK-14353) Dateset Time Windowing API for Python, R, and SQL

Burak Yavuz created SPARK-14353: --- Summary: Dateset Time Windowing API for Python, R, and SQL Key: SPARK-14353 URL: https://issues.apache.org/jira/browse/SPARK-14353 Project: Spark Issue Type

[jira] [Updated] (SPARK-14287) Method to determine if Dataset is bounded or not

[ https://issues.apache.org/jira/browse/SPARK-14287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-14287: Summary: Method to determine if Dataset is bounded or not (was: isStreaming method for Dataset

[jira] [Created] (SPARK-14287) isStreaming method for Dataset

Burak Yavuz created SPARK-14287: --- Summary: isStreaming method for Dataset Key: SPARK-14287 URL: https://issues.apache.org/jira/browse/SPARK-14287 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-14160) Windowing for structured streaming

[ https://issues.apache.org/jira/browse/SPARK-14160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-14160: Description: This JIRA is to track the status regarding event time windowing operations

[jira] [Updated] (SPARK-14160) Windowing for structured streaming

[ https://issues.apache.org/jira/browse/SPARK-14160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-14160: Description: This JIRA is to track the status regarding event time windowing operations

[jira] [Updated] (SPARK-14160) Windowing for structured streaming

[ https://issues.apache.org/jira/browse/SPARK-14160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-14160: Description: This JIRA is to track the status regarding event time windowing operations

[jira] [Updated] (SPARK-14160) Windowing for structured streaming

[ https://issues.apache.org/jira/browse/SPARK-14160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-14160: Description: This JIRA is to track the status regarding event time windowing operations

[jira] [Updated] (SPARK-14160) Windowing for structured streaming

[ https://issues.apache.org/jira/browse/SPARK-14160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-14160: Description: This JIRA is to track the status regarding event time windowing operations

[jira] [Updated] (SPARK-14160) Windowing for structured streaming

[ https://issues.apache.org/jira/browse/SPARK-14160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-14160: Description: This JIRA is to track the status regarding event time windowing operations

[jira] [Created] (SPARK-14160) Windowing for structured streaming

Burak Yavuz created SPARK-14160: --- Summary: Windowing for structured streaming Key: SPARK-14160 URL: https://issues.apache.org/jira/browse/SPARK-14160 Project: Spark Issue Type: Sub-task

Re: [VOTE] Release Apache Spark 1.6.1 (RC1)

+1 On Tue, Mar 8, 2016 at 10:59 AM, Andrew Or wrote: > +1 > > 2016-03-08 10:59 GMT-08:00 Yin Huai : > >> +1 >> >> On Mon, Mar 7, 2016 at 12:39 PM, Reynold Xin wrote: >> >>> +1 (binding) >>> >>> >>> On Sun, Mar 6, 2016 at 12:08

Re: Calculation of histogram bins and frequency in Apache spark 1.6

You could use the Bucketizer transformer in Spark ML. Best, Burak On Tue, Feb 23, 2016 at 9:13 AM, Arunkumar Pillai wrote: > Hi > Is there any predefined method to calculate histogram bins and frequency > in spark. Currently I take range and find bins then count

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] ef34c8: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: ef34c811ad9b74897382c4f38a11bbfc3350d7d3 https://github.com/phpmyadmin/phpmyadmin/commit/ef34c811ad9b74897382c4f38a11bbfc3350d7d3 Author: Burak Yavuz <hitowerdi...@hotmail.com> Date: 2016

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 82190f: Translated using Weblate (Turkish)

Branch: refs/heads/QA_4_6 Home: https://github.com/phpmyadmin/phpmyadmin Commit: 82190f978a905c0227514a4c04d2356cd293573a https://github.com/phpmyadmin/phpmyadmin/commit/82190f978a905c0227514a4c04d2356cd293573a Author: Burak Yavuz <hitowerdi...@hotmail.com> Date: 2016

Re: Using SPARK packages in Spark Cluster

Hello Gourav, The packages need to be loaded BEFORE you start the JVM, therefore you won't be able to add packages dynamically in code. You should use the --packages with pyspark before you start your application. One option is to add a `conf` that will load some packages if you are constantly

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 97a9a8: Translated using Weblate (Turkish)

Branch: refs/heads/QA_4_6 Home: https://github.com/phpmyadmin/phpmyadmin Commit: 97a9a8bbd8867104ad9b09114d681cf4f1f869bb https://github.com/phpmyadmin/phpmyadmin/commit/97a9a8bbd8867104ad9b09114d681cf4f1f869bb Author: Burak Yavuz <hitowerdi...@hotmail.com> Date: 2016

Re: Redirect Spark Logs to Kafka

You can use the KafkaLog4jAppender ( https://github.com/apache/kafka/blob/trunk/log4j-appender/src/main/java/org/apache/kafka/log4jappender/KafkaLog4jAppender.java ). Best, Burak On Mon, Feb 1, 2016 at 12:20 PM, Ashish Soni wrote: > Hi All , > > Please let me know how we

Re: Guidelines for writing SPARK packages

Thanks for the reply David, just wanted to fix one part of your response: > If you > want to register a release for your package you will also need to push > the artifacts for your package to Maven central. > It is NOT necessary to push to Maven Central in order to make a release. There are

Re: Spark not able to fetch events from Amazon Kinesis

Hi Yash, I've run into multiple problems due to version incompatibilities, either due to protobuf or jackson. That may be your culprit. The problem is that all failures by the Kinesis Client Lib is silent, therefore don't show up on the logs. It's very hard to debug those buggers. Best, Burak

Re: Optimized way to multiply two large matrices and save output using Spark and Scala

BlockMatrix.multiply is the suggested method of multiplying two large matrices. Is there a reason that you didn't use BlockMatrices? You can load the matrices and convert to and from RowMatrix. If it's in sparse format (i, j, v), then you can also use the CoordinateMatrix to load, BlockMatrix to

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] bd7f28: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: bd7f28f8f794dad75c07221c31795200c65e2d30 https://github.com/phpmyadmin/phpmyadmin/commit/bd7f28f8f794dad75c07221c31795200c65e2d30 Author: Burak Yavuz <hitowerdi...@hotmail.com> Date: 2016

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 27be93: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: 27be93ab6d19cc0afb24b212e6e7ceee4ea317db https://github.com/phpmyadmin/phpmyadmin/commit/27be93ab6d19cc0afb24b212e6e7ceee4ea317db Author: Burak Yavuz <hitowerdi...@hotmail.com> Date: 2015

Re: number of blocks in ALS/recommendation API

Copying the first part from the scaladoc: " This is a blocked implementation of the ALS factorization algorithm that groups the two sets of factors (referred to as "users" and "products") into blocks and reduces communication by only sending one copy of each user vector to each product block on

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] e6ca04: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: e6ca04f83aae09b7dbc187b0fdaaca85b7e8f1f1 https://github.com/phpmyadmin/phpmyadmin/commit/e6ca04f83aae09b7dbc187b0fdaaca85b7e8f1f1 Author: Burak Yavuz <hitowerdi...@hotmail.com> Date: 2015

Re: Spark streaming with Kinesis broken?

I've noticed this happening when there was some dependency conflicts, and it is super hard to debug. It seems that the KinesisClientLibrary version in Spark 1.5.2 is 1.3.0, but it is 1.2.1 in Spark 1.5.1. I feel like that seems to be the problem... Brian, did you verify that it works with the

Re: Spark streaming with Kinesis broken?

t; wrote: > >> Yes, it worked in the 1.6 branch as of commit >> db5165246f2888537dd0f3d4c5a515875c7358ed. That makes it much less >> serious of an issue, although it would be nice to know what the root cause >> is to avoid a regression. >> >> On Thu, De

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 502d72: Translated using Weblate (Turkish)

Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: 502d728c8fa9bc682b3dba15580ffc4df767dd1b https://github.com/phpmyadmin/phpmyadmin/commit/502d728c8fa9bc682b3dba15580ffc4df767dd1b Author: Burak Yavuz <hitowerdi...@hotmail.com> Date: 2015

[jira] [Created] (SPARK-12106) Flaky Test: BatchedWriteAheadLog - name log with aggregated entries with the timestamp of last entry

Burak Yavuz created SPARK-12106: --- Summary: Flaky Test: BatchedWriteAheadLog - name log with aggregated entries with the timestamp of last entry Key: SPARK-12106 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Updated] (SPARK-12106) Flaky Test: BatchedWriteAheadLog - name log with aggregated entries with the timestamp of last entry

[ https://issues.apache.org/jira/browse/SPARK-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-12106: Description: This test is still transiently flaky, because async methods can finish out of order

Re: Export BLAS module on Spark MLlib

Or you could also use reflection like in this Spark Package: https://github.com/brkyvz/lazy-linalg/blob/master/src/main/scala/com/brkyvz/spark/linalg/BLASUtils.scala Best, Burak On Mon, Nov 30, 2015 at 12:48 PM, DB Tsai wrote: > The workaround is have your code in the same

[jira] [Created] (SPARK-11985) Update Spark Streaming - Kinesis Library Documentation regarding data de-aggregation and message handler

Burak Yavuz created SPARK-11985: --- Summary: Update Spark Streaming - Kinesis Library Documentation regarding data de-aggregation and message handler Key: SPARK-11985 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Updated] (SPARK-11985) Update Spark Streaming - Kinesis Library Documentation regarding data de-aggregation and message handler

[ https://issues.apache.org/jira/browse/SPARK-11985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-11985: Description: Update documentation and provide how-to example in guide. > Update Spark Stream

<    1   2   3   4   5   6   7   8   9   10   >