Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: 9c43f5e2d562d2818c71013424321f20988877dd
https://github.com/phpmyadmin/localized_docs/commit/9c43f5e2d562d2818c71013424321f20988877dd
Author: Burak Yavuz
Date: 2018-03-10 (Sat, 10 Mar 2018
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: 7dc7fa713082976097a838f8807ddbb2a33fa284
https://github.com/phpmyadmin/localized_docs/commit/7dc7fa713082976097a838f8807ddbb2a33fa284
Author: Burak Yavuz
Date: 2018-03-08 (Thu, 08 Mar 2018
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: 304c836e2ef77dc7c4ad2f6cede7f3b4d719
https://github.com/phpmyadmin/localized_docs/commit/304c836e2ef77dc7c4ad2f6cede7f3b4d719
Author: Burak Yavuz
Date: 2018-03-05 (Mon, 05 Mar 2018
Congrats all! Well deserved.
On Sat, Mar 3, 2018 at 4:10 AM, Marco Gaido wrote:
> Congratulations to you all!
>
> On 3 Mar 2018 8:30 a.m., "Liang-Chi Hsieh" wrote:
>
>>
>> Congrats to everyone!
>>
>>
>> Kazuaki Ishizaki wrote
>> > Congratulations to everyone!
>> >
>> > Kazuaki Ishizaki
>> >
>>
Burak Yavuz created SPARK-23515:
---
Summary: JsonProtocol.sparkEventToJson can OOM when jsonifying an
event
Key: SPARK-23515
URL: https://issues.apache.org/jira/browse/SPARK-23515
Project: Spark
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/phpmyadmin
Commit: 0d9e9b0610a5951eb028eb02034cf63b3e9e9c07
https://github.com/phpmyadmin/phpmyadmin/commit/0d9e9b0610a5951eb028eb02034cf63b3e9e9c07
Author: Burak Yavuz
Date: 2018-01-26 (Fri, 26 Jan 2018
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/phpmyadmin
Commit: bc5d9b1733c7e24ce63f91e6e1d86d3193d00c91
https://github.com/phpmyadmin/phpmyadmin/commit/bc5d9b1733c7e24ce63f91e6e1d86d3193d00c91
Author: Burak Yavuz
Date: 2018-01-24 (Wed, 24 Jan 2018
[
https://issues.apache.org/jira/browse/SPARK-23194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16336183#comment-16336183
]
Burak Yavuz commented on SPARK-23194:
-
cc [~cloud_fan] seems like you touched
Burak Yavuz created SPARK-23194:
---
Summary: from_json in FAILFAST mode doesn't fail fast, instead it
just returns nulls
Key: SPARK-23194
URL: https://issues.apache.org/jira/browse/SPARK-23194
Pr
Branch: refs/heads/QA_4_7
Home: https://github.com/phpmyadmin/phpmyadmin
Commit: 72914771bb5794298cde06365d499a4f0e6c85d3
https://github.com/phpmyadmin/phpmyadmin/commit/72914771bb5794298cde06365d499a4f0e6c85d3
Author: Burak Yavuz
Date: 2018-01-22 (Mon, 22 Jan 2018
[
https://issues.apache.org/jira/browse/SPARK-23173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16334226#comment-16334226
]
Burak Yavuz commented on SPARK-23173:
-
In terms of usability, I prefer 1. In t
[
https://issues.apache.org/jira/browse/SPARK-23135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16329293#comment-16329293
]
Burak Yavuz commented on SPARK-23135:
-
cc [~vanzin]
> Accumulators don&#x
[
https://issues.apache.org/jira/browse/SPARK-23135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-23135:
Environment:
was:
Didn't do a lot of digging but may be caused by:
[https://githu
[
https://issues.apache.org/jira/browse/SPARK-23135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-23135:
Attachment: webUIAccumulatorRegression.png
> Accumulators don't show up properly in th
[
https://issues.apache.org/jira/browse/SPARK-23135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-23135:
Description:
Didn't do a lot of digging but may be caused by:
[https://github.com/apache/
Burak Yavuz created SPARK-23135:
---
Summary: Accumulators don't show up properly in the Stages page
anymore
Key: SPARK-23135
URL: https://issues.apache.org/jira/browse/SPARK-23135
Project:
Burak Yavuz created SPARK-23094:
---
Summary: Json Readers choose wrong encoding when bad records are
present and fail
Key: SPARK-23094
URL: https://issues.apache.org/jira/browse/SPARK-23094
Project
Burak Yavuz created SPARK-23092:
---
Summary: Migrate MemoryStream to DataSource V2
Key: SPARK-23092
URL: https://issues.apache.org/jira/browse/SPARK-23092
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-20168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz reassigned SPARK-20168:
---
Assignee: Yash Sharma
> Enable kinesis to start stream from Initial position specified b
[
https://issues.apache.org/jira/browse/SPARK-20168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-20168:
Fix Version/s: 2.3.0
> Enable kinesis to start stream from Initial position specified b
[
https://issues.apache.org/jira/browse/SPARK-20168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz resolved SPARK-20168.
-
Resolution: Done
Target Version/s: 2.3.0
Resolved with
https://github.com/apache/spark
In Spark 2.2, you can read from Kafka in batch mode, and then use the json
reader to infer schema:
val df = spark.read.format("kafka")...
.select($"value.cast("string"))
val json = spark.read.json(df)
val schema = json.schema
While the above should be slow (since you're reading almost all data
Hi Stavros,
Queryable state is definitely on the roadmap! We will revamp the StateStore
API a bit, and a queryable StateStore is definitely one of the things we
are thinking about during that revamp.
Best,
Burak
On Dec 8, 2017 9:57 AM, "Stavros Kontopoulos"
wrote:
> Just to re-phrase my questi
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: 3cb9d5aabae32e8d42427484ff3c30777c7acc8c
https://github.com/phpmyadmin/localized_docs/commit/3cb9d5aabae32e8d42427484ff3c30777c7acc8c
Author: Burak Yavuz
Date: 2017-12-04 (Mon, 04 Dec 2017
/a3fd8abc19f7bfb5fc508e3f122c8d54d6edead3
Author: Burak Yavuz
Date: 2017-12-02 (Sat, 02 Dec 2017)
Changed paths:
M po/tr.mo
M po/tr.po
Log Message:
---
Translated using Weblate (Turkish)
Currently translated at 100.0% (2489 of 2489 strings)
[CI skip]
Compare:
https
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: c7f016f67729bc90587003445683ccacac183481
https://github.com/phpmyadmin/localized_docs/commit/c7f016f67729bc90587003445683ccacac183481
Author: Burak Yavuz
Date: 2017-12-01 (Fri, 01 Dec 2017
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: 0885757246501f4498510f180e34c7cd289feb79
https://github.com/phpmyadmin/localized_docs/commit/0885757246501f4498510f180e34c7cd289feb79
Author: Burak Yavuz
Date: 2017-11-29 (Wed, 29 Nov 2017
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/phpmyadmin
Commit: 5479fe57b39fbdb7eb4982c52b1d6f15792beb92
https://github.com/phpmyadmin/phpmyadmin/commit/5479fe57b39fbdb7eb4982c52b1d6f15792beb92
Author: Burak Yavuz
Date: 2017-11-29 (Wed, 29 Nov 2017
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/phpmyadmin
Commit: 0693d61bcd0c97ea4eb4de80613ed6dd7dda344e
https://github.com/phpmyadmin/phpmyadmin/commit/0693d61bcd0c97ea4eb4de80613ed6dd7dda344e
Author: Burak Yavuz
Date: 2017-11-23 (Thu, 23 Nov 2017
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: b54d28e3a3c342c55f0235313c08ee243250b8b7
https://github.com/phpmyadmin/localized_docs/commit/b54d28e3a3c342c55f0235313c08ee243250b8b7
Author: Burak Yavuz
Date: 2017-11-23 (Thu, 23 Nov 2017
'origin/master'
Commit: e47dc0231bf33ada38bfe1d80810bdb7e339ad4d
https://github.com/phpmyadmin/phpmyadmin/commit/e47dc0231bf33ada38bfe1d80810bdb7e339ad4d
Author: Burak Yavuz
Date: 2017-11-15 (Wed, 15 Nov 2017)
Changed paths:
M po/tr.po
Log Message:
---
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: 4aa32ba948949dbb68aa25338d0b78b986e85d5b
https://github.com/phpmyadmin/localized_docs/commit/4aa32ba948949dbb68aa25338d0b78b986e85d5b
Author: Burak Yavuz
Date: 2017-11-14 (Tue, 14 Nov 2017
I think if you don't cache the jdbc table, then it should auto-refresh.
On Mon, Nov 13, 2017 at 1:21 PM, spark receiver
wrote:
> Hi
>
> I’m using struct streaming(spark 2.2) to receive Kafka msg ,it works
> great. The thing is I need to join the Kafka message with a relative static
> table stor
I think if you don't cache the jdbc table, then it should auto-refresh.
On Mon, Nov 13, 2017 at 1:21 PM, spark receiver
wrote:
> Hi
>
> I’m using struct streaming(spark 2.2) to receive Kafka msg ,it works
> great. The thing is I need to join the Kafka message with a relative static
> table stor
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: 533afa8ed1b0d851ee4d53b5d05d33fde3556efe
https://github.com/phpmyadmin/localized_docs/commit/533afa8ed1b0d851ee4d53b5d05d33fde3556efe
Author: Burak Yavuz
Date: 2017-11-06 (Mon, 06 Nov 2017
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: e7a1461c709f68dcf1a464e2785def1650d431ae
https://github.com/phpmyadmin/localized_docs/commit/e7a1461c709f68dcf1a464e2785def1650d431ae
Author: Burak Yavuz
Date: 2017-11-04 (Sat, 04 Nov 2017
Branch: refs/heads/QA_4_7
Home: https://github.com/phpmyadmin/phpmyadmin
Commit: 7571c19980c9f7c2c68f64e7141f7fd7ec8e1b3a
https://github.com/phpmyadmin/phpmyadmin/commit/7571c19980c9f7c2c68f64e7141f7fd7ec8e1b3a
Author: Burak Yavuz
Date: 2017-11-04 (Sat, 04 Nov 2017
+1
On Fri, Nov 3, 2017 at 10:02 PM, vaquar khan wrote:
> +1
>
> On Fri, Nov 3, 2017 at 8:14 PM, Weichen Xu
> wrote:
>
>> +1.
>>
>> On Sat, Nov 4, 2017 at 8:04 AM, Matei Zaharia
>> wrote:
>>
>>> +1 from me too.
>>>
>>> Matei
>>>
>>> > On Nov 3, 2017, at 4:59 PM, Wenchen Fan wrote:
>>> >
>>> >
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/phpmyadmin
Commit: e6ca6b4bac078bf63d36add321861ba957598050
https://github.com/phpmyadmin/phpmyadmin/commit/e6ca6b4bac078bf63d36add321861ba957598050
Author: Burak Yavuz
Date: 2017-11-03 (Fri, 03 Nov 2017
Branch: refs/heads/QA_4_7
Home: https://github.com/phpmyadmin/phpmyadmin
Commit: acd2f7e154ef03e45d40d8428dcb1f8e326bca7b
https://github.com/phpmyadmin/phpmyadmin/commit/acd2f7e154ef03e45d40d8428dcb1f8e326bca7b
Author: Burak Yavuz
Date: 2017-11-03 (Fri, 03 Nov 2017
/localized_docs/commit/d1261990999edce98e2489dddb980fc653dfa6bf
Author: Burak Yavuz
Date: 2017-11-03 (Fri, 03 Nov 2017)
Changed paths:
M po/tr.mo
M po/tr.po
Log Message:
---
Translated using Weblate (Turkish)
Currently translated at 99.2% (2452 of 2471 strings)
[CI skip
Hi Daniel,
Several things:
1) Your error seems to suggest you're using a different version of Spark
and a different version of the sql-kafka connector. Could you make sure
they are on the same Spark version?
2) With Structured Streaming, you may remove everything related to a
StreamingContext.
Hi Darshan,
How are you creating your kafka stream? Can you please share the options
you provide?
spark.readStream.format("kafka")
.option(...) // all these please
.load()
On Sat, Oct 14, 2017 at 1:55 AM, Darshan Pandya
wrote:
> Hello,
>
> I'm using Spark 2.1.0 on CDH 5.8 with kafka 0.10.
Burak Yavuz created SPARK-22238:
---
Summary: EnsureStatefulOpPartitioning shouldn't ask for the child
RDD before planning is completed
Key: SPARK-22238
URL: https://issues.apache.org/jira/browse/SPARK-
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: b02c07015241ff8561a09bca47f9605520580743
https://github.com/phpmyadmin/localized_docs/commit/b02c07015241ff8561a09bca47f9605520580743
Author: Burak Yavuz
Date: 2017-10-05 (Thu, 05 Oct 2017
> KafkaSink("hello2")).start();
>
> query1.awaitTermination();
> query2.awaitTermination();
> sparkSession.streams().awaitAnyTermination();
>
>
>
>
>
> On Tue, Sep 19, 2017 at 11:48 PM, Burak Yavuz wrote:
>
>> Hey Kant,
>>
>> That won't work
[
https://issues.apache.org/jira/browse/SPARK-21977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz resolved SPARK-21977.
-
Resolution: Fixed
Fix Version/s: 2.3.0
> SinglePartition optimizations break cert
Hey Kant,
That won't work either. Your second query may fail, and as long as your
first query is running, you will not know. Put this as the last line
instead:
spark.streams.awaitAnyTermination()
On Tue, Sep 19, 2017 at 10:11 PM, kant kodali wrote:
> Looks like my problem was the order of awai
[
https://issues.apache.org/jira/browse/SPARK-21977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-21977:
Description:
This is a bit hard to explain as there are several issues here, I'll try my
[
https://issues.apache.org/jira/browse/SPARK-21977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-21977:
Summary: SinglePartition optimizations break certain Streaming Stateful
Aggregation requirements
Burak Yavuz created SPARK-21977:
---
Summary: SinglePartition optimizations break certain StateStore
requirements
Key: SPARK-21977
URL: https://issues.apache.org/jira/browse/SPARK-21977
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz reassigned SPARK-21977:
---
Assignee: Burak Yavuz
> SinglePartition optimizations break certain StateStore requireme
[
https://issues.apache.org/jira/browse/SPARK-21977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-21977:
Description: This is a bit hard to explain as there are several issues here
> SinglePartit
Hi Eduardo,
What you have written out is to output counts "as fast as possible" for
windows of 5 minute length and with a sliding window of 1 minute. So for a
record at 10:13, you would get that record included in the count for
10:09-10:14, 10:10-10:15, 10:11-10:16, 10:12-10:16, 10:13-10:18.
Plea
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/phpmyadmin
Commit: 6d59c7fa8d6e6c837a6a1c3097b4a6af07b04e6c
https://github.com/phpmyadmin/phpmyadmin/commit/6d59c7fa8d6e6c837a6a1c3097b4a6af07b04e6c
Author: Burak Yavuz
Date: 2017-09-08 (Fri, 08 Sep 2017
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: d8c3ee7ed4366ebb6998058a2604a2a91c1564f6
https://github.com/phpmyadmin/localized_docs/commit/d8c3ee7ed4366ebb6998058a2604a2a91c1564f6
Author: Burak Yavuz
Date: 2017-09-08 (Fri, 08 Sep 2017
Burak Yavuz created SPARK-21925:
---
Summary: Update trigger interval documentation in docs with
behavior change in Spark 2.2
Key: SPARK-21925
URL: https://issues.apache.org/jira/browse/SPARK-21925
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: c5818b626c248a9c9850f4831a57d8437fca9d3d
https://github.com/phpmyadmin/localized_docs/commit/c5818b626c248a9c9850f4831a57d8437fca9d3d
Author: Burak Yavuz
Date: 2017-09-05 (Tue, 05 Sep 2017
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: 2e00be11cfba0b9dc1ce32e7758127a90c2163f4
https://github.com/phpmyadmin/localized_docs/commit/2e00be11cfba0b9dc1ce32e7758127a90c2163f4
Author: Burak Yavuz
Date: 2017-09-05 (Tue, 05 Sep 2017
x("time")*
>
> On Wed, Aug 30, 2017 at 10:38 AM, kant kodali wrote:
>
>> @Burak so how would the transformation or query would look like for the
>> above example? I don't see flatMapGroupsWithState in the DataSet API
>> Spark 2.1.1. I may be able to upgrade t
Hey TD,
If I understood the question correctly, your solution wouldn't return the
exact solution, since it also groups by on destination. I would say the
easiest solution would be to use flatMapGroupsWithState, where you:
.groupByKey(_.train)
and keep in state the row with the maximum time.
On T
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/sql-parser
Commit: 762475ae5a81aa2af318b9436d4f2337dd186d8e
https://github.com/phpmyadmin/sql-parser/commit/762475ae5a81aa2af318b9436d4f2337dd186d8e
Author: Burak Yavuz
Date: 2017-08-21 (Mon, 21 Aug 2017
Hi Jacek,
The way the memory sink is architected at the moment is that it either
appends a row (append/update mode) or replaces all rows (complete mode).
When a user specifies a checkpoint location, the guarantee Structured
Streaming provides is that output sinks will not lose data and will be abl
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: a0e022e7bb7b5378024698d42353e3d201be8d78
https://github.com/phpmyadmin/localized_docs/commit/a0e022e7bb7b5378024698d42353e3d201be8d78
Author: Burak Yavuz
Date: 2017-08-17 (Thu, 17 Aug 2017
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: 0b25218bf8fb278af4f4c430f1bfe53ddc6e8b09
https://github.com/phpmyadmin/localized_docs/commit/0b25218bf8fb278af4f4c430f1bfe53ddc6e8b09
Author: Burak Yavuz
Date: 2017-08-16 (Wed, 16 Aug 2017
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: 65a48395d512e622d0cd4616654b9a9e9fa7bb69
https://github.com/phpmyadmin/localized_docs/commit/65a48395d512e622d0cd4616654b9a9e9fa7bb69
Author: Burak Yavuz
Date: 2017-08-12 (Sat, 12 Aug 2017
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/phpmyadmin
Commit: 1b6c0c78c1ed76257ab46e498023241f6795f307
https://github.com/phpmyadmin/phpmyadmin/commit/1b6c0c78c1ed76257ab46e498023241f6795f307
Author: Burak Yavuz
Date: 2017-08-11 (Fri, 11 Aug 2017
Branch: refs/heads/QA_4_7
Home: https://github.com/phpmyadmin/phpmyadmin
Commit: 45bbc3a3b0f8ce343d4f725be024776bb089f8df
https://github.com/phpmyadmin/phpmyadmin/commit/45bbc3a3b0f8ce343d4f725be024776bb089f8df
Author: Burak Yavuz
Date: 2017-08-10 (Thu, 10 Aug 2017
[
https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-21590:
Issue Type: Improvement (was: Bug)
> Structured Streaming window start time should supp
[
https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16118560#comment-16118560
]
Burak Yavuz commented on SPARK-21590:
-
Ah, I apologize, I thought the other
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: 45b4fc38bed5513c8cfb291ca0efda7302776800
https://github.com/phpmyadmin/localized_docs/commit/45b4fc38bed5513c8cfb291ca0efda7302776800
Author: Burak Yavuz
Date: 2017-08-07 (Mon, 07 Aug 2017
[
https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16115998#comment-16115998
]
Burak Yavuz commented on SPARK-21590:
-
[~KevinZwx] there's nothing wrong.
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: 1233d632e0bec9428de43ad30879de1e88fbd294
https://github.com/phpmyadmin/localized_docs/commit/1233d632e0bec9428de43ad30879de1e88fbd294
Author: Burak Yavuz
Date: 2017-08-05 (Sat, 05 Aug 2017
[
https://issues.apache.org/jira/browse/SPARK-21588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113519#comment-16113519
]
Burak Yavuz commented on SPARK-21588:
-
that's what I was proposing. `nul
[
https://issues.apache.org/jira/browse/SPARK-21588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113422#comment-16113422
]
Burak Yavuz commented on SPARK-21588:
-
[~vinodkc] [~aokolnychyi]
It happens
[
https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16111460#comment-16111460
]
Burak Yavuz commented on SPARK-21590:
-
There are tests to make sure it supp
[
https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16111458#comment-16111458
]
Burak Yavuz commented on SPARK-21590:
-
Does it output incorrect results if
Burak Yavuz created SPARK-21588:
---
Summary: SQLContext.getConf(key, null) should return null, but it
throws NPE
Key: SPARK-21588
URL: https://issues.apache.org/jira/browse/SPARK-21588
Project: Spark
Hi Priyank,
You may register them as temporary tables to use across language boundaries.
Python:
df = spark.readStream...
# Python logic
df.createOrReplaceTempView("tmp1")
Scala:
val df = spark.table("tmp1")
df.writeStream
.foreach(...)
On Fri, Jul 28, 2017 at 3:06 PM, Priyank Shrivastava w
I think Kant meant time windowing functions. You can use
`window(TIMESTAMP, '24 hours', '24 hours')`
On Tue, Jul 25, 2017 at 9:26 AM, Keith Chapman
wrote:
> Here is an example of a window lead function,
>
> select *, lead(someColumn1) over ( partition by someColumn2 order by
> someColumn13 asc
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: d44be7ccf1b9ab8c43c8114134afc34709f439fa
https://github.com/phpmyadmin/localized_docs/commit/d44be7ccf1b9ab8c43c8114134afc34709f439fa
Author: Burak Yavuz
Date: 2017-07-23 (Sun, 23 Jul 2017
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: 8de51b187366c4f0818e2a9709c9edac1bd1f658
https://github.com/phpmyadmin/localized_docs/commit/8de51b187366c4f0818e2a9709c9edac1bd1f658
Author: Burak Yavuz
Date: 2017-07-21 (Fri, 21 Jul 2017
Branch: refs/heads/QA_4_7
Home: https://github.com/phpmyadmin/phpmyadmin
Commit: efeda3d386f430bea4abc51b42f0630d08ffd70b
https://github.com/phpmyadmin/phpmyadmin/commit/efeda3d386f430bea4abc51b42f0630d08ffd70b
Author: Burak Yavuz
Date: 2017-07-19 (Wed, 19 Jul 2017
[
https://issues.apache.org/jira/browse/SPARK-21463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz reassigned SPARK-21463:
---
Assignee: Burak Yavuz
> Output of StructuredStreaming tables don't respect user s
Burak Yavuz created SPARK-21463:
---
Summary: Output of StructuredStreaming tables don't respect user
specified schema when reading back the table
Key: SPARK-21463
URL: https://issues.apache.org/jira/browse/
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/phpmyadmin
Commit: 982e6180b1fd66d8d9f91ac7d921139390e9c900
https://github.com/phpmyadmin/phpmyadmin/commit/982e6180b1fd66d8d9f91ac7d921139390e9c900
Author: Burak Yavuz
Date: 2017-07-18 (Tue, 18 Jul 2017
[
https://issues.apache.org/jira/browse/SPARK-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz reassigned SPARK-21445:
---
Assignee: Burak Yavuz
> NotSerializableException thrown by UTF8String.IntWrap
Burak Yavuz created SPARK-21445:
---
Summary: NotSerializableException thrown by UTF8String.IntWrapper
Key: SPARK-21445
URL: https://issues.apache.org/jira/browse/SPARK-21445
Project: Spark
Issue
Hi Matthew,
Which Spark version are you using? The expression `to_json` was added in
2.2 with this commit:
https://github.com/apache/spark/commit/0cdcf9114527a2c359c25e46fd6556b3855bfb28
Best,
Burak
On Sun, Jul 16, 2017 at 6:24 PM, Matthew cao wrote:
> Hi all,
> I just read the databricks blog
Have you checked out this blog post?
https://databricks.com/blog/2017/02/23/working-complex-data-formats-structured-streaming-apache-spark-2-1.html
Shows tools and tips on how to work with nested data. You can access data
through `field1.field2.field3` and such with JSON.
Best,
Burak
On Sat, Jul
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: 88c9e535e801aa57d581b3006a664aa09d016c57
https://github.com/phpmyadmin/localized_docs/commit/88c9e535e801aa57d581b3006a664aa09d016c57
Author: Burak Yavuz
Date: 2017-07-15 (Sat, 15 Jul 2017
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: bf3d00394fad64f87ac8b4aac28e71d8dedd06af
https://github.com/phpmyadmin/localized_docs/commit/bf3d00394fad64f87ac8b4aac28e71d8dedd06af
Author: Burak Yavuz
Date: 2017-07-13 (Thu, 13 Jul 2017
[
https://issues.apache.org/jira/browse/SPARK-21370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-21370:
Description:
During Streaming Aggregation, we have two StateStores per task, one used as
read
[
https://issues.apache.org/jira/browse/SPARK-21370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz reopened SPARK-21370:
-
> Avoid doing anything on HDFSBackedStateStore.abort() when there are no
> updates to
[
https://issues.apache.org/jira/browse/SPARK-21370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-21370:
Issue Type: Test (was: Improvement)
> Avoid doing anything on HDFSBackedStateStore.abort() w
[
https://issues.apache.org/jira/browse/SPARK-21370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz closed SPARK-21370.
---
Resolution: Not A Problem
> Avoid doing anything on HDFSBackedStateStore.abort() when there are
Burak Yavuz created SPARK-21370:
---
Summary: Clarify In-Memory State Store purpose (read-only,
read-write) with an additional state
Key: SPARK-21370
URL: https://issues.apache.org/jira/browse/SPARK-21370
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/localized_docs
Commit: 36c3e506285977c660d801f52f187323e97ad2ba
https://github.com/phpmyadmin/localized_docs/commit/36c3e506285977c660d801f52f187323e97ad2ba
Author: Burak Yavuz
Date: 2017-07-04 (Tue, 04 Jul 2017
/8961532a5a7339f2c0506c32d89b11e0291b6916
Author: Burak Yavuz
Date: 2017-07-01 (Sat, 01 Jul 2017)
Changed paths:
M po/tr.mo
M po/tr.po
Log Message:
---
Translated using Weblate (Turkish)
Currently translated at 99.5% (2417 of 2428 strings)
[CI skip]
Compare:
https
Branch: refs/heads/master
Home: https://github.com/phpmyadmin/phpmyadmin
Commit: 153e77fa0b3e748a241a68c4b58a7080cc462762
https://github.com/phpmyadmin/phpmyadmin/commit/153e77fa0b3e748a241a68c4b58a7080cc462762
Author: Burak Yavuz
Date: 2017-06-28 (Wed, 28 Jun 2017
301 - 400 of 1161 matches
Mail list logo
