[phpMyAdmin Git] [phpmyadmin/phpmyadmin] bd6bcc: Translated using Weblate (Turkish)

2020-07-22 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: bd6bcc09c18a37ab26ed7783a1ff82db50e1c0ab https://github.com/phpmyadmin/phpmyadmin/commit/bd6bcc09c18a37ab26ed7783a1ff82db50e1c0ab Author: Burak Yavuz Date: 2020-07-22 (Wed, 07 July 2020) +02:00 Changed paths: M po

Re: REST Structured Steaming Sink

2020-07-01 Thread Burak Yavuz
Well, the difference is, a technical user writes the UDF and a non-technical user may use this built-in thing (misconfigure it) and shoot themselves in the foot. On Wed, Jul 1, 2020, 6:40 PM Andrew Melo wrote: > On Wed, Jul 1, 2020 at 8:13 PM Burak Yavuz wrote: > > > > I'm

Re: REST Structured Steaming Sink

2020-07-01 Thread Burak Yavuz
I'm not sure having a built-in sink that allows you to DDOS servers is the best idea either. foreachWriter is typically used for such use cases, not foreachBatch. It's also pretty hard to guarantee exactly-once, rate limiting, etc. Best, Burak On Wed, Jul 1, 2020 at 5:54 PM Holden Karau wrote:

[phpMyAdmin Git] [phpmyadmin/localized_docs] 1dbe8a: Translated using Weblate (Turkish)

2020-06-19 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: 1dbe8a9310d4aceecc6efdc4ee783e940a51686b https://github.com/phpmyadmin/localized_docs/commit/1dbe8a9310d4aceecc6efdc4ee783e940a51686b Author: Burak Yavuz Date: 2020-06-20 (Sat, 06 June 2020) +02:00 Changed paths

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] c3b057: Translated using Weblate (Turkish)

2020-06-16 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: c3b057a6240a0200486a585f4dbc6ba103b98cd5 https://github.com/phpmyadmin/phpmyadmin/commit/c3b057a6240a0200486a585f4dbc6ba103b98cd5 Author: Burak Yavuz Date: 2020-06-16 (Tue, 06 June 2020) +02:00 Changed paths: M po

Re: [vote] Apache Spark 3.0 RC3

2020-06-09 Thread Burak Yavuz
+1 Best, Burak On Tue, Jun 9, 2020 at 1:48 PM Shixiong(Ryan) Zhu wrote: > +1 (binding) > > Best Regards, > Ryan > > > On Tue, Jun 9, 2020 at 4:24 AM Wenchen Fan wrote: > >> +1 (binding) >> >> On Tue, Jun 9, 2020 at 6:15 PM Dr. Kent Yao wrote: >> >>> +1 (non-binding) >>> >>> >>> >>> -- >>>

[phpMyAdmin Git] [phpmyadmin/localized_docs] f43c5b: Translated using Weblate (Turkish)

2020-05-22 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: f43c5bffdadd6a43a5aff3aeeebe1035199854a4 https://github.com/phpmyadmin/localized_docs/commit/f43c5bffdadd6a43a5aff3aeeebe1035199854a4 Author: Burak Yavuz Date: 2020-05-22 (Fri, 05 May 2020) +02:00 Changed paths

Re: [DISCUSS] "complete" streaming output mode

2020-05-21 Thread Burak Yavuz
Oh wow. I never thought this would be up for debate. I use complete mode VERY frequently for all my dashboarding use cases. Here are some of my thoughts: > 1. It destroys the purpose of watermark and forces Spark to maintain all of state rows, growing incrementally. It only works when all keys

Re: [DatasourceV2] Default Mode for DataFrameWriter not Dependent on DataSource Version

2020-05-20 Thread Burak Yavuz
Hey Russell, Great catch on the documentation. It seems out of date. I honestly am against having different DataSources having different default SaveModes. Users will have no clue if a DataSource implementation is V1 or V2. It seems weird that the default value can change for something that I

[phpMyAdmin Git] [phpmyadmin/localized_docs] 3981f4: Translated using Weblate (Turkish)

2020-05-19 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: 3981f4c89230739099264eb2504b1dcf5a297831 https://github.com/phpmyadmin/localized_docs/commit/3981f4c89230739099264eb2504b1dcf5a297831 Author: Burak Yavuz Date: 2020-05-19 (Tue, 05 May 2020) +02:00 Changed paths

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 4ffdee: Translated using Weblate (Turkish)

2020-05-12 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: 4ffdee88df5ba16ddc121294463e555c786b59cf https://github.com/phpmyadmin/phpmyadmin/commit/4ffdee88df5ba16ddc121294463e555c786b59cf Author: Burak Yavuz Date: 2020-05-12 (Tue, 05 May 2020) +02:00 Changed paths: M po

[jira] [Commented] (SPARK-31640) Support SHOW PARTITIONS for DataSource V2 tables

2020-05-08 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102746#comment-17102746 ] Burak Yavuz commented on SPARK-31640: - Hi [~younggyuchun],   I'd take a look at how SHOW

[jira] [Created] (SPARK-31640) Support SHOW PARTITIONS for DataSource V2 tables

2020-05-04 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-31640: --- Summary: Support SHOW PARTITIONS for DataSource V2 tables Key: SPARK-31640 URL: https://issues.apache.org/jira/browse/SPARK-31640 Project: Spark Issue Type

[phpMyAdmin Git] [phpmyadmin/localized_docs] 4ddc04: Translated using Weblate (Turkish)

2020-05-04 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: 4ddc04e9ba5a6706ef075146dfe5a1f532866b4e https://github.com/phpmyadmin/localized_docs/commit/4ddc04e9ba5a6706ef075146dfe5a1f532866b4e Author: Burak Yavuz Date: 2020-05-04 (Mon, 05 May 2020) +02:00 Changed paths

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] f5d993: Translated using Weblate (Turkish)

2020-05-03 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: f5d9934230bf9860382622988f2cd5322826f615 https://github.com/phpmyadmin/phpmyadmin/commit/f5d9934230bf9860382622988f2cd5322826f615 Author: Burak Yavuz Date: 2020-05-04 (Mon, 05 May 2020) +02:00 Changed paths: M po

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] a0b8a0: Translated using Weblate (Turkish)

2020-05-02 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: a0b8a0f1bf2c2db631c55700d524b3b384c3a594 https://github.com/phpmyadmin/phpmyadmin/commit/a0b8a0f1bf2c2db631c55700d524b3b384c3a594 Author: Burak Yavuz Date: 2020-05-02 (Sat, 05 May 2020) +02:00 Changed paths: M po

[jira] [Assigned] (SPARK-31624) SHOW TBLPROPERTIES doesn't handle Session Catalog correctly

2020-05-01 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reassigned SPARK-31624: --- Assignee: Burak Yavuz > SHOW TBLPROPERTIES doesn't handle Session Catalog correc

[jira] [Created] (SPARK-31624) SHOW TBLPROPERTIES doesn't handle Session Catalog correctly

2020-05-01 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-31624: --- Summary: SHOW TBLPROPERTIES doesn't handle Session Catalog correctly Key: SPARK-31624 URL: https://issues.apache.org/jira/browse/SPARK-31624 Project: Spark

Re: [spark streaming] checkpoint location feature for batch processing

2020-05-01 Thread Burak Yavuz
Hi Rishi, That is exactly why Trigger.Once was created for Structured Streaming. The way we look at streaming is that it doesn't have to be always real time, or 24-7 always on. We see streaming as a workflow that you have to repeat indefinitely. See this blog post for more details!

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 9fad88: Translated using Weblate (Turkish)

2020-04-26 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: 9fad882de68b6dc6bb7f99436549d6dfe12c57cb https://github.com/phpmyadmin/phpmyadmin/commit/9fad882de68b6dc6bb7f99436549d6dfe12c57cb Author: Burak Yavuz Date: 2020-04-26 (Sun, 04 April 2020) +02:00 Changed paths: M po

Re: Spark structured streaming - Fallback to earliest offset

2020-04-14 Thread Burak Yavuz
Just set `failOnDataLoss=false` as an option in readStream? On Tue, Apr 14, 2020 at 4:33 PM Ruijing Li wrote: > Hi all, > > I have a spark structured streaming app that is consuming from a kafka > topic with retention set up. Sometimes I face an issue where my query has > not finished

[phpMyAdmin Git] [phpmyadmin/localized_docs] fe5176: Translated using Weblate (Turkish)

2020-04-12 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: fe5176e5bc03432b237dfcda4d61a213e0bf3c01 https://github.com/phpmyadmin/localized_docs/commit/fe5176e5bc03432b237dfcda4d61a213e0bf3c01 Author: Burak Yavuz Date: 2020-04-13 (Mon, 04 April 2020) +02:00 Changed

[jira] [Resolved] (SPARK-29314) ProgressReporter.extractStateOperatorMetrics should not overwrite updated as 0 when it actually runs a batch even with no data

2020-04-08 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-29314. - Fix Version/s: 3.0.0 Resolution: Fixed Resolved by [https://github.com/apache/spark/pull

[jira] [Assigned] (SPARK-29314) ProgressReporter.extractStateOperatorMetrics should not overwrite updated as 0 when it actually runs a batch even with no data

2020-04-08 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reassigned SPARK-29314: --- Assignee: Jungtaek Lim > ProgressReporter.extractStateOperatorMetrics should not overwr

[jira] [Resolved] (SPARK-31278) numOutputRows shows value from last micro batch when there is no new data

2020-04-07 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-31278. - Resolution: Fixed > numOutputRows shows value from last micro batch when there is no new d

[jira] [Assigned] (SPARK-31278) numOutputRows shows value from last micro batch when there is no new data

2020-04-07 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reassigned SPARK-31278: --- Assignee: Burak Yavuz > numOutputRows shows value from last micro batch w

[jira] [Commented] (SPARK-31278) numOutputRows shows value from last micro batch when there is no new data

2020-04-07 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077695#comment-17077695 ] Burak Yavuz commented on SPARK-31278: - Resolved by [https://github.com/apache/spark/pull/28040

[jira] [Updated] (SPARK-31278) numOutputRows shows value from last micro batch when there is no new data

2020-04-07 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-31278: Fix Version/s: 3.0.0 > numOutputRows shows value from last micro batch when there is no new d

[phpMyAdmin Git] [phpmyadmin/localized_docs] 1a762e: Translated using Weblate (Turkish)

2020-04-06 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: 1a762e420805115a940ba137774a3c1fba8db440 https://github.com/phpmyadmin/localized_docs/commit/1a762e420805115a940ba137774a3c1fba8db440 Author: Burak Yavuz Date: 2020-04-06 (Mon, 04 April 2020) +02:00 Changed

[jira] [Created] (SPARK-31278) numOutputRows shows value from last micro batch when there is no new data

2020-03-26 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-31278: --- Summary: numOutputRows shows value from last micro batch when there is no new data Key: SPARK-31278 URL: https://issues.apache.org/jira/browse/SPARK-31278 Project

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 744d8c: Translated using Weblate (Turkish)

2020-03-20 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: 744d8c0632471e44550dc5e2475de45c95a2b386 https://github.com/phpmyadmin/phpmyadmin/commit/744d8c0632471e44550dc5e2475de45c95a2b386 Author: Burak Yavuz Date: 2020-03-20 (Fri, 03 March 2020) +01:00 Changed paths: M po

[jira] [Resolved] (SPARK-31178) sql("INSERT INTO v2DataSource ...").collect() double inserts

2020-03-18 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-31178. - Fix Version/s: 3.0.0 Assignee: Burak Yavuz Resolution: Fixed Resolved by [https

[jira] [Commented] (SPARK-31178) sql("INSERT INTO v2DataSource ...").collect() double inserts

2020-03-17 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061292#comment-17061292 ] Burak Yavuz commented on SPARK-31178: - cc [~wenchen] [~rdblue] > sql("INSERT INTO v2Da

[jira] [Created] (SPARK-31178) sql("INSERT INTO v2DataSource ...").collect() double inserts

2020-03-17 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-31178: --- Summary: sql("INSERT INTO v2DataSource ...").collect() double inserts Key: SPARK-31178 URL: https://issues.apache.org/jira/browse/SPARK-31178 Proj

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 928d01: Translated using Weblate (Turkish)

2020-03-15 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: 928d0173e52846760c44ab4a09f41ad6301dada8 https://github.com/phpmyadmin/phpmyadmin/commit/928d0173e52846760c44ab4a09f41ad6301dada8 Author: Burak Yavuz Date: 2020-03-15 (Sun, 03 March 2020) +01:00 Changed paths: M po

[phpMyAdmin Git] [phpmyadmin/localized_docs] 047810: Translated using Weblate (Turkish)

2020-03-15 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: 04781051bfe075be5cf21ed0960c133989c9b78f https://github.com/phpmyadmin/localized_docs/commit/04781051bfe075be5cf21ed0960c133989c9b78f Author: Burak Yavuz Date: 2020-03-15 (Sun, 03 March 2020) +01:00 Changed

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 736446: Translated using Weblate (Turkish)

2020-03-15 Thread Burak Yavuz
Branch: refs/heads/QA_5_0 Home: https://github.com/phpmyadmin/phpmyadmin Commit: 736446e952fbe0f90431f0e1a6362e0fb3737fd6 https://github.com/phpmyadmin/phpmyadmin/commit/736446e952fbe0f90431f0e1a6362e0fb3737fd6 Author: Burak Yavuz Date: 2020-03-15 (Sun, 03 March 2020) +01:00 Changed paths: M po

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 2a2887: Translated using Weblate (Turkish)

2020-03-15 Thread Burak Yavuz
Branch: refs/heads/QA_4_9 Home: https://github.com/phpmyadmin/phpmyadmin Commit: 2a288776702b9f631d0d593e3f4878476e973e8b https://github.com/phpmyadmin/phpmyadmin/commit/2a288776702b9f631d0d593e3f4878476e973e8b Author: Burak Yavuz Date: 2020-03-15 (Sun, 03 March 2020) +01:00 Changed paths: M po

[phpMyAdmin Git] [phpmyadmin/localized_docs] dd3cb4: Translated using Weblate (Turkish)

2020-03-14 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: dd3cb45a598442e29f7ff428f3e698387d34ee39 https://github.com/phpmyadmin/localized_docs/commit/dd3cb45a598442e29f7ff428f3e698387d34ee39 Author: Burak Yavuz Date: 2020-03-15 (Sun, 03 March 2020) +01:00 Changed

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 56b800: Translated using Weblate (Turkish)

2020-03-13 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: 56b80021bd21fb386a2a886b676d27c94918d107 https://github.com/phpmyadmin/phpmyadmin/commit/56b80021bd21fb386a2a886b676d27c94918d107 Author: Burak Yavuz Date: 2020-03-13 (Fri, 03 March 2020) +01:00 Changed paths: M po

Re: ForEachBatch collecting batch to driver

2020-03-11 Thread Burak Yavuz
foreachBatch gives you the micro-batch as a DataFrame, which is distributed. If you don't call collect on that DataFrame, it shouldn't have any memory implications on the Driver. On Tue, Mar 10, 2020 at 3:46 PM Ruijing Li wrote: > Hi all, > > I’m curious on how foreachbatch works in spark

Re: [VOTE] Amend Spark's Semantic Versioning Policy

2020-03-09 Thread Burak Yavuz
+1 On Mon, Mar 9, 2020 at 4:55 PM Reynold Xin wrote: > +1 > > > > On Mon, Mar 09, 2020 at 3:53 PM, John Zhuge wrote: > >> +1 (non-binding) >> >> On Mon, Mar 9, 2020 at 1:32 PM Michael Heuer wrote: >> >>> +1 (non-binding) >>> >>> I am disappointed however that this only mentions API and not

[jira] [Created] (SPARK-31061) Impossible to change the provider of a table in the HiveMetaStore

2020-03-05 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-31061: --- Summary: Impossible to change the provider of a table in the HiveMetaStore Key: SPARK-31061 URL: https://issues.apache.org/jira/browse/SPARK-31061 Project: Spark

[jira] [Created] (SPARK-30924) Add additional validation into Merge Into

2020-02-22 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-30924: --- Summary: Add additional validation into Merge Into Key: SPARK-30924 URL: https://issues.apache.org/jira/browse/SPARK-30924 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-29908) Support partitioning for DataSource V2 tables in DataFrameWriter.save

2020-02-19 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-29908. - Resolution: Duplicate > Support partitioning for DataSource V2 tables in DataFrameWriter.s

[jira] [Commented] (SPARK-30814) Add Columns references should be able to resolve each other

2020-02-13 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036418#comment-17036418 ] Burak Yavuz commented on SPARK-30814: - cc [~cloud_fan] [~imback82], can we prioritize this over

[jira] [Created] (SPARK-30814) Add Columns references should be able to resolve each other

2020-02-13 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-30814: --- Summary: Add Columns references should be able to resolve each other Key: SPARK-30814 URL: https://issues.apache.org/jira/browse/SPARK-30814 Project: Spark

Re: Best way to read batch from Kafka and Offsets

2020-02-04 Thread Burak Yavuz
write mode but > my thinking was at that point it was easier to read from kafka through > batch mode. > > Thanks, > RJ > > On Tue, Feb 4, 2020 at 4:20 PM Burak Yavuz wrote: > >> Hi Ruijing, >> >> Why do you not want to use structured streaming here?

Re: Best way to read batch from Kafka and Offsets

2020-02-04 Thread Burak Yavuz
Hi Ruijing, Why do you not want to use structured streaming here? This is exactly why structured streaming + Trigger.Once was built, just so that you don't build that solution yourself. You also get exactly once semantics if you use the built in sinks. Best, Burak On Mon, Feb 3, 2020 at 3:15 PM

[jira] [Assigned] (SPARK-30697) Handle database and namespace exceptions in catalog.isView

2020-02-02 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reassigned SPARK-30697: --- Assignee: Burak Yavuz > Handle database and namespace exceptions in catalog.isV

[jira] [Resolved] (SPARK-30697) Handle database and namespace exceptions in catalog.isView

2020-02-02 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-30697. - Fix Version/s: 3.0.0 Resolution: Fixed Resolved by [#27423|https://github.com/apache

[jira] [Created] (SPARK-30697) Handle database and namespace exceptions in catalog.isView

2020-01-31 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-30697: --- Summary: Handle database and namespace exceptions in catalog.isView Key: SPARK-30697 URL: https://issues.apache.org/jira/browse/SPARK-30697 Project: Spark

[phpMyAdmin Git] [phpmyadmin/localized_docs] 630086: Translated using Weblate (Turkish)

2020-01-31 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: 630086043ce2cc90d9f79f0668ceb3d3741f8df3 https://github.com/phpmyadmin/localized_docs/commit/630086043ce2cc90d9f79f0668ceb3d3741f8df3 Author: Burak Yavuz Date: 2020-01-31 (Fri, 01 January 2020) +01:00 Changed

[jira] [Resolved] (SPARK-30669) Introduce AdmissionControl API to Structured Streaming

2020-01-30 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-30669. - Fix Version/s: 3.0.0 Assignee: Burak Yavuz Resolution: Done Resolved by [https

[jira] [Created] (SPARK-30669) Introduce AdmissionControl API to Structured Streaming

2020-01-28 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-30669: --- Summary: Introduce AdmissionControl API to Structured Streaming Key: SPARK-30669 URL: https://issues.apache.org/jira/browse/SPARK-30669 Project: Spark Issue

[jira] [Resolved] (SPARK-30314) Add identifier and catalog information to DataSourceV2Relation

2020-01-26 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-30314. - Fix Version/s: 3.0.0 Resolution: Fixed Resolved by [https://github.com/apache/spark/pull

[jira] [Assigned] (SPARK-30314) Add identifier and catalog information to DataSourceV2Relation

2020-01-26 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reassigned SPARK-30314: --- Assignee: Yuchen Huo > Add identifier and catalog information to DataSourceV2Relat

[jira] [Commented] (SPARK-30612) can't resolve qualified column name with v2 tables

2020-01-23 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022678#comment-17022678 ] Burak Yavuz commented on SPARK-30612: - I prefer SubqueryAlias. We need to support all degrees

[jira] [Commented] (SPARK-30615) normalize the column name in AlterTable

2020-01-23 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022577#comment-17022577 ] Burak Yavuz commented on SPARK-30615: - I actually had a PR in progress on this. Let me push

[jira] [Commented] (SPARK-30612) can't resolve qualified column name with v2 tables

2020-01-23 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022343#comment-17022343 ] Burak Yavuz commented on SPARK-30612: - SPARK-30314 should help make this work easier > ca

[phpMyAdmin Git] [phpmyadmin/localized_docs] a8d178: Translated using Weblate (Turkish)

2020-01-20 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: a8d1787fa6ce694471cf6a3793155b894bc5c0f4 https://github.com/phpmyadmin/localized_docs/commit/a8d1787fa6ce694471cf6a3793155b894bc5c0f4 Author: Burak Yavuz Date: 2020-01-20 (Mon, 01 January 2020) +01:00 Changed

[jira] [Resolved] (SPARK-29219) DataSourceV2: Support all SaveModes in DataFrameWriter.save

2020-01-09 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-29219. - Fix Version/s: 3.0.0 Resolution: Done Resolved by [https://github.com/apache/spark/pull

[jira] [Assigned] (SPARK-29219) DataSourceV2: Support all SaveModes in DataFrameWriter.save

2020-01-09 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reassigned SPARK-29219: --- Assignee: Burak Yavuz > DataSourceV2: Support all SaveModes in DataFrameWriter.s

[phpMyAdmin Git] [phpmyadmin/localized_docs] ff34b6: Translated using Weblate (Turkish)

2020-01-08 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: ff34b63cf5913c25f69edcd21cf36abb8c81e71f https://github.com/phpmyadmin/localized_docs/commit/ff34b63cf5913c25f69edcd21cf36abb8c81e71f Author: Burak Yavuz Date: 2020-01-08 (Wed, 01 January 2020) +01:00 Changed

[phpMyAdmin Git] [phpmyadmin/localized_docs] d20e33: Translated using Weblate (Turkish)

2020-01-06 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: d20e3317cee47f4b6e0b275c28b0eaca990c4f87 https://github.com/phpmyadmin/localized_docs/commit/d20e3317cee47f4b6e0b275c28b0eaca990c4f87 Author: Burak Yavuz Date: 2020-01-06 (Mon, 01 January 2020) +01:00 Changed

Re: Issues with Delta Lake on 3.0.0 preview + preview 2

2019-12-30 Thread Burak Yavuz
I can't imagine any Spark data source using Spark internals compiled on Spark 2.4 working on 3.0 out of the box. There are many braking changes. I'll try to get a *dev* branch for 3.0 soon (mid Jan). Best, Burak On Mon, Dec 30, 2019, 8:53 AM Jean-Georges Perrin wrote: > Hi there, > > Trying to

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 301b4e: Translated using Weblate (Turkish)

2019-12-23 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: 301b4e261ec9d183fc0a529c55bd985d501f1062 https://github.com/phpmyadmin/phpmyadmin/commit/301b4e261ec9d183fc0a529c55bd985d501f1062 Author: Burak Yavuz Date: 2019-12-23 (Mon, 12 December 2019) +01:00 Changed paths: M

[phpMyAdmin Git] [phpmyadmin/localized_docs] eec987: Translated using Weblate (Turkish)

2019-12-23 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: eec98780adc068c51fec1264fa98d3199416c878 https://github.com/phpmyadmin/localized_docs/commit/eec98780adc068c51fec1264fa98d3199416c878 Author: Burak Yavuz Date: 2019-12-23 (Mon, 12 December 2019) +01:00 Changed

[jira] [Updated] (SPARK-30334) Add metadata around semi-structured columns to Spark

2019-12-23 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-30334: Description: Semi-structured data is used widely in the data industry for reporting events

[jira] [Created] (SPARK-30334) Add metadata around semi-structured columns to Spark

2019-12-23 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-30334: --- Summary: Add metadata around semi-structured columns to Spark Key: SPARK-30334 URL: https://issues.apache.org/jira/browse/SPARK-30334 Project: Spark Issue

[jira] [Created] (SPARK-30324) Simplify API for JSON access in DataFrames/SQL

2019-12-20 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-30324: --- Summary: Simplify API for JSON access in DataFrames/SQL Key: SPARK-30324 URL: https://issues.apache.org/jira/browse/SPARK-30324 Project: Spark Issue Type: New

[jira] [Resolved] (SPARK-30143) StreamingQuery.stop() should not block indefinitely

2019-12-13 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-30143. - Fix Version/s: 3.0.0 Resolution: Done Resolved as part of [https://github.com/apache

[jira] [Assigned] (SPARK-30143) StreamingQuery.stop() should not block indefinitely

2019-12-13 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reassigned SPARK-30143: --- Assignee: Burak Yavuz > StreamingQuery.stop() should not block indefinit

[jira] [Resolved] (SPARK-30241) Make the target table relations not children of DELETE/UPDATE/MERGE

2019-12-12 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-30241. - Resolution: Not A Problem > Make the target table relations not children of DELETE/UPDATE/ME

[jira] [Created] (SPARK-30241) Make the target table relations not children of DELETE/UPDATE/MERGE

2019-12-12 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-30241: --- Summary: Make the target table relations not children of DELETE/UPDATE/MERGE Key: SPARK-30241 URL: https://issues.apache.org/jira/browse/SPARK-30241 Project: Spark

[jira] [Created] (SPARK-30143) StreamingQuery.stop() should not block indefinitely

2019-12-05 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-30143: --- Summary: StreamingQuery.stop() should not block indefinitely Key: SPARK-30143 URL: https://issues.apache.org/jira/browse/SPARK-30143 Project: Spark Issue Type

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 798046: Translated using Weblate (Turkish)

2019-12-05 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: 7980468153bcc0c62946f652947a39873ac3381b https://github.com/phpmyadmin/phpmyadmin/commit/7980468153bcc0c62946f652947a39873ac3381b Author: Burak Yavuz Date: 2019-11-26 (Tue, 11 November 2019) +01:00 Changed paths: M

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 798046: Translated using Weblate (Turkish)

2019-12-05 Thread Burak Yavuz
Branch: refs/heads/QA_5_0 Home: https://github.com/phpmyadmin/phpmyadmin Commit: 7980468153bcc0c62946f652947a39873ac3381b https://github.com/phpmyadmin/phpmyadmin/commit/7980468153bcc0c62946f652947a39873ac3381b Author: Burak Yavuz Date: 2019-11-26 (Tue, 11 November 2019) +01:00 Changed paths: M

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] c799d1: Translated using Weblate (Turkish)

2019-11-25 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: c799d1ad7431c80c5740128fdaa4c4089b9d1881 https://github.com/phpmyadmin/phpmyadmin/commit/c799d1ad7431c80c5740128fdaa4c4089b9d1881 Author: Burak Yavuz Date: 2019-11-26 (Tue, 11 November 2019) +01:00 Changed paths: M

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 798046: Translated using Weblate (Turkish)

2019-11-25 Thread Burak Yavuz
Branch: refs/heads/QA_4_9 Home: https://github.com/phpmyadmin/phpmyadmin Commit: 7980468153bcc0c62946f652947a39873ac3381b https://github.com/phpmyadmin/phpmyadmin/commit/7980468153bcc0c62946f652947a39873ac3381b Author: Burak Yavuz Date: 2019-11-26 (Tue, 11 November 2019) +01:00 Changed paths: M

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 9457e1: Translated using Weblate (Turkish)

2019-11-24 Thread Burak Yavuz
Branch: refs/heads/QA_5_0 Home: https://github.com/phpmyadmin/phpmyadmin Commit: 9457e11ad39f27ae1889da764363f3bd68167bfc https://github.com/phpmyadmin/phpmyadmin/commit/9457e11ad39f27ae1889da764363f3bd68167bfc Author: Burak Yavuz Date: 2019-11-24 (Sun, 11 November 2019) +01:00 Changed paths: M

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 30411b: Translated using Weblate (Turkish)

2019-11-21 Thread Burak Yavuz
Branch: refs/heads/QA_5_0 Home: https://github.com/phpmyadmin/phpmyadmin Commit: 30411bcc5445e10f6229379a57b58c2879d282d4 https://github.com/phpmyadmin/phpmyadmin/commit/30411bcc5445e10f6229379a57b58c2879d282d4 Author: Burak Yavuz Date: 2019-11-21 (Thu, 11 November 2019) +01:00 Changed paths: M

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] cd1383: Translated using Weblate (Turkish)

2019-11-21 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: cd13839b65c472bcbfb270de903c0555d5c93c6a https://github.com/phpmyadmin/phpmyadmin/commit/cd13839b65c472bcbfb270de903c0555d5c93c6a Author: Burak Yavuz Date: 2019-11-21 (Thu, 11 November 2019) +01:00 Changed paths: M

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 19cdf4: Translated using Weblate (Turkish)

2019-11-21 Thread Burak Yavuz
Branch: refs/heads/QA_4_9 Home: https://github.com/phpmyadmin/phpmyadmin Commit: 19cdf4f165d8d8137e88bc5c340475a1e6f4beec https://github.com/phpmyadmin/phpmyadmin/commit/19cdf4f165d8d8137e88bc5c340475a1e6f4beec Author: Burak Yavuz Date: 2019-11-21 (Thu, 11 November 2019) +01:00 Changed paths: M

Re: Structured Streaming & Enrichment Broadcasts

2019-11-18 Thread Burak Yavuz
If you store the data that you're going to broadcast as a Delta table (see delta.io) and perform a stream-batch (where your Delta table is the batch) join, it will auto-update once the table receives any updates. Best, Burak On Mon, Nov 18, 2019, 6:21 AM Bryan Jeffrey wrote: > Hello. > > We're

[jira] [Commented] (SPARK-29900) make relation lookup behavior consistent within Spark SQL

2019-11-14 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974436#comment-16974436 ] Burak Yavuz commented on SPARK-29900: - I definitely agree the behavior is very confusing here

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 06aeed: Translated using Weblate (Turkish)

2019-11-13 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: 06aeed73b38c84dc0f1eab7fd6f947c7488a381c https://github.com/phpmyadmin/phpmyadmin/commit/06aeed73b38c84dc0f1eab7fd6f947c7488a381c Author: Burak Yavuz Date: 2019-11-13 (Wed, 11 November 2019) +01:00 Changed paths: M

[phpMyAdmin Git] [phpmyadmin/localized_docs] b49ead: Translated using Weblate (Turkish)

2019-11-13 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: b49ead05009bf38227885989e9ac203ff516b69e https://github.com/phpmyadmin/localized_docs/commit/b49ead05009bf38227885989e9ac203ff516b69e Author: Burak Yavuz Date: 2019-11-13 (Wed, 11 November 2019) +01:00 Changed

[phpMyAdmin Git] [phpmyadmin/localized_docs] bbb10d: Translated using Weblate (Turkish)

2019-11-11 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: bbb10d0543e854ceb326a36c9ca8f4a5aee50a38 https://github.com/phpmyadmin/localized_docs/commit/bbb10d0543e854ceb326a36c9ca8f4a5aee50a38 Author: Burak Yavuz Date: 2019-11-12 (Tue, 11 November 2019) +01:00 Changed

[phpMyAdmin Git] [phpmyadmin/localized_docs] 4ee4fe: Translated using Weblate (Turkish)

2019-11-10 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: 4ee4febedadee4a137f9018369345f3f449df04b https://github.com/phpmyadmin/localized_docs/commit/4ee4febedadee4a137f9018369345f3f449df04b Author: Burak Yavuz Date: 2019-11-11 (Mon, 11 November 2019) +01:00 Changed

[phpMyAdmin Git] [phpmyadmin/localized_docs] a095c7: Translated using Weblate (Turkish)

2019-11-10 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: a095c7ca666f9a6f49d4f3faa0a2e3a92c20134d https://github.com/phpmyadmin/localized_docs/commit/a095c7ca666f9a6f49d4f3faa0a2e3a92c20134d Author: Burak Yavuz Date: 2019-11-10 (Sun, 11 November 2019) +01:00 Changed

[phpMyAdmin Git] [phpmyadmin/localized_docs] 6315a5: Translated using Weblate (Turkish)

2019-11-09 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/localized_docs Commit: 6315a55a0761a4db4d430dc4df66d2209a614af9 https://github.com/phpmyadmin/localized_docs/commit/6315a55a0761a4db4d430dc4df66d2209a614af9 Author: Burak Yavuz Date: 2019-11-09 (Sat, 11 November 2019) +01:00 Changed

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] d4a745: Translated using Weblate (Turkish)

2019-11-09 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: d4a74542e4ff0f7488c956fc087255d2e09513cd https://github.com/phpmyadmin/phpmyadmin/commit/d4a74542e4ff0f7488c956fc087255d2e09513cd Author: Burak Yavuz Date: 2019-11-09 (Sat, 11 November 2019) +01:00 Changed paths: M

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 254920: Translated using Weblate (Turkish)

2019-11-09 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: 254920c443d791c195cd22bd72a5c4fe6573c1d1 https://github.com/phpmyadmin/phpmyadmin/commit/254920c443d791c195cd22bd72a5c4fe6573c1d1 Author: Burak Yavuz Date: 2019-11-07 (Thu, 11 November 2019) +01:00 Changed paths: M

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 254920: Translated using Weblate (Turkish)

2019-11-09 Thread Burak Yavuz
Branch: refs/heads/QA_5_0 Home: https://github.com/phpmyadmin/phpmyadmin Commit: 254920c443d791c195cd22bd72a5c4fe6573c1d1 https://github.com/phpmyadmin/phpmyadmin/commit/254920c443d791c195cd22bd72a5c4fe6573c1d1 Author: Burak Yavuz Date: 2019-11-07 (Thu, 11 November 2019) +01:00 Changed paths: M

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 254920: Translated using Weblate (Turkish)

2019-11-06 Thread Burak Yavuz
Branch: refs/heads/QA_4_9 Home: https://github.com/phpmyadmin/phpmyadmin Commit: 254920c443d791c195cd22bd72a5c4fe6573c1d1 https://github.com/phpmyadmin/phpmyadmin/commit/254920c443d791c195cd22bd72a5c4fe6573c1d1 Author: Burak Yavuz Date: 2019-11-07 (Thu, 11 November 2019) +01:00 Changed paths: M

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 16eb18: Translated using Weblate (Turkish)

2019-11-06 Thread Burak Yavuz
Branch: refs/heads/master Home: https://github.com/phpmyadmin/phpmyadmin Commit: 16eb18e01fbfb22335a01af3542f1394e03366f1 https://github.com/phpmyadmin/phpmyadmin/commit/16eb18e01fbfb22335a01af3542f1394e03366f1 Author: Burak Yavuz Date: 2019-11-07 (Thu, 11 November 2019) +01:00 Changed paths: M

[phpMyAdmin Git] [phpmyadmin/phpmyadmin] 7309d3: Translated using Weblate (Turkish)

2019-11-06 Thread Burak Yavuz
Branch: refs/heads/QA_5_0 Home: https://github.com/phpmyadmin/phpmyadmin Commit: 7309d31c6afa7fe40d1efa52e7e8e5b42d148481 https://github.com/phpmyadmin/phpmyadmin/commit/7309d31c6afa7fe40d1efa52e7e8e5b42d148481 Author: Burak Yavuz Date: 2019-11-07 (Thu, 11 November 2019) +01:00 Changed paths: M

[jira] [Created] (SPARK-29778) saveAsTable append mode is not passing writer options

2019-11-06 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-29778: --- Summary: saveAsTable append mode is not passing writer options Key: SPARK-29778 URL: https://issues.apache.org/jira/browse/SPARK-29778 Project: Spark Issue

Re: Delta with intelligent upsett

2019-11-02 Thread Burak Yavuz
You can just add the target partitioning filter to your MERGE or UPDATE condition, e.g. MERGE INTO target USING source ON target.key = source.key AND target.year = year(current_date()) ... Best, Burak On Thu, Oct 31, 2019, 10:15 PM ayan guha wrote: > > Hi > > we have a scenario where we have

<    1   2   3   4   5   6   7   8   9   10   >