Re: unsubscribe

[Arne Zachlod]

please read this to unsubscribe: https://spark.apache.org/community.html

TL;DR: user-unsubscr...@spark.apache.org so no mail to the list

On 4/30/19 6:38 AM, Amrit Jangid wrote:




-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[Amrit Jangid]

unsubscribe

[mayur bhole]

Re: unsubscribe

[Song Yang]

>
> unsubscribe
>

unsubscribe

[Byron Lee]

unsubscribe

unsubscribe

[Byron Lee]

Re: Unsubscribe

[Sunil Prabhakara]

Unsubscribe

unsubscribe

[Daniel O' Shaughnessy]

Please stop asking to unsubscribe

[Andrew Melo]

The correct way to unsubscribe is to mail

user-unsubscr...@spark.apache.org

Just mailing the list with "unsubscribe" doesn't actually do anything...

Thanks
Andrew

-----
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[Ahmed Abdulla]

unsubscribe

unsubscribe

[Junior Alvarez]

unsubscribe

Unsubscribe

[Samuel Zhou]

Unsubscribe

unsubscribe

[Junior Alvarez]

Unsubscribe

Unsubscribe

[Nikhil.R.Patil]

Unsubscribe
"Confidentiality Warning: This message and any attachments are intended only 
for the use of the intended recipient(s). 
are confidential and may be privileged. If you are not the intended recipient. 
you are hereby notified that any 
review. re-transmission. conversion to hard copy. copying. circulation or other 
use of this message and any attachments is 
strictly prohibited. If you are not the intended recipient. please notify the 
sender immediately by return email. 
and delete this message and any attachments from your system.

Virus Warning: Although the company has taken reasonable precautions to ensure 
no viruses are present in this email. 
The company cannot accept responsibility for any loss or damage arising from 
the use of this email or attachment."

Re: Unsubscribe

[Raghunadh Madamanchi]

Unsubscribe

On Wed, Jan 30, 2019 at 9:19 PM Soumitra Johri 
wrote:

> unsubscribe
> On Wed, Jan 30, 2019 at 10:05 PM wang wei 
> wrote:
>
>> Unsubscribe
>>
>

Re: Unsubscribe

[Soumitra Johri]

unsubscribe
On Wed, Jan 30, 2019 at 10:05 PM wang wei 
wrote:

> Unsubscribe
>

Unsubscribe

[15313776907]

Unsubscribe

Unsubscribe

[wang wei]

Unsubscribe

unsubscribe

[Aditya Gautam]

unsubscribe

unsubscribe

[Andrew Milkowski]

unsubscribe

Re: unsubscribe

[Aditya Gautam]

On Tue, Jan 29, 2019, 10:14 AM Charles Nnamdi Akalugwu  unsubscribe
>

unsubscribe

[Charles Nnamdi Akalugwu]

unsubscribe

unsubscribe

[Mun, Woyou - US]

unsubscribe

unsubscribe

[Daniel O' Shaughnessy]

unsubscribe

Fwd: unsubscribe

[Anahita Talebi]

unsubscribe

unsubscribe

[neeraj bhadani]

unsubscribe

unsubscribe

[Irtiza Ali]

unsubscribe

Unsubscribe

[pokemonmaster9505]

Re: Unsubscribe

[Sherman Tong]

Unsubscribe

Sent from sherman's mobile device and sorry for being short.

> On Jan 19, 2019, at 2:02 PM, Aditya Gautam  wrote:
> 
> 

Unsubscribe

[Aditya Gautam]

Unsubscribe

[Huy Banh]

Unsubscribe

[Владимир Курятков]

Unsubscribe

RE: How to unsubscribe???

[Junior Alvarez]

Hi!

Thanks for your info...:-)

Unfortunately, I have never received that email you’re talking about (with 
instructions to double confirm), and it is not in my junk or deleted folders 
neither..

Who is the sender of that second email??? And is there a way for you to send me 
that link, so I can double confirm unsubscribing???


B r
/Junior

From: Trevor News 
Sent: den 16 januari 2019 16:31
To: Junior Alvarez 
Cc: user@spark.apache.org
Subject: Re: How to unsubscribe???

Hi Junior,
After you send an email to 
user-unsubscr...@spark.apache.org<mailto:user-unsubscr...@spark.apache.org>, 
you should receive a email with Instructions to double confirm. You will be 
asked to send another email using the link in the 2nd email. Only when that 
step is complete will the unsubscribe take effect.

Please check your Spam or Junk or Clutter folders. Unless we confirm, we will 
continue the subscription.

Hope that helps.

Trevor
Sent from my iPhone

On Jan 16, 2019, at 12:22 AM, Junior Alvarez 
mailto:junior.alva...@ericsson.com>> wrote:
Hi!

I’ve been sending an unsubscribe mail, to this address: 
user-unsubscr...@spark.apache.org<mailto:user-unsubscr...@spark.apache.org>, 
for the last months, and still…I don’t manage to unsubscribe…Why???

B r
/Junior

Re: How to unsubscribe???

[Trevor News]

Hi Junior,
After you send an email to user-unsubscr...@spark.apache.org, you should 
receive a email with Instructions to double confirm. You will be asked to send 
another email using the link in the 2nd email. Only when that step is complete 
will the unsubscribe take effect. 

Please check your Spam or Junk or Clutter folders. Unless we confirm, we will 
continue the subscription. 

Hope that helps. 

Trevor

Sent from my iPhone

> On Jan 16, 2019, at 12:22 AM, Junior Alvarez  
> wrote:
> 
> Hi!
>  
> I’ve been sending an unsubscribe mail, to this address: 
> user-unsubscr...@spark.apache.org, for the last months, and still…I don’t 
> manage to unsubscribe…Why???
>  
> B r
> /Junior

How to unsubscribe???

[Junior Alvarez]

Hi!

I've been sending an unsubscribe mail, to this address: 
user-unsubscr...@spark.apache.org<mailto:user-unsubscr...@spark.apache.org>, 
for the last months, and still...I don't manage to unsubscribe...Why???

B r
/Junior

Unsubscribe

[Deepak Sahoo]

Unsubscribe

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[Liu, Jialin]

Unsubscribe

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[Tariq Hasan]

Unsubscribe

Unsubscribe

[GmailLiang]

Unsubscribe 

Sent from Tianchu(Alex) iPhone

On Dec 4, 2018, at 00:00, Nirmal Manoharan  wrote:

I am trying to deduplicate on streaming data using the dropDuplicate function 
with watermark. The problem I am facing currently is that I have to two 
timestamps for a given record
1. One is the eventtimestamp - timestamp of the record creation from the source
2. Another is an transfer timestamp - timestamp from an intermediate process 
that is responsible to stream the data. 
The duplicates are introduced during the intermediate stage so for a given a 
record duplicate, the eventtimestamp is same but transfer timestamp is 
different. 

For the watermark, I like to use the transfertimestamp because I know the 
duplicates cant occur more than 3 minutes apart in transfer. But I cant use it 
within dropDuplicate because it wont capture the duplicates as the duplicates 
have different transfer timestamp. 

Here is an example,
Event 1:{ "EventString":"example1", "Eventtimestamp": 
"2018-11-29T10:00:00.00", "TransferTimestamp": "2018-11-29T10:05:00.00" }
Event 2 (duplicate): {"EventString":"example1", "Eventtimestamp": 
"2018-11-29T10:00:00.00", "TransferTimestamp": "2018-11-29T10:08:00.00"}

In this case, the duplicate was created during transfer after 3 mins from the 
original event

My code is like below,

streamDataset.
.withWatermark("transferTimestamp", "4 minutes")
.dropDuplicates("eventstring","transferTimestamp");

The above code won't drop the duplicates as transferTimestamp is unique for the 
event and its duplicate. But currently, this is the only way as Spark forces me 
to include the watermark column in the dropDuplicates function. 

I would really like to see an dropDuplicate implementation like below which 
would be a valid case for any at-least once semantics streams where I dont have 
to use the watermark field in dropDuplicates and still the watermark based 
state eviction is honored. 
streamDataset.
.withWatermark("transferTimestamp", "4 minutes")
.dropDuplicates("eventstring");

If anyone has an alternate solution for this, please let me know. I cant use 
the eventtimestamp as it is not ordered and time range varies drastically 
(delayed events and junk events). 

Thanks in advance
-Nirmal

unsubscribe

[Junior Alvarez]

unsubscribe

[Kappaganthu, Sivaram (CORP)]

From: Kappaganthu, Sivaram (CORP)
Sent: Saturday, December 1, 2018 10:18 PM
To: user@spark.apache.org
Subject: unsubscribe


--
This message and any attachments are intended only for the use of the addressee 
and may contain information that is privileged and confidential. If the reader 
of the message is not the intended recipient or an authorized representative of 
the intended recipient, you are hereby notified that any dissemination of this 
communication is strictly prohibited. If you have received this communication 
in error, notify the sender immediately by return email and delete the message 
and any attachments from your system.

unsubscribe

[Kappaganthu, Sivaram (CORP)]

--
This message and any attachments are intended only for the use of the addressee 
and may contain information that is privileged and confidential. If the reader 
of the message is not the intended recipient or an authorized representative of 
the intended recipient, you are hereby notified that any dissemination of this 
communication is strictly prohibited. If you have received this communication 
in error, notify the sender immediately by return email and delete the message 
and any attachments from your system.

unsubscribe

[Vamshi Talla]

Best Regards,

Vamshi T

Unsubscribe

[Donni Khan]

Unsubscribe

[Hasunie Adikari]

-- 
AM Hasunie Sandanathala Adikari
Tel:0713095876

Unsubscribe

[Iryna Kharaborkina]

unsubscribe

[Mario Amatucci]

Mario Amatucci
Senior Software Engineer

Office: +48 12 881 10 05 x 31463   
Email: mario_amatu...@epam.com<mailto:mario_amatu...@epam.com>
Gdansk, Poland   epam.com<http://www.epam.com/>

~do more with less~

CONFIDENTIALITY CAUTION AND DISCLAIMER
This message is intended only for the use of the individual(s) or entity(ies) 
to which it is addressed and contains information that is legally privileged 
and confidential. If you are not the intended recipient, or the person 
responsible for delivering the message to the intended recipient, you are 
hereby notified that any dissemination, distribution or copying of this 
communication is strictly prohibited. All unintended recipients are obliged to 
delete this message and destroy any printed copies.


From: Ryan Adams 
Sent: Thursday, September 20, 2018 7:54 PM
To: user@spark.apache.org
Subject: unsubscribe

unsubscribe

Ryan Adams
radams...@gmail.com<mailto:radams...@gmail.com>

unsubscribe

[Ryan Adams]

unsubscribe

Ryan Adams
radams...@gmail.com

unsubscribe

[Or Rappel-Kroyzer]

Re: Unsubscribe

[Mohan Palavancha]

On Thu, Sep 13, 2018 at 7:47 PM Pekka Lehtonen  wrote:

>
>

Unsubscribe

[Pekka Lehtonen]

Unsubscribe

[Fiona Chow]

Hey all,

I would like to unsubscribe from this mailing list. thank you

-- 










This e-mail and any attachments are confidential and intended 
solely for the use of the recipient(s) to whom they are addressed. If you 
have received it in error, please destroy all copies and inform the sender. 
This email and any attachments are believed to be free from viruses but 
Birdi Ltd. accepts no liability in connection therewith. Any views or 
opinions presented in this email are solely those of the author and do not 
necessarily represent those of Birdi Ltd.

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[Bibudh Lahiri]

Unsubscribe

Unsubscribe

[Anu B Nair]

Hi,

I have tried all possible way to unsubscripted from this group. Can anyone
help?

--
Anu

Re: Unsubscribe

[Sunil Prabhakara]

>
>

Unsubscribe

[Michael Styles]

Unsubscribe

[Happy??????]

unsubscribe

[Ryan Adams]

Ryan Adams
radams...@gmail.com

unsubscribe

[네이버]

> On 8 Aug 2018, at 17:35, Daniel Zhang  wrote:
> 
> Hi, 
> 
> I have one question related to run unit test in Intellij.
> 
> I import spark into my Intellij as Maven project, and have no issue to build 
> the whole project. 
> 
> While for some unit tests, I see they can be run directly in Intellij as unit 
> tests, but others are not.
> 
> Just for example, in the test package: org.apache.spark.sql.hive.execution, 
> there are 2 tests Scala class: PruningSuite and ScriptTransformationSuite, 
> both eventually extends from SparkFunSuite.scala, which is subclass of 
> scalatest FunSuite.
> 
> But in my Intellij, as shown in the picture:
> 
> 
> 
> The PruningSuite is marked as Scala class icon, and I can click it with "Run 
> PruningSuite" directly, to run this unit test. But for 
> ScriptTranformationSuite, it is marked with different icon, and the "Run 
> " unit test option is not there.
> 
> Anyone knows the reason?
> 
> Thanks
> 
> Yong

unsubscribe

[Eco Super]

Hi User,
unsubscribe me

***UNCHECKED*** UNSUBSCRIBE

[sridhararao mutluri]

unsubscribe

[BEKHTI, Abdelmajid]

unsubscribe

unsubscribe

[Peter]

unsubscribe

unsubscribe

[ARAVIND ARUMUGHAM Sethurathnam]

unsubscribe

-- 
Wealth is not money. Wealth is relationships with people.

unsubscribe

[刘崇光]

unsubscribe

unsubscribe

[panda]

unsubscribe

Sent from YoMail

Unsubscribe

[varma dantuluri]

-- 
Regards,

Varma Dantuluri

Unsubscribe

[Shahab Yunus]

Unsubscribe

Unsubscribe

[varma dantuluri]

Unsubscribe

-- 
Regards,

Varma Dantuluri

unsubscribe

[varma dantuluri]

unsubscribe

-- 
Regards,

Varma Dantuluri

Unsubscribe

[Anu B Nair]

unsubscribe

[韩盼]

unsubscribe


-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[varma dantuluri]

-- 
Regards,

Varma Dantuluri

unsubscribe

[Nikhil Kalbande]

unsubscribe
DISCLAIMER
==
This e-mail may contain privileged and confidential information which is the 
property of Persistent Systems Ltd. It is intended only for the use of the 
individual or entity to which it is addressed. If you are not the intended 
recipient, you are not authorized to read, retain, copy, print, distribute or 
use this message. If you have received this communication in error, please 
notify the sender and delete all copies of this message. Persistent Systems 
Ltd. does not accept any liability for virus infected mails.

unsubscribe

[15811225244]

unsubscribe

unsubscribe

[学生张洪斌]

发自网易邮箱大师

unsubscribe

[purna pradeep]

unsubscribe

unsubscribe

[Romero, Saul]

unsubscribe

unsubscribe

[purna pradeep]

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[purna pradeep]

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[Andrei Balici]

-- 
Andrei Balici
Student at the School of Computer Science,
University of Manchester

Re: unsubscribe

[Romero, Saul]

unsubscribe

On Tue, Mar 27, 2018 at 1:15 PM, Nicholas Sharkey <nicholasshar...@gmail.com
> wrote:

>
>

unsubscribe

[Nicholas Sharkey]

unsubscribe

[Mikhail Ibraheem]

unsubscribe

[学生张洪斌]

| |
学生张洪斌
|
|
邮箱：hongbinzh...@163.com
|

签名由 网易邮箱大师 定制

Unsubscribe

[purna pradeep]

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: Unsubscribe

[Romero, Saul]

Unsubscribe


On Mon, Feb 26, 2018 at 8:58 AM, Mallanagouda Patil <
mallanagouda.c.pa...@gmail.com> wrote:

> Unsubscribe
>

Unsubscribe

[purna pradeep]

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[Mallanagouda Patil]

Unsubscribe

Unsubscribe

[purna pradeep]

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[Arun Khetarpal]

Unsubscribe

[Bhaskar Kvvsr]

-- 
*Thanks and Regards,*
*Rama Bhaskar*

Unsubscribe

[Sandeep Kr. Choudhary]

Thanks

Regards

Sandeep Kumar Choudhary
IIT Delhi
Contact: +917042645119

unsubscribe

[qiming zhang]

unsubscribe

Unsubscribe

[Anu B Nair]

Unsubscribe

[Sudheesh K J]

Thanks & Regards

Sudheesh K J
Tata Consultancy Services Limited,
TCS Centre SEZ Unit,
Infopark PO,
Kochi - 682042
Kerala, India
Cell Number: 9746068506
Mail to: sudheesh...@tcs.com
Web site: www.tcs.com

From: Brindha Sengottaiyan <sbrindhad...@yahoo.com.INVALID>
Sent: 24 February 2018 03:06 AM
To: user@spark.apache.org
Subject: Unsubscribe


=-=-=
Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this communication in error, 
please notify us by reply e-mail or telephone and 
immediately and permanently delete the message 
and any attachments. Thank you

Unsubscribe

[Brindha Sengottaiyan]

Unsubscribe

[Ryan Myer]

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[Sandeep Varma]

Sandeep Varma
Principal
ZS Associates India Pvt. Ltd.
World Trade Center, Tower 3, Kharadi, Pune 411014, Maharashtra, India
T  |  +91 20 6739 5224  M  |  +91 97 6633 0103
www.zs.com

ZS  Impact where it matters.






Notice: This message, including attachments, may be confidential or privileged. 
If you are not the addressee, notify the sender immediately and delete this 
email from your system.

Re: Unsubscribe

[purna pradeep]

Unsubscribe