Re: Tools for regression testing

[Bjørn Jørgensen]

At the wikipedia regression testing page
https://en.wikipedia.org/wiki/Regression_testing

Under use
"
Regression tests can be broadly categorized as functional tests
 or unit tests
. Functional tests exercise the
complete program with various inputs. Unit tests exercise individual
functions, subroutines , or
object methods. Both functional testing tools and unit-testing tools tend
to be automated and are often third-party products that are not part of the
compiler suite. A functional test may be a scripted series of program
inputs, possibly even involving an automated mechanism for controlling
mouse movements and clicks. A unit test may be a set of separate functions
within the code itself or a driver layer that links to the code without
altering the code being tested.
"

When you change or add anything to Spark. You fork the git repo. then you
make the changes, then you make a new branch. and push the branch to yours
fork git repo.

"Push commits to your branch. This will trigger “Build and test” and
“Report test results” workflows on your forked repository and start testing
and validating your changes."
This is number 7 in Howto contributing to Spark under Pull request



So to answer your question. Yes, every change is tested before the change
[PR] goes to the master branch.
We don't have unit tests for everything, so we have to test things
manually after building.




tor. 24. mar. 2022 kl. 20:47 skrev Mich Talebzadeh <
mich.talebza...@gmail.com>:

> good point.
>
> I just wanted to know when we do changes to releases or RC, is there some
> mechanism that ensures the Spark release still functions as expected
> after any code changes, updates etc?
>
> For example there was a recent discussion about Kafka upgrade to 3.x with
> Spark upgrade to 3.x and its likely impact. Integration testing can be
> achieved through CI/CD which I believe Spark relied on Jenkins until
> recently.
>
> HTH
>
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
> On Thu, 24 Mar 2022 at 19:38, Sean Owen  wrote:
>
>> Hm, then what are you looking for besides all the tests in Spark?
>>
>> On Thu, Mar 24, 2022, 2:34 PM Mich Talebzadeh 
>> wrote:
>>
>>> Thanks
>>>
>>> I know what unit testing is. The question was not about unit testing. it
>>> was specific to regression testing
>>> 
>>>  artifacts .
>>>
>>>
>>> cheers,
>>>
>>>
>>> Mich
>>>
>>>
>>>view my Linkedin profile
>>> 
>>>
>>>
>>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>>
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>>> any loss, damage or destruction of data or any other property which may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for any monetary damages
>>> arising from such loss, damage or destruction.
>>>
>>>
>>>
>>>
>>> On Thu, 24 Mar 2022 at 19:02, Bjørn Jørgensen 
>>> wrote:
>>>
 Yes, Spark uses unit tests.

 https://app.codecov.io/gh/apache/spark

 https://en.wikipedia.org/wiki/Unit_testing



 man. 21. mar. 2022 kl. 15:46 skrev Mich Talebzadeh <
 mich.talebza...@gmail.com>:

> Hi,
>
> As a matter of interest do Spark releases deploy a specific regression
> testing tool?
>
> Thanks
>
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for
> any loss, damage or destruction of data or any other property which may
> arise from relying on this email's technical content is explicitly
> disclaimed. The author will in no case be liable for any monetary damages
> arising from such loss, damage or destruction.
>
>
>


 --
 Bjørn Jørgensen
 Vestre Aspehaug 4, 6010 Ålesund
 Norge

 +47 480 94 297

>>>

-- 
Bjørn Jørgensen
Vestre Aspehaug 4, 6010 Ålesund
Norge

+47 480 94 297

Re: Tools for regression testing

[Mich Talebzadeh]

good point.

I just wanted to know when we do changes to releases or RC, is there some
mechanism that ensures the Spark release still functions as expected after
any code changes, updates etc?

For example there was a recent discussion about Kafka upgrade to 3.x with
Spark upgrade to 3.x and its likely impact. Integration testing can be
achieved through CI/CD which I believe Spark relied on Jenkins until
recently.

HTH



   view my Linkedin profile



 https://en.everybodywiki.com/Mich_Talebzadeh



*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.




On Thu, 24 Mar 2022 at 19:38, Sean Owen  wrote:

> Hm, then what are you looking for besides all the tests in Spark?
>
> On Thu, Mar 24, 2022, 2:34 PM Mich Talebzadeh 
> wrote:
>
>> Thanks
>>
>> I know what unit testing is. The question was not about unit testing. it
>> was specific to regression testing
>> 
>>  artifacts .
>>
>>
>> cheers,
>>
>>
>> Mich
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Thu, 24 Mar 2022 at 19:02, Bjørn Jørgensen 
>> wrote:
>>
>>> Yes, Spark uses unit tests.
>>>
>>> https://app.codecov.io/gh/apache/spark
>>>
>>> https://en.wikipedia.org/wiki/Unit_testing
>>>
>>>
>>>
>>> man. 21. mar. 2022 kl. 15:46 skrev Mich Talebzadeh <
>>> mich.talebza...@gmail.com>:
>>>
 Hi,

 As a matter of interest do Spark releases deploy a specific regression
 testing tool?

 Thanks



view my Linkedin profile
 


  https://en.everybodywiki.com/Mich_Talebzadeh



 *Disclaimer:* Use it at your own risk. Any and all responsibility for
 any loss, damage or destruction of data or any other property which may
 arise from relying on this email's technical content is explicitly
 disclaimed. The author will in no case be liable for any monetary damages
 arising from such loss, damage or destruction.



>>>
>>>
>>> --
>>> Bjørn Jørgensen
>>> Vestre Aspehaug 4, 6010 Ålesund
>>> Norge
>>>
>>> +47 480 94 297
>>>
>>

Re: Tools for regression testing

[Sean Owen]

Hm, then what are you looking for besides all the tests in Spark?

On Thu, Mar 24, 2022, 2:34 PM Mich Talebzadeh 
wrote:

> Thanks
>
> I know what unit testing is. The question was not about unit testing. it
> was specific to regression testing
> 
>  artifacts .
>
>
> cheers,
>
>
> Mich
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
> On Thu, 24 Mar 2022 at 19:02, Bjørn Jørgensen 
> wrote:
>
>> Yes, Spark uses unit tests.
>>
>> https://app.codecov.io/gh/apache/spark
>>
>> https://en.wikipedia.org/wiki/Unit_testing
>>
>>
>>
>> man. 21. mar. 2022 kl. 15:46 skrev Mich Talebzadeh <
>> mich.talebza...@gmail.com>:
>>
>>> Hi,
>>>
>>> As a matter of interest do Spark releases deploy a specific regression
>>> testing tool?
>>>
>>> Thanks
>>>
>>>
>>>
>>>view my Linkedin profile
>>> 
>>>
>>>
>>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>>
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>>> any loss, damage or destruction of data or any other property which may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for any monetary damages
>>> arising from such loss, damage or destruction.
>>>
>>>
>>>
>>
>>
>> --
>> Bjørn Jørgensen
>> Vestre Aspehaug 4, 6010 Ålesund
>> Norge
>>
>> +47 480 94 297
>>
>

Re: Tools for regression testing

[Mich Talebzadeh]

Thanks

I know what unit testing is. The question was not about unit testing. it
was specific to regression testing

 artifacts .


cheers,


Mich


   view my Linkedin profile



 https://en.everybodywiki.com/Mich_Talebzadeh



*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.




On Thu, 24 Mar 2022 at 19:02, Bjørn Jørgensen 
wrote:

> Yes, Spark uses unit tests.
>
> https://app.codecov.io/gh/apache/spark
>
> https://en.wikipedia.org/wiki/Unit_testing
>
>
>
> man. 21. mar. 2022 kl. 15:46 skrev Mich Talebzadeh <
> mich.talebza...@gmail.com>:
>
>> Hi,
>>
>> As a matter of interest do Spark releases deploy a specific regression
>> testing tool?
>>
>> Thanks
>>
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>
>
> --
> Bjørn Jørgensen
> Vestre Aspehaug 4, 6010 Ålesund
> Norge
>
> +47 480 94 297
>

Re: Tools for regression testing

[Bjørn Jørgensen]

Yes, Spark uses unit tests.

https://app.codecov.io/gh/apache/spark

https://en.wikipedia.org/wiki/Unit_testing



man. 21. mar. 2022 kl. 15:46 skrev Mich Talebzadeh <
mich.talebza...@gmail.com>:

> Hi,
>
> As a matter of interest do Spark releases deploy a specific regression
> testing tool?
>
> Thanks
>
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>


-- 
Bjørn Jørgensen
Vestre Aspehaug 4, 6010 Ålesund
Norge

+47 480 94 297

Tools for regression testing

[Mich Talebzadeh]

Hi,

As a matter of interest do Spark releases deploy a specific regression
testing tool?

Thanks



   view my Linkedin profile



 https://en.everybodywiki.com/Mich_Talebzadeh



*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.