Re: Measuring the execution time of Hive queries through Ambari

2020-06-30 Thread Mich Talebzadeh 
Many thanks to all. We will consider these options one by one.

Regards,
.




LinkedIn * 
https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*





*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.




On Tue, 30 Jun 2020 at 16:35, Julien Tane  wrote:

> Hi Mich,
>
> Again Ambari is only a cluster management framework. Not a complete GUI.
> It can have plugins like things like views.
>
>
> On Ambari you can have different Stacks. which correspond to the available
> services for a given services, and which you can install, start and stop.
>
>
> First of all, which stack is installed (see Manage Ambari > Versions  has
> a list of stacks.
>
> on HDP 3.1 Tez is there Tez.ui is available in the code but the Tez-UI
> (ambari View) is not supported anymore by ambari.
>
>
> What we did is that we installed a tomcat. and in this tomcat we deployed
> the tez-ui war. We then set the right values for the yarn configuration...
>
> And it worked
>
>
> Under Manage Ambari >Views, you will find the Views which are installed.
> for instance we have:
>
>
>
>
>
> Julien Tane
> Big Data Engineer
>
> [image: Tel.] +49 721 98993-393
> [image: Fax] +49 721 98993-66
> [image: E-Mail] j...@solute.de
>
> solute GmbH
> Zeppelinstraße 15
> 76185 Karlsruhe
> Germany
>
>
> [image: Logo Solute]
>
> Marken der solute GmbH | brands of solute GmbH
> [image: Marken]
> Geschäftsführer | Managing Director: Dr. Thilo Gans, Bernd Vermaaten
> Webseite | www.solute.de
> Sitz | Registered Office: Karlsruhe
> Registergericht | Register Court: Amtsgericht Mannheim
> Registernummer | Register No.: HRB 110579
> USt-ID | VAT ID: DE234663798
>
> *Informationen zum Datenschutz | Information about privacy policy*
> https://www.solute.de/ger/datenschutz/grundsaetze-der-datenverarbeitung.php
>
>
>
> --
> *Von:* Mich Talebzadeh 
> *Gesendet:* Montag, 22. Juni 2020 14:23:51
> *An:* user
> *Betreff:* Re: Measuring the execution time of Hive queries through Ambari
>
> Hi  Julien.
>
> It is as I see is standard Ambari. Has TEZ UI but when I run the query and
> check TEZ UI it says TEZ view is not deployed!
>
> Thanks
>
>
>
> LinkedIn * 
> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>
>
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
> On Mon, 22 Jun 2020 at 13:10, Julien Tane  wrote:
>
>> Mich,
>>
>>
>> When you say, that you are using ambari to connect to hvie what do you
>> mean by that.
>>
>> Unless you added a view in ambari to perform query (as far as I know, not
>> in the vanilla ambari)
>>
>>
>> One thing you could more or less do is use the tez.ui (assuming you are
>> using tez)
>>
>> but here again this is not in the standard ambari (at least not the newer
>> versions)
>>
>> one other possibility (depending on how you configured yarn) would be to
>> use the yarn ui
>>
>> which should be accessible in the Yarn Tab from your ambari... But here,
>> it kinds of depends
>>
>> on how you configured your system.
>>
>>
>> Kind Regards,
>>
>>
>> J
>>
>>
>>
>>
>>
>> Julien Tane
>> Big Data Engineer
>>
>> [image: Tel.] +49 721 98993-393
>> [image: Fax] +49 721 98993-66
>> [image: E-Mail] j...@solute.de
>>
>> solute GmbH
>> Zeppelinstraße 15
>> 76185 Karlsruhe
>> Germany
>>
>>
>> [image: Logo Solute]
>>
>> Marken der solute GmbH | brands of solute GmbH
>> [image: Marken]
>> Geschäftsführer | Managing Director: Dr. Thilo Gans, Bernd Vermaaten
>> Webseite | www.solute.de
>> Sitz | Registered Office: Karlsruhe
>> Registergericht | Register Court: Amtsgericht Mannheim
>> Registernummer | Register N

Re: Measuring the execution time of Hive queries through Ambari

2020-06-30 Thread Zoltan Haindrich 

Hey Mich!

I don't know which version you use (HDP-3+?) - but you might want to see if "Data 
Analytics Studio" is available for that version; it could give similar insights as 
TezUI had.

cheers,
Zoltan

On 6/22/20 2:23 PM, Mich Talebzadeh wrote:

Hi  Julien.

It is as I see is standard Ambari. Has TEZ UI but when I run the query and 
check TEZ UI it says TEZ view is not deployed!

Thanks



LinkedIn 
/https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw/



*Disclaimer:* Use it at your own risk.Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this 
email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction.




On Mon, 22 Jun 2020 at 13:10, Julien Tane mailto:j...@solute.de>> wrote:

Mich,


When you say, that you are using ambari to connect to hvie what do you mean 
by that.

Unless you added a view in ambari to perform query (as far as I know, not 
in the vanilla ambari)


One thing you could more or less do is use the tez.ui (assuming you are 
using tez)

but here again this is not in the standard ambari (at least not the newer 
versions)

one other possibility (depending on how you configured yarn) would be to 
use the yarn ui

which should be accessible in the Yarn Tab from your ambari... But here, it 
kinds of depends

on how you configured your system.


Kind Regards,


J



Julien Tane
Big Data Engineer
Tel.+49 721 98993-393
Fax +49 721 98993-66
E-Mail  j...@solute.de 

solute GmbH
Zeppelinstraße 15
76185 Karlsruhe
Germany

Logo Solute

Marken der solute GmbH | brands of solute GmbH
Marken

Geschäftsführer | Managing Director: Dr. Thilo Gans, Bernd Vermaaten
Webseite | www.solute.de 
Sitz | Registered Office: Karlsruhe
Registergericht | Register Court: Amtsgericht Mannheim
Registernummer | Register No.: HRB 110579
USt-ID | VAT ID: DE234663798
*Informationen zum Datenschutz | Information about privacy policy*
https://www.solute.de/ger/datenschutz/grundsaetze-der-datenverarbeitung.php



*Von:* Mich Talebzadeh mailto:mich.talebza...@gmail.com>>
*Gesendet:* Montag, 22. Juni 2020 12:57:27
*An:* user
*Betreff:* Measuring the execution time of Hive queries through Ambari
Hi,

Using Ambari to connect to Hive, is there any way of measuring the query 
time?

Please be aware that this is through Ambari not through beeline etc.

The tool we have at the moment is Ambari to Prod.

We do not have any other luxury!

Thanks




LinkedIn 
/https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw/



*Disclaimer:* Use it at your own risk.Any and all responsibility for any 
loss, damage or destruction of data or any other property which may arise from 
relying on this
email's technical content is explicitly disclaimed. The author will in no 
case be liable for any monetary damages arising from such loss, damage or 
destruction.

Re: Measuring the execution time of Hive queries through Ambari

2020-06-22 Thread Mich Talebzadeh 
Hi  Julien.

It is as I see is standard Ambari. Has TEZ UI but when I run the query and
check TEZ UI it says TEZ view is not deployed!

Thanks



LinkedIn * 
https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
*





*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.




On Mon, 22 Jun 2020 at 13:10, Julien Tane  wrote:

> Mich,
>
>
> When you say, that you are using ambari to connect to hvie what do you
> mean by that.
>
> Unless you added a view in ambari to perform query (as far as I know, not
> in the vanilla ambari)
>
>
> One thing you could more or less do is use the tez.ui (assuming you are
> using tez)
>
> but here again this is not in the standard ambari (at least not the newer
> versions)
>
> one other possibility (depending on how you configured yarn) would be to
> use the yarn ui
>
> which should be accessible in the Yarn Tab from your ambari... But here,
> it kinds of depends
>
> on how you configured your system.
>
>
> Kind Regards,
>
>
> J
>
>
>
>
>
> Julien Tane
> Big Data Engineer
>
> [image: Tel.] +49 721 98993-393
> [image: Fax] +49 721 98993-66
> [image: E-Mail] j...@solute.de
>
> solute GmbH
> Zeppelinstraße 15
> 76185 Karlsruhe
> Germany
>
>
> [image: Logo Solute]
>
> Marken der solute GmbH | brands of solute GmbH
> [image: Marken]
> Geschäftsführer | Managing Director: Dr. Thilo Gans, Bernd Vermaaten
> Webseite | www.solute.de
> Sitz | Registered Office: Karlsruhe
> Registergericht | Register Court: Amtsgericht Mannheim
> Registernummer | Register No.: HRB 110579
> USt-ID | VAT ID: DE234663798
>
> *Informationen zum Datenschutz | Information about privacy policy*
> https://www.solute.de/ger/datenschutz/grundsaetze-der-datenverarbeitung.php
>
>
>
> --
> *Von:* Mich Talebzadeh 
> *Gesendet:* Montag, 22. Juni 2020 12:57:27
> *An:* user
> *Betreff:* Measuring the execution time of Hive queries through Ambari
>
> Hi,
>
> Using Ambari to connect to Hive, is there any way of measuring the query
> time?
>
> Please be aware that this is through Ambari not through beeline etc.
>
> The tool we have at the moment is Ambari to Prod.
>
> We do not have any other luxury!
>
> Thanks
>
>
>
>
> LinkedIn * 
> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> *
>
>
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>