Hortonworks Spark Certification Query
Hi all, Is there anyone who wrote the HDPCD examination as in the below link? http://hortonworks.com/training/certification/exam-objectives/#hdpcdspark I'm going to sit for this with a very little time to prepare, can I please be helped with the questions to expect and their probable solutions? This is my first certification examination in life. So, a kind help shall be highly acknowledged. Thanks, Aakash.
RE: HDPCD SPARK Certification Queries
Replication join = broadcast join. Look for that term on google. Many examples. Semi join can be done on dataframes/dataset by passing “semi join” as the third parameter on the join/joinWith function. Not sure about the other two. Sent from my Windows 10 phone From: Aakash Basu<mailto:aakash.spark@gmail.com> Sent: Thursday, November 17, 2016 3:41 PM To: user@spark.apache.org<mailto:user@spark.apache.org> Subject: HDPCD SPARK Certification Queries Hi all, I want to know more about this examination - http://hortonworks.com/training/certification/exam-objectives/#hdpcdspark If anyone's there who appeared for the examination, can you kindly help? 1) What are the kind of questions that come, 2) Samples, 3) All the other details. Thanks, Aakash.
HDPCD SPARK Certification Queries
Hi all, I want to know more about this examination - http://hortonworks.com/training/certification/exam-objectives/#hdpcdspark If anyone's there who appeared for the examination, can you kindly help? 1) What are the kind of questions that come, 2) Samples, 3) All the other details. Thanks, Aakash.
Re: Spark Certification
Thanks. Do we have any forum or study group for certification aspirants? I would like to join. On 15 Feb 2016 05:53, "Olivier Girardot" <o.girar...@lateral-thoughts.com> wrote: > It does not contain (as of yet) anything > 1.3 (for example in depth > knowledge of the Dataframe API) > but you need to know about all the modules (Core, Streaming, SQL, MLLib, > GraphX) > > Regards, > > Olivier. > > 2016-02-11 19:31 GMT+01:00 Prem Sure <premsure...@gmail.com>: > >> I did recently. it includes MLib & Graphx too and I felt like exam >> content covered all topics till 1.3 and not the > 1.3 versions of spark. >> >> >> On Thu, Feb 11, 2016 at 9:39 AM, Janardhan Karri <jkarri@gmail.com> >> wrote: >> >>> I am planning to do that with databricks >>> http://go.databricks.com/spark-certified-developer >>> >>> Regards, >>> Janardhan >>> >>> On Thu, Feb 11, 2016 at 2:00 PM, Timothy Spann <tim.sp...@airisdata.com> >>> wrote: >>> >>>> I was wondering that as well. >>>> >>>> Also is it fully updated for 1.6? >>>> >>>> Tim >>>> http://airisdata.com/ >>>> http://sparkdeveloper.com/ >>>> >>>> >>>> From: naga sharathrayapati <sharathrayap...@gmail.com> >>>> Date: Wednesday, February 10, 2016 at 11:36 PM >>>> To: "user@spark.apache.org" <user@spark.apache.org> >>>> Subject: Spark Certification >>>> >>>> Hello All, >>>> >>>> I am planning on taking Spark Certification and I was wondering If one >>>> has to be well equipped with MLib & GraphX as well or not ? >>>> >>>> Please advise >>>> >>>> Thanks >>>> >>> >>> >> > > > -- > *Olivier Girardot* | Associé > o.girar...@lateral-thoughts.com > +33 6 24 09 17 94 >
Re: Spark Certification
It does not contain (as of yet) anything > 1.3 (for example in depth knowledge of the Dataframe API) but you need to know about all the modules (Core, Streaming, SQL, MLLib, GraphX) Regards, Olivier. 2016-02-11 19:31 GMT+01:00 Prem Sure <premsure...@gmail.com>: > I did recently. it includes MLib & Graphx too and I felt like exam content > covered all topics till 1.3 and not the > 1.3 versions of spark. > > > On Thu, Feb 11, 2016 at 9:39 AM, Janardhan Karri <jkarri@gmail.com> > wrote: > >> I am planning to do that with databricks >> http://go.databricks.com/spark-certified-developer >> >> Regards, >> Janardhan >> >> On Thu, Feb 11, 2016 at 2:00 PM, Timothy Spann <tim.sp...@airisdata.com> >> wrote: >> >>> I was wondering that as well. >>> >>> Also is it fully updated for 1.6? >>> >>> Tim >>> http://airisdata.com/ >>> http://sparkdeveloper.com/ >>> >>> >>> From: naga sharathrayapati <sharathrayap...@gmail.com> >>> Date: Wednesday, February 10, 2016 at 11:36 PM >>> To: "user@spark.apache.org" <user@spark.apache.org> >>> Subject: Spark Certification >>> >>> Hello All, >>> >>> I am planning on taking Spark Certification and I was wondering If one >>> has to be well equipped with MLib & GraphX as well or not ? >>> >>> Please advise >>> >>> Thanks >>> >> >> > -- *Olivier Girardot* | Associé o.girar...@lateral-thoughts.com +33 6 24 09 17 94
Re: Spark Certification
I was wondering that as well. Also is it fully updated for 1.6? Tim http://airisdata.com/ http://sparkdeveloper.com/ From: naga sharathrayapati <sharathrayap...@gmail.com<mailto:sharathrayap...@gmail.com>> Date: Wednesday, February 10, 2016 at 11:36 PM To: "user@spark.apache.org<mailto:user@spark.apache.org>" <user@spark.apache.org<mailto:user@spark.apache.org>> Subject: Spark Certification Hello All, I am planning on taking Spark Certification and I was wondering If one has to be well equipped with MLib & GraphX as well or not ? Please advise Thanks
Re: Spark Certification
I did recently. it includes MLib & Graphx too and I felt like exam content covered all topics till 1.3 and not the > 1.3 versions of spark. On Thu, Feb 11, 2016 at 9:39 AM, Janardhan Karri <jkarri@gmail.com> wrote: > I am planning to do that with databricks > http://go.databricks.com/spark-certified-developer > > Regards, > Janardhan > > On Thu, Feb 11, 2016 at 2:00 PM, Timothy Spann <tim.sp...@airisdata.com> > wrote: > >> I was wondering that as well. >> >> Also is it fully updated for 1.6? >> >> Tim >> http://airisdata.com/ >> http://sparkdeveloper.com/ >> >> >> From: naga sharathrayapati <sharathrayap...@gmail.com> >> Date: Wednesday, February 10, 2016 at 11:36 PM >> To: "user@spark.apache.org" <user@spark.apache.org> >> Subject: Spark Certification >> >> Hello All, >> >> I am planning on taking Spark Certification and I was wondering If one >> has to be well equipped with MLib & GraphX as well or not ? >> >> Please advise >> >> Thanks >> > >
Spark Certification
Hello All, I am planning on taking Spark Certification and I was wondering If one has to be well equipped with MLib & GraphX as well or not ? Please advise Thanks
Apache spark certification pass percentage ?
Hi All, Does anyone know pass percentage for Apache spark certification exam ? Thanks Sri -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Apache-spark-certification-pass-percentage-tp25761.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: Apache spark certification pass percentage ?
Hi Sri, That would depend on the organization from where you are applying the certification. This place would be more helpful where you can ask about questions and information about using spark and/or contributing to spark. Goodluck - Thanks, via mobile, excuse brevity. On Dec 22, 2015 3:56 PM, "kali.tumm...@gmail.com" <kali.tumm...@gmail.com> wrote: > Hi All, > > Does anyone know pass percentage for Apache spark certification exam ? > > Thanks > Sri > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Apache-spark-certification-pass-percentage-tp25761.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
Re: JAVA for SPARK certification
Note that O'Reilly Media has test prep materials in development. The exam does include questions in Scala, Python, Java, and SQL -- and frankly a number of the questions are about comparing or identifying equivalent Spark techniques between two of those different languages. The questions do not go into much detail for any of the languages Scala, Python, Java -- emphasis is on using Spark, not language nuances. Also, there is no coding required: the questions typically to have several code blocks and you select among them to identify the best answer. Overall the exam is targeted at an intermediate Spark user, with background as an application developer in either Python, Scala, or Java, and some familiarity with Big Data and distributed systems. Those were the requirements. Five different practice areas assess the following: 1. Understanding breadth of Spark API usage across Scala, Java, Python 2. Applying best practices to avoid runtime issues and performance bottlenecks 3. Distinguishing Spark features and practices from MapReduce usage 4. Integrating SQL, Streaming, ML, Graph atop the Spark unified engine 5. Solving typical use cases with Spark in Scala, Java, Python Understanding how Spark operates in a production environment is a major emphasis of the exam. Understanding about typical kinds of serialization exceptions is also important. If you look through earlier talks about Spark best practices from Matei Zaharia, Patrick Wendell, Reynold Xin, et al., those are great for prep. BTW, the Kryterion platform allows a person taking the test to mark questions for revisiting later. So if a problem seems difficult or non-intuitive, just mark it and move on the to the next one. Then come back to the marked ones later. Some questions are easier, some are harder, but the order is always randomized. There's a 90 minute limit; however, most people who pass finish within 60 minutes. So if you use mark for later review you'll likely have time at the end to revisit the harder questions. On Tue, May 5, 2015 at 7:05 AM, Gourav Sengupta gourav.sengu...@gmail.com wrote: Hi, I think all the required materials for reference are mentioned here: http://www.oreilly.com/data/sparkcert.html?cmp=ex-strata-na-lp-na_apache_spark_certification My question was regarding the proficiency level required for Java. There are detailed examples and code mentioned for JAVA, Python and Scala in most of the SCALA tutorials mentioned in the above link for reference. Regards, Gourav On Tue, May 5, 2015 at 3:03 PM, ayan guha guha.a...@gmail.com wrote: Very interested @Kartik/Zoltan. Please let me know how to connect on LI On Tue, May 5, 2015 at 11:47 PM, Zoltán Zvara zoltan.zv...@gmail.com wrote: I might join in to this conversation with an ask. Would someone point me to a decent exercise that would approximate the level of this exam (from above)? Thanks! On Tue, May 5, 2015 at 3:37 PM Kartik Mehta kartik.meht...@gmail.com wrote: Production - not whole lot of companies have implemented Spark in production and so though it is good to have, not must. If you are on LinkedIn, a group of folks including myself are preparing for Spark certification, learning in group makes learning easy and fun. Kartik On May 5, 2015 7:31 AM, ayan guha guha.a...@gmail.com wrote: And how important is to have production environment? On 5 May 2015 20:51, Stephen Boesch java...@gmail.com wrote: There are questions in all three languages. 2015-05-05 3:49 GMT-07:00 Kartik Mehta kartik.meht...@gmail.com: I too have similar question. My understanding is since Spark written in scala, having done in Scala will be ok for certification. If someone who has done certification can confirm. Thanks, Kartik On May 5, 2015 5:57 AM, Gourav Sengupta gourav.sengu...@gmail.com wrote: Hi, how important is JAVA for Spark certification? Will learning only Python and Scala not work? Regards, Gourav -- Best Regards, Ayan Guha
Re: JAVA for SPARK certification
Awesome!! Thank you Mr. Nathan, Great to have a guide like you and helping us all, Regards, Kartik On May 11, 2015 5:07 PM, Paco Nathan cet...@gmail.com wrote: Note that O'Reilly Media has test prep materials in development. The exam does include questions in Scala, Python, Java, and SQL -- and frankly a number of the questions are about comparing or identifying equivalent Spark techniques between two of those different languages. The questions do not go into much detail for any of the languages Scala, Python, Java -- emphasis is on using Spark, not language nuances. Also, there is no coding required: the questions typically to have several code blocks and you select among them to identify the best answer. Overall the exam is targeted at an intermediate Spark user, with background as an application developer in either Python, Scala, or Java, and some familiarity with Big Data and distributed systems. Those were the requirements. Five different practice areas assess the following: 1. Understanding breadth of Spark API usage across Scala, Java, Python 2. Applying best practices to avoid runtime issues and performance bottlenecks 3. Distinguishing Spark features and practices from MapReduce usage 4. Integrating SQL, Streaming, ML, Graph atop the Spark unified engine 5. Solving typical use cases with Spark in Scala, Java, Python Understanding how Spark operates in a production environment is a major emphasis of the exam. Understanding about typical kinds of serialization exceptions is also important. If you look through earlier talks about Spark best practices from Matei Zaharia, Patrick Wendell, Reynold Xin, et al., those are great for prep. BTW, the Kryterion platform allows a person taking the test to mark questions for revisiting later. So if a problem seems difficult or non-intuitive, just mark it and move on the to the next one. Then come back to the marked ones later. Some questions are easier, some are harder, but the order is always randomized. There's a 90 minute limit; however, most people who pass finish within 60 minutes. So if you use mark for later review you'll likely have time at the end to revisit the harder questions. On Tue, May 5, 2015 at 7:05 AM, Gourav Sengupta gourav.sengu...@gmail.com wrote: Hi, I think all the required materials for reference are mentioned here: http://www.oreilly.com/data/sparkcert.html?cmp=ex-strata-na-lp-na_apache_spark_certification My question was regarding the proficiency level required for Java. There are detailed examples and code mentioned for JAVA, Python and Scala in most of the SCALA tutorials mentioned in the above link for reference. Regards, Gourav On Tue, May 5, 2015 at 3:03 PM, ayan guha guha.a...@gmail.com wrote: Very interested @Kartik/Zoltan. Please let me know how to connect on LI On Tue, May 5, 2015 at 11:47 PM, Zoltán Zvara zoltan.zv...@gmail.com wrote: I might join in to this conversation with an ask. Would someone point me to a decent exercise that would approximate the level of this exam (from above)? Thanks! On Tue, May 5, 2015 at 3:37 PM Kartik Mehta kartik.meht...@gmail.com wrote: Production - not whole lot of companies have implemented Spark in production and so though it is good to have, not must. If you are on LinkedIn, a group of folks including myself are preparing for Spark certification, learning in group makes learning easy and fun. Kartik On May 5, 2015 7:31 AM, ayan guha guha.a...@gmail.com wrote: And how important is to have production environment? On 5 May 2015 20:51, Stephen Boesch java...@gmail.com wrote: There are questions in all three languages. 2015-05-05 3:49 GMT-07:00 Kartik Mehta kartik.meht...@gmail.com: I too have similar question. My understanding is since Spark written in scala, having done in Scala will be ok for certification. If someone who has done certification can confirm. Thanks, Kartik On May 5, 2015 5:57 AM, Gourav Sengupta gourav.sengu...@gmail.com wrote: Hi, how important is JAVA for Spark certification? Will learning only Python and Scala not work? Regards, Gourav -- Best Regards, Ayan Guha
Re: JAVA for SPARK certification
And how important is to have production environment? On 5 May 2015 20:51, Stephen Boesch java...@gmail.com wrote: There are questions in all three languages. 2015-05-05 3:49 GMT-07:00 Kartik Mehta kartik.meht...@gmail.com: I too have similar question. My understanding is since Spark written in scala, having done in Scala will be ok for certification. If someone who has done certification can confirm. Thanks, Kartik On May 5, 2015 5:57 AM, Gourav Sengupta gourav.sengu...@gmail.com wrote: Hi, how important is JAVA for Spark certification? Will learning only Python and Scala not work? Regards, Gourav
Re: JAVA for SPARK certification
Production - not whole lot of companies have implemented Spark in production and so though it is good to have, not must. If you are on LinkedIn, a group of folks including myself are preparing for Spark certification, learning in group makes learning easy and fun. Kartik On May 5, 2015 7:31 AM, ayan guha guha.a...@gmail.com wrote: And how important is to have production environment? On 5 May 2015 20:51, Stephen Boesch java...@gmail.com wrote: There are questions in all three languages. 2015-05-05 3:49 GMT-07:00 Kartik Mehta kartik.meht...@gmail.com: I too have similar question. My understanding is since Spark written in scala, having done in Scala will be ok for certification. If someone who has done certification can confirm. Thanks, Kartik On May 5, 2015 5:57 AM, Gourav Sengupta gourav.sengu...@gmail.com wrote: Hi, how important is JAVA for Spark certification? Will learning only Python and Scala not work? Regards, Gourav
Re: JAVA for SPARK certification
I might join in to this conversation with an ask. Would someone point me to a decent exercise that would approximate the level of this exam (from above)? Thanks! On Tue, May 5, 2015 at 3:37 PM Kartik Mehta kartik.meht...@gmail.com wrote: Production - not whole lot of companies have implemented Spark in production and so though it is good to have, not must. If you are on LinkedIn, a group of folks including myself are preparing for Spark certification, learning in group makes learning easy and fun. Kartik On May 5, 2015 7:31 AM, ayan guha guha.a...@gmail.com wrote: And how important is to have production environment? On 5 May 2015 20:51, Stephen Boesch java...@gmail.com wrote: There are questions in all three languages. 2015-05-05 3:49 GMT-07:00 Kartik Mehta kartik.meht...@gmail.com: I too have similar question. My understanding is since Spark written in scala, having done in Scala will be ok for certification. If someone who has done certification can confirm. Thanks, Kartik On May 5, 2015 5:57 AM, Gourav Sengupta gourav.sengu...@gmail.com wrote: Hi, how important is JAVA for Spark certification? Will learning only Python and Scala not work? Regards, Gourav
Re: JAVA for SPARK certification
Very interested @Kartik/Zoltan. Please let me know how to connect on LI On Tue, May 5, 2015 at 11:47 PM, Zoltán Zvara zoltan.zv...@gmail.com wrote: I might join in to this conversation with an ask. Would someone point me to a decent exercise that would approximate the level of this exam (from above)? Thanks! On Tue, May 5, 2015 at 3:37 PM Kartik Mehta kartik.meht...@gmail.com wrote: Production - not whole lot of companies have implemented Spark in production and so though it is good to have, not must. If you are on LinkedIn, a group of folks including myself are preparing for Spark certification, learning in group makes learning easy and fun. Kartik On May 5, 2015 7:31 AM, ayan guha guha.a...@gmail.com wrote: And how important is to have production environment? On 5 May 2015 20:51, Stephen Boesch java...@gmail.com wrote: There are questions in all three languages. 2015-05-05 3:49 GMT-07:00 Kartik Mehta kartik.meht...@gmail.com: I too have similar question. My understanding is since Spark written in scala, having done in Scala will be ok for certification. If someone who has done certification can confirm. Thanks, Kartik On May 5, 2015 5:57 AM, Gourav Sengupta gourav.sengu...@gmail.com wrote: Hi, how important is JAVA for Spark certification? Will learning only Python and Scala not work? Regards, Gourav -- Best Regards, Ayan Guha
Re: JAVA for SPARK certification
Hi, I think all the required materials for reference are mentioned here: http://www.oreilly.com/data/sparkcert.html?cmp=ex-strata-na-lp-na_apache_spark_certification My question was regarding the proficiency level required for Java. There are detailed examples and code mentioned for JAVA, Python and Scala in most of the SCALA tutorials mentioned in the above link for reference. Regards, Gourav On Tue, May 5, 2015 at 3:03 PM, ayan guha guha.a...@gmail.com wrote: Very interested @Kartik/Zoltan. Please let me know how to connect on LI On Tue, May 5, 2015 at 11:47 PM, Zoltán Zvara zoltan.zv...@gmail.com wrote: I might join in to this conversation with an ask. Would someone point me to a decent exercise that would approximate the level of this exam (from above)? Thanks! On Tue, May 5, 2015 at 3:37 PM Kartik Mehta kartik.meht...@gmail.com wrote: Production - not whole lot of companies have implemented Spark in production and so though it is good to have, not must. If you are on LinkedIn, a group of folks including myself are preparing for Spark certification, learning in group makes learning easy and fun. Kartik On May 5, 2015 7:31 AM, ayan guha guha.a...@gmail.com wrote: And how important is to have production environment? On 5 May 2015 20:51, Stephen Boesch java...@gmail.com wrote: There are questions in all three languages. 2015-05-05 3:49 GMT-07:00 Kartik Mehta kartik.meht...@gmail.com: I too have similar question. My understanding is since Spark written in scala, having done in Scala will be ok for certification. If someone who has done certification can confirm. Thanks, Kartik On May 5, 2015 5:57 AM, Gourav Sengupta gourav.sengu...@gmail.com wrote: Hi, how important is JAVA for Spark certification? Will learning only Python and Scala not work? Regards, Gourav -- Best Regards, Ayan Guha
JAVA for SPARK certification
Hi, how important is JAVA for Spark certification? Will learning only Python and Scala not work? Regards, Gourav
Re: JAVA for SPARK certification
I too have similar question. My understanding is since Spark written in scala, having done in Scala will be ok for certification. If someone who has done certification can confirm. Thanks, Kartik On May 5, 2015 5:57 AM, Gourav Sengupta gourav.sengu...@gmail.com wrote: Hi, how important is JAVA for Spark certification? Will learning only Python and Scala not work? Regards, Gourav
Re: JAVA for SPARK certification
There are questions in all three languages. 2015-05-05 3:49 GMT-07:00 Kartik Mehta kartik.meht...@gmail.com: I too have similar question. My understanding is since Spark written in scala, having done in Scala will be ok for certification. If someone who has done certification can confirm. Thanks, Kartik On May 5, 2015 5:57 AM, Gourav Sengupta gourav.sengu...@gmail.com wrote: Hi, how important is JAVA for Spark certification? Will learning only Python and Scala not work? Regards, Gourav
