Hi Mich, I have been using ChatGPT free version, Bing AI, Google Bard and other AI chatbots.
My use cases so far include writing, debugging code, generating documentation and explanation on Spark key terminologies for beginners to quickly pick up new concepts, summarizing pros and cons or uses cases of different tools available in data engineering for my decision making (as we know, modern tech stack have too many tools available), rephrasing difficult data concepts into something a 7 years old could understand, generating pictures for illustrations ... With all those use cases mentioned, I feel free version ChatGPT, Bing AI and Google Bard do quite well already. I usually can find a satisfying answer from one of these three with one attempt. A better prompt engineering would help you get the better answer, too. So my take is no need to pay for premium version of ChatGPT unless you feel all these free tools can't serve your needs. I started using all these three almost since the first week of the beta test by signing up for the wait-list. My personal preference is Bing AI first for all generic questions and personal fun stuff. Google Bard second if I would like to send the answer as email or Google doc with the built-in export integration and ChatGPT last if both Bing and Bard failed me, which happened to me once or twice only even though I used all these three daily. Hope it helps! We can always chat more about it in the slack community if you are interested. Thank you a lot for your continuous help in this Spark community! I'd be glad if my reply is useful to you 😁 Thank You & Best Regards Winston Lai ________________________________ From: Mich Talebzadeh <mich.talebza...@gmail.com> Sent: Thursday, June 1, 2023 4:51:43 AM To: user @spark <user@spark.apache.org> Subject: ChatGPT and prediction of Spark future I have started looking into ChatGPT as a consumer. The one I have tried is the free not plus version. I asked a question entitled "what is the future for spark" and asked for a concise response This was the answer "Spark has a promising future due to its capabilities in data processing, scalability, performance, and integration with other technologies. It is well-suited for big data analytics and machine learning tasks. With a strong community and extensive ecosystem, Spark is positioned to continue evolving and meeting the growing demands of data-driven applications." I have a naive question from those that know far more than me about AI (which ChatGPT I believe to be based on). How reliable the responses are (subject to interpretation) and is it worthwhile paying $20 subscription for the plus version? With regard to the response on Spark's future, I too agree that Spark will be used for years to come, especially in empowering Data Fabric and Cloud Data Fusion. Thanks, Mich Talebzadeh, Lead Solutions Architect/Engineering Lead Palantir Technologies Limited London United Kingdom [https://ci3.googleusercontent.com/mail-sig/AIorK4zholKucR2Q9yMrKbHNn-o1TuS4mYXyi2KO6Xmx6ikHPySa9MLaLZ8t2hrA6AUcxSxDgHIwmKE] view my Linkedin profile<https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> https://en.everybodywiki.com/Mich_Talebzadeh Disclaimer: Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction.
