Should we expect the output of [ChatGPT] to be stable or deterministic given the same prompt?
- Does [ChatGPT] "converge" on the same solutions, given the same inputs? Where is there additional entropy in the algorithm or implementation? - random seed(s) - Hash randomization - distributed system failure - "Which data series predict recession, and with what confidence?" - Known good: Bond Yield-Curve Inversion - "Which economic interventions are appropriate for the current conditions?" #EvidenceBasedPolicy On Wed, Jan 4, 2023, 4:34 PM Wes Turner <wes.tur...@gmail.com> wrote: > What are the expected limitations of [ChatGPT]? > > What is "Prompt Engineering"? > [Prompt engineering - Wikipedia]( > https://en.wikipedia.org/wiki/Prompt_engineering ) > > What lessons about technology reliance could you teach, in regards to > Clippy? > > - "What is ChatGPT? Wrong answers only" > - Human_n: EDGES WITH REASONING > > - "Tell me IDK ("I don't know") when you don't know" > > - "How certain are you that that is the correct answer?" > > - "Are static analysis code metrics sufficient for Safety Critical code?" > > - "Whose code is this based on?" > > - "Where and when did you learn this?" > > - "Why would a US President abstain from using ChatGPT or similar to fill > speeches 'just like what I said before'?" > > #Burgundy > > GPT or similar trained on only Formally-Verified code with associated tests > and/or e.g. Lean Mathlib, or e.g. the Principia in SymPy & Cirq; that > could probably eliminate my job, but maybe still not teaching > > On Wed, Jan 4, 2023, 6:28 AM Christian Mascher <christian.masc...@gmx.de> > wrote: > >> Hi, >> >> a student of mine was aware of this chatbot and asked it about a >> class-assignment of his own accord. We program in Java with some extra >> homemade library class used by some schools in our region. >> >> The bot came up with a "solution" which was flawed in several respects: >> 1. It used some other (unimported) classes - solution doesn't work and >> doesn't fit the assignment. >> 2. It put all the code into the constructor, a typical (design and >> style) error for students beginning with Java. >> >> When confronted with the problem number one above, it acknowledged the >> fault and produced a different unrelated solution. >> >> Sooo.... >> >> I was impressed how well the chatbot simulated a typical clueless human >> who even thinks he is smart, while his code is basically bullshit. >> (Probably a result of googling forums, where other learners posted their >> solutions to assignments with the given school library classes.) The bot >> clearly passed the Turing test ;-) >> >> But... >> >> I don't think the interaction was helpful for somebody who is learning >> to program. It is probably less helpful than conversing with other also >> not very knowledgeable students as they are at least reasoning humans. >> >> Talking to the bot might be fun to do in the last lesson before >> christmas or so. Entertaining until you realise the software is >> "simulating" intelligent conversation - not really talking with insight. >> And that could turn out to be a waste of time. >> >> Happy new year >> >> Christian >> >> Am 03.01.2023 um 04:06 schrieb Jurgis Pralgauskis: >> > Hi, happy NY! >> > >> > ChatGPT can create, fix and explain code >> > https://openai.com/blog/chatgpt/#samples >> > <https://openai.com/blog/chatgpt/#samples> >> > >> > Anyone tried to incorporate it into teaching process? >> > Or have ideas/doubts how it ciuld help? >> > >> > _______________________________________________ >> > Edu-sig mailing list -- edu-sig@python.org >> > To unsubscribe send an email to edu-sig-le...@python.org >> > https://mail.python.org/mailman3/lists/edu-sig.python.org/ >> > Member address: christian.masc...@gmx.de >> _______________________________________________ >> Edu-sig mailing list -- edu-sig@python.org >> To unsubscribe send an email to edu-sig-le...@python.org >> https://mail.python.org/mailman3/lists/edu-sig.python.org/ >> Member address: wes.tur...@gmail.com >> >
_______________________________________________ Edu-sig mailing list -- edu-sig@python.org To unsubscribe send an email to edu-sig-le...@python.org https://mail.python.org/mailman3/lists/edu-sig.python.org/ Member address: arch...@mail-archive.com
