[Edu-sig] Re: ChatGPT for py teaching

[Christian Mascher]

Hi,

a student of mine was aware of this chatbot and asked it about a
class-assignment of his own accord. We program in Java with some extra
homemade library class used by some schools in our region.

The bot came up with a "solution" which was flawed in several respects:
1. It used some other (unimported) classes - solution doesn't work and
doesn't fit the assignment.
2. It put all the code into the constructor, a typical (design and
style) error for students beginning with Java.

When confronted with the problem number one above, it acknowledged the
fault and produced a different unrelated solution.

Sooo

I was impressed how well the chatbot simulated a typical clueless human
who even thinks he is smart, while his code is basically bullshit.
(Probably a result of googling forums, where other learners posted their
solutions to assignments with the given school library classes.) The bot
clearly passed the Turing test ;-)

But...

I don't think the interaction was helpful for somebody who is learning
to program. It is probably less helpful than conversing with other also
not very knowledgeable students as they are at least reasoning humans.

Talking to the bot might be fun to do in the last lesson before
christmas or so. Entertaining until you realise the software is
"simulating" intelligent conversation - not really talking with insight.
And that could turn out to be a waste of time.

Happy new year

Christian

Am 03.01.2023 um 04:06 schrieb Jurgis Pralgauskis:

Hi, happy NY!

ChatGPT can create, fix and explain code
https://openai.com/blog/chatgpt/#samples


Anyone tried to incorporate it into teaching process?
Or have ideas/doubts how it ciuld help?

___
Edu-sig mailing list -- edu-sig@python.org
To unsubscribe send an email to edu-sig-le...@python.org
https://mail.python.org/mailman3/lists/edu-sig.python.org/
Member address: christian.masc...@gmx.de

___
Edu-sig mailing list -- edu-sig@python.org
To unsubscribe send an email to edu-sig-le...@python.org
https://mail.python.org/mailman3/lists/edu-sig.python.org/
Member address: arch...@mail-archive.com

[Edu-sig] Re: ChatGPT for py teaching

[Wes Turner]

What are the expected limitations of [ChatGPT]?

What is "Prompt Engineering"?
[Prompt engineering - Wikipedia](
https://en.wikipedia.org/wiki/Prompt_engineering )

What lessons about technology reliance could you teach, in regards to
Clippy?

- "What is ChatGPT? Wrong answers only"
  - Human_n: EDGES WITH REASONING

- "Tell me IDK ("I don't know") when you don't know"

- "How certain are you that that is the correct answer?"

- "Are static analysis code metrics sufficient for Safety Critical code?"

- "Whose code is this based on?"

- "Where and when did you learn this?"

- "Why would a US President abstain from using ChatGPT or similar to fill
speeches 'just like what I said before'?"

#Burgundy

GPT or similar trained on only Formally-Verified code with associated tests
and/or e.g. Lean Mathlib, or e.g. the Principia in SymPy & Cirq; that could
probably eliminate my job, but maybe still not teaching

On Wed, Jan 4, 2023, 6:28 AM Christian Mascher 
wrote:

> Hi,
>
> a student of mine was aware of this chatbot and asked it about a
> class-assignment of his own accord. We program in Java with some extra
> homemade library class used by some schools in our region.
>
> The bot came up with a "solution" which was flawed in several respects:
> 1. It used some other (unimported) classes - solution doesn't work and
> doesn't fit the assignment.
> 2. It put all the code into the constructor, a typical (design and
> style) error for students beginning with Java.
>
> When confronted with the problem number one above, it acknowledged the
> fault and produced a different unrelated solution.
>
> Sooo
>
> I was impressed how well the chatbot simulated a typical clueless human
> who even thinks he is smart, while his code is basically bullshit.
> (Probably a result of googling forums, where other learners posted their
> solutions to assignments with the given school library classes.) The bot
> clearly passed the Turing test ;-)
>
> But...
>
> I don't think the interaction was helpful for somebody who is learning
> to program. It is probably less helpful than conversing with other also
> not very knowledgeable students as they are at least reasoning humans.
>
> Talking to the bot might be fun to do in the last lesson before
> christmas or so. Entertaining until you realise the software is
> "simulating" intelligent conversation - not really talking with insight.
> And that could turn out to be a waste of time.
>
> Happy new year
>
> Christian
>
> Am 03.01.2023 um 04:06 schrieb Jurgis Pralgauskis:
> > Hi, happy NY!
> >
> > ChatGPT can create, fix and explain code
> > https://openai.com/blog/chatgpt/#samples
> > 
> >
> > Anyone tried to incorporate it into teaching process?
> > Or have ideas/doubts how it ciuld help?
> >
> > ___
> > Edu-sig mailing list -- edu-sig@python.org
> > To unsubscribe send an email to edu-sig-le...@python.org
> > https://mail.python.org/mailman3/lists/edu-sig.python.org/
> > Member address: christian.masc...@gmx.de
> ___
> Edu-sig mailing list -- edu-sig@python.org
> To unsubscribe send an email to edu-sig-le...@python.org
> https://mail.python.org/mailman3/lists/edu-sig.python.org/
> Member address: wes.tur...@gmail.com
>
___
Edu-sig mailing list -- edu-sig@python.org
To unsubscribe send an email to edu-sig-le...@python.org
https://mail.python.org/mailman3/lists/edu-sig.python.org/
Member address: arch...@mail-archive.com

[Edu-sig] Re: ChatGPT for py teaching

[Wes Turner]

Should we expect the output of [ChatGPT] to be stable or deterministic
given the same prompt?

- Does [ChatGPT] "converge" on the same solutions, given the same inputs?
Where is there additional entropy in the algorithm or implementation?
  - random seed(s)
  - Hash randomization
  - distributed system failure

- "Which data series predict recession, and with what confidence?"
  - Known good: Bond Yield-Curve Inversion

- "Which economic interventions are appropriate for the current conditions?"

#EvidenceBasedPolicy

On Wed, Jan 4, 2023, 4:34 PM Wes Turner  wrote:

> What are the expected limitations of [ChatGPT]?
>
> What is "Prompt Engineering"?
> [Prompt engineering - Wikipedia](
> https://en.wikipedia.org/wiki/Prompt_engineering )
>
> What lessons about technology reliance could you teach, in regards to
> Clippy?
>
> - "What is ChatGPT? Wrong answers only"
>   - Human_n: EDGES WITH REASONING
>
> - "Tell me IDK ("I don't know") when you don't know"
>
> - "How certain are you that that is the correct answer?"
>
> - "Are static analysis code metrics sufficient for Safety Critical code?"
>
> - "Whose code is this based on?"
>
> - "Where and when did you learn this?"
>
> - "Why would a US President abstain from using ChatGPT or similar to fill
> speeches 'just like what I said before'?"
>
> #Burgundy
>
> GPT or similar trained on only Formally-Verified code with associated tests
> and/or e.g. Lean Mathlib, or e.g. the Principia in SymPy & Cirq; that
> could probably eliminate my job, but maybe still not teaching
>
> On Wed, Jan 4, 2023, 6:28 AM Christian Mascher 
> wrote:
>
>> Hi,
>>
>> a student of mine was aware of this chatbot and asked it about a
>> class-assignment of his own accord. We program in Java with some extra
>> homemade library class used by some schools in our region.
>>
>> The bot came up with a "solution" which was flawed in several respects:
>> 1. It used some other (unimported) classes - solution doesn't work and
>> doesn't fit the assignment.
>> 2. It put all the code into the constructor, a typical (design and
>> style) error for students beginning with Java.
>>
>> When confronted with the problem number one above, it acknowledged the
>> fault and produced a different unrelated solution.
>>
>> Sooo
>>
>> I was impressed how well the chatbot simulated a typical clueless human
>> who even thinks he is smart, while his code is basically bullshit.
>> (Probably a result of googling forums, where other learners posted their
>> solutions to assignments with the given school library classes.) The bot
>> clearly passed the Turing test ;-)
>>
>> But...
>>
>> I don't think the interaction was helpful for somebody who is learning
>> to program. It is probably less helpful than conversing with other also
>> not very knowledgeable students as they are at least reasoning humans.
>>
>> Talking to the bot might be fun to do in the last lesson before
>> christmas or so. Entertaining until you realise the software is
>> "simulating" intelligent conversation - not really talking with insight.
>> And that could turn out to be a waste of time.
>>
>> Happy new year
>>
>> Christian
>>
>> Am 03.01.2023 um 04:06 schrieb Jurgis Pralgauskis:
>> > Hi, happy NY!
>> >
>> > ChatGPT can create, fix and explain code
>> > https://openai.com/blog/chatgpt/#samples
>> > 
>> >
>> > Anyone tried to incorporate it into teaching process?
>> > Or have ideas/doubts how it ciuld help?
>> >
>> > ___
>> > Edu-sig mailing list -- edu-sig@python.org
>> > To unsubscribe send an email to edu-sig-le...@python.org
>> > https://mail.python.org/mailman3/lists/edu-sig.python.org/
>> > Member address: christian.masc...@gmx.de
>> ___
>> Edu-sig mailing list -- edu-sig@python.org
>> To unsubscribe send an email to edu-sig-le...@python.org
>> https://mail.python.org/mailman3/lists/edu-sig.python.org/
>> Member address: wes.tur...@gmail.com
>>
>
___
Edu-sig mailing list -- edu-sig@python.org
To unsubscribe send an email to edu-sig-le...@python.org
https://mail.python.org/mailman3/lists/edu-sig.python.org/
Member address: arch...@mail-archive.com

[Edu-sig] Re: ChatGPT for py teaching

[Wes Turner]

> Explainable AI (XAI), or Interpretable AI, or Explainable Machine
Learning (XML),[1] is artificial intelligence (AI) in which humans can
understand the decisions or predictions made by the AI.[2] It contrasts
with the "black box" concept in machine learning where even its designers
cannot explain why an AI arrived at a specific decision.[3][4] By refining
the mental models of users of AI-powered systems and dismantling their
misconceptions, XAI promises to help users perform more effectively.[5] XAI
may be an implementation of the social right to explanation.[6] XAI is
relevant even if there is no legal right or regulatory requirement. For
example, XAI can improve the user experience of a product or service by
helping end users trust that the AI is making good decisions. This way the
aim of XAI is to explain what has been done, what is done right now, what
will be done next and unveil the information the actions are based on.[7]
These characteristics make it possible (i) to confirm existing knowledge
(ii) to challenge existing knowledge and (iii) to generate new assumptions.
[8]
https://en.wikipedia.org/wiki/Explainable_artificial_intelligence

- How does [ChatGPT] work?

- Can ChatGPT explain the criteria it uses to filter candidate responses
(out of the Powerset of all possible responses)?

- What sorts of rejectable hypotheses and experimental designs is ChatGPT
capable of synthesizing?

...

>From https://en.wikipedia.org/wiki/Prompt_engineering :

> Prompts that include a train of thought in few-shot learning examples
show better indication of reasoning in language models. [7] In zero-shot
learning prepending text to the prompt that encourages a chain of thought
(e.g. "Let's think step by step") may improve the performance of a language
model in multi-step reasoning problems.


From
https://github.com/oblivia-simplex/ghidra_tools/blob/ac1fdf33d313314cde0eef0f1002a66dd95d59b4/g3po/g3po.py#L165-L179
:

``python
def generate_comment(c_code, temperature=0.19, program_info=None,
prompt=None, model=MODEL, max_tokens=MAXTOKENS):
intro = "Below is some C code that Ghidra decompiled from a binary that
I'm trying to reverse engineer."
#program_info = get_program_info()
#if program_info:
# intro = intro.replace("a binary", f'a {program_info["language_id"]}
binary')
if prompt is None:
prompt = """{intro}

```
{c_code}
```

Please provide a detailed explanation of what this code does, in {style},
that might be useful to a reverse engineer. Explain your reasoning as much
as possible. Finally, suggest a suitable name for this function and for
each variable bearing a default name, offer a more informative name, if the
purpose of that variable is unambiguous. {extra}

""".format(intro=intro, c_code=c_code, style=LANGUAGE, extra=EXTRA)
``

ChatGPT can help explain code and codebases, but can it explain each
response?

Similarly, "Is there any way to get the step-by-step solution in SymPy?"
[like e.g.  paid WolframAlpha and PhotoMath do]
https://stackoverflow.com/questions/39359220/is-there-any-way-to-get-the-step-by-step-solution-in-sympy



On Wed, Jan 4, 2023, 5:13 PM Wes Turner  wrote:

> Should we expect the output of [ChatGPT] to be stable or deterministic
> given the same prompt?
>
> - Does [ChatGPT] "converge" on the same solutions, given the same inputs?
> Where is there additional entropy in the algorithm or implementation?
>   - random seed(s)
>   - Hash randomization
>   - distributed system failure
>
> - "Which data series predict recession, and with what confidence?"
>   - Known good: Bond Yield-Curve Inversion
>
> - "Which economic interventions are appropriate for the current
> conditions?"
>
> #EvidenceBasedPolicy
>
> On Wed, Jan 4, 2023, 4:34 PM Wes Turner  wrote:
>
>> What are the expected limitations of [ChatGPT]?
>>
>> What is "Prompt Engineering"?
>> [Prompt engineering - Wikipedia](
>> https://en.wikipedia.org/wiki/Prompt_engineering )
>>
>> What lessons about technology reliance could you teach, in regards to
>> Clippy?
>>
>> - "What is ChatGPT? Wrong answers only"
>>   - Human_n: EDGES WITH REASONING
>>
>> - "Tell me IDK ("I don't know") when you don't know"
>>
>> - "How certain are you that that is the correct answer?"
>>
>> - "Are static analysis code metrics sufficient for Safety Critical code?"
>>
>> - "Whose code is this based on?"
>>
>> - "Where and when did you learn this?"
>>
>> - "Why would a US President abstain from using ChatGPT or similar to fill
>> speeches 'just like what I said before'?"
>>
>> #Burgundy
>>
>> GPT or similar trained on only Formally-Verified code with associated
>> tests
>> and/or e.g. Lean Mathlib, or e.g. the Principia in SymPy & Cirq; that
>> could probably eliminate my job, but maybe still not teaching
>>
>> On Wed, Jan 4, 2023, 6:28 AM Christian Mascher 
>> wrote:
>>
>>> Hi,
>>>
>>> a student of mine was aware of this chatbot and asked it about a
>>> class-assignment of his own accord. We program in Java with some extra
>

[Edu-sig] Re: ChatGPT for py teaching

[Miguela Fernandes]

Hi,

Some students used with HTML/ CSS and they were really happy with answers.
Also with explanation given by the chatgpt.


Miguela Fernandes
Agrupamento de Escolas da Batalha
Portugal

“All things are difficult before they are easy.” Thomas Fuller
I live in http://web20t11.blogspot.com/


On Tue, 3 Jan 2023 at 03:06, Jurgis Pralgauskis <
jurgis.pralgaus...@gmail.com> wrote:

> Hi, happy NY!
>
> ChatGPT can create, fix and explain code
> https://openai.com/blog/chatgpt/#samples
>
> Anyone tried to incorporate it into teaching process?
> Or have ideas/doubts how it ciuld help?
> ___
> Edu-sig mailing list -- edu-sig@python.org
> To unsubscribe send an email to edu-sig-le...@python.org
> https://mail.python.org/mailman3/lists/edu-sig.python.org/
> Member address: migu...@sapo.pt
>
___
Edu-sig mailing list -- edu-sig@python.org
To unsubscribe send an email to edu-sig-le...@python.org
https://mail.python.org/mailman3/lists/edu-sig.python.org/
Member address: arch...@mail-archive.com

[Edu-sig] Re: ChatGPT for py teaching

[Wes Turner]

On Wed, Jan 4, 2023 at 4:34 PM Wes Turner  wrote:

> What are the expected limitations of [ChatGPT]?
>
> What is "Prompt Engineering"?
> [Prompt engineering - Wikipedia](
> https://en.wikipedia.org/wiki/Prompt_engineering )
>
> What lessons about technology reliance could you teach, in regards to
> Clippy?
>
> - "What is ChatGPT? Wrong answers only"
>   - Human_n: EDGES WITH REASONING
>
> - "Tell me IDK ("I don't know") when you don't know"
>

- What are "Truthiness", Confidence Intervals and Error Propagation?
- What is Convergence?
- What does it mean for algorithmic outputs to converge given additional
parametric noise?


>
> - "How certain are you that that is the correct answer?"
>

- How does [ChatGPT] handle known-to-be or presumed-to-be unsolved math and
physics problems?

- "How do we create room-temperature superconductivity?"

- "How will planetary orbital trajectories change in the n-body gravity
problem if another dense probably interstellar mass passes through our
local system?"


>
> - "Are static analysis code metrics sufficient for Safety Critical code?"
>

- Where in the DevOpSec software development lifecycle should human code
review for security best practices and common vulnerabilities and
weaknesses?
  - Is the [ChatGPT] model trained from *only* Formally Verified code with
associated tests?
- Branch and line coverage metrics indicate which tests run which lines
of which functions. Code coverage typically implies dynamic analysis?


>
> - "Whose code is this based on?"
>
> - "Where and when did you learn this?"
>

- Explainability (XAI)
- How can models "Unlearn" or "Learn over" given a sufficient meta-analytic
procedure given the information available at that point in spacetime?



> - "Why would a US President abstain from using ChatGPT or similar to fill
> speeches 'just like what I said before'?"
>
> #Burgundy
>

- How can we use [ChatGPT] and other Prompt Engineering approaches to
perform Evidence-Based Policy with supporting computational analyses
prepared in form for meta-analysis given verification of data quality and
experimental controls?


>
> GPT or similar trained on only Formally-Verified code with associated tests
> and/or e.g. Lean Mathlib, or e.g. the Principia in SymPy & Cirq; that
> could probably eliminate my job, but maybe still not teaching
>

- "Q: ChatGPT etc. trained on mathlib and tests"
  https://github.com/leanprover-community/mathlib/issues/17919

- "Port the QuantumQ game to Cirq (SymPy (Python))?"
  - https://quantumai.google/cirq/start/start
-
https://colab.research.google.com/drive/11WGNX8TKOmjpmvJWO7v19gXKoEwIwxyw?usp=sharing

- "How does [ChatGPT] compare to Critical Thinking, Reasoning, Logic, and
Rationality?
  https://en.wikipedia.org/wiki/Critical_thinking#Logic_and_rationality



> On Wed, Jan 4, 2023, 6:28 AM Christian Mascher 
> wrote:
>
>> Hi,
>>
>> a student of mine was aware of this chatbot and asked it about a
>> class-assignment of his own accord. We program in Java with some extra
>> homemade library class used by some schools in our region.
>>
>> The bot came up with a "solution" which was flawed in several respects:
>> 1. It used some other (unimported) classes - solution doesn't work and
>> doesn't fit the assignment.
>> 2. It put all the code into the constructor, a typical (design and
>> style) error for students beginning with Java.
>>
>> When confronted with the problem number one above, it acknowledged the
>> fault and produced a different unrelated solution.
>>
>> Sooo
>>
>> I was impressed how well the chatbot simulated a typical clueless human
>> who even thinks he is smart, while his code is basically bullshit.
>> (Probably a result of googling forums, where other learners posted their
>> solutions to assignments with the given school library classes.) The bot
>> clearly passed the Turing test ;-)
>>
>> But...
>>
>> I don't think the interaction was helpful for somebody who is learning
>> to program. It is probably less helpful than conversing with other also
>> not very knowledgeable students as they are at least reasoning humans.
>>
>> Talking to the bot might be fun to do in the last lesson before
>> christmas or so. Entertaining until you realise the software is
>> "simulating" intelligent conversation - not really talking with insight.
>> And that could turn out to be a waste of time.
>>
>> Happy new year
>>
>> Christian
>>
>> Am 03.01.2023 um 04:06 schrieb Jurgis Pralgauskis:
>> > Hi, happy NY!
>> >
>> > ChatGPT can create, fix and explain code
>> > https://openai.com/blog/chatgpt/#samples
>> > 
>> >
>> > Anyone tried to incorporate it into teaching process?
>> > Or have ideas/doubts how it ciuld help?
>> >
>> > ___
>> > Edu-sig mailing list -- edu-sig@python.org
>> > To unsubscribe send an email to edu-sig-le...@python.org
>> > https://mail.python.org/mailman3/lists/edu-sig.python.org/
>> > Member address: christian.masc..

[Edu-sig] Re: ChatGPT for py teaching

[Jurgis Pralgauskis]

I suspect some nice things are comming - see examples of "Socratic tutor" :)

https://openai.com/research/gpt-4

2023-01-06, pn 19:03, Wes Turner  rašė:

>
>
> On Wed, Jan 4, 2023 at 4:34 PM Wes Turner  wrote:
>
>> What are the expected limitations of [ChatGPT]?
>>
>> What is "Prompt Engineering"?
>> [Prompt engineering - Wikipedia](
>> https://en.wikipedia.org/wiki/Prompt_engineering )
>>
>> What lessons about technology reliance could you teach, in regards to
>> Clippy?
>>
>> - "What is ChatGPT? Wrong answers only"
>>   - Human_n: EDGES WITH REASONING
>>
>> - "Tell me IDK ("I don't know") when you don't know"
>>
>
> - What are "Truthiness", Confidence Intervals and Error Propagation?
> - What is Convergence?
> - What does it mean for algorithmic outputs to converge given additional
> parametric noise?
>
>
>>
>> - "How certain are you that that is the correct answer?"
>>
>
> - How does [ChatGPT] handle known-to-be or presumed-to-be unsolved math
> and physics problems?
>
> - "How do we create room-temperature superconductivity?"
>
> - "How will planetary orbital trajectories change in the n-body gravity
> problem if another dense probably interstellar mass passes through our
> local system?"
>
>
>>
>> - "Are static analysis code metrics sufficient for Safety Critical code?"
>>
>
> - Where in the DevOpSec software development lifecycle should human code
> review for security best practices and common vulnerabilities and
> weaknesses?
>   - Is the [ChatGPT] model trained from *only* Formally Verified code with
> associated tests?
> - Branch and line coverage metrics indicate which tests run which
> lines of which functions. Code coverage typically implies dynamic analysis?
>
>
>>
>> - "Whose code is this based on?"
>>
>> - "Where and when did you learn this?"
>>
>
> - Explainability (XAI)
> - How can models "Unlearn" or "Learn over" given a sufficient
> meta-analytic procedure given the information available at that point in
> spacetime?
>
>
>
>> - "Why would a US President abstain from using ChatGPT or similar to fill
>> speeches 'just like what I said before'?"
>>
>> #Burgundy
>>
>
> - How can we use [ChatGPT] and other Prompt Engineering approaches to
> perform Evidence-Based Policy with supporting computational analyses
> prepared in form for meta-analysis given verification of data quality and
> experimental controls?
>
>
>>
>> GPT or similar trained on only Formally-Verified code with associated
>> tests
>> and/or e.g. Lean Mathlib, or e.g. the Principia in SymPy & Cirq; that
>> could probably eliminate my job, but maybe still not teaching
>>
>
> - "Q: ChatGPT etc. trained on mathlib and tests"
>   https://github.com/leanprover-community/mathlib/issues/17919
>
> - "Port the QuantumQ game to Cirq (SymPy (Python))?"
>   - https://quantumai.google/cirq/start/start
> -
> https://colab.research.google.com/drive/11WGNX8TKOmjpmvJWO7v19gXKoEwIwxyw?usp=sharing
>
> - "How does [ChatGPT] compare to Critical Thinking, Reasoning, Logic, and
> Rationality?
>   https://en.wikipedia.org/wiki/Critical_thinking#Logic_and_rationality
>
>
>
>> On Wed, Jan 4, 2023, 6:28 AM Christian Mascher 
>> wrote:
>>
>>> Hi,
>>>
>>> a student of mine was aware of this chatbot and asked it about a
>>> class-assignment of his own accord. We program in Java with some extra
>>> homemade library class used by some schools in our region.
>>>
>>> The bot came up with a "solution" which was flawed in several respects:
>>> 1. It used some other (unimported) classes - solution doesn't work and
>>> doesn't fit the assignment.
>>> 2. It put all the code into the constructor, a typical (design and
>>> style) error for students beginning with Java.
>>>
>>> When confronted with the problem number one above, it acknowledged the
>>> fault and produced a different unrelated solution.
>>>
>>> Sooo
>>>
>>> I was impressed how well the chatbot simulated a typical clueless human
>>> who even thinks he is smart, while his code is basically bullshit.
>>> (Probably a result of googling forums, where other learners posted their
>>> solutions to assignments with the given school library classes.) The bot
>>> clearly passed the Turing test ;-)
>>>
>>> But...
>>>
>>> I don't think the interaction was helpful for somebody who is learning
>>> to program. It is probably less helpful than conversing with other also
>>> not very knowledgeable students as they are at least reasoning humans.
>>>
>>> Talking to the bot might be fun to do in the last lesson before
>>> christmas or so. Entertaining until you realise the software is
>>> "simulating" intelligent conversation - not really talking with insight.
>>> And that could turn out to be a waste of time.
>>>
>>> Happy new year
>>>
>>> Christian
>>>
>>> Am 03.01.2023 um 04:06 schrieb Jurgis Pralgauskis:
>>> > Hi, happy NY!
>>> >
>>> > ChatGPT can create, fix and explain code
>>> > https://openai.com/blog/chatgpt/#samples
>>> > 
>>> >
>>> > Anyone tried to incorporate 

[Edu-sig] Re: ChatGPT for py teaching

[Wes Turner]

Khanmigo is a new (2023-03-14) Khan Academy tutoring AI:
https://blog.khanacademy.org/harnessing-ai-so-that-all-students-benefit-a-nonprofit-approach-for-equal-access/
:

"""
Participants in our limited pilot can use Khanmigo to:

- Get help with math
- Write a story together through back-and-forth idea generation (but
Khanmigo won’t write the story for them!)
- Prep for AP exams
- Practice new vocabulary words
- Learn computer programming
Interview a historical figure like Cleopatra or Jane Austen
- Debate a topic like “Should schools ban AI?”

Khanmigo does not, however, give students answers. Nobody learns anything
by being given the answer. Instead, Khanmigo asks questions. Questions are
thought-provoking. Questions are open-ended. And most importantly,
questions lead to learning
"""

What is the Socratic method?
https://en.wikipedia.org/wiki/Socratic_method

Why are LLMs picking random positive integers 42 and 7 most frequently?

On Fri, Mar 24, 2023, 12:20 AM Jurgis Pralgauskis <
jurgis.pralgaus...@gmail.com> wrote:

> I suspect some nice things are comming - see examples of "Socratic tutor"
> :)
>
> https://openai.com/research/gpt-4
>
> 2023-01-06, pn 19:03, Wes Turner  rašė:
>
>>
>>
>> On Wed, Jan 4, 2023 at 4:34 PM Wes Turner  wrote:
>>
>>> What are the expected limitations of [ChatGPT]?
>>>
>>> What is "Prompt Engineering"?
>>> [Prompt engineering - Wikipedia](
>>> https://en.wikipedia.org/wiki/Prompt_engineering )
>>>
>>> What lessons about technology reliance could you teach, in regards to
>>> Clippy?
>>>
>>> - "What is ChatGPT? Wrong answers only"
>>>   - Human_n: EDGES WITH REASONING
>>>
>>> - "Tell me IDK ("I don't know") when you don't know"
>>>
>>
>> - What are "Truthiness", Confidence Intervals and Error Propagation?
>> - What is Convergence?
>> - What does it mean for algorithmic outputs to converge given additional
>> parametric noise?
>>
>>
>>>
>>> - "How certain are you that that is the correct answer?"
>>>
>>
>> - How does [ChatGPT] handle known-to-be or presumed-to-be unsolved math
>> and physics problems?
>>
>> - "How do we create room-temperature superconductivity?"
>>
>> - "How will planetary orbital trajectories change in the n-body gravity
>> problem if another dense probably interstellar mass passes through our
>> local system?"
>>
>>
>>>
>>> - "Are static analysis code metrics sufficient for Safety Critical code?"
>>>
>>
>> - Where in the DevOpSec software development lifecycle should human code
>> review for security best practices and common vulnerabilities and
>> weaknesses?
>>   - Is the [ChatGPT] model trained from *only* Formally Verified code
>> with associated tests?
>> - Branch and line coverage metrics indicate which tests run which
>> lines of which functions. Code coverage typically implies dynamic analysis?
>>
>>
>>>
>>> - "Whose code is this based on?"
>>>
>>> - "Where and when did you learn this?"
>>>
>>
>> - Explainability (XAI)
>> - How can models "Unlearn" or "Learn over" given a sufficient
>> meta-analytic procedure given the information available at that point in
>> spacetime?
>>
>>
>>
>>> - "Why would a US President abstain from using ChatGPT or similar to
>>> fill speeches 'just like what I said before'?"
>>>
>>> #Burgundy
>>>
>>
>> - How can we use [ChatGPT] and other Prompt Engineering approaches to
>> perform Evidence-Based Policy with supporting computational analyses
>> prepared in form for meta-analysis given verification of data quality and
>> experimental controls?
>>
>>
>>>
>>> GPT or similar trained on only Formally-Verified code with associated
>>> tests
>>> and/or e.g. Lean Mathlib, or e.g. the Principia in SymPy & Cirq; that
>>> could probably eliminate my job, but maybe still not teaching
>>>
>>
>> - "Q: ChatGPT etc. trained on mathlib and tests"
>>   https://github.com/leanprover-community/mathlib/issues/17919
>>
>> - "Port the QuantumQ game to Cirq (SymPy (Python))?"
>>   - https://quantumai.google/cirq/start/start
>> -
>> https://colab.research.google.com/drive/11WGNX8TKOmjpmvJWO7v19gXKoEwIwxyw?usp=sharing
>>
>> - "How does [ChatGPT] compare to Critical Thinking, Reasoning, Logic, and
>> Rationality?
>>   https://en.wikipedia.org/wiki/Critical_thinking#Logic_and_rationality
>>
>>
>>
>>> On Wed, Jan 4, 2023, 6:28 AM Christian Mascher 
>>> wrote:
>>>
 Hi,

 a student of mine was aware of this chatbot and asked it about a
 class-assignment of his own accord. We program in Java with some extra
 homemade library class used by some schools in our region.

 The bot came up with a "solution" which was flawed in several respects:
 1. It used some other (unimported) classes - solution doesn't work and
 doesn't fit the assignment.
 2. It put all the code into the constructor, a typical (design and
 style) error for students beginning with Java.

 When confronted with the problem number one above, it acknowledged the
 fault and produced a different unrelated solution.

 Sooo