Jesus Christ.  I paid the $20 and uploaded a bunch of Nokia manuals and somehow 
the answer to “how to configure an XGS-PON port” got even more wrong.  It has 
invented sequences of commands that definitely do not exist on this platform 
and are not in the manuals I provided.  

 

Since I paid $20 I experimented with a number of other questions.  It’s doing 
ok with general questions about concepts and capabilities, but any question 
about HOW to do something is either ridiculously wrong or dangerously wrong.  
By ridiculously wrong I mean completely incorrect command syntax.  By 
dangerously wrong I mean commands that would be accepted, but which would 
result in no service on that port.  

 

It must be so good with Arista/Cisco stuff because there are so many examples 
on the web it can work with.  Presumably it can’t understand how routers work, 
but it can find an example that does what you asked for and regurgitate it for 
you.  

 

There may be a better use for it, but I don’t know what yet.  If anybody thinks 
of anything I’ll certainly try it while I have a month of this service paid 
for. 

 

-Adam

 

 

 

From: AF <af-boun...@af.afmug.com> On Behalf Of Ken Hohhof
Sent: Monday, June 03, 2024 10:02 AM
To: 'AnimalFarm Microwave Users Group' <af@af.afmug.com>
Subject: Re: [AFMUG] AI tools

 

Seems like all AI get a lot of their training on Reddit.  Pros and cons to that.

 

From: AF <af-boun...@af.afmug.com <mailto:af-boun...@af.afmug.com> > On Behalf 
Of Adam Moffett
Sent: Monday, June 3, 2024 7:51 AM
To: AnimalFarm Microwave Users Group <af@af.afmug.com <mailto:af@af.afmug.com> >
Subject: Re: [AFMUG] AI tools

 

I just gave Perplexity (free version) two questions where I know how GPT 
responded.  

 

"How do I configure OSPF export filters on Arista EOS?"

This answer was accurate, in fact it was more concise than what I got from chat 
GPT.  

 

"How do you configure an XGS-PON interface on the Nokia ISAM 7360?"

This answer was wrong.  Now, to be fair, Nokia has a lot of products, and I 
think what it gave me was the correct commands for a different Nokia product.  
It's the right sort of syntax you'd see on a Lucent/Alcatel/Nokia product, it's 
just wrong for the ISAM 7360.  

 

Another difference between those questions is Arista's documentation is freely 
available on the web whereas Nokia's documentation requires an account and 
login to access.  The reason I'd look for help on Nokia is specifically because 
the commands can vary, and the documentation is too much to digest for a mere 
human.  The doc package for the ISAM 7360 is >20,000 pages.  That's not 
counting release notes, white papers, forum posts, and technical notes.  So 
this is the exact sort of thing I really would like help researching and it 
gave me a wrong answer on the first test. 

 

I followed up with "These instructions may be for a different Nokia product. 
Are you sure they will work on 7360 ISAM?"  It provided several citations and 
concluded, "....therefore the instructions I provided should be applicable to 
the 7360." 

 

The first citation is a reddit post about configuring the ports on an NT 
(ethernet) card.  It apparently learned the naming convention of PON ports from 
another source and adapted the instructions on reddit using the NT card command 
syntax and inserting the PON port names.  That's an impressive bit of learning 
and correlating sources, and it's the sort of thing a human might try while 
learning the platform.  It's still wrong though.  

 

-Adam

 

 

On Sat, Jun 1, 2024 at 7:27 PM Ken Hohhof <khoh...@kwom.com 
<mailto:khoh...@kwom.com> > wrote:

Anybody here use AI on a daily basis, like for research or creative purposes?

 

I’m an AI naysayer, but this looks awfully attractive.  There’s a free tier, or 
unlock the full capability and almost unlimited queries for $20/mo.  I’m not 
sure I could do a decent eval on it though.

 

https://www.howtogeek.com/perplexity-is-the-only-paid-ai-chatbot-you-need-heres-why/

https://www.perplexity.ai/pro

 

-- 
AF mailing list
AF@af.afmug.com <mailto:AF@af.afmug.com> 
http://af.afmug.com/mailman/listinfo/af_af.afmug.com

-- 
AF mailing list
AF@af.afmug.com
http://af.afmug.com/mailman/listinfo/af_af.afmug.com

Reply via email to