I don't have any specific advice to offer without more info. What
do you mean by 'plug-ins'? Are you speaking just about browser
plugins (using the nsIPlugin family of interfaces and legacy
Navigator plugins, etc)? Or all dynamic link libraries? or what?
I see you did not post a response to blizzard's question.
Do you need to modify the calling convention for all calls? or
only some limited set?
Are you seeing specific problems?
If you recompile *everything* then I'd expect this to mostly
work. One place you'd have problems with is xptcall.
See: http://www.mozilla.org/scriptable/xptcall-faq.html
This is platform specific asm code that aims to make and use the
same call signatures that the compiler would generate. If you are
dealing with code that will call or be called by objects using
xptcall then you'd need to modify your copy of that code for your
specific platform.
I'll be happy to try to answer specific questions. Let's keep any
discussion on the newsgroups to invite insight from others.
John.
Leslie Ann Ong wrote:
>
> Hi,
>
> I'm a student at Oregon Graduate Institute
> and am currently working on a project
> involving Mozilla.
>
> I need to modify some Mozilla source code
> (for project purposes, not for distribution
> of anykind) to enable it to handle plug-ins
> compiled using StackGuard.
>
> Stackguard is a gcc compiler enhancement to protect
> programs against stack smashing attacks. The
> Stackguard code generator produces programs that
> defend themselves against stack smashing attack by doing
> integrity checks on the stack PRIOR to returning
> from function calls. It does this by inserting canary
> word before the return address in a stack frame.
>
> Since Mozilla employs a custom interface for plug-ins,
> it won't be able to recognize stack frames with
> such a canary word inserted.
>
> I need to change some code in Mozilla so that it
> can recognze plug-ins compiled using StackGuard.
> I've browsed through the Mozilla code for almost
> 2 weeks now but still can't pinpoint where I should
> begin.
>
> I am wondering if you can help me know where to
> start.
>
> I really am looking forward to hearing from you.
>
> Thank you very much.
>
> Leslie Ann Ong