Re: [R] Noisy objective functions
On Sun, 13 Aug 2023, Hans W writes:
> While working on 'random walk' applications, I got interested in
> optimizing noisy objective functions. As an (artificial) example, the
> following is the Rosenbrock function, where Gaussian noise of standard
> deviation `sd = 0.01` is added to the function value.
>
> fn <- function(x)
> (1+rnorm(1, sd=0.01)) * adagio::fnRosenbrock(x)
>
> To smooth out the noise, define another function `fnk(x, k = 1)` that
> calls `fn` k times and returns the mean value of those k function
> applications.
>
> fnk <- function(x, k = 1) { # fnk(x) same as fn(x)
> rv = 0.0
> for (i in 1:k) rv <- rv + fn(x)
> return(rv/n)
> }
>
> When we apply several optimization solvers to this noisy and smoothed
> noise functions we get for instance the following results:
> (Starting point is always `rep(0.1, 5)`, maximal number of iterations 5000,
> relative tolerance 1e-12, and the optimization is successful if the
> function value at the minimum is below 1e-06.)
>
> k nmk anms neldermead ucminf optim_BFGS
> ---
> 1 0.21 0.32 0.13 0.00 0.00
> 3 0.52 0.63 0.50 0.00 0.00
> 10 0.81 0.91 0.87 0.00 0.00
>
> Solvers: nmk = dfoptim::nmk, anms = pracma::anms [both Nelder-Mead codes]
> neldermead = nloptr::neldermead,
> ucminf = ucminf::ucminf, optim_BFGS = optim with method "BFGS"
>
> Read the table as follows: `nmk` will be successful in 21% of the
> trials, while for example `optim` will never come close to the true
> minimum.
>
> I think it is reasonable to assume that gradient-based methods do
> poorly with noisy objectives, though I did not expect to see them fail
> so clearly. On the other hand, Nelder-Mead implementations do quite
> well if there is not too much noise.
>
> In real-world applications, it will often not be possible to do the
> same measurement several times. That is, we will then have to live
> with `k = 1`. In my applications with long 'random walks', doing the
> calculations several times in a row will really need some time.
>
> QUESTION: What could be other approaches to minimize noisy functions?
>
> I looked through some "Stochastic Programming" tutorials and did not
> find them very helpful in this situation. Of course, I might have
> looked into these works too superficially.
>
Since Nelder--Mead worked /relatively/ well: in my
experience, its results can sometimes be improved by
restarting it, i.e. re-initializing the simplex. See this
note here: http://enricoschumann.net/R/restartnm.htm ,
which incidentally also uses the Rosenbrock function.
Just for the record, I think Differential Evolution (DE)
can handle such problems well, though it would usually
need more iterations. As computational "proof" ;-) , I
run DE 50 times for the k == 1 case, and each time store
whether the resulting objective-function value is below
1e-6. I let DE take way more function evaluations
(population of 100 times 500 generations = 5 function
evaluations); but it gets a value below 1e-6 in all 50
cases.
library("NMOF")
ofv.below.threshold <- logical(50)
for (i in seq_along(ofv.below.threshold)) {
sol <- DEopt(fnk,
algo = list(
nP = 100, nG = 500,
min = rep( 5, 5), max = rep( 10, 5)))
ofv.below.threshold[i] <- sol$OFvalue < 1e-6
}
sum(ofv.below.threshold)/length(ofv.below.threshold)
(These 50 runs take less than half a minute on my
machine.) Note that I have on purpose initialized the
population in the range 5 to 10, i.e. way off the optimum.
--
Enrico Schumann
Lucerne, Switzerland
http://enricoschumann.net
__
R-help@r-project.org mailing list -- To UNSUBSCRIBE and more, see
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.
Re: [R] Noisy objective functions
More to provide another perspective, I'll give the citation of some work
with Harry Joe and myself from over 2 decades ago.
@Article{,
author = {Joe, Harry and Nash, John C.},
title = {Numerical optimization and surface estimation with imprecise
function evaluations},
journal = {Statistics and Computing},
year= {2003},
volume = {13},
pages = {277--286},
}
Essentially this fits a quadratic approximately by regression, assuming the
returned
objective is imprecise. It is NOT good for high dimension, of course, and is
bedeviled
by needing to have some idea of the scale of the imprecision i.e., the noise
amplitude. However, it does work for some applications. Harry had some success
with
Monte Carlo evaluation of multidimensional integrals optimizing crude
quadratures.
That is, multiple crude quadrature could be more efficient than single precise
quadrature.
However, this approach is not one that can be blindly applied. There are all
sorts
of issues about what point cloud to keep as the "fit model, move to model
minimum,
add points, delete points" process evolves.
JN
On 2023-08-13 15:28, Hans W wrote:
While working on 'random walk' applications, I got interested in
optimizing noisy objective functions. As an (artificial) example, the
following is the Rosenbrock function, where Gaussian noise of standard
deviation `sd = 0.01` is added to the function value.
fn <- function(x)
(1+rnorm(1, sd=0.01)) * adagio::fnRosenbrock(x)
To smooth out the noise, define another function `fnk(x, k = 1)` that
calls `fn` k times and returns the mean value of those k function
applications.
fnk <- function(x, k = 1) { # fnk(x) same as fn(x)
rv = 0.0
for (i in 1:k) rv <- rv + fn(x)
return(rv/n)
}
When we apply several optimization solvers to this noisy and smoothed
noise functions we get for instance the following results:
(Starting point is always `rep(0.1, 5)`, maximal number of iterations 5000,
relative tolerance 1e-12, and the optimization is successful if the
function value at the minimum is below 1e-06.)
k nmk anms neldermead ucminf optim_BFGS
---
1 0.21 0.32 0.13 0.00 0.00
3 0.52 0.63 0.50 0.00 0.00
10 0.81 0.91 0.87 0.00 0.00
Solvers: nmk = dfoptim::nmk, anms = pracma::anms [both Nelder-Mead codes]
neldermead = nloptr::neldermead,
ucminf = ucminf::ucminf, optim_BFGS = optim with method "BFGS"
Read the table as follows: `nmk` will be successful in 21% of the
trials, while for example `optim` will never come close to the true
minimum.
I think it is reasonable to assume that gradient-based methods do
poorly with noisy objectives, though I did not expect to see them fail
so clearly. On the other hand, Nelder-Mead implementations do quite
well if there is not too much noise.
In real-world applications, it will often not be possible to do the
same measurement several times. That is, we will then have to live
with `k = 1`. In my applications with long 'random walks', doing the
calculations several times in a row will really need some time.
QUESTION: What could be other approaches to minimize noisy functions?
I looked through some "Stochastic Programming" tutorials and did not
find them very helpful in this situation. Of course, I might have
looked into these works too superficially.
__
R-help@r-project.org mailing list -- To UNSUBSCRIBE and more, see
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.
__
R-help@r-project.org mailing list -- To UNSUBSCRIBE and more, see
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.
Re: [R] OFF TOPIC: chatGPT glibly produces a lot of wrong answers?
Hi Bert, The article notes that chatGPT often gets the concept wrong, rather than the facts. I think this can be traced to the one who poses the question. I have often encountered requests for help that did not ask for what was really wanted. I was recently asked if I could graphically concatenate years of derived quantities that were based on an aggregation of daily cycles. You get an average daily cycle for each year, but this doesn't necessarily connect to the average daily cycle for the next year. It didn't work, but it was a case of YKWIM (You Know What I Mean). In this failure of communication, the questioner frames the question in a way that may be figured out by a human, but is not logically consistent. It is the basis for some very funny scenes in Douglas Adams' "Hitchhiker" series, but can be intensely frustrating to both parties in real life. Jim On Mon, Aug 14, 2023 at 3:50 AM Bert Gunter wrote: > > **OFF TOPIC** but perhaps of interest to some on this list. I apologize in > advance to those who may be offended. > > The byline: > > "ChatGPT's odds of getting code questions correct are worse than a coin flip > > But its suggestions are so annoyingly plausible" > * > from here: > https://www.theregister.com/2023/08/07/chatgpt_stack_overflow_ai/ > > Hmm... Perhaps not surprising. Sounds like some expert consultants I've > met. 😕 > > Just for amusement. I am ignorant about this and have no strongly held > views, > > Cheers to all, > Bert > > [[alternative HTML version deleted]] > > __ > R-help@r-project.org mailing list -- To UNSUBSCRIBE and more, see > https://stat.ethz.ch/mailman/listinfo/r-help > PLEASE do read the posting guide http://www.R-project.org/posting-guide.html > and provide commented, minimal, self-contained, reproducible code. __ R-help@r-project.org mailing list -- To UNSUBSCRIBE and more, see https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code.
Re: [R] Noisy objective functions
Thanks, Ben.
For certain reasons, I would *not* like to apply global optimization solvers,
e.g., for reasons of higher dimensions and longer running times.
I was hoping for suggestions from the "Stochastic Programming" side.
And please, never suggest `optim` with method "SANN".
See the Optimization cheatsheet I wrote with John Nash:
"NOTE: CG (John is the author!) and SANN are NOT recommended."
https://github.com/hwborchers/CheatSheets/blob/main/Base%20R%20Optim%20Cheatsheet.pdf
Hans W.
On Sun, 13 Aug 2023 at 21:28, Hans W wrote:
>
> While working on 'random walk' applications, I got interested in
> optimizing noisy objective functions. As an (artificial) example, the
> following is the Rosenbrock function, where Gaussian noise of standard
> deviation `sd = 0.01` is added to the function value.
>
> fn <- function(x)
> (1+rnorm(1, sd=0.01)) * adagio::fnRosenbrock(x)
>
> To smooth out the noise, define another function `fnk(x, k = 1)` that
> calls `fn` k times and returns the mean value of those k function
> applications.
>
> fnk <- function(x, k = 1) { # fnk(x) same as fn(x)
> rv = 0.0
> for (i in 1:k) rv <- rv + fn(x)
> return(rv/n)
> }
>
> When we apply several optimization solvers to this noisy and smoothed
> noise functions we get for instance the following results:
> (Starting point is always `rep(0.1, 5)`, maximal number of iterations 5000,
> relative tolerance 1e-12, and the optimization is successful if the
> function value at the minimum is below 1e-06.)
>
> k nmk anms neldermead ucminf optim_BFGS
> ---
> 1 0.21 0.32 0.13 0.00 0.00
> 3 0.52 0.63 0.50 0.00 0.00
> 10 0.81 0.91 0.87 0.00 0.00
>
> Solvers: nmk = dfoptim::nmk, anms = pracma::anms [both Nelder-Mead codes]
> neldermead = nloptr::neldermead,
> ucminf = ucminf::ucminf, optim_BFGS = optim with method "BFGS"
>
> Read the table as follows: `nmk` will be successful in 21% of the
> trials, while for example `optim` will never come close to the true
> minimum.
>
> I think it is reasonable to assume that gradient-based methods do
> poorly with noisy objectives, though I did not expect to see them fail
> so clearly. On the other hand, Nelder-Mead implementations do quite
> well if there is not too much noise.
>
> In real-world applications, it will often not be possible to do the
> same measurement several times. That is, we will then have to live
> with `k = 1`. In my applications with long 'random walks', doing the
> calculations several times in a row will really need some time.
>
> QUESTION: What could be other approaches to minimize noisy functions?
>
> I looked through some "Stochastic Programming" tutorials and did not
> find them very helpful in this situation. Of course, I might have
> looked into these works too superficially.
__
R-help@r-project.org mailing list -- To UNSUBSCRIBE and more, see
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.
Re: [R] OFF TOPIC: chatGPT glibly produces a lot of wrong answers?
It does often behave better if you say to it "that doesn't seem to be working" and perhaps some error message It is afterall a language tool. Its function is to provide text that seems real. If you ask it a science question and ask it to provide references in Vancouver format, it can format the references perfectly. They will be from real authors (often who have published in the general field), they will be in real journals for the field. But the title is entirely false but plausible. Expect many a scammer to get caught out... On Sun, 13 Aug 2023, 18:50 Bert Gunter, wrote: > **OFF TOPIC** but perhaps of interest to some on this list. I apologize in > advance to those who may be offended. > > The byline: > > "ChatGPT's odds of getting code questions correct are worse than a coin > flip > > But its suggestions are so annoyingly plausible" > * > from here: > https://www.theregister.com/2023/08/07/chatgpt_stack_overflow_ai/ > > Hmm... Perhaps not surprising. Sounds like some expert consultants I've > met. 😕 > > Just for amusement. I am ignorant about this and have no strongly held > views, > > Cheers to all, > Bert > > [[alternative HTML version deleted]] > > __ > R-help@r-project.org mailing list -- To UNSUBSCRIBE and more, see > https://stat.ethz.ch/mailman/listinfo/r-help > PLEASE do read the posting guide > http://www.R-project.org/posting-guide.html > and provide commented, minimal, self-contained, reproducible code. > [[alternative HTML version deleted]] __ R-help@r-project.org mailing list -- To UNSUBSCRIBE and more, see https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code.
Re: [R] Noisy objective functions
This is a huge topic.
Differential evolution (DEoptim package) would be one good starting
point; there is a simulated annealing method built into optim() (method
= "SANN") but it usually requires significant tuning.
Also genetic algorithms.
You could look at the NLopt list of algorithms
https://nlopt.readthedocs.io/en/latest/NLopt_Algorithms/ , focusing on
the options for derivative-free global optimization , and then use them
via the nloptr package.
Good luck ...
On 2023-08-13 3:28 p.m., Hans W wrote:
While working on 'random walk' applications, I got interested in
optimizing noisy objective functions. As an (artificial) example, the
following is the Rosenbrock function, where Gaussian noise of standard
deviation `sd = 0.01` is added to the function value.
fn <- function(x)
(1+rnorm(1, sd=0.01)) * adagio::fnRosenbrock(x)
To smooth out the noise, define another function `fnk(x, k = 1)` that
calls `fn` k times and returns the mean value of those k function
applications.
fnk <- function(x, k = 1) { # fnk(x) same as fn(x)
rv = 0.0
for (i in 1:k) rv <- rv + fn(x)
return(rv/n)
}
When we apply several optimization solvers to this noisy and smoothed
noise functions we get for instance the following results:
(Starting point is always `rep(0.1, 5)`, maximal number of iterations 5000,
relative tolerance 1e-12, and the optimization is successful if the
function value at the minimum is below 1e-06.)
k nmk anms neldermead ucminf optim_BFGS
---
1 0.21 0.32 0.13 0.00 0.00
3 0.52 0.63 0.50 0.00 0.00
10 0.81 0.91 0.87 0.00 0.00
Solvers: nmk = dfoptim::nmk, anms = pracma::anms [both Nelder-Mead codes]
neldermead = nloptr::neldermead,
ucminf = ucminf::ucminf, optim_BFGS = optim with method "BFGS"
Read the table as follows: `nmk` will be successful in 21% of the
trials, while for example `optim` will never come close to the true
minimum.
I think it is reasonable to assume that gradient-based methods do
poorly with noisy objectives, though I did not expect to see them fail
so clearly. On the other hand, Nelder-Mead implementations do quite
well if there is not too much noise.
In real-world applications, it will often not be possible to do the
same measurement several times. That is, we will then have to live
with `k = 1`. In my applications with long 'random walks', doing the
calculations several times in a row will really need some time.
QUESTION: What could be other approaches to minimize noisy functions?
I looked through some "Stochastic Programming" tutorials and did not
find them very helpful in this situation. Of course, I might have
looked into these works too superficially.
__
R-help@r-project.org mailing list -- To UNSUBSCRIBE and more, see
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.
__
R-help@r-project.org mailing list -- To UNSUBSCRIBE and more, see
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.
[R] Noisy objective functions
While working on 'random walk' applications, I got interested in
optimizing noisy objective functions. As an (artificial) example, the
following is the Rosenbrock function, where Gaussian noise of standard
deviation `sd = 0.01` is added to the function value.
fn <- function(x)
(1+rnorm(1, sd=0.01)) * adagio::fnRosenbrock(x)
To smooth out the noise, define another function `fnk(x, k = 1)` that
calls `fn` k times and returns the mean value of those k function
applications.
fnk <- function(x, k = 1) { # fnk(x) same as fn(x)
rv = 0.0
for (i in 1:k) rv <- rv + fn(x)
return(rv/n)
}
When we apply several optimization solvers to this noisy and smoothed
noise functions we get for instance the following results:
(Starting point is always `rep(0.1, 5)`, maximal number of iterations 5000,
relative tolerance 1e-12, and the optimization is successful if the
function value at the minimum is below 1e-06.)
k nmk anms neldermead ucminf optim_BFGS
---
1 0.21 0.32 0.13 0.00 0.00
3 0.52 0.63 0.50 0.00 0.00
10 0.81 0.91 0.87 0.00 0.00
Solvers: nmk = dfoptim::nmk, anms = pracma::anms [both Nelder-Mead codes]
neldermead = nloptr::neldermead,
ucminf = ucminf::ucminf, optim_BFGS = optim with method "BFGS"
Read the table as follows: `nmk` will be successful in 21% of the
trials, while for example `optim` will never come close to the true
minimum.
I think it is reasonable to assume that gradient-based methods do
poorly with noisy objectives, though I did not expect to see them fail
so clearly. On the other hand, Nelder-Mead implementations do quite
well if there is not too much noise.
In real-world applications, it will often not be possible to do the
same measurement several times. That is, we will then have to live
with `k = 1`. In my applications with long 'random walks', doing the
calculations several times in a row will really need some time.
QUESTION: What could be other approaches to minimize noisy functions?
I looked through some "Stochastic Programming" tutorials and did not
find them very helpful in this situation. Of course, I might have
looked into these works too superficially.
__
R-help@r-project.org mailing list -- To UNSUBSCRIBE and more, see
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.
Re: [R] OFF TOPIC: chatGPT glibly produces a lot of wrong answers?
Thanks. https://www.wsj.com/articles/with-ai-hackers-can-simply-talk-computers-into-misbehaving-ad488686?mod=hp_lead_pos10 Ever heard of AI prompt injection? *Stephen Dawson, DSL* /Executive Strategy Consultant/ Business & Technology +1 (865) 804-3454 http://www.shdawson.com On 8/13/23 13:49, Bert Gunter wrote: **OFF TOPIC** but perhaps of interest to some on this list. I apologize in advance to those who may be offended. The byline: "ChatGPT's odds of getting code questions correct are worse than a coin flip But its suggestions are so annoyingly plausible" * from here: https://www.theregister.com/2023/08/07/chatgpt_stack_overflow_ai/ Hmm... Perhaps not surprising. Sounds like some expert consultants I've met. 😕 Just for amusement. I am ignorant about this and have no strongly held views, Cheers to all, Bert [[alternative HTML version deleted]] __ R-help@r-project.org mailing list -- To UNSUBSCRIBE and more, see https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code. __ R-help@r-project.org mailing list -- To UNSUBSCRIBE and more, see https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code.
[R] OFF TOPIC: chatGPT glibly produces a lot of wrong answers?
**OFF TOPIC** but perhaps of interest to some on this list. I apologize in advance to those who may be offended. The byline: "ChatGPT's odds of getting code questions correct are worse than a coin flip But its suggestions are so annoyingly plausible" * from here: https://www.theregister.com/2023/08/07/chatgpt_stack_overflow_ai/ Hmm... Perhaps not surprising. Sounds like some expert consultants I've met. 😕 Just for amusement. I am ignorant about this and have no strongly held views, Cheers to all, Bert [[alternative HTML version deleted]] __ R-help@r-project.org mailing list -- To UNSUBSCRIBE and more, see https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code.
