Re: convert static arrays to dynamic arrays and return, have wrong data.
"Nick Treleaven" wrote in message news:m42lbb$2pru$1...@digitalmars.com... This is: https://issues.dlang.org/show_bug.cgi?id=8838 Apparently it's a bit tricky to implement ATM. yebblies: > This is not very easy, because the compiler lowers all static array > assignment to slice assignment, making _every_ static array assignment > unsafe. That needs to be fixed first, and requires extensive changes > in the interpreter. I think the situation has slightly improved since.
Re: convert static arrays to dynamic arrays and return, have wrong data.
On 12/11/2014 15:36, Nick Treleaven wrote: Seeing as the 'scope' attribute doesn't seem to be happening any time soon, shouldn't the compiler reject static array slicing in @safe code? The user is then forced to think about the operation, and put the code in a @trusted delegate if they think it is actually safe. This is: https://issues.dlang.org/show_bug.cgi?id=8838 Apparently it's a bit tricky to implement ATM. yebblies: > This is not very easy, because the compiler lowers all static array > assignment to slice assignment, making _every_ static array assignment > unsafe. That needs to be fixed first, and requires extensive changes > in the interpreter. Steven Schveighoffer: > Can you just ban slicing that escapes the statement?
Re: convert static arrays to dynamic arrays and return, have wrong data.
On Sunday, 9 November 2014 at 10:04:16 UTC, bearophile wrote: Yeah, what do you suggest to change in the language to avoid this problem? 1. Deprecate dynamic arrays. 2. Implement dynamic arrays as a library type with it's own fat-slice implementation which supports reallocation (slices with indirection and stored begin/end indices). 3. Provide conversion to regular shrinkable slices for operations on the array with a warning similar to those provided by iterators in C++.
Re: convert static arrays to dynamic arrays and return, have wrong data.
On 09/11/2014 10:34, bearophile wrote: If you just disallow that kind of operations indiscriminately, you reduce a lot the usefulness of D (because fixed size => dynamic slice array is a conversion useful in many cases) and probably force the introduction of many casts, and I don't know if this will increase the overall safety of the D code. Seeing as the 'scope' attribute doesn't seem to be happening any time soon, shouldn't the compiler reject static array slicing in @safe code? The user is then forced to think about the operation, and put the code in a @trusted delegate if they think it is actually safe. It would help a bit if we had @trusted blocks instead of having to call a @trusted delegate inline (which is non-obvious). The status quo encourages people to just mark whole functions as @trusted, skipping much otherwise acceptable safety enforcement.
Re: convert static arrays to dynamic arrays and return, have wrong data.
On 11/10/14 3:29 AM, Don wrote: The problem is, that you need to be able to take a slice of a stack-allocked array (otherwise stack allocated arrays are useless). Eg you should be able to pass a slice of a stack array to writefln(). Detecting if the slice is returned, requires flow analysis. Currently the front-end doesn't do any flow analysis at all, except for a couple of special cases like closures and super() calls. While all of that is true, the OP's code should be rejected. It returns a static array as a dynamic array in one expression. -Steve
Re: convert static arrays to dynamic arrays and return, have wrong data.
On Monday, 10 November 2014 at 08:29:40 UTC, Don wrote: stack-allocked array (otherwise stack allocated arrays are useless). Eg you should be able to pass a slice of a stack array to writefln(). Detecting if the slice is returned, requires flow analysis. Currently the front-end doesn't do any flow analysis at all, except for a couple of special cases like closures and super() calls. Ceterum censeo ... http://wiki.dlang.org/User:Schuetzm/scope
Re: convert static arrays to dynamic arrays and return, have wrong data.
On Sunday, 9 November 2014 at 15:09:10 UTC, H. S. Teoh via Digitalmars-d wrote: On Sun, Nov 09, 2014 at 08:29:58AM +, AlanThinker via Digitalmars-d wrote: It seems that, D's array is strange, It can implicit convert static arrays to dynamic arrays no error and no warning. But when I return the converted arrays out the function. Outside function will get some wrong data. It may very easily cause some bug because no error when convert static arrays to dynamic arrays. [...] Yes, this is a known problem. There may even be an issue filed in bugzilla about it (if not, please file one!). The problem is that local static arrays are allocated on the stack, and the implicit conversion to dynamic array is simply taking a slice of the stack-allocated array. As a result, after the function returns, the slice is now pointing at stack memory that has gone out of scope. I'm not sure if the current compiler issues a warning / error if you do this in @safe code, but IMO it should do this even in @system code since the implicit conversion is almost never correct. T The problem is, that you need to be able to take a slice of a stack-allocked array (otherwise stack allocated arrays are useless). Eg you should be able to pass a slice of a stack array to writefln(). Detecting if the slice is returned, requires flow analysis. Currently the front-end doesn't do any flow analysis at all, except for a couple of special cases like closures and super() calls.
Re: convert static arrays to dynamic arrays and return, have wrong data.
On Sun, Nov 09, 2014 at 08:29:58AM +, AlanThinker via Digitalmars-d wrote: > It seems that, D's array is strange, > It can implicit convert static arrays to dynamic arrays no error and > no warning. > But when I return the converted arrays out the function. > Outside function will get some wrong data. > > It may very easily cause some bug because no error when convert static > arrays to dynamic arrays. [...] Yes, this is a known problem. There may even be an issue filed in bugzilla about it (if not, please file one!). The problem is that local static arrays are allocated on the stack, and the implicit conversion to dynamic array is simply taking a slice of the stack-allocated array. As a result, after the function returns, the slice is now pointing at stack memory that has gone out of scope. I'm not sure if the current compiler issues a warning / error if you do this in @safe code, but IMO it should do this even in @system code since the implicit conversion is almost never correct. T -- People who are more than casually interested in computers should have at least some idea of what the underlying hardware is like. Otherwise the programs they write will be pretty weird. -- D. Knuth
Re: convert static arrays to dynamic arrays and return, have wrong data.
BTW, adding .dup resolve error: BTW, adding .dup resolve error, but i mean it easy to make mistake because no compile error when implicit convert.
Re: convert static arrays to dynamic arrays and return, have wrong data.
On Sun, 09 Nov 2014 12:46:28 +
novice2 via Digitalmars-d wrote:
> int[3] test1()
> {
>int[3] arr;
>...
> }
>
> disasm shows:
> - arr created on stack
> - arr address returned
> - stack changed
> - data lost.
hm. what i see in disasm is: array is created on the *caller* stack.
then address of that array passed to `test1()` as hidden argument, so
`test1()` actually returns nothing at all, it just changes that passed
array.
signature.asc
Description: PGP signature
Re: convert static arrays to dynamic arrays and return, have wrong data.
int[3] test1()
{
int[3] arr;
...
}
disasm shows:
- arr created on stack
- arr address returned
- stack changed
- data lost.
Re: convert static arrays to dynamic arrays and return, have wrong data.
BTW, adding .dup resolve error:
int[] test11()
{
return test1().dup;
}
int[] test22()
{
return test2().dup;
}
Re: convert static arrays to dynamic arrays and return, have wrong data.
AlanThinker: Is it possible to raise error when implicit convert static arrays to dynamic arrays? Because there are really different. To do this you need a sound tracking of memory areas. I think this is a "must have" for D, but so far D designers think otherwise. If you just disallow that kind of operations indiscriminately, you reduce a lot the usefulness of D (because fixed size => dynamic slice array is a conversion useful in many cases) and probably force the introduction of many casts, and I don't know if this will increase the overall safety of the D code. Bye, bearophile
Re: convert static arrays to dynamic arrays and return, have wrong data.
Is it possible to raise error when implicit convert static arrays to dynamic arrays? Because there are really different. On Sunday, 9 November 2014 at 10:04:16 UTC, bearophile wrote: AlanThinker: It seems that, D's array is strange, It can implicit convert static arrays to dynamic arrays no error and no warning. But when I return the converted arrays out the function. Outside function will get some wrong data. It may very easily cause some bug because no error when convert static arrays to dynamic arrays. Yeah, what do you suggest to change in the language to avoid this problem? Bye, bearophile
Re: convert static arrays to dynamic arrays and return, have wrong data.
AlanThinker: It seems that, D's array is strange, It can implicit convert static arrays to dynamic arrays no error and no warning. But when I return the converted arrays out the function. Outside function will get some wrong data. It may very easily cause some bug because no error when convert static arrays to dynamic arrays. Yeah, what do you suggest to change in the language to avoid this problem? Bye, bearophile
