| To: | REALbasic NUG <realbasic-nug at lists dot realsoftware dot com> |
|---|---|
| Subject: | Re: RbScript - careful with Doubles |
| From: | Bob Delaney <delaneyrm at earthlink dot net> |
| Date: | Fri, 30 Sep 2005 12:22:50 -0500 |
| Delivered-to: | realbasic-nug at lists dot realsoftware dot com |
| References: | <S dot 0000672091 at mail dot tempel dot org> <p06230901bf62730bb8fc at [192 dot 168 dot 2 dot 55]> <C65F1AC6-31A4-11DA-8AA1-000393C6C4C4 at hit dot net> <6B696481-2EEC-46DF-A648-EEF9D8A3AEB0 at adx-online dot com> <FEF336E4-31BA-11DA-8AA1-000393C6C4C4 at hit dot net> <EF672859-2763-4BA1-BFDF-91CB94EAC1BD at adx-online dot com> <3D762723-31BE-11DA-8AA1-000393C6C4C4 at hit dot net> |
At 8:31 AM -0700 9/30/05, Joe Huber wrote: I didn't follow your code in any detail, but I notice that you're using STR(x) which will inherently reduces the precision of the returned value to a Single. That was my mistake. It should have been: return(format(x, "#.###############"))With that, my example gives correct results. RBScript does not have a problem with doubles. Bob _______________________________________________ Unsubscribe or switch delivery mode: <http://www.realsoftware.com/support/listmanager/> Search the archives of this list here: <http://support.realsoftware.com/listarchives/lists.html> |
| Previous by Date: | Re: "You're not going to learn how to program in BASIC any more", Philip Regan |
|---|---|
| Next by Date: | Re: Mac Print Margins, Robert Fang |
| Previous by Thread: | Re: RbScript - careful with Doubles, CV |
| Next by Thread: | Re: RbScript - careful with Doubles, Eric Pousse |
| Indexes: | [Date] [Thread] [Top] [All Lists] |