Results 1 to 4 of 4

Thread: Float vs. Decimal

  1. 06-29-1998, 07:48 AM #1
    Jim Craddock Guest

    Float vs. Decimal

    We are having problems with rounding errors on large monetary calculations in sql server 6.5

    The calculations include float fields (for volumes and unit of measure conversions in product movements). I was wondering if the float being "approximate" could be the problem.

    IF it is, why would I want to store things as a float instead of a dec(28,14)?
    Is it faster to compute numbers stored as approximate binaries? Will we see a big performance hit if we switch some of the table`s field`s to decimals?

    Thanks in advance.
    Reply With Quote Reply With Quote
  2. 08-22-2003, 05:15 PM #2
    ppushpa
    ppushpa is offline Registered User
    Join Date
    Aug 2003
    Posts
    1
    did you get the answer, i have the same question
    Reply With Quote Reply With Quote
  3. 08-25-2003, 09:12 AM #3
    skhanal
    skhanal is offline Experts
    Join Date
    Nov 2002
    Location
    New Jersey, USA
    Posts
    3,932
    decimal uses more bytes than float to store data.

    SQL Server is not very efficient in numerical calculations. You should consider doing calculations in your middle tier/front end.
    Reply With Quote Reply With Quote
  4. 08-25-2003, 10:31 AM #4
    MAK's Avatar
    MAK
    MAK is offline Registered User
    Join Date
    Sep 2002
    Location
    Fantasy
    Posts
    4,254
    6.5 is not supported by MS.

    Does this happen even in SQL 2000 when you use decimal?
    My Site:http://www.mssqlengineering.com
    My Book:http://www.wiley.com/WileyCDA/WileyT...470477288.html
    Reply With Quote Reply With Quote
« Previous Thread | Next Thread »

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

Forum Rules