1

awk high precision arithmetic

view story
linux-howto

http://unix.stackexchange.com – I am looking for a way to tell awk to do high-precision arithmetic in a substitution operation. This involves, reading a field from a file and substituting it with a 1% increment on that value. However, I am losing precision there. Here is a simplified reproduction of the problem: $ echo 0.4970436865354813 | awk '{gsub($1, $1*1.1)}; {print}' 0.546748 Here, I have a 16 digit after decimal precision but awk gives only six. Using printf, I am getting the same result: $ echo 0.4970436865354813 | awk '{gsub($1, $1*1.1)}; {printf("%.16G\n", $1)}' 0.546748 Any suggestions on to how to get t (HowTos)

missing's picture
Submitted by missing on 11/29/2012

Stories similar to awk high precision arithmetic

Printing float values in C 32 weeks 5 days ago

Hi,

I have small problem to print float value in the fallowing code

Code: float Cx, W,f=250000, Cr=92.00,pi=3.14;

W=2*pi*f; Cx = 1/W.Cr;  //Cx value will be come around like 7.07E-9. printf("capacitance value: %.10f",Cx); I am trying to print Cx value using above code but it was not printing like that, the value i am getting when i tried to print Cx value using above

Joystick using Fedora 17 27 weeks 2 days ago

installed kernel-modules-extra & joystick...but when i jscal -c

Code: [HMSS013@Phenom ~]$ jscal -c /dev/input/js0 Joystick has 28 axes and 112 buttons. Correction for axis 0 is none (raw), precision is 0. Correction for axis 1 is none (raw), precision is 0. Correction for axis 2 is none (raw), precision is 0. Correction for axis 3 is none (raw), precision is 0. Correction for ax

I know awk can do text/string substitution with sub() and gsub() like:

kent$ echo "fffff"|awk '{gsub("f", "b")}1' bbbbb

or

kent$ echo "fffff"|awk '{gsub(/f/, "b")}1' bbbbb

However today I made a typo mistake, I wrote the line as:

echo "fffff"|awk '{gsub('f', "b")}1'

and awk didn't complain about that but generated output as usual, of course, unexpected output, it took me sometime to find

How can I get high precision memory usage per proccess with "ps aux"?

$ ps aux USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND root 1 0.0 0.0 3672 1984 ? Ss Dec11 0:07 /sbin/init root 2 0.0 0.0 0 0 ? S Dec11 0:00 [kthreadd] root 3 0.0 0.0 0 0 ?

info on precision time protocol 2 years 40 weeks ago

Hi,

Can someone help me with info on precision time protocol (ptpd) ? Some examples of implementation and documentation will be helpful. Also how is its performance as compared to ntpd in terms of precision ?

When I run the time command in shell time ./myapp I get an output like the following:

real 0m0.668s user 0m0.112s sys 0m0.028s

However,when I run the command \time -f %e ./myapp I lose precision and I get:

2.01s

If I use the %E command I also lose precision in the same way.

Dell (NASDAQ: DELL) is turning up the heat in the competitive high-performance notebook market with a line of Precision mobile workstations aimed at engineering and design professionals on the go. The M4700, Dell’s 15-inch notebook, and the 17-inch M6700 offer Intel Core i5, i7 and Extreme Edition processors with Turbo Boost Technology, Nvidia Quadro K-series GPUs and AMD FirePro graphics. The sta

I'm brand new to this forum (doesn't mean I didn't used it before) but today I've a very important question with wich I found no help on the web. I've a Bash script that doesn't work and I don't know why...

I am thinking (constantly) how to make my server be synchronised better than it is. I run some cheap app which syncs me with some stratum 2 server on the colo and drift is about 1-2 ms per 10 sec (when the box is not too busy). I want better precision and I want my own clock.