# Householder’s Method

Householder’s method of order dd to solve f(x)=0f(x)=0 has rate of convergence d+1d+1:

xx+d(1/f)(d1)(x)(1/f)(d)(x)=:Hd(x)x \to x + d \frac{(1/f)^{(d-1)}(x)}{(1/f)^{(d)}(x)} =: H_d(x)

d=1d=1 corresponds to Newton’s method.

Using (wx)Maxima:

H(d, x) := factor(ratsimp(x + d *
    (diff(1/f(x), x, d - 1)) / (diff(1/f(x), x, d))));

# 1 General f(x)f(x)

H1(x)=xf(x)f(x) H_1(x) = x - \frac{f(x)}{f'(x)}

H2(x)=x1f(x)f(x)f(x)2f(x) H_2(x) = x - \frac{1}{\frac{f'(x)}{f(x)} - \frac{f''(x)}{2 f'(x)}}

H3(x)H_3(x) is getting complicated…

# 2 Reciprocal Square Root

x=1ax = \frac{1}{\sqrt{a}}

can be rearranged to

f(x)=x2a=0f(x) = x^{-2} - a = 0

Using (wx)Maxima:

f(x) := x^(-2) - a;
H(1, x);
H(2, x);
H(3, x);
H(4, x);

Gives

H1(x)=(3ax2)x2H2(x)=(3+ax2)x3ax2+1H3(x)=a2x4+6ax2+14ax(ax2+1)H4(x)=x(a2x4+10ax2+5)5a2x4+10ax2+1\begin{aligned} H_1(x) &= \frac{(3 - a x^2)x}{2} \\ H_2(x) &= \frac{(3 + a x^2)x}{3 a x^2 + 1} \\ H_3(x) &= \frac{a^2x^4 + 6ax^2 + 1}{4ax(ax^2+1)} \\ H_4(x) &= \frac{x(a^2x^4 + 10ax^2 + 5)}{5a^2x^4 + 10ax^2 + 1} \\ \end{aligned}

Expected number of steps for NN digit accuracy is logNlog(d+1)\frac{\log N}{\log (d+1)}

Cost in terms of cost MM of high precision multiplication or division, assuming aa is low precision exact and that addition and low precision multiplication can be neglected:

cost(H1)=2log2Mlog(N)cost(H2)=3log3Mlog(N)cost(H3)=4log4Mlog(N)cost(H4)=4log5Mlog(N)\begin{aligned} \operatorname{cost}(H_1) = \frac{2}{\log 2} M \log(N) \\ \operatorname{cost}(H_2) = \frac{3}{\log 3} M \log(N) \\ \operatorname{cost}(H_3) = \frac{4}{\log 4} M \log(N) \\ \operatorname{cost}(H_4) = \frac{4}{\log 5} M \log(N) \\ \end{aligned}

Cost assuming aa is high precision:

cost(H1)=3log2Mlog(N)cost(H2)=4log3Mlog(N)cost(H3)=5log4Mlog(N)cost(H4)=5log5Mlog(N)\begin{aligned} \operatorname{cost}(H_1) = \frac{3}{\log 2} M \log(N) \\ \operatorname{cost}(H_2) = \frac{4}{\log 3} M \log(N) \\ \operatorname{cost}(H_3) = \frac{5}{\log 4} M \log(N) \\ \operatorname{cost}(H_4) = \frac{5}{\log 5} M \log(N) \\ \end{aligned}

These are decreasing with higher dd, indicating that the extra complexity is worthwhile.

# 3 Iterated Quadratic Polynomial

f(z)=z2+cf(z) = z^2 + c

MM cost of high precision real multiplication or division.

Complex squaring costs 3M3 M, complex multiplication 4M4 M.

Cost of iteration is proportional to iteration count PP:

Cost of ff: 3MP3 M P

Cost of ff': 4MP4 M P

Cost of ff'': 7MP7 M P

Cost of the additional algebra in HdH_d does not depend on PP so is negligible.

Hence:

Cost of H1H_1: 7log2MPlogN10.1MPlogN\frac{7}{\log 2} M P \log N \approx 10.1 M P \log N

Cost of H2H_2: 14log3MPlogN12.7MPlogN\frac{14}{\log 3} M P \log N \approx 12.7 M P \log N

These are increasing with higher dd, indicating that the extra complexity is not worthwhile.