{"id":1957,"date":"2025-11-02T08:36:49","date_gmt":"2025-11-02T08:36:49","guid":{"rendered":"https:\/\/www.mathros.net.ua\/en\/?p=1957"},"modified":"2025-11-06T11:23:26","modified_gmt":"2025-11-06T11:23:26","slug":"method-of-successive-approximations","status":"publish","type":"post","link":"https:\/\/www.mathros.net.ua\/en\/method-of-successive-approximations.html","title":{"rendered":"Method of Successive Approximations: A Simple Way to Solve Hard Equations"},"content":{"rendered":"<p>Method of successive approximations is a convenient tool for finding roots of nonlinear equations when an exact analytical solution is difficult or impossible to obtain. The idea is simple: we build a sequence of approximations, each one refining the previous value, and step by step we move toward the desired answer. This approach works well in learning because it shows the logic of calculations and creates a foundation for mastering more powerful techniques. In this article, we focus on the fixed-point idea, the conditions for convergence, and practical iteration choices so that we can confidently move on to examples.<\/p>\n<h2>Method of Successive Approximations: Fixed Point and the Iterative Process<\/h2>\n<p>Let\u2019s start by reformulating the problem. The equation <em>f(x)=0<\/em> is conveniently written in the form <em>x=\u03c6(x)<\/em>. A solution in this case is a number <em>\u03be<\/em> for which <em>\u03be=\u03c6(\u03be)<\/em> holds; the point <em>\u03be<\/em> is called a fixed point of the transformation <em>\u03c6(x)<\/em>.<\/p>\n<p>Next, we run iterations from an initial guess <em>x<sub>0<\/sub><\/em>:<\/p>\n<p><img decoding=\"async\" class=\"aligncenter wp-image-10026185 size-full\" src=\"https:\/\/www.mathros.net.ua\/en\/wp-content\/uploads\/2025\/11\/method-of-successive-approximations1.jpg\" alt=\"Method of successive approximations formula\" width=\"149\" height=\"14\" \/><\/p>\n<p>To keep computations stable, we work on an interval <em>[a,b]<\/em> where we expect the root and make sure all approximations stay inside this interval. The decisive factor is how <em>&#8220;contractive&#8221;<\/em> <em>\u03c6(x)<\/em>: is: if on <em>[a,b]<\/em><\/p>\n<p><img decoding=\"async\" class=\"aligncenter wp-image-10026186 size-full\" src=\"https:\/\/www.mathros.net.ua\/en\/wp-content\/uploads\/2025\/11\/method-of-successive-approximations2.jpg\" alt=\"Method of successive approximations convergence condition\" width=\"132\" height=\"16\" \/><\/p>\n<p>then the fixed point is unique, and the sequence <em>{x<sub>k<\/sub>}<\/em> converges to <em>\u03be<\/em>. A smaller <em>q<\/em> usually means the error shrinks faster from step to step. In practice, <em>q<\/em> is often estimated approximately: we evaluate the derivative numerically at several points in the interval and take the largest absolute value among those results.<\/p>\n<h2>Building the Formula and Choosing the Parameter: How to Achieve Convergence<\/h2>\n<p>A convenient way to construct the transformation is the relaxation formula<\/p>\n<p><img decoding=\"async\" class=\"aligncenter wp-image-10026188 size-full\" src=\"https:\/\/www.mathros.net.ua\/en\/wp-content\/uploads\/2025\/11\/method-of-successive-approximations3.jpg\" alt=\"Method of successive approximations formula\" width=\"103\" height=\"14\" \/><\/p>\n<p>where the parameter <em>\u03bb&gt;0<\/em> sets the <em>&#8220;step length&#8221;<\/em>. If <em>\u03bb<\/em> is too large, the progress becomes unstable and may break convergence; if it\u2019s too small, the march toward the solution slows down. To keep steps under control, we link the choice of <em>\u03bb<\/em> to the behavior of <em>f'(x)<\/em> on the working interval. If<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-10026189 size-full\" src=\"https:\/\/www.mathros.net.ua\/en\/wp-content\/uploads\/2025\/11\/method-of-successive-approximations4.jpg\" alt=\"Method of successive approximations convergence condition\" width=\"144\" height=\"16\" \/><\/p>\n<p>then <em>\u03c6(x)<\/em> is a contracting transformation and the iterations converge. In practice, it helps to estimate <em>M=max<sub>x\u2208[a,b]<\/sub>|f'(x)|<\/em> and take <em>\u03bb<\/em> within <em>(0,2\/M)<\/em>. A common practical choice is <em>\u03bb\u22481\/M<\/em>: the step is moderate yet sufficient to maintain stable convergence.<\/p>\n<p>We usually stop the process when <em>|x<sub>k+1<\/sub>-x<sub>k<\/sub>|&lt;\u03b5<\/em>, where <em>\u03b5<\/em> is the desired accuracy. If, in addition, <em>|\u03c6'(x)|\u2264q&lt;1<\/em> is known, the following a posteriori estimate is useful:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-10026191 size-full\" src=\"https:\/\/www.mathros.net.ua\/en\/wp-content\/uploads\/2025\/11\/method-of-successive-approximations5.jpg\" alt=\"Method of successive approximations convergence condition\" width=\"156\" height=\"28\" \/><\/p>\n<p>which allows you to estimate the distance to the true root <em>x<sup>\u2217<\/sup><\/em> using the last two iterates and a known (or approximately estimated) constant <em>q<\/em>. If convergence slows down or oscillations appear, it\u2019s worth adjusting <em>\u03bb<\/em> or changing the form of <em>\u03c6(x)<\/em> to reduce the effective <em>q<\/em> and bring the iterations back to a stable regime. This is a natural tuning cycle: estimate the derivative, choose <em>\u03bb<\/em>, check convergence, tweak the parameters, and continue computing until the required accuracy is reached.<\/p>\n<h2>Method of Successive Approximations: Practice on an Example \u2014 Full Calculation<\/h2>\n<p>Now that we understand the basics, let\u2019s see how the method of successive approximations works on a concrete example. While theory matters, a hands-on calculation gives the best sense of how effective and accurate the approach is. We\u2019ll go through the task from start to finish to see how to obtain an approximate solution step by step.<\/p>\n<h6>Example 1. Find, with accuracy \u03b5=0.01, the solution of the nonlinear equation f(x)=x<sup>3<\/sup>+x-5=0 on the interval [-2,2]<\/h6>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-10026197 size-full\" src=\"https:\/\/www.mathros.net.ua\/en\/wp-content\/uploads\/2025\/11\/method-of-successive-approximations8.jpg\" alt=\"Visualization of f(x) and its derivative over the interval [-2,2]\" width=\"600\" height=\"350\" \/><\/p>\n<p>On the segment <em>[-2,2]<\/em> we have <em>f(-2)=-15&lt;0<\/em> and <em>f(2)=5&gt;0<\/em>, so there is at least one root. We will build iterations using the relaxation form <em>\u03c6(x)=x-\u03bb\u22c5f(x)<\/em>. The derivative <em>f'(x)=3\u22c5x<sup>2<\/sup>+1<\/em> on <em>[-2,2]<\/em> satisfies <em>1\u2264f'(x)\u226413<\/em>. Therefore, we take <em>M=max<sub>\u2208[-2,2]<\/sub>|f'(x)|=13<\/em> and choose <em>\u03bb=1\/M=1\/13\u22480.077<\/em>. Then the iterative process is<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-10026214 size-full\" src=\"https:\/\/www.mathros.net.ua\/en\/wp-content\/uploads\/2025\/11\/method-of-successive-approximations10.jpg\" alt=\"Method of successive approximations example\" width=\"181\" height=\"16\" \/><\/p>\n<p>Start the computations from the initial guess <em>x<sub>0<\/sub>=-2<\/em>. We get:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-10026195 size-full\" src=\"https:\/\/www.mathros.net.ua\/en\/wp-content\/uploads\/2025\/11\/method-of-successive-approximations7.jpg\" alt=\"Method of successive approximations example\" width=\"602\" height=\"501\" \/><\/p>\n<p>The stopping criterion is satisfied on the transition from <em>x<sub>11<\/sub><\/em> to <em>x<sub>12<\/sub><\/em>, because <em>|x<sub>12<\/sub>\u200b-x<sub>11<\/sub>|=0.005&lt;0.01<\/em>. Therefore, we can finish the calculations, and the approximate solution with the stated accuracy is <em>x=1.513<\/em>. This result is consistent with the behavior of the function on the given interval and shows how a well-chosen parameter <em>\u03bb<\/em> ensures stable convergence of the iterations to the root.<\/p>\n<h2>Next Level: Three Tools for Confident Decisions<\/h2>\n<p>You\u2019ve already felt the logic of the method in practice. Now let\u2019s expand the toolkit and see what to master next to work with nonlinear <a title=\"What is equation\" href=\"https:\/\/en.wikipedia.org\/wiki\/Equation\" target=\"_blank\" rel=\"nofollow noopener\">equations<\/a> faster, more reliably, and more flexibly.<\/p>\n<ol>\n<li><a title=\"Bisection method\" href=\"https:\/\/www.mathros.net.ua\/en\/bisection-method.html\">Bisection Method: Guaranteed Convergence without Unnecessary Complications<\/a> \u2014 It narrows the interval step by step, ensuring a predictable move toward the root and transparent accuracy control at every stage.<\/li>\n<li><a title=\"Newton\u2019s method\" href=\"https:\/\/www.mathros.net.ua\/en\/newtons-method.html\">Newton\u2019s Method: Maximum Speed with a Good Starting Point<\/a> \u2014 It uses tangent-based approximation to rapidly reduce the error when the initial guess is chosen well and the function behaves stably.<\/li>\n<li><a title=\"Secant method\" href=\"https:\/\/www.mathros.net.ua\/en\/secant-method.html\">Secant (Chord) Method: Reliable Approximation without Derivatives<\/a> \u2014 Instead of the tangent, it uses the line segment between two points on the graph, allowing stable steps even when computing derivatives is impractical or impossible.<\/li>\n<\/ol>\n<h2>Final Stage: The Flowchart Becomes a Program<\/h2>\n<p>If you enjoy combining mathematics with programming, try turning the flowchart below into code. See how successive updates gradually bring you closer to the root. You\u2019ll feel the logic of the process, be able to experiment with initial values, and compare the speed of convergence with other approaches. In practice, you\u2019ll see why a clear algorithm structure is important for a stable result. Isn\u2019t it interesting to test this on your own examples and watch your program confidently produce the answer?<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-10026201 size-full\" src=\"https:\/\/www.mathros.net.ua\/en\/wp-content\/uploads\/2025\/11\/method-of-successive-approximations9.jpg\" alt=\"Flowchart of the algorithm for solving nonlinear equations using the method of successive approximations\" width=\"600\" height=\"432\" \/><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Method of successive approximations is a convenient tool for finding roots of nonlinear equations when an exact analytical solution is<\/p>\n","protected":false},"author":1,"featured_media":1958,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"template-centered.php","format":"standard","meta":{"footnotes":""},"categories":[390],"tags":[129,405,399,134,398],"class_list":["post-1957","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-numerical-methods-for-solving-single-variable-equations","tag-iterative-methods","tag-method-of-successive-approximations","tag-nonlinear-equations","tag-numerical-methods","tag-root-finding"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.mathros.net.ua\/en\/wp-json\/wp\/v2\/posts\/1957","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.mathros.net.ua\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.mathros.net.ua\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.mathros.net.ua\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.mathros.net.ua\/en\/wp-json\/wp\/v2\/comments?post=1957"}],"version-history":[{"count":1,"href":"https:\/\/www.mathros.net.ua\/en\/wp-json\/wp\/v2\/posts\/1957\/revisions"}],"predecessor-version":[{"id":1959,"href":"https:\/\/www.mathros.net.ua\/en\/wp-json\/wp\/v2\/posts\/1957\/revisions\/1959"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.mathros.net.ua\/en\/wp-json\/wp\/v2\/media\/1958"}],"wp:attachment":[{"href":"https:\/\/www.mathros.net.ua\/en\/wp-json\/wp\/v2\/media?parent=1957"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.mathros.net.ua\/en\/wp-json\/wp\/v2\/categories?post=1957"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.mathros.net.ua\/en\/wp-json\/wp\/v2\/tags?post=1957"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}