List of Algorithms
A complete list of all major algorithms (300), in any domain. The goal is to provide a ready to run program for each one, or a description of the algorithm. Programming languages include Java, JavaScript and PHP, C, C++ either in direct form or generated from a Scriptol source.
 Automata
 Artificial intelligence
 Bioinformatics and cheminformatics
 Compression
 Cryptography
 Geometry
 Graphs
 Graphics
 Lists, arrays and trees
 Logic programming
 Mathematics
 Matrix processing
 Optic
 Optimization
 Parsing
 Prediction (statistics)
 Quantum
 Random number generators
 Sciences
 Signal processing
 Software engineering
 Memory allocation
 Distributed systems
 Operating systems algorithms (disk, scheduling...)
 Texts
 Utilities
 Misc
Automata
 Powerset construction. Algorithm to convert nondeterministic automaton to deterministic automaton.
 ToddCoxeter algorithm. Procedure for generating cosets.
Artificial intelligence
 Alphabeta. Alpha max plus beta min. Basic algo used to find the best move in board games.
 Antalgorithms. The ant colony optimisation is a set of algorithms inspired by ant behavior to solve a problem, find the best path between two locations.
 CLA. Cortical Learning Algorithm. For robotic learning, based on three properties, sparse distributed representation, temporal inference, onlinelearning. Code available through the NuPic project from Numenta.
 DE (Differential evolution). Solve the Chebyshev polynomial fitting problem, which applies to electronic filters.
 SemiSupervised Recognition of Sarcastic Sentences in Online Product Reviews.
Algorithm that recognize sacarsms or irony in a tweet or an online document. A such algorithm will be essential for humanoid robots programming too.  Sentiment analysis. Actually a combination of algos, naive Bayes, maximum entropy and SVM (Support Vector Machine classifieur).
Computer vision
 Epitome. Represent an image or video by a smaller one.
 Counting objects in an image. Uses the connectedcomponent labeling algorithm to first label each object, and count then the objects.
 Deep Dense Face Detector. Farafade, Saberian and Li. Able to recognize face even with different angles.
 EvolutionConstructed Features. Brigham Young University. For the ability to identify known objects and add new objects to the knowledge base without human intervention.
 O'Carroll algorithm. From a mathematical conversion of insect vision, this algorithm evaluates how to get around avoiding objects.
 TrackingLearning Detection. Detects moving objects and follows them.
 ViolaJones object detection framework, simple and fast. Able to recognize human faces, it is implemented in OpenCV.
Genetic algorithms
They uses three operator. selection (choose solution), reproduction (use choosen solutions to construct other ones), replacement (replace solution if better). Fitness proportionate selection. Also known as roulettewheel selection, is a function used for selecting solutions.
 Truncation selection. Another method for selecting solutions, ordered by fitness.
 Tournament selection. Select the best solution by a kind of tournament.
 Stochastic universal sampling. The individuals are mapped to contiguous segments of a line, such that each individual's segment is equal in size to its fitness exactly as in roulettewheel selection.
Neural networks
 Hopfield net. Recurrent artificial neural network that serve as contentaddressable memory systems with binary threshold units. They converge to a stable state.
 Backpropagation. Supervised learning technique used for training artificial neural networks.
 Selforganizing map (Kohonen map). Neural networks trained using unsupervised learning to produce low dimensional (2D, 3D) representation of the training samples. Good for visualizing highdimensional data.
Machine learning
 PAVA (PoolAdjacentViolators Algorithm). Leeuw, Hornik, Mair. Improve a function for a set of points. Optimize the isotonic regression. C++ code.
 Multiplicative Weights. Assigns weights to different strategy to make a decision. This applies to objects recognition and is found also in natural genetics.
Bioinformatics and Cheminformatics
 NeedlemanWunsch. Performs a global alignment on two sequences, for protein or nucleotide sequences.
 SmithWaterman. Variation of the NeedlemanWunsch.
 Ullmann's algorithm for subgraph isomorphism solving. (1976). Determine if two graphs have isomorphic subgraphs.
The maximum common subgraph isomorphism problem may be computed with a modular product graph.
Compression
Lossless compression algorithms
 BurrowsWheeler transform. Preprocessing useful for improving lossless compression.
 Deflate. Data compression used by ZIP.
 Delta encoding. Aid to compression of data in which sequential data occurs frequently.
 Incremental encoding. Delta encoding applied to sequences of strings.
 LZW. (LempelZivWelch). Successor of LZ78. Builds a translation table from the data to compress. Is used by the GIF graphical format.
 LZ77 and 78. The basis of further LZ variations (LZW, LZSS, ...). They are both dictionary coders.
 LZMA. Short for LempelZivMarkov chainAlgorithm.
 LZO. Data compression algorithm that is focused on speed.
 PPM (Prediction by Partial Matching). Adaptive statistical data compression technique based on context modeling and prediction.
 ShannonFano coding. Constructs prefix codes based on a set of symbols and their probabilities.
 Truncated binary. An entropy encoding typically used for uniform probability distributions with a finite alphabet. Improve binary encoding.
 Runlength encoding. Primary compression that replaces a sequence of same code by the number of occurences.
 Sequitur. Incremental grammar inference on a string.
 EZW (Embedded Zerotree Wavelet). Progressive encoding to compress an image into a bit stream with increasing accuracy. May be lossy compression also with better results.
 Zopfli. By Google, generic compression, efficient but slow. The name means small bread in swiss german.
 Brotli. By Google, successor to Zopfli but faster, based on LZ 77, entropy encoding and context modeling.
 Huffman coding. Simple lossless compression taking advantage of relative character frequencies.
 Adaptive Huffman coding. Adaptive coding technique based on Huffman coding.
 Arithmetic coding. Advanced entropy coding.
 Range encoding. Same as arithmetic coding, but looked at in a slightly different way.
 Unary coding. Code that represents a number n with n ones followed by a zero.
 Elias delta, gamma, omega coding. Universal code encoding the positive integers.
 Fibonacci coding. Universal code which encodes positive integers into binary code words.
 Golomb coding. Form of entropy coding that is optimal for alphabets following geometric distributions.
 Rice coding. Form of entropy coding that is optimal for alphabets following geometric distributions.
Entropy encoding
Coding scheme that assigns codes to symbols so as to match code lengths with the probabilities of the symbols .
Lossy compression algorithms
 Linear predictive coding. Lossy compression by representing the spectral envelope of a digital signal of speech in compressed form.
 Alaw algorithm. Standard companding algorithm.
 Mulaw algorithm. Standard analog signal compression or companding algorithm.
 Fractal compression. Method used to compress images using fractals.
 Transform coding. Type of data compression for data like audio signals or photographic images.
 Vector quantization. Technique often used in lossy data compression.
 Wavelet compression. Form of data compression well suited for image and audio compression.
Cryptography
Secret key (symmetric encryption)
Use a secret key (or a pair of directly related keys) for both decryption and encryption. Advanced Encryption Standard (AES), also known as Rijndael.
 Blowfish. Designed by Schneier as a generalpurpose algorithm, intended as a replacement for the aging DE.
 Data Encryption Standard (DES), formerly DE Algorithm.
 IDEA (International Data Encryption Algorithm). Formerly IPES (Improved PES), another replacement for DES. Is used by PGP (Pretty Good Privacy). Performs transformations on data splitted in blocks, using a key.
 RC4 or ARC4. Stream cipher widelyused in protocols such as SSL for Internet traffic and WEP for wireless networks.
 Tiny Encryption Algorithm. Easy to implement block cipher algorithme using some formulas.
 PES (Proposed Encryption Standard). Older name for IDEA.
Public key (asymmetric encryption)
Use a pair of keys, designated as public key and private key. The public key encrypt the message, only the private key permits to decrypt it. DSA (Digital Signature Algorithm). Generate keys with prime and random numbers. Was used by US agencies, and now public domain.
 ElGamal. Based on DiffieHellman, used by GNU Privacy Guard software, PGP, and other cryptographic systems.
 RSA (Rivest, Shamir, Adleman). Widely used in electronic commerce protocols. Use prime numbers.
 DiffieHellman (Merkle) key exchange (or exponential key exchange). Method and algorithm to share secret over an unprotected communications channel. Used by RSA.
 NTRUEncrypt. Make use of rings of polynomials with convolution multiplications.
Message digest functions
A message digest is a code resulting of the encryption of a string or data of any length, processed by a hash function. MD5. Used for checking ISO images of CDs or DVDs.
 RIPEMD (RACE Integrity Primitives Evaluation Message Digest). Based upon the principles of MD4 and similar to SHA1.
 SHA1 (Secure Hash Algorithm 1). Most commonly used of the SHA set of related cryptographic hash functions. Was designed by the NSA agency.
 HMAC. keyedhash message authentication.
 Tiger (TTH). Usually used in Tiger tree hashes.
Cryptographic using pseudorandom numbers
Techniques in cryptography
Secret sharing, Secret Splitting, Key Splitting, M of N algorithms. Shamir's secret sharing scheme. This is a formula based on polynomial interpolation.
 Blakley's secret sharing scheme. Is geometric in nature, the secret is a point in an mdimensional space.
Other techniques and decryption
 Subset sum. Given a set of integers, does any subset sum equal zero? Used in cryptography.
 Shor's algorithm. Quantum algorithm able to decrypt a code based on asymetric functions such as RSA.
Geometry
 Gift wrapping. Determining the convex hull of a set of points.
 GilbertJohnsonKeerthi distance. Determining the smallest distance between two convex shapes.
 Graham scan. Determining the convex hull of a set of points in the plane.
 Line segment intersection. Finding whether lines intersect with a sweep line algorithm.
 Point in polygon. Tests whether a given point lies within a given.
 Ray/Plane intersection.
 Line/Triangle intersection. Particular case of Ray/Plane intersection.
 Polygonization of implicit surfaces. Approximate an implicit surface with a polygonal representation.
 Triangulation. Method to evaluate the distance to a point from angles to other points, whose distance is known.
Graphs
 A* tree search. Search the optimal path between two nodes on a graph. Special case of bestfirst search that uses heuristics to improve speed.
 3D Surface Tracker Technology. Process to add images on walls in a video while hidden surfaces are taken into account.
 BellmanFord. Computes shortest paths in a weighted graph (where some of the edge weights may be negative).
 Graph canonization. Find a canonical form of a graph that is isomorphic to another graph. Used in cheminformatics.
 Dijkstra's algorithm. Computes shortest paths in a graph with nonnegative edge weights.
 Perturbation methods. An algorithm that computes a locally shortest paths in a graph.
 FloydWarshall. Solves the all pairs shortest path problem in a weighted, directed graph.
 Floyd's cyclefinding. Finds cycles in iterations.
 Johnson. All pairs shortest path algorithm in sparse weighted directed graph.
 Hopcroft–Karp algorithm. From a bipartite graph, returns the maximum number of edges with no common endpoints. Alternatives are breadthfirst and depthfirst algos.
 Kruskal. Finds a minimum spanning tree for a graph.
 Prim's. Finds a minimum spanning tree for a graph. Also called DJP , Jarník or Prim–Jarník algorithm.
 Boruvka. Finds a minimum spanning tree for a graph.
 FordFulkerson. Computes the maximum flow in a graph.
 EdmondsKarp. Implementation of FordFulkerson.
 Nonblocking Minimal Spanning Switch. For a telephone exchange.
 WoodhouseSharp. Finds a minimum spanning tree for a graph.
 Spring based. Algorithm for graph drawing.
 Hungarian. Algorithm for finding a perfect matching.
 Coloring algorithm. Graph coloring algorithm.
 Nearest neighbour. Find nearest neighbour.
 Topological sort. Sort a directed acyclic graph in such a manner that each node comes before all nodes to which it has edges (according to directions).
 Tarjan's offline least common ancestors algorithm. Compute lowest common ancestors for pairs of nodes in a tree.
Graphics
 Bresenham's line algorithm. Uses decision variables to plots a straight line between 2 specified points.
 Colorization. A process for coloring a picture or video in black and white, with a few strokes to mark the colors. Examples.
 Depixelizing Pixel Art. Smoothing algorithm that converts an image in coarse pixels into a realistic picture. (Johannes Kopf and Dani Lischinski). Demonstration. A C++ implementation.
 DDA line algorithm. Uses floatingpoint math to plots a straight line between 2 specified points.
 Flood fill. Fills a connected region with a color.
 HDR. There are many algorithms for contrasting photos.
 Xiaolin Wu's line algorithm. Line antialiasing.
 Painter's algorithm. Detects visible parts of a 3dimensional scenery.
 Ray tracing. Realistic image rendering.
 Phong shading. An illumination model and an interpolation method in 3D computer graphics.
 Gouraud shading. Simulate the differing effects of light and colour across the surface of a 3D object.
 Scanline rendering. Constructs an image by moving an imaginary line.
 Global illumination. Considers direct illumination and reflection from other objects.
 Interpolation. Constructing new data points such as in digital zoom.
 Resynthesizer. Remove an object on a photo and rebuild the background Used by Photoshop and The Gimp. Resynthesizer tutorial .
 Slopeintercept algorithm. It is an implementation of the slopeintercept formula for drawing a line.
 Spline interpolation. Reduces error with Runge's phenomenon.
 3D Surface Tracker Technology. Adding images or vidéo on walls in a vidéo, hidden surfaces being taken into account.
Lists, arrays and trees
Searching
 Binary search algorithm. Locates an item in a sorted list.
 Breadthfirst search. Traverses a graph level by level.
 Bestfirst search. Traverses a graph in the order of likely importance using a priority queue.
 Depthfirst search. Traverses a graph branch by branch.
 Dictionary search. See predictive search.
 Disjointset data structure and algorithm. With for application, building a maze.
 Hash table. Associate keys to items in an unsorted collection, to retrieve them in a linear time.
 Interpolated search. See predictive search.
 Median search. In an unordered list of numbers. Torben's algo is slower but does not modify the input array.
 Predictive search. Binary like search which factors in magnitude of search term versus the high and low values in the search.
 Selection algorithm. Finds the kth largest item in a list.
 Skip list. Structure composed of linked lists for a quicker access, and algorithm or search/insertion.
 Splay tree. Binary tree with a function to place a node at the root and reorganize other accordingly.
 Uniformcost search. A tree search that finds the lowest cost route where costs vary.
Sorting
 Binary tree sort. Sort of a binary tree, incremental, similar to insertion sort.
 Bogosort. Inefficient random sort of a desk card.
 Bubble sort. For each pair of indices, swap the items if out of order.
 Bucket sort. Split a list in buckets and sort them individually. Generalizes pigeonhole sort.
 Cocktail sort (or bidirectional bubble, shaker, ripple, shuttle, happy hour sort). Variation of bubble sort that sorts in both directions each pass through the list.
 Comb sort. Efficient variation of bubble sort that eliminates "turtles", the small values near the end of the list and makes use of gaps bewteen values.
 Counting sort. It uses the range of numbers in the list A to create an array B of this length. Indexes in B are used to count how many elements in A have a value less than i.
 Gnome sort. Similar to insertion sort except that moving an element to its proper place is accomplished by a series of swaps, as in bubble sort.
 Heapsort. Convert the list into a heap, keep removing the largest element from the heap and adding it to the end of the list.
 Insertion sort. Determine where the current item belongs in the list of sorted ones, and insert it there.
 Introsort. Or introspective sort. It begins in quicksort and switches to heapsort at certain recursion level.
 Merge sort. Sort the first and second half of the list separately, then merge the sorted lists.
 Pancake sort. Reverse elements of some prefix of a sequence.
 Pigeonhole sort. Fill an empty array with all elements of an array to be sorted, in order.
 Postman sort. Hierarchical variant of bucket sort, used by post offices.
 Quicksort. Divide list into two, with all items on the first list coming before all items on the second list.; then sort the two lists. Often the method of choice.
 Radix sort. Sorts keys associated to items, or integer by processing digits.
 Selection sort. Pick the smallest of the remaining elements, add it to the end of the sorted list.
 Shell sort. Improves insertion sort with use of gaps between values.
 Smoothsort. See heapsort.
 Stochastic sort. See bogosort.
 Tim sort. Analyse la liste à classer avant de choisir la procédure optimale. Sans doute le plus rapide et ne dépend pas de la taille de la liste. Analyze the list to be classified before choosing the optimal procedure. Probably the fastest and does not depend on the size of the list. Used internally by Java, Python, C++.
Merging
 Simple Merge. Merge n sorted streams into one output stream. All the stream heads are compared, and the head with the least key is removed and written to the output.
 kway Merge sort (or pway. A merge sort that sorts a data stream using repeated merges.
Logic programming
 Davis–Putnam algorithm. Checks the validity of a firstorder formula.
Mathematics
Algebra
 Buchberger's algorithm. Finds a Gräbner basis.
 Extended Euclidean algorithm. Solves the equation ax+by= c.
 Fourier transform multiplication. For very big numbers, computing the fast Fourier transforms for two numbers, and multiplying the two results entry by entry.
 GramSchmidt process. Orthogonalizes a set of vectors.
 GaussJordan elimination. Solves systems of linear equations.
 Karatsuba multiplication. Recursive algorithm efficient for big numbers. Derived from the ToomCook method.
 KnuthBendix completion. For rewriting rule systems.
 Multivariate division. For polynomials in several indeterminates.
 Risch algorithm. Translates indefinite integral to algebraic problem.
 ToomCook (Toom3). Splits each number to be multiplied into multiple parts.
Eigenvalue algorithm
Algorithms to find the Eigenvalue and/or Eigenvector of a matrix.
 QR algorithm. A popular method based on the QR decomposition.
 Inverse iteration. Iterative eigenvalue algorithm.
 Rayleigh quotient iteration. Extends the principle of the inverse iteration by using the Rayleigh quotient to obtain increasingly accurate eigenvalue estimates.
 Arnoldi iteration. Compute the eigenvalues of the orthogonal projection of A onto the Krylov subspace.
 Lanczos iteration. Method to find a zero vector in the process of the quadratic sieve.
 Jacobi method. Numerical procedure for the calculation of all eigenvalues and eigenvectors of a real symmetric. matrix
 Bisection.
 Divideandconquer. Apply to real symmetric matrices.
Eigenvector algorithms
 Richardson eigenvector algorithm.
 MaxPlus. Eigenvector algorithm for nonlinear H 1 control.
 Abrams and Lloyd eigenvector algorithm.
Arithmetic
 Binary GCD algorithm. Efficient way of calculating greatest common divisor.
 Booth's multiplication. Multiply two signed numbers in two's complement notation.
 Euclidean algorithm. Computes the greatest common divisor.
 Binary multiplication (Peasant or Egyptian multiplication). Decomposes the larger multiplicand into a sum of powers of two and creates a table of doublings of the second multiplicand.
Discrete logarithm in group theory
 Babystep giantstep. This is a series of well defined steps to compute the discrete logarithm.
 Pollard's rho algorithm for logarithms. Analogous to Pollard's rho algorithm for integer factorization but solves the discrete logarithm problem.
 PohligHellman algorithm. Solves the problem for a multiplicative group whose order is a smooth integer. Based on the Chinese remainder theorem and runs in polynomial time.
 Index calculus algorithm. Best known algorithm for certain groups, as the multiplicative group modulo m.
Integer factorization
Breaking an integer into its prime factors . Also named prime factorization.
 Fermat's factorization method. A representation of an odd integer as the difference of two squares.
 Trial division. The simplest of the integer factorization algorithms. Try to divide the integer n by every prime number.
 Lenstra elliptic curve factorization or elliptic curve factorization method (ECM). Fast, subexponential running time, employs elliptic curves.
 Pollard's rho . Variation of Pollard's p1 that is effective at splitting composite numbers with small factors.
 Pollard's p1. A specialpurpose algorithm, that is only suitable for integers with specific types of factors.
 Congruence of squares. Finding a congruence of squares modulo n is a mean to to factor the integer n.
 Quadratic sieve. Uses the idea of Dixon's method. It is a generalpurpose algorithm that is simpler than the number field sieve and the fastest for integers under 100 decimal digits.
 Dixon's factorization method. Generalpurpose integer factorization algorithm.
 Special number field sieve. Specialpurpose algorithm ideal for Fermat numbers.
 General number field sieve (GNS). Derived from special number field sieve. Efficient algorithm known for factoring big integers. Uses steps to factor the integer.
Prime test
Determining whether a given number is prime.
 AKS primality test (AgrawalKayalSaxena). The first published algorithm to be simultaneously polynomial, deterministic, and unconditional. Generalization of Fermat's theorem, extended to polynomials.
 Fermat primality test. Rely on an equality or set of equalities that hold true for prime values, and then see whether or not they hold for the number to test.
 MillerRabin primality test. Similar to the Fermat primality test. Unconditional probabilistic algorithm.
 Sieve of Eratosthenes. Ancient algorithm for finding all prime numbers up to a specified integer.
 Sieve of Atkin. Optimized version of the sieve of Eratosthenes.
 SolovayStrassen primality test. Same principle as the Fermat test.
Numerical
 Fibonacci. Calculating the sequence of Fibonacci.
 Biconjugate gradient method. Solves systems of linear equations.
 Dancing Links. Finds all solutions to the exact cover problem.
 De Boor algorithm. Computes splines.
 De Casteljau's algorithm. Computes Bezier curves.
 False position method. Approximates roots of a function.
 GaussLegendre. Computes the digits of pi.
 Kahan summation. A more accurate method of summing floatingpoint numbers.
 MISER. Monte Carlo simulation, numerical integration.
 Newton's method. Finds zeros of functions with calculus.
 Rounding functions. The classic ways to round numbers.
 Secant method. Approximates roots of a function.
 Shifting nthroot. Digit by digit root extraction.
 Square root. Approximates the square root of a number.
 Borwein's algorithm. Calculates the value of 1/e.
Statistics
 MetropolisHastings. Generate a sequence of samples from the probability distribution of one or more variables. Application: Light Transport.
Matrix processing
 Exponentiating by squaring. Quickly computes powers of numbers and matrices.
 Rutishauser. Algorithm for tridiagonalizing banded matrices. Uses the standard chasing step.
 Strassen algorithm. Faster matrix multiplication.
 Symbolic Cholesky decomposition. Efficient way of storing sparse matrix.
 Zha's algorithm. For tridiagonalizing arrowhead matrices, improves Rutishauser.
 Matrix chain multiplication. Given a sequence of matrices, we want to find the most efficient way to multiply these matrices together using dynamic programming (not to perform the multiplication).
Optic
 Gerchberg Saxton. algorithm for the determination of the phase from image and diffraction plane pictures.
Optimization
See also Graphs.
 Almost Linear Max Flow. An algorithm by Kelner, Tat Lee, Orecchia, Sidford for maximum flow considering all paths simultaneously.
 Ant colony optimization. Probabilistic technique for solving problems which can be reduced to finding good paths through graphs.
 BellmanFord. (1955). Calculates the shortest path between a vertex and all other vertices on a directed graph. Supports negative values unlike the Dijkstra's algorithm.
 BFGS (BroydenFletcherGoldfarbShanno method). Solves a unconstrained nonlinear optimization problem.
 Branch and bound. Method to find optimal solutions of discrete and combinatorial optimization problems.
 Conjugate gradient method. Iterative algorithm for the numerical solution of systems of linear equations, whose matrix is symmetric and positive definite.
 Evolution strategy. Technique based on ideas of adaptation and evolution. Operators are. mating selection, recombination, mutation, fitness function evaluation, and environmental selection.
 GaussNewton. An algorithm for solving nonlinear least squares problems.
 Gradient descent. Approaches a local minimum of a function by taking steps proportional to the negative of the gradient (or the approximate gradient) of the function at the current point.
 Gradient ascent. Approaches a local maximum of a function, as gradient descent but one takes steps proportional to the gradient.
 Hungarian (KuhnMunkre). Optimize the assignement of resources or jobs for the lesser cost.
 LevenbergMarquardt. Numerical solution to the problem of minimizing a sum of squares of several, generally nonlinear functions that depend on a common set of parameters.
 Line search. Iterative approaches to find a local minimum of an objective function in unconstrained optimization.
 Local search. Metaheuristic for solving hard optimization problems as maximizing a criterion among a number of candidate solutions.
 NelderMead method (downhill simplex method). A nonlinear optimization algorithm.
 Newton's method in optimization. The same algorithm to find roots of equations in one or more dimensions can also be used to find local maxima and local minima of functions.
 Optimal layout. Place the greatest number of objects in a limited area.
 Paxos. Set of distributed algorithms to achieve consensus among several proposals and many factors.
 PSO, Particle swarm optimization. Swarm intelligence modeled by particles in multidimensional space that have a position and a velocity.
 Randomrestart hill climbing. Metaalgorithm built on top of the hill climbing optimization algorithm.
 Simplex algorithm. An algorithm for solving the linear programming problem
 Simulated annealing. Generic probabilistic metaalgorithm for the global optimization problem, inspirated by annealing in metallurgy.
 Stable marriages or GaleShapley. It is used in economics, mathematics biology and other sciences. We want to couple a set x of elements incompatible with each other and a set of elements incompatible with each other so that each x finds the y that suits him best and vice versa.
 Steepest descent. see gradient descent.
 Stochastic tunneling. Approach to minimize a function based on the Monte Carlo methodsampling.
 Tabu search. optimization method of search algorithm by using memory structures.
 Trust search. Another iterative approaches to find a local minimum of an objective function in unconstrained optimization.
Parsing
 CYK (CockeYoungerKasami). An efficient O(n^{3}) algorithm for parsing any CNF contextfree grammar.
 Earley's algorithm. A chart parser, O(n^{3}) algorithm for parsing any contextfree grammar.
 Insideoutside. An O(n^{3}) algorithm for reestimating production probabilities in probabilistic contextfree grammars.
LL Parsers
Parse a LL contextfree grammar topdown from left to right.
Such as ANTLR that is LL(*).
LR Parsers
Bottomup parsers for contextfree grammars. Dijkstra's shunting yard algorithm is commonly used to implement operator precedence parsers which convert from infix notation to Reverse Polish notation (RPN).
 LALR (Lookahead LR). With a onetoken lookahead. Yacc/Bison use LALR(1)
 SLR (Simple LR) parser. An LR(0) modified to prevent shiftreduce and reducereduce conflits. Remains inferior to LR(1).
 Canonical LR parser or LR(1) parser. Has a lookahead of one token.
 GLR. (Generalyzed LR parser) by Masaru Tomita. An extension of an LR to handle nondeterministic or ambiguous grammars. It is efficient to parse natural language.
Recursive Descent Parsers
Topdown parsers built from a set of mutuallyrecursive procedures that represent the production rules of the grammar.
 Packrat parser. A linear time parsing algorithm supporting contextfree LL(k) grammars. Use backup and memoization (remembering its choices) to avoid nontermination.
Prediction (statistics)
 BaumWelch. Finds the unknown parameters of a Hidden Markov Model (HMM). It makes use of the forwardbackward algorithm.
 Viterbi. Calculates the Viterbi path, a sequence of states that is most luckily to appear in a sequence of event.
Quantum
Application of quantum computation to various categories of problems
 Grover's algorithm. Provides quadratic speedup for many search problems.
 Shor's algorithm. Provides exponential speedup for factorizing a number.
 DeutschJozsa. Criterion of balance for Boolean function.
(Pseudo) Random number generators
 Blum Blum Shub. Based on a formula on prime numbers.
 Mersenne twister. By Matsumoto Nishimura, fast and with high period.
 Lagged Fibonacci generator. Improvement of Linear congruential generator, uses the Fibonacci sequence.
 Linear congruential generator. One of oldest, not the best, use three numbers to generate a sequence.
 Yarrow algorithm. By Bruce Schneier, John Kelsey, and Niels Ferguson. Cryptographically secure pseudorandom numbers generator, can also be used as a real random number generator, accepting random inputs from analog random sources.
 Fortuna. Allegedly an improvement on Yarrow algorithm.
 Linear feedback shift register. A shift register whose input bit is a linear function of its previous state. The first state is the seed.
Sciences
Astronomy
 Ephemerides.
 Positions of Moon or other celestial objects.
 Julian day. Number of days that have elapsed since Monday, January 1, 4713 BC in the proleptic Julian calendar. The algorithm is a formula. Variations are: heliocentric, chronological, modified, reduced, truncated, Dublin Lilian julian day.
 Julian date. The Julian day, not rounded, decimal fraction.
Medical
 Computation useful in healthcare.
 Help to diagnosis.
Signal processing
 CORDIC. Fast trigonometric function computation technique.
 Rainflowcounting algorithm. Reduces a complex stress history to a count of elementary stressreversals for use in fatigue analysis.
 Osem. Algorithm for processing of medical images.
 Goertzel algorithm. Can be used for DTMF digit decoding.
 Discrete Fourier transform. Determines the frequencies
contained in a (segment of a) signal.
 Fast Fourier transform
 CooleyTukey FFT
 Rader's FFT
 Bluestein's FFT
 Bruun's FFT
 Primefactor FFT
 RichardsonLucy deconvolution. Image deblurring algorithm.
 Elser DifferenceMap. XRay diffraction microscopy.
 Shazam. Recognition of a song by comparing signals and detecting what is unique.
Software engineering
 Algorithms for Recovery and Isolation Exploiting Semantics. Recovery.
 Unicode Collation. Provides a standard way to put names, words or strings of text in sequence.
 CHS conversion. Converting between disk addressing systems.
 Cyclic redundancy check. Calculation of a check word.
 Parity control. Simple/fast error detection technique. Is a number even or odd?
Memory allocation
 Boehm garbage collector. Conservative garbage collector.
 Buddy memory allocation. Algorithm to allocate memory such that fragmentation is less.
 Generational garbage collector. Fast garbage collectors that segregate memory by age.
 Mark and sweep.
 Reference counting. Simple memory manager that counts links to data and reclaims the space when the count is zero.
Distributed systems
 Lamport ordering. A partial ordering of events based on the happenedbefore relation.
 Snapshot. A snapshot is the process of recording the global state of a system.
 Vector clocks. A total ordering of events.
 Marzullo. Distributed clock synchronization.
 Intersection. Another clock agreement algorithm.
Operating systems algorithms
 Banker. Algorithm used for deadlock avoidance.
 Page replacement. Selecting the victim page under low memory conditions.
 Bully. Selecting new leader among many computers.
Disk scheduling algorithms.
 Elevator. Disk scheduling algorithm that works like an elevator.
 Shortest seek first. Disk scheduling algorithm to reduce seek time.
Process synchronisation algorithms.
 Peterson. Allows two processes to share a singleuse resource without conflict, using shared memory for communication. Can be generalized.
 Lamport's Bakery algorithm. Improve the robustness of multiple threadhandling processes by means of mutual exclusion.
 Dekker. Another concurrent programming algorithm, as the Peterson's one.
Scheduling algorithms
 Earliest deadline first scheduling. When an event occurs (end of task, new task released, etc.) the queue will be searched for the process closest to its deadline.
 Fairshare scheduling. Sharing cpu time between groups and users in groups. Another algorithm is called recursively to manage sharing of processes.
 Least slack time scheduling or Least Laxity First. Assigns priority based on the slack time (difference between the deadline, ready and run time) of a process.
 List scheduling. From an ordered list of processes with priorities, assign first to highest priority the available resources. Possible strategies: critical path, longest path, highest level first, longest processing time.
 Multi level feedback queue.
 Ratemonotonic scheduling. Optimal, preemptive, staticpriority scheduling algorithm. Priority given in rate monotonic principle (first deadline is first processed).
 RoundRobin scheduling. Simplest algorithm, assigns time slices to each process without priority.
 Shortest job next (or first). Executes next the waiting process with the smallest execution time, is nonpreemptive.
 Shortest remaining time. A version of shortest job next scheduling that terminates the running process before to choose another task.
Texts
Searching
 AhoCorasick. Search in a text by building a table from words.
 Bitap (or shiftor, shiftand, BaezaYatesGonnet). Fuzzy string searching algorithm developed by Udi Manber and Sun Wu.
 BoyerMoore string search. Search in text by skipping substring not containing letters in the searched input.
 Burrows Wheeler transform. String transformation that may be used to search words in a text faster.
 KnuthMorrisPratt. Build a table when searching to skip substring.
 RabinKarp string search. Use hashing for multiple searches.
 Longest common subsequence problem. Haskell's algorithm. Of two sequences.
 Longest increasing subsequence problem. Of two sequences. It also reduces to find the longest path in a directed acyclic graph.
 Shortest common supersequence. Of two sequences.
 Horspool. Simplification of the BoyerMoore algorithm. O(mn).
Approximate matching
 Levenshtein distance (or edit distance). Minimum number of operations (insertion, deletion, replacement) needed to transform one string into the other.
 Soundex. Phonetic algorithm for indexing words by their sound (in English).
 Metaphone. Indexing words by their sound (in English).
 NYSIIS. (New York State Identification and Intelligence System). Phonetic algorithm that improves soundex.
Word processing
 Latent Dirichlet Allocation (LDA). Analysis of documents to associate the content with a topic. Used by search engines.
 Latent Semantic Indexing (LSI). Automation of methods to attach a text to a topic from the words that occur commonly in this context.
 Stemming. A method of reducing words to their stem, or root form.
Utilities
 Doomsday. Day of the week.
 Xor swap. Swaps the values of two variables without using a buffer by xoring the values.
 Hamming weight. Find the number of 1 bits in a binary word.
 Luhn. A checksum formula for validating identification numbers such as creditcard numbers.
 Create bit mask. Bit manipulation algorithms.
Misc.
 BrowseRank. Alternative to PageRank based on users behavior.
 Hypertext Induced Topic Selection (HITS, patent in 1997). Algorithm for scoring Web pages, by Jon Kleinberg. One score depends upon backlinks, the other one is based on external links.
 Leaf shape. From 28 parameters, the GrowthAlgorithm Model of Leaf Shape can reproduce all the shape of real leaves found in the nature.
 PageRank. (1998) Algorithm of scoring by Larry Page and Sergey Brin (Google), using backlinks and external links. The score of a Web page depends also to various other criteria.
 SchreierSims. For permutation groups. A method of computing a Base and Strong Generating Set (BSGS) of a permutation group. Used by algebra algorithms.
 RobinsonSchensted. Combinatorial algorithm.
Links
Legal: You are free to print and distribute a printed version of this page. Don't put it on another website, put a link on it instead.
Last update: March 16, 2021.
Tweet 
