Media Summary: Logistics, course topics, basic tail bounds (Markov, Chebyshev, Chernoff, Bernstein), Morris' External memory model: linked list, matrix multiplication, B-tree, buffered repository tree, sorting. Distinct elements, k-wise independence, geometric subsampling of streams.
Algorithms For Big Data Compsci 229r Lecture 1 - Detailed Analysis & Overview
Logistics, course topics, basic tail bounds (Markov, Chebyshev, Chernoff, Bernstein), Morris' External memory model: linked list, matrix multiplication, B-tree, buffered repository tree, sorting. Distinct elements, k-wise independence, geometric subsampling of streams. Khintchine, decoupling, Hanson-Wright, proof of distributional JL lemma. Oblivious subspace embeddings, faster iterative regression, sketch-and-solve regression. Approximate matrix multiplication with Frobenius error via sampling / JL, matrix median trick, subspace embeddings.
Communication complexity (indexing, gap hamming) + application to median and F0 lower bounds. Amnesic dynamic programming (approximate distance to monotonicity). Low-rank approximation, column-based matrix reconstruction, k-means, compressed sensing. Linear least squares via subspace embeddings, leverage score sampling, non-commutative Khintchine, oblivious subspaceĀ ... RIP and connection to incoherence, basis pursuit, Krahmer-Ward theorem. ORS theorem (distributional JL implies Gordon's theorem), sparse JL.
