We introduce a set of operations that we call crystal operations on matrices with entries either in {0, 1} or in N. There are horizontal and vertical forms of these operations, which commute with each other, and they give rise to two different structures of a crystal graph of type A on these sets of matrices. They provide a new perspective on many aspects of the RSK correspondence and its dual,...