This article introduces the frequency structure matrix as a new representation of color filter arrays (CFAs). The matrix records the frequency components of CFA filtered images and their positions in the spectrum. The matrix can be conveniently obtained by applying the symbolic DFT to the CFA pattern. With this new representation, it is easy to analyze the characteristics of CFAs and to formulate the CFA design as an optimization problem.