This work draws on previous works regarding spectral learning algorithm for structured data (see [5], [9], [2], [1], [8]). We present an extension of the Hidden Markov Models, called Graphical Weighted Models (GWM), whose purpose is to model distributions over labeled graphs. We describe the spectral algorithm for GWM, which generalizes the previous spectral algorithms for sequences and trees. ...