The conventional theory about the origin of the state is that the adoption of farming led to an increase in productivity, which led to food surplus. Food surplus is held to be a prerequisite for the emergence of hierarchical societies and eventually states. We challenge this theory and propose that hierarchy arose due to the shift to dependence on appropriable cereal grains. Our empirical investigation, utilizing multiple data sets spanning several millennia, demonstrates a causal effect of the cultivation of cereals on hierarchy, without finding a similar effect for land productivity. We present several case studies that further support our claims.