Modern astronomy as a field of inquiry may be shaped by what we consider the "scientific" ways of knowing. However, the history of astronomy as a human endeavour dates back millennia before the "modern" notions of "science". This long history means that astronomy is, at its core, built on a rich cultural diversity and history. This offers a rich potential that, while having been examined in various studies, has yet to be explored from a contextual pedagogical perspective. This paper offers an initial exploratory theoretical perspective on how social semiotics can be used to inform a conceptual framework. This approach not only brings notions of culture into the teaching and learning of astronomy but uses culture as the starting point in a way that does justice to the cultural diversity of the discipline and the world. In doing so, this paper develops two frameworks: (i) the Conceptual Framework for Culture in Astronomy Education and (ii) the Pedagogical Framework for Culture in Astronomy Education, both of these offer a novel approach to astronomy education.