We provide a new perspective on Takens' Theorem from the theory of dynamical systems to investigate the importance of path dependent modelling in Finance and Machine Learning. We also provide some insight on the construction of architectures from the point
of view of invariant theory.