It's really a chanson that recounts the thoughts of a lower-course "Lady with the port" (fille du port, Possibly a prostitute) who develops a crush on an elegantly attired obvious higher-class British traveller (or "milord"), whom she has found strolling the streets of your town many occasions (with an attractive youthful lady on his arm), but who