Little effort - great effect
The grooved lantern glass should be free of grease and dust, so that the applied colour will stay on the glass for a long time.
Use glass & porcelain paint, this also adheres to smooth glass surfaces. Simply dab Chalky paint in blue with a sponge brush on the wide surfaces.
Put the candle into the Wind light - done!