I only wear dresses and skirts so I have to say both. When it's a casual day, I usually wear skirts. Usually for dates or more "professional" days I wear my fancy dresses.
I'm very much a tomboy but I do have a few skirt/dress items. Rarely wear them though - I save them for special occasions, like a date with my partner or for a friend's party, stuff like that.