Yup! I had a 10 swarm adventure this last spring, two of the swarms acted just like that. In my opinion, if the bees actually landed and clustered outside of the hive, and then within an hour or two went back to the hive, the queen didn't go with them for whatever reason.
My question is, how many days went by between the split and the swarm?