One Rule at a Time