While it’s rude to have your elbows on the table, it’s also rude to have your hands in your lap. If you have enough crumbs in your napkin, it’d be considered playing with your food.