Will Hardik Patel's exit prove costly for Congress?