No, it won't affect your rankings, but it wouldn't hurt to leave your site up on the old host for about a month. This ensures that the DNS propagates across the Web and that the search spiders are indexing the pages at the new host. Once you see the spiders in your log files at the new host, it should be safe to take down the site at the old server.