How about tax return if uber/lyft isn't your main job?
You might get screwed up paying more tax?
Wear and tear of your vehicle, and insurance cancellation if you meet some incident while doing uber/lyft are the other possible losses.
I would say its better enjoy the off time, or enhance skills rather than being independent contractor.