Bringing it down to the level of individual tasks misses the point of the commandment, which is a day off of work.
This is basically the problem the Pharisees and Essenes had - they wanted to judge every individual task as to whether it counted as labor or not, and then prohibit it for Sabbath. Embarrassingly, one group of Essenes even prohibited pooping on the Sabbath. Seems to me like holding it all day is a lot more work.
I mean, there's your personal answer. But for many, church has become a myriad of tasks - good works, I'm sure - but they still subvert the day of rest into a day of labors.