There are much bigger drains on productivity than working from home.