A ballot measure that proposes putting a Life Time fitness center in a residential area is stirring up controversy in Poway.