Sam and Aaron Taylor-Johnson didn’t get criticism of their 24-year age gap