We introduce an approach to optimize a machine translation (MT) system on multiple metrics simultaneously. Different metrics (. BLEU, TER) focus on different aspects of translation quality; our multi-objective approach leverages these diverse aspects to improve overall quality. Our approach is based on the theory of Pareto Optimality.