Collective decision-making (CDM) processes used in online crowdsourcing are designed with choices such as time to decide a winner, how to choose a winner, etc. We propose a new experimental design approach called Asymmetric Response Surface Method to efficiently determine the appropriate choices for CDM, based on the objective of the CDM, for a particular crowdsourcing application. One may apply this new method to other experimental design problems as well.