skip to main content
research-article

Using reputation and adaptive coalitions to support collaboration in competitive environments

Published: 01 October 2015 Publication History

Abstract

Internet-based scenarios, like co-working, e-freelancing, or crowdsourcing, usually need supporting collaboration among several actors that compete to service tasks. Moreover, the distribution of service requests, i.e., the arrival rate, varies over time, as well as the service workload required by each customer. In these scenarios, coalitions can be used to help agents to manage tasks they cannot tackle individually. In this paper we present a model to build and adapt coalitions with the goal of improving the quality and the quantity of tasks completed. The key contribution is a decision making mechanism that uses reputation and adaptation to allow agents in a competitive environment to autonomously enact and sustain coalitions, not only its composition, but also its number, i.e., how many coalitions are necessary. We provide empirical evidence showing that when agents employ our mechanism it is possible for them to maintain high levels of customer satisfaction. First, we show that coalitions keep a high percentage of tasks serviced on time despite a high percentage of unreliable workers. Second, coalitions and agents demonstrate that they successfully adapt to a varying distribution of customers' incoming tasks. This occurs because our decision making mechanism facilitates coalitions to disband when they become non-competitive, and individual agents detect opportunities to start new coalitions in scenarios with high task demand.

References

[1]
Abdallah, S., Lesser, V., 2004. Organization-based cooperative coalition formation. In: Proceedings of IEEE/WIC/ACM International Conference on Intelligent Agent Technology, 2004. (IAT 2004), pp. 162-168.
[2]
Afsarmanesh, H., Camarinha-Matos, L.M., 2005. A framework for management of virtual organization breeding environments. In: Proceedings of IMP Group Conference. Springer, pp. 35-48.
[3]
H. Afsarmanesh, L.M. Camarinha-Matos, S.S. Msanjila, On management of 2nd generation virtual organizations breeding environments, Annu. Rev. Control, 33 (2009) 209-219.
[4]
S. Aknine, S. Pinson, M. Shakun, A multi-agent coalition formation method based on preference models, Group Decis. Negot., 13 (2004) 513-538.
[5]
Amgoud, L., 2005. Towards a formal model for task allocation via coalition formation. In: Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS '05. ACM, New York, NY, USA, pp. 1185-1186.
[6]
Anagnostopoulos, A., Becchetti, L., Castillo, C., Gionis, A., Leonardi, S., 2012. Online team formation in social networks. In: Proceedings of the 21st International Conference on World Wide Web, WWW '12. ACM, New York, NY, USA, pp. 839-848.
[7]
Anagnostopoulos, A., Castillo, C., Gionis, A., Becchetti, L., Leonardi, S., 2010. Power in unity: forming teams in large-scale community systems. In: Proceedings of Conference on Information and Knowledge Management (CIKM). ACM Press, pp. 599-608.
[8]
Chen, X., Lin, Q., Zhou, D., 2013. Optimistic knowledge gradient policy for optimal budget allocation in crowdsourcing. In: Proceedings of the 30th International Conference on Machine Learning (ICML-13), JMLR Workshop and Conference Proceedings, vol. 28, pp. 64-72.
[9]
Decker, K., Sycara, K., Williamson, M., 1997. Middle-agents for the internet. In: Proceedings of the 15th International Joint Conference on Artificial Intelligence.
[10]
Ho, C.J., Vaughan, J.W., 2012. Online task assignment in crowdsourcing markets. In: AAAI.
[11]
Ho, C.J., Zhang, Y., Vaughan, J., vander Schaar, M., 2012. Towards social norm design for crowdsourcing markets. In: AAAI Workshops.
[12]
Ipeirotis, P., Provost, F., Sheng, V., Wang, J., 2013. Repeated labeling using multiple noisy labelers. Data Min. Knowl. Discov. 1-40.
[13]
P.G. Ipeirotis, Analyzing the amazon mechanical turk marketplace, XRDS, 17 (2010) 16-21.
[14]
Karger, D.R., Oh, S., Shah, D., 2011a. Budget-optimal task allocation for reliable crowdsourcing systems. CoRR, abs/1110.3564.
[15]
Karger, D.R., Oh, S., Shah, D., 2011b. Iterative learning for reliable crowdsourcing systems. In: Advances in Neural Information Processing Systems, vol. 24, pp. 1953-1961.
[16]
Kittur, A., Nickerson, J.V., Bernstein, M., Gerber, E., Shaw, A., Zimmerman, J., Lease, M., and Horton, J., 2013. The future of crowd work. In: Proceedings of the 2013 Conference on Computer Supported Cooperative Work, CSCW '13. ACM, New York, NY, USA, pp. 1301-1318.
[17]
M. Klusch, A. Gerber, Dynamic coalition formation among rational agents, IEEE Intell. Syst., 17 (2002) 42-47.
[18]
Kraus, S., Shehory, O., Taase, G., 2003. Coalition formation with uncertain heterogeneous information. In: Proceedings of the Second International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS '03. ACM, New York, NY, USA, pp. 1-8.
[19]
Lappas, T., Liu, K., Terzi, E., 2009. Finding a team of experts in social networks. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '09. ACM, New York, NY, USA, pp. 467-476.
[20]
Lau, H.C., Zhang, L., 2003. Task allocation via multi-agent coalition formation: taxonomy, algorithms and complexity. In The 15th IEEE International Conference on Tools with Artificial Intelligence, 2003, pp. 346-350.
[21]
F. Maturana, W. Shen, D.H. Norrie, Metamorph, Int. J. Prod. Res., 37 (1999) 2159-2174.
[22]
Mérida-Campos, C., Willmott, S., 2004. Modelling coalition formation over time for iterative coalition games. In: Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems-Volume 2, AAMAS '04. IEEE Computer Society, Washington, DC, USA, pp. 572-579.
[23]
Mérida-Campos, C., Willmott, S., 2006a. Agent compatibility and coalition formation: investigating two interacting negotiation strategies. In: Fasli, M., Shehory, O. (Eds.), TADA/AMEC, Lecture Notes in Computer Science, vol. 4452. Springer, pp. 75-89.
[24]
Mérida-Campos, C., Willmott, S., 2006b. The effect of heterogeneity on coalition formation in iterated request for proposal scenarios. In: Dunin-Keplicz, B., Omicini, A., Padget, J.A. (Eds.), EUMAS, CEUR Workshop Proceedings, vol. 223. CEUR-WS.org.
[25]
oDesk.{https://www.odesk.com/}.
[26]
T. Sandholm, K. Larson, M. Andersson, O. Shehory, F. Tohmé, Coalition structure generation with worst case guarantees, Artif. Intell., 111 (1999) 209-238.
[27]
Shehory, O., Kraus, S., 1995. Task allocation via coalition formation among autonomous agents. In: Proceedings of the 14th International Joint Conference on Artificial Intelligence-Volume 1, IJCAI'95, San Francisco, CA, USA, pp. 655-661.
[28]
O. Shehory, S. Kraus, Methods for task allocation via agent coalition formation, Artif. Intell., 101 (1998) 165-200.
[29]
Shehory, O., Kraus, S., 1999. Feasible formation of coalitions among autonomous agents in non-super-additive environments. Comput. Intell. 15 (3).
[30]
Slivkins, A., Vaughan, J.W., 2013. Online decision making in crowdsourcing markets: theoretical challenges (position paper). CoRR, abs/1308.1746.
[31]
R.G. Smith, The contract net protocol, IEEE Trans. Comput., 29 (1980) 1104-1113.
[32]
Soh, L.-K., Li, X., 2003. An integrated multilevel learning approach to multiagent coalition formation. In: Proceedings of the 18th International Joint Conference on Artificial Intelligence, IJCAI'03, San Francisco, CA, USA, pp. 619-624.
[33]
K.P. Sycara, R. Vaculín, Process mediation, execution monitoring and recovery for semantic web services, IEEE Data Eng. Bull., 31 (2008) 13-17.
[34]
The Economist, 2011. The Rise of Co-working {http://www.economist.com/node/21542190?fsrc=scn/fb/wl/ar/anotheralternativetotheoffice}.
[35]
Ye, D., Zhang, M., Sutanto, D., 2012. formation. In: vander Hoek, W., Padgham, L., Conitzer, V., Winikoff, M. (Eds.), AAMAS. IFAAMAS, pp. 1253-1254.
[36]
Zheng, X., Koenig, S., 2008. Greedy approaches for solving task-allocation problems with coalitions. In: AAMAS 2008 Workshop on Formal Models and Methods for Multi-Robot Systems.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Engineering Applications of Artificial Intelligence
Engineering Applications of Artificial Intelligence  Volume 45, Issue C
October 2015
488 pages

Publisher

Pergamon Press, Inc.

United States

Publication History

Published: 01 October 2015

Author Tags

  1. Coalitions
  2. Collaboration
  3. Competitive environments
  4. Crowdsourcing
  5. Reputation

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 28 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media