Rational bidding using reinforcement learning: an application in automated resource allocation

Borissov, Nikolay and Anandasivam, Arun and Wirström, Niklas and Neumann, Dirk (2008) Rational bidding using reinforcement learning: an application in automated resource allocation. In: The 5th International Workshop on Grid Economics and Business Models (Gecon 2008), 26 Aug 2008, Las Palmas de Gran Canaria, Spain.


Official URL:


The application of autonomous agents by the provisioning and usage of computational resources is an attractive research field. Various methods and technologies in the area of artificial intelligence, statistics and economics are playing together to achieve i) autonomic resource provisioning and usage of computational resources, to invent ii) competitive bidding strategies for widely used market mechanisms and to iii) incentivize consumers and providers to use such market-based systems. The contributions of the paper are threefold. First, we present a framework for supporting consumers and providers in technical and economic preference elicitation and the generation of bids. Secondly, we introduce a consumer-side reinforcement learning bidding strategy which enables rational behavior by the generation and selection of bids. Thirdly, we evaluate and compare this bidding strategy against a truth-telling bidding strategy for two kinds of market mechanisms – one centralized and one decentralized.

Item Type:Conference or Workshop Item (Paper)
Uncontrolled Keywords:Bid Generation, Reinforcement learning, Service Provisioning and Usage, Grid Computing
ID Code:3538
Deposited By:Niklas Wirström
Deposited On:23 Apr 2009
Last Modified:18 Nov 2009 16:23

Repository Staff Only: item control page