Data-driven Clustering and Feature-based Retail Electricity Pricing with Smart Meters
65 Pages Posted: 22 Oct 2020 Last revised: 7 Mar 2022
N. Bora Keskin
Duke University - Fuqua School of Business
Yuexing Li
Duke University, Fuqua School of Business, Students
Nur Sunar
University of North Carolina (UNC) at Chapel Hill - Kenan-Flagler Business School
Date Written: March 2, 2022
Abstract
We consider an electric utility company that serves retail electricity customers over a discrete-time horizon. In each period, the company observes the customers' consumption as well as high-dimensional features on customer characteristics and exogenous factors. A distinctive element of our work is that these features exhibit three types of heterogeneity—over time, customers, or both. Based on the consumption and feature observations, the company can dynamically adjust the retail electricity price at the customer level. The consumption depends on the features: there is an underlying structure of clusters in the feature space, and the relationship between consumption and features is different in each cluster. Initially, the company knows neither the underlying cluster structure nor the corresponding consumption models. We design a data-driven policy of joint spectral clustering and feature-based pricing and show that our policy achieves near-optimal performance, i.e., its average regret converges to zero at the fastest achievable rate. This work is the first to theoretically analyze joint clustering and feature-based pricing with different types of feature heterogeneity. Our case study based on real-life smart meter data from Texas illustrates that our policy increases company profits by 146% over a three-month period relative to the company policy, and is robust to various forms of model misspecification.
Keywords: spectral clustering, feature-based dynamic pricing, data-driven analysis, retail electricity, smart meter, lasso regularization, exploration-exploitation
Suggested Citation: Suggested Citation
N. Bora Keskin (Contact Author)

Duke University - Fuqua School of Business ( email )
100 Fuqua Drive
Durham, NC 27708-0120
United States
HOME PAGE: http://faculty.fuqua.duke.edu/~nk145/
Yuexing Li
Duke University, Fuqua School of Business, Students ( email )
Durham, NC
United States
Do you have a job opening that you would like to promote on SSRN?
Related eJournals
-
Econometrics: Econometric & Statistical Methods - Special Topics eJournal
Econometrics: Econometric & Statistical Methods - Special Topics eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS1,716PAPERS9,338 -
Econometrics: Econometric & Statistical Methods - General eJournal
Econometrics: Econometric & Statistical Methods - General eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS1,600PAPERS12,682 -
Econometrics: Mathematical Methods & Programming eJournal
Econometrics: Mathematical Methods & Programming eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS1,488PAPERS6,860 -
Marketing Science eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS1,003PAPERS2,461 -
Decision Analysis eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS980PAPERS468 -
IO: Theory eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS936PAPERS14,862 -
Sustainability & Economics eJournal
Sustainability & Economics eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS907PAPERS27,939 -
Stochastic Models eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS846PAPERS506 -
Environment & Natural Resources eJournal
Environment & Natural Resources eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS823PAPERS652 -
Technology, Operations Management & Production eJournal
Technology, Operations Management & Production eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS788PAPERS1,508 -
Microeconomics: Production, Market Structure & Pricing eJournal
Microeconomics: Production, Market Structure & Pricing eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS768PAPERS16,275 -
Consumer Social Responsibility eJournal
Consumer Social Responsibility eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS747PAPERS3,824This Journal is curated by:Timothy M. Devinney at University of Manchester - Alliance Manchester Business School -
Renewable Energy eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS741PAPERS4,111 -
Politics & Energy eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS700PAPERS14,289 -
Econometric Modeling: Microeconometric Models of Household Behavior eJournal
Econometric Modeling: Microeconometric Models of Household Behavior eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS648PAPERS3,476 -
Econometric Modeling: Agriculture, Natural Resources & Environmental Economics eJournal
Econometric Modeling: Agriculture, Natural Resources & Environmental Economics eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS640PAPERS6,482 -
Microeconomics: Intertemporal Consumer Choice & Savings eJournal
Microeconomics: Intertemporal Consumer Choice & Savings eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS603PAPERS7,656 -
Machine Learning eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS386PAPERS4,838 -
Innovation & Management Science eJournal
Innovation & Management Science eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS293PAPERS7,045 -
Information Systems & Economics eJournal
Information Systems & Economics eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS233PAPERS13,842This Journal is curated by:Erik Brynjolfsson at National Bureau of Economic Research (NBER) -
Energy Policy & Economics eJournal
Energy Policy & Economics eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS145PAPERS8,090 -
Energy Finance, Efficiency & Storage eJournal
Energy Finance, Efficiency & Storage eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS120PAPERS1,758 -
Energy eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS91PAPERS11,871 -
Urbanism eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS60PAPERS503 -
Libraries & Information Technology eJournal
Libraries & Information Technology eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS44PAPERS3,251