Data-driven Clustering and Feature-based Retail Electricity Pricing with Smart Meters
65 Pages Posted: 22 Oct 2020 Last revised: 7 Mar 2022
N. Bora Keskin
Duke University - Fuqua School of Business
Yuexing Li
Duke University, Fuqua School of Business, Students
Nur Sunar
University of North Carolina (UNC) at Chapel Hill - Kenan-Flagler Business School
Date Written: March 2, 2022
Abstract
We consider an electric utility company that serves retail electricity customers over a discrete-time horizon. In each period, the company observes the customers' consumption as well as high-dimensional features on customer characteristics and exogenous factors. A distinctive element of our work is that these features exhibit three types of heterogeneity—over time, customers, or both. Based on the consumption and feature observations, the company can dynamically adjust the retail electricity price at the customer level. The consumption depends on the features: there is an underlying structure of clusters in the feature space, and the relationship between consumption and features is different in each cluster. Initially, the company knows neither the underlying cluster structure nor the corresponding consumption models. We design a data-driven policy of joint spectral clustering and feature-based pricing and show that our policy achieves near-optimal performance, i.e., its average regret converges to zero at the fastest achievable rate. This work is the first to theoretically analyze joint clustering and feature-based pricing with different types of feature heterogeneity. Our case study based on real-life smart meter data from Texas illustrates that our policy increases company profits by 146% over a three-month period relative to the company policy, and is robust to various forms of model misspecification.
Keywords: spectral clustering, feature-based dynamic pricing, data-driven analysis, retail electricity, smart meter, lasso regularization, exploration-exploitation
Suggested Citation: Suggested Citation
N. Bora Keskin (Contact Author)

Duke University - Fuqua School of Business ( email )
100 Fuqua Drive
Durham, NC 27708-0120
United States
HOME PAGE: http://faculty.fuqua.duke.edu/~nk145/
Yuexing Li
Duke University, Fuqua School of Business, Students ( email )
Durham, NC
United States
Do you have a job opening that you would like to promote on SSRN?
Related eJournals
-
Econometrics: Econometric & Statistical Methods - Special Topics eJournal
Econometrics: Econometric & Statistical Methods - Special Topics eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS1,733PAPERS9,276 -
Econometrics: Econometric & Statistical Methods - General eJournal
Econometrics: Econometric & Statistical Methods - General eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS1,615PAPERS12,635 -
Econometrics: Mathematical Methods & Programming eJournal
Econometrics: Mathematical Methods & Programming eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS1,503PAPERS6,838 -
Marketing Science eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS1,012PAPERS2,434 -
Decision Analysis eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS987PAPERS469 -
IO: Theory eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS945PAPERS14,744 -
Sustainability & Economics eJournal
Sustainability & Economics eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS913PAPERS27,872 -
Stochastic Models eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS851PAPERS502 -
Environment & Natural Resources eJournal
Environment & Natural Resources eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS831PAPERS644 -
Technology, Operations Management & Production eJournal
Technology, Operations Management & Production eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS797PAPERS1,496 -
Microeconomics: Production, Market Structure & Pricing eJournal
Microeconomics: Production, Market Structure & Pricing eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS774PAPERS16,128 -
Consumer Social Responsibility eJournal
Consumer Social Responsibility eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS755PAPERS3,799This Journal is curated by:Timothy M. Devinney at University of Manchester - Alliance Manchester Business School -
Renewable Energy eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS744PAPERS4,024 -
Politics & Energy eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS705PAPERS14,215 -
Econometric Modeling: Microeconometric Models of Household Behavior eJournal
Econometric Modeling: Microeconometric Models of Household Behavior eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS655PAPERS3,420 -
Econometric Modeling: Agriculture, Natural Resources & Environmental Economics eJournal
Econometric Modeling: Agriculture, Natural Resources & Environmental Economics eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS649PAPERS6,413 -
Microeconomics: Intertemporal Consumer Choice & Savings eJournal
Microeconomics: Intertemporal Consumer Choice & Savings eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS607PAPERS7,600 -
Machine Learning eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS383PAPERS4,463 -
Innovation & Management Science eJournal
Innovation & Management Science eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS295PAPERS6,969 -
Information Systems & Economics eJournal
Information Systems & Economics eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS234PAPERS13,773This Journal is curated by:Erik Brynjolfsson at National Bureau of Economic Research (NBER) -
Energy Policy & Economics eJournal
Energy Policy & Economics eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS145PAPERS8,045 -
Energy Finance, Efficiency & Storage eJournal
Energy Finance, Efficiency & Storage eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS120PAPERS1,728 -
Energy eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS92PAPERS11,570 -
Urbanism eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS60PAPERS499 -
Libraries & Information Technology eJournal
Libraries & Information Technology eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS44PAPERS2,990