Data-driven Clustering and Feature-based Retail Electricity Pricing with Smart Meters
65 Pages Posted: 22 Oct 2020 Last revised: 7 Mar 2022
N. Bora Keskin
Duke University - Fuqua School of Business
Yuexing Li
Johns Hopkins University - Carey Business School
Nur Sunar
University of North Carolina (UNC) at Chapel Hill - Kenan-Flagler Business School
Date Written: March 2, 2022
Abstract
We consider an electric utility company that serves retail electricity customers over a discrete-time horizon. In each period, the company observes the customers' consumption as well as high-dimensional features on customer characteristics and exogenous factors. A distinctive element of our work is that these features exhibit three types of heterogeneity—over time, customers, or both. Based on the consumption and feature observations, the company can dynamically adjust the retail electricity price at the customer level. The consumption depends on the features: there is an underlying structure of clusters in the feature space, and the relationship between consumption and features is different in each cluster. Initially, the company knows neither the underlying cluster structure nor the corresponding consumption models. We design a data-driven policy of joint spectral clustering and feature-based pricing and show that our policy achieves near-optimal performance, i.e., its average regret converges to zero at the fastest achievable rate. This work is the first to theoretically analyze joint clustering and feature-based pricing with different types of feature heterogeneity. Our case study based on real-life smart meter data from Texas illustrates that our policy increases company profits by 146% over a three-month period relative to the company policy, and is robust to various forms of model misspecification.
Keywords: spectral clustering, feature-based dynamic pricing, data-driven analysis, retail electricity, smart meter, lasso regularization, exploration-exploitation
Suggested Citation: Suggested Citation
N. Bora Keskin (Contact Author)

Duke University - Fuqua School of Business ( email )
100 Fuqua Drive
Durham, NC 27708-0120
United States
HOME PAGE: http://faculty.fuqua.duke.edu/~nk145/
Yuexing Li
Johns Hopkins University - Carey Business School ( email )
100 International Drive
Baltimore, MD 21202
United States
4102344761 (Phone)
HOME PAGE: http://https://yuexing-li.com
Do you have a job opening that you would like to promote on SSRN?
Related eJournals
-
Econometrics: Econometric & Statistical Methods - Special Topics eJournal
Econometrics: Econometric & Statistical Methods - Special Topics eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS1,695PAPERS9,589 -
Econometrics: Econometric & Statistical Methods - General eJournal
Econometrics: Econometric & Statistical Methods - General eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS1,582PAPERS12,878 -
Econometrics: Mathematical Methods & Programming eJournal
Econometrics: Mathematical Methods & Programming eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS1,470PAPERS6,990 -
Marketing Science eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS989PAPERS2,538 -
Decision Analysis eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS964PAPERS473 -
IO: Theory eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS921PAPERS15,230 -
Sustainability & Economics eJournal
Sustainability & Economics eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS898PAPERS28,160 -
Stochastic Models eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS831PAPERS516 -
Environment & Natural Resources eJournal
Environment & Natural Resources eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS808PAPERS662 -
Technology, Operations Management & Production eJournal
Technology, Operations Management & Production eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS774PAPERS1,544 -
Microeconomics: Production, Market Structure & Pricing eJournal
Microeconomics: Production, Market Structure & Pricing eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS758PAPERS16,693 -
Consumer Social Responsibility eJournal
Consumer Social Responsibility eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS743PAPERS3,938This Journal is curated by:Timothy M. Devinney at University of Manchester - Alliance Manchester Business School -
Renewable Energy eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS733PAPERS4,386 -
Politics & Energy eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS691PAPERS14,508 -
Econometric Modeling: Microeconometric Models of Household Behavior eJournal
Econometric Modeling: Microeconometric Models of Household Behavior eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS639PAPERS3,602 -
Econometric Modeling: Agriculture, Natural Resources & Environmental Economics eJournal
Econometric Modeling: Agriculture, Natural Resources & Environmental Economics eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS633PAPERS6,791 -
Microeconomics: Intertemporal Consumer Choice & Savings eJournal
Microeconomics: Intertemporal Consumer Choice & Savings eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS593PAPERS7,884 -
Machine Learning eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS370PAPERS6,248 -
Innovation & Management Science eJournal
Innovation & Management Science eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS288PAPERS7,147 -
Information Systems & Economics eJournal
Information Systems & Economics eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS231PAPERS14,074This Journal is curated by:Erik Brynjolfsson at National Bureau of Economic Research (NBER) -
Energy Policy & Economics eJournal
Energy Policy & Economics eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS148PAPERS8,271 -
Energy Finance, Efficiency & Storage eJournal
Energy Finance, Efficiency & Storage eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS122PAPERS1,855 -
Energy eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS90PAPERS12,689 -
Urbanism eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS60PAPERS549 -
Libraries & Information Technology eJournal
Libraries & Information Technology eJournal
Subscribe to this fee journal for more curated articles on this topic
FOLLOWERS45PAPERS4,155