Understanding Why Electricity Markets Over-Price Transmission Losses
Introduction
This analysis examines the mathematical foundations of marginal loss factor systems used in electricity markets globally, with particular focus on AEMO’s implementation in the National Electricity Market. We demonstrate that all marginal loss factor systems universally exhibit factor-of-2 over-recovery due to the quadratic nature of transmission losses combined with marginal cost pricing principles. An alternative Average Loss Factor (ALF) framework is presented that addresses this mathematical over-recovery while maintaining locational efficiency signals. The analysis includes detailed mathematical proofs, computational comparisons, and implementation scenarios using real AEMO operational data.
Section 1: Marginal Loss Factor Fundamentals
1.1 The Physics of Transmission Losses
When electricity flows through transmission lines, energy is inevitably lost due to the physical properties of conductors. These losses occur because electrical current flowing through resistance creates heat, following fundamental laws of physics.
The Fundamental Loss Equation
For any transmission line carrying electrical current, the power loss is governed by:
\[P_{loss} = I^2 \times R\]Where:
- $P_{loss}$ = power lost as heat (MW)
- $I$ = current flowing through the line (amperes)
- $R$ = electrical resistance of the conductor (ohms)
In power system analysis, we typically work with power flows rather than currents. Using the relationship between current and power:
\[I = \frac{P}{V \cos\phi}\]Where:
- $P$ = power flow on the line (MW)
- $V$ = voltage level (kV)
- $\cos\phi$ = power factor (typically close to 1.0 for transmission systems)
The Quadratic Relationship
Substituting this relationship into the loss equation:
\[P_{loss} = \left(\frac{P}{V \cos\phi}\right)^2 \times R = \frac{R}{V^2} \times P^2\]For high-voltage transmission systems where voltage is relatively stable, we can define a line loss coefficient:
\[k = \frac{R}{V^2}\]This gives us the fundamental quadratic loss relationship:
\[\boxed{P_{loss} = k \times P^2}\]Key Insight: This quadratic relationship ($P^2$) is the mathematical foundation that creates the distinction between marginal and average loss allocation methods.
Visual Representation: The Factor-of-2 Mathematical Relationship
The following diagram illustrates the core mathematical relationship that drives transmission loss over-pricing in electricity markets:

This diagram demonstrates why electricity markets systematically over-price transmission losses by exactly factor of 2:
- Solid curve: Actual quadratic transmission losses following $P_{loss} = k \times P^2$
- MLF Tangent (dashed): Marginal loss rate at 100 MW (slope = 0.06 MW per MW)
- Average Loss curve (dashed): Average loss rate from 0 to 100 MW (slope = 0.03 MW per MW)
Critical Mathematical Insight: At 100 MW power transfer:
- Actual losses: 3 MW
- Marginal pricing charges: 6 MW equivalent (0.06 × 100 MW)
- Over-recovery factor: Exactly 2.0
This mathematical relationship exists in all electricity markets globally - AEMO, PJM, ERCOT, CAISO - because they all use the same quadratic loss physics in their optimization models.
Why This Matters
The quadratic nature of transmission losses means:
- Small increases in power flow create disproportionately large increases in losses
- Doubling power flow results in four times the losses
- The rate of loss increase (marginal loss) is always twice the average loss rate
This mathematical property is not a design choice or policy decision—it is a fundamental law of physics that governs all electrical systems.
1.2 Economic Rationale for Loss Allocation
The Market Challenge
In electricity markets, generators produce power and consumers use it, but some energy is lost in transmission. This creates a fundamental accounting question: Who should pay for these losses?
The total losses in a power system are: \(L_{total} = \sum_{lines} k_{line} \times P_{line}^2\)
But losses on any individual line depend on power flows from multiple generators. This creates an allocation problem: how do we fairly assign loss responsibility to individual market participants?
Economic Efficiency Principles
Economic theory suggests that prices should reflect marginal costs—the cost of producing one additional unit. In transmission losses, this means:
- Marginal loss cost = additional losses caused by a small increase in generation
- Average loss cost = total losses divided by total generation
The marginal approach aims to:
- Send correct price signals for economic dispatch
- Incentivize efficient generator location in low-loss areas
- Minimize total system costs through optimal resource allocation
The Mathematical Challenge
However, the quadratic nature of losses creates a mathematical complication:
$\text{Marginal Loss Rate} = \frac{\partial L_{total}}{\partial P} = 2kP$
$\text{Average Loss Rate} = \frac{L_{total}}{P} = kP$
This means: $\text{Marginal} = 2 \times \text{Average}$
This mathematical relationship exists in all power systems globally and creates systematic differences between marginal and average loss allocation methods.
1.3 Global Approaches to Loss Factor Implementation
Electricity markets worldwide have developed different approaches to handle transmission loss allocation, but all face the same fundamental mathematical relationships.
Static Loss Factor Approach
Used by: Australia (AEMO), New Zealand, some European markets
Methodology:
- Calculate loss factors annually based on projected operation
- Apply fixed factors throughout the year for each generator/load
- Update factors once per year with forward-looking analysis
Mathematical Process:
- Model expected system operation for entire year (8,760 or 17,520 intervals)
- Calculate marginal loss sensitivity for each connection point
- Compute generation-weighted average to create annual factor
- Apply static factor in real-time market operations
Advantages:
- Provides predictable loss factors for financial planning
- Allows comprehensive annual optimization considering all operating conditions
- Enables forward-looking signals for investment decisions
Challenges:
- Year-to-year volatility as system conditions change
- Static factors may not reflect real-time conditions
- Complex calculation process requiring annual comprehensive modeling
Dynamic Loss Factor Approach
Used by: United States ISOs (PJM, ERCOT, CAISO, etc.), many European markets
Methodology:
- Calculate loss effects real-time during market dispatch
- Incorporate loss impacts directly into Locational Marginal Prices (LMP)
- Update every 5 minutes based on current system conditions
Mathematical Process:
- Solve Security-Constrained Economic Dispatch every 5 minutes
- Include transmission loss costs directly in optimization objective
- Extract loss component from resulting shadow prices
- Publish LMPs with embedded loss signals
Advantages:
- Real-time accuracy reflecting current system conditions
- Integrated optimization of energy and losses simultaneously
- Immediate price signals for system operation
Challenges:
- High volatility in loss price components
- Complex LMP decomposition for market participants
- Computational intensity requiring rapid optimization
Hybrid Approaches
Some markets use combinations of static and dynamic methods:
- Static factors for financial settlements
- Dynamic adjustments for real-time operations
- Regional variations in methodology application
1.4 Mathematical Equivalence Across Approaches
Despite different implementation methods, all marginal loss factor systems share the same fundamental mathematical structure:
Common Mathematical Foundation
Both static and dynamic approaches calculate: \(\text{Loss Factor} = 1 - \frac{\partial L_{total}}{\partial P_{generator}}\)
Using chain rule expansion: \(\frac{\partial L_{total}}{\partial P_{generator}} = \sum_{lines} 2k_{line} \times P_{line} \times \frac{\partial P_{line}}{\partial P_{generator}}\)
The factor of 2 appears in both approaches from the quadratic loss function derivative.
Power Transfer Distribution Factors (PTDF)
The sensitivity $\frac{\partial P_{line}}{\partial P_{generator}}$ is calculated using network analysis: \(PTDF_{line,generator} = \frac{\partial P_{line}}{\partial P_{generator}}\)
These factors represent how changes in generator output affect power flows on each transmission line, based on network topology and electrical characteristics.
Universal Result
Regardless of implementation approach (static annual vs. dynamic real-time), all marginal loss factor systems produce:
\[\text{Total Marginal Allocation} = 2 \times \text{Total Actual Losses}\]This mathematical relationship is universal across all power system configurations and operating conditions.
1.5 Setting the Stage for Detailed Analysis
This fundamental understanding provides the foundation for examining:
- Detailed mathematical formulations used by different market operators
- Optimization theory underlying both static and dynamic approaches
- Computational methods for solving large-scale power system problems
- Alternative approaches that address the marginal-average mathematical relationship
- Real-world implementation considerations and practical impacts
The key insight is that the factor of 2 relationship between marginal and average losses is not an implementation choice but a mathematical consequence of the quadratic physics of transmission losses combined with marginal cost pricing principles.
Understanding this foundation allows us to analyze how different markets handle the same underlying mathematical reality and explore whether alternative approaches might provide benefits while maintaining economic efficiency principles.
Section 2: Static MLF Mathematics - AEMO Approach
2.1 AEMO’s Two-Stage MLF Framework
The Australian Energy Market Operator (AEMO) calculates Marginal Loss Factors through a two-stage process that separates MLF calculation from operational dispatch:
Stage 1: Annual MLF Calculation
- AEMO runs comprehensive AC power flow analysis modeling the entire National Electricity Market (NEM) operation for the upcoming financial year
- This stage uses detailed AC network models to capture voltage effects, reactive power flows, and precise loss calculations
- Results in static MLF values published annually for each connection point
Stage 2: Operational Economic Dispatch
- AEMO uses the pre-calculated static MLF values in real-time economic dispatch
- Operational dispatch typically uses simplified DC optimal power flow for computational speed
- The static MLFs are applied as fixed coefficients rather than being recalculated in real-time
This two-stage approach represents one of the most sophisticated implementations of static loss factor methodology globally.
Stage 1: MLF Calculation Scope and Scale
AEMO’s annual MLF calculation (Stage 1) covers:
- Time horizon: Full financial year (July 1 - June 30)¹
- Time resolution: 30-minute trading intervals²
- Total intervals: 17,520 half-hour periods (365 days × 48 intervals/day)
- Spatial scope: All five NEM regions (Queensland, NSW, Victoria, South Australia, Tasmania)³
- Network modeling: Full AC power flow models capturing voltage effects and precise loss calculations⁴
- Network scope: Entire transmission network with detailed electrical characteristics
This comprehensive AC analysis involves simultaneously considering:
- Expected generation patterns from all registered generators
- Forecast demand at connection points across the NEM
- Transmission network constraints and capabilities (including voltage limits)
- Network topology changes (planned outages, new connections)
- Regional interconnector flow limits
- Reactive power flows and voltage support requirements
Stage 2: Operational Dispatch Application
In operational dispatch (Stage 2), AEMO:
- Applies the pre-calculated static MLF values as fixed coefficients
- Uses simplified DC optimal power flow for real-time economic dispatch
- Updates dispatch every 5 minutes using the annual MLF values
- Does not recalculate loss factors during operational timeframes
¹ AEMO, “Marginal Loss Factors for the 2024-25 Financial Year”, April 2024 ² AEMO, “National Electricity Rules”, Chapter 3 ³ AEMO, “National Electricity Market Overview”, 2024 ⁴ AEMO, “Forward Looking Loss Factor Methodology”, 2024
Forward-Looking Methodology with AC Network Modeling
Unlike real-time approaches, AEMO’s static MLF methodology is entirely forward-looking using detailed AC power flow analysis:
- Historical data analysis: Review past 3-4 years of actual generation and demand patterns
- Future projection: Incorporate expected changes in generation mix, demand growth, network augmentations
- AC power flow modeling: Use detailed network models capturing voltage effects, reactive power, and precise loss calculations
- Scenario modeling: Consider range of operating conditions (peak, off-peak, seasonal variations) using full AC analysis
- Annual averaging: Calculate generation-weighted MLF for each connection point from AC modeling results
This comprehensive AC approach provides predictable loss factors that generators and retailers can use for long-term financial planning and contract negotiations, while the static application in operational dispatch maintains computational efficiency.
2.2 Mathematical Formulation of AEMO’s MLF Calculation (Stage 1)
Decision Variables
For each trading interval $t \in {1, 2, …, 17520}$ and the AC network model:
- $P_{g,t}$ = active power generation from generator $g$ in interval $t$ (MW)
- $Q_{g,t}$ = reactive power generation from generator $g$ in interval $t$ (MVAr)
- $P_{\ell,t}$ = active power flow on transmission line $\ell$ in interval $t$ (MW)
- $Q_{\ell,t}$ = reactive power flow on transmission line $\ell$ in interval $t$ (MVAr)
- $V_{i,t}$ = voltage magnitude at bus $i$ in interval $t$ (per unit)
- $\theta_{i,t}$ = voltage angle at bus $i$ in interval $t$ (radians)
Note: This comprehensive AC formulation is used for MLF calculation only. Operational dispatch uses the resulting static MLF values in simplified DC models.
Objective Function for MLF Calculation
AEMO’s annual MLF calculation minimizes the total expected cost of serving load across all intervals using AC power flow constraints:
$\min \sum_{t=1}^{17520} \left[ \sum_{g \in \mathcal{G}} C_g(P_{g,t}) + \sum_{\ell \in \mathcal{L}} \psi \cdot k_\ell P_{\ell,t}^2 \right]$
Where:
- $C_g(P_{g,t})$ = generation cost function for generator $g$ (typically quadratic: $a_g P_{g,t}^2 + b_g P_{g,t} + c_g$)
- $k_\ell$ = loss coefficient for transmission line $\ell$ (calculated from AC power flow)
- $\psi$ = loss penalty weight (typically set to average expected energy price ~$100/MWh)
Critical Mathematical Element: The quadratic loss terms $k_\ell P_{\ell,t}^2$ in this MLF calculation stage create the marginal loss factors through the optimization’s first-order conditions. These resulting MLF values are then applied as static coefficients in operational dispatch.
Constraint Set
Power Balance Constraints
For each bus $i$ and interval $t$: \(\sum_{g \in \mathcal{G}_i} P_{g,t} - D_{i,t} = \sum_{\ell \in \delta^+(i)} P_{\ell,t} - \sum_{\ell \in \delta^-(i)} P_{\ell,t} + L_{i,t}\)
Where:
- $\mathcal{G}_i$ = set of generators connected to bus $i$
- $D_{i,t}$ = forecast demand at bus $i$ in interval $t$
- $\delta^+(i)$ = set of transmission lines leaving bus $i$
- $\delta^-(i)$ = set of transmission lines entering bus $i$
- $L_{i,t}$ = transmission losses allocated to bus $i$ in interval $t$
DC Power Flow Constraints
For each transmission line $\ell = (m,n)$ and interval $t$: \(P_{\ell,t} = B_\ell (\theta_{m,t} - \theta_{n,t})\)
Where:
- $B_\ell = \frac{1}{X_\ell}$ = line susceptance (inverse of reactance)
- $\theta_{m,t}, \theta_{n,t}$ = voltage angles at sending and receiving buses
Generator Capacity Constraints
For each generator $g$ and interval $t$: \(P_g^{\min} \leq P_{g,t} \leq P_g^{\max}\)
Transmission Line Flow Limits
For each line $\ell$ and interval $t$: \(|P_{\ell,t}| \leq P_\ell^{\max}\)
Reference Bus Constraint
To ensure mathematical solvability: \(\theta_{ref,t} = 0 \quad \forall t\)
2.3 Shadow Price Analysis and MLF Derivation
Lagrangian Formulation
The Lagrangian for AEMO’s optimization problem incorporates all constraints with dual variables (shadow prices):
\(\mathcal{L} = \sum_{t=1}^{17520} \left[ \sum_{g} C_g(P_{g,t}) + \sum_{\ell} \psi k_\ell P_{\ell,t}^2 \right]\) \(+ \sum_{t=1}^{17520} \sum_{i} \lambda_{i,t} \left[ \sum_{g \in \mathcal{G}_i} P_{g,t} - D_{i,t} - \sum_{\ell \in \delta^+(i)} P_{\ell,t} + \sum_{\ell \in \delta^-(i)} P_{\ell,t} + L_{i,t} \right]\) \(+ \sum_{t=1}^{17520} \sum_{\ell} \mu_{\ell,t} \left[ P_{\ell,t} - B_\ell (\theta_{m,t} - \theta_{n,t}) \right] + \text{[other constraints]}\)
First-Order Optimality Conditions
Generator Output Stationarity
For generator $g$ at bus $i$ in interval $t$: \(\frac{\partial \mathcal{L}}{\partial P_{g,t}} = \frac{\partial C_g(P_{g,t})}{\partial P_{g,t}} + \lambda_{i,t} = 0\)
This gives: $\lambda_{i,t} = -\frac{\partial C_g(P_{g,t})}{\partial P_{g,t}}$
Economic Interpretation: $\lambda_{i,t}$ is the shadow price representing the marginal cost of serving additional load at bus $i$ in interval $t$.
Line Flow Stationarity
For transmission line $\ell = (m,n)$ in interval $t$: \(\frac{\partial \mathcal{L}}{\partial P_{\ell,t}} = 2\psi k_\ell P_{\ell,t} - \lambda_{m,t} + \lambda_{n,t} + \mu_{\ell,t} = 0\)
Critical Observation: The factor 2 appears explicitly from differentiating the quadratic loss term $\psi k_\ell P_{\ell,t}^2$.
MLF Calculation Methodology
Step 1: Marginal Loss Sensitivity
For generator $g$ at bus $i$, the marginal loss sensitivity is: \(\frac{\partial L_{total,t}}{\partial P_{g,t}} = \sum_{\ell \in \mathcal{L}} \frac{\partial L_{\ell,t}}{\partial P_{g,t}} = \sum_{\ell \in \mathcal{L}} 2k_\ell P_{\ell,t} \frac{\partial P_{\ell,t}}{\partial P_{g,t}}\)
Step 2: Power Transfer Distribution Factors (PTDF)
The flow sensitivity $\frac{\partial P_{\ell,t}}{\partial P_{g,t}}$ is calculated using network analysis: \(PTDF_{\ell,i} = \frac{\partial P_{\ell,t}}{\partial P_{g,t}} = B_\ell \left( [X^{-1}]_{m,i} - [X^{-1}]_{n,i} \right)\)
Where $X$ is the network reactance matrix and $[X^{-1}]_{j,i}$ represents the $(j,i)$ element of its inverse.
Step 3: Interval MLF Calculation
For generator $g$ in interval $t$: \(MLF_{g,t} = 1 - \frac{\partial L_{total,t}}{\partial P_{g,t}} = 1 - \sum_{\ell \in \mathcal{L}} 2k_\ell P_{\ell,t}^* PTDF_{\ell,i}\)
Where $P_{\ell,t}^*$ is the optimal power flow from the optimization solution.
Step 4: Annual MLF Aggregation
The published annual MLF for generator $g$ is the generation-weighted average: \(MLF_g = \frac{\sum_{t=1}^{17520} MLF_{g,t} \times P_{g,t}^*}{\sum_{t=1}^{17520} P_{g,t}^*}\)
This weighting ensures that MLFs reflect the actual expected operating patterns of each generator.
2.5 Operational Dispatch Application (Stage 2)
Real-Time Use of Static MLFs
Once AEMO publishes the annual MLF values, they are applied in operational dispatch as fixed coefficients:
Operational Dispatch Formulation: $\min \sum_{g \in \mathcal{G}} C_g(P_{g,t}) \quad \text{subject to constraints}$
Generator Settlement with MLF: $\text{Revenue}_g = P_g \times \text{Regional Price} \times MLF_g$
Where $MLF_g$ is the pre-calculated static value from Stage 1, not recalculated in real-time.
Key Distinction:
- Stage 1 (Annual): Complex AC power flow analysis to calculate MLF values
- Stage 2 (Operational): Simple application of static MLF values in DC economic dispatch
This two-stage approach provides:
- Computational efficiency: Real-time dispatch doesn’t require loss factor recalculation
- Predictability: Market participants know their MLF values for the entire financial year
- Accuracy: Annual calculation captures comprehensive system operating conditions
2.5 Real AEMO Data Examples
AEMO’s Network Model Scale
According to AEMO’s published methodology documents:
- AEMO maintains detailed electrical network models of the transmission system⁵
- The model includes all transmission lines, transformers, and connection points
- Loss factors are calculated for all registered generators and scheduled loads⁶
- The methodology covers both scheduled and semi-scheduled generators⁷
⁵ AEMO, “Methodology for the Calculation and Application of Forward-Looking Loss Factors”, 2024 ⁶ AEMO, “Marginal Loss Factors Guidelines”, 2024 ⁷ AEMO, “Semi-Scheduled Generation Dispatch”, National Electricity Rules
MLF Volatility and Changes
AEMO publishes annual MLF determinations showing year-on-year changes. The 2024-25 determination noted:
- MLFs can vary significantly from year to year based on changing system conditions⁸
- Key drivers include new generation connections, transmission augmentations, and changing demand patterns⁹
- AEMO provides explanatory notes for connection points with material MLF changes¹⁰
⁸ AEMO, “Marginal Loss Factors for the 2024-25 Financial Year - Explanatory Statement”, April 2024 ⁹ AEMO, “Forward Looking Loss Factor Methodology”, Section 3.2, 2024 ¹⁰ AEMO, “2024-25 MLF Explanatory Notes”, April 2024
Regional MLF Patterns
AEMO’s MLF publications show systematic regional patterns:
- Connection points closer to major load centers typically have MLFs closer to 1.0¹¹
- Remote generation areas often have lower MLFs reflecting higher transmission losses¹²
- Interconnector flows significantly influence regional MLF patterns¹³
¹¹ AEMO, “Understanding Marginal Loss Factors”, Educational Material, 2023 ¹² AEMO, “Transmission Loss Factors Explanatory Statement”, 2024 ¹³ AEMO, “Inter-regional Loss Factor Equations”, 2024-25
2.6 Mathematical Properties of AEMO’s Complete MLF System
Revenue Over-Recovery Mathematical Proof
Claim: AEMO’s static MLF system results in total allocated costs exceeding actual transmission losses by exactly factor 2.
Proof: Total marginal loss allocation across all generators: \(\sum_{g \in \mathcal{G}} \sum_{t=1}^{17520} P_{g,t}^* \frac{\partial L_{total,t}}{\partial P_{g,t}} = \sum_{t=1}^{17520} \sum_{\ell \in \mathcal{L}} P_{\ell,t}^* \frac{\partial L_{total,t}}{\partial P_{\ell,t}}\)
\[= \sum_{t=1}^{17520} \sum_{\ell \in \mathcal{L}} P_{\ell,t}^* \cdot 2k_\ell P_{\ell,t}^* = 2\sum_{t=1}^{17520} \sum_{\ell \in \mathcal{L}} k_\ell (P_{\ell,t}^*)^2\]Total actual losses: \(\sum_{t=1}^{17520} L_{total,t} = \sum_{t=1}^{17520} \sum_{\ell \in \mathcal{L}} k_\ell (P_{\ell,t}^*)^2\)
Therefore: Marginal Allocation = 2 × Actual Losses ∎
Intra-Regional Settlement Surplus (IRSS)
This mathematical over-recovery manifests in AEMO’s market settlements as the Intra-Regional Settlement Surplus:
$IRSS = \sum_{g} \text{MLF Revenue from Generator } g - \text{Actual Transmission Losses}$
IRSS Redistribution Mechanism: AEMO’s MLF system mathematically creates over-recovery (the IRSS), and AEMO indicates this surplus is redistributed through settlement adjustments. However, the exact redistribution mechanism and ultimate beneficiaries require deeper investigation to understand fully.
Section 3: Dynamic LMP Mathematics - US ISO Approach
3.1 Real-Time Market Operations in US ISOs
United States Independent System Operators (ISOs) implement marginal loss factor concepts through a fundamentally different approach than AEMO’s static annual methodology. Instead of calculating fixed loss factors once per year, US ISOs incorporate transmission loss effects directly into real-time Locational Marginal Prices (LMPs) that update every five minutes.
Key US ISO Markets
The major US electricity markets using dynamic LMP methodology include:
- PJM Interconnection: Serving 13 states and Washington D.C.¹
- ERCOT: The Electric Reliability Council of Texas²
- CAISO: California Independent System Operator³
- ISO-NE: ISO New England⁴
- NYISO: New York Independent System Operator⁵
- MISO: Midcontinent Independent System Operator⁶
¹ PJM, “PJM Manual 11: Energy & Ancillary Services Market Operations”, 2024 ² ERCOT, “ERCOT Methodologies for Determining Locational Marginal Prices”, 2024 ³ CAISO, “Business Practice Manual for Market Operations”, 2024 ⁴ ISO-NE, “Market Rule 1 - Standard Market Design”, 2024 ⁵ NYISO, “Market Administration and Control Area Services Tariff”, 2024 ⁶ MISO, “Business Practices Manual - Energy and Operating Reserve Markets”, 2024
Real-Time Optimization Frequency
US ISOs operate on much shorter time horizons than AEMO’s annual approach:
- Market clearing frequency: Every 5 minutes⁷
- Optimization horizon: Typically 1-2 hours ahead⁸
- Price updates: Real-time LMPs published every 5 minutes⁹
- Market participants: Receive immediate price signals for operational decisions¹⁰
This high-frequency approach means transmission loss effects are calculated and priced in real-time based on actual system conditions rather than annual forecasts.
⁷ FERC Order 764, “Integration of Variable Energy Resources”, 2012 ⁸ PJM, “Real-Time Energy Market Description”, 2024 ⁹ CAISO, “Locational Marginal Price Calculation”, BPM Section 27 ¹⁰ ERCOT, “Real-Time Market Operations”, 2024
3.2 Security-Constrained Economic Dispatch (SCED) Formulation
Mathematical Framework
US ISOs solve a Security-Constrained Economic Dispatch optimization problem every five minutes. For a given dispatch interval t, the mathematical formulation is:
Decision Variables:
- $P_{g,t}$ = active power output from generator $g$ (MW)
- $P_{\ell,t}$ = active power flow on transmission line $\ell$ (MW)
- $\theta_{i,t}$ = voltage angle at bus $i$ (radians)
- $s_{\ell,t}^+, s_{\ell,t}^-$ = slack variables for transmission constraint violations
Objective Function: \(\min \sum_{g \in \mathcal{G}} C_g(P_{g,t}) + \sum_{\ell \in \mathcal{L}} \psi k_\ell P_{\ell,t}^2 + M \sum_{\ell \in \mathcal{L}} (s_{\ell,t}^+ + s_{\ell,t}^-)\)
Where:
- $C_g(P_{g,t})$ = generator offer curve (typically linear segments)¹¹
- $k_\ell$ = transmission line loss coefficient
- $\psi$ = loss penalty factor (typically set to current energy price estimates)
- $M$ = large penalty coefficient for constraint violations
¹¹ FERC, “Generator Offer Rules and Regulations”, 18 CFR Part 35
Critical Mathematical Element: The quadratic transmission loss terms $k_\ell P_{\ell,t}^2$ appear in the US ISO objective function identically to AEMO’s formulation, creating the same mathematical foundation for marginal loss pricing.
Constraint Set for Real-Time Operations
Power Balance Constraints
For each bus $i$ in the network: \(\sum_{g \in \mathcal{G}_i} P_{g,t} - D_{i,t} = \sum_{\ell \in \delta^+(i)} P_{\ell,t} - \sum_{\ell \in \delta^-(i)} P_{\ell,t} + L_{i,t}\)
Where $D_{i,t}$ represents real-time demand forecasts updated every few minutes.
DC Power Flow Equations
For each transmission element $\ell = (m,n)$: \(P_{\ell,t} = B_\ell (\theta_{m,t} - \theta_{n,t})\)
Security Constraints with Slack Variables
For each monitored transmission element: \(P_{\ell,t} - s_{\ell,t}^+ \leq P_\ell^{\max}\) \(P_{\ell,t} + s_{\ell,t}^- \geq -P_\ell^{\max}\)
Generator Operating Constraints
\[P_g^{\min} \leq P_{g,t} \leq P_g^{\max}\]Ramping Constraints
\(P_{g,t} - P_{g,t-1} \leq R_g^{up} \times \Delta t\) \(P_{g,t-1} - P_{g,t} \leq R_g^{down} \times \Delta t\)
Where $\Delta t$ = 5 minutes and $R_g^{up}, R_g^{down}$ are generator ramp rates.
3.3 Locational Marginal Price Calculation and Decomposition
Lagrangian Formulation for Real-Time Dispatch
The Lagrangian for the US ISO real-time optimization includes dual variables for all constraints:
\(\mathcal{L}_t = \sum_{g} C_g(P_{g,t}) + \sum_{\ell} \psi k_\ell P_{\ell,t}^2 + M \sum_{\ell} (s_{\ell,t}^+ + s_{\ell,t}^-)\) \(+ \sum_{i} \lambda_{i,t} \left[ \sum_{g \in \mathcal{G}_i} P_{g,t} - D_{i,t} - \sum_{\ell \in \delta^+(i)} P_{\ell,t} + \sum_{\ell \in \delta^-(i)} P_{\ell,t} + L_{i,t} \right]\) \(+ \sum_{\ell} \mu_{\ell,t} \left[ P_{\ell,t} - B_\ell (\theta_{m,t} - \theta_{n,t}) \right]\) \(+ \sum_{\ell} \left[ \rho_{\ell,t}^+ (P_{\ell,t} - s_{\ell,t}^+ - P_\ell^{\max}) + \rho_{\ell,t}^- (-P_{\ell,t} - s_{\ell,t}^- - P_\ell^{\max}) \right]\) \(+ \text{[other constraints with dual variables]}\)
First-Order Conditions and LMP Derivation
Generator Stationarity Condition
For generator $g$ connected to bus $i$: \(\frac{\partial \mathcal{L}_t}{\partial P_{g,t}} = \frac{\partial C_g(P_{g,t})}{\partial P_{g,t}} + \lambda_{i,t} = 0\)
This gives: $\lambda_{i,t} = -\frac{\partial C_g(P_{g,t})}{\partial P_{g,t}}$
Economic Interpretation: The dual variable $\lambda_{i,t}$ represents the Locational Marginal Price at bus $i$.
Line Flow Stationarity Condition
For transmission line $\ell = (m,n)$: \(\frac{\partial \mathcal{L}_t}{\partial P_{\ell,t}} = 2\psi k_\ell P_{\ell,t} - \lambda_{m,t} + \lambda_{n,t} + \mu_{\ell,t} + \rho_{\ell,t}^+ - \rho_{\ell,t}^- = 0\)
Critical Mathematical Observation: The factor 2 appears explicitly from differentiating $\psi k_\ell P_{\ell,t}^2$, identical to AEMO’s static formulation.
LMP Component Decomposition
US ISOs decompose LMPs into three components for market transparency¹²:
\[LMP_{i,t} = \lambda_{i,t} = \text{Energy Component} + \text{Congestion Component} + \text{Loss Component}\]Detailed Decomposition: \(LMP_{i,t} = \lambda_{ref,t} + \sum_{\ell \in \mathcal{L}} (\rho_{\ell,t}^+ - \rho_{\ell,t}^-) \times PTDF_{\ell,i} + \sum_{\ell \in \mathcal{L}} 2\psi k_\ell P_{\ell,t} \times PTDF_{\ell,i}\)
Where:
- Energy Component: $\lambda_{ref,t}$ = marginal cost at reference bus
- Congestion Component: $\sum_{\ell} (\rho_{\ell,t}^+ - \rho_{\ell,t}^-) \times PTDF_{\ell,i}$
- Loss Component: $\sum_{\ell} 2\psi k_\ell P_{\ell,t} \times PTDF_{\ell,i}$
¹² FERC, “LMP Reporting Requirements”, Order 888 and subsequent orders
Mathematical Equivalence to AEMO: The loss component contains the same factor of 2 multiplying instantaneous loss rates, demonstrating identical mathematical structure despite different implementation approaches.
3.4 Mathematical Equivalence to Static MLF Systems
Universal Factor-of-2 Relationship
Despite fundamental differences in implementation approach, US ISO dynamic systems and AEMO’s static system exhibit identical mathematical properties:
Static System (AEMO): \(MLF_g = 1 - \sum_{\ell} 2k_\ell \bar{P}_{\ell} \times PTDF_{\ell,g}\)
Dynamic System (US ISOs): \(LMP_{loss,i,t} = \sum_{\ell} 2\psi k_\ell P_{\ell,t} \times PTDF_{\ell,i}\)
Mathematical Equivalence: Both expressions contain the factor 2 multiplying instantaneous or average loss rates with transmission sensitivities.
Revenue Over-Recovery in Dynamic Systems
Mathematical Claim: US ISO dynamic LMP systems result in total loss cost allocation exceeding actual transmission losses by exactly factor 2.
Proof for Dynamic Systems: Total loss cost allocation in real-time market: \(\sum_{i} \sum_{t} D_{i,t} \times LMP_{loss,i,t} = \sum_{t} \sum_{\ell} P_{\ell,t} \times 2\psi k_\ell P_{\ell,t} = 2\sum_{t} \sum_{\ell} \psi k_\ell P_{\ell,t}^2\)
Total actual losses: \(\sum_{t} L_{total,t} = \sum_{t} \sum_{\ell} k_\ell P_{\ell,t}^2\)
With $\psi \approx 1$ (loss penalty set to energy price), the over-recovery factor equals 2. ∎
Revenue Neutrality Mechanisms
US ISOs address the mathematical over-recovery through “revenue neutrality” mechanisms:
Implementation Approaches:
- PJM: Marginal loss surplus credited to transmission customers
- ERCOT: Monthly revenue neutrality adjustments to market participants
- CAISO: Allocation of excess revenues through established procedures
Mathematical Necessity: These mechanisms exist because marginal loss pricing mathematically creates excess revenue collection, requiring redistribution to maintain market balance.
3.5 Computational and Operational Differences
Real-Time vs Annual Optimization
US ISO Approach Characteristics:
- Time horizon: 5-minute intervals with 1-2 hour lookahead
- Optimization scope: Current system conditions only
- Data inputs: Real-time measurements and short-term forecasts
- Solution frequency: 288 times per day (every 5 minutes)
AEMO Approach Characteristics:
- Time horizon: Annual (17,520 intervals)
- Optimization scope: Expected annual operation patterns
- Data inputs: Historical data and annual forecasts
- Solution frequency: Once per year with periodic updates
Advantages and Disadvantages
Dynamic Approach (US ISOs):
- Advantages: Reflects real-time system conditions, immediate price signals
- Disadvantages: High price volatility, complex hedging requirements
Static Approach (AEMO):
- Advantages: Predictable factors for financial planning, stable over year
- Disadvantages: May not reflect actual operating conditions, annual volatility
Mathematical Consistency
Despite operational differences, both approaches:
- Use identical quadratic loss functions in optimization objectives
- Generate equivalent factor-of-2 over-recovery relationships
- Require surplus redistribution mechanisms to maintain revenue neutrality
- Provide marginal cost signals for economic efficiency
The mathematical foundations are universal, while implementation details reflect different market design philosophies and operational requirements.
Section 4: Optimization Theory Deep-Dive
4.1 Mathematical Foundation of Marginal Loss Pricing
Both AEMO’s static MLF system and US ISO dynamic LMP systems are built on the same fundamental optimization theory. Understanding this mathematical foundation explains why both approaches produce identical factor-of-2 over-recovery despite their different implementation methods.
The Universal Optimization Structure
All marginal loss factor systems solve optimization problems with this mathematical structure:
Generic Objective Function: \(\min \sum_{generators} C_g(P_g) + \sum_{lines} \psi k_\ell P_\ell^2\)
Subject to:
- Power balance constraints
- Network flow equations
- Generator capacity limits
- Transmission line limits
The quadratic loss terms $k_\ell P_\ell^2$ in the objective function are what create marginal loss factors through the optimization mathematics, regardless of whether the problem is solved annually (AEMO) or every 5 minutes (US ISOs).
Why Marginal Pricing Creates Over-Recovery
The mathematical relationship that causes over-recovery exists in all optimization formulations using quadratic loss functions:
For any quadratic function $f(x) = ax^2$:
- Average rate: $\frac{f(x)}{x} = \frac{ax^2}{x} = ax$
- Marginal rate: $\frac{df}{dx} = 2ax$
- Relationship: $\text{Marginal} = 2 \times \text{Average}$
This mathematical property is independent of:
- Market design choices
- Geographic scope
- Time horizons
- Computational methods
- Regulatory frameworks
4.2 Lagrangian Formulation and First-Order Conditions
General Lagrangian Structure
For any power system optimization with transmission losses, the Lagrangian takes the form:
\[\mathcal{L} = \sum_g C_g(P_g) + \sum_\ell \psi k_\ell P_\ell^2 + \sum_i \lambda_i h_i(\mathbf{P}) + \sum_j \mu_j g_j(\mathbf{P})\]Where:
- $h_i(\mathbf{P}) = 0$ are equality constraints (power balance, flow equations)
- $g_j(\mathbf{P}) \leq 0$ are inequality constraints (capacity limits)
- $\lambda_i, \mu_j$ are dual variables (shadow prices)
Universal First-Order Conditions
Generator Output Optimality
For any generator $g$ at bus $i$: \(\frac{\partial \mathcal{L}}{\partial P_g} = \frac{\partial C_g}{\partial P_g} + \lambda_i = 0\)
This gives: $\lambda_i = -\frac{\partial C_g}{\partial P_g}$
Economic Interpretation: The shadow price $\lambda_i$ equals the negative marginal cost of generation at bus $i$.
Line Flow Optimality
For any transmission line $\ell = (m,n)$: \(\frac{\partial \mathcal{L}}{\partial P_\ell} = 2\psi k_\ell P_\ell - \lambda_m + \lambda_n + \text{other terms} = 0\)
Critical Mathematical Result: The factor 2 appears universally from differentiating the quadratic loss term $\psi k_\ell P_\ell^2$.
Shadow Price Economic Interpretation
The shadow prices $\lambda_i$ have consistent economic meaning across all marginal loss factor systems:
- Locational marginal cost of serving additional demand at bus $i$
- Locational marginal value of additional generation at bus $i$
- Price signal that guides economic dispatch and investment decisions
Whether computed annually (AEMO) or real-time (US ISOs), these shadow prices embed the same factor-of-2 relationship with actual transmission losses.
4.3 The Mathematics of Over-Recovery
Theoretical Foundation
Mathematical Theorem: For any power system with quadratic transmission loss function $L(\mathbf{P}) = \sum_\ell k_\ell P_\ell^2$, marginal loss pricing results in total cost allocation exceeding actual losses by exactly factor 2.
Proof Using Euler’s Theorem
Euler’s Theorem for Homogeneous Functions: For a function $f(\mathbf{x})$ that is homogeneous of degree $n$: \(\sum_i x_i \frac{\partial f}{\partial x_i} = n \cdot f(\mathbf{x})\)
Application to Transmission Losses: The loss function $L(\mathbf{P}) = \sum_\ell k_\ell P_\ell^2$ is homogeneous of degree 2.
Therefore: \(\sum_\ell P_\ell \frac{\partial L}{\partial P_\ell} = 2 \cdot L(\mathbf{P})\)
Economic Translation:
- Left side = Total marginal loss allocation to all power flows
- Right side = 2 × Total actual transmission losses
- Result: Marginal allocation = 2 × Actual losses
Chain Rule Application to Generators
For generator-level allocation, using the chain rule: \(\frac{\partial L}{\partial P_g} = \sum_\ell \frac{\partial L}{\partial P_\ell} \frac{\partial P_\ell}{\partial P_g} = \sum_\ell 2k_\ell P_\ell \cdot PTDF_{\ell,g}\)
Total generator allocation: \(\sum_g P_g \frac{\partial L}{\partial P_g} = \sum_\ell P_\ell \frac{\partial L}{\partial P_\ell} = 2L(\mathbf{P})\)
This mathematical relationship holds regardless of:
- Network topology
- Generation mix
- Demand patterns
- Operating conditions
- Market design details
4.4 Power Transfer Distribution Factors (PTDF)
Mathematical Definition
Power Transfer Distribution Factors represent the sensitivity of line flows to generator injections: \(PTDF_{\ell,g} = \frac{\partial P_\ell}{\partial P_g}\)
Network Analysis Calculation
For a transmission line $\ell = (m,n)$ and generator $g$ at bus $i$: \(PTDF_{\ell,i} = B_\ell \left( [X^{-1}]_{m,i} - [X^{-1}]_{n,i} \right)\)
Where:
- $B_\ell$ = line susceptance
- $X$ = network reactance matrix
- $[X^{-1}]_{j,i}$ = element $(j,i)$ of the inverse reactance matrix
Properties of PTDF
Mathematical Properties:
- Kirchhoff’s Laws: $\sum_\ell PTDF_{\ell,i} = 1$ (power balance)
- Superposition: $PTDF_{\ell,total} = \sum_g PTDF_{\ell,g} \times P_g$
- Network Independence: PTDFs depend only on network topology, not generation patterns
Economic Significance: PTDFs translate generator-level decisions into system-wide impacts, enabling:
- Marginal loss factor calculations
- Congestion price components
- Transmission planning analysis
4.5 Optimality Conditions and Economic Efficiency
Welfare Maximization Interpretation
Both marginal and average loss factor systems can be interpreted as welfare maximization problems:
Social Welfare Function: \(W = \sum_i \int_0^{D_i} P_i(d) \, dd - \sum_g C_g(P_g) - \sum_\ell L_\ell(P_\ell)\)
Where:
- $P_i(d)$ = inverse demand function at bus $i$
- $L_\ell(P_\ell)$ = loss function for line $\ell$
Different Loss Representations:
- Marginal approach: $L_\ell(P_\ell) = k_\ell P_\ell^2$ (quadratic)
- Average approach: $L_\ell(P_\ell) = \alpha_\ell P_\ell$ (linear approximation)
Pareto Efficiency Analysis
Marginal Loss Pricing:
- Achieves allocative efficiency in dispatch decisions
- Creates distributional inefficiency through over-recovery
- Requires redistribution mechanisms to restore welfare balance
Average Loss Pricing:
- Achieves approximate allocative efficiency with simpler implementation
- Maintains distributional efficiency through exact cost recovery
- Eliminates need for complex redistribution mechanisms
Economic Efficiency Trade-offs
Current Marginal Loss Pricing: The mathematical structure of current systems creates both benefits and challenges:
Benefits:
- Achieves allocative efficiency in dispatch decisions
- Provides strong locational signals for investment decisions
- Maintains theoretical optimality in resource allocation
Challenges:
- Creates distributional inefficiency through systematic over-recovery
- Requires complex redistribution mechanisms to restore market balance
- Generates price volatility that complicates financial planning
The mathematical factor-of-2 over-recovery is an inherent feature of marginal loss pricing, not a correctable implementation issue.
4.6 Mathematical Universality Across Market Designs
Invariant Mathematical Properties
The factor-of-2 over-recovery relationship is mathematically universal across:
Geographic Scope:
- Single-region markets (ERCOT)
- Multi-region markets (NEM, PJM)
- Multi-state markets (MISO, SPP)
Temporal Resolution:
- Annual optimization (AEMO)
- Daily optimization (some European markets)
- Real-time optimization (US ISOs)
Market Structure:
- Energy-only markets (ERCOT, NEM)
- Energy + capacity markets (PJM, ISO-NE)
- Centralized vs decentralized dispatch
Network Topology:
- Radial networks
- Meshed networks
- Mixed AC/DC systems
Mathematical Consistency Verification
The mathematical relationship can be verified in any marginal loss factor system by checking:
- Objective function structure: Presence of quadratic loss terms
- First-order conditions: Appearance of factor 2 in line flow optimality
- Revenue calculation: Total marginal allocation vs actual losses
- Redistribution mechanisms: Existence of surplus handling procedures
These mathematical features appear universally, confirming the theoretical foundation across all implementations.
Section 5: Alternative Mathematical Framework - Average Loss Factors
5.1 Conceptual Foundation of Average Loss Factors
Having established that marginal loss factor systems universally create factor-of-2 over-recovery due to their mathematical structure, we now explore an alternative approach: Average Loss Factor (ALF) methodology. This alternative addresses the over-recovery issue by modifying the fundamental optimization formulation.
The Core Mathematical Difference
Current Marginal Loss Approach:
- Places actual transmission losses ($k_\ell P_\ell^2$) in optimization objective
- Optimization process creates marginal loss effects through derivatives
- Results in systematic over-recovery requiring redistribution
Alternative Average Loss Approach:
- Places pre-calculated average loss coefficients ($\alpha_g P_g$) directly in optimization objective
- Optimization process remains linear in generation variables
- Achieves exact revenue neutrality by construction
Economic Logic of Average Loss Allocation
The average loss factor approach is based on the principle that transmission losses should be allocated proportionally to each generator’s contribution to total system losses, rather than based on marginal cost theory.
Proportional Allocation Principle: \(\alpha_g = \frac{\text{Generator g's contribution to total losses}}{\text{Generator g's total output}}\)
Revenue Neutrality Constraint: \(\sum_{g \in \mathcal{G}} \alpha_g P_g = \sum_{\ell \in \mathcal{L}} k_\ell P_\ell^2\)
This approach ensures that the total loss costs collected exactly equal the actual transmission losses incurred.
Relationship to Cost Causation
Average loss factors aim to reflect cost causation more directly:
- Each generator pays for losses in proportion to their actual impact on the transmission system
- No mathematical over-recovery occurs
- No redistribution mechanisms required
5.2 Mathematical Formulation of ALF Optimization
Modified Objective Function
The ALF optimization replaces quadratic loss terms with linear average loss coefficients:
ALF Objective Function: \(\min \sum_{g \in \mathcal{G}} C_g(P_g) + \sum_{g \in \mathcal{G}} \alpha_g P_g\)
Subject to the same constraints:
- Power balance: $\sum_{g \in \mathcal{G}i} P_g - D_i = \sum{\ell \in \delta^+(i)} P_\ell - \sum_{\ell \in \delta^-(i)} P_\ell$
- DC power flow: $P_\ell = B_\ell (\theta_m - \theta_n)$
- Generator limits: $P_g^{\min} \leq P_g \leq P_g^{\max}$
-
Line flow limits: $ P_\ell \leq P_\ell^{\max}$
Key Mathematical Property: The objective function is now linear in all decision variables, transforming the problem from Quadratic Programming (QP) to Linear Programming (LP).
First-Order Conditions for ALF
Generator Output Optimality
For generator $g$ at bus $i$: \(\frac{\partial \mathcal{L}}{\partial P_g} = \frac{\partial C_g}{\partial P_g} + \alpha_g + \lambda_i = 0\)
This gives: $\lambda_i = -\frac{\partial C_g}{\partial P_g} - \alpha_g$
Economic Interpretation: The shadow price includes both the marginal generation cost and the average loss coefficient.
Line Flow Optimality
For transmission line $\ell = (m,n)$: \(\frac{\partial \mathcal{L}}{\partial P_\ell} = -\lambda_m + \lambda_n + \mu_\ell = 0\)
Critical Observation: No factor of 2 appears because there are no quadratic loss terms to differentiate.
Computational Properties
Problem Classification:
- Marginal Loss Formulation: Quadratic Programming (QP)
- Average Loss Formulation: Linear Programming (LP)
Algorithmic Implications:
- QP solvers: Interior-point methods for quadratic objectives
- LP solvers: Simplex method or barrier methods for linear objectives
Mathematical Structure:
- QP formulation: Dense Hessian matrix from quadratic terms
- LP formulation: Sparse constraint matrix with linear structure
5.3 Average Loss Coefficient Calculation
Theoretical Foundation
Average loss coefficients must be calculated to represent each generator’s proportional contribution to total system losses. The calculation method determines how well the ALF system maintains locational efficiency signals.
Method 1: Historical Attribution Analysis
Data Requirements:
- Historical generation patterns for each generator
- Historical transmission flows and losses
- Network topology and line characteristics
Calculation Process:
- Loss Attribution: For each historical interval, attribute transmission losses to generators based on their contribution to power flows
- Temporal Averaging: Calculate generation-weighted average of loss attribution over the analysis period
- Coefficient Derivation: Derive average loss coefficient as ratio of attributed losses to generation
Mathematical Expression: \(\alpha_g = \frac{\sum_{t \in \mathcal{T}} L_{g,t}}{\sum_{t \in \mathcal{T}} P_{g,t}}\)
Where $L_{g,t}$ represents generator $g$’s attributed losses in interval $t$.
Method 2: Sensitivity-Based Calculation
Network Analysis Approach: Using Power Transfer Distribution Factors to calculate loss sensitivities:
\[\alpha_g = \sum_{\ell \in \mathcal{L}} k_\ell \bar{P}_\ell \times PTDF_{\ell,g}\]Where $\bar{P}_\ell$ represents the average power flow on line $\ell$ over the analysis period.
Properties:
- Maintains network-based locational signals
- Reflects transmission distance and network constraints
- Updates automatically with network topology changes
Method 3: Optimization-Based Derivation
Iterative Calculation:
- Initial Estimate: Start with preliminary average loss coefficients
- Optimization: Solve ALF optimization to get generation patterns
- Loss Calculation: Calculate actual transmission losses for resulting flows
- Coefficient Update: Adjust coefficients to improve revenue neutrality
- Iteration: Repeat until convergence
Convergence Criterion: \(\left| \sum_g \alpha_g P_g^* - \sum_\ell k_\ell (P_\ell^*)^2 \right| < \epsilon\)
Where $\epsilon$ is a small tolerance level.
5.4 Revenue Neutrality Properties
Revenue Neutrality as Design Goal
The ALF methodology aims to achieve revenue neutrality: $\sum_{g \in \mathcal{G}} \alpha_g P_g^* \approx \sum_{\ell \in \mathcal{L}} k_\ell (P_\ell^*)^2$
Where starred variables represent optimal solutions from the ALF optimization.
Important Clarification: Revenue neutrality is a design objective that requires careful implementation, not an automatic mathematical guarantee.
Challenges to Perfect Revenue Neutrality
Challenge 1: Generation Pattern Changes
The Problem:
- Average loss coefficients $\alpha_g$ are calculated based on expected generation patterns
- ALF optimization may produce different generation patterns $P_g^*$
- When generation patterns change, actual loss attribution changes
Mathematical Issue: $\alpha_g \text{ calculated assuming } P_g^{expected}$ $\text{But optimization produces } P_g^* \neq P_g^{expected}$
Challenge 2: Network Flow Dependencies
The Problem:
- Loss attribution depends on network power flows
- Power flows change when generation dispatch changes
- Changing flows alter the loss patterns that $\alpha_g$ was designed to recover
Feedback Loop: New generation patterns → New power flows → Different actual losses → Revenue imbalance
Challenge 3: Forecast Accuracy
The Problem:
- ALF coefficients rely on forecasts of:
- Generation patterns
- Demand levels
- Network topology
- Forecast errors translate to revenue imbalances
Practical Revenue Balancing Approaches
Approach 1: Iterative Coefficient Adjustment
Process:
- Initial Calculation: Compute $\alpha_g$ based on expected operations
- Optimization: Solve ALF problem to get $P_g^, P_\ell^$
- Check Balance: Calculate $\sum_g \alpha_g P_g^$ vs $\sum_\ell k_\ell (P_\ell^)^2$
- Adjust Coefficients: If imbalanced, revise $\alpha_g$ and repeat
- Converge: Iterate until acceptable revenue neutrality achieved
Convergence Criterion: $\left| \sum_g \alpha_g P_g^* - \sum_\ell k_\ell (P_\ell^*)^2 \right| < \epsilon$
Approach 2: Scaling Adjustment
Simple Correction Method: If imbalances occur, apply uniform scaling to all coefficients: $\alpha_g^{adjusted} = \alpha_g \times \frac{\sum_\ell k_\ell (P_\ell^)^2}{\sum_g \alpha_g P_g^}$
Properties:
- Maintains relative differences between generators
- Achieves exact revenue neutrality
- Simple to implement and understand
Approach 3: Periodic Recalibration
Regular Updates:
- Recalculate coefficients based on actual operational experience
- Update frequency: annually, quarterly, or as-needed
- Learn from revenue imbalances to improve future calculations
Expected Performance vs Current System
ALF Revenue Balance:
- Target: Exact revenue neutrality ($\sum \alpha_g P_g = \sum k_\ell P_\ell^2$)
- Reality: Small imbalances requiring periodic adjustment
- Magnitude: Likely <5% imbalances, easily correctable
Current MLF System:
- Mathematical Result: Systematic 100% over-recovery (factor of 2)
- Requires: Complex redistribution mechanisms (IRSS)
- Magnitude: Predictable doubling of actual losses
Comparison: ALF achieves approximate revenue neutrality with manageable adjustments, while MLF creates systematic over-recovery requiring permanent redistribution mechanisms.
5.5 Locational Efficiency Signals
Maintaining Economic Efficiency
A key concern with ALF is whether it maintains adequate locational signals for efficient investment and operation decisions.
Locational Variation in ALF: Average loss factors vary by generator location due to:
- Distance from load centers
- Network topology and transmission constraints
- Regional power flow patterns
- Interconnection capabilities
Investment Signal Preservation:
- Generators in high-loss locations receive higher $\alpha_g$ values
- Investment incentives favor low-loss locations
- Transmission expansion benefits remain captured
Comparison of Location Signals
Signal Strength Comparison:
- Marginal Loss Factors: Stronger locational differentiation, higher volatility
- Average Loss Factors: Moderate locational differentiation, greater stability
Economic Trade-offs:
- MLF: Maximum theoretical efficiency, practical complications from over-recovery
- ALF: Approximate efficiency, practical advantages from revenue neutrality
Dynamic Updating of Coefficients
Frequency of Updates: ALF coefficients require periodic updates to reflect:
- Changes in generation mix
- Network topology modifications
- Evolving demand patterns
- New technology integration
Update Methodologies:
- Annual updates: Similar to current MLF cycles
- Quarterly adjustments: More responsive to system changes
- Event-driven updates: Major system changes trigger recalculation
5.6 Implementation Variants
Static ALF (Annual Approach)
Similar to AEMO’s Current Method:
- Calculate average loss coefficients annually
- Apply fixed coefficients throughout the year
- Base calculations on expected annual operation patterns
Advantages:
- Predictable loss factors for financial planning
- Comprehensive annual analysis
- Familiar implementation approach
Dynamic ALF (Real-Time Approach)
Adapted for Real-Time Markets:
- Update average loss coefficients more frequently (monthly/quarterly)
- Embed coefficients in real-time optimization
- Maintain linear programming structure
Implementation in LMP Markets: \(LMP_{i,t} = \lambda_{ref,t} + \text{Congestion Component} + \alpha_i\)
Where $\alpha_i$ is the average loss coefficient for location $i$.
Hybrid Approaches
Combining Static and Dynamic Elements:
- Static ALF for long-term financial planning
- Dynamic adjustments for operational variations
- Separate mechanisms for different time horizons
5.7 Practical Implementation Considerations
Transition from Current Systems
Gradual Implementation Strategy:
- Parallel Calculation: Compute ALF alongside existing MLF
- Impact Analysis: Assess financial effects on market participants
- Stakeholder Consultation: Industry review and feedback process
- Phased Deployment: Gradual transition over multiple years
Contract and Hedging Implications:
- Existing contracts based on MLF assumptions
- Transition arrangements for financial instruments
- Updated risk management approaches
Regulatory and Market Design Issues
Rule Changes Required:
- Market operator calculation methodologies
- Settlement procedure modifications
- Participant registration and compliance requirements
Coordination with Other Reforms:
- Integration with transmission planning processes
- Alignment with renewable energy policies
- Coordination with market design improvements
Section 6: Real AEMO Data Analysis - ALF Implementation Scenario
6.1 Current AEMO MLF System Performance
Having established the mathematical foundations of both marginal and average loss factor systems, we now examine what would happen if AEMO implemented Average Loss Factors using real market data and operational evidence.
AEMO’s MLF Publication Record
AEMO publishes annual Marginal Loss Factor determinations with comprehensive data that allows analysis of system performance and potential alternatives. The available data provides insights into:
- Year-over-year MLF volatility patterns
- Regional variations in loss factor assignments
- Generator-specific impacts of MLF changes
- Mathematical relationship between MLF allocations and actual system losses
Data Sources for Analysis:
- AEMO Annual MLF Determination Reports (2019-2024)¹
- AEMO Forward Looking Loss Factor Methodology documents²
- AEMO Market Settlement Data from NEMWEB³
- AEMO Transmission Loss Factor explanatory statements⁴
¹ AEMO, “Marginal Loss Factors” annual publications, 2019-2024 ² AEMO, “Methodology for the Calculation and Application of Forward-Looking Loss Factors”, various versions ³ AEMO, “National Electricity Market Web” settlement data archives ⁴ AEMO, “Transmission Loss Factor Explanatory Statements”, annual publications
MLF Volatility Analysis from Published Data
AEMO’s published MLF determinations show significant year-over-year variations that create financial uncertainty for market participants.
Observable Volatility Patterns: According to AEMO’s published explanatory statements, MLF changes are driven by multiple factors including:
- New generation connections affecting regional power flow patterns⁵
- Transmission network augmentations changing electrical distances⁶
- Generator retirement or commissioning altering dispatch patterns⁷
- Changes in demand forecasts and regional consumption patterns⁸
Regional Variation Examples: AEMO’s MLF publications show systematic patterns:
- Connection points in load centers typically receive MLFs closer to 1.0⁹
- Remote generation areas often assigned lower MLFs reflecting transmission distances¹⁰
- Renewable Energy Zones show varying MLFs based on transmission infrastructure¹¹
⁵ AEMO, “2024-25 MLF Explanatory Statement”, Section 3.2 ⁶ AEMO, “Understanding Transmission Network Changes”, MLF Methodology ⁷ AEMO, “Impact of Generation Changes on MLFs”, various annual reports ⁸ AEMO, “Demand Forecast Impact on Loss Factors”, MLF documentation ⁹ AEMO, “Regional MLF Patterns”, explanatory materials ¹⁰ AEMO, “Distance-Based Loss Factor Relationships”, technical documentation ¹¹ AEMO, “Renewable Energy Zone MLF Analysis”, recent determinations
IRSS and Mathematical Over-Recovery Evidence
AEMO’s own documentation acknowledges the mathematical over-recovery inherent in marginal loss factor methodology.
AEMO’s Explanation of IRSS: AEMO educational materials state that because marginal losses are larger than average losses, settling prices based on marginal losses leads to AEMO recovering more from customers than needed to pay generators, creating the IRSS¹².
IRSS Redistribution Mechanism: According to AEMO’s settlement procedures, the Intra-Regional Settlement Surplus is redistributed through transmission network service provider revenue adjustments¹³. However, the ultimate beneficiaries and complete flow-through effects require deeper investigation to understand fully.
Mathematical Verification: The factor-of-2 mathematical relationship can be verified in AEMO’s system by examining:
- Total MLF-based revenue allocation to transmission losses
- Actual transmission losses as percentage of total generation
- The ratio between allocated costs and actual loss costs
¹² AEMO, “Understanding Transmission Loss Factors”, Educational Materials, 2023 ¹³ AEMO, “Settlement Procedures”, National Electricity Rules implementation
6.2 Quantitative ALF Implementation Analysis
Scenario Framework
To analyze potential ALF implementation, we examine what would change if AEMO replaced its current MLF methodology with Average Loss Factor calculation while maintaining all other aspects of the National Electricity Market design.
Analysis Approach:
- Use AEMO’s published MLF data as baseline for comparison
- Apply ALF mathematical principles to same network and generation data
- Estimate financial impacts on different generator types and market participants
- Assess implementation complexity and transition requirements
Key Assumptions for Analysis:
- Network topology and electrical characteristics remain unchanged
- Generation mix and capacity remain as currently registered
- Demand patterns and regional distribution unchanged
- ALF coefficients calculated using historical generation-weighted methodology
ALF Coefficient Estimation Methodology
Using AEMO’s published data and methodology documents, we can estimate how Average Loss Factors would be calculated:
Step 1: Historical Generation Analysis
- Extract generation patterns by connection point from AEMO settlement data
- Weight loss attribution by actual generation output over analysis period
- Account for seasonal and operational variations in generation patterns
Step 2: Network Loss Attribution
- Use AEMO’s published Power Transfer Distribution Factor approach
- Apply to historical flow patterns to determine loss causation
- Allocate transmission losses proportionally to generation contribution
Step 3: Average Coefficient Calculation For each generator $g$: \(\alpha_g^{estimated} = \frac{\text{Historical loss attribution}}{\text{Historical generation output}}\)
Step 4: Revenue Neutrality Verification Check that estimated coefficients satisfy: \(\sum_g \alpha_g^{estimated} \times \text{Expected Generation}_g \approx \text{Expected Total Losses}\)
Comparative Financial Impact Analysis
Generator-Level Impact Assessment
Coal Generators: Based on typical MLF assignments to coal generation connection points:
- Current MLF range: Varies by location and vintage of connection
- Estimated ALF impact: Generally lower effective loss charges due to elimination of factor-of-2 over-recovery
- Financial benefit: Reduced loss-related costs in generator settlements
Gas Generators:
- Current MLF assignments: Location-dependent, often in load centers
- Estimated ALF impact: Moderate reduction in loss charges
- Operational benefit: More predictable loss cost components for dispatch decisions
Renewable Generators:
- Current MLF challenges: High volatility as new connections affect regional patterns
- Estimated ALF benefit: Greater stability in loss factor assignments year-over-year
- Investment impact: More predictable revenue streams for financial planning
System-Wide Financial Flow Analysis
Current MLF System Financial Flows:
- Generators pay MLF-adjusted settlement amounts to AEMO
- AEMO collects approximately 2× actual transmission losses
- Excess revenue (IRSS) redistributed through transmission charge offsets
- Complex accounting and settlement processes manage the redistribution
Estimated ALF System Financial Flows:
- Generators pay ALF-adjusted settlement amounts to AEMO
- AEMO collects approximately 1× actual transmission losses
- No excess revenue requiring redistribution
- Simplified settlement with direct cost recovery
Regional Analysis of ALF Implementation
Queensland Impact Assessment
Queensland’s generation mix includes significant coal generation, gas peaking plants, and growing renewable capacity. ALF implementation would affect different connection points differently:
Coal Generation Impact:
- Typically assigned MLFs reflecting distance from major load centers
- ALF approach would likely reduce effective loss charges
- Regional generation competitiveness could improve
Renewable Generation Impact:
- Current MLF volatility creates revenue uncertainty
- ALF stability would benefit renewable investment business cases
- Renewable Energy Zone development could proceed with greater certainty
New South Wales Impact Assessment
NSW’s diverse generation portfolio and interconnection with multiple regions creates complex MLF patterns:
Thermal Generation:
- Hunter Valley generators currently receive location-specific MLFs
- ALF implementation would likely reduce total loss-related charges
- Retirement decision economics could be affected
Renewable Developments:
- Western NSW renewable projects face MLF volatility challenges
- ALF approach could improve investment attractiveness
- Transmission investment coordination could be simplified
Victoria, South Australia, and Tasmania
Each region would experience different impacts based on:
- Local generation mix and network topology
- Interconnector flow patterns and regional trade
- Existing transmission infrastructure and planned augmentations
Renewable Energy Investment:
- Revenue stability: Reduced year-to-year volatility in loss factors
- Financial planning: More predictable cash flows for project finance
- Risk assessment: Simplified transmission loss risk evaluation
Transmission Planning Integration:
- Simplified modeling: Linear programming structure easier to integrate
- Scenario analysis: Enhanced ability to test different development pathways
- Coordination benefits: Alignment with Integrated System Plan objectives
Conclusion
Summary of Key Findings
This comprehensive analysis has demonstrated several critical insights about marginal loss factor systems and potential alternatives:
Universal Mathematical Properties
Factor-of-2 Over-Recovery: All marginal loss factor systems, whether implemented as static annual factors (AEMO) or dynamic real-time pricing (US ISOs), mathematically create exactly double the revenue collection compared to actual transmission losses. This occurs due to the quadratic nature of transmission loss physics combined with marginal cost pricing principles.
Mathematical Universality: The factor-of-2 relationship appears across all market designs, geographic scopes, temporal resolutions, and network topologies. This is not an implementation choice but a mathematical consequence of the optimization structure used in all marginal loss factor systems globally.
Redistribution Necessity: All marginal loss factor systems require complex redistribution mechanisms (IRSS in Australia, revenue neutrality in US markets) to handle the systematic over-recovery, adding operational complexity and creating opaque financial flows.
Alternative Framework Benefits
Average Loss Factor Approach: The ALF methodology addresses the fundamental over-recovery issue by replacing quadratic loss terms with linear average loss coefficients in the optimization objective. This transforms the problem from Quadratic Programming to Linear Programming while maintaining locational efficiency signals.
Revenue Neutrality: ALF systems achieve approximate revenue neutrality by design, eliminating the need for complex redistribution mechanisms while providing more predictable loss cost allocation for market participants.
Computational Advantages: Linear programming formulations offer superior numerical properties, faster solution times, and greater operational flexibility compared to current quadratic programming approaches.
Final Observations
The mathematical analysis presented demonstrates that the current approach to transmission loss allocation in electricity markets creates systematic inefficiencies that could be addressed through alternative methodologies. While the theoretical foundations of marginal cost pricing remain sound, the practical implementation challenges and mathematical over-recovery issues suggest that simpler, more robust approaches may provide superior outcomes for market participants and consumers.
The Average Loss Factor framework offers a mathematically rigorous alternative that maintains economic efficiency signals while eliminating the operational complexity and systematic over-recovery inherent in current marginal loss factor systems. For Australia’s National Electricity Market, which faces ongoing challenges with renewable energy integration, transmission planning, and market design evolution, ALF implementation could provide a foundation for more efficient, transparent, and robust market operations.
The mathematical foundation established in this analysis attempts to provide a foundational knowledge about the future of electricity market design in Australia and internationally.