When you witness a magnet pulling a piece of iron, you are seeing one of the most profound "glitches" in classical physics. To understand why that piece of metal moves, we must dismantle our classical intuition and rebuild it using the tools of Dirac, Pauli, and Heisenberg.
1. The Paradox: Why the Lorentz Force is "Lazy"
In classical electromagnetism, the force exerted on a charge moving with velocity in a magnetic field is given by the Lorentz force law:
By definition, this force is always perpendicular to the velocity vector (). Since power is defined as the rate of doing work (), the magnetic force performs zero work.
Yet, when a magnet attracts a piece of metal, the metal clearly gains kinetic energy. If the magnetic force cannot do work, what is actually pulling the metal? The answer lies in the fact that magnetism is not merely a classical force, but a quantum relativistic correction.
2. The Dead End: The Bohr-van Leeuwen Theorem
Before we find the solution, we must prove that classical physics is incapable of producing magnetism. This is the Bohr-van Leeuwen Theorem.
Consider a system of electrons. The magnetic moment is defined by the orbital motion of charges:
Crucially, the total magnetization in the -direction is a linear function of the generalized velocities :
In an electromagnetic field, the Hamiltonian (total energy) is given by:
Using Hamilton’s equations of motion, we have . The thermal average of the magnetization is calculated via the canonical partition function:
Let us focus on the momentum integral for a single term . Since depends only on coordinates, we can pull it out and integrate over the momentum :
This integral is mathematically equivalent to integrating a total derivative. By recognizing that (where ), we have:
Since the kinetic energy term goes to infinity as momentum , the Boltzmann factor vanishes at the boundaries. Thus:
Result:. The physics is merciless: The vector potential shifts the momentum, but since we integrate over all possible momenta from to , this shift contributes nothing to the total integral. Classical physics predicts that magnets cannot exist.
3. Beyond the Schrödinger Equation
The Schrödinger equation is built upon the non-relativistic energy-momentum relation . If we attempt to use the relativistic relation by substituting quantum operators and , we obtain the Klein-Gordon Equation:
This equation can be written more compactly using the d'Alembertian operator, , which is the Minkowski spacetime generalization of the Laplacian operator:
However, when first proposed, the Klein-Gordon equation was nearly abandoned due to two significant conceptual problems that arose from interpreting as a single-particle wave function, analogous to its role in the Schrödinger equation.
On one hand, the relativistic energy-momentum relation is quadratic in energy, leading to two solutions: . The existence of negative energy states was deeply problematic. It implied that a particle could continuously radiate energy by transitioning to ever-lower negative energy levels, suggesting that no stable ground state existed for matter.
On the other hand, the wave function in quantum mechanics is used to construct a conserved probability current, , where is the probability density. For the Schrödinger equation, the probability density is always non-negative. For the Klein-Gordon equation, the derived conserved density is:
Because the equation is second-order in time, the values of and can be chosen independently at any given initial time. This allows for conditions where can be negative, which is nonsensical for a probability density. A particle cannot have a negative probability of being found somewhere.
These problems stem from the second-order nature of the time derivative. Dirac's goal was to find a new equation that was simultaneously first-order in time (like the Schrödinger equation) and relativistically covariant. The natural approach is to write a Hamiltonian linear in momentum with to-be-defined coefficients:
where are the momentum operators. The corresponding wave equation is:
For this equation to be relativistically consistent, any free-particle solution to it must also satisfy the relativistic energy-momentum relation (i.e., the Klein-Gordon equation). This requires that when the Dirac operator is applied twice ("squaring" the equation), it yields the Klein-Gordon operator:
Expanding the left side (noting that commute with each other, but the coefficient matrices do not necessarily commute):
Comparing the coefficients on both sides, we derive the algebraic requirements for and , known as the Clifford Algebra:
To make the equation manifestly covariant under Lorentz transformations, we define the Gamma matrices :
()
Substituting these back, we obtain the concise covariant form:
Using the properties of and , we can derive the core properties of :
Time component:
Space components:
Mixed terms ():
Combining these results, the Gamma matrices satisfy the famous Anti-commutation Relation:
where is the Minkowski metric.
The smallest irreducible representation satisfying this algebra involves matrices. We can deduce this by elimination:
1D (Scalar): Impossible. Scalars commute, so they cannot satisfy anti-commutation relations like unless they are zero, but forbids that.
2D: We can find at most 3 anti-commuting matrices (the Pauli matrices ). However, we need 4 anti-commuting matrices ( to ).
3D: Since and , the eigenvalues must come in pairs of and . This implies the dimension of the matrix must be even.
4D: This is the first even dimension that can accommodate more than 3 anti-commuting matrices. In 4D space, we can construct up to 5 mutually anti-commuting matrices (, and ).
In 4D, the most common choice is the Dirac Representation (Standard Representation), which uses the identity matrix and Pauli matrices :
This is a profound result: the requirement for a linear, relativistic wave equation forces the wave function to have four components, which we now understand as describing the electron (spin up/down) and its antiparticle, the positron (spin up/down). Dirac attempted to solve the negative probability problem but inadvertently unlocked the door to spin. This demonstrates that magnetism is not an added property of matter, but an inevitable consequence of spacetime symmetry.
4. Coupling with Electromagnetic Field
Now we consider the case with an electromagnetic potential . We need to perform a local gauge transformation in the Dirac equation. Momentum substitution: Replace momentum with the Kinetic Momentum: , where is the magnetic vector potential. Energy substitution: Replace the energy operator with: , where is the electric scalar potential. The equation becomes:
To handle 4D spacetime more intuitively, we usually write this in covariant form. Introducing the Gamma matrix definitions , and combining the 4-momentum operator with the 4-potential , the equation can be rearranged as:
Using the covariant derivative , it can be written in the minimalist form:
We now wish to solve this four-component spinor equation. The simple block form of the gamma matrices allows us to group the four components into pairs. Furthermore, in the non-relativistic limit, the rest energy is the dominant term. We write the wavefunction as a combination of a "large component" and a "small component" (both are 2-component spinors), explicitly extracting the time evolution of the rest energy:
Applying the product rule to the time derivative on the left side:
Substituting this into the Dirac equation and using the matrix form in the standard Dirac representation, we cancel the exponential term on both sides to obtain:
where is the kinetic momentum. We decompose the above equation into two coupled equations:
In the non-relativistic limit, the electron's kinetic and potential energies are much smaller than its rest energy, i.e., and . Thus, the equation for the small component approximates to:
This explains why is called the "small component": its magnitude is roughly times that of the large component. Substituting the expression for back into the equation for the large component :
Here lies the key to the emergence of spin. Using the Pauli matrix identity :
We calculate the operator cross product acting on a test function :
Since and , the remaining terms are:
Therefore:
Finally, we have fully derived the Pauli Equation, which explicitly includes the Zeeman term :
Clearly, an extra term has appeared in the Hamiltonian:
This is the origin of spin. If we hadn't introduced the matrices (i.e., the Spin-0 Klein-Gordon case), the kinetic operator term would simply be . This term would not produce a linear coupling with the magnetic field , degenerating instead into the standard electromagnetic coupling Hamiltonian for a spinless particle: . It is precisely because the relativistic covariance of the electron wavefunction requires a matrix structure that the non-commutativity of is transformed into a magnetic energy term. In simple terms: introducing the matrix mathematically adds an "internal axis of rotation" to the particle. Without it, the particle is a completely "isotropic" point in space. The matrix defines the non-commutativity of operators; in a Spin-0 world, the three components of momentum do not commute in a magnetic field, but their effect is "external" (changing the particle's trajectory). Introducing the matrix directly couples this non-commutativity (the magnetic field strength ) to the internal dimensions of the wavefunction.
5. Universal Covering between SU2 and SO3
We have already observed the "emergence" of spin from the dynamical level. However, as an intrinsic property, spin should theoretically not require an external electromagnetic field to manifest; fundamentally, its existence must be linked to symmetry and transformation. Why must the wavefunction be operated on by matrices? Why is it a two-component spinor? This requires us to delve into the kinematic underpinnings—specifically, the group-theoretical basis of spacetime symmetry. Even without considering electromagnetic fields, as a physical object, when we rotate the laboratory coordinate system by an angle , the electron's wavefunction must inevitably change. It is precisely this "transformation rule under rotation" that defines spin. Before diving into the physics, let us briefly introduce the most important groups: SU(2) and SO(3). These are Lie groups and hold an extremely important place in physics.
The basic definition of SU(2) is:
If we use real parameters and let to describe it:
The constraint becomes , indicating that SU(2) as a manifold is , a 3-sphere (hypersphere). Its -fibration is described as:
This can be described using two opposing conical surfaces for and an axis . At or , one parameter becomes degenerate. It can also be described as a "doughnut" (solid torus) that scales with , causing a parameter to degenerate at the endpoints. When , the doughnut is a circle with zero width; only is valid along the circle, while is invalid because the circle has no width. When , the doughnut becomes a sphere with no hole, so becomes invalid and only is effective.
The spherical coordinate system description is:
SU(2) can also be expressed by Pauli matrices:
Combining this further with spherical coordinates, we have:
The basic definition of SO(3) is:
SO(3) is more intuitive; it represents the rotation operations we can see and touch. As a manifold, SO(3) can be viewed as a solid ball of radius formed by the endpoints of with antipodal identification. Its abstraction lies in this antipodal identification. Although its origin is the simple fact that rotating counter-clockwise around a fixed axis is the same as rotating clockwise, this antipodal identification results in the solid ball being a connected manifold but not a simply connected one (i.e., not every closed curve or loop in the space can be continuously shrunk to a point). The solid ball with antipodal identification has a name: Real Projective Space of 3 dimensions, denoted as .
Mathematically, a representation of a group on a vector space is a homomorphism from the group to the general linear group (the group of all invertible transformations on ): . For Lie groups, the map is also required to be continuous. Projective representations arise because, in quantum mechanics, physical states are described by rays in Hilbert space (i.e., and represent the same physical state). Therefore, the group multiplication law only needs to hold up to a phase factor:
where is a complex number with modulus 1, called the group exponent. Bargmann's Theorem (1954) provides a rigorous mathematical framework for projective representations: for a Lie group satisfying (including SO(3) and the Lorentz group), all continuous projective unitary representations can be "lifted" to ordinary unitary representations of a central extension group . For SO(3), where the "phase ambiguity" cannot be removed simply, we solve this by finding its Universal Covering Group, SU(2), and converting the projective representation of SO(3) into an ordinary representation of SU(2).
The concept of the universal covering group introduced here highlights the profound connection between SO(3) and SU(2). In topology, the universal covering space of a space is like an "upgraded version" of it, possessing two core features: Simply Connectedness (all loops in can be shrunk to a point; no topological holes) and Local Isomorphism (in local regions, looks exactly like , but globally is often "larger" and covers in an manner).
Why do SU(2) matrices generate SO(3) rotations? Here is a classic construction method. We map a vector in 3D space to a second-order traceless Hermitian matrix:
(where are the Pauli matrices). Note that . Let a matrix in SU(2) act on via the following transformation: . Since is unitary and has a determinant of 1, this transformation preserves the tracelessness and Hermiticity of , and preserves the determinant: . This means , i.e., the transformation preserves the length of the vector, so it describes a 3D rotation. Observing the transformation formula , if we replace with : , we find that and produce exactly the same rotation effect. This is the algebraic root of the 2:1 covering: every rotation in SO(3) corresponds to two points in SU(2). This explains why rotating by does not return to the origin (in SU(2), it has only traveled half a circle), while rotating by is required to return to the origin (completing a full circle in SU(2)). That is to say, SO(3) itself has a "hole" (its fundamental group is ), while SU(2) (i.e., ) is simply connected (fundamental group is 0) and has no topological holes.
The second condition of the universal cover, local consistency, leads to another major feature of SU(2) and SO(3): they are locally isomorphic near the identity element. This means that if you look only at "infinitesimal" rotations, or rotate only a tiny bit, the two groups are exactly the same. It is only when you rotate a large amount (e.g., ) to explore the "full picture" of the group that you discover they are different (one returns to the start, the other goes to ). Mathematically speaking, this is because they possess the exact same Lie Algebra, i.e., an isomorphism of the tangent spaces at the identity: . From solving the Schrödinger equation, we know that the 3 generators of SO(3) are (corresponding to infinitesimal rotations about the x, y, z axes), and their commutation relations are: . This formula defines the essence of 3D rotation; the so-called generators form a basis for the Lie algebra.
For the SU(2) group, let us now solve for its generators. Assume an infinitesimal transformation:
For this to belong to SU(2), there is a unitarity constraint: . Thus, must be a Hermitian matrix, which is physically observable. There is also a special constraint: using the formula , we have . So must be a traceless matrix. The matrices that fit these conditions are exactly the Pauli matrices , which form a complete basis for the Lie algebra . Thus, the generator must be proportional to . Since , we find this differs from by only a factor of . This already demonstrates that the Lie algebras of SU(2) and SO(3) are isomorphic. If we take , it becomes the standard , exactly the same commutation relations as . This gives us a self-consistent theory of angular momentum, where in the physical world, total angular momentum exists. If spin is to qualify as "angular momentum" and be additive with to form a conserved quantity, must follow the exact same algebraic rules as . Since orbital angular momentum is defined by spatial coordinates and its commutation relations are fixed (derived from the commutation of and ), we have no choice but to let . Beyond theoretical consistency, real-world experimental results confirm this: when we perform the Stern-Gerlach experiment, measuring the deflection of electrons in a magnetic field, the measured physical values are . This directly proves that the operator representing the physical observable must have eigenvalues of . Mathematically, only the matrix has eigenvalues of (since the eigenvalues of are ).
Returning to representations: for Lie groups, a useful property of generators is that any finite transformation can be obtained from the generator via the exponential map. If is an element of the Lie algebra , then elements of the group can be written as:
Here is the angular momentum operator (matrix) we discussed. Note that this expression involves a common "abuse of notation" or shorthand in physics. Strictly speaking, the exponential map maps abstract Lie algebra elements to abstract Lie group elements. However, the physical formula is actually an operation within the representation space (matrix space). Since here is the matrix representation of the generator, the result is naturally the matrix representation of the group element.
Whether we are dealing with SO(3) or SU(2), their Lie algebras are isomorphic. This means they share the same set of generator commutation relations: (taking ). We want to find all finite-dimensional irreducible representations allowed by this set of algebraic rules. Define the ladder operators:
Introduce the eigenstates of such that:
Calculating the commutator:
This implies act as "ladders" for the eigenvalues:
If is an eigenvalue, then are also eigenvalues. However, since we are looking for finite-dimensional representations, the spectrum of eigenvalues must have an upper bound and a lower bound .
Using the operator identity acting on the highest weight state :
For convenience, we label the maximum weight as , i.e., . So the eigenvalue of the Casimir operator is . Similarly, using acting on the lowest weight state :
Solving the equation , we get two solutions:
Since , we must have . Climbing from to by adding 1 each step, we must reach the top in an integer number of steps :
We arrive at the conclusion that, based solely on the Lie algebra structure, the allowed values for are . However, the Lie algebra structure is only a local property. We must now test these results against the global group structure. The core criterion for this test is single-valuedness: If we transform a group element along a closed path back to the starting point (the identity), its representation matrix must also return to the identity matrix (for an ordinary representation). SO(3) is the rotation group in 3D space. Rotating by () around any axis (say, the -axis) restores physical space completely: , which is the group identity. For an ordinary representation of SO(3), it must satisfy: (the identity matrix). Substituting the formula derived from the Lie algebra, where is diagonal in the -basis with diagonal elements : . To make this matrix equal to the identity , every diagonal element must be 1: . If is an integer (), then is an integer, and the condition is met. However, if is a half-integer (), then is a half-integer, and . Therefore, half-integer spins are strictly forbidden in ordinary representations of SO(3).
However, the geometric structure of SU(2) is different from SO(3). It is the Universal Covering Group of SO(3) (a 2:1 cover). In SU(2), the parameter corresponds not to the identity element, but to ; only a rotation of corresponds to the identity element. We find that the behavior of perfectly matches the behavior of the SU(2) group itself. We have effectively obtained an instance of Bargmann's Theorem on SO(3) and SU(2): the projective representations of the non-simply connected Lie group SO(3) are equivalent to the ordinary representations of its universal covering group SU(2). The final mapping relationship is:
Spin j
In Lie Algebra
In SU(2)
In SO(3)
Physical Particle
Integer ()
Exists
Ordinary Rep. (but not faithful, cannot distinguish )
Ordinary Rep.
Bosons (Photons, etc.)
Half-Integer ()
Exists
Ordinary Rep. (Faithful Rep.)
Projective Rep. (Multi-valued)
Fermions (Electrons, etc.)
"Spin" is able to "emerge" from this abstract mathematical structure because quantum mechanics defines "physical state" more leniently than classical mechanics, thereby releasing topological degrees of freedom that were masked by classical physics.
Symmetry (Root): The universe possesses rotational symmetry, leading to the existence of the Lie algebra .
Quantization (Opportunity): The nature of probability waves allows for "projective representations," enabling the "half-integer parts" forbidden by classical physics in the Lie algebra to survive.
Intrinsic Nature (Formation): These surviving half-integer representations cannot correspond to any spatial motion, and thus can only be interpreted as the particle's innate intrinsic angular momentum.
Now let us specifically calculate what the representations are for different . We use the exponential map:
where is the rotation axis unit vector and is the rotation angle.
Simplest case: scalar representation. Dimension . The basis has only one state . Since can only be 0, the generator . The ladder operators acting on the highest/lowest weight states are 0, so , and thus . The exponential map gives the representation , also known as the trivial representation. This is a scalar; no matter how you rotate, the value is always multiplied by 1, remaining unchanged.
When , the dimension is . We already know the generator is . To calculate higher powers of , recall the property of Pauli matrices: (Identity matrix). Thus, the power law for generators is:
The general term formula is:
Summing the series by splitting the exponential series into even and odd parts:
Even term coefficient: . Odd term coefficient: . Finally, we get:
This is the representation for . It maps rotation operations to complex matrices. Checking : Substitute , . The result is .
When , the dimension is . We need matrices. In the angular momentum basis defined in physics (Cartesian basis), the generators satisfy . For example, the generator for rotation around the -axis, :
For an arbitrary axis , let matrix . Calculating powers of directly (other directions are similar):
We find a pattern: for generators, they satisfy the characteristic equation . This means: Odd terms (): ; Even terms (): ; term: (Identity matrix). Expanding the Taylor series again, but this time we must separate because .
Odd term coefficient: . Even term coefficient: . Result:
This is the representation for (Rodrigues' rotation formula in physics form). It maps rotation operations to real matrices (although contains , is a real matrix). Checking : Substitute , , .
Generally, we can establish generators and representations for all . The construction of generators for all relies on three core matrix element formulas for angular momentum operators in quantum mechanics. As long as we have these three formulas, we can write out matrices for or even . First, is a diagonal matrix:
Then (raising operator) is a superdiagonal matrix:
(lowering operator) is a subdiagonal matrix: It is the transpose of (in the real case). And and are composed of :
For example : Spin-3/2 representation. This belongs to fermions, similar to electrons, but has 4 components. Commonly seen in baryons or gravitinos in supergravity. Dimension: . Construct generator (diagonal):
(raising operator coefficients) requires calculating , where , which is . : ; : ; : . So:
Using :
Representation: This is a 4×4 unitary matrix. When rotating by 2π, since the diagonal elements are half-integers, it becomes −I4×4. So j=3/2 is also a faithful representation of SU(2) and a projective representation of SO(3).
Thus far, we have completely narrated the essence of spin from the perspective of symmetry and group theory. However, it seems we did not need relativistic corrections as in the previous chapter. Unlike the previous chapter where we started from the Dirac equation and directly derived the 4-component wavefunction, here we started from spatial rotation (SU(2)/SO(3)) and only derived the 2-component spinor (Pauli spinor) for j=1/2. Where did the other two components go? The reason lies again in relativistic effects; the current symmetry analysis only considered spatial rotations and did not consider Lorentz boosts. Only by introducing the Lorentz Group can we explain why the electron must be the direct sum of "left-handed" and "right-handed" SU(2) representations (2+2=4), thereby forming a perfect closed loop back to the structure of the Dirac equation.
6. Lorentz Group
To achieve complete spin, we must begin considering the true symmetry group: the Lorentz Group, which includes both rotations and boosts. When we attempt to find the "fundamental representation" of the Lorentz group, something extremely curious happens: the algebraic structure splits apart.
The definition of the Lorentz Group is:
Fundamentally, it is the group of linear transformations that preserve the metric of Minkowski spacetime. From the metric-preserving condition , we can derive a constraint on the component :
This means that Lorentz transformations must have either or , so the group is already disconnected. This allows us to divide the Lorentz group into two manifolds: and . The former is called the orthochronous Lorentz group. The latter does not contain the identity element and thus does not form a group; it is called the antichronous branch of the Lorentz group.
From the metric-preserving condition, we can also determine the value of the determinant:
Transformations with are denoted as and called the proper Lorentz group, while those with are called the improper branch. Combining these two considerations, we can divide the Lorentz group into four connected manifolds. However, in practice, we only need to study the proper orthochronous branch . This is because the other three branches can be obtained by acting on with two specific Lorentz transformations: time reversal and parity inversion . Moreover, real-world reference frame transformations are strictly orthochronous and proper.
We focus on the proper orthochronous Lorentz group. In this connected component, any transformation can be written as an exponential map from the identity. Just as has 3 rotation generators, has a total of 6 degrees of freedom (3 rotations + 3 boosts), corresponding to 6 generators. Considering an infinitesimal transformation , similar to the process above, we can write out two sets of generators: Rotation generators , corresponding to spatial rotations (these are the familiar angular momentum operators); and Boost generators , corresponding to velocity transformations along the axes. These 6 generators satisfy the Lorentz Lie algebra as follows:
Pure rotations are closed ( subalgebra):
Relation between rotations and boosts (Boost operators themselves rotate like vectors): $$[J_i, K_j] = i \epsilon_{ijk} K_k$$Boosts are not closed among themselves (The composition of two boosts in different directions is not just a boost but also produces a rotation, i.e., Thomas precession) (Note: the negative sign here is a characteristic manifestation of the spacetime metric , distinguishing it from the algebra of ):
At this point, the algebraic structure still looks coupled ( and are intertwined). To find irreducible representations, we introduce a non-unitary basis change (Complexification). Define two new sets of operators and :
Let's calculate the commutation relations for these new operators. First, look within :
Similarly, we can verify that . The most shocking result lies between and :
This means: upon complexification, the Lie algebra of the Lorentz group splits into the direct sum of two mutually independent algebras.
This is a massive simplification in group theory. Since we already know the representations of inside out (labeled by spin ), irreducible representations of the Lorentz group can be uniquely labeled by a pair of half-integers or integers . According to this decomposition, the most fundamental spinor representation is no longer unique; instead, there are two most basic choices (fundamental representations), corresponding to taking for one and for the other. This introduces the concept of chirality.
Left-handed Weyl Spinor corresponds to the label . It behaves as spin under and as a scalar under . This is a 2-component complex vector, denoted . In this representation, and . Solving for the physical generators gives:
Right-handed Weyl Spinor corresponds to the label . It behaves as a scalar under and as spin under . This is also a 2-component complex vector, denoted . In this representation, and . The physical generators are:
Note the difference in sign for ! This demonstrates that while and behave identically under spatial rotation () (both are spin ), their transformation properties under Lorentz Boosts () are diametrically opposite.
Since and are both 2-component objects, why do we need 4 components? The reason lies in Parity (). The parity transformation inverts spatial coordinates . is an axial vector (), so it remains invariant under : . is a polar vector (), so it changes sign under : . Substituting this into the definition of , we find that the parity transformation swaps these two algebras:
This means parity transforms the left-handed representation into the right-handed representation . If we want to describe a particle like an electron that has both spin and mass, and obeys parity conservation (under electromagnetic forces), we cannot simply pick one. We must take their "direct sum" together. Thus, the Dirac spinor, as a representation of extended by the parity operator, is precisely the direct sum of these two fundamental representations:
This explains why there are 4 components: two components come from the left-handed sector, and two components come from the right-handed sector; they are tightly coupled together by the mass term and parity transformation. The Pauli spinor we saw earlier with is merely a silhouette of this relativistic object in the rest frame (or non-relativistic limit).
Incidentally, the Weyl spinors here are deeply connected to the matrix mentioned earlier in the context of gamma matrices. In fact, the Hermitian operator is precisely the operator used to "identify" and "define" Weyl spinors. Without , we could not mathematically distinguish what is "Left-handed" and what is "Right-handed". In Dirac theory, is called the Chirality Operator. It has a crucial algebraic property: it anti-commutes with all (). However, it commutes with the generators of Lorentz transformations (), meaning is a conserved quantity of the Lorentz group representation (for massless particles), and we can use its eigenvalues to classify spinors. A Right-handed Weyl spinor is a state with a eigenvalue of +1 (), and a Left-handed Weyl spinor is a state with a eigenvalue of -1 (). Thus, what is physically referred to as "left-handedness" and "right-handedness" mathematically refers to whether the eigenvalue of is -1 or +1. Since the Dirac spinor is a mixture (direct sum) of left and right, how do we "sift" the left-handed and right-handed parts out of a mixed individually? This requires using projection operators based on :
These two operators have the standard properties of projection operators (). Their function is to kill off one handedness component and keep only the other:
In particle physics calculations (especially weak interactions), you will often see terms like ; this is telling you: "This interaction only plays with left-handed spinors; right-handed spinors, please step aside." (This is precisely the mathematical expression of parity non-conservation). To make this relationship immediately clear, we can choose a special set of Gamma matrix forms called the Weyl Representation (or Chiral Representation). Unlike the Dirac representation mentioned earlier, in the Weyl representation, the Gamma matrices are block diagonal, which makes the Dirac spinor explicitly split into upper and lower Weyl spinors . This is the most commonly used perspective in high-energy physics. In contrast, in low-energy condensed matter physics, we commonly use the Dirac (Standard) representation, where and are deeply mixed, better reflecting the non-relativistic approximation of "large components" and "small components".
7. Magnetic Gradient Force
We have completed a long mathematical journey. From the derivation of the Dirac equation to the representation of the Lorentz group, we have established that the electron must possess spin and is a 4-component relativistic object. Now, let us return to the original paradox: if the Lorentz force does no work, then who is doing the work? To answer this question, we need to link microscopic spin to macroscopic force.
By taking the non-relativistic approximation of the Dirac equation, we naturally obtained the Pauli equation. Let us revisit the "Zeeman term" that appeared seemingly out of nowhere:
In classical physics, we define the relationship between magnetic moment and angular momentum as the gyromagnetic ratio. For orbital angular momentum, this relationship is:
If we attempt to use the same logic to define the "spin magnetic moment," we need to relate the spin operator to the magnetic moment. Recalling the definition of the spin operator in Section 5:
Substituting back into the Zeeman term , we get:
We write the general form of magnetic potential energy as . Comparing this with the equation above, we can read out the electron's spin magnetic moment:
If we write this in the general Landé g-factor form , we immediately arrive at the conclusion:
This is not a parameter fudged to fit experiments; it is a direct mathematical consequence of the spacetime symmetry of the Dirac equation. It implies: Electron spin generates a magnetic moment twice as efficiently as classical orbital motion.
With the magnetic moment , we can finally explain "who is doing the work." The classical Lorentz force indeed does no work. However, for an object with an intrinsic magnetic moment, its dynamics are governed by the potential energy . According to Hamiltonian mechanics, force is the negative gradient of potential energy:
Since spin is an intrinsic property and remains constant under spatial differentiation, we obtain:
This is the force that does the work, known as the Gradient Force. If the magnetic field is uniform (), the force is zero, and there is only torque. However, the magnetic field produced by a real magnet is non-uniform (the magnetic field lines diverge), so . This is a conservative force that converts the potential energy of the magnetic field-moment coupling into the object's kinetic energy. Therefore, a magnet attracting iron is essentially the quantized spin magnetic moment being acted upon by the gradient force in a non-uniform magnetic field. The Lorentz force is responsible for deflection, while the gradient force is responsible for doing work.
So, there really are two types of magnetic forces. From the perspective of symmetry, they correspond to two completely different symmetry mechanisms, touching upon the edge of Quantum Field Theory. In QFT, interactions are prescribed by symmetry:
The Lorentz Force stems from Local Gauge Symmetry. The electromagnetic interaction exists to maintain the local phase invariance of the wavefunction: . To compensate for the variation of phase with position , we must introduce the gauge field and the covariant derivative . The resulting equation of motion (the Lorentz force) essentially describes how the gauge field couples to the Current. This geometric constraint dictates that the force must be perpendicular to the four-velocity; projected into 3D space, this is . Its "no work" property is a direct manifestation of the geometric structure of gauge symmetry.
The Gradient Force stems from Broken Spatial Translational Symmetry. According to Noether's Theorem, force and work are closely related to spacetime symmetry: Momentum ConservationSpatial Translational Symmetry. When an electron is in a uniform magnetic field, the Hamiltonian does not explicitly contain position . The system possesses spatial translational symmetry, momentum is conserved (), and there is no net force. However, when an electron is in a non-uniform magnetic field (near a magnet), the field depends on position: . The existence of the magnet breaks the spatial translational symmetry (Homogeneity is broken). It is precisely this breaking of spacetime background symmetry that forces the electron to change its momentum in response to the energy gradient. Thus, the Lorentz force is the price paid to maintain internal gauge symmetry, while the work-doing gradient force is the product of external spacetime symmetry breaking.
Since we are now adopting the perspective of Quantum Field Theory, we must point out that while Dirac's is glorious, it is not the ultimate truth. In the Dirac equation, we treat the electron as a classical field coupling to the electromagnetic field. But in full Quantum Electrodynamics (QED), the vacuum is not empty. As an electron propagates, it constantly emits and absorbs Virtual Photons, and even creates electron-positron pairs. This means the interaction Vertex between the electron and the magnetic field is no longer just a simple point (Tree level), but contains infinite Loop corrections. Julian Schwinger calculated the first-order correction (the one-loop diagram shown above) in 1948, giving the famous formula:
where is the fine-structure constant. This shifts the theoretical value of to , which is astonishingly consistent with experimental measurements (accurate to 12 decimal places). This tiny deviation (the Anomalous magnetic moment) not only confirms the relativistic origin of but also reveals the deep physics behind magnetism: when we feel the pull of a magnet, we are not only witnessing the geometric attributes of spacetime (spin) but also touching the seething ocean of virtual particles in the vacuum.
8. Heisenberg Model
We now know that every electron is a tiny magnetic needle (). However, if you put a bunch of these tiny magnets together, thermal agitation at room temperature is sufficient to completely randomize their orientations, resulting in zero macroscopic magnetic moment (paramagnetism). To form ferromagnetism, there must be an extremely strong "coupling force" between spins that forces them to align. The classical magnetic dipole-dipole interaction is far too weak—only about one ten-thousandth of the thermal energy. The real power comes from the combination of the identical particle statistics (Spin-Statistics) we mentioned earlier and the Coulomb interaction. This is known as the Exchange Interaction.
To demonstrate the essence of this, let us consider the simplest model: a two-electron system (such as a Helium atom or electrons on two adjacent Iron atoms). Assume there are two electrons, 1 and 2, and two spatial orbitals and , where is localized near atom A and is localized near atom B. We assume these two orbitals are orthonormal: . Note that this orthogonality is a prerequisite assumption for the Heisenberg model we are about to derive. Even if they are not orthonormal, we can create two new orthonormal orbitals through a basis transformation. Assuming their overlap integral is small greatly simplifies the calculation of the two-electron system, but this does not mean there is no interaction between the two electrons, as the interaction involves exchange integrals which generally are not zero.
The total Hamiltonian of this system is , where is the single-electron part (kinetic energy + nuclear potential energy), and is the Coulomb interaction between the two electrons: . Note: there is absolutely no magnetic interaction term here, only pure electrostatic repulsion.
According to the Fermi statistics hypothesis for identical particles in quantum mechanics, the total wavefunction of the electrons must change sign (be antisymmetric) under the action of the particle exchange operator :
Since the total wavefunction consists of a spatial part and a spin part: . We first derive the spin part, and then obtain the spatial part based on the overall antisymmetry. We have two spin-1/2 particles (e.g., two electrons), so there are a total of possible product states (uncoupled basis). We want to add their spins together to see what the total spin looks like, finding the common eigenstates of the total spin operator and total magnetic quantum number . According to angular momentum addition rules, the total spin formed by two spins of can be: (Triplet, with 3 values: ) and (Singlet, with 1 value: ).
The Triplet corresponds to three components. The total magnetic quantum number is the sum of the magnetic quantum numbers of the two particles: . To get , the only possibility is both electrons are spin-up: . So, the first member of the Triplet is determined: . Then, using the lowering operator (), we get the intermediate state () from to derive . Using the total lowering operator acting on the state : , acting on the coupled state on the left gives:
Acting on the product state on the right gives:
Thus we obtain:
The lowest weight state () is also simple; only both down can give : . So the spin part of the Triplet is symmetric (does not change sign upon exchange), which means the spatial part must be antisymmetric.
The quantum numbers for the Singlet are . It must be some linear combination of the product states and with : . Since eigenstates with different quantum numbers must be orthogonal, the Singlet must be orthogonal to in the Triplet. Solving this gives:
The spin part of the Singlet is antisymmetric, so the corresponding spatial part must be symmetric. Summarizing:
Our goal is to find a mathematical expression containing only spin operators and such that when it acts on the Singlet and Triplet states, it automatically yields the corresponding energies and . To construct this Hamiltonian, the most natural building block is the dot product of the two spins . We need to calculate the eigenvalues of this operator for the Singlet and Triplet states. Define the total spin operator for the two-electron system: . Squaring the total spin operator allows us to solve for the dot product term: . Using the eigenvalue formula for the square of the angular momentum operator in quantum mechanics (omitting for brevity, or treating spin as dimensionless):
For a single electron ():
For the Singlet ():
For the Triplet (): . Now, substituting these values back into the dot product formula to calculate the eigenvalues:
Dot product value for Singlet:
Dot product value for Triplet:
We assume the effective Hamiltonian has the following linear form (this is the most general rotationally symmetric form): , where is just a constant energy shift independent of spin configuration, which can be discarded (or the energy zero point redefined) when studying phase transitions and spin dynamics. Substituting the data for Singlet and Triplet, we have . Defining the constant , we obtain the two-particle Hamiltonian:
If (): The coefficient is negative. The larger the dot product (parallel, +1/4), the lower the energy. This is Ferromagnetism.
If (): The coefficient is positive. The smaller the dot product (anti-parallel, -3/4), the lower the energy. This is Antiferromagnetism.
Now we generalize this two-particle interaction to the entire lattice. Assuming each electron only interacts with its nearest neighbors. We need to sum over all atoms in the lattice. To correct for double counting:
Finally, we must consider the interaction of each electron spin with an external uniform magnetic field . This is a single-body interaction and does not involve neighbors. Recalling our conclusion from the Dirac equation, the electron has a spin magnetic moment:
To make the formula more concise and universal, physicists define a natural combination of constants called the Bohr Magneton. The Bohr Magneton is the natural unit of magnetic moment in atomic physics. It is defined as:
This physical quantity contains three fundamental constants: elementary charge , Planck constant , and electron mass . It represents the magnitude of the orbital magnetic moment generated by a classical electron moving in the ground state orbit of a hydrogen atom. This is in SI units; in Gaussian units, it also includes the speed of light: . If we treat the spin operator as a dimensionless operator (i.e., eigenvalues are instead of ), then the true physical angular momentum is . Extracting this and combining it with the constants above:
When an electron is in an external magnetic field , its potential energy (Zeeman Energy) is given by the classical electromagnetism formula . Substituting the magnetic moment expression:
Physical Convention on Signs: In condensed matter physics, we usually want the Hamiltonian to reflect energy minima. Electrons are negatively charged, so the magnetic moment is anti-parallel to the spin . The lowest energy state is when the magnetic moment is parallel to the magnetic field . This means the spin is anti-parallel to the magnetic field . To avoid dealing with cumbersome negative signs, or to make spin look like it aligns "with" the field (defining to point in the direction of the magnetic moment rather than angular momentum), literature sometimes adjusts the definition. However, the standard derivation (keeping the electron's negative charge) gives the Zeeman term as or . Nevertheless, in the customary notation of the Heisenberg model, for mathematical symmetry and ease of discussion (e.g., assuming is negative or redefining the spin direction), the Zeeman term is typically written with a negative sign, indicating that spins tend to align along the field (this is a phenomenological treatment):
(This implies that energy is minimized when is in the same direction as . This implies we have redefined the spin direction, or taken to be negative. In phenomenological models, we only care about: which direction does the magnetic field tend to pull the spins.)
Now, we combine the two pieces of the puzzle: Internal Interaction (Exchange Energy generated by the Pauli principle and Coulomb force) and External Interaction (Coupling of magnetic moment with external field generated by relativistic quantum effects). Adding them together, we finally obtain the core Hamiltonian describing solid-state magnetism—the Heisenberg Model:
This formula is the cornerstone of modern magnetism. The first term () explains why magnets have magnetism (spontaneous magnetization, ordered alignment of spins). The second term () explains how magnets are controlled by the outside world (magnetization process, hysteresis loop). and link microscopic quantum constants () with macroscopic observable magnetic fields.
9. Ising Model
We have completed the construction of the microscopic mechanism (Dirac Spin Exchange Interaction Heisenberg Hamiltonian). Now, we must move from the microscopic to the macroscopic. To do this, we need to handle the Heisenberg Model. However, solving the Heisenberg Model exactly in two or three dimensions is extremely difficult (because it contains non-commuting operators). Therefore, we need to introduce the Ising Model as an approximation and use Mean-Field Theory to demonstrate how symmetry is broken.
We first non-dimensionalize the Heisenberg model and analyze its structure. Assume the external magnetic field is along the -direction: . We expand the dot product of the spin operators into longitudinal () and transverse () components:
To see the physical meaning of the transverse part more clearly, we introduce Ladder Operators:
Thus, the Heisenberg model can be rewritten in two parts:
(where ). These two parts have distinct physical meanings:
Ising Part (Longitudinal Term): This term involves only . Since on different lattice sites commute (), they behave like classical scalar variables. This describes the static alignment of spins along the -axis.
Flip Part (Transverse/Flip Term): This term involves . Its action is to flip the spin at site down () while simultaneously flipping the spin at site up (): . Physically, this represents the movement of spin excitations. Just like a spin-flipped state hopping through the lattice, this corresponds to Spin Waves or Magnons. This is a form of quantum fluctuation that imparts "kinetic energy" to the system, tending to destroy ordered alignment.
In many real magnetic materials, due to the symmetry of the crystal structure, there exists Magnetic Anisotropy. This means the energy of spins along certain directions (e.g., the -axis, the easy axis) is lower than in the plane. If the anisotropy is strong enough, or if we are only concerned with phase transition behavior in the classical limit, we can ignore the Flip Part (quantum fluctuations) and retain only the longitudinal term. This is the famous Ising Model.
At this point, we replace the operator with a classical variable (absorbing the coefficients into ):
This is a massive simplification: we turn a non-commuting quantum matrix problem into a classical statistical combinatorial problem. The 2D Heisenberg model cannot be solved exactly to this day, though we can solve it using computational methods. However, the Ising model within it is relatively simpler. The solution to the 1D Ising model is very simple; there is no phase transition in 1D (Ising, 1924). But the 2D case is also very difficult to solve. It wasn't until the brilliant Lars Onsager published a very simple paper stating that he had solved it—without providing the solution details, but giving the critical temperature and pointing out that it is ferromagnetic at low temperatures and paramagnetic at high temperatures—that we had the first exactly solvable model exhibiting a ferromagnetic phase transition. He withheld the solution process until C.N. Yang saw the paper and provided a solution, which was still famously difficult. To understand the physical picture intuitively, we will adopt the Mean-Field Approximation here.
The problem we face is many-body coupling: the state of depends on , and depends on ... This chain reaction makes the partition function difficult to calculate. The Mean-Field idea is: when we focus on atom , we don't care whether neighbor is flipping between or ; we only care about the average influence of the neighbors. We write as an average value plus a fluctuation: . Ignoring the second-order fluctuation term , the Hamiltonian can be linearized into a single-body form:
This defines the Effective Molecular Field:
where is the coordination number (number of neighbors for each atom). Now, the problem becomes the statistical distribution of a single spin in an "external field" . According to the Boltzmann distribution, the probability of this spin being up is proportional to , and the probability of being down is proportional to (where ). Thus, the thermodynamic average of this spin is:
Since the lattice is uniform, must equal the average value of the field source itself, . Substituting , we obtain the famous Self-consistent Equation:
Let us consider the most critical case: no external magnetic field (h=0). The equation simplifies to:
where we package the constants into the definition of the Curie Temperature Tc=Jz/kB. This is a transcendental equation, and we can analyze the behavior of the solution graphically (by finding the intersection of y=m and y=tanh(TTcm)):
High-Temperature Phase (T>Tc): The slope of the tanh curve at the origin is Tc/T<1. The line and the curve intersect at only one point, m=0. Physical meaning: Thermal agitation is intense; without an external field, there is no magnetism. This is the Paramagnetic Phase.
Low-Temperature Phase (T<Tc): The slope of the tanh curve at the origin is Tc/T>1. The origin m=0 becomes an unstable solution, and two new stable non-zero solutions m=±m0 appear. Physical meaning: Even if h=0, the system will spontaneously generate a non-zero magnetization m0. This is the Ferromagnetic Phase.
This is Spontaneous Symmetry Breaking: The Hamiltonian has a flip symmetry σ→−σ when h=0. However, when the temperature drops below Tc, nature is forced to choose between "all up" and "all down." This choice is not imposed by an external force but is a collective decision made spontaneously by the system to lower its energy (driven by the exchange interaction J). This is precisely the statistical mechanical essence behind the macroscopic phenomenon of a magnet attracting iron.
10. Magnetic Domains
Based on the Ising model and Mean-Field Theory, we concluded that when the temperature is below the Curie temperature , electron spins spontaneously align, producing a massive macroscopic magnetization . However, this immediately leads to a new paradox: if you go to a hardware store and buy an iron nail (room temperature is obviously far below Iron's Curie temperature of ), it is not magnetic. It does not pick up other objects. This is because we ignored one final energy competition.
Our previous Hamiltonian only considered Exchange Energy and Zeeman Energy. However, at the macroscopic scale, there is also the classical Magnetostatic Energy. If all atoms in a piece of iron were aligned upwards, this magnet would establish a huge magnetic field in the surrounding space. The magnetic field contains energy density . Spreading out all those magnetic field lines costs a tremendous amount of energy. To reduce this Magnetostatic Energy, the material spontaneously splits into many tiny regions called Magnetic Domains. Although inside a domain, the exchange interaction keeps spins aligned (satisfying microscopic ferromagnetism), overall, the vector sum of the magnetic moments of the various domains is zero (). There are no external magnetic field lines, thereby drastically reducing the magnetostatic energy.
The boundary between magnetic domains is called a Domain Wall. Inside the domain wall, spins do not flip abruptly but rotate gradually. This is another game of energy trade-offs: Exchange Energy wants spins to be parallel and resists their turning (preferring the wall to be as wide as possible); Magnetic Anisotropy wants spins to align along the easy axis and resists them pointing in intermediate directions (preferring the wall to be as narrow as possible). The balance between the two determines the thickness of the domain wall (typically hundreds of atomic layers). The formation of magnetic domains is not derived from "first principles" like spin, but belongs to the realm of Micromagnetics, involving energy minimization in continuum field theory, which we will not expand upon here.
Now, we can finally fully describe the macroscopic process of "a magnet attracting iron":
Initial State: The interior of the iron nail is filled with chaotic magnetic domains; the macroscopic magnetic moment is zero.
External Field Intervention: When you bring a magnet close to the nail, you provide an external magnetic field .
Domain Wall Motion: The equilibrium is broken. Domains whose direction aligns with have lower Zeeman energy (). Consequently, these "compliant" domains begin to swallow the surrounding "non-compliant" domains. The domain walls move.
Macroscopic Magnetization: The nail rapidly gains a huge net magnetic moment.
Gradient Force Work: This induced macroscopic magnetic moment is pulled by the gradient force generated by the magnet's non-uniform field.
Click: The nail flies towards the magnet.
Conclusion: The Deep Symmetry of the Universe
When you play with two magnets in your hands, feeling the repulsion and attraction between them, you are feeling more than just a force. You are touching the essence of quantum mechanics and the secrets of cosmic evolution with your own hands. Let us review this journey and see how we rebuilt our physical intuition:
The Classical Collapse: We found that the Lorentz force does no work, and classical statistical physics forbids magnetism (Bohr-van Leeuwen Theorem).
The Relativistic Correction: The Dirac equation revealed that the electron must be a 4-component spinor carrying an intrinsic magnetic moment with g=2. Magnetism is the residue of relativistic effects in the low-speed world.
The Power of Quantum Statistics: The Pauli Exclusion Principle combined with Coulomb repulsion creates an equivalent "Exchange Interaction," forcing spins to align parallel.
Symmetry Breaking: The Ising model taught us that when the temperature drops, the system, in order to survive (lower its energy), is forced to break rotational symmetry and choose a direction.
Finally, it is worth mentioning that the Spontaneous Symmetry Breaking (SSB) we saw in the Ising model has significance far beyond solid-state physics. It is a core paradigm for understanding the universe in modern physics. At the beginning of the Big Bang (extremely high temperature), physical laws possessed extremely high symmetry. All fundamental particles were massless, just like the iron block at high temperatures has no magnetism (paramagnetic phase). As the universe cooled, when the temperature dropped below a certain critical value, the Higgs Field filling the universe underwent a phase transition. Just like electron spins suddenly choosing to point in one direction, the Higgs field acquired a non-zero Vacuum Expectation Value in empty space.
In a ferromagnet, symmetry breaking endows the material with magnetism.
In the Standard Model, symmetry breaking endows fundamental particles with mass.
So, the next time you see a magnet pick up a paperclip, realize this: you are witnessing a miniature moment of cosmic creation. The mechanism that gives the nail its magnetism is the very same mechanism that gives the quarks and electrons in your body their mass, allowing this universe to exist.
Magnetic force does no work; it is the geometry of spacetime doing the work. The attraction of a magnet is the dance of a quantum ghost in the macroscopic world.