Hot water line, 24/7(669) 281-0871
Homeowner guide

What San Jose's hard water does to your water heater

The water here is hard enough to change how long a heater lasts. A little routine maintenance changes it back.

  • 4 min read
  • San Jose focus
  • Sept 2026 updated
Plumber installing a tankless water heater in a San Jose garage
Hot water on demand

Perfect Tankless Plumbing, San Jose, CA

By Cedric Greenlee, Plumbing Guides Editor · Updated September 2026

San Jose Water Company data puts groundwater on most of the valley floor at roughly 11 to 26 grains per gallon, well above the 7 grains that counts as hard; that mineral load settles as sediment in tank heaters and scale in tankless units, so regular flushing, anode checks and often a softener extend a heater's life here.

How hard the water is

San Jose Water Company treats anything above 7 grains per gallon, or 120 parts per million, as hard water. Its own data for groundwater serving most of the valley floor runs roughly 11 to 26 grains per gallon, and imported surface water reaching parts of the system is softer, about 4.5 to 9. Published guidance on the city's water puts the typical range at 10 to 16 grains depending on the season and the blend.

In practice, most San Jose homes receive hard to very hard water, and the exact figure at your tap depends on the blend that reaches your street. A simple hardness test at the kitchen sink tells you where you stand.

What it does to a tank heater

When water is heated, the dissolved calcium and magnesium drop out. In a tank, they settle on the bottom as sediment. That layer insulates the water from the burner, so the heater works harder, overheats the tank bottom, and makes a popping or rumbling noise as trapped water boils under it. Local plumbers report tanks here often needing replacement years earlier than their rated life.

The anode rod, a sacrificial metal rod that corrodes so the steel tank does not, also wears faster in these conditions. Once it is gone, the tank starts to rust, and a rusting tank ends in a leak that cannot be repaired.

Sediment flushed from a water heater in a San Jose garage
Service van at a San Jose home for water heater maintenance

Heater popping or losing hot water? Call and we will flush it and check the anode while we are there.

Call (669) 281-0871

What it does to a tankless unit

A tankless unit has no tank for sediment, but it heats water inside a narrow heat exchanger, and that is where scale forms. Scale reduces heat transfer and narrows the passages, so the unit delivers less hot water, swings in temperature, and eventually shows a scale or overheat error. The flow sensor and inlet filter collect scale too.

None of this means tankless is a poor fit for San Jose. It means the annual descaling flush is part of owning one here.

How hard water affects each type and what helps
Tank heaterTankless heater
Where minerals goSediment on the tank bottomScale in the heat exchanger
Early symptomPopping or rumblingLukewarm water or swings
Part that wearsAnode rodFlow sensor and filter
Routine careFlush and anode checkAnnual descaling
Helps mostSoftener upstreamSoftener upstream
Warning sign of the endRust or a leaking tankHeat exchanger failure

Maintenance that actually helps

For tanks, a periodic flush removes loose sediment, and checking the anode rod every two to three years, a frequency local plumbers suggest for Santa Clara County water, lets you replace it before the tank is left unprotected. Both are short jobs compared with a new heater.

For tankless units, descaling through the isolation valves once a year is a sensible baseline, along with cleaning the cold inlet filter. If the unit lacks service valves, fitting them is a one-time cost that makes every later flush quick.

When a softener is worth it

A salt-based softener removes hardness before it reaches the heater, which slows sediment and scale dramatically and helps fixtures and glass too. It needs space near the main line, a drain and an outlet. A salt-free conditioner reduces scale formation without removing hardness and suits homes where a drain or salt is a problem.

If you have a tankless unit, or a tank that keeps failing early, a softener is usually the most effective single step. San Jose also disinfects with chloramine, so if you want a filter as well, it needs catalytic carbon rather than standard carbon.

From the guide to the job

Services related to this guide

FAQ

Questions readers ask about this

More guides

Keep reading

One number, any hour

Protect your heater from the water

Call to book a flush, an anode check or a hardness test and softener sizing.

Call, or find the office

Phone
(669) 281-0871
Hours
Open 24 hours, 7 days
Service office
332 Phelan Ave # A, San Jose, CA 95112
Head office
329 Arkansas St, Ste H, Vallejo, CA 94590
Coverage
San Jose and nearby Santa Clara County cities
Map placeholder for the Perfect Tankless Plumbing service office in San Jose
Call (669) 281-0871