Tankless or tank: choosing a water heater for a San Jose home
Both are good choices in the right house. The deciding factors here are your hot water habits, your gas line and San Jose's hard water.
- 4 min read
- San Jose focus
- Sept 2026 updated
Perfect Tankless Plumbing, San Jose, CA
In San Jose, a tankless water heater costs more to install, roughly $4,500 to $9,500 in the Bay Area against $2,200 to $4,500 for a tank, but never runs out of hot water and saves floor space; a tank is cheaper and faster to swap, and both need regular care against the city's hard water.
How each one heats water
A tank heater keeps 40 or 50 gallons hot around the clock and refills with cold water as you use it. When the hot water runs out, you wait for it to recover. A tankless heater stores nothing: when a tap opens, a flow sensor fires a large burner and heats the water as it passes through a heat exchanger. As long as the unit is sized for what you run at once, it does not run out.
That difference shapes everything else. The tank's burner is small, so an ordinary half-inch gas line feeds it. The tankless burner can be several times larger, so the gas supply often has to grow. The tank sits on the floor; the tankless unit hangs on a wall or outside. The tank loses a little heat all day; the tankless unit uses energy only when water is flowing.
What the published costs look like
A Bay Area plumbing company's 2026 cost guide puts a tank replacement at roughly $2,200 to $4,500 and a tankless installation at about $4,500 to $9,500. Those are planning ranges, not quotes, and where your house lands depends mostly on how much infrastructure the tankless unit needs.
The tank price is mostly the heater, the permit and the labor for a like-for-like swap. The tankless price includes the unit plus a larger gas line from the meter, new venting, a condensate drain on condensing models, isolation valves for flushing, and the wall mount. On a house where the gas line is already large enough and the vent route is short, a tankless conversion sits toward the lower end. On one with a long run from the meter, it sits higher.
| Tank (gas) | Tankless (gas) | |
|---|---|---|
| Installed range | $2,200 to $4,500 | $4,500 to $9,500 |
| Install time | About half a day | One to two days |
| Hot water | Until the tank runs out | Continuous when sized right |
| Space | Floor footprint | Wall mounted |
| Gas line | Usually existing | Usually upsized |
| Upkeep | Flush and anode checks | Annual descaling |
Install time and the permit
Every water heater replacement in California needs a plumbing permit and an inspection. A like-for-like tank swap is normally done in about half a day. A tank-to-tankless conversion usually takes one to two days, because the gas line is upsized, new venting is run and a condensate drain is added.
If the old heater has already failed and the house has no hot water, that difference matters. Some owners replace a failed tank with another tank to get hot water back the same day, then plan a tankless conversion later when there is time to do it properly.
Weighing tankless against a new tank? Call and we will look at your gas line and space before you decide.
Call (669) 281-0871Hard water changes the upkeep, not the choice
San Jose Water Company data puts groundwater on most of the valley floor at roughly 11 to 26 grains per gallon, which is very hard. Both kinds of heater suffer from it, in different ways. A tank collects sediment on its bottom, which makes it pop and rumble and shortens its life; the anode rod that protects the steel wears faster too. A tankless unit collects scale inside its heat exchanger, which reduces flow and eventually triggers an error.
Neither problem is a reason to avoid either heater. It just means the maintenance is real. A tank here benefits from a periodic flush and an anode check every two to three years. A tankless unit benefits from an annual descaling flush through its service valves, less often if a softener sits upstream.
Running costs and the heat pump option
PG&E rates are among the highest in the country, and local plumbers report that is pushing more Santa Clara County homeowners toward tankless and heat pump water heaters. A heat pump water heater is a third option worth knowing about: it is a tank, but it moves heat from the air rather than burning gas, and it is the most efficient of the three. It needs a 240V circuit in most cases, space around it and a condensate drain.
If your panel can support it and your garage has room, it deserves a place in the comparison, especially if you are moving away from gas.
Which houses suit which heater
Tankless suits households that run out of hot water, garages short on floor space, homes where owners plan to stay long enough to recover the higher installation cost, and houses where the gas line is already close to the right size.
A new tank suits tight budgets, rentals, homes where the gas line would be expensive to upsize, and failed-heater emergencies where hot water is needed today. A heat pump tank suits owners who want the lowest running cost and have the electrical capacity. We look at the gas meter, the run length, the vent route and the space before recommending any of them.
From the guide to the job
Services related to this guide
Tankless Water Heater Installation
Gas tankless, Electric tankless.
Tankless Water Heater Installation in San JoseWater Heater Replacement
40 and 50 gallon gas, Electric tank units.
Water Heater Replacement in San JoseHeat Pump Water Heater Installation
Hybrid 240V units, Condensate and clearance planning.
Read about heat pump water heater installation
FAQ
Questions readers ask about this
For households that run out of hot water or plan to stay a long time, often yes. The higher installation cost is mostly gas line and venting work, so the answer depends on your house.
Usually, if the gas line can be upsized and a vent route exists. Many units can also mount outside.
Usually one to two days, then the city inspection is scheduled.
It scales them, but an annual descaling flush keeps them working. A softener reduces how often it is needed.
If your panel supports a 240V circuit and you have space, yes. It is the most efficient of the three options.
More guides
Keep reading
What a Tankless Water Heater Install Costs in San Jose
Published ranges, the line items behind them and how to read a quote.
Tankless install costHard Water and Your Water Heater in San Jose, CA
What the local hardness numbers mean for tanks and tankless units, and what helps.
Hard water and heaters, explained
One number, any hour
Get a straight answer for your house
Call and we will look at your gas line, venting and space, then tell you which heater fits.
