Quick Answer: A tankless water heater has two separate things worth protecting against: sediment that can damage the manufacturer-required inlet screen, and mineral scale that coats the heat exchanger in hard water. The iSpring WSP-50SL spin-down filter (about $59) handles sediment; a Watts Inline Phosphate Scale Inhibitor (about $18) is the cheapest point-of-use fix for scale, while the SpringWell FutureSoft (about $1,450) treats the whole house. This matters for warranty reasons, too — Rinnai’s service manual caps hardness at 200 mg/L (11.7 grains per gallon) before heat-exchanger damage falls outside coverage, while Navien states its warranty does not exclude hard-water-caused failures the way some competitors’ do.

Tankless water heaters fail in two boring, preventable ways: grit gets past the small inlet screen and damages internal components, or hard water quietly coats the heat exchanger in scale until flow and efficiency drop. Both are cheap to prevent and expensive to fix after the fact — a heat-exchanger replacement dwarfs the cost of any filter on this list. This is a different problem from a tankless reverse-osmosis system, which is a compact RO unit that happens to have no storage tank — if that’s what you’re shopping for, see our best tankless reverse osmosis system guide instead.

Sediment vs. scale: two different problems, two different fixes

A sediment filter and a scale-prevention filter aren’t interchangeable, and a lot of buyers assume one product solves both. Sediment — sand, pipe scale flakes, rust particles — is a mechanical problem: it physically clogs or abrades the fine inlet screen most tankless units require, which is why manufacturers call out screen inspection in their own installation manuals. Scale is a chemical problem: dissolved calcium and magnesium come out of solution as the unit heats water and bond to the heat exchanger’s internal surfaces, narrowing the passages the water flows through. A sediment filter does nothing to stop scale, and a scale inhibitor or conditioner does nothing to stop grit — most homes with genuinely hard, sediment-bearing water (common on private wells) need both.

Best tankless water heater filters at a glance

ProductBest forSolvesInstall pointPrice
iSpring WSP-50SL Spin-DownSediment protectionGrit, rust, inlet-screen damageCold inlet line~$59
Watts Inline Phosphate FilterBudget scale protectionHeat-exchanger limescaleCold inlet line~$18
SpringWell FutureSoft (TAC)Whole-house scale protectionLimescale, warranty complianceMain point of entry~$1,450
iSpring ED2000 Electronic DescalerNo-plumbing scale optionLimescale (conditioning, not removal)Clamps onto existing pipe~$120

1. iSpring WSP-50SL Spin-Down — Best for Sediment Protection

iSpring WSP-50SL Spin-Down Sediment Filter

Best for sediment · 50-micron reusable screen · 20 GPM rated · ~$59

The same reusable spin-down filter we recommend in our best sediment filter for well water guide does double duty protecting a tankless unit's inlet screen. Its 50-micron stainless mesh catches grit and rust before either reaches the heater, and because it's a flush-clean spin-down rather than a disposable cartridge, there's no filter to remember to reorder — a quarter-turn of the flush valve clears it. Rated to 20 GPM, it won't bottleneck a tankless unit's higher flow demand the way an undersized filter can.

Check price on Amazon →

Replacement filters on time, every time — Prime ships them free in two days. Try it free for 30 days.

If you’re on municipal water with no visible sediment history, this step may be unnecessary — but if your tankless unit’s manual calls for one anyway (most do), a $59 reusable screen is a lot cheaper than a service call for a debris-damaged inlet.

2. Watts Inline Phosphate Filter — Best Budget Scale Protection

Watts / Scalewatcher Inline Phosphate Filter

Best budget scale fix · point-of-use · food-grade polyphosphate · ~$18

This is the same inline phosphate filter we cover in our best inline water filter guide, sized for a single appliance rather than the whole house. Its food-grade polyphosphate media sequesters calcium and magnesium so they can't bond into scale as the water heats, which is exactly the mechanism that threatens a tankless heat exchanger. It's a quick-connect fitting on the cold inlet line, and the cartridge typically lasts around six months depending on how hard your water actually is.

Check price on Amazon →

3. SpringWell FutureSoft — Best Whole-House Scale Protection

SpringWell FutureSoft Salt-Free Conditioner

Best whole-house pick · TAC conditioning · no salt, no wastewater · ~$1,450

If your hardness is high enough to put a Rinnai or similar unit's warranty at risk, a point-of-use inline filter is a stopgap, not a real fix — the same hard water is still scaling your other fixtures and appliances. The FutureSoft template-assisted-crystallization (TAC) conditioner, the same system we rate best-in-class in our best water descaler guide, is independently tested (an Arizona State University study using the German DVGW W512 protocol found a TAC conditioner prevented about 88% of scale buildup) and treats every tap in the house — the water heater included — with no salt, no wastewater, and no sodium added to your water.

Check price on Amazon →

4. iSpring ED2000 — Best No-Plumbing Option

iSpring ED2000 Electronic Descaler

Best no-plumbing option · clamp-on install · ~$120

For renters, or anyone who doesn't want to cut into a supply line at all, the ED2000 wraps coils of wire around the existing main pipe and plugs into an outlet — no plumber, no pipe cutting, installed in under 30 minutes. It doesn't remove hardness minerals the way the FutureSoft does; it alters how they crystallize so they're less likely to stick to hot surfaces like a heat exchanger. Results vary more with water chemistry than a physically installed TAC system, so treat it as the accessible option rather than the most rigorously proven one.

Check price on Amazon →

How to choose

The bottom line

A tankless water heater’s manual almost always asks for a sediment filter, and if you’re in a hard-water area, scale protection isn’t optional — Rinnai’s own warranty language excludes heat-exchanger damage above 200 mg/L hardness, and even brands like Navien that don’t exclude it still lose efficiency to scale over time. The iSpring WSP-50SL covers sediment for about $59, the Watts inline phosphate filter is the cheapest scale fix at $18, and the SpringWell FutureSoft is the whole-house, warranty-safe answer if your water is genuinely hard. Match the fix to the actual problem — sediment and scale are not the same thing — and you’ll spend far less than a single heat-exchanger service call.

Prices are approximate and change often — tap any button above to check the current Amazon price.