For 12 years, I've handled industrial control panels and PLC automation projects. In that time, I've personally made and documented nine significant mistakes, totaling roughly $38,000 in wasted budget. This is the story of the most expensive one, and the checklist item that would have prevented it.
Back in 2017, I was asked to fix a small PLC control panel at a plastics plant. The symptom list sounded familiar: HMI screens locking up, the PLC module randomly dropping outputs, and an IGBT 100A drive module blowing its DC bus every few weeks. Four months later, after two replaced IGBT modules (about $3,200 in parts), one replaced PLC HMI, and enough firmware reflashing to make me hate my laptop, I found out the truth. None of those components were the problem.
That is the trap with electrical PLC control. When an automation system fails mysteriously, our instinct is to suspect the automation hardware. We checked the PLC module, swapped the PLC HMI, replaced the cable, updated the firmware. The failure came back anyway. There is nothing wrong with looking at the PLC, but stopping there is how you end up with a spare-parts graveyard and an unhappy customer.
What Looks Like a PLC Problem, but Isn't
PLC controllers are tough in some ways and sensitive in others. A typical PLC module might be rated for 24 VDC with a tolerance of 19.2 to 30 V. That sounds forgiving. But if the DC supply dips below that threshold for even a few milliseconds, the PLC can brown out, reset, and lose communication with the HMI. The output modules may stay in a half-controlled state. It looks like a logic bug, or a bad module. It is not.
Here is a concrete example. We had a PLC HMI that kept rebooting every time a cold storage compressor kicked in. The compressor was on the same transformer as the control panel. During startup, it pulled so much current that the voltage sagged to about 60 percent of nominal for 300 milliseconds. Most people wouldn't notice a light flicker. For a PLC, that is a disaster.
According to SEMI F47 (semi.org), a widely referenced voltage sag immunity specification, equipment should tolerate a drop to 50 percent of nominal voltage for 200 milliseconds. Our sag was right on that edge, and the PLC's power supply had almost no headroom.
Another false suspect was the IGBT module. An IGBT 100A power stage can handle 100 amps under controlled conditions, but its gate driver is a low-voltage circuit. One short burst of overvoltage on the DC bus can destroy the gate oxide. So when the IGBT module failed, everyone said it's the drive. Actually, it was the power source feeding the drive.
The Deep Cause: Dirty Power, Frequency Conversion, and Assumptions
The real problem was never the PLC module or the IGBT. It was power quality. Three specific things were wrong at that plant, and at most of the others that called me later.
1. Voltage Sags and Brownouts
Voltage sags are the most common power event in industrial environments. Start of large motors, welders, compressors, even lifts can drag the local voltage down for a few hundred milliseconds. A PLC might survive one or two, but repeated sags eventually cause lockups. The HMI shows a communication timeout error, but the real issue is that the PLC silently reset. This is especially annoying because the fault often disappears before you arrive. You start the machine, it runs fine, and you look like an idiot.
2. Harmonics from a 50 to 60 Hz Converter
This is the one I missed until a colleague pointed it out. Many factories buy used or imported machines designed for 60 Hz, then plug them into a 50 Hz grid using a 50 to 60 Hz converter. That sounds reasonable. But not all converters are the same. A cheap static converter can produce a waveform that looks like a sine wave on a handheld scope but actually contains heavy harmonics. I once measured a cheap 50 to 60 Hz converter and saw total harmonic distortion above 20 percent.
Under IEEE 519 (ieee.org), general industrial systems should keep voltage distortion below 5 percent. At 20 percent THD, every PLC in the circuit gets corrupted zero crossings, missed timing, and random resets. The DC bus capacitors on the IGBT 100A module also take a beating. The counterintuitive part: the converter is supposed to make imported equipment run better, but it can become the worst power quality problem in the building.
3. Shared Neutrals and Noisy Grounds
The third issue was grounding. In older plants, control panels often share a neutral or ground path with welding equipment, VFDs, and other noisy loads. That turns the 'clean' ground into an antenna. PLC analog input cards see noise spikes, the HMI picks up false alarms, and networking between the PLC module and the HMI becomes flaky. It is not a coincidence that these problems show up more at 2 a.m., when nobody wants to open the cabinet with a scope.
The biggest assumption I made was this: I assumed the utility and the building wiring were fine because the lights were on. Lights do not care about harmonic distortion or a few milliseconds of sag. Microprocessors do.
The Price of Ignoring the Power Side
Let's put real numbers on it. At the plastics plant, our two replacement IGBT modules cost $3,200. Rework and troubleshooting ate about two weeks of time. Every failure stopped the production line for about two hours. The plant manager later told me each hour of unplanned downtime was worth about $1,800. So one failure was roughly $3,600 in lost output, plus my bill. Six failures in four months added up to about $21,600 in direct production loss alone. That does not include scrap, overtime, or the cost of expediting parts.
The food plant case was worse. When the PLC HMI rebooted, a valve closed at the wrong time and the whole batch had to be dumped. That cost around $5,000 in material. It was written off as 'unexplained production waste.' The real cause was a voltage sag that no one was measuring.
There is also a quieter cost: credibility. After two failed troubleshooting visits, the customer started questioning every recommendation I gave. That was fair. I had told him it was a random electrical failure without checking the input power. In 2022, I started my own documentation list and built a simple pre-power checklist for every control panel job. We have caught 47 potential problems with it in the past 18 months. That checklist is what I should have had in 2017.
The Fix: Keep PLCs and IGBT Modules on Clean Power
Once you accept that the PLC is at the mercy of the power source, the solution becomes clear. Do a power quality audit first. Use a power analyzer for at least a week. One-day measurements miss events that happen every three days.
Then make sure the PLC control, the HMI, and the IGBT gate logic are powered from something that can ride through sags and reject harmonics. In our projects, we standardized on Tripp-Lite SmartOnline UPS units for control panels. I chose them because of the online double-conversion topology. The PLC is never actually running on raw wall power; it runs from the UPS inverter all the time. That gives a clean sine wave and strong isolation from input frequency and voltage problems.
For 50 to 60 Hz converter applications, be careful. If you bought a converter to run imported equipment, do not feed its raw output directly to a PLC. Use a true online converter with good filtering, or put the PLC on an online UPS. And make sure the UPS and the converter are correctly rated; a 1 kVA UPS will not start a 5 kVA motor.
For the IGBT 100A module specifically, the real protection is upstream. A line reactor and a properly sized DC bus capacitor will help, but they won't fix a 20 percent THD source. Fix the source, or isolate the load with a UPS that regenerates a clean sine wave. Add surge suppression at the drive input while you chase the root cause.
This worked for us, but our plants were mostly small to mid-size operations with predictable loads. If your facility has arc furnaces, large cranes, or anything that switches megawatts, your power problems will be more violent than this. Run the audit and size the protection accordingly. Your mileage may vary.
One more personal note: I know what it is like to be the small customer. In my first year as an independent contractor, I called a large power protection company about a $400 UPS and they basically ignored me. Tripp-Lite answered my questions and helped me pick the right unit for a ridiculous little panel. They treated that tiny order like it mattered, so I have kept them on my vendor list even now that my orders are much bigger. Small orders deserve honest support because today's small order is tomorrow's repeat customer.
Final Thought
The next time your electrical PLC control system glitches, don't immediately buy a new PLC module. Don't blame the HMI. Look at the power first. Check voltage sags, harmonics, and whether your 50 to 60 Hz converter is actually delivering a clean waveform. It might save you $3,200, and a lot of embarrassment.
Leave a Reply