Solving PHP Scaling Issues

We have an export feature that can build an Excel file over the course of many background jobs. Worked beautifully for years. Man, those were the days.