My FME workflow, combines property data sourced from three different datasets. It must start and end with the same number of features, so I have in place a statisticsCalculator at the start and finish of the workflow, added a tester to ensure they are the same, and added another tester to ensure the count is above 24,000 (which I know the output will never be less).
Now very sporadically neither of these safety nets work and the layer is still produced. Usually we can fix the issue in 10min the next day but its frustrating I can't figure this out or why it happens sporadically, and its hard to test any improvements.
I have reviewed the log file, and get these errors when I have an issue. The file gets overwritten every night to catch any updates to databases so there is adequate disk space, the file isn't in use by another application or workflow, and the errors regarding attributes - the file is written fine majority of the time.
Error 1
2016-07-24 19:27:45| 92.1| 0.0|ERROR |MapInfo file 'C:\etc' could not be created. Check that file path name is valid and there is adequate disk space. Also ensure that the total record length for all the attributes is less than 4000 bytes and number of attributes are less than 250
Error 2
MapInfo file 'C:\etc' could not be created. Check that file path name is valid and there is adequate disk space.
Error 3
Also ensure that the total record length for all the attributes is less than 4000 bytes
With the implemented precautionary steps not capable of capturing the failure, is there another way to add a safety net actually into the writer to ensure that it is not written if say it doesn't have more than 24,000. The image below shows the workflow.