TF Agent: Add another condition to Flush a transformation
There are some cases where the transformation needs to be Flushed even if :
nb of Unused files > Group Size
Indeed if the Unused files have replicas in different SEs, it can be that the TransformationAgent cannot create the tasks to traat them (since files are grouped by Replica location).
So the Agent should also check if the nb of jobs associated to a transformation is equal to the nb of the Total Tasks of the transformation (meaning that all jobs have been created) and if all jobs are in a Final Status (Done, Completed, Failed, Killed, Stalled?) and if there are still Unused files. In this case the transformation needs to be Flushed.