Class ReplicateToMaxFederatedScheme

  • public class ReplicateToMaxFederatedScheme
    extends DataPartitionFederatedScheme
    Replicate to Max Federated scheme When the parameter server runs in federated mode it cannot pull in the data which is already on the workers. Therefore, a UDF is sent to manipulate the data locally. In this case the global maximum number of examples is taken and the worker replicates data to match that number of examples. The generation is done by multiplying with a Permutation Matrix with a global seed. These selected examples are appended to the original data. Then all entries in the federation map of the input matrix are separated into MatrixObjects and returned as a list. Only supports row federated matrices atm.