Class ShuffleFederatedScheme

  • public class ShuffleFederatedScheme
    extends DataPartitionFederatedScheme
    Shuffle Federated scheme When the parameter server runs in federated mode it cannot pull in the data which is already on the workers. Therefore, a UDF is sent to manipulate the data locally. In this case it is shuffled by generating a permutation matrix with a global seed and doing a mat mult. Then all entries in the federation map of the input matrix are separated into MatrixObjects and returned as a list. Only supports row federated matrices atm.