Package org.apache.sysds.resource.cost
Class RDDStats
- java.lang.Object
-
- org.apache.sysds.resource.cost.RDDStats
-
public class RDDStats extends Object
-
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description doublegetCost()Meant to be used at testingbooleanisCollected()Meant to be used at testing
-
-
-
Constructor Detail
-
RDDStats
public RDDStats(VarStats sourceStats)
Initiates RDD statistics object bound to an existingVarStatsobject. Uses HDFS block size to adjust automatically the number of partitions for the current RDD.- Parameters:
sourceStats- bound variables statistics
-
RDDStats
public RDDStats(long size, int partitions)Initiates RDD statistics object for intermediate variables (not bound toVarStats). Intended to be used for intermediate shuffle estimations.- Parameters:
size- distributed size of the objectpartitions- target number of partitions; -1 for fitting to HDFS block size
-
-