Package org.apache.sysds.utils
Class Statistics
- java.lang.Object
-
- org.apache.sysds.utils.Statistics
-
public class Statistics extends Object
This class captures all statistics.
-
-
Field Summary
Fields Modifier and Type Field Description static long
allocateDoubleArrTime
static boolean
allowWorkerStatistics
static long
examSparsityTime
static long
recomputeNNZTime
-
Constructor Summary
Constructors Constructor Description Statistics()
-
Method Summary
All Methods Static Methods Concrete Methods Modifier and Type Method Description static void
addCPMemObject(int hash, double sizeof)
static void
decrementNoOfExecutedSPInst()
static String
display()
Returns statistics of the DML program that was recently completed as a stringstatic String
display(int maxHeavyHitters)
Returns statistics as a stringstatic long
getCompileTime()
static String
getCPHeavyHitterCode(Instruction inst)
static long
getCPHeavyHitterCount(String opcode)
static Set<String>
getCPHeavyHitterOpCodes()
static String
getCPHeavyHittersMem(int num)
static long
getFunRecompiles()
static long
getFunRecompileTime()
static String
getHeavyHitters(int num)
Obtain a string tabular representation of the heavy hitter instructions that displays the time, instruction count, and optionally GPU stats about each instruction.static HashMap<String,org.apache.commons.lang3.tuple.Pair<Long,Double>>
getHeavyHittersHashMap()
static long
getJITCompileTime()
Returns the total time of asynchronous JIT compilation in milliseconds.static long
getJVMgcCount()
static long
getJVMgcTime()
static long
getNoOfCompiledSPInst()
static long
getNoOfExecutedSPInst()
static long
getNumPinnedObjects()
static long
getRunTime()
Returns the total time of run in nanoseconds.static double
getSizeofPinnedObjects()
static long
getTotalLix()
static long
getTotalLixUIP()
static long
getTotalUIPVar()
static void
incrementFunRecompiles()
static void
incrementFunRecompileTime(long delta)
static void
incrementJITCompileTime(long time)
static void
incrementJVMgcCount(long delta)
static void
incrementJVMgcTime(long time)
static void
incrementNoOfCompiledSPInst()
static void
incrementNoOfExecutedSPInst()
static void
incrementTotalLix()
static void
incrementTotalLixUIP()
static void
incrementTotalUIPVar()
static void
maintainCPFuncCallStats(String instName)
static void
maintainCPHeavyHitters(String instName, long timeNanos)
"Maintains" or adds time to per instruction/op timers, also increments associated countstatic void
maintainCPHeavyHittersMem(String name, double sizeof)
Helper method which keeps track of the heaviest weight objects (by total memory used) throughout execution of the program.static void
removeCPMemObject(int hash)
Helper method to remove a memory object which has become unpinnedstatic void
reset()
static void
resetCPHeavyHitters()
static void
resetJITCompileTime()
static void
resetJVMgcCount()
static void
resetJVMgcTime()
static void
resetNoOfCompiledJobs(int count)
static void
resetNoOfExecutedJobs()
static void
startCompileTimer()
static void
startRunTimer()
Starts the timer, should be invoked immediately before invoking Program.execute()static void
stopCompileTimer()
static void
stopRunTimer()
Stops the timer, should be invoked immediately after invoking Program.execute()static String[]
wrap(String str, int wrapLength)
-
-
-
Method Detail
-
getNoOfExecutedSPInst
public static long getNoOfExecutedSPInst()
-
incrementNoOfExecutedSPInst
public static void incrementNoOfExecutedSPInst()
-
decrementNoOfExecutedSPInst
public static void decrementNoOfExecutedSPInst()
-
getNoOfCompiledSPInst
public static long getNoOfCompiledSPInst()
-
incrementNoOfCompiledSPInst
public static void incrementNoOfCompiledSPInst()
-
getTotalUIPVar
public static long getTotalUIPVar()
-
incrementTotalUIPVar
public static void incrementTotalUIPVar()
-
getTotalLixUIP
public static long getTotalLixUIP()
-
incrementTotalLixUIP
public static void incrementTotalLixUIP()
-
getTotalLix
public static long getTotalLix()
-
incrementTotalLix
public static void incrementTotalLix()
-
resetNoOfCompiledJobs
public static void resetNoOfCompiledJobs(int count)
-
resetNoOfExecutedJobs
public static void resetNoOfExecutedJobs()
-
incrementJITCompileTime
public static void incrementJITCompileTime(long time)
-
incrementJVMgcTime
public static void incrementJVMgcTime(long time)
-
incrementJVMgcCount
public static void incrementJVMgcCount(long delta)
-
incrementFunRecompileTime
public static void incrementFunRecompileTime(long delta)
-
incrementFunRecompiles
public static void incrementFunRecompiles()
-
startCompileTimer
public static void startCompileTimer()
-
stopCompileTimer
public static void stopCompileTimer()
-
getCompileTime
public static long getCompileTime()
-
startRunTimer
public static void startRunTimer()
Starts the timer, should be invoked immediately before invoking Program.execute()
-
stopRunTimer
public static void stopRunTimer()
Stops the timer, should be invoked immediately after invoking Program.execute()
-
getRunTime
public static long getRunTime()
Returns the total time of run in nanoseconds.- Returns:
- run time in nanoseconds
-
reset
public static void reset()
-
resetJITCompileTime
public static void resetJITCompileTime()
-
resetJVMgcTime
public static void resetJVMgcTime()
-
resetJVMgcCount
public static void resetJVMgcCount()
-
resetCPHeavyHitters
public static void resetCPHeavyHitters()
-
getCPHeavyHitterCode
public static String getCPHeavyHitterCode(Instruction inst)
-
addCPMemObject
public static void addCPMemObject(int hash, double sizeof)
-
removeCPMemObject
public static void removeCPMemObject(int hash)
Helper method to remove a memory object which has become unpinned- Parameters:
hash
- hash of data object
-
maintainCPHeavyHittersMem
public static void maintainCPHeavyHittersMem(String name, double sizeof)
Helper method which keeps track of the heaviest weight objects (by total memory used) throughout execution of the program. Only reported if JMLC memory statistics are enabled and finegrained statistics are enabled. We only keep track of the -largest- instance of data associated with a particular string identifier so no need to worry about multiple bindings to the same name- Parameters:
name
- String denoting the variables namesizeof
- objects size (estimated bytes)
-
maintainCPHeavyHitters
public static void maintainCPHeavyHitters(String instName, long timeNanos)
"Maintains" or adds time to per instruction/op timers, also increments associated count- Parameters:
instName
- name of the instruction/optimeNanos
- time in nano seconds
-
maintainCPFuncCallStats
public static void maintainCPFuncCallStats(String instName)
-
getCPHeavyHitterCount
public static long getCPHeavyHitterCount(String opcode)
-
getHeavyHittersHashMap
public static HashMap<String,org.apache.commons.lang3.tuple.Pair<Long,Double>> getHeavyHittersHashMap()
-
getHeavyHitters
public static String getHeavyHitters(int num)
Obtain a string tabular representation of the heavy hitter instructions that displays the time, instruction count, and optionally GPU stats about each instruction.- Parameters:
num
- the maximum number of heavy hitters to display- Returns:
- string representing the heavy hitter instructions in tabular format
-
getCPHeavyHittersMem
public static String getCPHeavyHittersMem(int num)
-
getJITCompileTime
public static long getJITCompileTime()
Returns the total time of asynchronous JIT compilation in milliseconds.- Returns:
- JIT compile time
-
getJVMgcTime
public static long getJVMgcTime()
-
getJVMgcCount
public static long getJVMgcCount()
-
getFunRecompileTime
public static long getFunRecompileTime()
-
getFunRecompiles
public static long getFunRecompiles()
-
getNumPinnedObjects
public static long getNumPinnedObjects()
-
getSizeofPinnedObjects
public static double getSizeofPinnedObjects()
-
display
public static String display()
Returns statistics of the DML program that was recently completed as a string- Returns:
- statistics as a string
-
display
public static String display(int maxHeavyHitters)
Returns statistics as a string- Parameters:
maxHeavyHitters
- The maximum number of heavy hitters that are printed- Returns:
- statistics as string
-
-