Uses of Class
org.apache.sysds.common.Types.ValueType
-
-
Uses of Types.ValueType in org.apache.sysds.api.jmlc
Method parameters in org.apache.sysds.api.jmlc with type arguments of type Types.ValueType Modifier and Type Method Description void
PreparedScript. setFrame(String varname, String[][] frame, List<Types.ValueType> schema)
Binds a frame object to a registered input variable.void
PreparedScript. setFrame(String varname, String[][] frame, List<Types.ValueType> schema, boolean reuse)
Binds a frame object to a registered input variable.void
PreparedScript. setFrame(String varname, String[][] frame, List<Types.ValueType> schema, List<String> colnames)
Binds a frame object to a registered input variable.void
PreparedScript. setFrame(String varname, String[][] frame, List<Types.ValueType> schema, List<String> colnames, boolean reuse)
Binds a frame object to a registered input variable. -
Uses of Types.ValueType in org.apache.sysds.api.mlcontext
Methods in org.apache.sysds.api.mlcontext that return types with arguments of type Types.ValueType Modifier and Type Method Description List<Types.ValueType>
FrameSchema. getSchema()
Obtain the frame schemaMethod parameters in org.apache.sysds.api.mlcontext with type arguments of type Types.ValueType Modifier and Type Method Description void
FrameSchema. setSchema(List<Types.ValueType> schema)
Set the frame schemaConstructor parameters in org.apache.sysds.api.mlcontext with type arguments of type Types.ValueType Constructor Description FrameSchema(List<Types.ValueType> schema)
Constructor that specifies the schema as a list ofValueType
values. -
Uses of Types.ValueType in org.apache.sysds.common
Methods in org.apache.sysds.common that return Types.ValueType Modifier and Type Method Description static Types.ValueType
Types.ValueType. fromExternalString(String value)
static Types.ValueType
Types.ValueType. getHighestCommonType(Types.ValueType a, Types.ValueType b)
Get the highest common type that both ValueTypes can be contained instatic Types.ValueType
Types.ValueType. valueOf(String name)
Returns the enum constant of this type with the specified name.static Types.ValueType[]
Types.ValueType. values()
Returns an array containing the constants of this enum type, in the order they are declared.Methods in org.apache.sysds.common with parameters of type Types.ValueType Modifier and Type Method Description static Types.ValueType
Types.ValueType. getHighestCommonType(Types.ValueType a, Types.ValueType b)
Get the highest common type that both ValueTypes can be contained instatic boolean
Types.ValueType. isSameTypeString(Types.ValueType vt1, Types.ValueType vt2)
-
Uses of Types.ValueType in org.apache.sysds.hops
Methods in org.apache.sysds.hops that return Types.ValueType Modifier and Type Method Description Types.ValueType
Hop. getValueType()
Methods in org.apache.sysds.hops with parameters of type Types.ValueType Modifier and Type Method Description static Lop
BinaryOp. constructSPAppendLop(Hop left, Hop right, Types.DataType dt, Types.ValueType vt, boolean cbind, Hop current)
static boolean
OptimizerUtils. isValidCPDimensions(Types.ValueType[] schema, String[] names)
Returns false if schema and names are not properly specified; other true Length to be > 0, and length of both to be equal.void
Hop. setValueType(Types.ValueType vt)
Constructors in org.apache.sysds.hops with parameters of type Types.ValueType Constructor Description AggBinaryOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOp2 innOp, Types.AggOp outOp, Hop in1, Hop in2)
AggUnaryOp(String l, Types.DataType dt, Types.ValueType vt, Types.AggOp o, Types.Direction idx, Hop inp)
BinaryOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOp2 o, Hop inp1, Hop inp2)
DataOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOpData dop, String fname, long dim1, long dim2, long nnz, int blen)
READ operation for Matrix w/ dim1, dim2.DataOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOpData dop, String fname, long dim1, long dim2, long nnz, MatrixObject.UpdateType update, int blen)
DataOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOpData dop, HashMap<String,Hop> params)
READ operation for Matrix / SQL operation for tensor This constructor supports expressions in parametersDataOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOpData dop, Hop in, HashMap<String,Hop> inputParameters)
WRITE operation for Matrix This constructor supports expression in parametersDataOp(String l, Types.DataType dt, Types.ValueType vt, Hop in, Types.OpOpData dop, String fname)
DnnOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOpDnn o, ArrayList<Hop> inp)
Create a hop from the builtin expressionHop(String l, Types.DataType dt, Types.ValueType vt)
IndexingOp(String l, Types.DataType dt, Types.ValueType vt, Hop inpMatrix, Hop inpRowL, Hop inpRowU, Hop inpColL, Hop inpColU, boolean passedRowsLEU, boolean passedColsLEU)
LeftIndexingOp(String l, Types.DataType dt, Types.ValueType vt, Hop inpMatrixLeft, Hop inpMatrixRight, Hop inpRowL, Hop inpRowU, Hop inpColL, Hop inpColU, boolean passedRowsLEU, boolean passedColsLEU)
MultiThreadedHop(String name, Types.DataType dt, Types.ValueType vt)
NaryOp(String name, Types.DataType dataType, Types.ValueType valueType, Types.OpOpN op, Hop... inputs)
NaryOp constructor.ParameterizedBuiltinOp(String l, Types.DataType dt, Types.ValueType vt, Types.ParamBuiltinOp op, LinkedHashMap<String,Hop> inputParameters)
Creates a new HOP for a function callQuaternaryOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOp4 o, Hop inX, Hop inU, Hop inV)
QuaternaryOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOp4 o, Hop inX, Hop inU, Hop inV, boolean flag1, boolean flag2)
Constructor for wsigmoid.QuaternaryOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOp4 o, Hop inW, Hop inU, Hop inV, boolean umult, Types.OpOp1 uop, Types.OpOp2 sop)
QuaternaryOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOp4 o, Hop inX, Hop inU, Hop inV, Hop inW, boolean post)
Constructor for wsloss.QuaternaryOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOp4 o, Hop inX, Hop inU, Hop inV, Hop inW, int baseType, boolean flag1, boolean flag2)
ReorgOp(String l, Types.DataType dt, Types.ValueType vt, Types.ReOrgOp o, ArrayList<Hop> inp)
ReorgOp(String l, Types.DataType dt, Types.ValueType vt, Types.ReOrgOp o, Hop inp)
TernaryOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOp3 o, Hop inp1, Hop inp2, Hop inp3)
TernaryOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOp3 o, Hop inp1, Hop inp2, Hop inp3, Hop inp4, Hop inp5, Hop inp6)
UnaryOp(String l, Types.DataType dt, Types.ValueType vt, Types.OpOp1 o, Hop inp)
-
Uses of Types.ValueType in org.apache.sysds.hops.codegen
Constructors in org.apache.sysds.hops.codegen with parameters of type Types.ValueType Constructor Description SpoofFusedOp(String name, Types.DataType dt, Types.ValueType vt, Class<?> cla, SpoofCompiler.GeneratorAPI api, String genVarName, boolean dist, SpoofFusedOp.SpoofOutputDimsType type)
-
Uses of Types.ValueType in org.apache.sysds.hops.rewrite
Methods in org.apache.sysds.hops.rewrite with parameters of type Types.ValueType Modifier and Type Method Description static Hop
HopRewriteUtils. createDataGenOpByVal(Hop rowInput, Hop colInput, Hop dimsInput, Types.DataType dt, Types.ValueType vt, double value)
-
Uses of Types.ValueType in org.apache.sysds.lops
Methods in org.apache.sysds.lops that return Types.ValueType Modifier and Type Method Description Types.ValueType
Lop. getValueType()
get value type of the output that is produced by this lopMethods in org.apache.sysds.lops with parameters of type Types.ValueType Modifier and Type Method Description static SortKeys
SortKeys. constructSortByValueLop(Lop input1, Lop input2, SortKeys.OperationTypes op, Types.DataType dt, Types.ValueType vt, Types.ExecType et, int numThreads)
static SortKeys
SortKeys. constructSortByValueLop(Lop input1, SortKeys.OperationTypes op, Types.DataType dt, Types.ValueType vt, Types.ExecType et, int numThreads)
static Data
Data. createLiteralLop(Types.ValueType vt, String literalValue)
Method to create literal LOPs.void
Append. init(Lop input1, Lop input2, Lop input3, Types.DataType dt, Types.ValueType vt)
void
AppendG. init(Lop input1, Lop input2, Lop input3, Lop input4, Types.DataType dt, Types.ValueType vt, Types.ExecType et)
void
AppendGAlignedSP. init(Lop input1, Lop input2, Lop input3, Types.DataType dt, Types.ValueType vt)
void
AppendM. init(Lop input1, Lop input2, Lop input3, Types.DataType dt, Types.ValueType vt, Types.ExecType et)
void
AppendR. init(Lop input1, Lop input2, Types.DataType dt, Types.ValueType vt, Types.ExecType et)
String
Lop. prepOperand(String label, Types.DataType dt, Types.ValueType vt)
Method to prepare instruction operand with given parameters.String
Lop. prepOperand(String label, Types.DataType dt, Types.ValueType vt, boolean literal)
Method to prepare instruction operand with given parameters.void
Lop. setValueType(Types.ValueType vt)
set value type of the output that is produced by this lop -
Uses of Types.ValueType in org.apache.sysds.parser
Methods in org.apache.sysds.parser that return Types.ValueType Modifier and Type Method Description static Types.ValueType
Expression. computeValueType(Expression expr1, Types.ValueType v1, Types.ValueType v2, boolean cast)
static Types.ValueType
Expression. computeValueType(Expression expression1, Expression expression2, boolean cast)
Compute value type based on expressions.static Types.ValueType
Expression. computeValueType(Identifier identifier1, Identifier identifier2, boolean cast)
Compute value type based on identifiers.Types.ValueType
Identifier. getValueType()
Methods in org.apache.sysds.parser with parameters of type Types.ValueType Modifier and Type Method Description static Types.ValueType
Expression. computeValueType(Expression expr1, Types.ValueType v1, Types.ValueType v2, boolean cast)
static Builtins
BuiltinFunctionExpression. getValueTypeCastOperator(Types.ValueType vt)
Convert a value type (double, int, or boolean) to a built-in function operator.void
Identifier. setValueType(Types.ValueType vt)
Constructors in org.apache.sysds.parser with parameters of type Types.ValueType Constructor Description DataIdentifier(String name, Types.DataType dt, Types.ValueType vt)
-
Uses of Types.ValueType in org.apache.sysds.runtime.controlprogram
Methods in org.apache.sysds.runtime.controlprogram with parameters of type Types.ValueType Modifier and Type Method Description ScalarObject
ProgramBlock. executePredicate(ArrayList<Instruction> inst, Hop hops, boolean requiresRecompile, Types.ValueType retType, ExecutionContext ec)
Executes given predicate instructions (incl recompilation if required) -
Uses of Types.ValueType in org.apache.sysds.runtime.controlprogram.caching
Methods in org.apache.sysds.runtime.controlprogram.caching that return Types.ValueType Modifier and Type Method Description Types.ValueType[]
FrameObject. getSchema()
Types.ValueType[]
FrameObject. getSchema(int cl, int cu)
Obtain schema of value typesTypes.ValueType[]
FrameObject. mergeSchemas(FrameObject fo)
Creates a new collection which contains the schema of the current frame object concatenated with the schema of the passed frame object.static Types.ValueType[]
FrameObject. parseSchema(String schema)
Methods in org.apache.sysds.runtime.controlprogram.caching with parameters of type Types.ValueType Modifier and Type Method Description void
FrameObject. setSchema(Types.ValueType[] schema)
Constructors in org.apache.sysds.runtime.controlprogram.caching with parameters of type Types.ValueType Constructor Description FrameObject(String fname, MetaData meta, Types.ValueType[] schema)
MatrixObject(Types.ValueType vt, String file)
Constructor that takes the value type and the HDFS filename.MatrixObject(Types.ValueType vt, String file, MetaData mtd)
Constructor that takes the value type, HDFS filename and associated metadata.MatrixObject(Types.ValueType vt, String file, MetaData mtd, MatrixBlock data)
Constructor that takes the value type, HDFS filename and associated metadata and a MatrixBlock used for creation after serializationTensorObject(Types.ValueType vt, String fname)
-
Uses of Types.ValueType in org.apache.sysds.runtime.controlprogram.context
Methods in org.apache.sysds.runtime.controlprogram.context with parameters of type Types.ValueType Modifier and Type Method Description ScalarObject
ExecutionContext. getScalarInput(String name, Types.ValueType vt, boolean isLiteral)
static FrameBlock
SparkExecutionContext. toFrameBlock(org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock> rdd, Types.ValueType[] schema, int rlen, int clen)
static FrameBlock
SparkExecutionContext. toFrameBlock(RDDObject rdd, Types.ValueType[] schema, int rlen, int clen)
Constructors in org.apache.sysds.runtime.controlprogram.context with parameters of type Types.ValueType Constructor Description MatrixObjectFuture(Types.ValueType vt, String file, Future<MatrixBlock> fmb)
-
Uses of Types.ValueType in org.apache.sysds.runtime.data
Fields in org.apache.sysds.runtime.data declared as Types.ValueType Modifier and Type Field Description static Types.ValueType
TensorBlock. DEFAULT_VTYPE
Methods in org.apache.sysds.runtime.data that return Types.ValueType Modifier and Type Method Description Types.ValueType
DataTensorBlock. getColValueType(int col)
Types.ValueType[]
DataTensorBlock. getSchema()
Types.ValueType[]
TensorBlock. getSchema()
Get the schema if thisTensorBlock
is heterogeneous.Types.ValueType
BasicTensorBlock. getValueType()
Types.ValueType
TensorBlock. getValueType()
Get theValueType
if thisTensorBlock
is homogeneous.static Types.ValueType
TensorBlock. resultValueType(Types.ValueType in1, Types.ValueType in2)
Methods in org.apache.sysds.runtime.data with parameters of type Types.ValueType Modifier and Type Method Description static DenseBlock
DenseBlockFactory. createDenseBlock(Types.ValueType vt, int[] dims)
static DenseBlock
DenseBlockFactory. createDenseBlock(Types.ValueType vt, int[] dims, boolean dedup)
static DenseBlock
DenseBlockFactory. createDenseBlock(Types.ValueType vt, DenseBlock.Type type, int[] dims, boolean dedup)
abstract boolean
DenseBlock. isNumeric(Types.ValueType vt)
Indicates if the dense block is a specific numeric value type.boolean
DenseBlockBool. isNumeric(Types.ValueType vt)
boolean
DenseBlockFP32. isNumeric(Types.ValueType vt)
boolean
DenseBlockFP64. isNumeric(Types.ValueType vt)
boolean
DenseBlockFP64DEDUP. isNumeric(Types.ValueType vt)
boolean
DenseBlockInt32. isNumeric(Types.ValueType vt)
boolean
DenseBlockInt64. isNumeric(Types.ValueType vt)
boolean
DenseBlockLBool. isNumeric(Types.ValueType vt)
boolean
DenseBlockLFP32. isNumeric(Types.ValueType vt)
boolean
DenseBlockLFP64. isNumeric(Types.ValueType vt)
boolean
DenseBlockLFP64DEDUP. isNumeric(Types.ValueType vt)
boolean
DenseBlockLInt32. isNumeric(Types.ValueType vt)
boolean
DenseBlockLInt64. isNumeric(Types.ValueType vt)
boolean
DenseBlockLString. isNumeric(Types.ValueType vt)
boolean
DenseBlockString. isNumeric(Types.ValueType vt)
void
DataTensorBlock. reset(int[] dims, Types.ValueType[] schema)
static Types.ValueType
TensorBlock. resultValueType(Types.ValueType in1, Types.ValueType in2)
Constructors in org.apache.sysds.runtime.data with parameters of type Types.ValueType Constructor Description BasicTensorBlock(int[] dims, Types.ValueType vt, double val)
BasicTensorBlock(Types.ValueType vt, int[] dims)
BasicTensorBlock(Types.ValueType vt, int[] dims, boolean sp)
BasicTensorBlock(Types.ValueType vt, int[] dims, boolean sp, long estnnz)
DataTensorBlock(int ncols, Types.ValueType vt)
DataTensorBlock(Types.ValueType[] schema)
DataTensorBlock(Types.ValueType[] schema, int[] dims)
DataTensorBlock(Types.ValueType[] schema, int[] dims, String[][] data)
DataTensorBlock(Types.ValueType vt, int[] dims)
TensorBlock(Types.ValueType[] schema, int[] dims)
Create a dataTensorBlock
with the given schema and the given dimensions.TensorBlock(Types.ValueType vt, int[] dims)
Create a basicTensorBlock
with the givenValueType
and the given dimensions. -
Uses of Types.ValueType in org.apache.sysds.runtime.frame.data
Methods in org.apache.sysds.runtime.frame.data that return Types.ValueType Modifier and Type Method Description Types.ValueType
FrameBlock. getColumnType(int c)
Types.ValueType[]
FrameBlock. getSchema()
Returns the schema of the frame block.Methods in org.apache.sysds.runtime.frame.data with parameters of type Types.ValueType Modifier and Type Method Description static FrameBlock
FrameBlock. convertToFrameBlock(MatrixBlock mb, Types.ValueType[] schema, int k)
void
FrameBlock. setSchema(Types.ValueType[] schema)
Sets the schema of the frame block.Constructors in org.apache.sysds.runtime.frame.data with parameters of type Types.ValueType Constructor Description FrameBlock(int ncols, Types.ValueType vt)
FrameBlock(Types.ValueType[] schema)
FrameBlock(Types.ValueType[] schema, int rlen)
FrameBlock(Types.ValueType[] schema, String[] names)
FrameBlock(Types.ValueType[] schema, String[][] data)
FrameBlock(Types.ValueType[] schema, String[] names, int rlen)
FrameBlock(Types.ValueType[] schema, String[] names, String[][] data)
allocate a FrameBlock with the given data arrays.FrameBlock(Types.ValueType[] schema, String[] colNames, ColumnMetadata[] meta, Array<?>[] data)
FrameBlock(Types.ValueType[] schema, String constant, int nRow)
FrameBlock constructor with constant -
Uses of Types.ValueType in org.apache.sysds.runtime.frame.data.columns
Methods in org.apache.sysds.runtime.frame.data.columns that return Types.ValueType Modifier and Type Method Description abstract Types.ValueType
Array. getValueType()
Get the current value type of this array.Types.ValueType
BitSetArray. getValueType()
Types.ValueType
BooleanArray. getValueType()
Types.ValueType
CharArray. getValueType()
Types.ValueType
DDCArray. getValueType()
Types.ValueType
DoubleArray. getValueType()
Types.ValueType
FloatArray. getValueType()
Types.ValueType
HashLongArray. getValueType()
Types.ValueType
IntegerArray. getValueType()
Types.ValueType
LongArray. getValueType()
Types.ValueType
OptionalArray. getValueType()
Types.ValueType
RaggedArray. getValueType()
Types.ValueType
StringArray. getValueType()
Methods in org.apache.sysds.runtime.frame.data.columns that return types with arguments of type Types.ValueType Modifier and Type Method Description Pair<Types.ValueType,Boolean>
Array. analyzeValueType()
Analyze the column to figure out if the value type can be refined to a better type.abstract Pair<Types.ValueType,Boolean>
Array. analyzeValueType(int maxCells)
Analyze the column to figure out if the value type can be refined to a better type.Pair<Types.ValueType,Boolean>
BitSetArray. analyzeValueType(int maxCells)
Pair<Types.ValueType,Boolean>
BooleanArray. analyzeValueType(int maxCells)
Pair<Types.ValueType,Boolean>
CharArray. analyzeValueType(int maxCells)
Pair<Types.ValueType,Boolean>
DDCArray. analyzeValueType(int maxCells)
Pair<Types.ValueType,Boolean>
DoubleArray. analyzeValueType(int maxCells)
Pair<Types.ValueType,Boolean>
FloatArray. analyzeValueType(int maxCells)
Pair<Types.ValueType,Boolean>
HashLongArray. analyzeValueType(int maxCells)
Pair<Types.ValueType,Boolean>
IntegerArray. analyzeValueType(int maxCells)
Pair<Types.ValueType,Boolean>
LongArray. analyzeValueType(int maxCells)
Pair<Types.ValueType,Boolean>
OptionalArray. analyzeValueType(int maxCells)
Pair<Types.ValueType,Boolean>
RaggedArray. analyzeValueType(int maxCells)
Pair<Types.ValueType,Boolean>
StringArray. analyzeValueType(int maxCells)
Methods in org.apache.sysds.runtime.frame.data.columns with parameters of type Types.ValueType Modifier and Type Method Description static Array<?>
ArrayFactory. allocate(Types.ValueType v, int nRow)
static Array<?>
ArrayFactory. allocate(Types.ValueType v, int nRow, String val)
static Array<?>
ArrayFactory. allocateOptional(Types.ValueType v, int nRow)
Array<?>
Array. changeType(Types.ValueType t)
Change the allocated array to a different type.Array<?>
Array. changeType(Types.ValueType t, boolean containsNull)
Array<?>
Array. changeTypeWithNulls(Types.ValueType t)
Array<?>
DDCArray. changeTypeWithNulls(Types.ValueType t)
Array<?>
OptionalArray. changeTypeWithNulls(Types.ValueType t)
static <T> Array<?>
DDCArray. compressToDDC(Array<T> arr, Types.ValueType vt, boolean containsNull)
compress and change value.static Object
ArrayFactory. defaultNullValue(Types.ValueType v)
static long
ArrayFactory. getInMemorySize(Types.ValueType type, int _numRows, boolean containsNull)
static Object
ArrayFactory. parseString(String s, Types.ValueType v)
Array<?>
Array. safeChangeType(Types.ValueType t, boolean containsNull)
Constructors in org.apache.sysds.runtime.frame.data.columns with parameters of type Types.ValueType Constructor Description OptionalArray(T[] a, Types.ValueType vt)
-
Uses of Types.ValueType in org.apache.sysds.runtime.frame.data.compress
Fields in org.apache.sysds.runtime.frame.data.compress declared as Types.ValueType Modifier and Type Field Description Types.ValueType
ArrayCompressionStatistics. valueType
Constructors in org.apache.sysds.runtime.frame.data.compress with parameters of type Types.ValueType Constructor Description ArrayCompressionStatistics(int bytePerValue, int nUnique, boolean shouldCompress, Types.ValueType valueType, boolean containsNull, ArrayFactory.FrameArrayType bestType, long originalSize, long compressedSizeEstimate)
-
Uses of Types.ValueType in org.apache.sysds.runtime.frame.data.iterators
Methods in org.apache.sysds.runtime.frame.data.iterators with parameters of type Types.ValueType Modifier and Type Method Description static RowIterator<Object>
IteratorFactory. getObjectRowIterator(FrameBlock fb, Types.ValueType[] schema)
Get a row iterator over the frame where all fields are encoded as boxed objects according to the value types of the provided target schema. -
Uses of Types.ValueType in org.apache.sysds.runtime.frame.data.lib
Methods in org.apache.sysds.runtime.frame.data.lib that return Types.ValueType Modifier and Type Method Description static Types.ValueType
FrameUtil. isFloatType(String val, int len)
static Types.ValueType
FrameUtil. isHash(String val, int len)
static Types.ValueType
FrameUtil. isIntType(String val, int len)
static Types.ValueType
FrameUtil. isType(double val)
static Types.ValueType
FrameUtil. isType(double val, Types.ValueType min)
static Types.ValueType
FrameUtil. isType(String val)
static Types.ValueType
FrameUtil. isType(String val, Types.ValueType minType)
Get type type subject to minimum another type.Methods in org.apache.sysds.runtime.frame.data.lib with parameters of type Types.ValueType Modifier and Type Method Description static FrameBlock
FrameLibApplySchema. applySchema(FrameBlock fb, Types.ValueType[] schema)
Method to create a new FrameBlock where the given schema is applied.static FrameBlock
FrameLibApplySchema. applySchema(FrameBlock fb, Types.ValueType[] schema, int k)
Method to create a new FrameBlock where the given schema is applied, k is the parallelization degree.static FrameBlock
FrameFromMatrixBlock. convertToFrameBlock(MatrixBlock mb, Types.ValueType[] schema, int k)
static FrameBlock
FrameFromMatrixBlock. convertToFrameBlock(MatrixBlock mb, Types.ValueType vt, int k)
static boolean
FrameUtil. isDefault(String v, Types.ValueType t)
static Types.ValueType
FrameUtil. isType(double val, Types.ValueType min)
static Types.ValueType
FrameUtil. isType(String val, Types.ValueType minType)
Get type type subject to minimum another type. -
Uses of Types.ValueType in org.apache.sysds.runtime.instructions
Methods in org.apache.sysds.runtime.instructions with parameters of type Types.ValueType Modifier and Type Method Description static String
InstructionUtils. createLiteralOperand(String val, Types.ValueType vt)
-
Uses of Types.ValueType in org.apache.sysds.runtime.instructions.cp
Methods in org.apache.sysds.runtime.instructions.cp that return Types.ValueType Modifier and Type Method Description Types.ValueType
CPOperand. getValueType()
Types.ValueType
Data. getValueType()
Methods in org.apache.sysds.runtime.instructions.cp with parameters of type Types.ValueType Modifier and Type Method Description static LiteralOp
ScalarObjectFactory. createLiteralOp(Types.ValueType vt, String value)
static ScalarObject
ScalarObjectFactory. createScalarObject(Types.ValueType vt, double value)
static ScalarObject
ScalarObjectFactory. createScalarObject(Types.ValueType vt, Object obj)
static ScalarObject
ScalarObjectFactory. createScalarObject(Types.ValueType vt, String value)
static ScalarObject
ScalarObjectFactory. createScalarObject(Types.ValueType vt, LiteralOp lit)
static ScalarObject
ScalarObjectFactory. createScalarObject(Types.ValueType vt, ScalarObject so)
Constructors in org.apache.sysds.runtime.instructions.cp with parameters of type Types.ValueType Constructor Description CPOperand(String name, Types.ValueType vt, Types.DataType dt)
CPOperand(String name, Types.ValueType vt, Types.DataType dt, boolean literal)
ScalarObject(Types.ValueType vt)
-
Uses of Types.ValueType in org.apache.sysds.runtime.instructions.spark.data
Constructors in org.apache.sysds.runtime.instructions.spark.data with parameters of type Types.ValueType Constructor Description FrameReblockBuffer(int buffersize, long rlen, long clen, Types.ValueType[] schema)
-
Uses of Types.ValueType in org.apache.sysds.runtime.instructions.spark.utils
Methods in org.apache.sysds.runtime.instructions.spark.utils with parameters of type Types.ValueType Modifier and Type Method Description static org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>
FrameRDDConverterUtils. binaryBlockToDataFrame(org.apache.spark.sql.SparkSession sparkSession, org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock> in, DataCharacteristics mc, Types.ValueType[] schema)
static org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>
FrameRDDConverterUtils. binaryBlockToDataFrame(org.apache.spark.sql.SQLContext sqlContext, org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock> in, DataCharacteristics mc, Types.ValueType[] schema)
Deprecated.static int
FrameRDDConverterUtils. convertDFSchemaToFrameSchema(org.apache.spark.sql.types.StructType dfschema, String[] colnames, Types.ValueType[] fschema, boolean containsID)
NOTE: regarding the support of vector columns, we make the following schema restriction: single vector column, which allows inference of the vector length without data access and covers the common case.static org.apache.spark.sql.types.StructType
FrameRDDConverterUtils. convertFrameSchemaToDFSchema(Types.ValueType[] fschema, boolean containsID)
This function will convert Frame schema into DataFrame schemastatic org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock>
FrameRDDConverterUtils. csvToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaPairRDD<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> input, DataCharacteristics mc, Types.ValueType[] schema, boolean hasHeader, String delim, boolean fill, double fillValue, Set<String> naStrings)
static org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock>
FrameRDDConverterUtils. csvToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaRDD<String> input, DataCharacteristics mcOut, Types.ValueType[] schema, boolean hasHeader, String delim, boolean fill, double fillValue, Set<String> naStrings)
static org.apache.spark.api.java.JavaRDD<org.apache.spark.sql.Row>
FrameRDDConverterUtils. csvToRowRDD(org.apache.spark.api.java.JavaSparkContext sc, String fnameIn, String delim, Types.ValueType[] schema)
static org.apache.spark.api.java.JavaRDD<org.apache.spark.sql.Row>
FrameRDDConverterUtils. csvToRowRDD(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaRDD<String> dataRdd, String delim, Types.ValueType[] schema)
static org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock>
FrameRDDConverterUtils. textCellToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaPairRDD<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> in, DataCharacteristics mcOut, Types.ValueType[] schema)
static org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock>
FrameRDDConverterUtils. textCellToBinaryBlockLongIndex(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaPairRDD<Long,org.apache.hadoop.io.Text> input, DataCharacteristics mc, Types.ValueType[] schema)
-
Uses of Types.ValueType in org.apache.sysds.runtime.io
Methods in org.apache.sysds.runtime.io that return Types.ValueType Modifier and Type Method Description Types.ValueType[]
FrameReader. getDefSchema(long clen)
Methods in org.apache.sysds.runtime.io with parameters of type Types.ValueType Modifier and Type Method Description FrameBlock
FrameReader. readFrameFromHDFS(String fname, Types.ValueType[] schema, long rlen, long clen)
abstract FrameBlock
FrameReader. readFrameFromHDFS(String fname, Types.ValueType[] schema, String[] names, long rlen, long clen)
FrameBlock
FrameReaderBinaryBlock. readFrameFromHDFS(String fname, Types.ValueType[] schema, String[] names, long rlen, long clen)
FrameBlock
FrameReaderJSONL. readFrameFromHDFS(String fname, Types.ValueType[] schema, Map<String,Integer> schemaMap, long rlen, long clen)
FrameBlock
FrameReaderProto. readFrameFromHDFS(String fname, Types.ValueType[] schema, String[] names, long rlen, long clen)
FrameBlock
FrameReaderTextCell. readFrameFromHDFS(String fname, Types.ValueType[] schema, String[] names, long rlen, long clen)
FrameBlock
FrameReaderTextCSV. readFrameFromHDFS(String fname, Types.ValueType[] schema, String[] names, long rlen, long clen)
FrameBlock
FrameReader. readFrameFromInputStream(InputStream is, Types.ValueType[] schema, long rlen, long clen)
abstract FrameBlock
FrameReader. readFrameFromInputStream(InputStream is, Types.ValueType[] schema, String[] names, long rlen, long clen)
FrameBlock
FrameReaderBinaryBlock. readFrameFromInputStream(InputStream is, Types.ValueType[] schema, String[] names, long rlen, long clen)
FrameBlock
FrameReaderProto. readFrameFromInputStream(InputStream is, Types.ValueType[] schema, String[] names, long rlen, long clen)
FrameBlock
FrameReaderTextCell. readFrameFromInputStream(InputStream is, Types.ValueType[] schema, String[] names, long rlen, long clen)
FrameBlock
FrameReaderTextCSV. readFrameFromInputStream(InputStream is, Types.ValueType[] schema, String[] names, long rlen, long clen)
abstract TensorBlock
TensorReader. readTensorFromHDFS(String fname, long[] dims, int blen, Types.ValueType[] schema)
TensorBlock
TensorReaderBinaryBlock. readTensorFromHDFS(String fname, long[] dims, int blen, Types.ValueType[] schema)
TensorBlock
TensorReaderTextCell. readTensorFromHDFS(String fname, long[] dims, int blen, Types.ValueType[] schema)
-
Uses of Types.ValueType in org.apache.sysds.runtime.iogen
Methods in org.apache.sysds.runtime.iogen that return Types.ValueType Modifier and Type Method Description Types.ValueType
MappingProperties. getPatternValueType()
Types.ValueType[]
CustomProperties. getSchema()
Methods in org.apache.sysds.runtime.iogen with parameters of type Types.ValueType Modifier and Type Method Description Pair<Integer,Integer>
RawIndex. findValue(Object value, Types.ValueType valueType)
void
MappingProperties. setPatternRepresentation(Types.ValueType valueType, Object value)
void
CustomProperties. setSchema(Types.ValueType[] schema)
-
Uses of Types.ValueType in org.apache.sysds.runtime.iogen.codegen
Methods in org.apache.sysds.runtime.iogen.codegen that return Types.ValueType Modifier and Type Method Description Types.ValueType
CodeGenTrieNode. getValueType()
Methods in org.apache.sysds.runtime.iogen.codegen with parameters of type Types.ValueType Modifier and Type Method Description void
CodeGenTrieNode. setValueType(Types.ValueType valueType)
Constructors in org.apache.sysds.runtime.iogen.codegen with parameters of type Types.ValueType Constructor Description CodeGenTrieNode(boolean endOfCondition, String colIndex, Types.ValueType valueType, String key, HashSet<String> naStrings, CodeGenTrieNode.NodeType type)
-
Uses of Types.ValueType in org.apache.sysds.runtime.iogen.template
Methods in org.apache.sysds.runtime.iogen.template with parameters of type Types.ValueType Modifier and Type Method Description FrameBlock
FrameGenerateReader. readFrameFromHDFS(String fname, Types.ValueType[] schema, String[] names, long rlen, long clen)
FrameBlock
FrameGenerateReaderParallel. readFrameFromHDFS(String fname, Types.ValueType[] schema, String[] names, long rlen, long clen)
FrameBlock
FrameGenerateReader. readFrameFromInputStream(InputStream is, Types.ValueType[] schema, String[] names, long rlen, long clen)
FrameBlock
FrameGenerateReaderParallel. readFrameFromInputStream(InputStream is, Types.ValueType[] schema, String[] names, long rlen, long clen)
-
Uses of Types.ValueType in org.apache.sysds.runtime.transform.decode
Methods in org.apache.sysds.runtime.transform.decode that return Types.ValueType Modifier and Type Method Description Types.ValueType[]
Decoder. getSchema()
Methods in org.apache.sysds.runtime.transform.decode with parameters of type Types.ValueType Modifier and Type Method Description static Decoder
DecoderFactory. createDecoder(String spec, String[] colnames, Types.ValueType[] schema, FrameBlock meta)
static Decoder
DecoderFactory. createDecoder(String spec, String[] colnames, Types.ValueType[] schema, FrameBlock meta, int clen)
static Decoder
DecoderFactory. createDecoder(String spec, String[] colnames, Types.ValueType[] schema, FrameBlock meta, int minCol, int maxCol)
static Decoder
DecoderFactory. createDecoder(String spec, String[] colnames, Types.ValueType[] schema, FrameBlock meta, int clen, int minCol, int maxCol)
-
Uses of Types.ValueType in org.apache.sysds.runtime.transform.encode
Methods in org.apache.sysds.runtime.transform.encode with parameters of type Types.ValueType Modifier and Type Method Description static MultiColumnEncoder
EncoderFactory. createEncoder(String spec, String[] colnames, Types.ValueType[] schema, int clen, FrameBlock meta)
static MultiColumnEncoder
EncoderFactory. createEncoder(String spec, String[] colnames, Types.ValueType[] schema, int clen, FrameBlock meta, MatrixBlock embeddings)
static MultiColumnEncoder
EncoderFactory. createEncoder(String spec, String[] colnames, Types.ValueType[] schema, FrameBlock meta)
static MultiColumnEncoder
EncoderFactory. createEncoder(String spec, String[] colnames, Types.ValueType[] schema, FrameBlock meta, int minCol, int maxCol)
static MultiColumnEncoder
EncoderFactory. createEncoder(String spec, String[] colnames, Types.ValueType[] schema, FrameBlock meta, MatrixBlock embeddings)
-
Uses of Types.ValueType in org.apache.sysds.runtime.transform.tokenize
Methods in org.apache.sysds.runtime.transform.tokenize that return Types.ValueType Modifier and Type Method Description Types.ValueType[]
Tokenizer. getSchema()
-
Uses of Types.ValueType in org.apache.sysds.runtime.transform.tokenize.applier
Methods in org.apache.sysds.runtime.transform.tokenize.applier that return Types.ValueType Modifier and Type Method Description abstract Types.ValueType[]
TokenizerApplier. getOutSchema()
Types.ValueType[]
TokenizerApplierCount. getOutSchema()
Types.ValueType[]
TokenizerApplierHash. getOutSchema()
Types.ValueType[]
TokenizerApplierPosition. getOutSchema()
-
Uses of Types.ValueType in org.apache.sysds.runtime.util
Methods in org.apache.sysds.runtime.util that return Types.ValueType Modifier and Type Method Description static Types.ValueType[]
UtilFunctions. copyOf(Types.ValueType[] schema1, Types.ValueType[] schema2)
static Types.ValueType[]
UtilFunctions. nCopies(int n, Types.ValueType vt)
static Types.ValueType[]
UtilFunctions. stringToValueType(String[] schemaValues)
Generates a ValueType array from a String arrayMethods in org.apache.sysds.runtime.util with parameters of type Types.ValueType Modifier and Type Method Description static int
UtilFunctions. compareTo(Types.ValueType vt, Object in1, Object in2)
static MatrixBlock
Py4jConverterUtils. convertPy4JArrayToMB(byte[] data, int rlen, int clen, boolean isSparse, Types.ValueType valueType)
static MatrixBlock
Py4jConverterUtils. convertPy4JArrayToMB(byte[] data, int rlen, int clen, Types.ValueType valueType)
static FrameBlock
DataConverter. convertToFrameBlock(String[][] data, Types.ValueType[] schema)
static FrameBlock
DataConverter. convertToFrameBlock(String[][] data, Types.ValueType[] schema, String[] colnames)
static FrameBlock
DataConverter. convertToFrameBlock(MatrixBlock mb, Types.ValueType vt)
Converts a matrix block into a frame block of value type given.static FrameBlock
DataConverter. convertToFrameBlock(MatrixBlock mb, Types.ValueType[] schema)
Converts a matrix block into a frame block of with the given schemastatic FrameBlock
DataConverter. convertToFrameBlock(MatrixBlock mb, Types.ValueType[] schema, int k)
Converts a matrix block into a frame block of with the given schemastatic FrameBlock
DataConverter. convertToFrameBlock(MatrixBlock mb, Types.ValueType vt, int k)
Converts a matrix block into a frame block of a given value type.static TensorBlock
DataConverter. convertToTensorBlock(MatrixBlock mb, Types.ValueType vt, boolean toBasicTensor)
static Types.ValueType[]
UtilFunctions. copyOf(Types.ValueType[] schema1, Types.ValueType[] schema2)
static Object
UtilFunctions. doubleToObject(Types.ValueType vt, double in)
static Object
UtilFunctions. doubleToObject(Types.ValueType vt, double in, boolean sparse)
static int
UtilFunctions. frequency(Types.ValueType[] schema, Types.ValueType vt)
static FrameBlock
UtilFunctions. generateRandomFrameBlock(int rows, int cols, Types.ValueType[] schema, Random random)
Generates a random FrameBlock with given parameters.static Object
UtilFunctions. generateRandomValueFromValueType(Types.ValueType valueType, Random random)
Generates a random value for a given Value Typestatic String
HDFSTool. metaDataToString(Types.ValueType vt, Types.ValueType[] schema, Types.DataType dt, DataCharacteristics dc, Types.FileFormat fmt, FileFormatProperties formatProperties, PrivacyConstraint privacyConstraint)
static Types.ValueType[]
UtilFunctions. nCopies(int n, Types.ValueType vt)
static boolean
UtilFunctions. objectToBoolean(Types.ValueType vt, Object in)
static char
UtilFunctions. objectToCharacter(Types.ValueType vt, Object in)
static double
UtilFunctions. objectToDouble(Types.ValueType vt, Object in)
static double
UtilFunctions. objectToDoubleSafe(Types.ValueType vt, Object in)
static float
UtilFunctions. objectToFloat(Types.ValueType vt, Object in)
static int
UtilFunctions. objectToInteger(Types.ValueType vt, Object in)
static long
UtilFunctions. objectToLong(Types.ValueType vt, Object in)
static Object
UtilFunctions. objectToObject(Types.ValueType vt, Object in)
static Object
UtilFunctions. objectToObject(Types.ValueType vt, Object in, boolean ignoreNull)
static Object
HDFSTool. readObjectFromHDFSFile(String filename, Types.ValueType vt)
static ScalarObject
HDFSTool. readScalarObjectFromHDFSFile(String fname, Types.ValueType vt)
static TensorBlock
DataConverter. readTensorFromHDFS(String dir, Types.FileFormat fmt, long[] dims, int blen, Types.ValueType[] schema)
static Object
UtilFunctions. stringToObject(Types.ValueType vt, String in)
static void
HDFSTool. writeMetaDataFile(String mtdfile, Types.ValueType vt, Types.ValueType[] schema, Types.DataType dt, DataCharacteristics mc, Types.FileFormat fmt)
static void
HDFSTool. writeMetaDataFile(String mtdfile, Types.ValueType vt, Types.ValueType[] schema, Types.DataType dt, DataCharacteristics dc, Types.FileFormat fmt, FileFormatProperties formatProperties)
static void
HDFSTool. writeMetaDataFile(String mtdfile, Types.ValueType vt, Types.ValueType[] schema, Types.DataType dt, DataCharacteristics dc, Types.FileFormat fmt, FileFormatProperties formatProperties, PrivacyConstraint privacyConstraint)
static void
HDFSTool. writeMetaDataFile(String mtdfile, Types.ValueType vt, Types.ValueType[] schema, Types.DataType dt, DataCharacteristics mc, Types.FileFormat fmt, PrivacyConstraint privacyConstraint)
static void
HDFSTool. writeMetaDataFile(String mtdfile, Types.ValueType vt, DataCharacteristics mc, Types.FileFormat fmt)
static void
HDFSTool. writeMetaDataFile(String mtdfile, Types.ValueType vt, DataCharacteristics dc, Types.FileFormat fmt, FileFormatProperties formatProperties)
static void
HDFSTool. writeMetaDataFile(String mtdfile, Types.ValueType vt, DataCharacteristics dc, Types.FileFormat fmt, FileFormatProperties formatProperties, PrivacyConstraint privacyConstraint)
static void
HDFSTool. writeMetaDataFile(String mtdfile, Types.ValueType vt, DataCharacteristics mc, Types.FileFormat fmt, PrivacyConstraint privacyConstraint)
static void
HDFSTool. writeMetaDataFileFrame(String mtdfile, Types.ValueType[] schema, DataCharacteristics dc, Types.FileFormat fmt)
static void
HDFSTool. writeScalarMetaDataFile(String mtdfile, Types.ValueType vt)
static void
HDFSTool. writeScalarMetaDataFile(String mtdfile, Types.ValueType vt, PrivacyConstraint privacyConstraint)
-