fallbackFileFormat: Class[_ <: FileFormat]
Fallback V1 FileFormat
FallBackFileSourceV2 extended resolution rule is executed (to resolve an
InsertIntoStatement with a DataSourceV2Relation with a
Name of the file table (format)
inferSchema( files: Seq[FileStatus]): Option[StructType]
Infers schema of the given
files (as Hadoop FileStatuses)
FileTable is requested for a data schema
supportsDataType( dataType: DataType): Boolean = true
supportsDataType indicates whether a given DataType is supported in read/write path or not.
Default: All DataTypes are supported by default
FileTable takes the following to be created:
FileTable is an abstract class and cannot be created directly. It is created indirectly for the concrete FileTables.
capabilities are the following TableCapabilities:
capabilities is part of the Table abstraction.
dataSchema is a schema of the data of the file-backed table
dataSchema is a Scala lazy value to guarantee that the code to initialize it is executed once only (when accessed for the first time) and cached afterwards.
dataSchema is used when:
fileIndex is used when...FIXME
partitioning is part of the Table abstraction.
properties: util.Map[String, String]
properties is simply the options.
properties is part of the Table abstraction.
schema is part of the Table abstraction.