Object

ml.sparkling.graph.loaders.csv

CSVLoader

Related Doc: package csv

Permalink

object CSVLoader

Main class of csv loader Created by Roman Bartusiak (roman.bartusiak@pwr.edu.pl http://riomus.github.io).

Linear Supertypes
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. CSVLoader
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  6. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  10. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  11. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  12. def loadGraphFromCSV(file: String, csvLoaderConfig: CsvLoaderConfig = CsvLoaderConfig(), defaultVertex: Option[String] = Option(""), column1: Int = 0, column2: Int = 1, edgeAttributeProvider: EdgeAttributeExtractor[Double] = defaultEdgeAttribute, partitions: Int = 0)(implicit sc: SparkContext): Graph[String, Double]

    Permalink

    Simple load graph from CSV.

    Simple load graph from CSV. Columns from witch vertices will be created must be numeric identifiers of vertices

    file

    - CSV input file

    csvLoaderConfig

    - Loader config, with default value

    defaultVertex

    - default vertex, has default value

    column1

    - first column to be selected as vertex, default:0

    column2

    - second column to be selected as vertex, default:1

    sc

    - spark contex

    returns

    Graph[String,Double] - loaded graph

  13. def loadGraphFromCSV[VD, ED](file: String, graphBuilder: GraphBuilder[VD, ED], csvLoaderConfig: CsvLoaderConfig, partitions: Int)(implicit sc: SparkContext): Graph[VD, ED]

    Permalink

    Main method for graph loading from csv, should be used for extension and further development, please use case specific loading methods present in that object

    Main method for graph loading from csv, should be used for extension and further development, please use case specific loading methods present in that object

    VD

    - vertex attribute type

    ED

    - edge attribute type

    file

    - CSV file

    graphBuilder

    - graph builder to handle graph creation from csv file

    csvLoaderConfig

    - csv loader configuration

    sc

    - spark context

    returns

    Graph[VD,ED] - loaded graph

  14. def loadGraphFromCSVWitVertexIndexing[VD, ED](file: String, csvLoaderConfig: CsvLoaderConfig = CsvLoaderConfig(), defaultVertex: Option[VD] = Option("").asInstanceOf[Option[VD]], column1: Int = 0, column2: Int = 1, edgeAttributeProvider: EdgeAttributeExtractor[ED] = defaultEdgeAttribute, partitions: Int = 0)(implicit arg0: ClassTag[VD], arg1: ClassTag[ED], sc: SparkContext): Graph[VD, ED]

    Permalink

    Load graph from given CSV file, indexing vertices toprovide each unique ID.

    Load graph from given CSV file, indexing vertices toprovide each unique ID.

    VD

    - vertex type

    ED

    - edge type

    file

    - input CSV file

    csvLoaderConfig

    - CSV loader config , has default value

    defaultVertex

    - default Vertex value

    column1

    - first column to be selected as vertex, default:0

    column2

    - second column to be selected as vertex, default:1

    edgeAttributeProvider

    - provider for edge attribute, default 1L

    sc

    - spark context

    returns

    Graph[VD,ED] - loaded graph

  15. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  16. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  17. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  18. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  19. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  20. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  21. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  22. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped