Skip to content

IncompatibleClassChangeError went executing val trips = sqlContext.dbfFile("trips1M.dbf") #2

Description

@spcrim

Hello
I was able to build spark-dbf with Maven successfully after installing Shapefile download the trips1M.dbf
executed the Scala API ok until I executed the following
val trips = sqlContext.dbfFile("trips1M.dbf") then I got the following error.
java.lang.IncompatibleClassChangeError: class com.esri.spark.dbf.DBFRelation has interface org.apache.spark.sql.sources.PrunedScan as super class
Could you assist me in resolving this issue I try recompiling it and still get the same issue. Or is there a way to convert a list of dbf's into csv's.
Thanks
Configuration
I am using Hortonwork 2.3 HDP Spark 1.5.1
Single-node (VMWare ESXi-based) OS: CentOS 6.5
CPU: 4 vCPU
Mem: 12GB
3 HDs: 40GB, 40 GB, 35 GB (these contain an HDFS)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions