Download and view my resume (PDF)

Monday, December 2, 2013

No FileSystem for scheme: hdfs

In my programming today I had this error:

No FileSystem for scheme: hdfs

Short story: add hadoop-hdfs to your classpath

Long story: I upgraded the Hadoop libraries on my project to new versions which required me to replace "hadoop-core" with "hadoop-common". That was fine but then I got the above error. When I searched the web for help most advice had to do with misconfigured classpaths as if to imply that everyone should just know what libraries to include in the first place, but for me the missing lib was hadoop-hdfs. The error message is, I think, inadequate and ripe for improvement.

I used this POM entry:

<dependency>
    <groupId>org.apache.hadoop</groupId>
    <artifactId>hadoop-hdfs</artifactId>
    <version>2.2.0</version>
</dependency>

No comments:

Post a Comment