hdfs
gossamr
hdfs | gossamr | |
---|---|---|
3 | 1 | |
1,345 | 85 | |
- | - | |
4.2 | 0.0 | |
2 months ago | about 4 years ago | |
Go | Go | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
hdfs
-
MIT 6.824 MapReduce: Having trouble in connecting Hadoop file system with Golang
I have completed the part for MapReduce in Go on a local machine with multiple processes. Now, I want to run it over different machines for which I'll need a distributed file system like Hadoop. I am using HDFS Client for making queries to HDFS, but I am not able to set the appropriate file path in Go for input files. It is giving me an error similar to this issue.
-
Hadoop with Golang?
I find Go and Hadoop combination good when it comes loading loading data to Hadoop. For example this library and client is way faster that the Java based hdfs cli. https://github.com/colinmarc/hdfs
-
Read / weite HDFS file using java or python sdk in go sdk
This is a library and a cli to connect to hdfs. I have used it from inside docker containers. https://github.com/colinmarc/hdfs
gossamr
What are some alternatives?
juicefs - JuiceFS is a distributed POSIX file system built on top of Redis and S3.
seaweedfs - SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
Seaweed File System - SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. [Moved to: https://github.com/seaweedfs/seaweedfs]
gotests - Automatically generate Go test boilerplate from your source code.
barkfetch - Alternative to neofetch, written in go
MapReduce
cobra - A Commander for modern Go CLI interactions