What open source projects of go language are worth learning

Reprint ：https://www.zhihu.com/question/20801814

You can see , This year's Google home Go The popularity of programming languages has an alarming upward trend , Its development is also getting better , Therefore, this paper sorts out some excellent Go Store relevant open source projects and libraries , share , Learning together .

Storage server （Storage Server）

Go Implemented storage server

• minio- Minio It's a relationship with Amazon S3 APIs Compatible open source object storage server , Distributed storage solution
• rclone - “ For cloud storage Rsync” - Google Drive, Amazon Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Cloudfile…
• camlistore - Camlistore It's your personal storage system ： A storage 、 Sync 、 share 、 How to model and back up content
• torus - CoreOS Modern distributed storage system
• s3git - Cloud storage Git. Distributed version control system for data
• rook - to open up 、 Cloud local and general distributed storage

Key-Value Storage （Key-Value Store）

Go Realized Key-Value Storage

• etcd - Reliable distributed key-value Storage , The most critical data for distributed systems
• go-cache - Go Language implementation of an in memory cache framework , Realization Key-Value Sequence storage , For single machine applications
• biscuit - Biscuit be used for AWS When building infrastructure, there are many regions HA key-value Storage
• diskv - Support disk key-value Storage

file system （File System）

Go Implemented file system

• git-lfs - For version control of large files Git Expand
• seaweedfs - SeaweedFS Is a simple and highly scalable distributed file system for small files
• fsnotify - Go Implementation of cross platform file system monitoring library
• goofys - Go High performance achieved ,POSIX-ish Amazon S3 file system
• go-systemd - systemd Of Go Language binding version （ Include socket activation, journal, D-Bus, and unit files）
• gcsfuse - Used with Google Cloud storage interactive user space file system
• svfs - be based on Openstack Virtual file system

database （Database）

Go Implemented database

• BigCache - Efficient for Gigabit data key/value cache
• bolt - Go Low level implementation key/value database
• buntdb - One Go Fast implementation 、 Embeddable key/value In-memory database , With custom index and geospatial Supported features
• cache2go - key/value Memory cache , Support automatic invalidation based on timeout
• cockroach - A scalable 、 Support geographic processing 、 Data storage system supporting transaction processing
• couchcache - from Couchbase Server support RESTful Cache microservices
• dgraph - With extensibility 、 Distributed 、 Graphic database with low latency and high throughput
• eliasdb - Use REST API, Phrase search and similar SQL No dependency of query language , Graphic database supporting transaction processing
• forestdb - Go bindings for ForestDB.Go Language binding version ForestDB
• GCache - Support available cache 、LFU、LRU and ARC Cache database
• geocache - An in-memory cache that is suitable for geolocation based applications. Apply to Geo processing application based memory caching
• goleveldb - An implementation of the LevelDB key/value database in the Go.Go Realized LevelDB key/value database
• groupcache - Groupcache Is a cache and cache population Library , In many cases, it is used to replace memcached
• influxdb - Open source distributed metrics 、 An extensible database for event and real-time analysis
• ledisdb - be based on LevelDB similar Redis A high performance NoSQL database
• levigo - be used for LevelDB Of Go Package
• moss - Go The simplicity of implementation LSM key-value Storage engine
• piladb - Lightweight design based on stack data structure RESTful Database engine
• pREST - For anyone from PostgreSQL The database provides a RESTful API
• prometheus - Service monitoring system and time series database
• rqlite - be based on SQLite Build lightweight 、 Distributed relational database
• scribble - A small Flat File JSON Storage
• tidb - TiDB It's a distribution SQL database , Inspired by Google F1 and Google spanner.TiDB Support includes traditional RDBMS and NoSQL Characteristics of .
• tiedot - be based on Go Of NoSQL database
• Tile38 - Geolocation database with spatial index and real-time geofence

database transfer

• darwin - Go Implemented database schema Evolution Library
• goose - Database migration tool . You can create increments SQL or Go Scripts to manage the evolution of the database
• gormigrate - Gorm ORM Database migration assistant for
• migrate - Go Database migration processing implemented , Support MySQL, PostgreSQL, Cassandra, and SQLite
• pravasan - Simple migration tools , At present, we support MySQL,PostgreSQL, But the plan soon supported SQLite, MongoDB etc.
• soda - With database migration 、 Create and ORM And so on , Apply to MySQL, PostgreSQL, and SQLite
• sql-migrate - database schema Migration tools . Allow to use go-bindata Embed migration into your application

Database tools

• go-mysql - Go Implemented for processing MySQL Protocols and replicated toolsets
• go-mysql-elasticsearch - take MySQL Data is automatically synchronized to Elasticsearch in
• kingshard - Go High performance achieved MySQL Proxy project
• myreplication - MySQL Binary log replication listener . Support statement and row based replication
• orchestrator - MySQL Copy topology manager and visualizer
• pgweb - Go Based on Web Of PostgreSQL Database management system
• vitess - Distributed MySQL Toolset .vitess Provides servers and tools , In order to facilitate large-scale Web Service MySQL Database extension

SQL Query builder , For building and using SQL The library of

• dat - Go Realized Postgres Data access toolkit
• Dotsql - Go Language implementation library , Can help you to sql Save the file somewhere and use it easily
• goqu - Go Realized SQL Builders and query libraries
• igor - PostgreSQL Of Abstraction layer , Support advanced functions and use similar Gorm The grammar of
• ozzo-dbx - Powerful data retrieval methods and DB-agnostic Query build function
• scaneo - Generate Go Code to convert database rows into arbitrary structures
• sqrl - SQL Query builder ,Squirrel Of fork Better performance
• Squirrel - Help you build SQL Of the query Go library
• xo - Based on existing schema Define or support PostgreSQL,MySQL,SQLite,Oracle and Microsoft SQL Server Custom query generation database idiom Go Code

Database driven

Libraries for connecting and manipulating databases

relational database

• bgc - Go Implemented for BigQuery Data storage connection
• firebirdsql - Firebird RDBMS SQL drive
• go-adodb - Microsoft ActiveX Object Database driven , Use database/sql
• go-bqstreamer - BigQuery Fast concurrent stream insertion
• go-mssqldb - Microsoft MSSQL drive
• go-oci8 - Oracle drive , Use database/sql
• go-sql-driver/mysql - MySQL drive
• go-sqlite3 - SQLite3 drive , Use database/sql
• gofreetds - Microsoft MSSQL drive .Go wrapper over FreeTDS.
• pgx - PostgreSQL drive
• pq - Go Implemented for database/sql Of Postgres drive

NoSQL database

• aerospike-client-go - Go Realized Aerospike client
• arangolite - Go Realized ArangoDB Lightweight driver
• asc - be used for Aerospike Data storage connection
• cayley - Support multiple back-end graphics databases
• dsc - be used for SQL, NoSQL And the data storage connection of structured files
• dynago - DynamoDB The client of
• go-couchbase - Go Realized Couchbase client
• go-couchdb - Go Realized CouchDB HTTP API Package
• gocb - Official Couchbase Go SDK package
• gocql - Go Realized Apache Cassandra drive
• gomemcache - memcache Client library
• gorethink - RethinkDB drive
• goriak - Riak KV drive
• mgo - MongoDB drive , It is based on Standards Go Idioms are very simple API Realize rich and well tested function selection under
• neo4j - Neo4j Rest API binding
• Neo4j-GO - Neo4j REST client
• neoism - Neo4j client client
• redigo - Redis Database client
• redis - Redis client
• redis - Simple and powerful Redis client
• redis - Redis Protocol compatible TCP servers/services

Search and analyze databases

• bleve - Modern text index library
• elastic - Elasticsearch client
• elastigo - Elasticsearch Client library
• goes - And Elasticsearch Interactive Libraries
• skizze - A probabilistic data-structures service and storage. Data structure services and storage

come from ：gostor/awesome-go-storage: A curated list of awesome Go storage projects and libraries