github.com/whtcorpsinc/milevadb-prod@v0.0.0-20211104133533-f57f4be3b597/README.md (about) 1 ![](docs/Transparent.png) 2 3 ##This is a fork of MilevaDB by @CavHack copyrighted to WHTCORPS INC and EINSTAI; In consortia with OpenAI 4 ## OSS Software offered as is, Enterprise edition available to subscribers of EinstAI Californium and Moscovium 5 6 ## What is MilevaDB? 7 8 - __The transactions can span multiple tables__ 9 10 The go database is able to support any number of concurrent readers without locking, and allows a writer to make progress. MilevaDB supports rich transactions, in which multiple objects are inserted, updated or deleted. 11 12 - __Cloud-Native and Serverless__ 13 14 MilevaDB is designed to work in the cloud -- public, private, or hybrid -- making deployment, provisioning, operations, and maintenance simple. 15 16 - __Favor availability over consistency in the presence of network partitions__ 17 18 MilevaDB is a distributed database with a focus on high availability and horizontal scalability. It is based on egalitarian multi-paxos algorithm and optimized for writes. 19 20 ##Write-optimized storage__ 21 22 MilevaDN is a highly-available, distributed database that uses the Reliable Data Replication (RDR) protocol to provide consistent and reliable data. 23 24 MilevaDB is a distributed relational database. It is an ACID compliant transactional database that can be sharded and replicated across multiple nodes, with support for full cross-shard transactions. 25 26 It supports SQL queries and joins, as well as schema changes such as adding columns to tables without requiring downtime. 27 28 - __Graphs are hard to shard.__ 29 30 31 The first challenge is to design a graph database that can be distributed across multiple machines. This requires us to have a mechanism for partitioning the data across the machines in such a way that each machine has only partial information about the graph, but still allows the machines to work together to answer queries. 32 33 34 The second challenge is that in a graph, the same entity can be connected to multiple other entities. In a relational database, this is not an issue because each row in a table has its own unique identifier and hence, it’s easy to identify the entity that is being referenced. However, in a graph, there is no such identifier and hence, it’s not possible to identify the same entity across multiple connections. 35 36 The third challenge is that in a graph database, there are two types of edges: directed and undirected. In a directed edge, the direction of the edge is important and hence, it’s not possible to simply join two tables based on an undirected edge. 37 38 -__Control Quota on tables that can be imported in parallel_ 39 40 The DBS_JOBS table is the primary interface to the MilevaDB cluster. It provides both a current status and a short history of DBS operations across the cluster. 41 42 ##SUSE meets FUSE with a bit of AllegroSQL 43 44 Each table is split into one "index engine" to store indices, and multiple "data engines" to store row data. These settings control the maximum number of tables that can be imported in parallel. 45 46 The system is designed to be a distributed, fault tolerant 47 relational graph database which uses a Key Value store as its data store provided by FoundationDB via EinsteinDB, which is designed to be used in the cloud and can handle billions of edges and vertices. 48 49 -__tl;dr_ 50 51 tl;dr: We are building a distributed graph database that is optimized for traversing the graph from a small set of nodes to their neighbors, to their neighbors neighbors etc. 52 53 ##What is the current state of the project? 54 55 We have a working prototype of the database, which is able to store and query graphs of up to a few million vertices and edges. We are currently working on a paper describing the database and its design. 56 57 ##What are the short-term plans for MilevaDB? 58 59 We are currently working on a paper describing the database and its design. 60 61 ##What is the long-term vision for MilevaDB? 62 63 The long-term vision is to build a distributed relational graph database that is optimized for embedding key-value hybrid indices, traversing the network from a small set of nodes to their neighbors, to their neighbors neighbors etc. 64 65 ##How you plan to make it happen? 66 67 68 We are working on a paper describing the database and its design. 69 70 ##Who we are: 71 72 We are a team of researchers at WHTCORPS INC and EINST.AI, led by Spencer Fogelman(UCLA), Josh Leder(Netflix), and Karl Whitford(Amazon/EinsteinDB).