Improved documentation landing page (#665)

* Better doc landing page

* Typo

* Improved docs landing page

.gitignore

@@ -178,3 +178,4 @@ CMakeLists.txt.user
 gpt4all-chat/meta/*
 gpt4all-chat/models/*
 build_*
+build-*

gpt4all-bindings/python/docs/index.md

@@ -1,15 +1,50 @@
 # GPT4All
+Welcome to the GPT4All technical documentation.
 
-GTP4All is an ecosystem to train and deploy **powerful** and **customized** large language models that run locally on consumer grade CPUs.
+GPT4All is an open-source software ecosystem that allows anyone to train and deploy **powerful** and **customized** large language models on **everyday hardware**.
+Nomic AI oversees contributions to the open-source ecosystem ensuring quality, security and maintainability.
 
+GPT4All software is optimized to run inference of 7-13 billion parameter large language models on the CPUs of laptops, desktops and servers.
 
+### Navigating the Documentation
+In an effort to ensure cross-operating system and cross-language compatibility, the [GPT4All software ecosystem](https://github.com/nomic-ai/gpt4all)
+is organized as a monorepo with the following structure:
+
+- **gpt4all-backend**: The GPT4All backend maintains and exposes a universal, performance optimized C API for running inference with multi-billion parameter transformer decoders.
+This C API is then bound to any higher level programming language such as C++, Python, Go, etc.
+- **gpt4all-bindings**: GPT4All bindings contain a variety of high-level programming languages that implement the C API. Each directory is a bound programming language.
+- **gpt4all-api**: The GPT4All API (under initial development) exposes REST API endpoints for gathering completions and embeddings from large language models.
+- **gpt4all-chat**: GPT4All Chat is an OS native chat application that runs on OSX, Windows and Ubuntu. It is the easiest way to run local, privacy aware chat assistants on everyday hardware. You can download it on the [GPT4All Website](https://gpt4all.io) and read its source code in the monorepo.
+
+Explore detailed documentation for the backend, bindings and chat client in the sidebar.
 ## Models
+GPT4All models are artifacts produced through a process known as neural network quantization.
+A multi-billion parameter transformer decoder usually takes 30+ GB of VRAM to execute a forward pass.
+Most people do not have such a powerful computer or access to GPU hardware. By running trained LLMs through quantization algorithms, 
+GPT4All models can run on your laptop using only 4-8GB of RAM enabling their wide-spread utility.
+
+The GPT4All software ecosystem is currently compatible with three variants of the Transformer neural network architecture:
+- LLaMa
+- GPT-J
+- MPT
+
+Any model trained with one of these architectures can be quantized and run locally with all GPT4All bindings and in the
+chat client. You can add new variants by contributing the gpt4all-backend.
+
+You can find an exhaustive list of pre-quantized models on the [website](https://gpt4all.io) or in the download pane of the chat client.
 
-A GPT4All model is a 3GB - 8GB file that you can download and plug into the GPT4All open-source ecosystem software. **Nomic AI** supports and maintains this software ecosystem to enforce quality and security alongside spearheading the effort to allow any person or enterprise to easily train and deploy their own on-edge large language models. 
+## Frequently Asked Questions
+Find answers to frequently asked questions by searching the [Github issues](https://github.com/nomic-ai/gpt4all/issues) or in the [documentation FAQ](gpt4all_faq.md).
 
-See FAQ for frequently asked questions about GPT4All model backends.
+## Getting the most of your local LLM
 
+**Inference Speed**
+Inference speed of a local LLM depends on two factors: model size and the number of tokens given as input. 
+It is not advised to prompt local LLMs with large chunks of context as their inference speed will heavily degrade.
+You will likely want to run GPT4All models on GPU if you would like to utilize context windows larger than 750 tokens. Native GPU support for GPT4All models is planned.
 
-## Best Practices
-GPT4All models are designed to run locally on your own CPU. Large prompts may require longer computation time and
-result in worse performance. Giving an instruction to the model will typically produce the best results.
+**Inference Performance**
+Which model is best? That question depends on your use-case. The ability of an LLM to faithfully follow instructions is conditioned
+on the quantity and diversity of the pre-training data it trained on and the diversity, quality and factuality of the data the LLM
+was fine-tuned on. A goal of GPT4All is to bring the most powerful local assistant model to your desktop and Nomic AI is actively
+working on efforts to improve their performance and quality.