Skip to content

Commit 0df7491

Browse files
committed
Getting Started Guide updates
1 parent 14050c3 commit 0df7491

File tree

6 files changed

+90
-88
lines changed

6 files changed

+90
-88
lines changed

Getting Started/FastScore Specs/index.md

Lines changed: 40 additions & 39 deletions
Original file line numberDiff line numberDiff line change
@@ -9,42 +9,43 @@
99
| H2O || | CPU utilization (data deserialization) ||
1010
| Matlab || | Sensors ||
1111
| C || | Default sensors installed ||
12-
| | | | Dashboard sensor support ||
13-
| **Certified Deployment Options** | | | | |
14-
| Linux || | **Workflow, Concurrency, Scaling, etc** | |
15-
| AWS || | Single model complex analytic workflows ||
16-
| On-premise || | Multi-model complex analytic workflows ||
17-
| Private Cloud || | Single machine scaling ||
18-
| Public Cloud || | Infrastructure Scaling (multi-server, cloud, etc) ||
19-
| Azure || | Intra-engine concurrecy ||
20-
| Google Cloud || | Multi-engine concurrency ||
21-
| MacOS || | Model state persistence checkpointing ||
22-
| | | | Model state staring ||
23-
| **Data Source Types** | | | Multiple input/output streams ||
24-
| REST || | | |
25-
| Kafka || | **Third Party Orchestrators** ||
26-
| File || | Mesos/Marathon/DCOS ||
27-
| ODBC || | Swarm ||
28-
| HTTP || | Kubernetes ||
29-
| Experimental (TCP/UDP/Exec) || | | |
30-
| Kafka (Authenticated) || | **Model Management and AnalyticOps** | |
31-
| S3 (Authenticated) || | Store/Edit/Select Models ||
32-
| | | | Store/Edit/Select Streams ||
33-
| **Schema Definition Formats** | | | Store/Edit/Select Schemas ||
34-
| Avro Schema || | | |
35-
| Avro Schema Extensions (Restrictions) || | **Machine Learning Integration** | |
36-
| | | | R [ R ] ||
37-
| **Data Encoding Formats** | | | scikit-learn [ Python ] ||
38-
| Raw || | ml.lib [POJO ] ||
39-
| JSON || | H2O [POJO] ||
40-
| Avro-binary || | Tensorflow [ Python, R ] ||
41-
| UTF-8 || | | |
42-
| SOAP/RPC || | **Integration and Management Interfaces** | |
43-
| | | | RESTful API ||
44-
| **Environment Management** | | | GUI Dashboard ||
45-
| Import Policy || | CLI ||
46-
| | | | Model deploy Jupyter ||
47-
| **FastScore SDK** | | | | |
48-
| Python 2 || | **Authentication and Access Control** | |
49-
| Python 3 || | LDAP Authentication ||
50-
| Scala/Java || | Dashboard LDAP Authentication ||
12+
| Scala || | Dashboard sensor support ||
13+
| | | | | |
14+
| **Certified Deployment Options** | | | **Workflow, Concurrency, Scaling, etc** | |
15+
| Linux || | Single model complex analytic workflows ||
16+
| AWS || | Multi-model complex analytic workflows ||
17+
| On-premise || | Single machine scaling ||
18+
| Private Cloud || | Infrastructure Scaling (multi-server, cloud, etc) ||
19+
| Public Cloud || | Intra-engine concurrecy ||
20+
| Azure || | Multi-engine concurrency ||
21+
| Google Cloud || | Model state persistence checkpointing ||
22+
| MacOS || | Model state staring ||
23+
| | | | Multiple input/output streams ||
24+
| **Data Source Types** | | | | |
25+
| REST || | **Third Party Orchestrators** ||
26+
| Kafka || | Mesos/Marathon/DCOS ||
27+
| File || | Swarm ||
28+
| ODBC || | Kubernetes ||
29+
| HTTP || | | |
30+
| Experimental (TCP/UDP/Exec) || | **Model Management and AnalyticOps** | |
31+
| Kafka (Authenticated) || | Store/Edit/Select Models ||
32+
| S3 (Authenticated) || | Store/Edit/Select Streams ||
33+
| | | | Store/Edit/Select Schemas ||
34+
| **Schema Definition Formats** | | | | |
35+
| Avro Schema || | **Machine Learning Integration** | |
36+
| Avro Schema Extensions (Restrictions) || | R [ R ] ||
37+
| | | | scikit-learn [ Python ] ||
38+
| **Data Encoding Formats** | | | ml.lib [POJO ] ||
39+
| Raw || | H2O [POJO] ||
40+
| JSON || | Tensorflow [ Python, R ] ||
41+
| Avro-binary || | | |
42+
| UTF-8 || | **Integration and Management Interfaces** | |
43+
| SOAP/RPC || | RESTful API ||
44+
| | | | GUI Dashboard ||
45+
| **Environment Management** | | | CLI ||
46+
| Import Policy || | Model deploy Jupyter ||
47+
| | | | | |
48+
| **FastScore SDK** | | | **Authentication and Access Control** | |
49+
| Python 2 || | LDAP Authentication ||
50+
| Python 3 || | Dashboard LDAP Authentication ||
51+
| Scala/Java || | |

Getting Started/Getting Started with FastScore/index.md

Lines changed: 33 additions & 37 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,10 @@
11
---
2-
title: "Getting Started with FastScore v1.7"
3-
description: "This is a guide for installing and running FastScore. It contains instructions for first-time and novice users, as well as reference instructions for common tasks. This guide was last updated for v1.7 of FastScore.\n\nIf you need support or have questions, please email us: [[email protected]](mailto:[email protected])"
2+
title: "Getting Started with FastScore v1.8"
3+
description: "This is a guide for installing and running FastScore. It contains instructions for first-time and novice users, as well as reference instructions for common tasks. This guide was last updated for v1.8 of FastScore.\n\nIf you need support or have questions, please email us: [[email protected]](mailto:[email protected])"
44
---
55

6-
# Getting Started with FastScore v1.7
7-
This is a guide for installing and running FastScore. It contains instructions for first-time and novice users, as well as reference instructions for common tasks. This guide was last updated for v1.7 of FastScore.
6+
# Getting Started with FastScore v1.8
7+
This is a guide for installing and running FastScore. It contains instructions for first-time and novice users, as well as reference instructions for common tasks. This guide was last updated for v1.8 of FastScore.
88

99
If you need support or have questions, please email us: [email protected]
1010

@@ -93,7 +93,7 @@ Add the database to Model Manage in the usual way for Docker volumes:
9393
9494
1. If using docker-compose, put the volume in the `docker-compose.yml` file(see example file below)
9595
2. If running manually, with the `-v` flag when using `docker run`, e.g.,
96-
```docker run -it -d --net=host --rm -v db:/var/lib/mysql fastscore/model-manage-mysql:1.7 ``` (see more below)
96+
```docker run -it -d --net=host --rm -v db:/var/lib/mysql fastscore/model-manage-mysql:1.8 ``` (see more below)
9797
9898
#### Example Docker Compose File
9999
Below is an example Docker Compose file that will start a full suite of FastScore services with two engines:
@@ -102,43 +102,43 @@ Below is an example Docker Compose file that will start a full suite of FastScor
102102
version: '2'
103103
services:
104104
dashboard:
105-
image: fastscore/dashboard:1.7
105+
image: fastscore/dashboard:1.8
106106
network_mode: "bridge"
107107
ports:
108108
- "8000:8000"
109109
environment:
110110
CONNECT_PREFIX: https://172.17.0.1:8001
111111
112112
connect:
113-
image: fastscore/connect:1.7
113+
image: fastscore/connect:1.8
114114
network_mode: "bridge"
115115
ports:
116116
- "8001:8001"
117117
118118
engine-1:
119-
image: fastscore/engine:1.7
119+
image: fastscore/engine:1.8
120120
network_mode: "bridge"
121121
ports:
122122
- "8003:8003"
123123
environment:
124124
CONNECT_PREFIX: https://172.17.0.1:8001
125125
126126
engine-2:
127-
image: fastscore/engine:1.7
127+
image: fastscore/engine:1.8
128128
network_mode: "bridge"
129129
ports:
130130
- "8004:8003"
131131
environment:
132132
CONNECT_PREFIX: https://172.17.0.1:8001
133133
134134
database:
135-
image: fastscore/model-manage-mysql:1.7
135+
image: fastscore/model-manage-mysql:1.8
136136
network_mode: "bridge"
137137
ports:
138138
- "3306:3306"
139139
140140
model-manage:
141-
image: fastscore/model-manage:1.7
141+
image: fastscore/model-manage:1.8
142142
network_mode: "bridge"
143143
ports:
144144
- "8002:8002"
@@ -174,12 +174,12 @@ Check that all the Docker containers are running with the ```docker ps``` comman
174174
175175
``` bash
176176
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
177-
51acfc33eb4e fastscore/model-manage:1.7 "/bin/sh -c 'bin/mode" 15 seconds ago Up 14 seconds 0.0.0.0:8002->8002/tcp demos_model-manage_1
178-
4d20a9c3c4c9 fastscore/connect:1.7 "/bin/sh -c 'bin/conn" 16 seconds ago Up 14 seconds 0.0.0.0:8001->8001/tcp demos_connect_1
179-
432327548cef fastscore/dashboard:1.7 "npm run start-fds" 16 seconds ago Up 14 seconds 0.0.0.0:8000->8000/tcp demos_dashboard_1
180-
14e547577004 fastscore/model-manage-mysql:1.7 "/bin/sh -c '/sbin/my" 16 seconds ago Up 14 seconds 0.0.0.0:3306->3306/tcp demos_database_1
181-
bf7e50c22e0a fastscore/engine:1.7 "/bin/sh -c 'java -ja" 16 seconds ago Up 14 seconds 0.0.0.0:8004->8003/tcp demos_engine-2_1
182-
4585ac4cf93b fastscore/engine:1.7 "/bin/sh -c 'java -ja" 16 seconds ago Up 14 seconds 0.0.0.0:8003->8003/tcp demos_engine-1_1
177+
51acfc33eb4e fastscore/model-manage:1.8 "/bin/sh -c 'bin/mode" 15 seconds ago Up 14 seconds 0.0.0.0:8002->8002/tcp demos_model-manage_1
178+
4d20a9c3c4c9 fastscore/connect:1.8 "/bin/sh -c 'bin/conn" 16 seconds ago Up 14 seconds 0.0.0.0:8001->8001/tcp demos_connect_1
179+
432327548cef fastscore/dashboard:1.8 "npm run start-fds" 16 seconds ago Up 14 seconds 0.0.0.0:8000->8000/tcp demos_dashboard_1
180+
14e547577004 fastscore/model-manage-mysql:1.8 "/bin/sh -c '/sbin/my" 16 seconds ago Up 14 seconds 0.0.0.0:3306->3306/tcp demos_database_1
181+
bf7e50c22e0a fastscore/engine:1.8 "/bin/sh -c 'java -ja" 16 seconds ago Up 14 seconds 0.0.0.0:8004->8003/tcp demos_engine-2_1
182+
4585ac4cf93b fastscore/engine:1.8 "/bin/sh -c 'java -ja" 16 seconds ago Up 14 seconds 0.0.0.0:8003->8003/tcp demos_engine-1_1
183183
```
184184
185185
@@ -189,19 +189,19 @@ Sometimes, whether for testing purposes or to satisfy your own hardy can-do spir
189189
To do it manually, the FastScore microservices can be installed by pulling the images from DockerHub:
190190
191191
``` bash
192-
$ docker pull fastscore/model-manage:1.7
193-
$ docker pull fastscore/connect:1.7
194-
$ docker pull fastscore/engine:1.7
195-
$ docker pull fastscore/model-manage-mysql:1.7
196-
$ docker pull fastscore/dashboard:1.7
192+
$ docker pull fastscore/model-manage:1.8
193+
$ docker pull fastscore/connect:1.8
194+
$ docker pull fastscore/engine:1.8
195+
$ docker pull fastscore/model-manage-mysql:1.8
196+
$ docker pull fastscore/dashboard:1.8
197197
```
198198
199199
``` bash
200-
docker run -it -d --net=host --rm fastscore/connect:1.7
201-
docker run -it -d --net=host --rm -e "CONNECT_PREFIX=https://127.0.0.1:8001" fastscore/dashboard:1.7
202-
docker run -it -d --net=host --rm -e "CONNECT_PREFIX=https://127.0.0.1:8001" fastscore/engine:1.7
203-
docker run -it -d --net=host --rm -e "CONNECT_PREFIX=https://127.0.0.1:8001" fastscore/model-manage:1.7
204-
docker run -it -d --net=host --rm -v db:/var/lib/mysql fastscore/model-manage-mysql:1.7
200+
docker run -it -d --net=host --rm fastscore/connect:1.8
201+
docker run -it -d --net=host --rm -e "CONNECT_PREFIX=https://127.0.0.1:8001" fastscore/dashboard:1.8
202+
docker run -it -d --net=host --rm -e "CONNECT_PREFIX=https://127.0.0.1:8001" fastscore/engine:1.8
203+
docker run -it -d --net=host --rm -e "CONNECT_PREFIX=https://127.0.0.1:8001" fastscore/model-manage:1.8
204+
docker run -it -d --net=host --rm -v db:/var/lib/mysql fastscore/model-manage-mysql:1.8
205205
```
206206
207207
It is additionally useful to install the FastScore Command-Line Interface (CLI).
@@ -211,28 +211,24 @@ It is additionally useful to install the FastScore Command-Line Interface (CLI).
211211
The FastScore CLI can be downloaded and installed using the following commands:
212212
213213
``` bash
214-
wget https://s3-us-west-1.amazonaws.com/fastscore-cli/fastscore-cli-1.7.tar.gz
215-
tar xzf fastscore-cli-1.7.tar.gz
216-
cd fastscore-cli-1.7
217-
sudo python setup.py install
214+
pip install fastscore-cli
218215
```
219216
220217
This will install the required dependencies. The FastScore CLI is a Python tool, so it doesn't need to be compiled, and the setup script should automatically add the CLI to `$PATH`.
221218
222219
223-
> `python-setuptools` and `python-dev` (i.e. header files) are required to properly install the FastScore CLI. These may or may not be already present on your system. If not, you will need to install them.
220+
> `python-pip`, `python-setuptools` and `python-dev` (i.e. header files) are required to properly install the FastScore CLI. These may or may not be already present on your system. If not, you will need to install them.
224221
> For example:
225222
> ``` bash
226-
> $ sudo apt-get install python-setuptools
227-
> $ sudo apt-get install python-dev
223+
> $ sudo apt-get install python-pip python-dev python-setuptools
228224
> ```
229225
230226
231227
Once you've installed the FastScore CLI, check that it works by executing the following command in your terminal. Also see [FastScore Command Line Interface](https://opendatagroup.github.io/Reference/FastScore%20CLI/) for more information on subcommands.
232228
233229
``` bash
234230
$ fastscore help
235-
FastScore CLI v1.7
231+
FastScore CLI v1.8.0
236232
Usage: fastscore <command> [<subcommand> ...]
237233
Available commands:
238234
help Explain commands and options
@@ -350,7 +346,7 @@ FastScore is a streaming analytic engine: its core functionality is to read in r
350346
351347
### <a name="section-creating-and-loading-assets-into-fastscore-model-manage"></a>Creating and Loading Assets into FastScore Model Manage
352348
353-
Version 1.7 of FastScore supports models in Python, R, Java, MATLAB, [PFA](http://dmg.org/pfa/), [PrettyPFA](https://github.com/opendatagroup/hadrian/wiki/PrettyPFA-Reference) and C formats. Some setup steps differ slightly between Python/R models and PFA, Java, MATLAB, or C models. As a model interchange format, PFA can provide some benefits in performance, scalability, and security relative to R and Python. PrettyPFA is a human-readable equivalent to PFA. However, as the majority of users will be more familiar with R and Python, we focus on these two languages in this section.
349+
Version 1.8 of FastScore supports models in Python, R, Java, MATLAB, [PFA](http://dmg.org/pfa/), [PrettyPFA](https://github.com/opendatagroup/hadrian/wiki/PrettyPFA-Reference) and C formats. Some setup steps differ slightly between Python/R models and PFA, Java, MATLAB, or C models. As a model interchange format, PFA can provide some benefits in performance, scalability, and security relative to R and Python. PrettyPFA is a human-readable equivalent to PFA. However, as the majority of users will be more familiar with R and Python, we focus on these two languages in this section.
354350
355351
#### Loading Assets
356352
The FastScore CLI allows a user to load models directly from the command line. The list of models currently loaded in FastScore can be viewed using the model list command:
@@ -555,7 +551,7 @@ For filestreams, it is easiest to manage container input and output by linking a
555551
[...]
556552
557553
engine-1:
558-
image: fastscore/engine:1.7
554+
image: fastscore/engine:1.8
559555
network_mode: "host"
560556
environment:
561557
CONNECT_PREFIX: https://127.0.0.1:8001
Lines changed: 12 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -1,15 +1,19 @@
11
---
2-
title: "Release Notes for FastScore v1.7"
2+
title: "Release Notes for FastScore v1.8"
33
excerpt: ""
44
---
55
## Highlights
6-
Version 1.7 of FastScore introduces the beta version of FastScore Composer and Designer that enables faster analytic workflow creation and validation. This release also includes GitHub integration for the Model Manage backing store.
6+
Version 1.8 of FastScore includes Docker Secret support for GitHub Integration, MySQL backend, and S3 Streams. This release also includes support for Scala models and enhancements to the C/C++ model runner.
77

8-
## 1.7
8+
## 1.8
99

10-
* FastScore Composer and Designer BETA
11-
* FastScore Compare BETA
12-
* GitHub Integration
13-
* Scala FastScore SDK
14-
* Import Policy Enhancements
10+
* Enhanced CSV Encoding Support
11+
* GitHub Integration - Secrets Support
12+
* Enhanced Avro OCF Format Support
13+
* Relaxed Avro Schema Matching
14+
* S3 Transport Enhancements
15+
* Scala Model Runner
16+
* Enhanced C/C++ Model Support - Multiple Stream Capability
17+
* Docker Secret Support for MySQL Backend and S3 Streams
18+
* Msgpack Encoding
1519
* General improvements to performance and stability

Glossary/index.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13,5 +13,7 @@ excerpt: ""
1313
| Jet | A Unix process that runs a model. |
1414
| Job | A complete configuration of one or more interrelated FastScore engines that each contain a model, schemas, an import policy, and input/output stream(s). |
1515
| Manifold | A component of an engine that manages the data flow between streams and the model. |
16+
| Runner | FastScore Engine will use different model-specific runners to executed depending on the language of the model deployed. |
1617
| Sensor | A configurable function that captures specific meta data about the execution process of a model in production. |
1718
| Stream | A file that contains all information necessary to transport data from one place to another. Could be from a data source to the engine or from the engine to an application. There is at least one input stream and one output stream. |
19+

Reference/FastScore SDKs/index.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
# SDK Documentation
22

33
- [Python SDK](python/)
4-
- R SDK
54
- [Scala SDK](scala/com/opendatagroup/fastscore)
5+
<!--- - R SDK -->

index.md

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -15,10 +15,9 @@ Welcome to Open Data Group's documentation!
1515
### Getting Started
1616

1717
- [FastScore Getting Started Guide](/Getting Started/Getting Started with FastScore)
18-
- [Quick Setup Instructions - OVA](/Getting Started/FastStart with FastScore/)
19-
- [Release Notes](/Getting Started/Release Notes/)
2018
- [FastScore Specifications](/Getting Started/FastScore Specs/)
2119
- [FastScore Architecture](Getting Started/FastScore IA/)
20+
- [1.8 Release Notes](/Getting Started/Release Notes/)
2221

2322
### Knowledge Center
2423

@@ -50,8 +49,8 @@ Welcome to Open Data Group's documentation!
5049

5150
#### Streams Descriptors
5251

53-
- [Multiple Input and Output Streams](/Product Manuals/Multiple Input and Output Streams/)
5452
- [Stream Descriptors](/Product Manuals/Stream Descriptors/)
53+
- [Multiple Input and Output Streams](/Product Manuals/Multiple Input and Output Streams/)
5554
- [CSV Support](/Product Manuals/CSV Support/)
5655

5756
### Reference

0 commit comments

Comments
 (0)