@@ -11,10 +11,10 @@ SynapseML requires Scala 2.12, Spark 3.4+, and Python 3.8+.
1111| Topics | Links |
1212| :------ | :------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
1313| Build | [ ![ Build Status] ( https://msdata.visualstudio.com/A365/_apis/build/status/microsoft.SynapseML?branchName=master )] ( https://msdata.visualstudio.com/A365/_build/latest?definitionId=17563&branchName=master ) [ ![ codecov] ( https://codecov.io/gh/Microsoft/SynapseML/branch/master/graph/badge.svg )] ( https://codecov.io/gh/Microsoft/SynapseML ) [ ![ Code style: black] ( https://img.shields.io/badge/code%20style-black-000000.svg )] ( https://github.com/psf/black ) |
14- | Version | [ ![ Version] ( https://img.shields.io/badge/version-1.0.5 -blue )] ( https://github.com/Microsoft/SynapseML/releases ) [ ![ Release Notes] ( https://img.shields.io/badge/release-notes-blue )] ( https://github.com/Microsoft/SynapseML/releases ) [ ![ Snapshot Version] ( https://mmlspark.blob.core.windows.net/icons/badges/master_version3.svg )] ( #sbt ) |
15- | Docs | [ ![ Website] ( https://img.shields.io/badge/SynapseML-Website-blue )] ( https://aka.ms/spark ) [ ![ Scala Docs] ( https://img.shields.io/static/v1?label=api%20docs&message=scala&color=blue&logo=scala )] ( https://mmlspark.blob.core.windows.net/docs/1.0.5 /scala/index.html#package ) [ ![ PySpark Docs] ( https://img.shields.io/static/v1?label=api%20docs&message=python&color=blue&logo=python )] ( https://mmlspark.blob.core.windows.net/docs/1.0.5 /pyspark/index.html ) [ ![ Academic Paper] ( https://img.shields.io/badge/academic-paper-7fdcf7 )] ( https://arxiv.org/abs/1810.08744 ) |
14+ | Version | [ ![ Version] ( https://img.shields.io/badge/version-1.0.6 -blue )] ( https://github.com/Microsoft/SynapseML/releases ) [ ![ Release Notes] ( https://img.shields.io/badge/release-notes-blue )] ( https://github.com/Microsoft/SynapseML/releases ) [ ![ Snapshot Version] ( https://mmlspark.blob.core.windows.net/icons/badges/master_version3.svg )] ( #sbt ) |
15+ | Docs | [ ![ Website] ( https://img.shields.io/badge/SynapseML-Website-blue )] ( https://aka.ms/spark ) [ ![ Scala Docs] ( https://img.shields.io/static/v1?label=api%20docs&message=scala&color=blue&logo=scala )] ( https://mmlspark.blob.core.windows.net/docs/1.0.6 /scala/index.html#package ) [ ![ PySpark Docs] ( https://img.shields.io/static/v1?label=api%20docs&message=python&color=blue&logo=python )] ( https://mmlspark.blob.core.windows.net/docs/1.0.6 /pyspark/index.html ) [ ![ Academic Paper] ( https://img.shields.io/badge/academic-paper-7fdcf7 )] ( https://arxiv.org/abs/1810.08744 ) |
1616| Support
| [ ![ Gitter
] ( https://badges.gitter.im/Microsoft/MMLSpark.svg )] ( https://gitter.im/Microsoft/MMLSpark?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge ) [ ![ Mail
] ( https://img.shields.io/badge/mail-synapseml--support-brightgreen )] ( mailto:[email protected] ) | 17- | Binder | [ ![ Binder] ( https://mybinder.org/badge_logo.svg )] ( https://mybinder.org/v2/gh/microsoft/SynapseML/v1.0.5 ?labpath=notebooks%2Ffeatures ) |
17+ | Binder | [ ![ Binder] ( https://mybinder.org/badge_logo.svg )] ( https://mybinder.org/v2/gh/microsoft/SynapseML/v1.0.6 ?labpath=notebooks%2Ffeatures ) |
1818| Usage | [ ![ Downloads] ( https://static.pepy.tech/badge/synapseml )] ( https://pepy.tech/project/synapseml ) |
1919<!-- markdownlint-disable MD033 -->
2020<details open >
@@ -119,7 +119,7 @@ In Azure Synapse notebooks please place the following in the first cell of your
119119{
120120 " name" : " synapseml" ,
121121 " conf" : {
122- " spark.jars.packages" : " com.microsoft.azure:synapseml_2.12:1.0.5 " ,
122+ " spark.jars.packages" : " com.microsoft.azure:synapseml_2.12:1.0.6 " ,
123123 " spark.jars.repositories" : " https://mmlspark.azureedge.net/maven" ,
124124 " spark.jars.excludes" : " org.scala-lang:scala-reflect,org.apache.spark:spark-tags_2.12,org.scalactic:scalactic_2.12,org.scalatest:scalatest_2.12,com.fasterxml.jackson.core:jackson-databind" ,
125125 " spark.yarn.user.classpath.first" : " true" ,
@@ -155,15 +155,15 @@ cloud](http://community.cloud.databricks.com), create a new [library from Maven
155155coordinates] ( https://docs.databricks.com/user-guide/libraries.html#libraries-from-maven-pypi-or-spark-packages )
156156in your workspace.
157157
158- For the coordinates use: ` com.microsoft.azure:synapseml_2.12:1.0.5 `
158+ For the coordinates use: ` com.microsoft.azure:synapseml_2.12:1.0.6 `
159159with the resolver: ` https://mmlspark.azureedge.net/maven ` . Ensure this library is
160160attached to your target cluster(s).
161161
162162Finally, ensure that your Spark cluster has at least Spark 3.2 and Scala 2.12. If you encounter Netty dependency issues please use DBR 10.1.
163163
164164You can use SynapseML in both your Scala and PySpark notebooks. To get started with our example notebooks import the following databricks archive:
165165
166- ` https://mmlspark.blob.core.windows.net/dbcs/SynapseMLExamplesv1.0.5 .dbc `
166+ ` https://mmlspark.blob.core.windows.net/dbcs/SynapseMLExamplesv1.0.6 .dbc `
167167
168168### Python Standalone
169169
@@ -174,7 +174,7 @@ the above example, or from python:
174174``` python
175175import pyspark
176176spark = pyspark.sql.SparkSession.builder.appName(" MyApp" ) \
177- .config(" spark.jars.packages" , " com.microsoft.azure:synapseml_2.12:1.0.5 " ) \
177+ .config(" spark.jars.packages" , " com.microsoft.azure:synapseml_2.12:1.0.6 " ) \
178178 .getOrCreate()
179179import synapse.ml
180180```
@@ -185,9 +185,9 @@ SynapseML can be conveniently installed on existing Spark clusters via the
185185` --packages ` option, examples:
186186
187187``` bash
188- spark-shell --packages com.microsoft.azure:synapseml_2.12:1.0.5
189- pyspark --packages com.microsoft.azure:synapseml_2.12:1.0.5
190- spark-submit --packages com.microsoft.azure:synapseml_2.12:1.0.5 MyApp.jar
188+ spark-shell --packages com.microsoft.azure:synapseml_2.12:1.0.6
189+ pyspark --packages com.microsoft.azure:synapseml_2.12:1.0.6
190+ spark-submit --packages com.microsoft.azure:synapseml_2.12:1.0.6 MyApp.jar
191191```
192192
193193### SBT
@@ -196,7 +196,7 @@ If you are building a Spark application in Scala, add the following lines to
196196your ` build.sbt ` :
197197
198198``` scala
199- libraryDependencies += " com.microsoft.azure" % " synapseml_2.12" % " 1.0.5 "
199+ libraryDependencies += " com.microsoft.azure" % " synapseml_2.12" % " 1.0.6 "
200200```
201201
202202### Apache Livy and HDInsight
@@ -210,7 +210,7 @@ Excluding certain packages from the library may be necessary due to current issu
210210{
211211 " name" : " synapseml" ,
212212 " conf" : {
213- " spark.jars.packages" : " com.microsoft.azure:synapseml_2.12:1.0.5 " ,
213+ " spark.jars.packages" : " com.microsoft.azure:synapseml_2.12:1.0.6 " ,
214214 " spark.jars.excludes" : " org.scala-lang:scala-reflect,org.apache.spark:spark-tags_2.12,org.scalactic:scalactic_2.12,org.scalatest:scalatest_2.12,com.fasterxml.jackson.core:jackson-databind"
215215 }
216216}
0 commit comments