Releases: Hydrospheredata/mist
Releases · Hydrospheredata/mist
v1.1.3
v1.1.2
v1.1.1
v1.1.0
No changes were made, except adding Spark 2.4.0 and Scala 2.12 support.
2.12 artifacts were published too:
- spark-2.4.0-bin-hadoop2.7-scala-2.12.tgz
- mist-1.1.0-scala-2.12.tar.gz
- docker image:
hydrosphere/mist:1.1.0-2.4.0-scala-2.12
v1.0.0
v1.0.0-RC17
- Upgrade mist-ui to 2.0.1 (pagination for job list 🔥)
- Provide full error message from job invocation #501, #508
- Change default worker settings #513 : workerMode ->
exclusive,maxJobs-> 1 - Mqtt async interface - enable auto reconnect option #510
- Fix problems with collecting logs from workers #496
- Http api
- add
DELETEmethods forv2/api/functions,v2/api/artifacts,v2/api/contexts#507 - add
startTImeout,performTimeoutoptions forPOSTv2/api/functions/{id}/jobs
- add
- Mist-lib
v1.0.0-RC16
This release contains a lot of fixes and improvements around user libraries for functions. New mistlibversion for scala/java isn't compatible with previous versions, so to upgrade a mist to v1.0.0-RC16 it's required to migrate and redeploy functions (migration example)
Python library was completely rewritten and now is called mistpy. Also, now it's available in pipy.
Documentation
Example
- Python library improvements: #485, #441,
- Mistlib:
- Explicit result type declaration in
MistFnandHandlewas removed. Handle declaration was divided into two parts: first buildRawHandle[A]whereAis resulting type, then buildHandlefrom it usingasHandle/toHandlemethods andJsEncoder- fix #440 - #362 - default
mainmethod implementation, now it's possible to run mist functions directly fromspark-submit - scala:
- #473 - use default values in case classes for building argument extraction -
mist.api.encoding.generic.extractorWithDefaults
- #473 - use default values in case classes for building argument extraction -
- java:
- Explicit result type declaration in
- #491 - fix worker termination
- #484 - support contexts that were created before
v1.0.0-RC15
v1.0.0-RC15
- Manual worker mode fixes:
- Fix
workers.manual.onStopbehavior. PreviouslyonStopcommand was used to invoke user action after stopping worker, now it used directly to stop it (worker expects to handlesigkilland notify master node that it was correctly stopped) - Return
WORKER_NAMEenv foronStop- #480
- Fix
- Fail not started jobs if a context was marked as broken - #479 , #445
- Fix
spark-submitcommand building - #472
v1.0.0-RC14
- Logs collection improved - now job logs contain logs from spark #435 #462
- Added support for contexts on kubernetes backed cluster #430 #460
- Added support for python binary configuration #461 (
spark.pyspark.python,spark.pyspark.python.driver) - Docker image contains mesos library by default #444 #465
- Fixed job cancellation #469