Apache Spark™ Connect Client for Swift
Apache Spark™ Connect for Swift is a subproject of Apache Spark and aims to provide a modern Swift library to enable Swift developers to leverage the power of Apache Spark for distributed data processing, machine learning, and analytical workloads directly from their Swift applications.
Releases
- 0.6.0 (2026-04-10)
- 0.5.0 (2026-01-15)
- 0.4.0 (2025-10-01)
- 0.3.0 (2025-06-04)
- 0.2.0 (2025-05-20)
- 0.1.0 (2025-05-07)
Compatibility
Swift Package Index
Run an example
Install Spark K8s Operator Helm Chart
helm repo add spark https://apache.github.io/spark-kubernetes-operator
helm install spark spark/spark-kubernetes-operator
Launch Spark Connect Server
$ kubectl apply -f https://apache.github.io/spark-kubernetes-operator/spark-connect-server.yaml
sparkapplication.spark.apache.org/spark-connect-server created
$ kubectl get sparkapp
NAME CURRENT STATE AGE
spark-connect-server RunningHealthy 14s
Launch Swift-based SparkPi Application
$ kubectl apply -f https://apache.github.io/spark-kubernetes-operator/pi-swift.yaml
job.batch/spark-connect-swift-pi created
$ kubectl logs -f job/spark-connect-swift-pi
Pi is roughly 3.1426151426151425
Docker Image Size
| Name | Image Size |
|---|---|
apache/spark:4.1.1-python3-based SparkPi |
|
pyspark-connect-based SparkPi |
|
Swift-based SparkPi |