top of page
Chashnikov.dev


Testing Spark Streaming locally with EmbeddedKafka
It's been a while since my previous article in Spark/Scala series, where we ran Spark locally using Docker. And even before that we...
Mar 25, 20235 min read
924 views
1 comment


Spark: understanding Physical Plans
You have some kind of query - maybe it's written using Dataset API, maybe using Spark SQL. It reads from one or several Hive tables, or...
Dec 15, 20224 min read
10,557 views
0 comments


Starting up Spark Standalone Cluster with Docker
In previous post we've created a simple Spark app, and used Scalatest to check that it actually works. Even though we were creating a...
Oct 27, 20223 min read
4,934 views
0 comments


Testing Spark apps locally with Scalatest
Years ago I wrote a blog post describing process of building and deploying a simple Spark app. This post is now too old to be of any use...
Oct 22, 20223 min read
10,714 views
2 comments
bottom of page