In Spark 2.0, DataFrames and Datasets were extended to handle real time streaming data. This not only provides a single programming abstraction for batch and streaming data, it also brings support for ...