score:0

Accepted answer

from the manuals an example:

val windowedcounts = words
    .withwatermark("timestamp", "10 minutes")
    .groupby(
        window($"timestamp", "10 minutes", "5 minutes"),
        $"word")
    .count()

try putting your window clause up front i would hazard to guess. and use of $ as in the examples for field names.

score:0

val jsondf = explodedf.withwatermark("timestamp", "1 minutes")

val aggdf = jsondf.groupby(functions.window(jsondf.col("timestamp"), "30 seconds", "30 seconds"),jsondf.col("jsondata.name")) .avg("jsondata.price").alias("averageprice")

try this, thanks me latter


Related Query

More Query from same tag