Apache Beam is a great library that enables you to build batch/streaming pipelines in the unified way. Then again, there are some pitfalls and technical challenges when writing practical applications.
Results that may be inaccessible to you are currently showing.