Structured Streaming is a scalable and fault-tolerant stream processing engine built on the Spark SQL engine. You can express your streaming computation the same way you would express a batch computation on static data. The Spark SQL engine will take care of running it incrementally and...

Read more

Kubernetes & OpenShift

Data Engineering

Algorithms

AI Platforms

Linux & Systems

Cluster By, Order By, Sort By: When to use each one in Hive

What is a Data Lake ?

Understanding ADFS: A Practical Architectural Demonstration

Deploy Minio in Openshift

Run Ansible playbooks Using Red Hat Satellite

Running Spark on Kubernetes with AKS

Data Lakehouse, The Best of Both Worlds

CAP Theorem, Does it still hold in modern days

Pandas API over Pyspark