Ayadi Tahar | Data Engineering

Apache Spark and Cassandra : Best NoSQL Big Data combination

Publish Date: 2022-10-07   9 min read

Apache Spark and Cassandra : Best NoSQL Big Data combination

Apache Spark™ is considered as the most powerful engine for executing data engineering, data science, and machine learning on single-node machines or clusters over diverse data sources such as NoSQL databases. Apache Cassandra is an open source NoSQL distributed database trusted by thousands of...

Read more

Realtime Analysis using Spark Streaming and Kafka

Publish Date: 2022-10-09   8 min read

Realtime Analysis using Spark Streaming and Kafka

Spark Streaming is an extension of the core Spark API that enables scalable, high-throughput, fault-tolerant stream processing of live data streams. Data can be ingested from many sources like Kafka, Kinesis, or TCP sockets, and can be processed using complex algorithms expressed with high-level...

Read more

Read/Write data from/to PostgreSQL tables using Spark

Publish Date: 2022-10-02   8 min read

Read/Write data from/to PostgreSQL tables using Spark

Apache Spark is a fast and general computing engine used for big data processing. It can process data from different sources and formats, one of them is data from relational databases like PostgreSQL. In our article, we will show you the steps to on how to read data from PostgreSQL tables into...

Read more

First taste of Document Databases with MongoDB

Publish Date: 2022-09-21   16 min read

First taste of Document Databases with  MongoDB

MongoDB classified as a NoSQL document database with the scalability and flexibility that developers require for querying and indexing most complex data applications at any scale. MongoDB stores data in flexible, JSON-like documents with optional schemas (schema-less), meaning fields can vary from...

Read more

In memory Caching Database layer: Getting Started with Redis

Publish Date: 2022-09-30   6 min read

In memory Caching Database layer: Getting Started with Redis

The open source, in-memory data store used by millions of developers as a database, cache, streaming engine, and message broker. Redis is a data structure server. At its core, Redis provides a collection of native data types that help you solve a wide variety of problems, from caching to queuing to...

Read more
Search
Upcoming Articles
Running Spark on Kubernetes with AKS
Data Lakehouse, The Best of Both Worlds
CAP Theorem, Does it still hold in modern days
Pandas API over Pyspark