Data Engineering | Perardua Consultinghttps://www.perarduaconsulting.com/blog/tags/data-engineering/page/2 https://static.wixstatic.com/media/5584dc_9de4690541404b9b980acea3d27a8cba~mv2.jpg 2/3

top of page

data center

data center

Scalable Data Engineering for IT Success

Data Engineering

Aug 7, 20254 min read

Data Lake and Data

Data Lake and Data

Comparing Key Differences Between Databricks and Snowflake for Your Data Needs

Aug 6, 20255 min read

columnar formats

columnar formats

ORC vs Parquet which file format flexes harder in the data storage showdown

Data Infrastructure

Jul 24, 20254 min read

cloud

cloud

Comparing Apache Parquet, ORC, and JSON File Formats for Your Data Processing

Data Infrastructure

Jul 8, 20254 min read

Spark, Hive, & Hadoop

Spark, Hive, & Hadoop

Apache Iceberg, Hadoop, & Hive: Open your Datalake (Lakehouse) -> Part II

Data Infrastructure

Jun 24, 20257 min read

Data Vault Hubs, Satellites, and Links

Data Vault Hubs, Satellites, and Links

Data Vault Modeling Design Uses

Data Infrastructure

May 2, 20259 min read

How to Leverage Python Dask for Scalable Data Processing and Analysis

How to Leverage Python Dask for Scalable Data Processing and Analysis

How to Leverage Python Dask for Scalable Data Processing and Analysis

Data Infrastructure

Apr 25, 20257 min read

Apache Spark Logon on screen

Apache Spark Logon on screen

Mastering Aggregations with Apache Spark DataFrames and Spark SQL in Scala, Python, and SQL

Data Infrastructure

Apr 24, 20254 min read

Shuffling

Shuffling

How I Optimized Apache Spark Jobs to Prevent Excessive Shuffling

Data Infrastructure

Apr 24, 20253 min read

Data Disks

Data Disks

How I Optimize Data Access for Apache Spark RDD

Data Engineering

Apr 24, 20253 min read

HDF5 data storage with graph

HDF5 data storage with graph

Understanding HDF5 The Versatile Data Format Explained with Examples

Apr 22, 20254 min read

Apache Iceberg and HDF5

Apache Iceberg and HDF5

Exploring Apache Iceberg and HDF5 Use Cases in Modern Data Management

Apr 22, 20254 min read

Unlocking the Potential of Apache Iceberg in Cloud-Based Data Engineering Strategies

Unlocking the Potential of Apache Iceberg in Cloud-Based Data Engineering Strategies

Unlocking the Potential of Apache Iceberg in Cloud-Based Data Engineering Strategies

Apr 22, 20254 min read

Harnessing the Power of Dask for Scalable Data Science Workflows

Harnessing the Power of Dask for Scalable Data Science Workflows

Harnessing the Power of Dask for Scalable Data Science Workflows

Apr 22, 20255 min read

ETF, Mutual Fund Holdings

ETF, Mutual Fund Holdings

ETF & Mutual Funds Portfolios: Infrastructure

Data Infrastructure

Apr 19, 202512 min read

Spark

Spark

Apache Spark Best Practices: Optimize Your Data Processing

Data Engineering

Apr 16, 20254 min read

data engineering

data engineering

Gathering Data Statistics Using PySpark: A Comparative Analysis with Scala

Apr 15, 20255 min read

Portfolio Holdings Data: Analytics Content Retrieval

Portfolio Holdings Data: Analytics Content Retrieval

Portfolio Holdings Data: Analytics Content Retrieval

Portfolio Holdings

Apr 15, 20252 min read

City Roadway

City Roadway

Harnessing the Dask Python Library for Parallel Computing

Data Architecture

Apr 15, 20255 min read

Data Architecture

Data Architecture

Benefits of Data Architecture and Its Impact on Company Costs

Data Architecture

Apr 15, 20255 min read

bottom of page