Introducing .NET for Apache Spark

Introducing .NET for Apache Spark
PDF, ePUB
  • eBook:
    Introducing .NET for Apache Spark: Distributed Processing for Massive Datasets
  • Author:
    Ed Elliott
  • Edition:
    -
  • Categories:
  • Data:
    May 9, 2021
  • ISBN:
    1484269918
  • ISBN-13:
    9781484269916
  • Language:
    English
  • Pages:
    277 pages
  • Format:
    PDF, ePUB

Book Description
Get started using Apache Spark via C# or F# and the .NET for Apache Spark bindings. This book is an introduction to both Apache Spark and the .NET bindings. Readers new to Apache Spark will get up to speed quickly using Spark for data processing tasks performed against large and very large datasets. You will learn how to combine your knowledge of .NET with Apache Spark to bring massive computing power to bear by distributed processing of extremely large datasets across multiple servers.

This book covers how to get a local instance of Apache Spark running on your developer machine and shows you how to create your first .NET program that uses the Microsoft .NET bindings for Apache Spark. Techniques shown in the book allow you to use Apache Spark to distribute your data processing tasks over multiple compute nodes. You will learn to process data using both batch mode and streaming mode so you can make the right choice depending on whether you are processing an existing dataset or are working against new records in micro-batches as they arrive. The goal of the book is leave you comfortable in bringing the power of Apache Spark to your favorite .NET language. 

What You Will Learn
  • Install and configure Spark .NET on Windows, Linux, and macOS 
  • Write Apache Spark programs in C# and F# using the .NET bindings
  • Access and invoke the Apache Spark APIs from .NET with the same high performance as Python, Scala, and R
  • Encapsulate functionality in user-defined functions
  • Transform and aggregate large datasets 
  • Execute SQL queries against files through Apache Hive
  • Distribute processing of large datasets across multiple servers
  • Create your own batch, streaming, and machine learning programs
Who This Book Is For
.NET developers who want to perform big data processing without having to migrate to Python, Scala, or R; and Apache Spark developers who want to run natively on .NET and take advantage of the C# and F# ecosystems

Content

Part I: Getting Started
Chapter 1: Understanding Apache Spark
Chapter 2: Setting Up Spark
Chapter 3: Programming with .NET for Apache Spark

Part II: The APIs
Chapter 4: User-Defined Functions
Chapter 5: The DataFrame API
Chapter 6: Spark SQL and Hive Tables
Chapter 7: Spark Machine Learning API

Part III: Examples
Chapter 8: Batch Mode Processing
Chapter 9: Structured Streaming
Chapter 10: Troubleshooting
Chapter 11: Delta Lake

Download Introducing .NET for Apache Spark: Distributed Processing for Massive Datasets PDF or ePUB format free


Free sample

Download in .PDF format



Download in .ePUB format


Add comments
Прокомментировать
Введите код с картинки:*
Кликните на изображение чтобы обновить код, если он неразборчив
Copyright © 2019