3 arrows

Get 50% Off ForgeRock Training Bundles

closeClose

Apache Spark Programming with Databricks

  • Tuition USD $1,500 GSA  $1,360.20
  • Reviews star_rate star_rate star_rate star_rate star_half 3095 Ratings
  • Course Code ASPD
  • Duration 2 days
  • Available Formats Classroom, Virtual

This course uses a case study driven approach to explore the fundamentals of Spark Programming with Databricks, including Spark architecture, the DataFrame API, Structured Streaming, and query optimization. You will start by visualizing and applying Spark architecture concepts in example scenarios. Then, you will explore and preprocess datasets by applying a variety of DataFrame transformations and actions. After ingesting data from various file formats, you will apply these preprocessing steps and write them to Delta tables. The case study then expands to stream from Delta in an analytics use case that demonstrates core Structured Streaming concepts. Lastly, you will explore the Spark UI and how query optimization, partitioning, and caching affect performance.

Skills Gained

  • Define the major components of Spark architecture and execution hierarchy
  • Describe how DataFrames are built, transformed, and evaluated in Spark
  • Apply the DataFrame API to explore, preprocess, join, and ingest data in Spark
  • Apply the Structured Streaming API to perform analytics on streaming data
  • Navigate the Spark UI and describe how the catalyst optimizer, partitioning, and caching affect Spark's execution performance

Who Can Benefit

  • SQL analyst
  • Data engineer
  • Data scientist
  • Machine learning engineer
  • Data architect

Prerequisites

  • Familiarity with basic SQL concepts (select, filter, groupby, join, etc)
  • Beginner programming experience with Python or Scala (syntax, conditions, loops, functions)

When does class start/end?

Classes begin promptly at 9:00 am, and typically end at 5:00 pm.

Does the course schedule include a Lunchbreak?

Lunch is normally an hour long and begins at noon. Coffee, tea, hot chocolate and juice are available all day in the kitchen. Fruit, muffins and bagels are served each morning. There are numerous restaurants near each of our centers, and some popular ones are indicated on the Area Map in the Student Welcome Handbooks - these can be picked up in the lobby or requested from one of our ExitCertified staff.

How can someone reach me during class?

If someone should need to contact you while you are in class, please have them call the center telephone number and leave a message with the receptionist.

What languages are used to deliver training?

Most courses are conducted in English, unless otherwise specified. Some courses will have the word "FRENCH" marked in red beside the scheduled date(s) indicating the language of instruction.

What does GTR stand for?

GTR stands for Guaranteed to Run; if you see a course with this status, it means this event is confirmed to run. View our GTR page to see our full list of Guaranteed to Run courses.

Does ExitCertified deliver group training?

Yes, we provide training for groups, individuals and private on sites. View our group training page for more information.

Does ExitCertified deliver group training?

Yes, we provide training for groups, individuals, and private on sites. View our group training page for more information.

I thought this was a really cool experience. First time getting so much information crammed into two days.

The training and trainer were really brilliant. Very helpful and covered all the topics with real life examples.

Tech Data staffs experts for their training classes. I wish there were more labs offered and maybe even practice questions.

I had a good and comfortable remote training experience. Look forward to more such trainings.

I have had three AWS training classes with ExitCertified and I have been extremely satisfied with every class. They presented the information and architecture in a very logical manner that made it easier for me to learn.

17 options available

undo
  • May 13, 2021 May 14, 2021 (2 days) GTR
    Location
    iMVP
    Language
    English
    Time
    9:00AM 6:00PM EDT
    Enroll
    Enroll
  • Jun 6, 2021 Jun 8, 2021 (3 days)
    Location
    Edison, NJ
    Language
    English
    Time
    3:00PM 12:00AM PDT
    Enroll
    Enroll
  • Jun 6, 2021 Jun 8, 2021 (3 days)
    Location
    iMVP
    Language
    English
    Time
    6:00PM 3:00AM EDT
    Enroll
    Enroll
  • Jun 7, 2021 Jun 8, 2021 (2 days) GTR
    Location
    iMVP
    Language
    English
    Time
    9:00AM 6:00PM EDT
    Enroll
    Enroll
  • Jun 28, 2021 Jun 29, 2021 (2 days) GTR
    Location
    iMVP
    Language
    English
    Time
    12:00PM 9:00PM EDT
    Enroll
    Enroll
  • Jul 22, 2021 Jul 23, 2021 (2 days)
    Location
    iMVP
    Language
    English
    Time
    9:00AM 6:00PM EDT
    Enroll
    Enroll
  • Jul 26, 2021 Jul 28, 2021 (3 days)
    Location
    iMVP
    Language
    English
    Time
    10:30PM 7:30AM EDT
    Enroll
    Enroll
  • Aug 9, 2021 Aug 10, 2021 (2 days)
    Location
    iMVP
    Language
    English
    Time
    12:00PM 9:00PM EDT
    Enroll
    Enroll
  • Aug 15, 2021 Aug 17, 2021 (3 days)
    Location
    iMVP
    Language
    English
    Time
    6:00PM 3:00AM EDT
    Enroll
    Enroll
  • Aug 23, 2021 Aug 24, 2021 (2 days)
    Location
    iMVP
    Language
    English
    Time
    9:00AM 6:00PM EDT
    Enroll
    Enroll
  • Sep 20, 2021 Sep 21, 2021 (2 days)
    Location
    iMVP
    Language
    English
    Time
    9:00AM 6:00PM EDT
    Enroll
    Enroll
  • Oct 7, 2021 Oct 8, 2021 (2 days)
    Location
    iMVP
    Language
    English
    Time
    12:00PM 9:00PM EDT
    Enroll
    Enroll
  • Oct 25, 2021 Oct 26, 2021 (2 days)
    Location
    iMVP
    Language
    English
    Time
    9:00AM 6:00PM EDT
    Enroll
    Enroll
  • Nov 15, 2021 Nov 16, 2021 (2 days)
    Location
    iMVP
    Language
    English
    Time
    9:00AM 6:00PM EST
    Enroll
    Enroll
  • Nov 28, 2021 Nov 30, 2021 (3 days)
    Location
    iMVP
    Language
    English
    Time
    9:30PM 6:30AM EST
    Enroll
    Enroll
Contact Us 1-800-803-3948
Contact Us
FAQ Get immediate answers to our most frequently asked qestions. View FAQs arrow_forward