Skip to the content

RISHI RAJ S GERA

SVP Edtech Services, Magic Edtech

RISHI RAJ S GERA

SVP Edtech Services, Magic Edtech

  • Home
  • My Profile
    • Know your Consultant
    • Technical Skills
    • My Certifications
  • Expertise
    • Education Advisory Services
    • Digital Transformation
      • Platform Engineering
      • Digital Content – Micro Learning Instruction
  • Resources
    • News and Trends

Amazon EMR on EKS now supports Spark SQL through the StartJobRun API

Advanced learning
    • By
    • No Comments on Amazon EMR on EKS now supports Spark SQL through the StartJobRun API
    • September 19, 2022

Amazon EMR on EKS now supports Spark SQL through the StartJobRun API

We are excited to announce that Amazon EMR on EKS release 6.7.0 and onwards includes the ability to run Apache Spark SQL scripts through the StartJobRun API. Spark SQL is a Spark module for structured data processing. Unlike the Spark DataFrame API, Spark SQL interfaces provide Spark with more information about the structure of both the data and computation being performed. Internally, Spark SQL uses this extra information to perform additional optimizations. With this release, you can run Spark SQL queries and Spark SQL-based ETL pipelines directly through Amazon EMR on EKS’ StartJobRun API.

Share this:

  • Click to share on Twitter (Opens in new window)

Related

Leave a Reply Cancel reply

Follow Blog via Email

Enter your email address to follow this blog and receive notifications of new posts by email.

Generated by Feedzy
Back To Top