menu
techminis

A naukri.com initiative

New

google-web-stories
Home

>

Big Data News

>

Introducin...
source image

Amazon

2w

read

135

img
dot

Image Credit: Amazon

Introducing AWS Glue 5.0 for Apache Spark

  • AWS Glue 5.0, the newest version of AWS Glue, has been launched, upgrading Spark engines to Apache Spark 3.5.2 and Python 3.11.
  • Glue 5.0 upgrades runtimes to Spark 3.5.2, Python 3.11, and Java 17 with performance and security improvements.
  • It updates support for open table format libraries to Apache Hudi 0.15.0, Apache Iceberg 1.6.1, and Delta Lake 3.2.1.
  • AWS Lake Formation Fine Grained Access Control is now supported with AWS Glue 5.0 through Spark-native fine-grained access control.
  • Glue 5.0 offers Amazon SageMaker Unified Studio support, Frameworks updated to Spark 3.5.2, Python 3.11, Scala 2.12.18, and Java 17.
  • The upgrade also allows AWS Glue to support S3 Access Grants and use requirements.txt to manage python library dependencies.
  • AWS Glue 5.0 introduces data lineage support in Amazon DataZone preview.
  • Glue 5.0 reduces costs by 22% and improves the price-performance of AWS Glue jobs by 32%.
  • Apache Spark 3.5.2 added many highlights and enhancements, including Apache Arrow-optimized Python UDF.
  • To start using Glue 5.0, you can access AWS Glue Studio or the AWS Glue Console, and use the AWS SDK or AWS CLI.

Read Full Article

like

8 Likes

share

1 Share

For uninterrupted reading, download the app