Remove workspace templates
article thumbnail

Run interactive workloads on Amazon EMR Serverless from Amazon EMR Studio

AWS Big Data

You can now use EMR Serverless applications as the compute, in addition to Amazon EMR on EC2 clusters and Amazon EMR on EKS virtual clusters, to run JupyterLab notebooks from EMR Studio Workspaces. If you deployed the prerequisite resources using the provided CloudFormation template, use the password that you provided as an input parameter.

article thumbnail

Use your corporate identities for analytics with Amazon EMR and AWS IAM Identity Center

AWS Big Data

AWS Service Catalog provides a product template to create EMR clusters. Create a Service Catalog product template to create the EMR clusters. For S3 location for Workspace storage , select Select existing location and enter an existing S3 bucket (if you have one). EMR Studio is an IDE for users to build and run applications.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Monitor Apache HBase on Amazon EMR using Amazon Managed Service for Prometheus and Amazon Managed Grafana

AWS Big Data

A Prometheus server running on an Amazon Elastic Compute Cloud (Amazon EC2) instance collects these metrics and remote writes to an Amazon Managed Service for Prometheus workspace. We then use Amazon Managed Grafana to create dashboards and view these metrics using an Amazon Managed Service for Prometheus workspace as its data source.

article thumbnail

Use IAM runtime roles with Amazon EMR Studio Workspaces and AWS Lake Formation for cross-account fine-grained access control

AWS Big Data

EMR Studio provides fully managed Jupyter notebooks and tools such as Spark UI and YARN Timeline Server via EMR Studio Workspaces. You can attach an EMR Studio Workspace to an EMR cluster, and use the compute power of the EMR cluster and run data science jobs on the cluster. This runtime role scopes down access at the Workspace level.

article thumbnail

Use Amazon EMR with S3 Access Grants to scale Spark access to Amazon S3

AWS Big Data

Then, we’ll use the AWS CloudFormation template below to create an Amazon EMR on Amazon Elastic Compute Cloud ( Amazon EC2 ) Cluster, an EMR Serverless application and two different job roles. An Amazon EMR Studio where users can login and create workspace notebooks with the EMR Serverless application. df.write.format("csv").mode("overwrite").save("s3://

article thumbnail

Enhance monitoring and debugging for AWS Glue jobs using new job observability metrics: Part 2

AWS Big Data

Implement the solution Complete following steps to set up the solution: Set up an Amazon Managed Grafana workspace. Sign in to your workspace. The next step is to prepare the JSON template file. Download the Grafana template. The Amazon Managed Grafana pricing model depends on an active user license per workspace.

Metrics 96
article thumbnail

Simplify and speed up Apache Spark applications on Amazon Redshift data with Amazon Redshift integration for Apache Spark

AWS Big Data

Use this template when launching a new CloudFormation stack. In the navigation pane, choose Workspaces. Choose Create Workspace. Provide a name for the Workspace, for instance redshift-spark. Expand the Advanced configuration section and select Attach Workspace to an EMR cluster. Choose Create Workspace.