Wednesday, May 31, 2023

emr commands

 aws emr list-clusters --active


aws emr list-clusters --created-after CURRENT-TIME

aws emr describe-cluster --cluster-id CLUSTER-ID

 yarn application -list -appStates RUNNING

yarn application -list -appStates ALL

yarn application -list

yarn application -kill application_1686887631130_0088

yarn logs -applicationId  application_1686023660593_0058 > mrr.log

yarn application -status application_1686887631130_0099

yarn top



Architecting with Databricks Lakeflow — Scaling Ingestion and Transformation with Lakeflow

  The “Modern Data Stack” is undergoing a massive consolidation. The era of “fragmented best-of-breed” tools is being replaced by unified Da...