tags: SparkSpark MLRun Arbitrary Command on YarnDocker-based Hadoop/Spark/Hive OrchestrationApache Polaris and Apache IcebergApache Spark